Method for detecting region of anatomical structure, and ultrasound imaging device therefor

Abstract

Provided are an ultrasound imaging device and a method for detecting a region of an anatomical structure. The ultrasound imaging device comprises: an ultrasonic transmission / reception module; a memory storing instructions; and at least one processor comprising a processing circuit. The instructions may be executed individually or collectively by the at least one processor so as to instruct the ultrasound imaging device to: acquire a three-dimensional volume of an object including a site of interest through the ultrasonic transmission / reception module; obtain a rendered image by rendering the three-dimensional volume in a reference rendering direction; generate a mask image indicating the location of the site of interest on the rendered image by projecting the volume of the site of interest in the three-dimensional volume in the reference rendering direction; on the basis of the rendered image and the mask image, determine a region on the rendered image of a structure formed by the site of interest; and display the region of the structure on the rendered image.

Description

Method for detecting regions of anatomical structures and ultrasound imaging device according to the same

[0001] The present disclosure relates to an ultrasound imaging device for detecting a region of an anatomical structure, a method for the ultrasound imaging device to detect a region of an anatomical structure, and a computer-readable recording medium storing a computer program for performing the method.

[0002] Recently, various medical imaging devices are widely used in the medical field to visualize and acquire information about human biological tissues for the purpose of early diagnosis of various diseases or surgery. Representative examples of such medical imaging devices include ultrasound imaging devices, CT (Computed Tomography) devices, and MRI (Magnetic Resonance Imaging) devices.

[0003] An ultrasound imaging device is a device that irradiates an object with an ultrasound signal generated from a transducer of a probe and receives information on the signal reflected from the object to non-invasively acquire at least one image of an internal area of ​​the object (e.g., soft tissue or blood flow). Ultrasound imaging devices can be used for medical purposes, such as observing the inside of an object, detecting foreign substances, and measuring injuries. Such ultrasound imaging devices are widely used in conjunction with other imaging devices because they have the advantages of being safe, having higher stability compared to imaging devices using X-rays, enabling real-time image display, and eliminating radiation exposure.

[0004] One aspect of the present disclosure may provide an ultrasonic imaging device. The ultrasonic imaging device may include an ultrasonic transceiver module, a memory for storing instructions, and at least one processor including a processing circuit. When instructions are executed individually or collectively by at least one processor, the ultrasonic imaging device may, through the ultrasonic transceiver module, acquire a three-dimensional volume for an object including a region of interest, render the three-dimensional volume in a reference rendering direction to acquire a rendering image, project the volume of the region of interest within the three-dimensional volume in the reference rendering direction to generate a mask image indicating the location of the region of interest on the rendering image, determine a region of a structure formed by the region of interest on the rendering image based on the rendering image and the mask image, and display the region of the structure on the rendering image.

[0005] One aspect of the present disclosure may provide a method for detecting a region of an anatomical structure. A method for detecting a region of an anatomical structure may include the steps of: acquiring a three-dimensional volume for an object including a region of interest; rendering the three-dimensional volume in a reference rendering direction to acquire a rendering image; projecting the volume of the region of interest within the three-dimensional volume in the reference rendering direction to generate a mask image indicating the location of the region of interest on the rendering image; determining a region of a structure formed by the region of interest on the rendering image based on the rendering image and the mask image; and displaying a region of the structure on the rendering image.

[0006] One aspect of the present disclosure may provide a computer-readable recording medium having a program recorded thereon for performing a method of detecting regions of anatomical structures on a computer.

[0007] The present disclosure can be easily understood from the combination of the following detailed description and the accompanying drawings, where reference numerals denote structural elements.

[0008] FIGS. 1a and FIGS. 1b are block diagrams illustrating the configuration of an ultrasound imaging system according to one embodiment of the present disclosure.

[0009] FIGS. 2a, FIGS. 2b, FIGS. 2c, and FIGS. 2d are drawings illustrating an ultrasound imaging system according to one embodiment of the present disclosure.

[0010] FIG. 3 illustrates a method for an ultrasound imaging device to acquire an area of ​​an opening formed by a muscle of interest, according to one embodiment of the present disclosure.

[0011] FIG. 4 illustrates a method for an ultrasonic imaging device to acquire an area of ​​an opening formed by a region of interest using a mask image of the region of interest, according to one embodiment of the present disclosure.

[0012] FIG. 5 illustrates a method for an ultrasonic imaging device to determine a region of a structure within an object according to one embodiment of the present disclosure.

[0013] FIG. 6 illustrates a method for an ultrasonic imaging device to acquire location information of an opening formed by a region of interest using an artificial intelligence model, according to one embodiment of the present disclosure.

[0014] FIG. 7 illustrates a method for an ultrasound imaging device to acquire a hiatus region of the levator ani muscle using an artificial intelligence model, according to one embodiment of the present disclosure.

[0015] FIG. 8 illustrates a method for an ultrasound imaging device to acquire the position of the urethra according to one embodiment of the present disclosure.

[0016] FIG. 9 illustrates a method for an ultrasound imaging device to display the location of the levator ani hiatus region and the urethra according to one embodiment of the present disclosure.

[0017] FIG. 10 is a flowchart of a method for an ultrasound imaging device to display a region of interest on a rendered image according to one embodiment of the present disclosure.

[0018] FIG. 11 illustrates a method for an ultrasonic imaging device to display an image of a region of interest on a rendering image of an object, according to one embodiment of the present disclosure.

[0019] FIG. 12 illustrates a method for an ultrasound imaging device to display information regarding damage to a region of interest, according to one embodiment of the present disclosure.

[0020] FIG. 13 illustrates a method for an ultrasound imaging device to display a damaged area of ​​a region of interest on a cross-sectional image of a region of interest, according to one embodiment of the present disclosure.

[0021] In the present disclosure, the expression “at least one of a, b, or c” may refer to “a”, “b”, “c”, “a and b”, “a and c”, “b and c”, “a, b, and c all”, or variations thereof.

[0022] Embodiments of the present disclosure are described below in detail with reference to the attached drawings so that those skilled in the art can easily implement them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. Furthermore, in order to clearly explain the present disclosure in the drawings, parts unrelated to the explanation have been omitted, and similar parts throughout the specification are denoted by similar reference numerals.

[0023] The terms used in this disclosure are described in their current, general form considering the functions mentioned herein; however, they may refer to various other terms depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Accordingly, the terms used in this disclosure should not be interpreted solely by their names, but should be interpreted based on the meaning of the terms and the overall content of this disclosure.

[0024] Additionally, terms such as "first," "second," etc., may be used to describe various components, but the components should not be limited by these terms. These terms are used for the purpose of distinguishing one component from another.

[0025] Furthermore, the terms used in this disclosure are used merely to describe specific embodiments and are not intended to limit this disclosure. Singular expressions include a plural meaning unless the context clearly indicates a singular meaning. Additionally, throughout the specification, when a part is described as being "connected" to another part, this includes not only cases where they are "directly connected," but also cases where they are "electrically connected" with other elements interposed between them. Furthermore, when a part is described as "including" a component, this means that, unless specifically stated otherwise, it does not exclude other components but may include additional components.

[0026] This specification does not describe all elements of the embodiments, and general content in the art to which the invention pertains or content that overlaps with the embodiments is omitted. The terms 'module' or 'unit' as used in this specification may be implemented as one or more combinations of software, hardware, or firmware, and depending on the embodiments, multiple 'modules' or 'units' may be implemented as a single element, or a single 'module' or 'unit' may include multiple elements.

[0027] Phrases such as "in some embodiments" or "in one embodiment" appearing in various places in this specification do not necessarily refer to the same embodiment.

[0028] In the present disclosure, 'object' refers to the subject of imaging and may include a person, an animal, or a part thereof. For example, the object may include a part of the body (such as an organ or tissue) or a phantom.

[0029] In this disclosure, "ultrasonic image" refers to an image of an object that is transmitted to an object and is generated or processed based on an ultrasonic signal reflected from the object.

[0030] Referring to FIGS. 1a and FIGS. 1b, the ultrasound imaging system (100) may include a probe (20) and an ultrasound imaging device (40).

[0031] The ultrasound imaging device (40) can be implemented as a cart type as well as a portable type. Examples of portable ultrasound imaging devices may include, but are not limited to, a probe, a smartphone including an application, a laptop computer, a PDA (Personal Digital Assistant), or a tablet PC. The ultrasound imaging device (40) can also be implemented as a probe-integrated type.

[0032] The probe (20) may include a wired probe connected to the ultrasonic imaging device (40) via a wire and communicating with the ultrasonic imaging device (40) via a wire, a wireless probe connected to the ultrasonic imaging device (40) via a wireless connection and communicating with the ultrasonic imaging device (40) via a wireless connection, and / or a hybrid probe connected to the ultrasonic imaging device (40) via a wired or wireless connection and communicating with the ultrasonic imaging device (40) via a wired or wireless connection.

[0033] According to various embodiments of the present disclosure, as shown in FIG. 1a, the ultrasonic imaging device (40) may include an ultrasonic transceiver module (110), and as shown in FIG. 1b, the probe (20) may include an ultrasonic transceiver module (110). According to various embodiments of the present disclosure, it is also possible for both the ultrasonic imaging device (40) and the probe (20) to include an ultrasonic transceiver module (110).

[0034] According to various embodiments of the present disclosure, the probe (20) may further include at least one of an image processor (130), a display (140), or an input interface (170), or a combination thereof. In the present disclosure, the description of the ultrasonic transceiver module (110), image processor (130), display (140), or input interface (170) included in the ultrasonic imaging device (40) may also apply to the ultrasonic transceiver module (110), image processor (130), display (140), or input interface (170) included in the probe (20).

[0035] FIG. 1a is a block diagram showing the configuration of an ultrasound imaging system (100) when the probe (20) is a wired probe or a hybrid probe.

[0036] The probe (20) may include a plurality of transducers. The plurality of transducers may be arranged in a predetermined array to be implemented as a transducer array. The transducer array may correspond to a one-dimensional (1D) array or a two-dimensional (2D) array. The plurality of transducers may transmit an ultrasonic signal to a target (10) according to a transmission signal applied from a transmission module (113). The plurality of transducers may receive an ultrasonic signal (echo signal) reflected from the target (10) to form a reception signal. Additionally, the probe (20) may be implemented as an integral unit with the ultrasonic imaging device (40) or as a separate unit connected to the ultrasonic imaging device (40) via a wire. Additionally, the ultrasonic imaging device (40) may be connected to one or a plurality of probes (20) depending on the implementation type.

[0037] If the probe (20) is a wired probe or a hybrid probe, it may include a cable and a connector that can be connected to the connector of the ultrasound imaging device (40).

[0038] A probe (20) according to one embodiment of the present disclosure may be implemented as a two-dimensional probe. When the probe (20) is implemented as a two-dimensional probe, a plurality of transducers included in the probe (20) may be arranged in two dimensions to form a two-dimensional transducer array.

[0039] For example, a two-dimensional transducer array may be in the form of including a plurality of sub-arrays, each comprising a plurality of transducers arranged in a first direction, in a second direction different from the first direction.

[0040] In addition, when the probe (20) according to one embodiment of the present disclosure is implemented as a two-dimensional probe, the ultrasonic transceiver module (110) may include at least one of an analog beamformer or a digital beamformer. In addition, according to one embodiment of the present disclosure, the two-dimensional probe may include at least one of an analog beamformer or a digital beamformer or a combination thereof, depending on the implementation form.

[0041] The processor (120) controls the transmission module (113) to form a transmission signal to be applied to each transducer by taking into account the positions and focal points of the plurality of transducers included in the probe (20).

[0042] The processor (120) can control the receiving module (115) to generate ultrasonic data by converting the received signal received from the probe (20) into analog-to-digital and summing the digitally converted received signal, taking into account the positions and focusing points of the plurality of transducers.

[0043] When the probe (20) is implemented as a two-dimensional probe, the processor (120) can calculate a time delay value for digital beamforming for each of the multiple sub-arrays included in the two-dimensional transducer array. Additionally, the processor (120) can calculate a time delay value for analog beamforming for each of the transducers included in any one of the multiple sub-arrays. The processor (120) can control an analog beamformer and a digital beamformer to form a transmission signal to be applied to each of the multiple transducers according to the time delay value for analog beamforming and the time delay value for digital beamforming. Additionally, the processor (120) can control an analog beamformer to sum the signals received from the multiple transducers according to the time delay value for analog beamforming for each sub-array. Additionally, the processor (120) can control an ultrasonic transceiver module (110) to convert the signals summed for each sub-array into analog-to-digital. Additionally, the processor (120) can control the digital beamformer to generate ultrasonic data by summing the digitally converted signals according to a time delay value for digital beamforming.

[0044] The image processor (130) uses the generated ultrasound data to generate or process an ultrasound image.

[0045] The display (140) can display the generated ultrasound image and various information processed by the ultrasound imaging device (40) or the probe (20). The probe (20) or the ultrasound imaging device (40) may include one or more displays (140) depending on the implementation form. Additionally, the display (140) may include a touch panel or a touch screen. Additionally, the display (140) may include a flexible display.

[0046] The processor (120) can control the overall operation of the ultrasound imaging device (40) and control the operation of the components of the ultrasound imaging device (40). The processor (120) can perform or control various operations or functions of the ultrasound imaging device (40) by executing programs or instructions stored in memory (150). Additionally, the processor (120) can control the operation of the ultrasound imaging device (40) by receiving a control signal from an input interface (170) or an external device.

[0047] The ultrasound imaging device (40) includes a communication module (160) and can be connected to and communicate with an external device (e.g., probe (20), server, medical device, portable device (smartphone, tablet PC, wearable device, etc.)) through the communication module (160).

[0048] The communication module (160) may include one or more components that enable communication with an external device. The communication module (160) may include, for example, at least one of a short-range communication module, a wired communication module, or a wireless communication module.

[0049] The communication module (160) can receive control signals or data from an external device. The processor (120) can control the operation of the ultrasonic imaging device (40) according to the control signals received through the communication module (160). Additionally, it is possible for the processor (120) to transmit control signals to an external device through the communication module (160) and control the external device according to the transmitted control signals. The external device may operate according to the control signals received from the ultrasonic imaging device (40) or process data received from the ultrasonic imaging device (40).

[0050] A program or application related to the ultrasonic imaging device (40) may be installed on an external device. The program or application installed on the external device may control the ultrasonic imaging device (40) or operate according to a control signal or data received from the ultrasonic imaging device (40).

[0051] An external device may receive or download a program or application related to the ultrasound imaging device (40) from the ultrasound imaging device (40), probe (20), or server, and install and execute the program or application on the external device. The ultrasound imaging device (40), probe (20), or server providing the program or application may include a recording medium that stores instructions, commands, installation files, executable files, or related data of the said program or application. It is also possible for the external device to be sold with the program or application installed.

[0052] The memory (150) can store various data or programs for driving and controlling the ultrasonic imaging device (40), input / output ultrasonic data, ultrasonic images, etc.

[0053] The input interface (170) can receive user input for controlling the ultrasonic imaging device (40). For example, user input may include, but is not limited to, inputs such as operating a button, keypad, mouse, trackball, jog switch, knob, etc., inputs such as touching a touchpad or touchscreen, voice input, motion input, biometric information input (e.g., iris recognition, fingerprint recognition, etc.).

[0054] At least one processor (120) may include processing circuitry. By executing instructions in memory (150) individually or collectively by at least one processor (120), the ultrasound imaging device (40) can perform embodiments of the present disclosure.

[0055] At least one processor (120) can obtain a three-dimensional volume of an object including a region of interest through an ultrasonic transceiver module (110).

[0056] At least one processor (120) can obtain a rendered image by rendering a three-dimensional volume in a reference rendering direction.

[0057] At least one processor (120) can project the volume of the region of interest within a three-dimensional volume in a reference rendering direction to generate a mask image representing the location of the region of interest on the rendered image.

[0058] At least one processor (120) can determine a region on the rendering image of a structure formed by a region of interest based on the rendering image and the mask image.

[0059] At least one processor (120) can display an area of ​​the structure on a rendered image through a display (140).

[0060] At least one processor (120) inputs a rendering image and a mask image as input data for an artificial intelligence model, and can obtain information regarding the region of a structure on the rendering image from the artificial intelligence model.

[0061] At least one processor (120) can convert the pixel values ​​of the mask image into colors to generate a heatmap image.

[0062] At least one processor (120) can display a heatmap image on a rendered image through a display (140).

[0063] At least one processor (120) can calculate at least one of the cross-sectional area or diameter of the structure. At least one processor (120) can display at least one of the calculated cross-sectional area or diameter through a display (140).

[0064] At least one processor (120) can determine the position of the urethra on the rendered image by projecting the volume of the urethra within the three-dimensional volume in a reference rendering direction. At least one processor (120) can display an image indicating the determined position of the urethra on the rendered image through a display (140).

[0065] At least one processor (120) can identify a damaged area of ​​the area of ​​interest based on the volume of the area of ​​interest. At least one processor (120) can display an image indicating the damaged area on a rendered image through a display (140) based on the location of the identified damaged area.

[0066] At least one processor (120) can identify a damaged area of ​​the area of ​​interest based on the volume of the area of ​​interest. At least one processor (120) can display an image showing the damaged area on a cross-sectional image of a three-dimensional volume through a display (140) based on the location of the identified damaged area.

[0067] At least one processor (120) can divide a three-dimensional volume into multiple regions including a region of interest. At least one processor (120) can align the three-dimensional volume based on the divided multiple regions. At least one processor (120) can obtain a rendered image by rendering the aligned three-dimensional volume in a reference rendering direction. At least one processor (120) can generate a mask image by projecting the volume of the region of interest within the aligned three-dimensional volume in the reference rendering direction.

[0068] FIG. 1b illustrates a control block diagram of an ultrasound imaging system (100) when the probe (20) is a wireless probe or a hybrid probe.

[0069] According to various embodiments of the present disclosure, the ultrasonic imaging device (40) illustrated in FIG. 1b may be replaced with the ultrasonic imaging device (40) described with reference to FIG. 1a.

[0070] According to various embodiments of the present disclosure, the probe (20) illustrated in FIG. 1a may be replaced with the probe (20) described with reference to FIG. 1b.

[0071] The probe (20) may include a display (112), a transmitting module (113), a battery (114), a transducer (117), a charging module (116), a receiving module (115), an input interface (109), a processor (118), and a communication module (119). Although FIG. 1b shows the probe (20) including both the transmitting module (113) and the receiving module (115), depending on the implementation, the probe (20) may include only some of the components of the transmitting module (113) and the receiving module (115), and some of the components of the transmitting module (113) and the receiving module (115) may be included in the ultrasound imaging device (40). Additionally, according to one embodiment of the present disclosure, the probe (20) may further include an image processor (130).

[0072] The transducer (117) may include a plurality of transducers. The plurality of transducers may be arranged in a predetermined array to form a transducer array. The transducer array may correspond to a one-dimensional (1D) array or a two-dimensional (2D) array. The plurality of transducers may transmit an ultrasonic signal to a target (10) according to a transmission signal applied from a transmission module (113). Additionally, the plurality of transducers may receive an ultrasonic signal reflected from the target (10) and form or generate an electrical reception signal.

[0073] The charging module (116) can charge the battery (114). The charging module (116) can receive power from an external source. According to one embodiment of the present disclosure, the charging module (116) can receive power wirelessly. Additionally, according to one embodiment of the present disclosure, the charging module (116) can receive power via a wired connection. The charging module (116) can transfer the received power to the battery (114).

[0074] The processor (118) controls the transmission module (113) to generate or form a transmission signal to be applied to each of the multiple transducers by taking into account the positions and focal points of the multiple transducers.

[0075] The processor (118) controls the receiving module (115) to generate ultrasound data by converting the received signal received from the transducer (117) into analog-to-digital and summing the digitally converted received signal, taking into account the positions and focusing points of the plurality of transducers. According to one embodiment of the present disclosure, if the probe (20) includes an image processor (130), an ultrasound image can be generated using the generated ultrasound data.

[0076] When the probe (20) is implemented as a two-dimensional probe, the processor (118) can calculate a time delay value for digital beamforming for each of the multiple sub-arrays included in the two-dimensional transducer array. Additionally, the processor (118) can calculate a time delay value for analog beamforming for each of the transducers included in any one of the multiple sub-arrays. The processor (118) can control the analog beamformer and the digital beamformer to form a transmission signal to be applied to each of the multiple transducers according to the time delay value for analog beamforming and the time delay value for digital beamforming. Additionally, the processor (118) can control the analog beamformer to sum the signals received from the multiple transducers according to the time delay value for analog beamforming for each sub-array. Additionally, the processor (118) can control the ultrasonic transceiver module (110) to convert the signals summed for each sub-array into analog-to-digital. Additionally, the processor (118) can control the digital beamformer to generate ultrasonic data by summing the digitally converted signals according to a time delay value for digital beamforming.

[0077] The processor (118) can control the overall operation of the probe (20) and the operation of the components of the probe (20). The processor (118) can perform or control various operations or functions of the probe (20) by executing programs or instructions stored in memory (111). Additionally, the processor (118) can control the operation of the probe (20) by receiving a control signal from the input interface (109) of the probe (20) or an external device (e.g., an ultrasound imaging device (40)). Additionally, the processor (118) can control the operation of the probe (20) by receiving a control signal from the input interface (109) or an external device. The input interface (109) can receive user input for controlling the probe (20). For example, user input may include, but is not limited to, inputs involving the operation of buttons, keypads, mice, trackballs, jog switches, knobs, etc., inputs involving the touch of a touchpad or touchscreen, voice inputs, motion inputs, and biometric information inputs (e.g., iris recognition, fingerprint recognition, etc.).

[0078] The display (112) can display an ultrasound image generated by the probe (20), an ultrasound image generated by processing ultrasound data generated by the probe (20), an ultrasound image received from the ultrasound imaging device (40), or various information processed by the ultrasound imaging system (100). Additionally, the display (112) can further display status information of the probe (20). The status information of the probe (20) may include at least one of device information of the probe (20), battery status information of the probe (20), frequency band information of the probe (20), output information of the probe (20), information on whether there is an abnormality of the probe (20), setting information of the probe (20), or temperature information of the probe (20).

[0079] The probe (20) may include one or more displays (112) depending on the implementation form. Additionally, the displays (112) may include a touch panel or a touch screen. Additionally, the displays (112) may include a flexible display.

[0080] The communication module (119) can wirelessly transmit generated ultrasound data or ultrasound images to the ultrasound imaging device (40) via a wireless network. Additionally, the communication module (119) can receive control signals and data from the ultrasound imaging device (40).

[0081] The ultrasonic imaging device (40) can receive ultrasonic data or ultrasonic images from the probe (20).

[0082] In one embodiment of the present disclosure, when the probe (20) includes an image processor (130) capable of generating an ultrasound image using ultrasound data, the probe (20) can transmit ultrasound data or an ultrasound image generated by the image processor (130) to an ultrasound imaging device (40).

[0083] In one embodiment of the present disclosure, if the probe (20) does not include an image processor (130) capable of generating an ultrasound image using ultrasound data, the probe (20) can transmit ultrasound data to an ultrasound imaging device (40). The ultrasound data may include ultrasound raw data, and the ultrasound image may mean ultrasound image data.

[0084] The ultrasonic imaging device (40) may include a processor (120), an image processor (130), a display (140), a memory (150), a communication module (160), and an input interface (170).

[0085] The image processor (130) generates or processes an ultrasound image using ultrasound data received from the probe (20).

[0086] The display (140) can display an ultrasound image received from the probe (20), an ultrasound image generated by processing ultrasound data received from the probe (20), or various information processed by the ultrasound imaging system (100). The ultrasound imaging device (40) may include one or a plurality of displays (140) depending on the implementation form. Additionally, the display (140) may include a touch panel or a touch screen. Additionally, the display (140) may include a flexible display.

[0087] The processor (120) can control the overall operation of the ultrasound imaging device (40) and control the operation of the components of the ultrasound imaging device (40). The processor (120) can execute a program or application stored in memory (150) to perform or control various operations or functions of the ultrasound imaging device (40). Additionally, the processor (120) can control the operation of the ultrasound imaging device (40) by receiving a control signal from an input interface (170) or an external device.

[0088] The ultrasound imaging device (40) includes a communication module (160) and can be connected to and communicate with an external device (e.g., probe (20), server, medical device, portable device (smartphone, tablet PC, wearable device, etc.)) through the communication module (160).

[0089] The communication module (160) may include one or more components that enable communication with an external device. The communication module (160) may include, for example, at least one of a short-range communication module, a wired communication module, or a wireless communication module.

[0090] The communication module (160) of the ultrasound imaging device (40) and the communication module (119) of the probe (20) may communicate using a network or may communicate using a short-range wireless communication method. For example, the communication module (160) of the ultrasound imaging device (40) and the communication module (119) of the probe (20) may communicate using any one of wireless data communication methods including Wireless LAN, Wi-Fi, Bluetooth, Zigbee, WFD (Wi-Fi Direct), infrared communication (IrDA, infrared Data Association), BLE (Bluetooth LowEnergy), NFC (Near Field Communication), Wibro (Wireless Broadband Internet), WiMAX (World Interoperability for Microwave Access), SWAP (Shared Wireless Access Protocol), WiGig (Wireless Gigabit Alliance), RF communication, or 60 GHz millimeter wave (mm Wave) short-range communication.

[0091] To this end, the communication module (160) of the ultrasound imaging device (40) and the communication module (119) of the probe (20) may include at least one of a Wireless LAN communication module, a Wi-Fi communication module, a Bluetooth communication module, a Zigbee communication module, a Wi-Fi Direct (WFD) communication module, an Infrared Data Association (IrDA) module, a Bluetooth LowEnergy (BLE) communication module, a Near Field Communication (NFC) communication module, a Wireless Broadband Internet (Wibro) communication module, a World Interoperability for Microwave Access (WiMAX) communication module, a Shared Wireless Access Protocol (SWAP) communication module, a Wireless Gigabit Alliance (WiGig) communication module, an RF communication module, or a 60 GHz millimeter wave (mm Wave) short-range communication module.

[0092] In one embodiment of the present disclosure, the probe (20) transmits device information (e.g., ID information) of the probe (20) to an ultrasound imaging device (40) using a first communication method (e.g., BLE) and can be wirelessly paired with the ultrasound imaging device (40). Additionally, the probe (20) can transmit ultrasound data and / or ultrasound images to the paired ultrasound imaging device (40).

[0093] The device information of the probe (20) may include various information related to the serial number, model name, or battery status of the probe (20).

[0094] The ultrasound imaging device (40) can receive device information (e.g., ID information) of the probe (20) from the probe (20) using a first communication method (e.g., BLE) and can be wirelessly paired with the probe (20). Additionally, the ultrasound imaging device (40) can transmit an activation signal to the paired probe (20) and receive ultrasound data and / or ultrasound images from the probe (20). At this time, the activation signal may include a signal for controlling the operation of the probe (20).

[0095] In one embodiment of the present disclosure, the probe (20) can transmit device information (e.g., ID information) of the probe (20) to an ultrasound imaging device (40) using a first communication method (e.g., BLE) and can be wirelessly paired with the ultrasound imaging device (40). Additionally, the probe (20) can transmit ultrasound data and / or ultrasound images to the ultrasound imaging device (40) paired by the first communication method using a second communication method (e.g., 60 GHz millimeter wave, Wi-Fi).

[0096] The ultrasound imaging device (40) can receive device information (e.g., ID information) of the probe (20) from the probe (20) using a first communication method (e.g., BLE) and can be wirelessly paired with the probe (20). Additionally, the ultrasound imaging device (40) can transmit an activation signal to the paired probe (20) and receive ultrasound data and / or ultrasound images from the probe (20) using a second communication method (e.g., 60 GHz millimeter wave, Wi-Fi).

[0097] According to one embodiment of the present disclosure, a first communication method used to pair a probe (20) and an ultrasonic imaging device (40) with each other may have a frequency band lower than the frequency band of a second communication method used to transmit ultrasonic data and / or ultrasonic images to the probe (20) and the ultrasonic imaging device (40).

[0098] The display (140) of the ultrasound imaging device (40) can display UIs (User Interfaces) indicating device information of the probe (20). For example, the display (140) can display identification information of the wireless ultrasound probe (20), a pairing method indicating a method of pairing with the probe (20), a data communication status between the probe (20) and the ultrasound imaging device (40), a method of performing data communication with the ultrasound imaging device (40), or a UI indicating the battery status of the probe (20).

[0099] If the probe (20) includes a display (112), the display (112) of the probe (20) may display a UI indicating device information of the probe (20). For example, the display (112) may display identification information of the wireless ultrasound probe (20), a pairing method indicating a pairing method with the probe (20), a data communication status between the probe (20) and the ultrasound imaging device (40), a method for performing data communication with the ultrasound imaging device (40), or a UI indicating the battery status of the probe (20).

[0100] The communication module (160) can receive control signals or data from an external device. The processor (120) can control the operation of the ultrasonic imaging device (40) according to the control signals received through the communication module (160).

[0101] Additionally, the processor (120) can transmit a control signal to an external device through the communication module (160) and control the external device according to the transmitted control signal. The external device can operate according to the control signal received from the ultrasonic imaging device (40) or process data received from the ultrasonic imaging device (40).

[0102] An external device may receive or download a program or application related to the ultrasound imaging device (40) from the ultrasound imaging device (40), probe (20), or server, and install and execute the program or application on the external device. The ultrasound imaging device (40), probe (20), or server providing the program or application may include a recording medium that stores instructions, commands, installation files, executable files, or related data of the said program or application. It is also possible for the external device to be sold with the program or application installed.

[0103] The memory (150) can store various data or programs for driving and controlling the ultrasonic imaging device (40), input / output ultrasonic data, ultrasonic images, etc.

[0104] An example of an ultrasound imaging system (100) according to one embodiment of the present disclosure is described later through FIGS. 2a, 2b, 2c, and 2d.

[0105] FIGS. 2a, FIGS. 2b, FIGS. 2c, and FIGS. 2d are drawings illustrating an ultrasonic imaging device according to one embodiment of the present disclosure.

[0106] Referring to FIGS. 2a and 2b, the ultrasound imaging device (40a, 40b) may include a main display (121) and a sub-display (122). The main display (121) and the sub-display (122) may correspond to the display (140) of FIGS. 1a and 1b. At least one of the main display (121) or the sub-display (122) may be implemented as a touchscreen. At least one of the main display (121) or the sub-display (122) may display various information processed in the ultrasound image or the ultrasound imaging device (40a, 40b). Additionally, at least one of the main display (121) or the sub-display (122) may be implemented as a touchscreen and provide a GUI (Graphic User Interface) to receive data input from a user for controlling the ultrasound imaging device (40a, 40b). For example, the main display (121) displays an ultrasound image, and the sub-display (122) can display a control panel for controlling the display of the ultrasound image in the form of a GUI. The sub-display (122) can receive data for controlling the display of the image through the control panel displayed in the form of a GUI. For example, a TGC (Time Gain Compensation) button, an LGC (Lateral Gain Compensation) button, a Freeze button, a trackball, a jog switch, or a knob, etc., can be provided as a GUI on the sub-display (122).

[0107] The ultrasonic imaging device (40a, 40b) can control the display of the ultrasonic image displayed on the main display (121) using the input control data. Additionally, the ultrasonic imaging device (40a, 40b) can be connected to the probe (20) via a wired or wireless connection to transmit and receive ultrasonic signals to and from the target object.

[0108] Referring to FIG. 2b, the ultrasound imaging device (40b) may further include a control panel (165) in addition to the main display (121) and sub-display (122). The control panel (165) may include buttons, trackballs, jog switches, knobs, etc., and may receive data input from a user to control the ultrasound imaging device (40b). For example, the control panel (165) may include a TGC button (171), a Freeze button (172), etc. The TGC button (171) is a button for setting TGC values ​​according to the depth of the ultrasound image. Additionally, when the ultrasound imaging device (40b) detects input from the Freeze button (172) while scanning the ultrasound image, it may maintain the state in which the frame image at that point in time is displayed, capture the frame image at that point in time, or save the frame image at that point in time.

[0109] Meanwhile, buttons, trackballs, jog switches, knobs, etc. included in the control panel (165) may be provided as GUIs on the main display (121) or sub-display (122). Additionally, the ultrasonic imaging device (40a, 40b) may be connected to the probe (20) to transmit and receive ultrasonic signals to and from an object.

[0110] Additionally, the ultrasonic imaging device (40a, 40b) may include various types of input / output interfaces, such as speakers, LEDs, and vibration devices. For example, the ultrasonic imaging device (40a, 40b) may output various information in the form of graphics, sound, or vibration through the input / output interface. Additionally, the ultrasonic imaging device (40a, 40b) may output various notifications or data through the input / output interface.

[0111] Referring to FIG. 2c and FIG. 2d, the ultrasound imaging device (40c, 40d) can also be implemented as a portable device. Examples of the portable ultrasound imaging device (40c, 40d) may include, but are not limited to, a smartphone, laptop computer, PDA, or tablet PC including a probe and an application.

[0112] The ultrasound imaging device (40c) may include a main body (41). Referring to FIG. 2c, a probe (20) may be wired to one side of the main body (41). To this end, the main body (41) may include a detachable connection terminal to which the cable connected to the probe (20) is attached. The probe (20) may include a cable having a connection terminal that can be connected to the main body (41).

[0113] Referring to FIG. 2d, the probe (20) can be wirelessly connected to an ultrasound imaging device (40d). The main body (41) may include an input / output interface (e.g., a touch screen). The input / output interface may display ultrasound images, various information processed by the ultrasound imaging device, or a GUI.

[0114] The ultrasound imaging device (40d) and the probe (20) can establish communication or be paired using short-range wireless communication. For example, the ultrasound imaging device (40d) and the probe (20) can communicate using Bluetooth, BLE, Wi-Fi, or Wi-Fi Direct.

[0115] The ultrasound imaging device (40c, 40d) can execute a program or application related to the probe (20) to control the probe (20) and output information related to the probe (20). The ultrasound imaging device (40c, 40d) can perform operations related to the probe (20) while communicating with a predetermined server. The probe (20) can be registered with the ultrasound imaging device (40c, 40d) or registered with a predetermined server. The ultrasound imaging device (40c, 40d) can communicate with the registered probe (20) and perform operations related to the probe (20).

[0116] Additionally, the ultrasonic imaging device (40c, 40d) may include various types of input / output interfaces, such as speakers, LEDs, and vibration devices. For example, the ultrasonic imaging device (40c, 40d) may output various information in the form of graphics, sound, or vibration through the input / output interface. Additionally, the ultrasonic imaging device (40c, 40d) may output various notifications or data through the input / output interface.

[0117] According to one embodiment of the present disclosure, an ultrasound imaging device (40a, 40b, 40c, or 40d) may use an artificial intelligence (AI) model to process ultrasound images or obtain additional information from ultrasound images. According to one embodiment of the present disclosure, an ultrasound imaging device (40a, 40b, 40c, or 40d) may use an AI model to generate ultrasound images or perform processing such as correction, image quality improvement, encoding, or decoding on ultrasound images. Additionally, according to one embodiment of the present disclosure, an ultrasound imaging device (40a, 40b, 40c, or 40d) may use an AI model to perform processing such as defining a baseline, obtaining anatomical information, obtaining lesion information, surface extraction, defining boundaries, measuring length, measuring area, measuring volume, or generating annotations from ultrasound images.

[0118] The AI ​​model may be provided on an ultrasound imaging device (40a, 40b, 40c, or 40d) or on a server.

[0119] AI models can be implemented using various artificial neural network models or deep neural network models. Additionally, AI models can be trained and generated using various machine learning algorithms or deep learning algorithms. For example, AI models can be implemented using models such as CNN (Convolutional Neural Network), RNN (Recurrent Neural Network), GAN (Generative Adversarial Network), or LSTM (Long Short-Term Memory).

[0120] FIG. 3 illustrates a method for an ultrasonic imaging device (40) to acquire an area of ​​an opening formed by a muscle of interest, according to one embodiment of the present disclosure.

[0121] Referring to FIG. 3, the ultrasound imaging device (40) can obtain the area of ​​the levator hiatus formed by the levator ani muscle based on the ultrasound three-dimensional volume of the pelvic floor.

[0122] The levator ani hiatus is an opening formed by the levator ani muscle. The size of the levator ani hiatus can be used as an indicator to diagnose pelvic organ prolapse or urinary incontinence. The size of the levator ani hiatus can be measured in the patient's resting state (371), levator ani contraction state (373), and Valsalva state (375) with increased abdominal pressure.

[0123] The ultrasound imaging device (40) can acquire A cross-section (311), B cross-section (313), C cross-section (315) and rendering image (317) representing the pelvic base based on the ultrasound three-dimensional volume of the pelvic base.

[0124] The user may perform a pelvic floor ultrasound scan to scan the pelvic floor of the subject. For example, the ultrasound imaging device (40) may receive user input to 3D scan the perineum of the subject such that cross-section A of the 3D volume becomes the sagittal plane of the pelvic floor.

[0125] The ultrasound imaging device (40) can align a three-dimensional volume of the pelvic floor based on a predetermined anatomical reference axis and reference point to provide a cross-sectional image of the levator ani muscle. The predetermined anatomical reference axis and reference point may include, but are not limited to, the pubic symphysis, the coccyx, and a line connecting the pubic symphysis to the coccyx.

[0126] The ultrasound imaging device (40) can display cross-section A (321), cross-section B (323), cross-section C (325), and a rendering image (327) of the aligned three-dimensional volume. When looking at cross-section C (325) and the rendering image (327) of the aligned three-dimensional volume in FIG. 3, it can be seen that the levator ani, urethra, and rectum are clearly visible.

[0127] According to one embodiment of the present disclosure, an ultrasound imaging device (40) can detect a hiatus region (329) of the levator ani muscle in a rendering image (327). For example, the ultrasound imaging device (40) can input the rendering image (327) as an input to an artificial intelligence model through an artificial intelligence model, and obtain the location of the hiatus region (329) of the levator ani muscle within the rendering image (327) from the artificial intelligence model. To this end, the rendering image of the levator ani muscle is set as input data for training data, and the location of the hiatus region of the levator ani muscle within the rendering image is set as target data for training data so that the artificial intelligence model can be trained.

[0128] However, since the quality of the rendered image varies significantly depending on the accuracy of the alignment of the 3D volume, the reliability of the 3D volume data, or the rendering parameters, it may be difficult to accurately obtain the location of the hiatus of the levator ani muscle for artificial intelligence models that use only rendered images as input. Additionally, due to lighting effects, the location of the hiatus shown in the rendered image may differ slightly from the actual location of the hiatus. Furthermore, a very large amount of training data is required to train an artificial intelligence model even with low-quality rendered images.

[0129] According to one embodiment of the present disclosure, an ultrasound imaging device (40) can acquire a volume of the levator ani muscle within a three-dimensional volume of the pelvic floor. The ultrasound imaging device (40) can directly calculate the size of the levator ani hiatus, which is an opening formed by the levator ani muscle, from the acquired volume of the levator ani muscle.

[0130] However, muscles such as the levator ani muscle may be partially damaged or abnormally thinned due to childbirth, trauma, or aging. When muscles are damaged or thinned, the boundaries of the muscles may appear indistinct in ultrasound volume. Additionally, since the levator ani muscle is adjacent to other muscles internally and externally, if the difference in acoustic impedance between the muscles is small, adjacent muscles may be identified as part of the levator ani muscle.

[0131] According to one embodiment of the present disclosure, an ultrasound imaging device (40) can obtain a levator anus mask image by projecting the acquired levator anus volume in a reference rendering direction. Based on the levator anus mask image and a rendering image of a three-dimensional volume of the pelvic floor, the ultrasound imaging device (40) can obtain a levator anus hiatus region on the rendering image.

[0132] FIG. 4 illustrates a method according to one embodiment of the present disclosure in which an ultrasonic imaging device (40) obtains an area of ​​an opening formed by a region of interest using a projection image of a region of interest.

[0133] Referring to FIG. 4, the ultrasonic imaging device (40) can obtain the area of ​​the opening formed by the region of interest using a projection image of the region of interest.

[0134] Referring to the left drawing of FIG. 4, the ultrasound imaging device (40) can acquire a three-dimensional volume (410) of the pelvic floor and align the acquired three-dimensional volume (410) based on predetermined anatomical reference axes and reference points.

[0135] The ultrasound imaging device (40) can receive user input to three-dimensionally scan the perineum of an object such that cross-section A of the three-dimensional volume becomes the sagittal plane of the pelvic floor. The ultrasound imaging device (40) can generate a three-dimensional volume (410) for the pelvic floor based on ultrasound echo signals received from the pelvic floor. The three-dimensional volume (410) can represent the distribution of ultrasound data in space and may include three-dimensional coordinate values ​​(voxels) and data at the coordinate values.

[0136] The ultrasound imaging device (40) can segment a three-dimensional volume (410) of the pelvic floor into a predetermined plurality of regions. For example, the ultrasound imaging device (40) can segment the three-dimensional volume (410) of the pelvic floor into a volume of the levator ani muscle (420), a volume of the pubic symphysis, a volume of the urethra, a volume of the rectum, and a volume of the vagina. The ultrasound imaging device (40) can learn data for each structure using an artificial neural network (e.g., a Convolutional Neural Network) and automatically segment the structures.

[0137] The ultrasound imaging device (40) can align the acquired three-dimensional volume (410) based on predetermined anatomical reference axes and reference points. For example, the ultrasound imaging device (40) can identify the pubic symphysis and coccyx within the three-dimensional volume (410) and determine the center point of the hiatus of the levator ani muscle located on the line connecting the pubic symphysis to the coccyx as the center point (405) of the three-dimensional volume. Additionally, the ultrasound imaging device (40) can align the three-dimensional volume (410) so that the bladder, rectum, and anal canal are clearly observed in section A (404), the levator ani muscle appearing in section B is shown symmetrically, and the pelvic structure including the levator ani muscle is shown horizontally in section C.

[0138] Referring to the right side of FIG. 4, the ultrasound imaging device (40) can generate a rendering image (430) of an aligned three-dimensional volume (410). The ultrasound imaging device (40) can determine the direction of viewing the cross-section of the levator ani muscle (e.g., the direction of viewing the C cross-section of the aligned three-dimensional volume vertically) as the reference rendering direction (810) for the aligned three-dimensional volume (410), and generate a rendering image (430) by rendering the aligned three-dimensional volume (410) in the reference rendering direction (810).

[0139] Additionally, the ultrasound imaging device (40) can divide the levator ani volume (420) from the aligned three-dimensional volume (410). The ultrasound imaging device (40) can obtain a levator ani mask image (440) by projecting the divided levator ani volume (420) in a reference rendering direction (810).

[0140] For example, the ultrasonic imaging device (40) can determine the pixel value by averaging the voxel values ​​through which a virtual line of the reference rendering direction (810) toward the pixel passes for one pixel of the mask image (440).

[0141] Additionally, for example, the mask image (440) may be a mask image of a shadow obtained by projecting the levator anus volume (420) toward the reference rendering direction (810). In this case, the ultrasound imaging device (40) may determine the pixel value to 1 for one pixel of the mask image (440) if a value greater than the reference is detected in one or more voxels among the levator anus voxels through which a virtual line of the reference rendering direction (810) toward the pixel passes, and determine the pixel value to 0 if there are no voxels in which a value greater than the reference is detected.

[0142] Additionally, for example, the ultrasonic imaging device (40) can determine the pixel value by adding the voxel values ​​through which a virtual line of the reference rendering direction (810) toward the pixel passes for one pixel of the mask image (440).

[0143] According to one embodiment of the present disclosure, the projection may be referred to as volume ray casting. The levator ani mask image (440) may indicate the approximate location of the levator ani muscle on the rendering image. The levator ani mask image (440) may indicate the probability that each point on the rendering image is levator ani tissue.

[0144] The levator ani mask image (440) is a value accumulated from a three-dimensional volume, so it can indicate the damaged area of ​​the levator ani muscle. Additionally, the levator ani mask image (440) is an image projected in the same direction as the rendering direction of the rendering image (430), so it can indicate the location of the levator ani muscle in the rendering image (430).

[0145] The ultrasound imaging device (40) can identify the levator ani hiatus area on the rendering image (430) based on the levator ani mask image (440) and the rendering image (430).

[0146] According to one embodiment of the present disclosure, an ultrasound imaging device (40) can identify a hiatus region (465) of the levator anus on a rendering image (430) by comparing a mask image (440) of the levator anus and a rendering image (430). For example, the ultrasound imaging device (40) can determine the contour of an internal region of the levator anus within the mask image (440). The ultrasound imaging device (40) can determine the hiatus region (465) of the levator anus based on a line connecting points within the contour that are greater than or equal to a reference value among the pixel values ​​of the rendering image adjacent to the contour.

[0147] According to one embodiment of the present disclosure, an ultrasound imaging device (40) inputs a levator anus mask image (440) and a rendering image (430) into a hiatus identification artificial intelligence model and can obtain an image (450) indicating the location of the levator anus hiatus region from the hiatus identification artificial intelligence model. The hiatus identification artificial intelligence model can output an image (450) indicating the location of the levator anus hiatus region on the rendering image (430). The hiatus identification artificial intelligence model is described in more detail in FIG. 6.

[0148] The ultrasound imaging device (40) can display the outline of the hiatus area (465) of the levator anus muscle on a color rendering image (460) based on an image (450) indicating the location of the hiatus area of ​​the levator anus muscle. Additionally, the ultrasound imaging device (40) can measure the size of the levator anus muscle based on the hiatus area (465). For example, the ultrasound imaging device (40) can calculate the internal area of ​​the hiatus area, the circumference of the hiatus outline, the length from the far right to the far left of the outline (467, Lateral), and the vertical length of the outline (469, AP (Anterior-Posterior)). Additionally, the ultrasound imaging device (40) can display lines indicating measurement points and measurement lengths.

[0149] FIG. 5 illustrates a method in which an ultrasonic imaging device (40) determines a region of a structure within an object according to one embodiment of the present disclosure.

[0150] In step S510, the ultrasound imaging device (40) can acquire a three-dimensional volume of an object including the region of interest.

[0151] The site of interest may be a muscle, and the structure formed by the site of interest may be an opening formed by the muscle. For example, the site of interest may be the levator ani muscle, and the structure formed by the site of interest may be the hiatus of the levator ani. Additionally, the site of interest may be the esophagus, urethra, vagina, or anus, and the structure formed by the site of interest may be, but is not limited to, the esophageal hiatus, urethral hiatus, vaginal hiatus, or anal hiatus.

[0152] The ultrasound imaging device (40) can receive user input to three-dimensionally scan the perineum of a subject such that cross-section A of the three-dimensional volume becomes the sagittal plane of the pelvic floor. The ultrasound imaging device (40) can generate a three-dimensional volume of the pelvic floor based on the ultrasound echo signal received from the subject. The pelvic floor may include the pubic symphysis, levator ani, urethra, anus, etc.

[0153] In step S520, the ultrasound imaging device (40) can obtain a rendered image by rendering a three-dimensional volume in a reference rendering direction.

[0154] The ultrasound imaging device (40) can align the three-dimensional volume for consistency and accuracy of measurement before rendering the three-dimensional volume. The ultrasound imaging device (40) can divide the three-dimensional volume into multiple regions including the region of interest, and align the three-dimensional volume based on the divided multiple regions.

[0155] The ultrasound imaging device (40) can generate a rendered image by rendering the aligned three-dimensional volume in a reference rendering direction. The reference rendering direction may be a direction looking at the cross-section of the levator ani muscle. The reference rendering direction may be a direction looking vertically at cross-section C of the aligned three-dimensional volume.

[0156] The ultrasound imaging device (40) can surface render a three-dimensional volume aligned to show the surface of the levator ani muscle.

[0157] In step S530, the ultrasound imaging device (40) can project the volume of the region of interest within the three-dimensional volume in a reference rendering direction to generate a mask image indicating the location of the region of interest on the rendering image.

[0158] The ultrasound imaging device (40) can generate a mask image of the region of interest by projecting the volume of the region of interest within the aligned three-dimensional volume in a reference rendering direction.

[0159] In step S540, the ultrasound imaging device (40) can determine the region on the rendering image of the structure formed by the region of interest based on the rendering image and the mask image.

[0160] According to one embodiment of the present disclosure, an ultrasonic imaging device (40) can determine the region of a structure on a rendering image by comparing a mask image of a region of interest with a rendering image.

[0161] According to one embodiment of the present disclosure, an ultrasonic imaging device (40) inputs a mask image and a rendering image of a region of interest into an artificial intelligence model and obtains information indicating the location of a structure on the rendering image from the artificial intelligence model.

[0162] In step S550, the ultrasonic imaging device (40) can display an area of ​​the structure on a rendered image.

[0163] The ultrasonic imaging device (40) can display the area of ​​a structure formed by the region of interest on a rendering image. Additionally, the ultrasonic imaging device (40) can calculate the size of the structure. For example, the ultrasonic imaging device (40) can calculate at least one of the cross-sectional area or diameter of the structure.

[0164] The ultrasound imaging device (40) can display an area of ​​interest on a rendered image. The ultrasound imaging device (40) can display an image representing an area of ​​interest on a rendered image based on a mask image of the area of ​​interest. For example, the ultrasound imaging device (40) can generate a heatmap image by converting the pixel values ​​of the mask image into colors. The ultrasound imaging device (40) can display a heatmap image on a rendered image.

[0165] According to one embodiment of the present disclosure, the ultrasound imaging device (40) can determine the position of the urethra on a rendering image by projecting the volume of the urethra within a three-dimensional volume in a reference rendering direction. Additionally, the ultrasound imaging device (40) can display an image indicating the position of the urethra determined on the rendering image.

[0166] According to one embodiment of the present disclosure, an ultrasound imaging device (40) can identify a damaged area of ​​a region of interest based on the volume of the region of interest. Based on the location of the identified damaged area, the ultrasound imaging device (40) can display an image indicating the damaged area on a rendering image.

[0167] Since the ultrasound imaging device (40) can improve the accuracy of identifying the hiatus of the levator anus by using the levator anus mask image (715), even if the rendering image (710) of the levator anus does not sufficiently represent the actual levator anus due to an inexperienced ultrasound scan, the location of the levator anus or the location of the hiatus of the levator anus can be provided by using the levator anus mask image (715).

[0168] FIG. 6 illustrates a method in which an ultrasonic imaging device (40) according to one embodiment of the present disclosure obtains location information of an opening formed by a region of interest using an artificial intelligence model.

[0169] Referring to FIG. 6, the ultrasound imaging device (40) inputs a rendering image generated by rendering the three-dimensional volume of an object and a mask image of the region of interest generated by projecting the volume of the region of interest within the three-dimensional volume in the rendering direction as input data to an artificial intelligence model (610), and can obtain location information of an opening formed by the region of interest from the artificial intelligence model (610).

[0170] The ultrasound imaging device (40) inputs a rendering image (430) of the pelvic floor and a mask image (440) of the levator ani muscle as inputs to a hiatal identification artificial intelligence model (610), and can obtain an image (450) indicating the location of the hiatal area formed by the levator ani muscle from the hiatal identification artificial intelligence model (610).

[0171] According to one embodiment of the present disclosure, the artificial intelligence model (610) for identifying a hot hole can be learned using a supervised learning method.

[0172] Training data may be obtained for training the hiatal identification artificial intelligence model (610). A rendering image generated by rendering a three-dimensional volume of the pelvic floor and a levator ani mask image generated by projecting the volume of the levator ani muscle within the three-dimensional volume in the rendering direction may be obtained as input data for the training data. Additionally, location information of the hiatal area within the rendering image may be obtained as target data for the training data. The location information of the levator ani hiatal area may be obtained, for example, based on user input setting the hiatal area on the rendering image. The location information of the levator ani hiatal area may be in the form of an image as shown in FIG. 6, but is not limited thereto.

[0173] The artificial intelligence model (610) for identifying hiatus can be trained so that when a rendering image and a levator ani mask image, which are input data of the training data, are input, an image indicating the location of the hiatus of the levator ani, which is output data of the training data, is output.

[0174] According to one embodiment of the present disclosure, an ultrasound imaging device (40) can display the location of the hiatus of the levator anus on a rendering image and receive user input to adjust the location of the displayed hiatus of the levator anus. The ultrasound imaging device (40) can update a hiatus identification artificial intelligence model (610) based on the adjusted location of the hiatus of the levator anus. When the rendering image and the levator anus mask image are input, the ultrasound imaging device (40) can update the artificial intelligence model (610) so that the adjusted location of the hiatus of the levator anus is output.

[0175] The ultrasonic imaging device (40) can obtain a more accurate lacunae region by using a mask image along with a rendering image, and can reduce the burden on memory by using a low amount of memory. In addition, the ultrasonic imaging device (40) can obtain an accurate lacunae region even when training an artificial intelligence model using relatively little training data.

[0176] FIG. 7 illustrates a method in which an ultrasound imaging device (40) according to one embodiment of the present disclosure acquires a hiatus region of the levator ani muscle using an artificial intelligence model.

[0177] Referring to FIG. 7, even without location information of the levator ani muscle, the ultrasound imaging device (40) can obtain the location of the levator ani hiatus area on the rendering image using a pre-trained artificial intelligence model.

[0178] As described in Fig. 6, the artificial intelligence model for identifying hiatus can be pre-trained to output location information of the hiatus area of ​​the levator ani muscle when a rendering image of the pelvic floor and a mask image of the levator ani muscle are input.

[0179] Referring to the left drawing of FIG. 7, the ultrasound imaging device (40) inputs a rendering image (710) of the pelvic floor and a mask image (715) of the levator anus into a hiatus identification artificial intelligence model, and can obtain location information of the levator anus hiatus region from the hiatus identification artificial intelligence model.

[0180] The levator ani hiatus area (712) obtained from the hiatus identification artificial intelligence model can show a similarity of 95.95% and a maximum error of 3.02 mm with the actual levator ani hiatus area (711).

[0181] Even without location information of the levator ani muscle, the ultrasound imaging device (40) can obtain the location of the levator ani muscle hiatus region using a hiatus identification artificial intelligence model. Even if a rendering image (710) and a levator ani mask image (720) that does not contain location information of the hiatus region are input to the hiatus identification artificial intelligence model, the hiatus identification artificial intelligence model can output a region similar to the location of the hiatus region within the actual rendering image (710) based on parameters determined in advance through training.

[0182] Referring to the right drawing of FIG. 7, even if the levator anus mask image (720) does not include location information of the hiatus area, the levator anus hiatus area (722) obtained from the artificial intelligence model can show a similarity of 91.24% and a maximum error of 6.73 mm with the levator anus hiatus area (711) in the actual rendering image (710).

[0183] FIG. 8 illustrates a method for an ultrasound imaging device (40) to acquire the position of the urethra according to one embodiment of the present disclosure.

[0184] Referring to FIG. 8, the ultrasound imaging device (40) can divide the urethral volume (820) in a three-dimensional volume (410). The ultrasound imaging device (40) can project the urethral volume (820) in a reference rendering direction (810) to obtain an image (830) showing the position of the urethra within a rendering image (430).

[0185] The ultrasound imaging device (40) can display the outline of the levator ani hiatus region (465) and the center point (850) of the urethra based on an image (450) indicating the location of the levator ani hiatus and an image (830) indicating the location of the urethra. Additionally, the ultrasound imaging device (40) can measure the length and width associated with the levator ani hiatus based on the outline of the levator ani hiatus region (465) and the center point (850) of the urethra.

[0186] For example, the ultrasound imaging device (40) can calculate, in addition to the internal area of ​​the sac area, the length of the sac contour, and the length from the far right to the far left of the contour (467), a vertical line (469) passing through the center point of the urethra from the contour, the length from the center point of the urethra to the far right end point of the contour, and the length (863) from the center point of the urethra to the far left end point of the contour. Additionally, the ultrasound imaging device (40) can display the calculated lengths and areas.

[0187] FIG. 9 illustrates a method in which an ultrasonic imaging device (40) displays the location of the levator ani hiatus region and the urethra according to one embodiment of the present disclosure.

[0188] Referring to FIG. 9, as the location of the levator ani hiatus region and the urethra is obtained, the ultrasound imaging device (40) can display the outline of the levator ani hiatus region (465) and the center point (850) of the urethra on a color rendering image (460) representing the levator ani.

[0189] Additionally, the ultrasound imaging device (40) may display points and lines related to the measurement of the levator ani hiatus on a color rendering image (460). For example, the ultrasound imaging device (40) may display a line (910) indicating the length from the far right to the far left of the contour, a vertical line (920) passing through the center point (850) of the urethra in the contour, a line (940) indicating the length from the center point (850) of the urethra to the far right end point of the contour, and a line (930) indicating the length from the center point (850) of the urethra to the far left end point of the contour.

[0190] FIG. 10 is a flowchart of a method in which an ultrasound imaging device (40) displays a region of interest on a rendering image according to one embodiment of the present disclosure.

[0191] In step S1010, the ultrasound imaging device (40) can obtain a rendered image by rendering a three-dimensional volume in a reference rendering direction. In step S1020, the ultrasound imaging device (40) can generate a mask image indicating the location of the region of interest on the rendered image by projecting the volume of the region of interest within the three-dimensional volume in a reference rendering direction.

[0192] Steps S1010 and S1020 can be described with reference to steps S520 and S530 of FIG. 5.

[0193] In step S1030, the ultrasonic imaging device (40) can generate a heatmap image by converting the pixel values ​​of the mask image into colors.

[0194] The ultrasonic imaging device (40) can convert the pixel value into a color corresponding to the pixel value for each pixel of the mask image. For example, the ultrasonic imaging device (40) can convert the pixel value into a color with higher saturation as the pixel value increases.

[0195] In step S1040, the ultrasonic imaging device (40) can display a heatmap image on the rendered image.

[0196] The ultrasonic imaging device (40) can display a heatmap image indicating a region of interest by overlaying it on a rendering image.

[0197] FIG. 11 illustrates a method in which an ultrasonic imaging device (40) displays an image of a region of interest on a rendering image of an object according to one embodiment of the present disclosure.

[0198] Referring to FIG. 11, the ultrasound imaging device (40) can obtain a rendered image by rendering a three-dimensional volume of an object. The ultrasound imaging device (40) can obtain a projection image of the region of interest by projecting the volume of the region of interest within the three-dimensional volume in the rendering direction. The ultrasound imaging device (40) can convert the projection image into a heatmap image. The ultrasound imaging device (40) can display a heatmap image representing the region of interest by superimposing it on the rendered image.

[0199] The ultrasound imaging device (40) can obtain a color rendering image (460) by color rendering a three-dimensional volume of the pelvic floor. The ultrasound imaging device (40) can obtain a levator anus mask image (440) by projecting the volume of the levator anus within the three-dimensional volume in the rendering direction. The levator anus mask image (440) can indicate the position of the levator anus on the color rendering image (460).

[0200] The ultrasound imaging device (40) can convert the levator ani mask image (440) into a heatmap image (1110). The ultrasound imaging device (40) can generate the heatmap image (1110) by converting the pixel values ​​of the levator ani mask image (440) into colors corresponding to the pixel values. The ultrasound imaging device (40) can more clearly show the density of the levator ani accumulated in the rendering direction by converting colors that are more intense as the pixel values ​​are higher.

[0201] The ultrasound imaging device (40) can display a heatmap image (1110) representing the levator ani muscle on a color rendering image (460) of the pelvic floor. Additionally, the ultrasound imaging device (40) can display an image representing the levator ani hiatus area (465) along with the heatmap image (1110) representing the levator ani muscle on the color rendering image (460).

[0202] According to one embodiment of the present disclosure, the ultrasound imaging device (40) may display a levator ani mask image (440) rather than a heatmap image (1110) representing the levator ani on a color rendering image (460).

[0203] FIG. 12 illustrates a method in which an ultrasound imaging device (40) displays information regarding damage to a region of interest according to one embodiment of the present disclosure.

[0204] Referring to FIG. 12, the ultrasound imaging device (40) can detect a damaged area of ​​the area of ​​interest in the volume of the area of ​​interest. The ultrasound imaging device (40) can generate a projection image showing the damaged area of ​​the area of ​​interest. The ultrasound imaging device (40) can display the projection image showing the damaged area of ​​the area of ​​interest on a rendering image of an object.

[0205] The ultrasound imaging device (40) can color render the three-dimensional volume of the pelvic floor to obtain a color rendered image (460).

[0206] The ultrasound imaging device (40) can acquire the volume of the levator ani muscle within a three-dimensional volume and identify the damaged area (1210) of the levator ani muscle in the volume of the levator ani muscle. For example, the ultrasound imaging device (40) can identify the damaged area (1210) in the volume of the levator ani muscle based on the continuity of the volume data, the density of the volume data, etc.

[0207] The ultrasound imaging device (40) can generate a levator anus projection image by projecting the levator anus volume (420) within a three-dimensional volume in a reference rendering direction (810), and can determine an area corresponding to the damaged area (1210) of the levator anus volume (420) among the areas of the levator anus projection image (440).

[0208] The ultrasound imaging device (40) can change the projection image (440) so that an image (1220) indicating an area of ​​damage to the levator ani muscle is displayed on a determined area. The ultrasound imaging device (40) can change the changed projection image (440) into a heatmap image (1230) and display the heatmap image (1230) on a rendering image (460).

[0209] FIG. 13 illustrates a method in which an ultrasound imaging device (40) displays a damaged area of ​​a region of interest on a cross-sectional image of a region of interest according to one embodiment of the present disclosure.

[0210] Referring to FIG. 13, the ultrasound imaging device (40) can display a damaged area of ​​the area of ​​interest on a cross-sectional image of the area of ​​interest.

[0211] The ultrasound imaging device (40) can identify a damaged area (1210 in FIG. 12) in the volume of the levator ani muscle within the three-dimensional volume of the pelvic floor.

[0212] Additionally, the ultrasound imaging device (40) can display a cross-section A (1310) of the three-dimensional volume of the pelvic floor. The cross-section A (1310) represents the sagittal plane of the pelvic floor and can represent the bladder, rectum, and anal canal.

[0213] The ultrasound imaging device (40) can determine the levator ani region within cross-section A (1310) based on the location of the levator ani volume within a three-dimensional volume. Additionally, the ultrasound imaging device (40) can determine the damaged region (1315) within cross-section A (1310) based on the location of the damaged region (1210 in FIG. 12) within the levator ani volume. The ultrasound imaging device (40) can display an image showing the damaged region (1315) on cross-section A (1310).

[0214] Additionally, the ultrasound imaging device (40) can display C section indicator lines (1305) indicating the positions of C sections in the levator ani region within A section (1310).

[0215] The ultrasound imaging device (40) can display C cross-sections (1321 to 1328) corresponding to C cross-section indicator lines (1305). The C cross-sections (1321 to 1328) may be cross-sectional images representing the axial plane of the levator ani muscle.

[0216] The ultrasound imaging device (40) can identify a section (1324) representing a damaged area among the C sections (1321 to 1328) and a damaged area in section (1324) based on the location of a damaged area (1210 in FIG. 12) within the volume of the levator anus. The ultrasound imaging device (40) can display an image (1331) representing the identified damaged area on the section (1324) representing the damaged area.

[0217] A device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory storage medium' simply means that it is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily. For example, a 'non-transitory storage medium' may include a buffer in which data is stored temporarily.

[0218] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product (e.g., downloadable app) may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

Claims

1. In an ultrasound imaging device, Ultrasonic transceiver module; Memory for storing instructions; It includes at least one processor comprising processing circuitry, and When the above instructions are executed individually or collectively by the at least one processor, the ultrasound imaging device, Through the above-mentioned ultrasonic transceiver module, a three-dimensional volume of an object including a region of interest is obtained, and A rendered image is obtained by rendering the above 3D volume in the reference rendering direction, and Projecting the volume of the region of interest within the above 3D volume in the reference rendering direction to generate a mask image representing the position of the region of interest on the rendering image, and Based on the above rendering image and the above mask image, the region of the structure formed by the region of interest on the above rendering image is determined, and An ultrasonic imaging device that displays the area of ​​the structure on the above rendering image.

2. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the ultrasound imaging device, The above rendering image and the above mask image are input as input data for an artificial intelligence model, and An ultrasonic imaging device that obtains information regarding the region of the structure on the rendering image from the artificial intelligence model.

3. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the ultrasound imaging device, A heatmap image is generated by converting the pixel values ​​of the above mask image into colors, and Ultrasonic imaging device that displays the heatmap image on the above rendering image.

4. In Paragraph 1, An ultrasound imaging device in which the above-mentioned region of interest is a muscle, and the structure formed by the above-mentioned region of interest is an opening formed by the muscle.

5. In Paragraph 1, An ultrasound imaging device in which the above-mentioned region of interest is the levator ani muscle, and the structure formed by the above-mentioned region of interest is the levator ani hiatus formed by the above-mentioned levator ani muscle.

6. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the ultrasound imaging device, Calculate at least one of the cross-sectional area or diameter of the above structure, and Ultrasonic imaging device that displays at least one of the above-calculated cross-sectional area or diameter.

7. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the ultrasound imaging device, By projecting the volume of the urethra within the above three-dimensional volume in the above reference rendering direction, the position of the urethra on the rendering image is determined, and An ultrasound imaging device that displays an image indicating the location of the determined urethra on the above rendering image.

8. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the ultrasound imaging device, Based on the volume of the above-mentioned area of ​​interest, the damaged area of ​​the above-mentioned area of ​​interest is identified, and An ultrasound imaging device that displays an image indicating the damaged area on the rendering image based on the location of the identified damaged area.

9. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the ultrasound imaging device, Based on the volume of the above-mentioned area of ​​interest, the damaged area of ​​the above-mentioned area of ​​interest is identified, and An ultrasound imaging device that displays an image representing the damaged area on a cross-sectional image of the three-dimensional volume based on the location of the identified damaged area.

10. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the ultrasound imaging device, The above three-dimensional volume is divided into a plurality of regions including the region of interest, and Aligning the three-dimensional volume based on the above-mentioned divided plurality of parts, and The above-mentioned aligned 3D volume is rendered in the above-mentioned reference rendering direction to obtain the above-mentioned rendered image, and An ultrasound imaging device that generates the mask image by projecting the volume of the region of interest within the aligned three-dimensional volume in the reference rendering direction.

11. A method for an ultrasound imaging device to detect a region of an anatomical structure, A step of acquiring a three-dimensional volume for an object including a region of interest; A step of obtaining a rendered image by rendering the above 3D volume in a reference rendering direction; A step of projecting the volume of the region of interest within the three-dimensional volume in the reference rendering direction to generate a mask image indicating the position of the region of interest on the rendering image; Based on the above rendering image and the above mask image, a step of determining an area on the rendering image of a structure formed by the region of interest; and A method comprising the step of displaying an area of ​​the structure on the rendering image.

12. In Paragraph 11, Based on the above rendering image and the above mask image, the step of determining the region of the structure formed by the region of interest on the above rendering image is: A step of inputting the above rendering image and the above mask image as input data for an artificial intelligence model; and A method comprising the step of obtaining information regarding the region of the structure on the rendering image from the artificial intelligence model.

13. In Paragraph 11, A method for detecting the region of the above-mentioned anatomical structure is, A step of generating a heatmap image by converting the pixel values ​​of the above mask image into colors; and A method further comprising the step of displaying the heatmap image on the rendering image.

14. In Paragraph 11, A method in which the above-mentioned area of ​​interest is a muscle, and the structure formed by the above-mentioned area of ​​interest is an opening formed by the muscle.

15. In Paragraph 11, The above-mentioned area of ​​interest is the levator ani muscle, and the structure formed by the above-mentioned area of ​​interest is the levator ani hiatus formed by the above-mentioned levator ani muscle.

Images