Ultrasound imaging apparatus, method of controlling ultrasound imaging apparatus, and computer-readable recording medium
By rotating the reference cross-sectional image on the GUI view of the ultrasonic imaging device and updating the slice plane of the candidate standard cross-sectional image, the problem of discontinuity of standard cross-sectional image update in the prior art is solved, and higher operational fluency and user trust are achieved.
Patent Information
- Application Number
- CN202411342252.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2024-02-28
- Filing Date
- 2024-09-25
- Publication Date
- 2025-04-08
AI Technical Summary
When the existing ultrasonic imaging device updates the standard cross-sectional image, it is difficult for the reference cross-sectional image to effectively rotate the reference cross-sectional image to adjust the slice plane of the candidate standard cross-sectional image, resulting in discontinuous image updates.
The candidate standard cross-section image on the GUI view is updated by displaying the reference section image and the candidate standard cross-section image on the graphical user interface (GUI) view and allowing rotation of the reference section image, adjusting the slice plane of the candidate standard cross-section image based on the rotation.
Continuous update of standard cross-sectional images is realized, users' confidence in standard cross-sectional images are improved, and the operational fluency of the ultrasonic imaging device is enhanced.
Smart Images

Figure CN119770071A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to an ultrasonic imaging device, a method for controlling an ultrasonic imaging device, and a computer-readable recording medium. More specifically, the present disclosure relates to an ultrasonic imaging device for updating a standard cross-sectional image, a method for controlling an ultrasonic imaging device, and a computer-readable recording medium storing the method. Background Art
[0002] Recently, in the medical field, various medical imaging devices have been widely used to image biological tissues of the human body and obtain information about the biological tissues of the human body for the purpose of early diagnosis or surgery of various diseases. Representative examples of medical imaging devices include ultrasonic imaging devices, computer tomography (CT) devices, and magnetic resonance imaging (MRI) devices.
[0003] An ultrasonic imaging device is a device that irradiates an ultrasonic signal generated from a transducer of a probe to an object and receives information of a signal reflected from the object to non-invasively obtain at least one image about an internal area of the object (e.g., soft tissue or blood flow). Ultrasonic imaging devices can be used for medical purposes such as observing the inside of an object, detecting foreign matter, and measuring damage. Advantages of ultrasonic imaging devices include having higher stability than imaging devices using X-rays, displaying images in real time, and being safe due to no radiation exposure. Therefore, ultrasonic imaging devices are widely used along with other imaging devices. Summary of the invention
[0004] Additional aspects will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of the embodiments presented in the disclosure.
[0005] According to an embodiment of the present disclosure, a method for controlling an ultrasonic imaging device may include: obtaining a reference cross-sectional image intersecting a first axis from volume data. In an embodiment, the method for controlling the ultrasonic imaging device may include obtaining a candidate standard cross-sectional image intersecting a second axis from the volume data, the second axis being different from the first axis. In an embodiment, the method for controlling the ultrasonic imaging device may include displaying the reference cross-sectional image and the candidate standard cross-sectional image on a first graphical user interface (GUI) view. In an embodiment, the method for controlling the ultrasonic imaging device may include rotating the reference cross-sectional image on the first GUI view. In an embodiment, the method for controlling the ultrasonic imaging device may include updating the candidate standard cross-sectional image on the first GUI view by adjusting a slice plane of the candidate standard cross-sectional image based on the rotation of the reference cross-sectional image. In an embodiment, the method for controlling the ultrasonic imaging device may include displaying the updated candidate standard cross-sectional image as a standard cross-sectional image on the first GUI view according to completion of the rotation of the reference cross-sectional image. In an embodiment, the standard cross-sectional image may include at least one anatomical landmark.
[0006] An ultrasonic imaging device according to an embodiment of the present disclosure may include: a display, a memory storing one or more instructions, and at least one processor configured to execute the one or more instructions stored in the memory. In an embodiment, the at least one processor may be configured to execute the one or more instructions to obtain a reference cross-sectional image intersecting a first axis from volume data. In an embodiment, the at least one processor may be configured to execute the one or more instructions to obtain a candidate standard cross-sectional image intersecting a second axis from the volume data, the second axis being different from the first axis. In an embodiment, the at least one processor may be configured to execute the one or more instructions to display the reference cross-sectional image and the candidate standard cross-sectional image on a first graphical user interface (GUI) view. In an embodiment, the at least one processor may be configured to execute the one or more instructions to rotate the reference cross-sectional image on the first GUI view. The candidate standard cross-sectional image on the first GUI view is updated by adjusting the slice plane of the candidate standard cross-sectional image based on the rotation of the reference cross-sectional image. In an embodiment, the at least one processor may be configured to execute the one or more instructions to display the updated candidate standard cross-sectional image as the standard cross-sectional image on the first GUI view according to the completion of the rotation of the reference cross-sectional image. In an embodiment, the standard cross-sectional image may include at least one anatomical landmark.
[0007] According to an embodiment of the present disclosure, there may be provided a computer-readable recording medium storing a program for executing at least one of the methods of controlling the ultrasonic imaging apparatus on a computer. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] The above and other aspects, features and advantages of certain embodiments of the present disclosure will be more easily understood through the following description in conjunction with the accompanying drawings.
[0009] The present disclosure can be easily understood by combining the following detailed description with the accompanying drawings, and the accompanying drawings indicate structural elements.
[0010] Figure 1A and Figure 1B is a block diagram showing a configuration of an ultrasound imaging system according to an embodiment of the present disclosure; Figure 2A , Figure 2B , Figure 2C and Figure 2D An ultrasound imaging system according to an embodiment of the present disclosure is shown; Figure 3A and Figure 3B is a block diagram showing a configuration of an ultrasonic imaging apparatus according to an embodiment of the present disclosure; Figure 4 is a flowchart for describing a method of controlling an ultrasonic imaging device according to an embodiment of the present disclosure; Figure 5A is a view for describing a reference cross-sectional image and a standard cross-sectional image according to an embodiment of the present disclosure; Figure 5B is a view for describing a candidate standard cross-sectional image and a standard cross-sectional image according to an embodiment of the present disclosure; Figure 6 is a view for describing a first graphical user interface (GUI) according to an embodiment of the present disclosure; Fig. 7A and Figure 7B is a view for describing an update of a candidate standard cross-sectional image according to an embodiment of the present disclosure; Fig. 8A and Figure 8B is a view for describing displaying at least one anatomical landmark with a preset color by an ultrasound imaging apparatus according to an embodiment of the present disclosure; and Fig. 9 is a view for describing a three-dimensional ultrasonic image displayed by the ultrasonic imaging apparatus according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0011] This specification will describe the principles of the embodiments of the present disclosure, and disclose the embodiments to clarify the scope of the claims of the present disclosure, and enable those skilled in the art to implement the embodiments of the present disclosure. The embodiments of the present disclosure can be implemented in various forms.
[0012] Throughout the specification, similar reference numerals will refer to similar components. This specification does not describe all the elements of the embodiment, and will omit the description of the general content in the technical field to which the present disclosure belongs or the repetitive content between the embodiments. As used herein, the term "module" or "unit" may be implemented as one or a combination of two or more of software, hardware or firmware, and according to some embodiments, multiple "modules" or "units" may be implemented as a single element, or a single "module" or "unit" may include multiple elements.
[0013] Unless otherwise clearly indicated in the relevant context, a noun corresponding to an item in the singular may include one or more items.
[0014] In the present disclosure, phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "at least one of A, B or C" may include any or all possible combinations of the items listed together in the corresponding phrase in the phrase.
[0015] The term "and / or" includes any and all combinations of a plurality of the associated listed components.
[0016] Terms such as “first,” “second,” or “1st” or “2nd” may be used simply to distinguish a component from other components without limiting the components in other aspects (eg, importance or order).
[0017] In addition, the terms "front surface", "rear surface", "upper surface", "lower surface", "side surface", "left side", "right side", "upper part", "lower part" and the like used in the present disclosure are defined based on the drawings, and the shape and position of the components are not limited by these terms.
[0018] It will be understood that when the terms “includes,” “comprising,” and / or “having,” are used in the present disclosure, they specify the presence of stated features, figures, steps, operations, components, members, or combinations thereof, but do not preclude the presence or addition of one or more other features, figures, steps, operations, components, members, or combinations thereof.
[0019] It will be understood that when a component is referred to as being "connected to," "coupled to," "supported by," or "in contact with" another component, it may be directly or indirectly connected to, coupled to, supported by, or in contact with another component. When a component is indirectly connected to, coupled to, supported by, or in contact with another component, it may be connected to, coupled to, supported by, or in contact with another component through a third component.
[0020] It will also be understood that when a component is referred to as being “on” or “over” another component, it can be directly on the other component or intervening components may also be present.
[0021] Hereinafter, an ultrasonic imaging apparatus according to various embodiments will be described in detail with reference to the accompanying drawings. In the following description with reference to the accompanying drawings, the same or corresponding components are assigned like reference numerals, and a repeated description thereof may be omitted.
[0022] In the present disclosure, the image may include a medical image obtained by a medical imaging device such as a magnetic resonance imaging (MRI) device, a computer tomography (CT) device, an ultrasound imaging device, an X-ray imaging device, etc.
[0023] In the present disclosure, a "subject" may be a target to be photographed, and may include a person, an animal, or a part thereof. For example, the object may include a part of the body (intestines, organs, etc.), a phantom, etc.
[0024] In the present disclosure, an 'ultrasound image' means an image about an object that is generated or processed based on an ultrasound signal that is transmitted to the object and then reflected from the object.
[0025] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.
[0026] Figure 1A and Figure 1B is a block diagram showing a configuration of an ultrasound imaging system according to an embodiment of the present disclosure.
[0027] Reference Figure 1A and Figure 1B The ultrasound imaging system 100 may include a probe 20 and an ultrasound imaging device 40 .
[0028] The ultrasonic imaging device 40 may be implemented as a cart type or a portable type. Examples of portable ultrasonic imaging devices may include a smart phone, a laptop computer, a personal digital assistant (PDA), a tablet PC, etc., each of which includes a probe and an application, but is not limited thereto. The ultrasonic imaging device 40 may be implemented as a probe-integrated type.
[0029] The probe 20 may include a wired probe that is wiredly connected to the ultrasound imaging device 40 for wired communication with the ultrasound imaging device 40, a wireless probe that is wirelessly connected to the ultrasound imaging device 40 for wireless communication with the ultrasound imaging device 40, and / or a hybrid probe that is wiredly connected or wirelessly connected to the ultrasound imaging device 40 for wired communication or wireless communication with the ultrasound imaging device 40.
[0030] According to various embodiments of the present disclosure, Figure 1A As shown, the ultrasound imaging device 40 may include an ultrasound transmitting / receiving module 110, or the probe 20 may include a Figure 1B The ultrasound transmission / reception module 110 is shown. According to various embodiments of the present disclosure, both the ultrasound imaging device 40 and the probe 20 may include the ultrasound transmission / reception module 110.
[0031] According to various embodiments of the present disclosure, the probe 20 may include at least one of an imaging processor 130, a display 140, an input interface 170, or a combination thereof. In the present disclosure, the description about the ultrasound transmission / reception module 110, the imaging processor 130, the display 140, or the input interface 170 included in the ultrasound imaging device 40 may be applied to the ultrasound transmission / reception module 110, the imaging processor 130, the display 140, or the input interface 170 included in the probe 20.
[0032] Figure 1A is a block diagram showing a configuration of an ultrasound imaging system 100 having a probe 20 which is a wired probe or a hybrid probe.
[0033] The probe 20 may include a plurality of transducers. The plurality of transducers may be arranged in a preset arrangement and implemented as a transducer array. The transducer array may correspond to a one-dimensional (1D) array or a two-dimensional (2D) array. The plurality of transducers may transmit an ultrasonic signal to the object 10 according to a transmission signal applied from the transmission module 113. The plurality of transducers may form a reception signal by receiving an ultrasonic signal (echo signal) reflected from the object 10. In addition, the probe 20 may be implemented as an integrated type integrated into the ultrasonic imaging device 40, or a separate type wiredly connected to the ultrasonic imaging device 40. In addition, the ultrasonic imaging device 40 may be connected to a single or multiple probes 20 according to the implementation type.
[0034] In the case where the probe 20 is a wired probe or a hybrid probe, the probe 20 may include a cable and a connector that may be connected to a connector of the ultrasound imaging device 40 .
[0035] The probe 20 according to an embodiment of the present disclosure may be implemented as a two-dimensional probe. In the case where the probe 20 is a two-dimensional probe, a plurality of transducers included in the probe 20 may form a two-dimensional transducer array by being two-dimensionally arranged.
[0036] For example, a two-dimensional transducer array may be configured by arranging a plurality of sub-arrays along a second direction, each of the plurality of sub-arrays including a plurality of transducers arranged along a first direction, the second direction being different from the first direction.
[0037] In addition, in the case where the probe 20 according to an embodiment of the present disclosure is a two-dimensional probe, the ultrasound transmit / receive module 110 may include at least one of an analog beamformer or a digital beamformer. In addition, according to an embodiment of the present disclosure, depending on the implementation type, the two-dimensional probe may include at least one of an analog beamformer or a digital beamformer.
[0038] The processor 120 may control the transmission module 113 to form a transmission signal to be applied to each of the plurality of transducers included in the probe 20 in consideration of the position and focus of the transducer.
[0039] The processor 120 may control the receiving module 115 to perform analog-to-digital conversion on the reception signal received from the probe 20 , sum the digitally converted reception signal in consideration of the positions and focal points of the plurality of transducers, and thereby generate ultrasound data.
[0040] In the case where the probe 20 is implemented as a two-dimensional probe, the processor 120 may calculate a time delay value for digital beamforming for each of a plurality of subarrays included in a two-dimensional transducer array. In addition, the processor 120 may calculate a time delay value for analog beamforming for each transducer in any subarray included in the plurality of subarrays. The processor 120 may control the analog beamformer and the digital beamformer to form a transmission signal to be applied to each of the plurality of transducers according to the time delay value for analog beamforming and the time delay value for digital beamforming. In addition, the processor 120 may control the analog beamformer to sum the signals received from the plurality of transducers of each subarray according to the time delay value for analog beamforming. In addition, the processor 120 may control the ultrasound transmission / reception module 110 to perform analog-to-digital conversion on the signals summed for each subarray. In addition, the processor 120 may control the digital beamformer to sum the digitally converted signals according to the time delay value for digital beamforming and generate ultrasound data.
[0041] The imaging processor 130 may generate or process an ultrasound image by using the generated ultrasound data.
[0042] The display 140 may display the generated ultrasound image and various information processed in the ultrasound imaging device 40 or the probe 20. The probe 20 or the ultrasound imaging device 40 may include a single or multiple displays 140 according to the implementation type. In addition, the display 140 may include a touch panel or a touch screen. In addition, the display 140 may include a flexible display.
[0043] The processor 120 may control the overall operation of the ultrasonic imaging device 40 and control the operations of the components of the ultrasonic imaging device 40. The processor 120 may execute programs or instructions stored in the memory 150 to perform or control various operations or functions of the ultrasonic imaging device 40. In addition, the processor 120 may receive a control signal from the input interface 170 or an external device to control the operation of the ultrasonic imaging device 40.
[0044] The ultrasound imaging device 40 may include a communication module 160 , and connect to and communicate with an external device (eg, the probe 20 , a server, a medical device, or a portable device (smart phone, tablet PC, wearable device, etc.)) through the communication module 160 .
[0045] The communication module 160 may include one or more components for enabling communication with an external device. The communication module 160 may include, for example, at least one of a short-range communication module, a wired communication module, or a wireless communication module.
[0046] The communication module 160 may receive a control signal or data from an external device. The processor 120 may control the operation of the ultrasonic imaging device 40 according to the control signal received through the communication module 160. In addition, the processor 120 may transmit a control signal to the external device through the communication module 160, and control the external device according to the transmitted control signal. The external device may operate according to the control signal received from the ultrasonic imaging device 40, or process the data received from the ultrasonic imaging device 40.
[0047] A program or application related to the ultrasonic imaging device 40 may be installed in the external device. The program or application installed in the external device may control the ultrasonic imaging device 40 or operate according to a control signal or data received from the ultrasonic imaging device 40.
[0048] The external device may receive or download a program or application related to the ultrasonic imaging device 40 from the ultrasonic imaging device 40, the probe 20, or the server, install the program or application in the external device, and execute the program or application. The ultrasonic imaging device 40, the probe 20, or the server providing the program or application may include a recording medium storing instructions, commands, installation files, execution files, or related data of the corresponding program or application. The external device may be sold with the program or application installed.
[0049] The memory 150 may store various data or programs for driving and controlling the ultrasonic imaging device 40 , and inputting / outputting ultrasonic data and ultrasonic images.
[0050] The input interface 170 may receive user input for controlling the ultrasonic imaging device 40. For example, the user input may include input from an operation button, a keyboard, a mouse, a trackball, a micro switch, a knob, etc., input from a touch pad or a touch screen, voice input, motion input, biometric information input (e.g., iris recognition, fingerprint recognition, etc.), etc., but is not limited thereto.
[0051] Figure 1B is a control block diagram of an ultrasound imaging system 100 having a probe 20 , which is a wireless probe or a hybrid probe.
[0052] According to various embodiments of the present disclosure, Figure 1B The ultrasound imaging device 40 shown in FIG. Figure 1A The ultrasonic imaging device 40 is described instead.
[0053] According to various embodiments of the present disclosure, Figure 1A The probe 20 shown in FIG. Figure 1B The probe 20 described is substituted.
[0054] The probe 20 may include a display 112, a transmission module 113, a battery 114, a transducer 117, a charging module 116, a receiving module 115, an input interface 109, a processor 118, and a communication module 119. In addition, the probe 20 may further include a memory 111. Figure 1B The case where the probe 20 includes both the transmission module 113 and the reception module 115 is shown. However, the probe 20 may include a part of the components of the transmission module 113 and a part of the components of the reception module 115, and another part of the components of the transmission module 113 and another part of the components of the reception module 115 may be included in the ultrasonic imaging device 40. In addition, according to an embodiment of the present disclosure, the probe 20 may further include an imaging processor 130.
[0055] The transducer 117 may include a plurality of transducers. The plurality of transducers may be arranged in a preset arrangement and implemented as a transducer array. The transducer array may correspond to a 1D array or a 2D array. The plurality of transducers may transmit an ultrasonic signal to the object 10 according to a transmission signal applied from the transmission module 113. In addition, the plurality of transducers may receive the ultrasonic signal reflected from the object 10 and form or generate an electrical reception signal.
[0056] The charging module 116 may charge the battery 114. The charging module 116 may receive power from the outside. According to an embodiment of the present disclosure, the charging module 116 may receive power wirelessly. In addition, according to an embodiment of the present disclosure, the charging module 116 may receive power by wire. The charging module 116 may transmit the received power to the battery 114.
[0057] The processor 118 may control the transmission module 113 to generate or form a transmission signal to be applied to each of the plurality of transducers taking into account the positions and focal points of the plurality of transducers.
[0058] The processor 118 may control the receiving module 115 to perform analog-to-digital conversion on the received signal received from the transducer 117, sum the digitally converted received signal in consideration of the positions and focal points of the plurality of transducers, and thereby generate ultrasound data. According to an embodiment of the present disclosure, the probe 20 may include an imaging processor 130, and in this case, the probe 20 may generate an ultrasound image by using the generated ultrasound data.
[0059] In the case where the probe 20 is implemented as a 2D probe, the processor 118 may calculate a time delay value for digital beamforming for each of a plurality of subarrays included in the 2D transducer array. In addition, the processor 118 may calculate a time delay value for analog beamforming for each transducer included in any of the plurality of subarrays. The processor 118 may control the analog beamformer and the digital beamformer to form a transmission signal to be applied to each of the plurality of transducers according to the time delay value for analog beamforming and the time delay value for digital beamforming. In addition, the processor 118 may control the analog beamformer to sum the signals received from the plurality of transducers of each subarray according to the time delay value for analog beamforming. In addition, the processor 118 may control the ultrasound transmission / reception module 110 to perform analog-to-digital conversion on the signals summed for each subarray. In addition, the processor 118 may control the digital beamformer to sum the digitally converted signals according to the time delay value for digital beamforming and generate ultrasound data.
[0060] The processor 118 may control the overall operation of the probe 20 and control the operation of the components of the probe 20. The processor 118 may execute the program or instructions stored in the memory 111 to perform or control various operations or functions of the probe 20. In addition, the processor 118 may control the operation of the probe 20 by receiving a control signal from the input interface 109 of the probe 20 or an external device (e.g., the ultrasound imaging device 40). The input interface 109 may receive a user input for controlling the probe 20. For example, the user input may include input from an operation button, a keyboard, a mouse, a trackball, a micro switch, a knob, etc., input from a touch pad or a touch screen, voice input, motion input, biometric information input (e.g., iris recognition, fingerprint recognition, etc.), etc., but is not limited thereto.
[0061] The display 112 may display an ultrasonic image generated by the probe 20, an ultrasonic image generated by processing ultrasonic data generated by the probe 20, an ultrasonic image received from the ultrasonic imaging device 40, or various information processed in the ultrasonic imaging system 100. In addition, the display 112 may also display status information of the probe 20. The status information of the probe 20 may include at least one of device information of the probe 20, battery status information of the probe 20, frequency band information of the probe 20, output information of the probe 20, abnormality information of the probe 20, setting information of the probe 20, or temperature information of the probe 20.
[0062] Depending on the type of implementation, the probe 20 may include a single or multiple displays 112. Additionally, the display 112 may include a touch panel or a touch screen. Additionally, the display 112 may include a flexible display.
[0063] The communication module 119 may wirelessly transmit the generated ultrasound data or ultrasound image to the ultrasound imaging device 40 through a wireless network. In addition, the communication module 119 may receive a control signal and data from the ultrasound imaging device 40.
[0064] The ultrasound imaging device 40 may receive ultrasound data or an ultrasound image from the probe 20 .
[0065] In an embodiment of the present disclosure, according to the probe 20 including the imaging processor 130 capable of generating an ultrasound image by using ultrasound data, the probe 20 may transmit the ultrasound data or the ultrasound image generated by the imaging processor 130 to the ultrasound imaging device 40 .
[0066] In an embodiment of the present disclosure, according to the probe 20 not including the imaging processor 130 capable of generating an ultrasound image by using ultrasound data, the probe 20 may transmit ultrasound data to the ultrasound imaging device 40. The ultrasound data may include ultrasound raw data, and the ultrasound image may be ultrasound image data.
[0067] The ultrasound imaging device 40 may include a processor 120 , an imaging processor 130 , a display 140 , a memory 150 , a communication module 160 , and an input interface 170 .
[0068] The imaging processor 130 may generate or process an ultrasound image by using ultrasound data received from the probe 20 .
[0069] The display 140 may display an ultrasound image received from the probe 20, an ultrasound image generated by processing ultrasound data received from the probe 20, or various information processed in the ultrasound imaging system 100. Depending on the implementation type, the ultrasound imaging device 40 may include a single or multiple displays 140. In addition, the display 140 may include a touch panel or a touch screen. In addition, the display 140 may include a flexible display.
[0070] The processor 120 may control the overall operation of the ultrasonic imaging device 40 and control the operations of the components of the ultrasonic imaging device 40. The processor 120 may execute programs or instructions stored in the memory 150 to perform or control various operations or functions of the ultrasonic imaging device 40. In addition, the processor 120 may control the operation of the ultrasonic imaging device 40 by receiving a control signal from the input interface 170 or an external device.
[0071] The ultrasound imaging device 40 may include a communication module 160 , and connect to and communicate with an external device (eg, the probe 20 , a server, a medical device, a portable device (smart phone, tablet PC, wearable device, etc.)) through the communication module 160 .
[0072] The communication module 160 may include one or more components for enabling communication with an external device. The communication module 160 may include, for example, at least one of a short-range communication module, a wired communication module, or a wireless communication module.
[0073] The communication module 160 of the ultrasonic imaging device 40 may communicate with the communication module 119 of the probe 20 via a network or a short-range wireless communication method. For example, the communication module 160 of the ultrasonic imaging device 40 may communicate with the communication module 119 of the probe 20 via any one of the following wireless data communication methods, including wireless local area network (LAN), wireless fidelity (Wi-Fi), Bluetooth, Zigbee, Wi-Fi Direct (WFD), infrared communication (Infrared Data Association (IrDA)), Bluetooth Low Energy (BLE), near field communication (NFC), wireless broadband Internet (Wibro), world interoperability for microwave access (WiMAX), shared wireless access protocol (SWAP), Wireless Gigabit Alliance (WiGig), radio frequency (RF) communication, or 60 GHz millimeter wave short-range communication.
[0074] To this end, the communication module 160 of the ultrasonic imaging device 40 and the communication module 119 of the probe 20 may include at least one of the following communication modules: a wireless LAN communication module, a Wi-Fi communication module, a Bluetooth communication module, a zigbee communication module, a WFD communication module, an IrDA communication module, a BLE communication module, an NFC communication module, a Wibro communication module, a WiMAX communication module, a SWAP communication module, a WiGig communication module, an RF communication module or a 60GHz millimeter wave short-range communication module.
[0075] In an embodiment of the present disclosure, the probe 20 may transmit device information (e.g., identification (ID) information) of the probe 20 to the ultrasound imaging device 40 by using a first communication method (e.g., BLE) and wirelessly pair with the ultrasound imaging device 40. In addition, the probe 20 may transmit ultrasound data and / or ultrasound images to the paired ultrasound imaging device 40.
[0076] The device information of the probe 20 may include various information related to the serial number, model, battery status, etc. of the probe 20.
[0077] The ultrasonic imaging device 40 may receive device information (e.g., ID information) of the probe 20 from the probe 20 by using a first communication method (e.g., BLE), and wirelessly pair with the probe 20. In addition, the ultrasonic imaging device 40 may transmit an activation signal to the paired probe 20 and receive ultrasonic data and / or an ultrasonic image from the probe 20. At this time, the activation signal may include a signal for controlling the operation of the probe 20.
[0078] In an embodiment of the present disclosure, the probe 20 can send device information (e.g., ID information) of the probe 20 to the ultrasonic imaging device 40 by using a first communication method (e.g., BLE), and wirelessly pair with the ultrasonic imaging device 40. In addition, the probe 20 can send ultrasonic data and / or ultrasonic images to the ultrasonic imaging device 40 paired by the first communication method by using a second communication method (e.g., 60 GHz millimeter wave or Wi-Fi).
[0079] The ultrasonic imaging device 40 may receive device information (e.g., ID information) of the probe 20 from the probe 20 by using a first communication method (e.g., BLE), and wirelessly pair with the probe 20. In addition, the ultrasonic imaging device 40 may send an activation signal to the paired probe 20, and receive ultrasonic data and / or ultrasonic images from the probe 20 by using a second communication method (e.g., 60 GHz millimeter wave or Wi-Fi).
[0080] According to an embodiment of the present disclosure, a first communication method for pairing the probe 20 with the ultrasonic imaging device 40 may have a lower frequency band than a second communication method through which the probe 20 transmits ultrasonic data and / or ultrasonic images to the ultrasonic imaging device 40 .
[0081] The display 140 of the ultrasonic imaging device 40 may display a user interface (UI) indicating device information of the probe 20. For example, the display 140 may display ID information of the probe 20 as a wireless ultrasonic probe, a pairing method for pairing with the probe 20, a data communication status between the probe 20 and the ultrasonic imaging device 40, a method for data communication with the ultrasonic imaging device 40, or a UI indicating a battery status of the probe 20.
[0082] According to the probe 20 including the display 112, the display 112 of the probe 20 may display a UI indicating device information of the probe 20. For example, the display 112 may display ID information of the probe 20 as a wireless ultrasound probe, a pairing method for pairing with the probe 20, a data communication status between the probe 20 and the ultrasound imaging device 40, a method for data communication with the ultrasound imaging device 40, or a UI indicating a battery status of the probe 20.
[0083] The communication module 160 may receive a control signal or data from an external device. The processor 120 may control the operation of the ultrasonic imaging device 40 according to the control signal received through the communication module 160.
[0084] In addition, the processor 120 may transmit a control signal to the external device through the communication module 160 to control the external device according to the control signal. The external device may operate according to the control signal received from the ultrasonic imaging device 40 or process data received from the ultrasonic imaging device 40.
[0085] The external device may receive or download a program or application related to the ultrasonic imaging device 40 from the ultrasonic imaging device 40, the probe 20, or the server, install the program or application in the external device, and execute the program or application. The ultrasonic imaging device 40, the probe 20, or the server providing the program or application may include a recording medium storing instructions, commands, installation files, execution files, related data, etc. of the corresponding program or application. The external device may be sold with the program or application installed.
[0086] The memory 150 may store various data or programs for driving and controlling the ultrasonic imaging device 40 , inputting / outputting ultrasonic data, ultrasonic images, and the like.
[0087] The following will refer to Figure 2A , Figure 2B , Figure 2C and Figure 2D An example of an ultrasound imaging system 100 according to an embodiment of the present disclosure is described.
[0088] Figure 2A , Figure 2B , Figure 2C and Figure 2D An ultrasonic imaging device according to an embodiment of the present disclosure is shown.
[0089] Reference Figure 2A and Figure 2B , each of the ultrasonic imaging devices 40a and 40b may include a main display 121 and a sub-display 122. The main display 121 and the sub-display 122 may correspond to Figure 1A and Figure 1BThe display 140 of the main display 121 or the sub-display 122 may be implemented as a touch screen. At least one of the main display 121 or the sub-display 122 may display an ultrasonic image or various information processed in the ultrasonic imaging devices 40a and 40b. In addition, at least one of the main display 121 or the sub-display 122 may be implemented as a touch screen and provide a graphical user interface (GUI) to receive data for controlling the ultrasonic imaging devices 40a and 40b from a user. For example, the main display 121 may display an ultrasonic image, and the sub-display 122 may display a control panel for controlling the display of the ultrasonic image in the form of a GUI. The sub-display 122 may receive control data for controlling the display of the ultrasonic image through the control panel displayed in the form of a GUI. For example, a time gain compensation (TGC) button, a lateral gain compensation (LGC) button, a freeze button, a trackball, a micro switch, or a knob may be provided to the sub-display 122 as a GUI.
[0090] The ultrasonic imaging devices 40a and 40b may control display of an ultrasonic image displayed on the main display 121 by using the received control data. In addition, the ultrasonic imaging devices 40a and 40b may be connected to the probe 20 by wire or wirelessly to transmit / receive ultrasonic signals to / from the subject.
[0091] Reference Figure 2B In addition to the main display 121 and the sub-display 122, the ultrasonic imaging device 40b may further include a control panel 165. The control panel 165 may include buttons, trackballs, micro switches, knobs, etc., and receive data for controlling the ultrasonic imaging device 40b from a user. For example, the control panel 165 may include a TGC button 171, a freeze button 172, etc. The TGC button 171 may be a button for setting a TGC value for each depth of an ultrasonic image. In addition, according to detecting an input of the freeze button 171 when the ultrasonic imaging device 40b scans an ultrasonic image, the ultrasonic imaging device 40b may maintain a display state of a frame image at a corresponding time, capture a frame image at a corresponding time, or store a frame image at a corresponding time.
[0092] In addition, buttons, trackballs, micro switches, knobs, etc. included in the control panel 165 may be provided as a GUI to the main display 121 or the sub-display 122. In addition, ultrasonic imaging devices 40a and 40b may be connected to the probe 20 to transmit / receive ultrasonic signals to / from a subject.
[0093] In addition, the ultrasonic imaging devices 40a and 40b may include an input / output interface (which may be one or more of various types), such as a speaker, a light emitting diode (LED), a vibration device, etc. For example, the ultrasonic imaging devices 40a and 40b may output various information in the form of graphics, sound, or vibration through the input / output interface. In addition, the ultrasonic imaging devices 40a and 40b may output various notifications or data through the input / output interface.
[0094] Reference Figure 2C and Figure 2D The ultrasonic imaging devices 40c and 40d may be implemented as a portable type. Examples of the portable type ultrasonic imaging devices 40c and 40d may include a smartphone, a laptop computer, a PDA, or a tablet PC including a probe and an application, but are not limited thereto.
[0095] The ultrasonic imaging device 40c may include a main body 41. Figure 2C , the probe 20 may be wired to one side of the body 41. To this end, the body 41 may include a connection terminal to which a cable connected to the probe 20 may be attached / detached. The probe 20 may include a cable including a connection terminal connectable to the body 41.
[0096] Reference Figure 2D The probe 20 may be wirelessly connected to the ultrasound imaging device 40d. The body 41 may include an input / output interface (eg, a touch screen). The input / output interface may display an ultrasound image, various information processed in the ultrasound image, a GUI, and the like.
[0097] The ultrasonic imaging device 40d may establish communication with the probe 20 by using short-range wireless communication or may be paired with the probe 20. For example, the ultrasonic imaging device 40d may communicate with the probe 20 by using Bluetooth, BLE, Wi-Fi, or WFD.
[0098] The ultrasonic imaging devices 40c and 40d may execute a program or application program related to the probe 20 to control the probe 20 and output information related to the probe 20. The ultrasonic imaging devices 40c and 40d may perform operations related to the probe 20 by communicating with a preset server. The probe 20 may be registered in the ultrasonic imaging devices 40c and 40d or the preset server. The ultrasonic imaging devices 40c and 40d may communicate with the probe 20 registered therein and perform operations related to the probe 20.
[0099] In addition, the ultrasonic imaging devices 40c and 40d may include an input / output interface (which may be one or more of various types), such as a speaker, an LED, a vibration device, etc. For example, the ultrasonic imaging devices 40c and 40d may output various information in the form of graphics, sound, or vibration through the input / output interface. In addition, the ultrasonic imaging devices 40a and 40b may output various notifications or data through the input / output interface. As an example, the main body 41 in the ultrasonic imaging devices 40c and 40d may be included in the display 145, and the display 145 may correspond to Figure 1A and Figure 1B Display 140.
[0100] According to an embodiment of the present disclosure, the ultrasonic imaging device 40a, 40b, 40c or 40d can process an ultrasonic image or obtain additional information from an ultrasonic image by using an artificial intelligence (AI) model. According to an embodiment of the present disclosure, the ultrasonic imaging device 40a, 40b, 40c or 40d can generate an ultrasonic image or perform processing on the ultrasonic image, such as compensation, image quality enhancement, encoding or decoding, by using an AI model. In addition, according to an embodiment of the present disclosure, the ultrasonic imaging device 40a, 40b, 40c or 40d can perform processing on the ultrasonic image by using an AI model, such as defining a baseline, obtaining anatomical information, obtaining lesion information, extracting a plane, defining a boundary, measuring a length, measuring a width, measuring a volume, or generating annotations.
[0101] The AI model may be included in the ultrasound imaging device 40a, 40b, 40c, 40d or a server.
[0102] The AI model can be implemented by using various artificial neural network (ANN) models or deep neural network (DNN) models. In addition, the AI model can be learned and generated by using various machine learning algorithms or deep learning algorithms. The AI model can be implemented by using models such as convolutional neural network (CNN), recurrent neural network (RNN), generative adversarial network (GAN), long short-term memory (LSTM), etc.
[0103] Figure 3A and Figure 3B is a block diagram showing a configuration of an ultrasonic imaging device according to an embodiment of the present disclosure. According to various embodiments of the present disclosure, Figure 3A and Figure 3B The ultrasound imaging device 40 shown in FIG. Figure 1A and 1B The ultrasonic imaging device 40 is described instead.
[0104] Figure 3A and Figure 3B The components shown in the figure may be only embodiments of the present disclosure, and the components included in the ultrasonic imaging device 40 are not limited to Figure 3Aand Figure 3B The ultrasonic imaging device 40 according to an embodiment of the present disclosure may not include those components shown in FIG. Figure 3A and Figure 3B Some of the components shown in, or may also include Figure 3A and Figure 3B In addition, the components related to Figure 3A and 3B The components shown in the figure repeat the description of the components.
[0105] Reference Figure 3A , the ultrasound imaging device 40 may include a processor 120 , a display 140 , and a memory 150 .
[0106] The display 140 may display each of a plurality of ultrasound images obtained from the volume data in a preset display area. In an embodiment, the ultrasound image displayed on the display 140 may include an ultrasound image whose specific cross section is rotated, or an ultrasound image whose specific cross section is converted into another cross section. In an embodiment, the display 140 may display the ultrasound image and various indicators related to the ultrasound image. Details about various ultrasound images and indicators displayed on the display 140 will be described in more detail through the drawings and descriptions thereof to be described below.
[0107] The memory 150 may store instructions or program codes for executing functions or operations of the ultrasound imaging device 40. In an embodiment, at least one instruction, algorithm, data structure, program code, and application stored in the memory 150 may be implemented in a programming language or scripting language such as C, C++, Java, assembler, etc.
[0108] In an embodiment, the memory 150 may include at least one of a flash memory, a hard disk memory, a multimedia card micro memory, a card-type memory (e.g., a secure digital (SD) memory or an extreme digital (XD) memory), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a mask ROM, a flash ROM, a hard disk drive (HDD), or a solid-state drive (SSD).
[0109] The processor 120 may execute one or more instructions of a program stored in the memory 150. In an embodiment, the processor 120 may be configured with hardware components that perform arithmetic, logic, and input / output operations and signal processing. In an embodiment, the processor 120 may be configured with, for example, at least one of a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU), an application specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), or a field programmable gate array (FPGA), but is not limited thereto. In an embodiment, the processor 120 may include a plurality of processors.
[0110] In the case where the method according to an embodiment of the present disclosure includes multiple operations, the multiple operations may be performed by a single or multiple processors. For example, in the case where the first operation, the second operation, and the third operation are performed by the method according to the embodiment, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor, and the third operation may be performed by the second processor. However, the embodiments of the present disclosure are not limited thereto.
[0111] One or more processors according to the present disclosure may be implemented as a single-core processor or a multi-core processor. In the case where the method according to an embodiment of the present disclosure includes multiple operations, the multiple operations may be performed by a single core or multiple cores included in one or more processors.
[0112] Reference Figure 3B , the ultrasound imaging device 40 may include a probe 20, a processor 120, a display 140, and a memory 150. Figure 3B The processor 120, the display 140 and the memory 150 of the ultrasonic imaging device 40 shown in FIG. 1 correspond to the reference Figure 3A The processor 120 , the display 140 , and the memory 150 of the ultrasonic imaging apparatus 40 are described above, so a repeated description thereof will be omitted.
[0113] The probe 20 may include a wired probe that is wiredly connected to the ultrasound imaging device 40 for wired communication with the ultrasound imaging device 40, a wireless probe that is wirelessly connected to the ultrasound imaging device 40 for wireless communication with the ultrasound imaging device 40, and / or a hybrid probe that is wiredly connected or wirelessly connected to the ultrasound imaging device 40 for wired communication or wireless communication with the ultrasound imaging device 40.
[0114] In an embodiment, the probe 20 may transmit an ultrasonic signal to an object and receive an ultrasonic signal reflected from the object, thereby forming a received signal. In an embodiment, at least one processor 120 may generate ultrasonic data based on the received signal received from the probe 20. In an embodiment, at least one processor 120 may control the probe 20 to transmit / receive an ultrasonic signal and form a received signal. Details related to the operation of the probe 20 have been described above, and accordingly, repeated descriptions will be omitted.
[0115] In the following, the Figure 3A and Figure 3B The operation of the processor 120 is described in detail with reference to the following figures. In addition, the operation of the processor 120 may correspond to the operation of the ultrasonic imaging device 40 which will be described with reference to the following figures.
[0116] In an embodiment, the at least one processor 120 may execute one or more instructions to obtain a reference cross-sectional image intersecting the first axis from the volume data.
[0117] In an embodiment, the at least one processor 120 may execute one or more instructions to obtain a candidate standard cross-sectional image intersecting a second axis different from the first axis from the volume data.
[0118] In an embodiment, the at least one processor 120 may execute one or more instructions to display the reference cross-sectional image and the candidate standard cross-sectional image on the first GUI view.
[0119] In an embodiment, the at least one processor 120 may execute one or more instructions to rotate the reference cross-sectional image on the first GUI view.
[0120] In an embodiment, the at least one processor 120 may execute one or more instructions to adjust a slice plane of the candidate standard cross-sectional image based on the rotation of the reference cross-sectional image, and thereby update the candidate standard cross-sectional image on the first GUI view.
[0121] In an embodiment, the at least one processor 120 may include an operation of executing one or more instructions to display the updated candidate standard cross-sectional image as the standard cross-sectional image on the first GUI view according to completion of the rotation of the reference cross-sectional image.
[0122] In an embodiment, the standard cross-sectional image may include at least one anatomical landmark.
[0123] In an embodiment, the standard cross-sectional image may correspond to a mid-sagittal plane (MSP) of the subject.
[0124] In an embodiment, the reference cross-sectional image may correspond to at least one of a coronal plane or an axial plane of the volume data. In an embodiment, the candidate standard cross-sectional image may correspond to a sagittal plane of the volume data.
[0125] In an embodiment, at least one processor 120 may execute one or more instructions to display a first indicator and a second indicator on a first GUI view, the first indicator representing a first line formed as an intersection line of a slice plane of a reference cross-sectional image and a slice plane of a candidate standard cross-sectional image, and the second indicator representing a second line formed as an intersection line of a slice plane of the reference cross-sectional image and a slice plane of the standard cross-sectional image.
[0126] In an embodiment, the at least one processor 120 may execute one or more instructions to display an angle indicator on the first GUI view, the angle indicator indicating an angle between the first indicator and the second indicator.
[0127] In an embodiment, the at least one processor 120 may execute one or more instructions to adjust a slice plane of the candidate standard cross-sectional image so that an angle between the first indicator and the second indicator corresponds to an angle between the reference cross-sectional image and the standard cross-sectional image.
[0128] In an embodiment, the at least one processor 120 may execute one or more instructions to complete rotating the reference cross-sectional image when the angle between the first indicator and the second indicator becomes zero.
[0129] In an embodiment, the at least one processor 120 may execute one or more instructions to display at least one anatomical landmark on the first GUI view, the at least one anatomical landmark having a preset color distinguished from other regions.
[0130] Figure 4 is a flowchart for describing a method of controlling an ultrasonic imaging apparatus according to an embodiment of the present disclosure.
[0131] Will refer to Figure 4 The operation of the ultrasonic imaging device 40 is schematically described, and details about each of the operations will be described with reference to the following drawings. The operation of the ultrasonic imaging device 40 to be described below can be performed by Figure 3A and Figure 3B Executed by at least one processor 120.
[0132] In operation S410, the ultrasonic imaging device 40 may obtain volume data of the object. The volume data may include three-dimensional ultrasonic data formed based on the reception signal received from the probe 20. The volume data may be obtained by three-dimensionally arranging a two-dimensional ultrasonic image obtained based on the reception signal received from the probe 20 according to a position and performing interpolation, and the volume data may be configured as a group of a plurality of pixels having brightness values located in three dimensions. In an embodiment, the ultrasonic imaging device 40 may obtain a two-dimensional ultrasonic cross-sectional image by extracting a portion of the plurality of pixels of the volume data.
[0133] In an embodiment, the ultrasound imaging device 40 may obtain a standard cross-sectional image including at least one anatomical landmark for the object from the volume data.
[0134] In an embodiment, an anatomical landmark may be an anatomical feature observable in an ultrasound image of the object and may be used to extract a standard cross-sectional image from the volume data. For example, the anatomical landmarks for the object may include, but are not limited to, a midline (ML), a choroid plexus (CP), a diencephalon (DCP), a nuchal translucency (NT), a nasal bone (NB), and a palate (PL).
[0135] In an embodiment, a standard cross-sectional image may include a cross-section required for diagnosing a condition or disease of an object in an ultrasound image. For example, depending on whether the object is a fetus, in order to observe the growth status according to the number of weeks of the fetus, it may be necessary to observe the crown-rump length (CRL), which is the length from the top of the fetus's head to the buttocks. In this case, in order to more accurately observe the CRL of the fetus, it may be necessary to obtain the MSP of the fetus (including a cross-section of the CRL). However, the present disclosure is not necessarily limited to the above examples. The standard cross-sectional image may include a lateral sagittal plane (PSP), a transthalamic plane (TTP), a transventricular plane (TVP), a transcerebellar plane (TCP), etc., and the standard cross-sectional image may include common anatomical landmarks and different anatomical landmarks.
[0136] In an embodiment, the ultrasonic imaging device 40 may obtain a standard cross-sectional image for the object from the volume data based on the component vector of the anatomical landmark. In an embodiment, the ultrasonic imaging device 40 may identify a region corresponding to the anatomical landmark included in the volume data by performing segmentation on the volume data. In an embodiment, the ultrasonic imaging device 40 may obtain the component vector of the anatomical landmark by performing principal component analysis (PCA) on the identified region corresponding to the anatomical landmark. In an embodiment, the ultrasonic imaging device 40 may identify a center point (or centroid) of the region corresponding to the anatomical landmark from the volume data. In an embodiment, the ultrasonic imaging device 40 may obtain a standard cross-sectional image including the anatomical landmark by slicing the volume data along a plane including the identified center point and perpendicular to the obtained component vector.
[0137] In an embodiment, the ultrasonic imaging device 40 may identify a region corresponding to an anatomical landmark from the volume data by applying the volume data to a segmentation module. The segmentation module may include a model that learns by using the volume data as an input to output a segmentation map. The segmentation map may include data in which a plurality of anatomical landmarks included in the volume data are distinguished from each other. For example, the segmentation map may include data in which pixels that do not correspond to anatomical landmarks in the volume data have a value of 0 and pixels that respectively correspond to a plurality of anatomical landmarks have values other than 0. The segmentation module may be trained based on a learning data set in which a plurality of anatomical landmarks included in the volume data are marked as being distinguished from each other, and by performing the training, the neural network parameters of the segmentation module may be optimized. In an embodiment, the segmentation module may be stored in the memory 150 of the ultrasonic imaging device 40, and the ultrasonic imaging device 40 may train the segmentation module stored in the memory 150, or identify a region corresponding to an anatomical landmark through the trained segmentation module stored in the memory 150.
[0138] In an embodiment, the ultrasonic imaging device 40 may obtain a standard cross-sectional image including an anatomical landmark from the volume data by applying the volume data to a standard cross-sectional image extraction module. The standard cross-sectional image extraction module may include a model that is learned by using the volume data as an input to extract a standard cross-sectional image including an anatomical landmark. For example, according to the volume data input to the standard cross-sectional image extraction module, at least one of a plurality of standard cross-sectional images that can be obtained from the volume data may be output. In an embodiment, the ultrasonic imaging device 40 may obtain a user input of selecting at least one from a plurality of standard cross-sectional images, and obtain the selected at least one standard cross-sectional image from the standard cross-sectional image extraction module. The standard cross-sectional image extraction module may be trained based on a learning data set including the volume data and a plurality of standard cross-sectional images that can be obtained from the volume data, and by performing the training, the neural network parameters of the standard cross-sectional image extraction module may be optimized. In an embodiment, the standard cross-sectional image extraction module may be stored in the memory 150 of the ultrasonic imaging device 40, and the ultrasonic imaging device 40 may obtain the standard cross-sectional image by training the standard cross-sectional image extraction module stored in the memory 150, or by the trained standard cross-sectional image extraction module stored in the memory 150.
[0139] In an embodiment, the ultrasonic imaging device 40 may translate the acquired volume data so that the center point of the volume data is located at the center point of the anatomical landmark included in the standard cross-sectional image. In an embodiment, the ultrasonic imaging device 40 may translate the volume data by calculating a translation vector based on a difference between the center point of the volume data and the center point of the anatomical landmark included in the standard cross-sectional image and moving the coordinates of a plurality of voxels included in the volume data by the calculated translation vector.
[0140] In an embodiment, the reference cross-sectional image obtained in operation S420 described below and the candidate standard cross-sectional image obtained in operation S430 described below may be cross-sectional images obtained from the translated volume data. In operation S420, the ultrasonic imaging apparatus 40 may obtain a reference cross-sectional image crossing the first axis from the volume data.
[0141] In an embodiment, the cross-sectional image intersecting the first axis may include a cross-sectional image of the volume data forming a preset angle relative to the first axis. For example, in the case where the first axis is the X axis of the XYZ coordinate system, the reference cross-sectional image intersecting the X axis may include a cross-sectional image of the volume data sliced in a YZ plane perpendicular to the X axis. In an embodiment, the ultrasonic imaging device 40 may obtain the reference cross-sectional image intersecting the X axis by extracting pixels of the volume data located on a plane intersecting the first axis.
[0142] In an embodiment, the ultrasonic imaging device 40 may obtain a reference cross-sectional image intersecting the first axis from the translated volume data. In this case, the position of the center point of the translated volume data may be the same as the position of the center point of the anatomical landmark included in the standard cross-sectional image. Therefore, the reference cross-sectional image may include the anatomical landmark included in the standard cross-sectional image. For example, in the case where the standard cross-sectional image is an MSP including the ML of the object, the reference cross-sectional image may include the center point of the ML of the object and include a cross section of the ML located on a slice plane intersecting the first axis. In operation S430, the ultrasonic imaging device 40 may obtain a candidate standard cross-sectional image intersecting a second axis from the volume data, the second axis being different from the first axis.
[0143] In an embodiment, the second axis different from the first axis may be an axis forming a preset angle relative to the first axis. For example, in the case where the first axis is the X axis of the XYZ coordinate system, the second axis may include a Y axis or a Z axis perpendicular to the X axis. In an embodiment, the ultrasonic imaging device 40 may obtain a candidate standard cross-sectional image by extracting pixels located on a plane intersecting the second axis from the volume data.
[0144] In an embodiment, because the first axis of the reference cross-sectional image and the second axis of the candidate standard cross-sectional image form a preset angle, the reference cross-sectional image and the standard cross-sectional image may also form a preset angle. In other words, the reference cross-sectional image and the candidate standard cross-sectional image may include that the anatomical features of the object can be observed from the volume data sliced along different planes.
[0145] In an embodiment, the ultrasonic imaging device 40 may obtain a plurality of cross-sectional images intersecting the X-axis, the Y-axis, and the Z-axis from the volume data. The ultrasonic imaging device 40 may obtain one of the plurality of cross-sectional images as a candidate standard cross-sectional image, and obtain at least one of the remaining cross-sectional images of the plurality of cross-sectional images that are not candidate standard cross-sectional images as a reference cross-sectional image. In this document, the plurality of cross-sectional images intersecting the X-axis, the Y-axis, and the Z-axis may correspond to the coronal plane, the axial plane, and the sagittal plane, respectively. However, the present disclosure is not limited thereto, and the correspondence between the plurality of cross-sectional images intersecting the X-axis, the Y-axis, and the Z-axis and the coronal plane, the axial plane, and the sagittal plane may be different.
[0146] In an embodiment, the ultrasonic imaging device 40 may obtain a candidate standard cross-sectional image intersecting the second axis from the translated volume data. In this case, the position of the center point of the translated volume data may be the same as the position of the center point of the anatomical landmark included in the standard cross-sectional image. Therefore, the candidate standard cross-sectional image may include the anatomical landmark included in the standard cross-sectional image. For example, in the case where the standard cross-sectional image is an MSP including the ML of the object, the reference cross-sectional image may include the center point of the ML of the object and include a cross section of the ML located on a slice plane intersecting the second axis.
[0147] In an embodiment, the ultrasonic imaging device 40 may determine a cross-sectional image corresponding to a standard cross-sectional image from the coronal plane, the axial plane, and the sagittal plane obtained from the volume data as a candidate standard cross-sectional image. In an embodiment, each of the multiple standard cross-sectional images that can be obtained from the volume data may be set in advance to correspond to one of the coronal plane, the axial plane, and the sagittal plane. For example, the standard cross-sectional images of MSP and PSP may be set in advance to correspond to the sagittal plane, and the standard cross-sectional images of TTP, TVP, and TCP may be set in advance to correspond to the axial plane. In an embodiment, information representing a preset correspondence may be stored in the ultrasonic imaging device 40, and the ultrasonic imaging device 40 may determine one of the coronal plane, the axial plane, and the sagittal plane obtained from the volume data as a candidate standard cross-sectional image based on the stored information, and determine at least one of the cross-sectional images that have not been determined as candidate standard cross-sectional images as a reference cross-sectional image.
[0148] In an embodiment, the ultrasonic imaging device 40 may calculate the angle of each of the coronal plane, the axial plane, and the sagittal plane obtained from the volume data relative to the standard cross-sectional image, and determine the cross-sectional image having the smallest angle relative to the standard cross-sectional image as a candidate standard cross-sectional image. For example, in the case where the standard cross-sectional image is an MSP, the sagittal plane among the coronal plane, the axial plane, and the sagittal plane may be a cross-sectional image having the smallest angle relative to the standard cross-sectional image. Therefore, the ultrasonic imaging device 40 may determine the sagittal plane as a candidate standard cross-sectional image, and determine at least one of the coronal plane or the axial plane as a reference cross-sectional image.
[0149] In operation S440, the ultrasonic imaging device 40 may display the reference cross-sectional image and the candidate standard cross-sectional image on the first GUI view. In an embodiment, the first GUI may include an area on which the reference cross-sectional image is displayed and an area on which the candidate standard cross-sectional image is displayed. In an embodiment, the area on which the candidate standard cross-sectional image is displayed may be larger than the area on which the reference cross-sectional image is displayed.
[0150] In an embodiment, a plurality of reference cross-sectional images may be obtained, and in this case, the first GUI may display the plurality of reference cross-sectional images on the first GUI view by including areas on which the plurality of reference cross-sectional images are respectively displayed. For example, the reference cross-sectional image may correspond to a coronal plane and an axial plane, and the candidate standard cross-sectional image may correspond to a sagittal plane. In this case, all of the coronal plane, the axial plane, and the sagittal plane obtained from the volume data may be displayed on the first GUI view.
[0151] In an embodiment, the ultrasonic imaging device 40 may display a first indicator and a second indicator on the first GUI view, the first indicator representing a first line formed as an intersection line of a slice plane of a reference cross-sectional image and a slice plane of a candidate standard cross-sectional image, and the second indicator representing a second line formed as an intersection line of a slice plane of the reference cross-sectional image and a slice plane of the standard cross-sectional image. In an embodiment, a plurality of reference cross-sectional images may be obtained, and in this case, a first indicator and a second indicator for each of the plurality of reference cross-sectional images may be displayed on the first GUI view. For example, in a case where the reference cross-sectional image includes an axial plane and a coronal plane, a first indicator and a second indicator for the axial plane and a first indicator and a second indicator for the coronal plane may be displayed on the first GUI view.
[0152] In an embodiment, since the first indicator indicates a first line formed as an intersection line of a slice plane of a reference cross-sectional image and a slice plane of a candidate standard cross-sectional image, the first indicator may indicate position information of the slice plane of the candidate standard cross-sectional image. In addition, since the second indicator indicates a second line formed as an intersection line of a slice plane of a reference cross-sectional image and a slice plane of a standard cross-sectional image, the second indicator may indicate position information of the slice plane of the standard cross-sectional image. Therefore, the ultrasonic imaging device 40 may indicate position information of the slice plane of the candidate standard cross-sectional image and the slice plane of the standard cross-sectional image relative to the reference cross-sectional image through the first indicator and the second indicator.
[0153] In an embodiment, the ultrasound imaging device 40 may display an angle indicator indicating the angle between the first indicator and the second indicator on the first GUI view. In an embodiment, the angle indicator may include a graphical element indicating the angle, such as an icon, a graphic, a circular bar, etc., or a text indicating the angle value. In an embodiment, while displaying the first indicator and the second indicator for each of the multiple reference cross-sectional images, the angle indicator for each of the multiple reference cross-sectional images may be displayed. For example, the ultrasound imaging device 40 may display an angle indicator indicating the angle between the first indicator and the second indicator for the axial plane (as one of the reference cross-sectional images) on the first GUI view, and display an angle indicator indicating the angle between the first indicator and the second indicator for the coronal plane.
[0154] In operation S450, the ultrasonic imaging device 40 may rotate the reference cross-sectional image on the first GUI view. In other words, the ultrasonic imaging device 40 may display the ultrasonic image with the reference cross-sectional image rotated on the first GUI view. In an embodiment, when a plurality of reference cross-sectional images are displayed, the ultrasonic imaging device 40 may rotate each of the plurality of reference cross-sectional images on the first GUI view.
[0155] In an embodiment, the plurality of reference cross-sectional images may be rotated such that one cross-sectional image is rotated and then the remaining cross-sectional images are rotated. For example, in the case where the plurality of reference cross-sectional images include a coronal plane and an axial plane, on the first GUI view, the axial plane may not be rotated while the coronal plane is rotated, and after the rotation of the coronal plane is completed, the axial plane may be rotated, but is not limited thereto. However, all reference cross-sectional images in the plurality of reference cross-sectional images may be rotated.
[0156] In an embodiment, the ultrasonic imaging device 40 may rotate the reference cross-sectional image so that the angle between the first indicator and the second indicator decreases. In an embodiment, when the reference cross-sectional image rotates, the first indicator may be displayed at a position where the first indicator has been previously displayed. In other words, although the reference cross-sectional image rotates, the display position of the first indicator may not change. In an embodiment, the second indicator may be displayed at a fixed position on the reference cross-sectional image. In other words, when the reference cross-sectional image rotates, the second indicator may be displayed while rotating with the reference cross-sectional image. Therefore, when the reference cross-sectional image rotates, the angle between the first indicator and the second indicator may change, and the ultrasonic imaging device 40 may rotate the reference cross-sectional image in a direction in which the angle between the first indicator and the second indicator decreases. In an embodiment, when the reference cross-sectional image rotates, the angle indicator representing the angle between the first indicator and the second indicator may be updated to represent the changed angle between the first indicator and the second indicator and displayed.
[0157] In operation S460, the ultrasonic imaging device 40 may update the candidate standard cross-sectional image on the first GUI view by adjusting the slice plane of the candidate standard cross-sectional image based on the rotation of the reference cross-sectional image. Herein, updating the candidate standard cross-sectional image by the ultrasonic imaging device 40 may be the following operation: obtaining a new candidate standard cross-sectional image by adjusting the slice plane of the previously obtained candidate standard cross-sectional image relative to the volume data, and displaying the obtained candidate standard cross-sectional image on the first GUI view.
[0158] In an embodiment, the ultrasonic imaging device 40 may calculate the angle between the first indicator and the second indicator that changes based on the rotation of the reference cross-sectional image and adjust the slice plane of the candidate standard cross-sectional image so that the calculated angle corresponds to the angle between the first line formed as the intersection line between the slice plane of the reference cross-sectional image and the slice plane of the candidate standard cross-sectional image, and the second line formed as the intersection line between the slice plane of the reference cross-sectional image and the slice plane of the standard cross-sectional image. For example, in the case where the angle between the first indicator and the second indicator changes from 20 degrees to 10 degrees according to the rotation of the reference cross-sectional image, the ultrasonic imaging device 40 may adjust the slice plane of the candidate standard cross-sectional image so that the angle between the first line and the second line changes from 20 degrees to 10 degrees.
[0159] In an embodiment, when a plurality of reference cross-sectional images are obtained, the angle between the first indicator and the second indicator of the non-rotated reference cross-sectional image may not change. In this case, the ultrasonic imaging device 40 may adjust the slice plane of the candidate standard cross-sectional image so that the angle between the first line formed as the intersection line of the slice plane of the non-rotated reference cross-sectional image and the slice plane of the candidate standard cross-sectional image and the second line formed as the intersection line of the slice plane of the non-rotated reference cross-sectional image and the slice plane of the standard cross-sectional image does not change.
[0160] In operation S470, according to the completion of the rotation of the reference cross-sectional image, the ultrasonic imaging apparatus 40 may display the updated candidate standard cross-sectional image as the standard cross-sectional image on the first GUI view.
[0161] In an embodiment, when the angle between the first indicator and the second indicator becomes zero, the ultrasonic imaging device 40 may complete the rotation of the reference cross-sectional image. In an embodiment, when a plurality of reference cross-sectional images are obtained, the ultrasonic imaging device 40 may complete the rotation of the reference cross-sectional image when all angles between the first indicator and the second indicator of the reference cross-sectional image become zero, and display the updated candidate standard cross-sectional image as the standard cross-sectional image on the first GUI view.
[0162] In an embodiment, according to the completion of the rotation of the reference cross-sectional image, the ultrasonic imaging device 40 may display a notification indicator on the first GUI view indicating that the standard cross-sectional image has been displayed. In an embodiment, the notification indicator may include identification information of the standard cross-sectional image, such as the name of the standard cross-sectional image, or anatomical feature information including the name, size, shape, etc. of the anatomical landmark included in the standard cross-sectional image. Therefore, the user can easily understand through the displayed notification indicator that the rotation of the reference cross-sectional image has currently been completed and the standard cross-sectional image is displayed.
[0163] In an embodiment, the ultrasonic imaging device 40 may display one or more anatomical landmarks having a preset color distinguished from other regions on the first GUI view. In an embodiment, the one or more anatomical landmarks may include one or more anatomical landmarks included in the reference cross-sectional image, the candidate standard cross-sectional image, and the standard cross-sectional image. In other words, the ultrasonic imaging device 40 may display the reference cross-sectional image, the candidate standard cross-sectional image, and the standard cross-sectional image including the anatomical landmarks having a preset color distinguished from other regions on the first GUI view.
[0164] In an embodiment, one or more anatomical landmarks may be displayed in different preset colors. For example, ML among the anatomical landmarks may be displayed in green on the first GUI view, and CP may be displayed in blue on the first GUI view. In this way, since the ultrasound imaging device 40 displays one or more landmarks included in the ultrasound image in different colors, the ultrasound imaging device 40 may help the user analyze the anatomical features of the corresponding object.
[0165] In an embodiment, the ultrasonic imaging device 40 can display one or more anatomical landmarks with preset colors included in the reference cross-sectional image, the candidate standard cross-sectional image, and the standard cross-sectional image by identifying the region corresponding to the anatomical landmark from the volume data. The method in which the ultrasonic imaging device 40 identifies the region corresponding to the anatomical landmark included in each cross-sectional image from the volume data has been described above, and therefore, repeated description will be omitted.
[0166] In an embodiment, the ultrasound imaging device 40 may display a three-dimensional ultrasound image of the object on the first GUI view. In an embodiment, the ultrasound imaging device 40 may obtain a three-dimensional ultrasound image of the object by setting the surrounding area of the object as the region of interest in the volume data and performing 3D rendering on the three-dimensional data set as the region of interest in the volume data. For example, the ultrasound imaging device 40 may obtain a three-dimensional ultrasound image of a fetus by setting the surrounding area of the fetus as the region of interest in the volume data and performing 3D rendering.
[0167] In an embodiment, the ultrasound imaging device 40 may receive a user input for setting a region of interest of a three-dimensional ultrasound image. For example, the user input for setting the region of interest may include a touch input for selecting an object of the ultrasound image displayed by the touch screen of the display 140, or the user input for setting the region of interest may be received through the input interface 170, but is not limited thereto.
[0168] In an embodiment, the ultrasonic imaging device 40 may change the rendering direction of the three-dimensional ultrasonic image based on the rotation of the reference cross-sectional image. In an embodiment, the rendering direction of the three-dimensional ultrasonic image may be a direction parallel to the slice plane of the candidate standard cross-sectional image. In an embodiment, by adjusting the slice plane of the candidate standard cross-sectional image based on the rotation of the reference cross-sectional image, the rendering direction may be changed to a direction parallel to the adjusted slice plane. In other words, the ultrasonic imaging device 40 may update the three-dimensional ultrasonic image on the first GUI view by changing the rendering direction of the three-dimensional ultrasonic image based on the rotation of the reference cross-sectional image.
[0169] As such, the ultrasonic imaging apparatus 40 according to an embodiment of the present disclosure can visually show the user how much the standard cross-sectional image obtained from volume data is tilted relative to the reference cross-sectional image, and show the user the process of updating the candidate standard cross-sectional image to the standard cross-sectional image.
[0170] Figure 5A is a view for describing a reference cross-sectional image and a standard cross-sectional image according to an embodiment of the present disclosure.
[0171] Reference Figure 5A , the ultrasonic imaging device 40 may obtain a sagittal plane, an axial plane, and a coronal plane from the volume data 500. The sagittal plane may be a cross-sectional image intersecting the Z-axis of the volume data 500, and may be a cross-sectional image having the A-plane 510 as a slice plane. The axial plane may be a cross-sectional image intersecting the Y-axis of the volume data 500, and may be a cross-sectional image having the B-plane 520 as a slice plane. The coronal plane may be a cross-sectional image intersecting the X-axis of the volume data 500, and may be a cross-sectional image having the C-plane 530 as a slice plane. However, the present disclosure is not limited thereto, and the correspondence between the sagittal plane and the slice plane, the axial plane and the slice plane, and the coronal plane and the slice plane may be different.
[0172] In an embodiment, the ultrasonic imaging device 40 may obtain a standard cross-sectional image from the volume data 500. The standard cross-sectional image may include at least one anatomical landmark of the object, and may be a cross-sectional image required for diagnosing a state or disease of the object and having a D plane 540 of the volume data 500 as a slice plane. In an embodiment, the standard cross-sectional image having the D plane 540 as a slice plane may correspond to the MSP of the object.
[0173] In an embodiment, the ultrasonic imaging device 40 may determine one of the sagittal plane, the axial plane, or the coronal plane as a candidate standard cross-sectional image. For example, the ultrasonic imaging device 40 may determine the A plane 510 of the volume data 500 that is pre-set to have a corresponding relationship with the standard cross-sectional image as a candidate standard cross-sectional image. As another example, the ultrasonic imaging device 40 may calculate the angles of the sagittal plane, the axial plane, and the coronal plane relative to the standard cross-sectional image, and determine the sagittal plane with the smallest angle as the candidate standard cross-sectional image. In this article, the angle of the sagittal plane relative to the standard cross-sectional image, the angle of the axial plane relative to the standard cross-sectional image, and the angle of the coronal plane relative to the standard cross-sectional image may include the angle of the A plane 510 relative to the D plane 540, the angle of the B plane 520 relative to the D plane 540, and the angle of the C plane 530 relative to the D plane 540.
[0174] Figure 5B is a view for describing a candidate standard cross-sectional image and a standard cross-sectional image according to an embodiment of the present disclosure.
[0175] Reference Figure 5B , the ultrasonic imaging device 40 may obtain a candidate standard cross-sectional image 511 and a standard cross-sectional image 541. In this context, the candidate standard cross-sectional image 511 may correspond to a standard cross-sectional image having Figure 5AThe A plane 510 is used as the sagittal plane of the slice plane, and the standard cross-sectional image 541 may correspond to the A plane 510 having Figure 5A The D plane 540 is used as the MSP of the slice plane.
[0176] In an embodiment, the candidate standard cross-sectional image 511 may be a cross-sectional image observable by slicing the object 550 along the a-line 561. Herein, the a-line 561 may be a line corresponding to the A-plane 510 of the volume data 500. In other words, because the A-plane 510 of the volume data 500 of the candidate standard cross-sectional image 511 is a preset slicing plane regardless of the position of the object 550, all of the one or more landmarks included in the MSP may not be accurately observed in the candidate standard cross-sectional image 511.
[0177] According to an embodiment, the standard cross-sectional image 541 may be a cross-sectional image observable by slicing the object 550 along the b-line 562. Herein, the b-line 562 may be a line that makes the right and left sides of the object 550 symmetrical. In other words, because the D plane 540 of the volume data 500 of the standard cross-sectional image 541 is a slice plane determined based on the anatomical landmarks of the object 550, all of the one or more landmarks included in the MSP may be accurately observed in the standard cross-sectional image 541.
[0178] Like this, the standard cross-sectional image 541 used for diagnosis in the ultrasonic imaging device 40 may not be a reference cross-sectional image obtained by crossing the volume data 500 along a preset axis, but a cross-sectional image obtained by extracting to include an anatomical landmark to be observed. In this case, by providing the user with information between the standard cross-sectional image and the reference cross-sectional image, the user's confidence in the standard cross-sectional image can be improved.
[0179] Figure 6 is a view for describing a first GUI view according to an embodiment of the present disclosure.
[0180] Reference Figure 6 , the ultrasound imaging device 40 may display the sagittal plane 610, the axial plane 620, and the coronal plane 630 on the first GUI view. Herein, the first GUI view may include a screen on which the sagittal plane 610, the axial plane 620, and the coronal plane 630 are displayed. In addition, the sagittal plane 610 may correspond to a Figure 5A The A plane 510 of the volume data 500 is used as a candidate standard cross-sectional image of the slice plane, and the axial plane 620 and the coronal plane 630 may correspond to the image having Figure 5A The B plane 520 of the volume data 500 is used as a slice plane and has Figure 5A The C plane 530 of the volume data 500 is used as a reference cross-sectional image of the slice plane.
[0181] In an embodiment, the ultrasound imaging device 40 may display a first indicator 621 and a second indicator 622 for the axial plane 620 on the first GUI view. Herein, the first indicator 621 for the axial plane 620 may represent a first line 601 formed as an intersection line of the A plane 510 and the B plane 520 on the volume data 500. In addition, the second indicator 622 for the axial plane 620 may represent a second line 602 formed as an intersection line of the B plane 520 and the D plane 540 as a slice plane of the MSP on the volume data 500.
[0182] In an embodiment, an angle indicator may be displayed on the first GUI view, the angle indicator indicating an angle of 15 degrees between the first indicator 621 and the second indicator 622 for the axial plane 620. Herein, the angle of 15 degrees indicated by the angle indicator may correspond to an angle between the first line 601 and the second line 602 for the axial plane 620 on the volume data 500.
[0183] In an embodiment, the ultrasound imaging device 40 may display a first indicator 631 and a second indicator 632 for the coronal plane 630 on the first GUI view. Herein, the first indicator 631 for the coronal plane 630 may represent a first line 603 formed as a cross line between the A plane 510 and the C plane 530 on the volume data 500. In addition, the second indicator 632 for the coronal plane 630 may represent a second line 604 formed as a cross line between the C plane 530 and the D plane 540 as slice planes of the MSP on the volume data 500.
[0184] In an embodiment, an angle indicator indicating an angle of 10 degrees between the first indicator 631 and the second indicator 632 for the coronal plane 630 may be displayed on the first GUI view. Herein, the angle of 10 degrees indicated by the angle indicator may correspond to an angle between the first line 603 and the second line 604 for the coronal plane 630 on the volume data 500.
[0185] Like this, the ultrasonic imaging device according to the embodiment of the present disclosure can display the first indicator and the second indicator to indicate how much the slice plane of the reference cross-sectional image intersecting the volume data along the preset axis is tilted relative to the slice plane of the standard cross-sectional image. Therefore, the user can more easily understand the position information of the standard cross-sectional image relative to the reference cross-sectional image.
[0186] Fig. 7A and Figure 7B 2 is a view for describing updating of candidate standard cross-sectional images according to an embodiment of the present disclosure.
[0187] Reference Fig. 7A, the ultrasonic imaging device 40 may rotate the axial plane 620a, which is one of the reference cross-sectional images, on the first GUI view. According to the completion of the rotation of the axial plane 620a, the rotated axial plane 620b may be displayed. When the axial plane 620a rotates, a first indicator 621 for the axial plane 620a may be displayed at a position where the first indicator 621 has been previously displayed, and a second indicator 622 for the axial plane 620a may be displayed at a fixed position on the axial plane 620a. Therefore, the angle between the first indicator 621 and the second indicator 622 may change, and the axial plane 620a may rotate in a clockwise direction in which the angle between the first indicator 621 and the second indicator 622 decreases.
[0188] In an embodiment, the rotation of the axial plane 620a may be completed when the angle between the first indicator 621 and the second indicator 622 becomes zero. In other words, the axial plane 620a may rotate 15 degrees in the clockwise direction and then stop. Because the rotated axial plane 620b has rotated until the angle between the first indicator 621 and the second indicator 622 becomes zero, the first indicator 621 and the second indicator 622 displayed together with the rotated axial plane 620b may indicate the same direction.
[0189] In an embodiment, when the axial plane 620a rotates on the first GUI view, the coronal plane 630a may not rotate. In other words, the axial plane 620a and the coronal plane 630a displayed as reference cross-sectional images on the first GUI view may rotate independently, and when any one of the axial plane 620a or the coronal plane 630a rotates, the other cross-sectional image may not rotate.
[0190] In an embodiment, the ultrasonic imaging device 40 may adjust the slice plane of the sagittal plane 610a as the candidate standard cross-sectional image based on the rotation of the axial plane 620a, thereby updating the sagittal plane 610a on the first GUI view. In an embodiment, according to the completion of the rotation of the axial plane 620a, the sagittal plane 610a having the A plane 510 of the volume data 500 as the slice plane may be updated to the sagittal plane 610b having the A' plane 515 of the volume data 500 as the slice plane, and the updated sagittal plane 610b may be displayed on the first GUI view.
[0191] When the axial plane 620a rotates, a plurality of axial planes divided according to a preset time interval or a preset angle interval may be continuously displayed. In this case, the slice plane of the sagittal plane 610a may be adjusted in a direction gradually approaching the A' plane 515 of the volume data 500 from the A plane 510 of the volume data 500 to correspond to the displayed plurality of axial planes, respectively.
[0192] In an embodiment, a line formed as an intersection line of the A′ plane 515 and the B plane 520 of the volume data 500 may correspond to a line formed as Figure 5A The second line 602 is the intersection line of the D plane 540 and the B plane 520 of the volume data 500. In an embodiment, the slice plane of the sagittal plane 610a can be adjusted in a direction parallel to the B plane 520 (as the slice plane of the axial plane 620a). Therefore, although the slice plane of the sagittal plane 610a is adjusted from the A plane 510 to the A' plane 515, the line formed as the intersection line between the adjusted slice plane and the C plane 530 is the same as the line formed as Figure 6 The angle between the second line 604 of the intersection line between the D-plane 540 and the C-plane 530 of the volume data 500 shown in FIG. 5 may not change.
[0193] Reference Figure 7B , the ultrasound imaging device 40 can rotate the axial plane 620a as one of the reference cross-sectional images on the first GUI view. Because the rotation of the coronal plane 630a corresponds to the above reference Fig. 7A The rotation of the axial plane 620a is described above, so a repeated description will be omitted.
[0194] In an embodiment, the ultrasound imaging device 40 may adjust the slice plane of the sagittal plane 610b as a candidate standard cross-sectional image based on the rotation of the coronal plane 630a, thereby updating the sagittal plane 610b on the first GUI view. Figure 7B The sagittal plane 610b may correspond to the Fig. 7A The sagittal plane 610b is updated by the rotation of the axial plane 620a of the volume data 500. In an embodiment, according to the completion of the rotation of the coronal plane 630a, the sagittal plane 610b having the A' plane of the volume data 500 as the slice plane can be updated to the sagittal plane 610c having the D plane 540 of the volume data 500 as the slice plane. Then, the updated sagittal plane 610c can be displayed on the first GUI view. In this article, considering that the D plane 540 having the volume data 500 is used as the slice plane, the updated sagittal plane 610c can correspond to the standard cross-sectional image.
[0195] In an embodiment, the slice plane of the sagittal plane 610b can be adjusted in a direction parallel to the C plane 530 which is the slice plane of the coronal plane 630a. Therefore, although the slice plane of the sagittal plane 610b is adjusted from the A' plane 515 to the D plane 540, the line formed as the intersection line of the adjusted slice plane and the B plane 520 is the same as the line formed as Figure 6 The angle between the second line 602 of intersection of the D-plane 540 and the C-plane 530 shown may not change.
[0196] Like this, the ultrasonic imaging device according to an embodiment of the present disclosure can update the candidate standard cross-sectional image to the standard cross-sectional image by rotating each of the reference cross-sectional images. In this article, because the direction in which the slice plane of the candidate standard cross-sectional image is adjusted depends on each of the reference cross-sectional images, the user can easily understand how much the standard cross-sectional image is tilted relative to each of the reference cross-sectional images.
[0197] Fig. 8A and Figure 8B is a view for describing displaying at least one anatomical landmark with a preset color by an ultrasound imaging apparatus according to an embodiment of the present disclosure.
[0198] Reference Fig. 8A , the ultrasound imaging device 40 may display at least one anatomical landmark having a preset color distinguished from other regions on the first GUI view. In this article, Fig. 8A The sagittal plane 610a may correspond to the candidate standard cross-sectional image, and the axial plane 620a and the coronal plane 630a may correspond to the reference cross-sectional image.
[0199] In an embodiment, the sagittal plane 610a may include the ML 811a, CP 812a, and DCP 813a of the fetus. In this case, the ML 811a may be displayed in green, the CP 812a may be displayed in blue, and the DCP 813a may be displayed in purple. In an embodiment, in the case where the standard cross-sectional image is the MSP, it may be necessary to exclude the CP 812a from the anatomical landmark. That is, because the sagittal plane 610a is a candidate standard cross-sectional image before the slice plane is adjusted based on the rotation of the axial plane 620a and the coronal plane 630a, the sagittal plane 610a may not include the anatomical features observable in the MSP.
[0200] In an embodiment, the axial plane 620a may include the ML 821a and the CP 822a of the fetus. In this case, the ML 821a of the axial plane 620a may be displayed in green, and the CP 822a of the axial plane 620a may be displayed in blue.
[0201] In an embodiment, the coronal plane 630a may include the ML 831a, CP 832a, and DCP 833a of the fetus. In this case, the ML 831a of the coronal plane 630a may be displayed in green, the CP 832a may be displayed in blue, and the DCP 833a may be displayed in purple.
[0202] In an embodiment, the ultrasonic imaging device 40 may display first indicators 621 and 631 indicating a first line on the first GUI view, the first line being formed as an intersection line of the slice plane of the axial plane 620a and the slice plane of the coronal plane 630a as the reference cross-sectional image and the slice plane of the sagittal plane 610a as the candidate standard cross-sectional image. In other words, the first indicators 621 and 631 may indicate position information of the slice plane of the sagittal plane 610a, which are observable in the axial plane 620a and the coronal plane 630a. Therefore, by comparing the ML821a and 831a displayed in green in the axial plane 620a and the coronal plane 630 with the first indicators 621 and 631, the user may easily understand how much the slice plane of the MSP as the candidate standard cross-sectional image is tilted relative to the slice plane of the sagittal plane 610a.
[0203] Reference Figure 8B , the ultrasound imaging device 40 may display at least one anatomical landmark having a preset color distinguished from other areas on the first GUI view. In this case, Figure 8B The sagittal plane 610c may correspond to a candidate standard cross-sectional image updated based on the reference cross-sectional image, and the axial plane 620b and the coronal plane 630b may correspond to the fully rotated reference cross-sectional image.
[0204] In an embodiment, the sagittal plane 610c may include the ML 811b, DCP 813b, and NB 814b of the fetus. In this case, the ML 811b and DCP 813b may be respectively used with Fig. 8A The ML 811a and DCP 813a of the sagittal plane 610a are displayed in the same color, and the NB 814b may be displayed in yellow. In an embodiment, the candidate standard cross-sectional image may be a cross-sectional image updated to the MSP as the standard cross-sectional image by adjusting the slice plane. Therefore, the sagittal plane 610c may include the NB 814b observable in the MSP but not the CP 812a, which is similar to Fig. 8A The sagittal plane 610a is different.
[0205] In an embodiment, the axial plane 620b may include the ML 821b and the CP 822b of the fetus, and the ML 821b and the CP 822b may be respectively used to Fig. 8A The ML 821a and CP 822a of the axial plane 620a are displayed in the same color.
[0206] In an embodiment, the coronal plane 630b may include the ML 831b, CP 832b, and DCP 833b of the fetus, and the ML 831b, CP 832b, and DCP 833b may be used to respectively Fig. 8AThe ML 831a, CP 832a and DCP 833a of the coronal plane 630a are displayed in the same color.
[0207] Like this, according to an embodiment of the present disclosure, one or more anatomical landmarks on the first GUI view can change size and position while maintaining a preset color, while updating the candidate standard cross-sectional image according to the rotation of the reference cross-sectional image. Therefore, the user can more easily recognize the changes in the anatomical landmarks observable in the image and have more confidence in the standard cross-sectional image displayed on the ultrasound imaging device.
[0208] Fig. 9 is a view for describing a three-dimensional ultrasonic image displayed by the ultrasonic imaging apparatus according to an embodiment of the present disclosure.
[0209] Reference Fig. 9 , the ultrasonic imaging device 40 may display three-dimensional ultrasonic images 910a and 910b of the object on the first GUI view. Fig. 9 The sagittal planes 610a and 610c, the axial planes 620a and 620b, and the coronal planes 630a and 630b may correspond to Fig. 8A and Figure 8B The sagittal planes 610a and 610c, the axial planes 620a and 620b, and the coronal planes 630a and 630b.
[0210] In an embodiment, the ultrasound imaging device 40 can display the three-dimensional ultrasound images 910a and 920b of the fetus by setting the surrounding area of the fetus as the region of interest in the volume data. In an embodiment, the three-dimensional ultrasound images 910a and 920b of the fetus can be displayed at one area of the sagittal planes 610a and 610c. However, the present disclosure is not limited to the above example, and one of the axial planes 620a and 620b and the coronal planes 630a and 630b can be replaced by the three-dimensional ultrasound images 910a and 920b and displayed.
[0211] In an embodiment, the rendering direction of the three-dimensional ultrasound images 910a and 920b may be parallel to the direction of the slice planes of the sagittal planes 610a and 610b. In an embodiment, the ultrasound imaging device 40 may display a position indicator 911 indicating the position of the slice planes of the sagittal planes 610a and 610c on the three-dimensional ultrasound images 910a and 920b.
[0212] For example, on the first GUI view on which the axial plane 620a and the coronal plane 630a are displayed without rotation, the sagittal plane 610a that is not updated and the three-dimensional ultrasound image 910a having a rendering direction parallel to the slice plane of the sagittal plane 610a may be displayed. In this case, because the sagittal plane 610a is a candidate standard cross-sectional image before the slice plane is adjusted, the position indicator 911 may not be displayed at a position passing through the center of the fetus included in the three-dimensional ultrasound image 910a.
[0213] In addition, on the first GUI view on which the rotated axial plane 620a and the coronal plane 630a are displayed, the sagittal plane 610c updated to the MSP as the standard cross-sectional image and the three-dimensional ultrasound image 910b having a rendering direction parallel to the slice plane of the sagittal plane 610c may be displayed. In this case, since the sagittal plane 610c corresponds to the MSP, the position indicator 911 may be displayed at a position passing through the center of the fetus included in the three-dimensional ultrasound image 910b.
[0214] Like this, the ultrasonic imaging device according to an embodiment of the present disclosure can display a three-dimensional ultrasonic image of an object together with a cross-sectional image of the object. In this article, because the rendering direction of the three-dimensional ultrasonic image can be changed to correspond to the candidate standard cross-sectional image updated as the standard cross-sectional image, the user's confidence in the standard cross-sectional image can also be improved.
[0215] In addition, the embodiments of the present disclosure may be implemented in the form of a computer-readable recording medium, which includes instructions that can be executed by a computer, such as a program module executed by a computer. The computer-readable recording medium may be any available medium that can be accessed by a computer, and may include volatile media or non-volatile media and separable media or inseparable media. In addition, the computer-readable recording medium may include computer storage media and communication media. The computer storage medium may include volatile media and non-volatile media and separable media and inseparable media implemented by any method or technology for storing information such as computer-readable instructions, data structures, program modules or other data. The communication medium may include other data of the modulated data signal, such as computer-readable instructions, data structures or program modules.
[0216] In addition, the computer-readable storage medium may be provided in the form of a non-transitory storage medium. In this document, the term "non-transitory storage medium" simply means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but the term does not distinguish between a location where data is semi-permanently stored in the storage medium and a location where data is temporarily stored in the storage medium. For example, a "non-transitory storage medium" may include a buffer that temporarily stores data.
[0217] The foregoing description is for illustrative purposes only, and it will be readily understood that a person of ordinary skill in the art may make various modifications thereto without changing the technical spirit and essential features of the present disclosure. Therefore, it should be understood that the above embodiments are for illustrative purposes only in all respects and not for limiting purposes. For example, each component described as a single type may be implemented in a distributed type, and components described as distributed may be implemented in a combined form.
[0218] The scope of the present disclosure is indicated by the claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and equivalent concepts should be construed as being included in the scope of the present disclosure.
Claims
1. A method for controlling an ultrasonic imaging device, the method comprising: obtaining volume data of the object; obtaining a reference cross-sectional image intersecting a first axis from the volume data; obtaining, from the volume data, a candidate standard cross-sectional image intersecting a second axis different from the first axis; Displaying the reference cross-sectional image and the candidate standard cross-sectional image on a first GUI view; rotating the reference cross-sectional image on the first GUI view; updating the candidate standard cross-sectional image on the first GUI view by adjusting a slice plane of the candidate standard cross-sectional image based on the rotation of the reference cross-sectional image; as well as According to the completion of the rotation of the reference cross-sectional image, the updated candidate standard cross-sectional image is displayed as the standard cross-sectional image on the first GUI view, Wherein, the standard cross-sectional image includes at least one anatomical landmark.
2. The method according to claim 1, wherein: The standard cross-sectional image corresponds to one of a midsagittal plane, a lateral sagittal plane, a transthalamic plane, a transventricular plane, and a transcerebellar plane of the subject.
3. The method according to claim 1, wherein: The reference cross-sectional image corresponds to at least one of a coronal plane or an axial plane of the volume data, and The candidate standard cross-sectional image corresponds to a sagittal plane of the volume data.
4. The method according to claim 1, wherein: Displaying the reference cross-sectional image and the candidate standard cross-sectional image comprises: A first indicator and a second indicator are displayed on the first GUI view, the first indicator representing a first line formed as an intersection line of a slice plane of the reference cross-sectional image and a slice plane of the candidate standard cross-sectional image, and the second indicator representing a second line formed as an intersection line of the slice plane of the reference cross-sectional image and a slice plane of the standard cross-sectional image.
5. The method according to claim 4, wherein: Displaying the reference cross-sectional image and the candidate standard cross-sectional image includes: displaying an angle indicator on the first GUI view, the angle indicator indicating an angle between the first indicator and the second indicator.
6. The method according to claim 4, wherein: Rotating the reference cross-sectional image includes: rotating the reference cross-sectional image so that an angle between the first indicator and the second indicator decreases.
7. The method according to claim 4, wherein: The updating includes adjusting the slice plane of the candidate standard cross-sectional image so that an angle between the first indicator and the second indicator corresponds to an angle between the reference cross-sectional image and the standard cross-sectional image.
8. The method according to claim 7, wherein: Displaying the updated candidate standard cross-sectional image as the standard cross-sectional image includes: completing the rotation of the reference cross-sectional image when an angle between the first indicator and the second indicator becomes zero.
9. The method according to claim 1 further comprises displaying the at least one anatomical landmark on the first GUI view using a preset color that is distinguished from other areas.
10. The method of claim 1, further comprising displaying a three-dimensional ultrasound image of the object on the first GUI view.
11. An ultrasonic imaging device, comprising: monitor; a memory storing one or more instructions; as well as at least one processor configured to execute the one or more instructions stored in the memory, Wherein, the at least one processor is configured to execute the one or more instructions to: Obtaining the object's volume data, obtaining a reference cross-sectional image intersecting the first axis from the volume data, obtaining a candidate standard cross-sectional image intersecting a second axis from the volume data, the second axis being different from the first axis, displaying the reference cross-sectional image and the candidate standard cross-sectional image on a first GUI view, rotating the reference cross-sectional image on the first GUI view, updating the candidate standard cross-sectional image on the first GUI view by adjusting a slice plane of the candidate standard cross-sectional image based on the rotation of the reference cross-sectional image; According to the completion of the rotation of the reference cross-sectional image, the updated candidate standard cross-sectional image is displayed as the standard cross-sectional image on the first GUI view, Wherein, the standard cross-sectional image includes at least one anatomical landmark.
12. The ultrasonic imaging apparatus according to claim 11, wherein: The standard cross-sectional image corresponds to one of a midsagittal plane, a lateral sagittal plane, a transthalamic plane, a transventricular plane, and a transcerebellar plane of the subject.
13. The ultrasonic imaging apparatus according to claim 11, wherein: The reference cross-sectional image corresponds to at least one of a coronal plane or an axial plane of the volume data, and The candidate standard cross-sectional image corresponds to a sagittal plane of the volume data.
14. The ultrasonic imaging apparatus according to claim 11, wherein: The at least one processor is further configured to execute the one or more instructions to: A first indicator and a second indicator are displayed on the first GUI view, the first indicator representing a first line formed as an intersection line of a slice plane of the reference cross-sectional image and a slice plane of the candidate standard cross-sectional image, and the second indicator representing a second line formed as an intersection line of the slice plane of the reference cross-sectional image and a slice plane of the standard cross-sectional image.
15. The ultrasonic imaging apparatus according to claim 14, wherein: The at least one processor is further configured to execute the one or more instructions to display an angle indicator on the first GUI view, the angle indicator representing an angle between the first indicator and the second indicator.
16. The ultrasonic imaging apparatus according to claim 14, wherein: The at least one processor is further configured to execute the one or more instructions to adjust the slice plane of the candidate standard cross-sectional image so that an angle between the first indicator and the second indicator corresponds to an angle between the reference cross-sectional image and the standard cross-sectional image.
17. The ultrasonic imaging apparatus according to claim 11, wherein: The at least one processor is further configured to execute the one or more instructions to display the at least one anatomical landmark on the first GUI view using a preset color that is distinguished from other areas.
18. The ultrasonic imaging apparatus according to claim 11, wherein: The at least one processor is further configured to execute the one or more instructions to display at least one indicia of the object using a preset color.
19. The ultrasonic imaging device according to claim 11, further comprising: Probe, The at least one processor is further configured to execute the one or more instructions to obtain the volume data based on a received signal received from the probe. 20 . A computer-readable recording medium storing a program for executing the method according to claim 1 on a computer.