Ultrasound image processing device, ultrasound diagnostic system, and ultrasound image processing method

Abstract

[Problem] To provide an ultrasound image processing device, an ultrasound diagnostic system, and an ultrasound image processing method, which improve the operability of a display operation in the ultrasound image processing device. An ultrasonic image processing apparatus according to an embodiment of the present invention has a display device, a sensing unit, a setting unit, a display control unit, and a display processing unit. The display device has a display screen that displays an ultrasound image relating to a subject. The sensing unit senses a touch operation of a user on the display screen. When a first touch operation on the ultrasonic image is sensed, the setting unit sets a target point at a position on the ultrasonic image where the first touch operation has been performed. The display control unit displays a first GUI element for performing a display operation on the ultrasound image with reference to the target point in a predetermined region of the display screen. When a second touch operation on the first GUI element is sensed, the display control unit performs display processing on the ultrasound image in accordance with the second touch operation.

Description

[0001] Cross-reference to related applications

[0002] This application claims priority based on Japanese Patent Application No. 2024-130085, filed on August 6, 2024, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The embodiments described herein mainly relate to ultrasonic image processing apparatus, ultrasonic diagnostic system, and ultrasonic image processing method. Background Technology

[0004] In recent years, small-scale ultrasound diagnostic systems have been developed by connecting mobile devices such as smartphones with installed ultrasound software to ultrasound probes. These systems require the user to operate the mobile device with one hand while holding it with the other.

[0005] However, in ultrasonic imaging operations on mobile devices, multi-touch and other single-handed operations while holding the mobile device require difficult operation.

[0006] Existing technical documents

[0007] Patent Document 1: Japanese Patent Application Publication No. 2010-269139 Summary of the Invention

[0008] The problem that the invention aims to solve

[0009] One problem to be solved by the embodiments disclosed in this specification and accompanying drawings is to improve the operability of the display operation in an ultrasonic image processing apparatus. However, the problem to be solved by the embodiments disclosed in this specification and accompanying drawings is not limited to the above-mentioned problem. Problems corresponding to the effects of the various structures shown in the embodiments described below can also be identified as other problems.

[0010] The ultrasonic image processing apparatus of this embodiment includes a display device, a sensing unit, a setting unit, a display control unit, and a display processing unit. The display device has a display screen that displays an ultrasonic image related to a subject. The sensing unit senses a user's touch operation on the display screen. Upon sensing a first touch operation on the ultrasonic image, the setting unit sets an object point on the ultrasonic image at the location of the first touch operation. The display control unit displays a first GUI element in a designated area of ​​the display screen for displaying the ultrasonic image based on the object point. Upon sensing a second touch operation on the first GUI element, the display control unit performs display processing on the ultrasonic image according to the second touch operation.

[0011] The ultrasound diagnostic system of this embodiment includes an ultrasound probe and a mobile device. The ultrasound probe transmits ultrasound waves to a subject and receives ultrasound signals from the subject. The mobile device includes: a generation unit that generates an ultrasound image based on the ultrasound signals; a display device having a display screen for displaying the ultrasound image; a sensing unit that senses a user's touch operation on the display screen; a setting unit that, upon sensing a first touch operation on the ultrasound image, sets an object point at the location on the ultrasound image where the first touch operation occurred; a display control unit that displays a first GUI element for displaying the ultrasound image based on the object point in a predetermined area of ​​the display screen; and a display processing unit that, upon sensing a second touch operation on the first GUI element, performs display processing on the ultrasound image according to the second touch operation.

[0012] The ultrasound image processing method of the embodiment includes the following steps: displaying an ultrasound image related to a subject; sensing a user's touch operation on a display screen displaying the ultrasound image; if a first touch operation on the ultrasound image is sensed, setting an object point at the location on the ultrasound image where the first touch operation occurred; displaying a first GUI element for performing display operations on the ultrasound image based on the object point in a predetermined area of ​​the display screen; and if a second touch operation on the first GUI element is sensed, performing display processing on the ultrasound image according to the second touch operation.

[0013] Invention Effects

[0014] The purpose of this invention is to improve the operability of the display operation in an ultrasonic image processing device. Attached Figure Description

[0015] Figure 1 This is a diagram illustrating an example of the configuration of the ultrasound diagnostic system according to the first embodiment.

[0016] Figure 2 This is a diagram showing a connection example of the ultrasound diagnostic system according to the first embodiment.

[0017] Figure 3 This diagram illustrates the process of processing ultrasonic images according to the first embodiment.

[0018] Figure 4 This diagram illustrates the setting of object points in the first embodiment.

[0019] Figure 5 This diagram illustrates the display position of the first GUI element in the first embodiment.

[0020] Figure 6 This figure illustrates the display processing of ultrasound images according to the first embodiment.

[0021] Figure 7 This is another figure illustrating the display processing of ultrasonic images according to the first embodiment.

[0022] Figure 8 This is a diagram illustrating an example of the configuration of the ultrasound diagnostic system according to the second embodiment.

[0023] Figure 9 This diagram illustrates the process of processing ultrasonic images according to the second embodiment.

[0024] Figure 10 The first figure illustrates the overlapping display of the ultrasound image, region of interest, and accompanying information in the second embodiment.

[0025] Figure 11 The second figure illustrates the overlapping display of the ultrasound image, region of interest, and accompanying information in the second embodiment.

[0026] Figure 12 The third figure illustrates the overlapping display of the ultrasound image, region of interest, and accompanying information in the second embodiment.

[0027] Figure 13 The fourth figure illustrates the overlapping display of the ultrasonic image, the area of ​​interest, and the accompanying information in the second embodiment.

[0028] Figure 14 This diagram illustrates the setting of object points in the second embodiment.

[0029] Figure 15 This figure illustrates the display processing of ultrasonic images according to the second embodiment.

[0030] Figure 16 This diagram illustrates the positions of the first display area and the second display area in the third embodiment.

[0031] Figure 17 This diagram illustrates the positions of the first display area and the second display area in the fourth embodiment.

[0032] Explanation of reference numerals in the attached figures

[0033] 1…Ultrasound Diagnostic System

[0034] 2…Ultrasonic probe

[0035] 3…Mobile devices

[0036] 21…processing circuit

[0037] 22…Transducer Section

[0038] 23…Ultrasonic transceiver circuit

[0039] 24…communication interface

[0040] 31…processing circuit

[0041] 32…memory

[0042] 33…Image storage

[0043] 34…Input Interface

[0044] 35…monitor

[0045] 36…Communication Interface

[0046] 211…Mode switching function

[0047] 212…Probe control function

[0048] 311…B mode processing function

[0049] 312…Doppler processing function

[0050] 313…Image generation function

[0051] 314… Display control function

[0052] 315…System Control Functions

[0053] 316…Sensing Function

[0054] 317…Settings

[0055] 318… Display processing function

[0056] 319…Includes information generation function Detailed Implementation

[0057] The ultrasonic image processing apparatus of this embodiment includes a display device, a sensing unit, a setting unit, a display control unit, and a display processing unit. The display device has a display screen that displays an ultrasonic image related to a subject. The sensing unit senses a user's touch operation on the display screen. Upon sensing a first touch operation on the ultrasonic image, the setting unit sets an object point on the ultrasonic image at the location of the first touch operation. The display control unit displays a first GUI element in a designated area of ​​the display screen for displaying the ultrasonic image based on the object point. Upon sensing a second touch operation on the first GUI element, the display control unit performs display processing on the ultrasonic image according to the second touch operation.

[0058] (First Implementation)

[0059] Hereinafter, the embodiments of the ultrasonic image processing apparatus, ultrasonic diagnostic system, and ultrasonic image processing method will be described in detail with reference to the accompanying drawings.

[0060] Figure 1 This is a diagram illustrating an example of the configuration of the ultrasound diagnostic system 1 according to the first embodiment. (See diagram below.) Figure 1 As shown, the ultrasonic image processing device 1 includes an ultrasonic probe 2 and a mobile device 3. The ultrasonic probe 2 and the mobile device 3 are connected to each other via wired or wireless means to communicate with each other.

[0061] Figure 2 This diagram shows the connection between the ultrasonic probe 2 and the mobile device 3. Figure 2 The ultrasonic probe 2 and the mobile device 3 are connected via a wired connection. The user holds the ultrasonic probe 2 and the mobile device 3 with different hands while observing the ultrasonic image on the mobile device 3 and simultaneously adjusting the contact position of the ultrasonic probe 2 against the subject P. The mobile device 3 is operated by the fingers of the hand holding the probe. Specifically, the mobile device 3 can be operated by the thumb of the hand holding the probe. For simplicity, the ultrasonic probe 2 and the wired cable are not shown below.

[0062] The ultrasonic probe 2 performs ultrasonic scanning on a scanning area within the subject P, for example, under control from the mobile device 3. The ultrasonic probe 2 can be, for example, a 1D array linear probe with multiple ultrasonic transducers arranged in a predetermined direction, a 2D array probe with multiple ultrasonic transducers arranged in a matrix, or a mechanical 4D probe capable of performing ultrasonic scanning while mechanically oscillating the array of ultrasonic transducers in a direction orthogonal to its arrangement direction. The ultrasonic probe 2 includes a processing circuit 21, a transducer unit 22, an ultrasonic transceiver circuit 23, and a communication interface 24.

[0063] The transducer section 22 may include, for example, an array of ultrasonic transducers, a matching layer disposed on the ultrasonic transducers, and a backing material to prevent ultrasonic waves from propagating rearward from the ultrasonic transducers. The ultrasonic transducers may be, for example, piezoelectric transducers, and as an example, are made of piezoelectric ceramics.

[0064] The ultrasonic transducer array generates ultrasonic waves based on a drive signal supplied from the ultrasonic transceiver circuit 23. Ultrasonic waves are then transmitted from the transducer unit 22 to the subject P. When ultrasonic waves are transmitted from the transducer unit 22 to the subject P, the transmitted ultrasonic waves are sequentially reflected by discontinuities in the acoustic impedance of the body's tissues. The reflected waves are received by the ultrasonic transducer array and converted into electrical signals (echo signals). The amplitude of the received reflected signal depends on the difference in acoustic impedance on the discontinuities of the reflected ultrasonic waves. Furthermore, in cases where the transmitted ultrasonic pulses are reflected by surfaces such as moving blood flow or the heart wall, the echo signal is frequency-shifted due to the Doppler effect, depending on the velocity component of the ultrasonic wave transmission direction of the moving body.

[0065] The ultrasonic transceiver circuit 23 is a processor that supplies drive signals to the transducer section 22. For ease of explanation, the ultrasonic transceiver circuit 23 will be described below as consisting of an ultrasonic transmitting circuit and an ultrasonic receiving circuit.

[0066] The ultrasonic transmitting circuit is implemented, for example, by a trigger generating circuit, a transmission delay circuit, and a pulse generating circuit (pulse generator group). The trigger generating circuit repeatedly generates rate pulses at a predetermined rate frequency to form transmitted ultrasonic waves. The transmission delay circuit assigns a delay time to each piezoelectric vibrator required to determine the transmission directionality in order to converge the ultrasonic waves generated from the transducer section 22 onto the beam for each rate pulse generated by the trigger generating circuit. The pulse generating circuit applies a drive signal (drive pulse) to the ultrasonic vibrator array disposed on the transducer section 22 at a timing based on the rate pulses. By varying the delay time assigned to each rate pulse using the transmission delay circuit, the transmission direction from the surface of the piezoelectric vibrator can be arbitrarily adjusted.

[0067] The ultrasonic receiving circuit is a processor that performs various processing on the echo signal received by the transducer section 22. Specifically, the ultrasonic receiving circuit is implemented, for example, by a preamplifier (preamplifier group), an A / D converter, a demodulator, and a beamformer (receive delay addition circuit). The preamplifier amplifies the echo signal received by the transducer section 22 for each channel and performs gain correction processing. The A / D converter converts the gain-corrected echo signal into a digital signal. The demodulator demodulates the digital signal. The beamformer, for example, assigns a delay time to the demodulated digital signal required to determine the receiving directionality and adds multiple digital signals with the assigned delay time. Through the addition processing of the beamformer, a received signal is generated in which the reflected component from the direction corresponding to the receiving directionality is emphasized.

[0068] The processing circuit 21 is, for example, a processor that controls the operation of the ultrasonic probe 2. The processing circuit 21 executes the mode switching function 211 and the probe control function 212, etc., by using a processor that executes a program stored in a memory (not shown). Each function 211 to 212 is not limited to being implemented by a single processing circuit. Multiple independent processors can also be combined to form a processing circuit, and each function 211 to 212 can be implemented by each processor executing a program.

[0069] In mode switching function 211, processing circuit 21 switches the ultrasonic transceiver operation mode. Processing circuit 21 switches the operation mode according to the instruction from mobile device 3 via mode switching function 211.

[0070] Action modes include B mode, M mode, color Doppler imaging (CDI) mode, power mode, super microvascular imaging (SMI) mode, tissue Doppler imaging (TDI) mode, and Doppler mode, etc.

[0071] B mode converts the signal intensity of the echo into brightness for image display. M mode displays the temporal changes of a moving echo source. CDI mode displays blood flow velocity information. Power mode displays blood flow energy information. SMI mode displays subtle blood flow information through blood flow emphasis and clutter suppression. TDI mode uses the Doppler effect to display the motion information of tissues within a living organism in color.

[0072] Doppler imaging is a mode that uses the Doppler effect to display the velocity information of blood flow in a living organism. Further sub-Doppler modes include pulse wave (PW) mode and continuous wave (CW) mode. PW mode uses pulsed Doppler imaging, while CW mode uses continuous wave Doppler imaging.

[0073] In probe control function 212, processing circuit 21 controls basic operations such as ultrasonic wave transmission and reception performed by ultrasonic probe 2. For example, processing circuit 21 controls various parts and circuits of ultrasonic probe 2 based on instructions from mobile device 3 through probe control function 212.

[0074] The communication interface 24 can wirelessly connect to the mobile device 3, for example, according to any wireless communication standard. Alternatively, the communication interface 24 may also have a USB port, allowing for wired connection via an interface cable (IFC) with USB terminals. Furthermore, the communication interface 24 can also connect to an external device via a network for data communication.

[0075] Mobile device 3 controls ultrasonic probe 2, generating and displaying ultrasonic images based on the echo signals received by ultrasonic probe 2. Mobile device 3 is a portable computer terminal.

[0076] The mobile device 3 has a processing circuit 31, a memory 32, an image memory 33, an input interface 34, a display 35, and a communication interface 36.

[0077] The memory 32 is a storage device that stores various types of information, such as an HDD (Hard Disk Drive), SSD (Solid State Drive), or integrated circuit storage device. For example, the memory 32 stores programs used for ultrasonic transceiver, ultrasonic image data, and various other data. Besides HDDs and SSDs, the memory 32 can also be a removable storage medium such as a CD (Compact Disk), DVD (Digital Versatile Disk), or flash memory. The memory 32 can also be a drive device that reads and writes various types of information between itself and semiconductor storage elements such as flash memory or RAM. Furthermore, the storage area of ​​the memory 32 can be located inside the mobile device 3 or in an external storage device connected via a network.

[0078] Image memory 33 may be, for example, a magnetic storage medium, an optical storage medium, or a semiconductor memory, or a storage medium that can be read by a processor. Image memory 33 stores image data corresponding to multiple frames prior to the freeze operation input via input interface 34. The image data stored in image memory 33 may be displayed sequentially (movie mode display), for example.

[0079] These memories 32 and image memories 33 do not necessarily need to be implemented using separate storage devices. Memory 32 and image memories 33 can be implemented using a single storage device. Alternatively, memory 32 and image memories 33 can be implemented using multiple storage devices.

[0080] Input interface 34 accepts various instructions from the user, converts the accepted input operations into electrical signals, and outputs them to processing circuit 31. As input interface 34, for example, a mouse, keyboard, trackball, switch, button, joystick, rotary encoder, operation panel, touch command screen (TCS), touchpad, and touch panel display can be appropriately used.

[0081] Display 35 displays various information. For example, display 35 outputs ultrasonic images generated by processing circuit 31, a GUI (Graphical User Interface) for handling various operations from the user, etc. Various arbitrary displays can be used as display 35. For example, a liquid crystal display (LCD), a CRT (Cathode Ray Tube) display, an organic EL (Organic Electro Luminescence) display, or a plasma display can be used as display 35. Display 35 is part of the display screen, displaying ultrasonic images and user interfaces.

[0082] The mobile device 3 of this embodiment has at least a touch panel display as an input interface 34 and a display 35. Hereinafter, the displayed screen is the touch panel display. However, the displayed screen is not limited to the touch panel display.

[0083] The communication interface 36 can wirelessly connect to the ultrasonic probe 2, for example, according to any wireless communication standard. Alternatively, the communication interface 36 may also have a USB port for wired connection via an IFC with a USB terminal. Furthermore, the communication interface 36 can also connect to an external device via a network for data communication.

[0084] The processing circuit 31 controls the overall operation of the ultrasound diagnostic system 1 based on the electrical signal of the input operation output from the input interface 34. For example, the processing circuit 31 has a processor such as a CPU and a memory such as ROM and RAM as hardware resources. The processing circuit 31 uses the processor that executes the program expanded in the memory 32 to perform B-mode processing function 311, Doppler processing function 312, image generation function 313, display control function 314, system control function 315, sensing function 316, setting function 317, and display processing function 318, etc. Each function 311 to 318 is not limited to being implemented by a single processing circuit. Multiple independent processors can also be combined to form a processing circuit, and each function 311 to 318 can be implemented by each processor executing the program.

[0085] In the B-mode processing function 311, the processing circuit 31 generates B-mode data based on the received signal from the ultrasonic probe 2. More specifically, the processing circuit 31, through the B-mode processing function 311, performs envelope detection processing and logarithmic compression processing on the received signal received from the ultrasonic probe 2, to generate data (B-mode data) in which the signal intensity is represented by brightness. The generated B-mode data is stored as B-mode RAW data on a two-dimensional ultrasonic scan line (grating) in a RAW data memory (not shown).

[0086] In the Doppler processing function 312, the processing circuit 31 performs frequency analysis on the received signal received from the ultrasonic probe 2 to generate data (Doppler information) that extracts motion information of a moving body within a ROI (Region of Interest) set in the scanning area based on the Doppler effect. The generated Doppler information is stored as Doppler RAW data on the two-dimensional ultrasonic scan line in a RAW data memory (not shown).

[0087] In the image generation function 313, the processing circuit 31 generates various ultrasonic image data based on data generated by the B-mode processing function 311 and / or the Doppler processing function 312. Specifically, the processing circuit 31 generates B-mode image data composed of pixels by performing RAW data-pixel transformation, such as coordinate transformation corresponding to the scanning mode of the ultrasonic waves from the ultrasonic probe 2, on the B-mode RAW data stored in the RAW data storage device through the image generation function 313.

[0088] Additionally, the processing circuit 31 generates Doppler image data that visualizes blood flow information, for example, by performing a RAW-pixel transformation on the Doppler RAW data stored in the RAW data memory. The Doppler image data is average velocity image data, variance image data, energy image data, or a combination thereof.

[0089] In the display control function 314, the processing circuit 31 displays images based on various ultrasonic image data generated by the image generation function 313 on the display screen. Specifically, for example, the processing circuit 31 controls the display of images based on B-mode image data, Doppler image data, or image data containing both generated by the image generation function 313 on the display screen via the display control function 314. Additionally, in the display control function 314, the processing circuit 31 displays a first GUI element for performing display operations on the ultrasonic image based on an object point in a designated area of ​​the display screen.

[0090] The first GUI element is used to perform display processing on the ultrasound image displayed on the screen. Display processing refers to image processing related to the display of the ultrasound image on the screen. Display processing includes, for example, zooming in / out of the ultrasound image, moving the display area of ​​the ultrasound image, and / or image quality processing of the ultrasound image. Display operations are operations used to perform display processing.

[0091] More specifically, the processing circuit 31, through the display control function 314, converts (scan conversions) the scan line signal train of ultrasonic scanning into a scan line signal train in a video format, such as television, to generate display image data. Furthermore, the processing circuit 31 can also perform various processing on the display image data, such as dynamic range adjustment, brightness adjustment, contrast adjustment, gamma curve correction, and RGB conversion. Additionally, the processing circuit 31 can generate a user interface for the operator to input various instructions through the input interface 34 and display the user interface on the display screen.

[0092] System control function 315 is a function that uniformly controls the operation of the entire ultrasound diagnostic system 1. For example, processing circuit 31 controls ultrasound probe 2 based on parameters related to ultrasound transmission and reception through system control function 315. As an example, system control function 315 acquires received signals from ultrasound probe 2.

[0093] In the sensing function 316, the processing circuit 31 senses touch operations on the display screen. The processing circuit 31 sends electrical signals corresponding to the sensed touch operations to various circuits and components.

[0094] In setting function 317, upon sensing a first touch operation on the ultrasonic image, processing circuit 31 sets an object point on the ultrasonic image at the location where the first touch operation occurred. The object point can be set as a pixel of the ultrasonic image or as coordinates set on the ultrasonic image. The object point serves as a reference point for display processing.

[0095] In the display processing function 318, when a second touch operation on a first GUI element displayed through the display control function 314 is sensed, the processing circuit 31 performs display processing on the ultrasonic image based on the second touch operation.

[0096] The mobile device 3, which is the ultrasonic image processing apparatus 1, will be described in detail below. In this description, the mobile device 3 is a smartphone, but this embodiment is not limited to this.

[0097] Figure 3 This is a diagram illustrating an example of the ultrasonic image processing flow of the first embodiment. For example... Figure 3As shown, the processing circuit 31 acquires the ultrasonic signal through the implementation of the system control function 315 (step S11). The ultrasonic signal is acquired via the ultrasonic probe 2. The ultrasonic signal can also be referred to as the echo signal. In addition, the processing circuit 31 can also perform data processing on the acquired received signal through the implementation of the B-mode processing function 311 and / or the Doppler processing function 312 to generate B-mode data and / or Doppler RAW data.

[0098] If step S11 is performed, the processing circuit 31 generates an ultrasonic image based on the ultrasonic signal collected in step S11 through the implementation of the image generation function 313 (step S12). The ultrasonic image is, for example, a B-mode image, a Doppler mode image, and / or a color Doppler mode image.

[0099] If step S12 is performed, the processing circuit 31 displays the ultrasonic image generated in step S12 (step S13) through the implementation of the display control function 314. For example, the processing circuit 31 displays the ultrasonic image on a display screen.

[0100] If step S13 is performed, the processing circuit 31, through the implementation of setting function 317, sets an object point on the ultrasonic image at the location where the first touch operation occurred when a first touch operation on the ultrasonic image displayed in step S13 is sensed (step S14). The object point is, for example, the center point in the magnification processing of the ultrasonic image. As an example, the first touch operation is a press (long press).

[0101] Figure 4 This is a diagram illustrating an example of how object points are defined. For example... Figure 4 As shown, a first display area 351 and a second display area 352 are displayed on the display screen of the mobile device 3. As an example, the first display area 351 and the second display area 352 can be arranged sequentially from the top of the display screen along its length. For example, an ultrasonic image 81 may be displayed in the first display area 351. For example, a user interface for accepting input to the ultrasonic image 81 may be displayed in the second display area 352.

[0102] Hereinafter, the first display area 351 will be referred to as the image display area 351. The second display area 352 will be referred to as the UI display area 352. The processing circuit 31 sets an object point by sensing a first touch operation on the ultrasonic image 81 displayed on the image display area 351. When multiple first touch operations are sensed, the processing circuit 31 can set the object point at the position where the latest first touch operation is sensed. By setting the object point, display processing based on the position of interest to the user can be performed.

[0103] Furthermore, the first touch operation is not limited to pressing. The first touch operation can also be a tap, double tap, triple tap, press and hold, swipe, drag, scrub, and / or scroll. Additionally, the display screen may not be divided into an image display area 351 and a UI display area 352. For example, the user interface may be appropriately displayed on the image display area 351 based on touch operations performed on it.

[0104] If step S14 is performed, the processing circuit 31, through the implementation of the display control function 314, displays the first GUI element used for displaying the ultrasonic image based on the object point set in step S14 in a designated area of ​​the display screen (step S15). The display processing is, for example, zooming in / out processing of the ultrasonic image displayed in the image display area. The designated area is, for example, the UI display area. The first GUI element is, for example, a slider. Hereinafter, the first GUI element will be referred to as the zoom-in GUI element. Furthermore, the first GUI element is not limited to zoom-in / zoom-out processing.

[0105] Figure 5 This is a diagram representing a magnified view of a GUI element. For example... Figure 5 As shown, an image display area 351 and a UI display area 352 are displayed on the screen of the mobile device 3. An ultrasonic image 81 is displayed in the image display area 351. An object point 911 is defined in the ultrasonic image 81. In the UI display area 352, a zoom GUI element 821 includes a slider that can be slidable vertically on the mobile device 3. The zoom GUI element 821 is, for example, a GUI element used to adjust the magnification of the ultrasonic image 81 based on the object point 911.

[0106] If a GUI element is already displayed at the location where the magnified GUI element 821 is displayed, for example, the processing circuit 31 may cause that GUI element to be hidden, minimized, and / or moved, and the magnified GUI element 821 may be displayed at that location. The magnified GUI element 821 may be displayed, for example, near the thumb of the hand holding the mobile device 3.

[0107] Specifically, such as Figure 5As shown, when the mobile device 3 is held with the right hand, the magnified GUI element 821 can be displayed in the right half of the UI display area 352. When the mobile device 3 is held with the left hand, the magnified GUI element 821 can be displayed in the left half of the UI display area 352. As an example, the processing circuit 31 uses the touch sensor of the ultrasonic probe 2 to identify whether the hand holding the mobile device 3 is the right or left hand.

[0108] By using a slider that can slide vertically as the magnified GUI element 821, it is easier for the user to operate the display while holding the mobile device 3. Furthermore, by changing the display position of the magnified GUI element 821 according to the user's hand holding the mobile device 3, it is also easier for the user to operate the display while holding the mobile device 3.

[0109] Furthermore, the object point 911 may or may not be displayed. The processing circuit 31 switches between displaying and not displaying the object point, for example, based on a specific touch operation. Additionally, it is not limited to using the touch sensor of the ultrasonic probe 2 to identify the hand holding the mobile device 3. For example, it can be automatically identified using various sensors of the mobile device 3, or it can be identified by manual input from the user into the mobile device 3.

[0110] If step S15 is performed, and the processing circuit 31 senses a second touch operation on the magnified GUI element displayed in step S15 through the sensing function 316, it performs display processing on the ultrasonic image based on the object point set in step S14 (step S16) through the implementation of the display processing function 318. The second touch operation is, for example, sliding or rapid scrolling. The display processing is magnification processing centered on the object point.

[0111] Figure 6 This is a diagram showing the magnified processing of ultrasound image 81. For example... Figure 6 As shown, the display screen of mobile device 3 displays an image display area 351 and a UI display area 352. The image display area 351 displays a magnified ultrasound image 81. The UI display area 352 contains a magnified GUI element 821. (See diagram below.) Figure 6 As shown, the zoomed-in GUI element 821 can be a slider that can slide in the vertical direction of the display screen.

[0112] like Figure 6As shown, the ultrasonic image 81 is magnified with the object point 911 centered by sliding the magnified GUI element 821 upwards. During this magnification process, the ultrasonic image 81 is magnified such that the object point 911 is brought closer to the center of the image display area 351. By performing magnification centered on the object point 911 on the ultrasonic image 81, the user can magnify and display the area of ​​interest on the screen without moving the ultrasonic image 81 after magnification.

[0113] In addition, by sliding the magnified GUI element 821 downwards, the ultrasonic image 81 is reduced in size with the center point of the ultrasonic image 81 as the center.

[0114] Alternatively, after magnifying the ultrasonic image 81, the image display area 351 can be moved. This movement can be, for example, by moving the image display area 351 relative to the ultrasonic image 81 to change the displayed portion of the ultrasonic image 81.

[0115] Figure 7 Yes Figure 6 The image 81 is a result of motion processing on the ultrasound image. (See image 81.) Figure 7 As shown, the display screen shows an image display area 351 and a UI display area 352. The image display area 351 displays a magnified ultrasound image 81. The UI display area 352 displays a magnified GUI element 821.

[0116] like Figure 7 As shown, in Figure 6 Region R1, located in the center of image display area 351, causes image display area 351 to... Figure 6 The position is moved upwards and to a position lower than the center of the image display area 351. Through this movement, in... Figure 6 The area R2 not partially displayed is entirely included in the image display area 351. The processing circuit 31 receives touch operations performed with one finger, such as sliding or swiping on the ultrasonic image 81, calculates the direction and amount of movement of the image display area 351, and moves the image display area 351 accordingly. This touch operation can also be referred to as a third touch operation. By moving the image display area 351, it is easy to search for the vicinity of the area of ​​interest in the magnified ultrasonic image 81. Furthermore, by receiving touch operations performed with one finger, it is easy to operate the device 3 while holding it.

[0117] Furthermore, the motion processing is not limited to moving the image display area 351 in the upward direction relative to the ultrasonic image 81. The motion processing can move the image display area 351 in any direction relative to the ultrasonic image 81.

[0118] If step S16 is performed, the ultrasonic image processing of the first embodiment ends.

[0119] Furthermore, when multiple first touch operations are sensed by the sensing function 316, the processing circuit 31 can set object points at the locations of the multiple first touch operations. In this case, in step S5, the processing circuit 31 displays multiple first GUI elements corresponding to the multiple object points. Additionally, the motion processing of the ultrasound image is not limited to touch operations on the ultrasound image. For example, based on a third touch operation such as a double-click or triple-click on the ultrasound image, GUI elements for performing motion processing can be displayed in the UI display area 351, and motion processing can be performed based on touch operations (fourth touch operations) on the displayed GUI elements. Moreover, when object points are set, the ultrasound image can be immediately displayed based on a specific touch operation, performing display processing of the ultrasound image before zooming in / out. Furthermore, it is not necessary to hold the ultrasound probe 2. For example, this embodiment can be applied simply by holding the mobile device 3 with one hand. Additionally, this embodiment can also be applied during periods when ultrasound diagnosis is not performed.

[0120] According to the first embodiment, by setting an object point at any position on the ultrasonic image with one hand and performing magnification processing on the ultrasonic image based on the object point, it is possible to display the magnified ultrasonic image centered at any position with one hand without moving the image display area, thereby making the display operation of the hand holding the mobile device 3 easier. Moreover, by moving the image display area according to the touch operation of the ultrasonic image with one hand and / or the touch operation of the GUI elements, it is possible to easily display the part of the magnified ultrasonic image that is not included in the image display area with one hand.

[0121] (Second Implementation)

[0122] The first embodiment involves the user manually setting the target point at any location on the ultrasound image. The second embodiment automatically sets the region of interest and automatically sets the target point within the set region of interest. The ultrasound diagnostic system 1 of the second embodiment will be described below. Components having the same function as those in the first embodiment are labeled with the same reference numerals and will be described repeatedly only where necessary.

[0123] Figure 8 This is a diagram showing an example of the configuration of the ultrasound diagnostic system 1 according to the second embodiment.

[0124] The processing circuit 31 controls the overall operation of the ultrasound diagnostic system 1 based on the electrical signal of the input operation output from the input interface 34. For example, the processing circuit 31 has a processor such as a CPU and a memory such as ROM and RAM as hardware resources. The processing circuit 31 uses the processor that executes the program expanded in the memory 32 to perform B-mode processing function 311, Doppler processing function 312, image generation function 313, display control function 314, system control function 315, sensing function 316, setting function 317, display processing function 318, and auxiliary information generation function 319, etc. Each function 311 to 319 is not limited to being implemented by a single processing circuit. Multiple independent processors can also be combined to form a processing circuit, and each function 311 to 319 can be implemented by each processor executing the program.

[0125] In setting function 317, when the processing circuit 31 senses a fifth touch operation on the ultrasonic image, it sets a region of interest on the ultrasonic image and sets the center of the region of interest as the object point. The fifth touch operation can be, for example, pressing, tapping, double-tapping, triple-tapping, long-pressing, swiping, dragging, fast scrolling, and / or scrolling. Furthermore, the fifth touch operation can be assigned the same touch operation as the first touch operation.

[0126] In the ancillary information generation function 319, the processing circuit 31 generates ancillary information that can identify each of the multiple regions of interest set by the setting function 317. The ancillary information includes, for example, textual information, scales, body markings, etc., of various parameters related to the ultrasound image.

[0127] Figure 9 This is a diagram illustrating an example of the ultrasonic image processing flow of the second embodiment. Figure 9 Steps S21, S22, and S23 shown can be performed in conjunction with... Figure 3 The processes shown in steps S11, S12, and S13 are the same. The explanation will begin from step S24 below.

[0128] If step S23 is performed, and the processing circuit 31 detects a touch operation on the ultrasonic image displayed in step S23 via the sensing function 316, it sets a region of interest on the ultrasonic image through the implementation of the setting function 317 (step S24). The touch operation can be an operation that can be performed with one finger. For example, a touch operation is a press. The processing circuit 31 sets the region of interest based on the brightness, signal strength, color, etc., of the ultrasonic image.

[0129] When multiple regions of interest are defined, the processing circuit 31 can also generate supplementary information capable of identifying each of the multiple regions of interest through the implementation of the supplementary information generation function 319. The generated supplementary information is associated with the corresponding region of interest. In addition, the processing circuit 31 can also overlay the regions of interest and / or supplementary information in the ultrasound image through the implementation of the display control function 314.

[0130] Figure 10 This is an example of an ultrasound image 81 that shows the area of ​​interest and accompanying information overlaid. (See figure 81.) Figure 10 As shown, the display screen of the mobile device 3 includes a UI display area 352 and an image display area 351. Although not shown, the UI display area 352 can also display various UI elements related to the ultrasonic image 81 displayed in the image display area 351, which contains GUI elements. The ultrasonic image 81 is displayed in the image display area 351.

[0131] In ultrasound image 81, a portion of ultrasound image 81 is designated as the region of interest. For example... Figure 10 As shown, three regions of interest, 91a, 91b, and 91c, are defined in the ultrasound image 81. As an example, the regions of interest are defined as areas in the ultrasound image 81 where the brightness is lower than a threshold. The regions of interest can be emphasized relative to the ultrasound image 81. As an example, the regions of interest are emphasized by overlaying them with a hue different from the hues contained in the ultrasound image 81.

[0132] Associate additional information with each of the multiple areas of interest. For example... Figure 10 As shown, the accompanying information is numbered 1 to 3. The accompanying information can be, for example, numbered sequentially from 1 to 3 according to the outlier values, from highest to lowest. Outliers can be, for example, the magnitude of the difference between brightness and the threshold, and / or the size of the region of interest. The region of interest and the accompanying information are displayed overlaid in the ultrasound image 81. (See image 81 for details.) Figure 10 As shown, three regions of interest and accompanying information are superimposed in ultrasound image 81.

[0133] By automatically setting the focus area based on touch operations performed with a single finger, users can easily set multiple focus areas.

[0134] Furthermore, the shape of the region of interest is not limited to an ellipse. The region of interest can be of any shape. Additionally, supplementary information can be generated independently of outliers. For example, supplementary information can be generated sequentially from the top of the ultrasound image 81. Supplementary information is not limited to numbers. Supplementary information can be, for example, a string or a color.

[0135] Additionally, in step S24, the processing circuit 31 can also, through the implementation of the setting function 317, set the specified regions obtained by dividing the ultrasonic image into multiple parts according to the shape of the ultrasonic image displayed in step S23 as regions of interest. For example, the processing circuit 31 sets the regions of interest by reading the LUT (Look-Up Table) pre-stored in the memory 32, which specifies the regions of interest corresponding to the shape of the ultrasonic image.

[0136] Figure 11 This is an example diagram showing the region of interest in an annular fan-shaped ultrasound image 81a. (See diagram for example.) Figure 11 As shown, the display screen of mobile device 3 includes a UI display area 352 and an image display area 351. Although not shown, the UI display area 352 can display various UI elements related to the ultrasonic image 81a displayed in the image display area 351, including GUI elements. The ultrasonic image 81a is displayed in the image display area 351. A portion of the ultrasonic image 81a is designated as a region of interest. (As shown...) Figure 11 As shown, each region of the annular fan-shaped ultrasound image 81a, divided into four parts, is designated as a region of interest. The annular fan-shaped ultrasound image 81a is generated based on ultrasound signals collected by the convex ultrasound probe 2. The annular fan-shaped ultrasound image 81a is used, for example, for the diagnosis of the abdomen.

[0137] Figure 12 This is an example diagram showing the region of interest in a rectangular ultrasound image 81b. (See diagram 81b for example.) Figure 12 As shown, the display screen of mobile device 3 includes a UI display area 352 and an image display area 351. Although not shown, the UI display area 352 can display various UI elements related to the ultrasonic image 81b displayed in the image display area 351, including GUI elements. The ultrasonic image 81b is displayed in the image display area 351. A portion of the ultrasonic image 81b is designated as a region of interest. (The text repeats itself here.) Figure 12 As shown, each region of the rectangular ultrasound image 81b, divided into nine parts, is designated as a region of interest. The rectangular ultrasound image 81b is generated based on ultrasound signals collected by the linear ultrasound probe 2. The rectangular ultrasound image 81b is used, for example, for the diagnosis of muscle fibers, blood vessels, etc.

[0138] Figure 13 This is an example diagram showing the region of interest in a fan-shaped ultrasound image 81c. (See diagram 81c.) Figure 13As shown, the display screen of mobile device 3 displays a UI display area 352 and an image display area 351. In the UI display area 352, although not shown, various UI elements related to the ultrasonic image 81c displayed in the image display area 351, including GUI elements, can be displayed. The ultrasonic image 81c is displayed in the image display area 351. A portion of the ultrasonic image 81c is designated as a region of interest. (As shown...) Figure 13 As shown, each region of the fan-shaped ultrasound image 81c, divided into six parts, is designated as a region of interest. The fan-shaped ultrasound image 81c is generated based on ultrasound signals collected by a fan-shaped or monolithic ultrasound probe 2. The fan-shaped ultrasound image 81c is used, for example, for the diagnosis of circulatory organs.

[0139] Furthermore, the region of interest corresponding to the shape of the ultrasound image is not limited to... Figure 11-13 The region of interest is shown. The region of interest corresponding to the shape of the ultrasound image can be defined for any shape.

[0140] If step S24 is performed, the processing circuit 31 sets the center position of the region of interest set in step S24 as the object point by implementing the setting function 317 (step S25). If multiple regions of interest are set in step S24, the processing circuit 31 sets the object point at the center position of each of the multiple regions of interest by implementing the setting function 317.

[0141] Figure 14 This is a diagram illustrating an example of multiple object points defined in an ultrasound image. For example... Figure 14 As shown, the display screen of the mobile device 3 includes a UI display area 352 and an image display area 351. Although not shown, the UI display area 352 can display various UI elements related to the ultrasonic image 81 displayed in the image display area 351, including GUI elements. The ultrasonic image 81 is displayed in the image display area 351.

[0142] like Figure 14 As shown, in ultrasound image 81, with Figure 10 Similarly, three interest regions are defined: interest region 91a, interest region 91b, and interest region 91c. The object point is positioned at the center of each of the three interest regions. Figure 14As shown, object point 911a, set in one of the three interest areas 91a, is activated. Object points 911b, set in the other interest areas 91b, and object point 911c, set in interest area 91c, are deactivated. The activated object point 911a becomes the reference for display processing. The deactivated object points 911b and 911c do not become the reference for display processing before being activated. By automatically setting object points in the interest areas, object point setting operations can be easily performed.

[0143] Furthermore, upon detecting a touch operation on the ultrasonic image 81 (sixth touch operation), the processing circuit 31, through the implementation of setting function 317, sequentially activates one object point based on the accompanying information. For example, when a touch operation is received, the processing circuit 31 deactivates the valid object point and activates one of the multiple deactivated object points in the order of their numbers, which are part of the accompanying information.

[0144] like Figure 14 As shown, when the sensing function 316 detects a touch operation on the area of ​​interest 91a, 91b, or 91c of the ultrasonic image 81, the processing circuit 31 activates the object point set in the area of ​​interest at the location where the touch operation occurred. Furthermore, when the sensing function 316 detects a touch operation on a portion of the ultrasonic image 81 in the image display area 351 other than the areas of interest 91a, 91b, or 91c, the processing circuit 31 activates the object points in numerical order. By switching the activated object points among multiple object points, display operations can be performed based on a specific object point among the multiple object points.

[0145] Furthermore, object points are illustrated for illustrative purposes, but may not be displayed. Additionally, touch operations that activate object points can be assigned to any location on the display screen. The area of ​​interest and / or accompanying information may not always be displayed over the ultrasound image. For example, the display of the area of ​​interest and / or accompanying information can be switched on and off based on specific operations.

[0146] If step S25 is performed, the processing circuit 31, through the implementation of the display control function 314, displays the first GUI element used to perform display operations on the ultrasonic image based on the object point set in step S25 in a designated area of ​​the display 35 (step S26). The same processing as step S15 in the first embodiment can be performed.

[0147] If step S26 is performed, the processing circuit 31 performs display processing on the ultrasound image based on an effective object point through the implementation of the display processing function 318 (step S27). The display processing is, for example, magnification processing centered on the object point.

[0148] Figure 15 This is a diagram showing the magnified processing of ultrasound image 81. For example... Figure 15 As shown, the display screen of mobile device 3 displays an image display area 351 and a UI display area 352. The image display area 351 displays a magnified ultrasonic image 81. The magnification is performed with the object point set in the area of ​​interest 91a as the center point. The UI display area 352 contains a magnified GUI element 821. (See diagram below.) Figure 15 As shown, the zoomed-in GUI element 821 can be a slider that can slide in the vertical direction of the display screen.

[0149] like Figure 15 As shown, by sliding the magnifying GUI element 821 upwards, the ultrasonic image 81 is magnified / reduced with the effective object point as the center. In this magnification process, the ultrasonic image 81 is magnified in such a way that the effective object point is brought closer to the center of the image display area 351. By performing magnification centered on the effective object point on the ultrasonic image 81, the user can magnify and display a specific area of ​​interest from multiple areas of interest on the display 35 without moving the ultrasonic image 81 after magnification.

[0150] Alternatively, the movement process shown in the first embodiment can be performed after the enlargement process of the second embodiment.

[0151] If step S27 is performed, the ultrasonic image processing of the second embodiment ends.

[0152] Furthermore, the activation of object points is not limited to the methods described above. For example, multiple magnified GUI elements corresponding to multiple object points are displayed in the UI display area. When a touch operation on a specific magnified GUI element is detected by the sensing function 316, the processing circuit 31 activates only the object point corresponding to that magnified GUI element and performs magnification processing on the ultrasonic image based on the activated object point.

[0153] According to the second embodiment, the target point can be automatically set by automatically setting the region of interest. Furthermore, by overlaying the region of interest onto the ultrasound image, the interpretation of the ultrasound image can be aided.

[0154] (Third Implementation)

[0155] The first and second embodiments display the image display area and the UI display area sequentially from the top of the display screen. The third embodiment swaps the display positions of the image display area and the UI display area. Hereinafter, the ultrasound diagnostic system of the third embodiment will be described. Components having the same function as those in the first and / or second embodiments are labeled with the same reference numerals and will be described repeatedly only where necessary.

[0156] In the display control function 314, the processing circuit 31 swaps the positions of the image display area and the UI display area based on gesture operations on the mobile device 3. Gesture operations include shaking the mobile device 3. Shaking, for example, is an operation that senses the movement of the mobile device 3 via its accelerometer or similar sensor, and shakes the mobile device 3 along the normal direction of the display screen. By swapping the positions of the image display area and the UI display area without touch operation, the user can perform these swapping operations while stably holding the mobile device 3.

[0157] Figure 16 This diagram shows the swapping of the positions of the image display area 351 and the UI display area 352. (Example) Figure 16 As shown, the display screen of the mobile device 3 displays an image display area 351 and a UI display area 352. An ultrasonic image 81 is displayed in the image display area 351. Although not shown, the UI display area 352 can display various UI elements related to the ultrasonic image 81 displayed in the image display area 351, including GUI elements. By shaking or other switching operations, the image display area 351 and the UI display area 352 are swapped, and the image display area 351 is positioned below the UI display area 352.

[0158] Furthermore, various display processing can be applied to the ultrasonic image 81, GUI elements, etc., by swapping the positions of the image display area 351 and the UI display area 352. For example, in the image display area 351, a scaled-down ultrasonic image 81 can also be displayed near the hand holding the mobile device 3.

[0159] According to the third embodiment, by configuring the position of the image display area to be lower than the position of the UI display area, the ultrasonic image can be displayed within the reach of the thumb of the hand holding the mobile device 3.

[0160] (Fourth Implementation)

[0161] The first, second, and third embodiments display the image display area and the UI display area with the length of the mobile device aligned vertically. The fourth embodiment displays the image display area and the UI display area with the short side of the mobile device aligned vertically. Hereinafter, the ultrasound diagnostic system of the fourth embodiment will be described. Components having the same function as those in the first, second, and / or third embodiments will be labeled with the same reference numerals and will be described repeatedly only where necessary.

[0162] In the display control function 314, when the mobile device 3 is held by both hands, the processing circuit 31 displays the image in a second layout in which the divided UI display areas are arranged such that the image display area is sandwiched between the length of the mobile device 3. As an example, the processing circuit 31 uses the touch sensor of the ultrasonic probe 2 to identify whether the hand holding the mobile device 3 is the right hand or the left hand.

[0163] Furthermore, it is not limited to using the tactile sensor of the ultrasonic probe 2 to identify the hand holding the mobile device 3. For example, it can be identified automatically using the mobile device 3, or it can be identified by the user manually inputting information into the mobile device 3.

[0164] Figure 17 This diagram illustrates a second layout of the image display area 351, the UI display area 352a, and the UI display area 352b. The display screen shows various information with the shorter side of the mobile device 3 aligned vertically. For example... Figure 17 As shown, the display screen of the mobile device 3 includes an image display area 351, a UI display area 352a, and a UI display area 352b. An ultrasonic image 81 is displayed in the image display area 351. The UI display areas 352a and 352b are arranged to sandwich the image display area 351 from the left and right. For example, a quality GUI element 822 for adjusting the image quality of the ultrasonic image 81 is displayed in the left UI display area 352a. For example, a magnification GUI element 821 for zooming in / out of the ultrasonic image 81 is displayed in the right UI display area 352b. As an example, the quality GUI element 822 can be operated with the left hand. The magnification GUI element 821 can be operated with the right hand. By dividing and configuring the UI display areas, operability when holding the mobile device 3 with both hands can be improved.

[0165] Furthermore, the layout of the image display area and the UI display area is not limited to Figure 17 The layout shown.

[0166] According to the fourth embodiment, by changing the layout of the display area according to whether the hand holding the mobile device 3 is holding it with one hand or two hands, operability can be improved according to the hand holding the mobile device 3.

[0167] According to at least one embodiment described above, the operability of the display operation in the ultrasonic image processing apparatus can be improved.

[0168] The term "processor" as used in the above description refers to circuits such as CPUs, GPUs, application-specific integrated circuits (ASICs), and programmable logic devices (e.g., simple programmable logic devices (SPLDs), complex programmable logic devices (CPLDs), and field-programmable gate arrays (FPGAs)). The processor implements its functions by reading and executing a program stored in a memory circuit. Alternatively, instead of storing the program in a memory circuit, the program can be directly programmed into the processor's circuitry. In this case, the processor implements its functions by reading and executing the program programmed into the circuitry. On the other hand, if the processor is, for example, an ASIC, instead of storing the program in a memory circuit, the functionality is directly programmed into the processor's circuitry as logic circuitry. Furthermore, the processors in this embodiment are not limited to each processor being a single circuit; multiple independent circuits can be combined to form a single processor to implement its functions. Moreover, it is also possible to... Figure 1 and Figure 8 Multiple components are integrated into a single processor to achieve its function.

[0169] Several embodiments have been described, but these embodiments are provided by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other ways, and various omissions, substitutions, modifications, and combinations of embodiments can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, and are also included in the scope of the invention as described in the claims and its equivalents.

[0170] While specific embodiments have been described, these embodiments are merely illustrative and are not intended to limit the scope of the invention. In fact, the novel embodiments described herein can be embodied in various other forms; moreover, various omissions, substitutions, and changes can be made to the forms of the embodiments described herein without departing from the spirit of the invention. The appended claims and their equivalents are intended to cover various forms or variations falling within the scope and spirit of the invention.

Claims

1. An ultrasonic image processing device, characterized in that, have: The display device has a display screen that displays ultrasound images related to the subject. The sensing unit senses the user's touch operation on the display screen; The setting unit, upon sensing a first touch operation on the ultrasonic image, sets an object point at the location on the ultrasonic image where the first touch operation occurred. The display control unit displays a first GUI element for displaying the ultrasonic image based on the object point in a designated area of ​​the display screen. as well as The display processing unit, upon sensing a second touch operation on the first GUI element, performs display processing on the ultrasonic image based on the second touch operation.

2. The ultrasonic image processing device according to claim 1, characterized in that, The object point includes the center point in the magnification operation of the ultrasound image. The display processing includes the zoom-in operation directed towards the object point.

3. The ultrasonic image processing device according to claim 1, characterized in that, The display control unit displays the ultrasonic image in a first layout, with a first display area for displaying the ultrasonic image and a second display area for displaying GUI elements arranged along the length of the display screen.

4. The ultrasonic image processing device according to claim 1, characterized in that, If a third touch operation, different from the first touch operation, is detected on the ultrasonic image, the display processing unit performs motion processing on the ultrasonic image relative to the display screen.

5. The ultrasonic image processing apparatus according to claim 1, characterized in that, When the display control unit senses a third touch operation on the ultrasonic image that is different from the first touch operation, it displays a second GUI element. Upon sensing a fourth touch operation on the second GUI element, the display processing unit performs motion processing of the ultrasonic image relative to the display screen.

6. The ultrasonic image processing apparatus according to claim 1, characterized in that, When a fifth touch operation, including the first touch operation, is sensed on the ultrasonic image, the setting unit sets a region of interest on the ultrasonic image and sets the center of the region of interest as the target point.

7. The ultrasonic image processing apparatus according to claim 6, characterized in that, The setting unit sets the region of interest as the area where the brightness of the ultrasonic image is lower than a threshold.

8. The ultrasonic image processing apparatus according to claim 6, characterized in that, The setting unit sets the specified regions obtained by dividing the ultrasonic image into multiple parts according to the shape of the ultrasonic image as the regions of interest.

9. The ultrasonic image processing apparatus according to claim 6, characterized in that, The display control unit overlays the area of ​​interest onto the ultrasound image.

10. The ultrasonic image processing apparatus according to claim 6, characterized in that, The ultrasonic image processing device also includes an auxiliary information generation unit that generates auxiliary information capable of identifying multiple regions of interest individually. The setting unit sets the object point at the center of each of the multiple interest areas. The display control unit causes the plurality of areas of interest and / or the accompanying information to be displayed overlaid on the ultrasound image.

11. The ultrasonic image processing apparatus according to claim 10, characterized in that, If a sixth touch operation, different from the fifth touch operation, is detected on the ultrasonic image, the setting unit sequentially activates one object point based on the accompanying information. The display processing unit performs display processing on the ultrasonic image based on the effective object point.

12. The ultrasonic image processing apparatus according to claim 10, characterized in that, The accompanying information is the number of the multiple regions of interest.

13. The ultrasonic image processing apparatus according to claim 3, characterized in that, The display control unit swaps the positions of the first display area and the second display area based on gesture operations on the display device.

14. The ultrasonic image processing apparatus according to claim 13, characterized in that, The gesture operation includes shaking the display device.

15. The ultrasonic image processing apparatus according to claim 1, characterized in that, When the display device is held by both hands, the display control unit divides the second display area of ​​the display GUI elements and displays them in a second layout in which the second display area is arranged such that it sandwiches the first display area displaying the ultrasonic image from the length direction of the display device.

16. The ultrasonic image processing apparatus according to claim 1, characterized in that, The first touch operation and / or the second touch operation include pressing, tapping, double-tapping, triple-tapping, long-pressing, swiping, dragging, fast scrolling and / or scrolling.

17. The ultrasonic image processing apparatus according to claim 1, characterized in that, The first GUI element is displayed near the thumb of the single hand holding the display device.

18. The ultrasonic image processing apparatus according to claim 1, characterized in that, The first touch operation and / or the second touch operation are performed by only one finger of the user's single hand holding the display device.

19. An ultrasonic diagnostic system comprising an ultrasonic probe and a mobile device, characterized in that, The ultrasonic probe sends ultrasonic waves to the subject and receives ultrasonic signals from the subject. The mobile device has: The generation unit generates an ultrasonic image based on the ultrasonic signal; The display device has a display screen for displaying the ultrasonic image; The sensing unit senses the user's touch operation on the display screen; The setting unit, upon sensing a first touch operation on the ultrasonic image, sets an object point at the location on the ultrasonic image where the first touch operation occurred. The display control unit displays a first GUI element for displaying the ultrasonic image based on the object point in a designated area of ​​the display screen. as well as The display processing unit, upon sensing a second touch operation on the first GUI element, performs display processing on the ultrasonic image based on the second touch operation.

20. An ultrasonic image processing method, characterized in that, The following steps are required: Displays ultrasound images related to the subject; Sensing user touch operations on the display screen showing the ultrasonic image; Upon sensing a first touch operation on the ultrasonic image, an object point is set at the location on the ultrasonic image where the first touch operation occurred. A first GUI element for displaying the ultrasonic image based on the object point is displayed in a designated area of ​​the display screen. as well as Upon sensing a second touch operation on the first GUI element, display processing is performed on the ultrasonic image based on the second touch operation.

Images