Control method of an ultrasound imaging device, image processing method and device therefor

Abstract

The embodiment of the application discloses a control method and image processing method of an ultrasonic imaging device and the device, a target operation command is determined through the position relationship between a first fixed point selected by a user on a tissue image and an identified tissue structure, the prediction of the user operation intention is realized, the user does not need to find and select the required operation control, the target operation command can be automatically determined, the target operation command is prompted and / or executed, the control method of the ultrasonic imaging device is very simple to operate, the time of the user in finding the target operation command on the display interface or the operation key is saved, the operation steps of editing are reduced, the work efficiency is improved, meanwhile, the operation guide can be provided for the user lacking experience, the learning cost is reduced, the user is separated from the previous complicated manual operation, and the medical institution pursuing work efficiency has great significance.

Description

Technical Field

[0001] This application relates to the field of ultrasound imaging, and in particular to an operation control method for an ultrasound imaging device, a method and apparatus for processing ultrasound images, and an ultrasound imaging device. Background Technology

[0002] Medical ultrasound imaging diagnostic equipment utilizes the propagation of ultrasound waves through the human body to obtain ultrasound images of human tissues and organs. Traditionally, doctors rely on experience to interpret ultrasound images and arrive at diagnoses. Currently, some medical ultrasound imaging diagnostic devices have emerged that can automatically analyze ultrasound images. These devices can automatically identify characteristic regions in ultrasound images (such as follicles, hair follicles, cysts, etc.), allowing doctors to perform measurements and diagnoses based on these automatically identified regions. However, current automatic identification results are not entirely accurate, still requiring doctors to edit the characteristic regions using editing tools. However, current manual editing operations are very complex, not only failing to provide doctors with the convenience of intelligent detection but also increasing their learning costs and operational burden. Summary of the Invention

[0003] The following is an overview of the subject matter described in detail herein. This overview is not intended to limit the scope of the claims.

[0004] This application provides a control method for an ultrasound imaging device, a method for processing ultrasound images, and an ultrasound imaging device and computer storage medium, which can improve the ease of operation and efficiency of ultrasound image editing.

[0005] In a first aspect, embodiments of this application provide a control method for an ultrasonic imaging device, comprising:

[0006] The first ultrasonic wave is emitted towards the target tissue, and the echo of the first ultrasonic wave returned by the target tissue is received to obtain the first ultrasonic echo signal.

[0007] A tissue image of the target tissue is obtained based on the first ultrasonic echo signal;

[0008] Image recognition is performed on tissue images to identify target tissue structures within the images, thus obtaining the identified tissue structures.

[0009] Displays tissue images and identified tissue structures;

[0010] Select the first fixed point on the tissue image;

[0011] Determine the target operation command based on the positional relationship between the first fixed point and the identified organizational structure;

[0012] Display operation prompts for the target operation command and / or execute the target operation command, wherein the target operation command includes at least one of the following: add organizational structure command, delete organizational structure command, split organizational structure command, merge organizational structure command, and edit organizational structure command.

[0013] Secondly, embodiments of this application provide a control method for an ultrasonic imaging device, including:

[0014] The first ultrasound wave is emitted towards the ovary, and the echo of the first ultrasound wave returned by the ovary is received to obtain the first ultrasound echo signal.

[0015] An image of ovarian tissue was obtained based on the first ultrasound echo signal;

[0016] Image recognition is performed on ovarian tissue images to identify follicles in the ovarian tissue images and obtain a set of identified follicles, which includes at least one identified follicle.

[0017] Displays images of ovarian tissue and outlines of identified follicles in a set of identified follicles;

[0018] Select the first fixed point on the tissue image;

[0019] The follicle manipulation command is determined based on the positional relationship between the first fixed point and the outline of the identified follicle;

[0020] Display operation prompts for the target operation command and / or execute follicle operation commands, wherein the follicle operation commands include at least one of the following: add follicle command, delete follicle command, split follicle command, merge follicle command, and edit follicle command.

[0021] Thirdly, embodiments of this application provide an image processing method, including:

[0022] Acquire and display ultrasound images, wherein the ultrasound images include tissue images of the target tissue and identified tissue structures, wherein the identified tissue structures are obtained by image recognition of the tissue images;

[0023] Select the first fixed point on the tissue image;

[0024] Determine the target operation command based on the positional relationship between the first fixed point and the identified organizational structure;

[0025] Display operation prompts for the target operation command and / or execute the target operation command, wherein the target operation command includes at least one of the following: add organizational structure command, delete organizational structure command, split organizational structure command, merge organizational structure command, and edit organizational structure command.

[0026] Fourthly, embodiments of this application provide an ultrasound imaging device, comprising:

[0027] Ultrasonic probe;

[0028] Transmitter / receiver circuit: The transmitter / receiver circuit is used to control the ultrasound probe to transmit ultrasound waves to the target tissue and receive ultrasound echoes to obtain ultrasound echo signals.

[0029] The processor is used to process ultrasound echo signals, obtain tissue images of the target tissue, and obtain the identified tissue structures by performing image recognition on the tissue images.

[0030] A monitor is used to display images of tissue or identified tissue structures.

[0031] An input device for selecting a point on a tissue image displayed on a monitor;

[0032] The processor is also used to execute the control method of the ultrasonic imaging device of the first and second aspects embodiments described above, or the image processing method of the third aspect embodiment.

[0033] Fifthly, embodiments of this application provide an image processing apparatus, comprising:

[0034] A processor for acquiring and processing ultrasound images, wherein the ultrasound images include tissue images of the target tissue and identified tissue structures;

[0035] A monitor is used to display images of tissue or identified tissue structures.

[0036] An input device for selecting a point on a tissue image displayed on a monitor;

[0037] The processor is also used to perform the image processing method described in the third aspect above.

[0038] Sixthly, embodiments of this application provide an electronic device, including a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the control method of the ultrasonic imaging device as described in the first and second aspects above, or the image processing method as described in the third aspect.

[0039] In a seventh aspect, embodiments of this application provide a computer storage medium storing a computer program applied to an ultrasonic imaging device. When the computer program is executed by a processor, it implements the control method of the ultrasonic imaging device as described in the first and second aspects of the above embodiments, or the image processing method as described in the third aspect of the embodiments.

[0040] Eighthly, embodiments of this application provide a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the control method of the ultrasonic imaging device as described in the first and second aspects, or the image processing method as described in the third aspect.

[0041] The control method, image processing method, and device for ultrasound imaging equipment provided in this application determine the target operation command by the positional relationship between the first fixed point selected by the user on the tissue image and the identified tissue structure. This achieves prediction of the user's operation intention. The user does not need to search for and select the required operation controls; the target operation command can be determined based on the positional relationship between the selected first fixed point and the identified tissue structure. This allows for prompting and / or execution of the target operation command. The target operation command includes at least one of the following: adding a tissue structure, deleting a tissue structure, splitting a tissue structure, merging a tissue structure, and editing a tissue structure. It can operate on the target tissue structure in the tissue image. The control method of the ultrasound imaging equipment in this application is very simple to operate, saving users time searching for the target operation command on the display interface or operation buttons, reducing editing steps, improving work efficiency, and providing operation guidance for inexperienced users, reducing learning costs, and freeing users from the previous cumbersome manual operation. This is of great significance to medical institutions that pursue work efficiency. Attached Figure Description

[0042] The accompanying drawings are used to provide a further understanding of the technical solutions of this application and constitute a part of the specification. They are used together with the embodiments of this application to explain the technical solutions of this application and do not constitute a limitation on the technical solutions of this application.

[0043] Figure 1 This is a structural block diagram of an ultrasound imaging device provided in one embodiment of this application;

[0044] Figure 2 This is a flowchart of a method for controlling an ultrasonic imaging device according to an embodiment of this application;

[0045] Figure 3 This is a display interface view of a tissue image and an identified tissue image provided in one embodiment of this application;

[0046] Figure 4 This is an operational view of determining the command to increase follicles provided in one embodiment of this application;

[0047] Figure 5This is an operational view of executing a command to increase follicles, provided in one embodiment of this application;

[0048] Figure 6 This is an operational view of the command to delete follicles provided in one embodiment of this application;

[0049] Figure 7 This is an operational view of executing a follicle deletion command according to an embodiment of this application;

[0050] Figure 8 This is an operational view of the command to determine follicle splitting provided in one embodiment of this application;

[0051] Figure 9 This is an operational view of executing a follicle splitting command provided in one embodiment of this application;

[0052] Figure 10 This is an operational view of the command to determine fused follicles provided in one embodiment of this application;

[0053] Figure 11 This is an operational view of executing a follicle merging command provided in one embodiment of this application;

[0054] Figure 12 This is an operational view of determining the command to edit the organizational structure, provided in one embodiment of this application;

[0055] Figure 13 This is an operational view of executing commands to edit organizational structure, provided in one embodiment of this application;

[0056] Figure 14 This is a view of a tissue image displayed on a touch screen according to one embodiment of this application;

[0057] Figure 15 This is a flowchart of a method for controlling an ultrasonic imaging device according to an embodiment of this application;

[0058] Figure 16 This is a structural block diagram of an image processing apparatus provided in one embodiment of this application;

[0059] Figure 17 This is a flowchart of an image processing method provided in one embodiment of this application. Detailed Implementation

[0060] The present application will be further described below with reference to the accompanying drawings and specific embodiments. The described embodiments should not be considered as limitations on the present application, and all other embodiments obtained by those skilled in the art without inventive effort are within the scope of protection of the present application.

[0061] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0062] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.

[0063] Medical ultrasound imaging diagnostic equipment utilizes the propagation of ultrasound waves through the human body to obtain ultrasound images of human tissues and organs. These images include tissue images of target tissues (such as the heart, lungs, and ovaries). Doctors can use their experience to identify target tissue structures within these images (e.g., blood vessels in the heart, alveoli in the lungs, follicles in the ovaries), observe and / or measure the state of these structures to obtain a diagnostic result. However, diagnosis based solely on visual observation and experience is prone to errors.

[0064] Currently, some medical ultrasound imaging diagnostic devices have emerged that can automatically analyze ultrasound images. These devices can automatically identify characteristic regions (such as follicles, hair follicles, cysts, etc.) in ultrasound images, allowing doctors to perform measurements and diagnoses based on these automatically identified regions. However, the current automatic identification results are not entirely accurate, and doctors still need to edit the characteristic regions using editing tools. However, the current manual editing process is very complex, not only preventing doctors from experiencing the convenience of intelligent detection but also increasing their learning costs and operational burden.

[0065] To illustrate the issue more clearly, the following explanation uses ovarian ultrasound as an example (this is merely an illustrative example and does not limit the application of this application). Some cases of primary infertility may be caused by an obstruction at a certain step in the continuous process of follicular development. Continuous dynamic ultrasound examination combined with blood hormone level monitoring can detect subtle defects in the processes of follicle recruitment, development, selection, maturation, and ovulation. Ultrasound assessment of ovarian function in infertility includes monitoring follicular development, evaluating follicular reserve function, and diagnosing ovarian insensitivity syndrome. Clinically, follicle monitoring can be performed using ultrasound. However, due to the large number and small size of follicles, doctors often estimate their size and count them visually to improve efficiency. Inexperienced doctors often make inaccurate estimates, and even experienced doctors sometimes lack precision.

[0066] The applicant is aware that image processing can automatically segment follicles and calculate their size from ovarian ultrasound images, helping doctors improve measurement efficiency during follicle monitoring. However, due to current technological limitations and unclear ovarian images, some inaccuracies exist, such as inaccurate boundaries, misidentification, missed identification, and misidentification of adjacent follicles with unclear spacing as a single follicle, or misidentification of a large follicle as several small follicles. Therefore, after follicle identification, manual editing of the identified image is often required, such as using editing tools to add unidentified follicles or delete incorrectly identified follicles. However, the currently known editing method requires manually selecting the desired editing tool and then manually editing the identified image. In practice, frequent tool switching is necessary to complete the image editing, making the operation very complex. This not only prevents users from experiencing the convenience of intelligent detection but also increases the learning cost and operational burden on doctors.

[0067] Based on this, the present invention proposes a control method for an ultrasound imaging device, a processing method for ultrasound images, and an ultrasound imaging device and computer storage medium thereof, which improves the ease of operation and efficiency of editing ultrasound recognition images, reduces the learning cost and operation steps, and is of great significance to medical institutions that pursue work efficiency.

[0068] This invention provides an ultrasound imaging device that improves the ease of operation and efficiency of editing ultrasound recognition images. For example... Figure 1 The diagram shows a structural block diagram of an ultrasound imaging device. The ultrasound imaging device 10 may include a probe 100, a transmitting circuit 101, a transmitting / receiving selection switch 102, a receiving circuit 103, a beamforming circuit 104, a processor 105, and a display 106.

[0069] The ultrasound probe 100 includes a transducer (not shown) composed of multiple array elements arranged in an array. These elements can be arranged in a row to form a linear array, or in a two-dimensional matrix to form a planar array; they can also form a convex array. Each element is used to emit an ultrasonic beam based on an excitation electrical signal, or to convert a received ultrasonic beam into an electrical signal. Therefore, each element can be used to achieve the mutual conversion between electrical pulse signals and ultrasonic beams, thereby enabling the emission of ultrasonic waves to target tissues in the human body (e.g., the heart, lungs, ovaries, etc.), and can also be used to receive echoes of ultrasonic waves reflected back from the tissue. During ultrasound detection, the transmit / receive selection switch 102 can control which elements are used to emit ultrasonic beams, which elements are used to receive ultrasonic beams, or control the elements to be used in time-slotted manner for emitting ultrasonic beams or receiving echoes of ultrasonic beams. Elements participating in ultrasonic wave emission can be simultaneously excited by electrical signals to emit ultrasonic waves simultaneously; or elements participating in ultrasonic wave emission can be excited by several electrical signals with a certain time interval to continuously emit ultrasonic waves with a certain time interval.

[0070] The transmitting circuit 101 generates a transmission sequence under the control of the processor 105. This transmission sequence controls some or all of the multiple array elements to transmit ultrasound waves towards the target tissue. The transmission sequence parameters include the array element positions, the number of array elements, and the ultrasound beam transmission parameters (e.g., amplitude, frequency, number of transmissions, transmission interval, transmission angle, waveform, focusing position, etc.). In some cases, the transmitting circuit 101 also performs phase delay on the transmitted beam, allowing different transmitting array elements to transmit ultrasound waves at different times, so that each transmitted ultrasound beam can be focused in a predetermined region of interest. Different operating modes, such as B-image mode, C-image mode, and D-image mode (Doppler mode), may have different transmission sequence parameters. After the echo signal is received by the receiving circuit 320 and processed by subsequent modules and corresponding algorithms, a B-image reflecting the tissue anatomy, a C-image reflecting the tissue anatomy and blood flow information, and a D-image reflecting the Doppler spectrum can be generated.

[0071] The receiving circuit 103 receives the electrical signal of the ultrasonic echo from the ultrasonic probe 100 and processes the electrical signal of the ultrasonic echo. The receiving circuit 103 may include one or more amplifiers, analog-to-digital converters (ADCs), etc. The amplifier amplifies the received ultrasonic echo electrical signal after appropriate gain compensation, and the ADC samples the analog echo signal at predetermined time intervals to convert it into a digitized signal. The digitized echo signal still retains amplitude, frequency, and phase information. The data output by the receiving circuit 103 can be sent to the beamforming circuit 104 for processing, or to the memory 107 for storage.

[0072] The beamforming circuit 104 is signal-connected to the receiving circuit 103 and is used to perform beamforming processing such as delay and weighted summation on the signal output by the receiving circuit 103. Since the distance from the ultrasonic receiving point in the tested tissue to the receiving array element varies, the channel data of the same receiving point output by different receiving array elements has delay differences, requiring delay processing to align the phases and perform weighted summation on the different channel data of the same receiving point to obtain the beamformed ultrasonic image data. The ultrasonic image data output by the beamforming circuit 104 is also called radio frequency (RF) data. The beamforming circuit 104 outputs the RF data to the IQ demodulation circuit. In some embodiments, the beamforming circuit 104 can also output the RF data to the memory 107 for caching or storage, or directly output the RF data to the image processing module of the processor 105 for image processing.

[0073] The beamforming circuit 104 can perform the above functions in hardware, firmware or software. For example, the beamforming circuit 104 may include a central controller circuit (CPU), one or more microprocessor chips or any other electronic components capable of processing input data according to specific logic instructions. When the beamforming circuit 104 is implemented in software, it can execute instructions stored on a tangible and non-transitory computer-readable medium (e.g., memory 107) to perform beamforming calculations using any appropriate beamforming method.

[0074] The processor 105 is configured to process input data according to specific logic instructions. It is a central controller circuit (CPU), one or more microprocessors, a graphics controller circuit (GPU), or any other electronic component. It can control peripheral electronic components according to input instructions or predetermined instructions, or perform data reading and / or saving on the memory 107. It can also process input data by executing programs in the memory 107. For example, it can perform one or more processing operations on the acquired ultrasound data according to one or more operating modes. The processing operations include, but are not limited to, adjusting or limiting the form of ultrasound waves emitted by the ultrasound probe 100, generating various image frames for display on the display 106 of the subsequent human-machine interaction device, or adjusting or limiting the content and form displayed on the display 106, or adjusting one or more image display settings displayed on the display 106 (e.g., ultrasound images, interface components, locating regions of interest, ultrasound recognition images, etc.).

[0075] The image processing module of processor 105 processes the data output from beamforming circuit 104 or IQ demodulation circuit to generate a grayscale image reflecting the signal strength variations within the scanning range. This grayscale image reflects the internal anatomical structure of the tissue and is called a B-image. The image processing module can output the B-image to the display 106 of the human-computer interaction device for display. The human-computer interaction device is used for human-computer interaction, i.e., receiving user input and outputting visual information; it can receive user input via keyboard, operation buttons, mouse, trackball, etc., or via a touch screen integrated with the display; it outputs visual information via display 106.

[0076] The memory 107 may be a tangible and non-transitory computer-readable medium, such as a flash memory card, solid-state memory, hard disk, etc., for storing data or programs. For example, the memory 107 may be used to store acquired ultrasound data or image frames generated by the processor 105 that are not immediately displayed, or the memory 107 may store a graphical user interface, one or more default image display settings, or programming instructions for the processor, beamforming circuit, or IQ demodulation circuit.

[0077] It should be noted that, Figure 1 The structure shown is for illustrative purposes only and may include more... Figure 1 The more or fewer components shown, or having the same Figure 1 The different configurations shown. Figure 1 The components shown can be implemented in hardware and / or software.

[0078] In one embodiment of this application, the display 106 of the aforementioned ultrasonic imaging device 10 may be a touch screen, a liquid crystal display, or an independent display device such as a liquid crystal display or a television set, separate from the ultrasonic imaging device 10, or a display screen on an electronic device such as a mobile phone or tablet computer.

[0079] In one embodiment of this application, the memory 107 of the aforementioned ultrasound imaging device 10 may be a flash memory card, a solid-state memory, a hard disk, etc.

[0080] In one embodiment of this application, a computer-readable storage medium is also provided, which stores a plurality of program instructions. After being called and executed by the processor 105, the plurality of program instructions can execute some or all of the steps or any combination of the steps in the control method of the ultrasonic imaging device in various embodiments of this application.

[0081] In one embodiment, the computer-readable storage medium may be a memory 107, which may be a non-volatile storage medium such as a flash memory card, a solid-state memory, or a hard disk.

[0082] In one embodiment of this application, the processor 105 of the aforementioned ultrasound imaging device 10 can be implemented by software, hardware, firmware, or a combination thereof. It can use at least one of the following: application-specific integrated circuit (ASIC), digital signal processor (DSP), digital signal processing device (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), central processing unit (CPU), controller, microcontroller, and microprocessor, so that the processor 105 can execute the corresponding steps of the control method of the ultrasound imaging device in the various embodiments of this application.

[0083] In different scenarios, ultrasound examination of different target tissues in the human body is required, such as the heart, lungs, and ovaries. This invention, in its embodiments, emits ultrasound waves to these target tissues and detects the echoes to obtain tissue images. Image recognition is then performed on these images to obtain and display the target tissue structure. Furthermore, based on the location of a first fixed point selected by the user on the displayed tissue image, a target operation command is determined, displaying operation prompts and / or executing the target operation command, thereby improving the convenience and efficiency of ultrasound image editing. The following description primarily uses the ultrasound examination of the ovary as an example. However, those skilled in the art should understand that this invention is not limited to the ovary; the methods and devices in the following embodiments are also applicable to measuring peristaltic parameters of other tissues, such as the heart and lungs.

[0084] The embodiments of the ultrasound imaging device provided in this application can execute the following control methods or image processing methods of various ultrasound imaging devices. The specific embodiments are described below using the control methods of ultrasound imaging devices.

[0085] See Figure 2 As shown in the figure, this application provides a control method for an ultrasonic imaging device, including:

[0086] Step 100: A first ultrasonic wave is emitted toward the target tissue, and the echo of the first ultrasonic wave returned by the target tissue is received to obtain a first ultrasonic echo signal.

[0087] In this step, the ultrasound imaging device 10 generally supports multiple ultrasound examination modes, such as B-mode, color Doppler mode, ultrasound elastography mode, power Doppler mode, and vector flow mode. In step 201, the ultrasound imaging device 10 can use B-mode (reflecting tissue anatomy), C-mode (reflecting tissue anatomy and blood flow information), E-mode (elastography), or M-mode (also known as echocardiography) that can display tissue structure images. The target tissue can be set according to the needs of the ultrasound examination; for example, ultrasound examination can be performed on organs such as the heart, lungs, and ovaries. For example, it can be used through... Figure 1 The ultrasound probe 100 shown emits a first ultrasound wave toward the ovary. By controlling the emission sequence parameters of the transmitting circuit 101, the first ultrasound wave emitted by the ultrasound probe 100 toward the ovary can conform to the requirements for tissue structure image examination, such as B-mode, C-mode, E-mode, or M-mode. After receiving the first ultrasound wave, the ovary returns an echo of the first ultrasound wave. This echo is received by the ultrasound probe 100 and sent to the receiving circuit 103 to be converted into an electrical signal. This signal is then processed by the beamforming circuit 104 to obtain the first ultrasound echo signal. In one embodiment, the first ultrasound echo signal can be stored in the memory 107 for further processing. In another embodiment, it can also be processed and displayed by the image processing module of the processor 105.

[0088] In one embodiment, a linear array ultrasound probe can be used to emit the first ultrasound wave described above for two-dimensional ultrasound detection (e.g., to detect two-dimensional images of follicles in the ovary). In another embodiment, an area array probe can be used to emit the first ultrasound wave described above for three-dimensional ultrasound detection (e.g., to detect three-dimensional images of follicles in the ovary).

[0089] Step 200: Obtain a tissue image of the target tissue based on the first ultrasonic echo signal.

[0090] In this step, the first ultrasound echo signal output by the beamforming circuit 104 can be processed by the image processing module of the processor 105 to generate a grayscale image showing the signal strength variation within the scanning range. This grayscale image reflects the tissue structure of the target tissue; for example, for the tissue structure of the ovary, an ovarian tissue image is generated. In one embodiment, the tissue image can be a B-image or E-image reflecting only the internal anatomical structure of the tissue, or a C-image or M-image reflecting the internal anatomical structure and blood flow information of the tissue. For two-dimensional ultrasound images, the tissue image is the cross-section of the target tissue corresponding to the linear array probe. For three-dimensional ultrasound images, the tissue image can be a three-dimensional stereoscopic image, or a cross-section based on a three-dimensional stereoscopic image. It is understood that a three-dimensional ultrasound image can have multiple cross-sections in different directions (default direction, direction selected by the user according to the detection scenario, or direction manually set by the user). Therefore, in this step, multiple tissue images of the target tissue can be obtained based on the first ultrasound echo signal. In one embodiment, the processor 105 can store the tissue image of the target tissue in the memory 107 for further processing. In another embodiment, the tissue image of the target tissue can also be displayed in real time on the display 106.

[0091] Step 300: Perform image recognition on the tissue image to identify the target tissue structure in the tissue image and obtain the identified tissue structure.

[0092] In this step, by performing image recognition on the tissue image of the target tissue, the ultrasound imaging device 10 (or the processor 105 in the ultrasound imaging device 10) determines the target tissue structure of interest to the user in the tissue image (e.g., blood vessels in the heart, follicles in the ovary, etc.) for observation, measurement, or diagnosis. The identified target tissue structure is called the identified tissue structure. In one embodiment, the identified tissue structure is recorded and saved by the ultrasound imaging device 10 in the form of image feature data. For example, the image feature corresponding to the identified tissue structure is the outline of the identified tissue structure. In one embodiment, the processor 105 integrates all the identified tissue structures and their image features in the tissue image into an identified tissue structure set for unified management, editing, addition, deletion, and display. In another embodiment, the identified tissue structure can be recorded and saved by the ultrasound imaging device 10 in the form of location data. For example, the ultrasound imaging device 10 records the position of the identified tissue structure in the tissue image.

[0093] The image recognition performed on the tissue image in this step can be automatic, manual, or semi-automatic. In one embodiment, an automatic image recognition algorithm can be used to identify the target tissue structure in the tissue image. For example, by setting a grayscale threshold, image regions in the tissue image that are above or below the grayscale threshold are automatically segmented, and further processed (e.g., by area filtering) to identify the target tissue structure. The grayscale threshold parameter can be automatically recommended by the ultrasound imaging device 10 or selected or set by the user according to the detection scenario. It should be noted that the above image recognition algorithm is merely an example; other image recognition algorithms can also be used to identify the target tissue structure. In another embodiment, image recognition can be performed manually by the user. For example, the user can use a human-computer interaction device (e.g., keyboard, operation buttons, mouse, trackball, etc.) or touchscreen to trace the outline of the target tissue structure in the tissue image to obtain the target tissue structure. In another embodiment, image recognition can be performed semi-automatically. That is, the user points to the target tissue structure in the tissue image, and combined with the image recognition algorithm, the target tissue structure is automatically identified as a region. Region identification involves identifying features within a local area selected by the user to obtain the target tissue structure. For example, a user moves the cursor to a follicle in an ovarian tissue image using a trackball, and then an algorithm identifies the features of the area pointed to by the cursor to obtain the follicle's outline. In another embodiment, automatic and manual image recognition can be combined; that is, candidate target tissue structures are obtained through automatic image recognition, and then the user manually selects and confirms the desired target tissue structure. In one embodiment, image recognition of a tissue image can obtain at least one identified tissue structure, where at least one identified tissue structure constitutes a set of identified tissue structures. Taking follicle identification as an example, by performing image recognition on an ovarian tissue image, follicles in the ovarian tissue image are identified, obtaining a set of identified follicles. In one embodiment, the set of identified follicles may include the location data and / or image data (e.g., outline data) of multiple identified follicles.

[0094] In one embodiment, when multiple tissue images exist, image recognition can be performed on each tissue image separately, or the user can select the required tissue image to perform image recognition based on the detection scenario.

[0095] Step 400: Display the tissue image and the identified tissue structures.

[0096] In this step, the target tissue image processed by the image processing module of the processor 105 can be displayed on the display 106, along with the identified tissue structures identified in step 230. In one embodiment, the identified tissue structures in the set of identified tissue structures can be displayed as a processing unit. For example, the tissue image of the target tissue displayed on the display 106 can be a B image, a C image, an E image, or an M image. In one embodiment, the display of the identified tissue structures can be indicated by identification marks on the tissue image, such as graphic markers indicating the position of the target tissue structure on the tissue image, such as arrows, center marks, or centroid marks. Alternatively, identification marks can be used to indicate the shape features of the target tissue structure, such as contours, measurement marks (e.g., diameter marking lines, angle marks). The identification marks mentioned above can be of one type or a combination of multiple types (e.g., marking contours and measurement lines simultaneously). In another embodiment, the display of the identified tissue structure can be differentiated from the background area of ​​other parts of the tissue image. For example, the display state of the identified tissue structure and / or the background area can be adjusted to distinguish it from the background area of ​​other parts of the tissue image. For instance, the brightness of the identified tissue structure may be higher than the background area, or the color, contrast, and saturation of the identified tissue structure may differ from the background area. For example, in one embodiment, see... Figure 3 As shown, the display 106 shows an image 310 of ovarian tissue and the outline 330 of identified follicles 320 in the identified follicle set.

[0097] In one embodiment, a single tissue image and its identified tissue structures are displayed for a two-dimensional ultrasound image. In another embodiment, a tissue image and its identified tissue structures are displayed for a three-dimensional ultrasound image in a default cross-sectional direction, or a tissue image and its identified tissue structures selected by the user are displayed.

[0098] Step 500: Select a first fixed point on the tissue image.

[0099] In this step, the processor 105 acquires first operation instruction information input by the user, which indicates that the user selects a first fixed point in the tissue image. In one embodiment, the first fixed point is a cursor input by the user on the tissue image (e.g., an ovarian tissue image). The processor 105 determines the first fixed point by acquiring the position of the cursor on the tissue image in real time. At this time, the first operation instruction information is the real-time position information of the cursor on the tissue image. The user can control the position of the cursor on the tissue image through input devices such as a mouse, trackball, touchpad, or touch screen. As the cursor moves on the tissue image, the position information of the first fixed point is continuously updated. In another embodiment, the first fixed point is a location selected by the user on the tissue image. For example, the user can determine the first fixed point by controlling the position of the cursor on the tissue image and simultaneously inputting selection information. In this case, the first operation instruction information is the position information of the cursor when the user inputs the selection information. The user can control the position of the cursor on the tissue image through input devices such as a mouse, trackball, touchpad, or touch screen, and input the selection information through physical confirmation buttons (such as the confirmation button on the keyboard or ultrasound imaging device 10, the left mouse button, or pressing the trackball) or virtual buttons (such as the button area displayed on the screen). In another embodiment, the user can select the first fixed point on the tissue image by clicking on the touch display. In this case, the first operation instruction is the position information of the user clicking on the tissue image.

[0100] Step 600: Determine the target operation command based on the positional relationship between the first fixed point and the identified organizational structure.

[0101] In this step, the processor 105 can determine the target operation command based on the relationship between the position of the first fixed point on the tissue image and the identified tissue structure. The target operation command includes at least one of the following: adding a tissue structure, deleting a tissue structure, splitting a tissue structure, merging a tissue structure, and editing a tissue structure. In one embodiment, the target operation command may differ for different target tissues. For example, for ovarian detection, the target operation command is a follicle operation command; for heart detection, the target operation command is a blood vessel operation command. For example, ovarian ultrasound detection is used as an example. See [link to documentation]. Figure 4 As shown, when the first fixed point 410 is inside the outline of the identified follicle, the corresponding follicle operation command is the "Add Follicle" command. Similarly, in an ovarian ultrasound detection scenario, when the first fixed point is at the edge of the outline of the identified follicle, the corresponding follicle operation command is the "Edit Follicle" command. Furthermore, when the first fixed point is near the endpoint of the measurement line of the identified follicle, the corresponding follicle operation command is the "Adjust Measurement Line Endpoint Position" command. Taking cardiac ultrasound detection as another example, when the first fixed point is inside the wall of an identified blood vessel, the corresponding blood vessel operation command is the "Add Blood Vessel" command.

[0102] In another embodiment, the processor 105 can simultaneously determine more types of target operation commands based on the identified tissue structure and other image features of the identified tissue structure. For example, taking ovarian ultrasound detection as an example, when the first fixed point is outside the outline of the identified follicle and located on one side of the first endpoint of the measurement line, the corresponding follicle operation command is to adjust the position of the first endpoint on the follicle outline.

[0103] In another embodiment, the processor 105 can simultaneously determine the target operation command based on the relationship between the tissue image and the identified tissue structure. For example, taking ovarian ultrasound detection as an example, when the first fixed point is inside the tissue structure of a suspected follicle and outside the outline of the identified follicle, the corresponding target operation command is an "add follicle" command; when the first fixed point is in the tissue structure of a non-suspected follicle and outside the outline of the identified follicle, the corresponding follicle operation command is a "split follicle" command.

[0104] In one embodiment, the memory 107 may pre-store a command lookup table of the location of the first fixed point and the target operation command. The command lookup table records the correspondence between the location type of the first fixed point and the corresponding target operation command. For example, the processor 105 first determines the location relationship type between the first fixed point and the identified tissue structure, and then searches for the corresponding target operation command in the command lookup table according to the location relationship type, thereby determining the target operation command. For example, taking the ovarian ultrasound detection scenario as an example, when the first fixed point is inside the outline of the identified follicle, the location relationship type of the first fixed point is determined to be "inside the follicle". By searching the command lookup table, the follicle operation command corresponding to "inside the follicle" is determined to be the follicle increase command. By using a pre-set command lookup table, the determination of the target operation command is divided into two parts: first, determining the positional relationship, achieving the first fixed-point position judgment, and second, determining the execution instruction. When it is necessary to add / modify the position judgment scenario or position judgment algorithm, it is only necessary to point the calculation result to the pre-configured positional relationship, such as "inside the follicle," to determine the target operation command. Therefore, it is not necessary to modify the entire target operation command algorithm. Similarly, by modifying or switching the command lookup table, the function switching under different scenarios can be achieved. For example, by switching / modifying the command lookup table, the target operation command with the positional relationship "inside the follicle" can be switched from an "add follicle" command to a "merge follicle" command, realizing the switching of command combinations. Of course, in another embodiment, the target operation command can also be determined directly by the algorithm without looking up the lookup table, that is, the target operation command can be directly determined by logical condition judgment or algorithm based on the position of the first fixed point.

[0105] Step 700: Display the operation prompt information for the target operation command and / or execute the target operation command.

[0106] In this step, the processor 105 displays operation prompts based on the determined target operation command, or directly executes the target operation command, or executes the target operation command while displaying the operation prompts, or displays the operation prompts first and then executes the target operation command based on the user's next operation. The target operation command includes at least one of the following: add organizational structure command, delete organizational structure command, split organizational structure command, merge organizational structure command, and edit organizational structure command.

[0107] In one embodiment, the processor 105 displays the operation prompt information corresponding to the target operation command on the display 106. For example, it prompts the target operation command to be executed at the corresponding position of the first fixed point through text or graphics. It should be noted that in this embodiment, only the operation prompt information is displayed (e.g., prompting "add"), and the target operation command is not actually executed. To execute the target operation command, further input from the user is required. In one embodiment, the user does not execute the operation corresponding to the current operation prompt information, but instead reselects the first fixed point (or moves the position of the first fixed point). At this time, the processor 105 will redetermine the target operation command based on the new position of the first fixed point (e.g., re-execute the above step 600). For example, if the user moves the cursor on the tissue image, the processor 105 will redetermine the corresponding target operation command based on the last position of the cursor. Another example is that the user determines the first fixed point by clicking the touch screen, and then updates the position of the first fixed point by clicking the touch screen again. Based on this, in one embodiment, after the user performs the corresponding confirmation operation (e.g., click the mouse / press the trackball / press the button to input confirmation) after the operation prompt information is displayed, the processor 105 executes the target operation command (e.g., execute the command to increase follicles) at the position indicated by the first fixed point.

[0108] In another embodiment, the processor 105 directly executes the target operation command at the first fixed point based on its location. For example, the user clicks on the tissue image to confirm the first fixed point using a cursor and a confirmation button. The processor 105 then executes the target operation command corresponding to the location pointed to by the first fixed point. For example, based on the location of the first fixed point clicked by the user, the processor executes the target operation command of increasing follicles at that location. Furthermore, in one embodiment, the processor 105 controls the display 106 to display corresponding operation prompts while executing the target operation command. For example, while executing the command to increase follicles, the processor displays the operation prompt message "Increase".

[0109] In one embodiment, for a two-dimensional ultrasound image, operation prompts and / or target operation commands are displayed on the currently displayed tissue image. In another embodiment, for a three-dimensional ultrasound image, operation prompts and / or target operation commands are displayed on the tissue image with the default or user-selected cross-sectional direction among multiple tissue images. In yet another embodiment, for a three-dimensional ultrasound image, the target operation command can also be executed directly on the three-dimensional ultrasound image based on a first fixed point input by the user, such as adding / deleting / merging / splitting / editing three-dimensional follicles.

[0110] It should be noted that the target operation commands mentioned in the above embodiments are for illustrative purposes only and do not limit the scope of protection of this application. It is understood that different target operation commands can be set according to different detection scenarios and detection requirements.

[0111] The control method for an ultrasound imaging device provided in this application determines the corresponding target operation command by selecting the position of a first fixed point on the tissue image. This achieves prediction of the user's operation intention. The user does not need to search for and select the required operation controls; the target operation command can be determined based on the position of the selected first fixed point. This allows for prompting and / or execution of the target operation command. The target operation command includes at least one of the following: adding tissue structure, deleting tissue structure, splitting tissue structure, merging tissue structure, and editing tissue structure. It can operate on target tissue structures in the tissue image. The control method for the ultrasound imaging device in this application is very simple to operate, saving users time searching for target operation commands on the display interface or operation buttons, reducing editing steps, improving work efficiency, and providing operation guidance for inexperienced users, reducing learning costs, and freeing users from previously cumbersome manual operations. This is of great significance to medical institutions that pursue work efficiency.

[0112] In one embodiment, the identified tissue structure may include other types of image features besides displaying the outline, such as identification markers for the target tissue structure in the tissue image, like graphic markers indicating the position of the target tissue structure on the tissue image: such as arrows, center markers, centroid markers, or markers that distinguish the identified tissue structure from other areas. In other embodiments, it may also include other markers besides the outline for indicating the shape features of the target tissue structure, such as measurement markers (e.g., diameter marking lines, angle markers). The markers mentioned above can be of one type or a combination of multiple types (e.g., simultaneously marking the outline and measurement lines).

[0113] In one embodiment, in step 400 above, in addition to displaying the outline of the identified tissue structure, other features of the identified tissue structure may also be displayed, such as measurement features and their corresponding measurement results, see [link to relevant documentation]. Figure 3 As shown, for example, the measurement results (such as the volume and diameter of follicles) can be summarized and displayed through the result display window 340. After the target operation command corresponding to the location of the first fixed point is executed, the identified tissue structure is remeasured and the measurement results summarized in the structure display window are refreshed, for example, the measurement results are reordered.

[0114] In one embodiment, the processor 105 can further determine the position of the first fixed point on the tissue image based on the first operation instruction information input by the user, and determine the target operation command corresponding to the position of the first fixed point according to a preset algorithm or logical relationship. The target operation command is used to predict the operation that the user needs to perform. In one embodiment, the target operation command is used to edit the image features of the tissue structure identified in step 300 above or to generate new image features.

[0115] In another embodiment, the processor 105 can also determine the target operation command based on the relationship between the first fixed point and the tissue image. For example, the target operation command can be determined based on the features of the tissue image pointed to by the first fixed point. Ovarian ultrasound detection is used as an example for illustration. See [link to relevant documentation]. Figure 4 As shown, when the first fixed point 410 is inside the tissue structure suspected to be a follicle (displayed as a dark gray closed pattern on the tissue image), the corresponding follicle operation command is the "Add Follicle" command; taking cardiac ultrasound detection as an example, when the first fixed point is inside the tissue structure suspected to be a blood vessel, the corresponding blood vessel operation command is the "Add Blood Vessel" command.

[0116] In one embodiment, the target operation command includes at least one of the following: add organizational structure command, delete organizational structure command, split organizational structure command, merge organizational structure command, and edit organizational structure command:

[0117] The "Add Tissue Structure" command is used to perform region recognition on the area indicated by a first fixed point in a tissue image, to identify the target tissue structure within the indicated area, obtain the new tissue structure, and display the new tissue structure. For example, in one embodiment, the location of the first fixed point is outside the already identified tissue structures, and the corresponding target operation command is the "Add Tissue Structure" command. When this command is executed, the unidentified tissue structure indicated by the first fixed point will be identified, resulting in a new tissue structure (e.g., a new follicle or a new blood vessel in the heart, and the corresponding outline will be displayed). In one embodiment, the new tissue structure can also be added to the set of already identified tissue structures.

[0118] The delete organizational structure command is used to delete the identified organizational structure indicated by the first fixed point. In one embodiment, the identified organizational structure indicated by the first fixed point can be deleted from the set of identified organizational structures. For example, in one embodiment, the location of the first fixed point is within the identified organizational structure, and the corresponding target operation command is the delete organizational structure command. When this command is executed, the identified organizational structure indicated by the first fixed point will be deleted (e.g., the identified follicle will be deleted, and the outline of the corresponding follicle will be undisplayed).

[0119] The "Merge Organizational Structure" command is used to merge the identified organizational structure indicated by the first fixed point and the identified organizational structure indicated by the next fixed point to obtain a merged organizational structure, which is then displayed. The next fixed point is the next fixed point selected by the user after selecting the first fixed point. After the processor 105 obtains the first operation instruction information, the processor 105 obtains the second operation instruction information input by the user, which represents the next fixed point selected by the user in the organizational image. The input method for the next fixed point can be the same as that for the first fixed point, for example, both can be determined by controlling the cursor position on the organizational image using a trackball. In another embodiment, the input method for the next fixed point can also be different from that for the first fixed point; for example, the first fixed point can be input by controlling the cursor using a trackball, while the second fixed point can be input by operating the touchscreen. In this step, the identified organizational structure indicated by the first fixed point and the identified organizational structure indicated by the next fixed point are actually the same organizational structure; it's just that the processor 105 mistakenly identified them as two different organizational structures in step 300. For example, in one embodiment, the location of the first fixed point is within the identified tissue structure, and the corresponding target operation command is the merge tissue structure command. When the user selects the next fixed point, the identified tissue structure indicated by the first fixed point and another identified tissue structure indicated by the next fixed point will be merged (e.g., merging two follicles), and the merged tissue structure will be displayed again.

[0120] The "Split Tissue Structure" command is used to split an identified tissue structure according to a boundary line to obtain a first split tissue structure and a second split tissue structure. The first and second split tissue structures are displayed. The boundary line is a straight line formed by a first fixed point and a next fixed point on the tissue image, crossing the identified tissue structure. The next fixed point is the next fixed point selected by the user after selecting the first fixed point. It can use the same or different input method as the first fixed point. The first and next fixed points form a boundary line on the tissue image that crosses the identified tissue structure, allowing for segmentation of the identified tissue structure. For example, in one embodiment, the first fixed point is located outside the identified tissue structure. In this case, the corresponding target operation command is the "Split Tissue Structure" command. When the user selects the next fixed point, the first and next fixed points are used as two endpoints to determine the boundary line, and the identified tissue structure crossed by the boundary line is split (e.g., splitting one follicle into two new follicles along the boundary line).

[0121] The "Edit Organizational Structure" command is used to edit the identified organizational structure indicated by the first fixed point. For example, in one embodiment, the first fixed point is located at the edge of the identified organizational structure, the edge extension area (e.g., the area determined by defining the edge based on the outline of the organizational structure and extending the edge inward and / or outward), or a preset editing trigger position inside (e.g., center point, centroid, endpoint, etc.). The corresponding target operation command is the "Edit Organizational Structure" command. When this command is executed, the user can edit the identified organizational structure. For example, in one embodiment, the processor 105 determines the relationship between the first fixed point and the outline of the identified organizational structure, determining that the first fixed point 410 is located at the edge of the outline of the identified organizational structure. In this case, the target operation command is determined to be the "Edit Organizational Structure" command, and the cursor of the first fixed point 410 changes to a double-headed arrow, allowing the user to drag the outline of the identified organizational structure to edit the outline. In another embodiment, the processor 105 determines that the first fixed point 410 is located at the center of the identified organizational structure. In this case, the target operation command is determined to be the "Edit Organizational Structure" command, and the cursor of the first fixed point 410 changes to a drag marker, allowing the user to drag the position of the identified organizational structure. In another embodiment, when the identified organizational structure is displayed in a manner distinct from the background area, the processor 105 determines that the first fixed point 410 is located at the editing trigger position of the identified organizational structure. At this point, the target operation command is determined to be an edit organizational structure command. The user can then draw, erase, or edit the outline of the organizational structure by manipulating the cursor or by touching the screen. In one embodiment, spline, polynomial, or other curve or surface fitting methods can be used to fit the two-dimensional or three-dimensional outline of the target organizational structure. Then, the control points in the curve or surface can be dragged to edit the outline of the target organizational structure.

[0122] It should be noted that the positional relationship between the first fixed point and the identified organizational structure can be the positional relationship with a single identified organizational structure or the relationship with multiple identified organizational structures. For example, the target operation command is determined to be the add organizational structure command only when the first fixed point is not within the range of any identified organizational structure on the organizational image.

[0123] In one embodiment, step 600 specifically includes at least one of the following steps: 601, 602, 603, 604, and 605:

[0124] Step 601: If the first fixed point is located outside the identified organizational structure, determine the target operation command as the add organizational structure command.

[0125] In this step, the processor 105 determines the relationship between the first fixed point and the identified tissue structure, confirming that the first fixed point is located outside the identified tissue structure. At this point, the target operation command is determined to be the "Add Tissue Structure" command. The "Add Tissue Structure" command is used to perform region recognition on the area indicated by the first fixed point in the tissue image, to identify the target tissue structure within the indicated area, obtain the newly added tissue structure, and display the newly added tissue structure (e.g., displaying the outline of the newly added tissue structure or distinguishing it from the background area). An ovarian ultrasound examination scenario is used as an example for illustration; see [link to example]. Figure 4 As shown, if the first fixed point 410 is located outside the identified follicle, the target operation command is determined to be an "increase follicle" command. If this "increase follicle" command is executed (automatically or by user confirmation), region identification is performed on the area indicated by the first fixed point to identify the follicles within the indicated area of ​​the first fixed point. See [link to relevant documentation]. Figure 5 As shown, follicle 510 was newly obtained, and its outline is displayed. It is evident that users only need to select the first fixed point outside the already identified tissue structure on the tissue image to automatically determine the command to add a tissue structure, thus eliminating the need to search for input buttons (such as physical or virtual buttons) for this command, effectively improving operational efficiency.

[0126] Step 602: If the first fixed point is located inside the identified organizational structure, the target operation command is determined to be the delete organizational structure command.

[0127] In this step, the processor 105 determines the relationship between the first fixed point and the identified tissue structure, confirming that the first fixed point is located inside the identified tissue structure. At this point, the target operation command is determined to be a delete tissue structure command, to delete the identified tissue structure indicated by the first fixed point and cancel its display. In one embodiment, the delete tissue structure command is used to remove the identified tissue structure indicated by the first fixed point from the set of identified tissue structures. An ovarian ultrasound examination scenario is used as an example for illustration; see [link to example]. Figure 6 As shown, if the first fixed point 410 is located inside the identified follicle 610, the target operation command is determined to be the follicle deletion command. See [link to relevant documentation]. Figure 7 As shown, if the follicle deletion command is executed (either automatically or with user confirmation), the identified follicle indicated by the first fixed point is deleted from the set of identified follicles. It is evident that the user only needs to select the first fixed point within the identified tissue structure on the tissue image to automatically determine the follicle deletion command, effectively improving operational efficiency.

[0128] Step 603: If the first fixed point is located outside the identified organizational structure, the target operation command is determined to be the split organizational structure command.

[0129] In this step, the processor 105 determines the relationship between the first fixed point and the identified tissue structure, confirming that the first fixed point is located outside the identified tissue structure. At this point, the target operation command is determined to be the "split tissue structure" command. The "split tissue structure" command is used to split the identified tissue structure. When the user selects the first fixed point and then selects the next fixed point, and the next fixed point is also located outside the identified tissue structure, the line connecting the first and next fixed points forms a boundary line. The processor 105 splits the identified tissue structure according to this boundary line to obtain a first split tissue structure and a second split tissue structure, which are then displayed. An example is provided using an ovarian ultrasound examination scenario. See [link to example]. Figure 8 As shown, if the first fixed point 410 is located outside the identified follicle 810, the target operation command is determined to be a follicle splitting command. If this follicle splitting command is executed (for example, the user selects and confirms the next fixed point 820), the processor 105 splits the identified follicle according to the boundary line 830 determined by the first fixed point 410 and the next fixed point 820. See [link to relevant documentation]. Figure 9 As shown, the first split follicle 910 and the second split follicle 920 are obtained, and the outlines of the first split follicle 910 and the second split follicle 920 can be displayed. It can be seen that the user only needs to select the first fixed point outside the identified tissue structure on the tissue image to automatically determine the split follicle command, which effectively improves the operation efficiency.

[0130] Step 604: If the first fixed point is located inside the identified organizational structure, determine the target operation command as the merge organizational structure command.

[0131] In this step, the processor 105 determines the relationship between the first fixed point and the identified tissue structure, confirming that the first fixed point is located inside the identified tissue structure. At this point, the target operation command is determined to be the merge tissue structure command. The merge tissue structure command is used to merge two identified tissue structures. When the user selects the first fixed point and then selects the next fixed point, and the next fixed point is also located within another identified tissue structure, the processor 105 merges the identified tissue structure indicated by the first fixed point and the identified tissue structure indicated by the next fixed point to obtain a merged tissue structure, which is then displayed (e.g., displaying the outline of the merged tissue structure or distinguishing the merged tissue structure). An example is provided using an ovarian ultrasound examination scenario. See [link to documentation]. Figure 10 As shown, if the first fixed point 410 is located inside an identified follicle 1010, the target operation command is determined to be a follicle merging command. If this follicle merging command is executed (for example, the user selects and confirms the next fixed point 810 located inside another follicle 1020), the processor 105 merges follicles 1010 and follicle 1020 according to the first fixed point 410 and the next fixed point 9810, resulting in the following: Figure 11 The merged follicle 1110 shown is displayed, demonstrating that users only need to select the first fixed point within the identified tissue structure on the tissue image to automatically determine the merged follicle command, effectively improving operational efficiency.

[0132] Step 605: If the first fixed point is located inside, on the edge or in the extended edge area of ​​the identified organizational structure, the corresponding target operation command is the edit organizational structure command.

[0133] See Figure 12 , 13 As shown, in this step, the processor 105 determines the relationship between the first fixed point and the identified organizational structure, and determines that the first fixed point 410 is located in the editing trigger position (e.g., center point, centroid, endpoint, etc.) inside, on the edge or edge extension area of ​​the identified organizational structure. At this time, the target operation command is determined to be the organizational structure editing command. The process of editing the organizational structure command has been described in detail in the above embodiments and will not be repeated here.

[0134] In one embodiment, the position of the first fixed point on the tissue image corresponds to two or more target operation commands. For example, if the first fixed point is located within an identified tissue structure (such as within the outline of an identified follicle), the corresponding target operation command is a delete tissue structure command (such as a delete follicle command) or a merge tissue structure command (such as a merge follicle command). This allows for the integration of more target operation commands, enriching the variety of target operation commands and providing users with more image feature editing tools.

[0135] In one embodiment, prompts for two or more target operation commands can be displayed simultaneously. For example, a command selection window can simultaneously display the above-mentioned delete organizational structure command and merge organizational structure command, allowing the user to further select the target operation command to be executed.

[0136] In another embodiment, the target operation commands can be grouped so that each target operation command under different groups uniquely corresponds to a positional relationship type. That is, under the user-selected or default group, the target operation command corresponding to the current first fixed point is unique. This can both enrich the image feature editing tools and allow users to quickly select the target operation command they need.

[0137] Specifically, in one embodiment, prior to step 600 above, the following steps are also included:

[0138] Get the operation command group information.

[0139] In this step, the processor 105 acquires operation command grouping information. This operation command grouping information indicates which group of target operation commands the processor 105 should use. In one embodiment, this operation command grouping information can be the default operation command grouping information of the ultrasound imaging device 10, such as operation command grouping information pre-stored in the memory 107. The processor 105 acquires this operation command grouping information by reading the memory 107. In another embodiment, the operation command grouping information is input by the user. For example, the user inputs the operation command grouping information through an operation grouping switch button, which can be a physical button or a virtual button on the display 106. Alternatively, the user can input the operation command grouping information via voice command. In one embodiment, the operation command grouping information input by the user can also be stored in the memory 107. When the processor 105 needs to determine the target operation command based on the position of the first fixed point, it reads it from the memory 107. In one embodiment, different command lookup tables can be set to group target operation commands. The command lookup table records the correspondence between the location type of the first fixed point and the corresponding target operation command. When the user inputs operation command grouping information, different command lookup tables are switched accordingly to switch between different operation command groups.

[0140] In one embodiment, step 600 specifically includes the following steps:

[0141] The target operation command is determined based on the positional relationship between the first fixed point and the identified organizational structure, as well as the operation command grouping information.

[0142] In this embodiment, the processor 105 determines the current operation command group based on the acquired operation command grouping information, and determines the target operation command under the currently selected operation command group based on the positional relationship between the first fixed point and the identified organizational structure. Specifically, this includes at least one of the following steps: 611, 612, 613, and 614.

[0143] Step 611: If the first fixed point is located outside the identified organizational structure and the operation command grouping information is the first group, the target operation command is determined to be the add organizational structure command.

[0144] In this step, the processor 105 determines the relationship between the first fixed point and the identified tissue structure, and determines that the first fixed point is located outside the identified tissue structure. In addition, the operation command grouping information obtained by the processor 105 indicates that the current operation command group is the first group. Based on the location of the first fixed point (located outside the identified tissue structure), the processor 105 determines the corresponding target operation command from the first group as the tissue structure addition command (for example, the follicle addition command in the above embodiment).

[0145] Step 612: If the first fixed point is located inside the identified organizational structure and the operation command grouping information is the first group, the target operation command is determined to be the delete organizational structure command.

[0146] In this step, the processor 105 determines the relationship between the first fixed point and the identified tissue structure, and determines that the first fixed point is located inside the identified tissue structure. In addition, the operation command grouping information obtained by the processor 105 indicates that the current operation command group is the first group. Based on the location of the first fixed point (located inside the identified tissue structure), the processor 105 determines the corresponding target operation command from the first group as the tissue structure deletion command (for example, the follicle deletion command in the above embodiment).

[0147] Step 613: If the first fixed point is located outside the identified organizational structure and the operation command grouping information is the second group, the target operation command is determined to be the organizational structure splitting command.

[0148] In this step, the processor 105 determines the relationship between the first fixed point and the identified tissue structure, and determines that the first fixed point is located outside the identified tissue structure. In addition, the operation command grouping information obtained by the processor 105 indicates that the current operation command group is the second group. Based on the position of the first fixed point (located outside the identified tissue structure), the processor 105 determines the corresponding target operation command from the second group as the tissue structure splitting command (for example, the follicle splitting command in the above embodiment).

[0149] Step 614: If the first fixed point is located inside the outline of the identified organizational structure and the operation command grouping information is the second group, the target operation command is determined to be the merge organizational structure command.

[0150] In this step, the processor 105 determines the relationship between the first fixed point and the identified tissue structure, and determines that the first fixed point is located inside the identified tissue structure. In addition, the operation command grouping information obtained by the processor 105 indicates that the current operation command group is the second group. Based on the location of the first fixed point (located inside the identified tissue structure), the processor 105 determines the corresponding target operation command from the second group as the merging tissue structure command (for example, the merging follicle command in the above embodiment).

[0151] In one embodiment, step 500 specifically includes:

[0152] The cursor's position on the tissue image is used as the first fixed point.

[0153] In this step, the first fixed point is the cursor entered by the user on the tissue image. The processor 105 determines the first fixed point by acquiring the cursor's position on the tissue image in real time. The user can control the cursor's position on the tissue image using input devices such as a mouse, trackball, touchpad, or touchscreen. In this step, the user can move the cursor between different positions on the tissue image to observe the operation prompts corresponding to the target operation commands at different positions, and execute the corresponding target operation commands according to the guidance of the operation prompts.

[0154] In one embodiment, after step 500 and before step 600, the following steps are further included:

[0155] Step 501: Select the next fixed point on the tissue image. The input method for the next fixed point can be the same as that for the first fixed point, for example, both can be determined by controlling the cursor position on the tissue image using a trackball. In another embodiment, the input method for the next fixed point can also be different from that of the first fixed point; for example, the first fixed point can be input by controlling the cursor using a trackball, while the second fixed point can be input by operating a touchscreen.

[0156] In another embodiment, the next fixed point is determined after a sliding operation starting from the first fixed point. That is, the starting point of the sliding trajectory is the first fixed point, and the ending point of the sliding trajectory is the next fixed point. The sliding trajectory can be a sliding gesture trajectory or a cursor movement trajectory, and the sliding trajectory can be a straight line or a curve. In one embodiment, the sliding trajectory is obtained by operating the cursor while pressing the input confirmation key.

[0157] In one embodiment, step 600 specifically includes the following steps:

[0158] The target operation command is determined based on the positional relationship between the first and next fixed points and the identified organizational structure.

[0159] In this embodiment, the processor 105 determines the positional relationship between the first fixed point and the next fixed point and the identified tissue structure based on the position of the first fixed point and the position of the next fixed point, determines the target operation command, and then displays the prompt information of the target operation command and / or directly executes the target operation command. Specifically, it includes at least one of the following steps 621 to 62X:

[0160] Step 621: If the first fixed point and the next fixed point are located outside the identified organizational structure, determine the target operation command as the split organizational structure command.

[0161] In this step, the processor 105 determines the relationship between the first fixed point and the next fixed point and the outline of the identified tissue structure, confirming that both the first fixed point and the next fixed point are located outside the identified tissue structure. The processor 105 then determines that the corresponding target operation command is a tissue structure splitting command (e.g., the follicle splitting command in the above embodiment). In one embodiment, the identified tissue structure can be split based on the sliding trajectory formed by the first fixed point and the second fixed point as a dividing line, wherein the dividing line can be a straight line or a curve.

[0162] Step 622: If the first fixed point and the next fixed point are located inside different identified organizational structures, the target operation command is determined to be the merge organizational structure command.

[0163] In this step, the processor 105 makes a judgment based on the relationship between the first fixed point, the next fixed point and the identified tissue structure, and determines that both the first fixed point and the next fixed point are located inside the identified tissue structure. The processor 105 then determines that the corresponding target operation command is a tissue structure merging command (for example, the follicle merging command in the above embodiment).

[0164] Step 623: If the first fixed point is located inside the identified organizational structure and the next fixed point is located outside the identified organizational structure, determine the target operation command as the command to add an organizational structure, split an organizational structure, or expand an organizational structure.

[0165] In this step, the processor 105 determines the relationship between the first fixed point, the next fixed point, and the identified organizational structure, identifying that the first fixed point is located inside the identified organizational structure and the second fixed point is located outside the identified organizational structure. The processor 105 then determines that the corresponding target operation command is a new organizational structure command, an expanded organizational structure command, or a split organizational structure command. Specifically, for the new organizational structure command, the command is displayed or executed at the location indicated by the second fixed point (e.g., the new follicle command in the above embodiment). For the split organizational structure command, the command is executed along the boundary line formed by the first and second fixed points (e.g., the split follicle command in the above embodiment). For the expanded organizational structure command, the new organizational structure command (e.g., the new follicle command in the above embodiment) is first executed at the location indicated by the second fixed point, and then a merge organizational structure command (e.g., the merge follicle command in the above embodiment) is executed on the identified organizational structures indicated by the first and second fixed points respectively. In one embodiment, if the location pointed to by the second fixed point...

[0166] Step 624: If both the first fixed point and the next fixed point are located inside the identified organizational structure, determine the target operation command as either the delete organizational structure command or the split organizational structure command.

[0167] In this step, the processor 105 determines the relationship between the first fixed point, the next fixed point, and the identified organizational structure, confirming that both the first fixed point and the next fixed point are located within the identified organizational structure. The processor 105 then determines the corresponding target operation command as either a delete organizational structure command or a split organizational structure command. Specifically, for the delete organizational structure command, the delete organizational structure command (e.g., the delete follicle command in the above embodiment) is executed on the identified organizational structure containing the first and second fixed points. For the split organizational structure command, the split organizational structure command (e.g., the split follicle command in the above embodiment) is executed on the identified organizational structure containing the first and second fixed points using the extension line of the boundary line formed by the first and second fixed points.

[0168] Step 625: If both the first fixed point and the next fixed point are located at the edge of an identified tissue structure (e.g., the outline edge of a follicle), or if at least one of the first fixed point and the next fixed point is located at the edge of an identified tissue structure, the target operation command is determined to be the edit tissue structure command. The process of the edit tissue structure command has been described in detail in the above embodiments and will not be repeated here.

[0169] In one embodiment, executing the target operation command in step 700 includes the following steps:

[0170] Execute the target operation command based on the first confirmation command entered when the cursor is stationary at the first fixed point.

[0171] In this step, the user can send a first confirmation command to the processor 105 via physical buttons, virtual buttons, or a voice input device. This first confirmation command instructs the processor 105 to execute a target operation command at the location indicated by the first fixed point. For example, executing a command to delete an organizational structure (such as a command to delete follicles) or a command to add an organizational structure (such as a command to add follicles) as described in the above embodiments. Specifically, in one embodiment, the command to delete an organizational structure can directly delete the identified organizational structure indicated by the first fixed point from the set of identified organizational structures.

[0172] In another embodiment, executing the target operation command in step 700 includes the following steps:

[0173] The target operation command is executed based on the first confirmation command entered when the cursor is stationary at the first fixed point, and the second confirmation command entered when the cursor is stationary at the next fixed point.

[0174] In this step, the processor 105 needs to determine the execution operation positions of the first fixed point and the next fixed point on the tissue image before executing the target operation command. The user inputs a first confirmation instruction for the first fixed point and a next confirmation instruction for the next fixed point. The second confirmation instruction for the next fixed point can be input in the same way as the first confirmation instruction. For example, the user can determine the position of the next fixed point by moving the cursor and clicking the physical confirmation button and send the second confirmation instruction to the processor 105. Then, the processor 105 determines the two execution point positions required to execute the target operation command based on the first and second confirmation instructions and executes the target operation command. For example, when executing the merging tissue structure command (such as the merging follicle command) and the splitting tissue structure command (such as the splitting follicle command) in the above embodiments, if the next fixed point corresponding to the next confirmation instruction input by the user does not meet the requirements of the target operation command (for example, in the merging follicle command, the next fixed point is located outside the identified follicle outline), then the target operation command is not executed.

[0175] In another embodiment, executing the target operation command in step 700 includes the following steps:

[0176] The target operation command is executed based on the first fixed point input on the touchscreen.

[0177] In this step, the user selects a first fixed point on the touch screen, and the touch screen sends a first confirmation instruction to the processor 105. The first confirmation instruction is used to instruct the processor 105 to execute the target operation command at the location indicated by the first fixed point.

[0178] In another embodiment, executing the target operation command in step 700 includes the following steps:

[0179] The target operation command is executed based on the first fixed point input by the touchscreen and the next fixed point input by the touchscreen.

[0180] In this step, the user selects a first fixed point and a second fixed point on the touch screen. The touch screen sends a first confirmation instruction and a next confirmation instruction to the processor 105. The processor 105 determines the two execution point positions required to execute the target operation command based on the first confirmation instruction and the second confirmation instruction, and then executes the target operation command.

[0181] In one embodiment, the processor 105 merges the identified organizational structure indicated by the first fixed point and another identified organizational structure at the next fixed point according to the first confirmation command input by the user when the cursor is stationary at the first fixed point and the second confirmation command input when the cursor is stationary at the next fixed point, to obtain the merged organizational structure and its outline, and displays the outline of the merged organizational structure through the display 106.

[0182] Specifically, in one embodiment, the command to add a new organizational structure in any of the above embodiments can be implemented by the following method:

[0183] When a user selects a first fixed point outside the already identified tissue structure and inputs a first confirmation command, confirming the execution of the command to add a new tissue structure at the first fixed point, the processor 105 transmits the tissue image and the coordinate information of the first fixed point to an algorithm for adding a tissue structure contour. This algorithm uses the position of the first fixed point input by the user to segment the contour of the target tissue structure in the tissue image and displays it. In one embodiment, a region growing algorithm can be used to add the target tissue structure. An initial point list is generated by the user selecting the first fixed point. The neighborhood of each point Pi in the point list is traversed (generally 4 or 8 neighborhoods for two-dimensional data, and 6 or 26 neighborhoods for three-dimensional data). If the gray values ​​of point Pi and its neighboring points meet the specific gray distribution of the target tissue structure (e.g., the gray value of a neighboring point is less than a first threshold and the gray difference between it and point Pi is less than a second threshold), then the neighboring points are also added to the point list. After the point list is traversed, all the points in the point list form a connected region, which is the newly added target tissue structure. Morphological operations can be performed on the newly added target tissue structure to make the edges smoother. Interactive segmentation algorithms such as GraphCut or Random Walker can also be used to add target tissue structures. The user-selected first fixed point or the point obtained by the aforementioned region growing algorithm is used as the foreground (i.e., points on the target tissue structure), and points in the image or volume data with gray values ​​greater than a threshold are used as the background region (i.e., points not on the target tissue structure). Interactive segmentation algorithms such as Graph Cut (image segmentation) or Random Walk are then used for segmentation, determining whether the remaining points belong to the target tissue structure or not, thus obtaining the newly added target tissue structure. Alternatively, deep learning segmentation algorithms can be used. Based on the position of the first fixed point, image blocks are extracted from the image and fed into a deep learning segmentation network to obtain the segmentation results. The tissue structure contour addition algorithm in this step can be applied to different types of target tissue structures, such as follicles, blood vessels, hair follicles, and cysts—tissue structures with closed shapes or capable of presenting closed shapes within the display interface.

[0184] Specifically, in one embodiment, the merge organizational structure command of any of the above embodiments can be implemented by the following method:

[0185] The user selects a first fixed point within the identified tissue structure contour and inputs a first confirmation command. Then, within another identified tissue structure contour, the user selects a next fixed point and inputs a second confirmation command. The processor 105 determines to execute the tissue structure merging command. At this time, the processor 105 inputs the tissue image, the coordinate information of the first fixed point, and the next fixed point into the contour merging algorithm to merge the contours of the two identified tissue structures, obtaining a merged tissue structure and its contour. In one embodiment, the contour merging algorithm can use interactive segmentation algorithms such as Graph Cut or Random Walker to merge contours by adding target tissue structures. In this method, the points traversed by the straight line formed by the first fixed point and the next fixed point are used as the foreground (i.e., points on the target tissue structure), and the points in the image or volume data with gray values ​​greater than a threshold are used as the background region (i.e., points not on the target tissue structure). Interactive segmentation algorithms such as Graph Cut or Random Walker are used for segmentation to obtain a merged region. In another embodiment, the two target tissue structures indicated by the first fixed point and the next fixed point can also be treated as a whole, their centroids calculated, and the above-mentioned tissue structure contour-adding algorithm executed at the centroid position to obtain the merged tissue structure and its contour.

[0186] In one embodiment, the processor 105 determines the boundary line formed by the first fixed point and the next fixed point on the tissue image that crosses the identified tissue structure, based on the first confirmation command input by the user when the cursor is stationary at the first fixed point and the second confirmation command input when the cursor is stationary at the next fixed point. The processor 105 then splits the identified tissue structure according to the boundary line to obtain the first split tissue structure and its outline and the second split tissue structure and its outline, and displays the outlines of the first split tissue structure and the second split tissue structure on the display 106.

[0187] Specifically, in one embodiment, the command to split the organizational structure in any of the above embodiments can be implemented by the following method:

[0188] The user selects a first fixed point outside the identified tissue structure outline and inputs a first confirmation command. Then, the user selects a next fixed point, also outside the identified tissue structure outline, and inputs a second confirmation command. The processor 105 determines to execute the tissue structure splitting command. At this time, the processor 105 inputs the tissue image, the coordinate information of the first fixed point and the next fixed point into the outline splitting algorithm to split the outline of the identified tissue structure, obtaining the outlines of the first split tissue structure and the second split tissue structure. In one embodiment, a forced splitting method can be used, that is, the boundary line (for two-dimensional images) or interface (for three-dimensional images, the interface is formed by the boundary line extending in the depth direction of the tissue image) determined by the first fixed point and the next fixed point is forcibly set to non-follicular regions, thereby splitting a target tissue structure into two. In another embodiment, the center or centroid of each of the two regions after the identified tissue structure is divided by the boundary line or interface can be calculated, and the above-mentioned tissue structure outline increasing algorithm can be executed with the center or centroid of each region to obtain the outlines of the first split tissue structure and the second split tissue structure.

[0189] In one embodiment, see Figure 14 As shown, this is an organization image interface displayed on a touch screen, which includes a prompt window 1410 for prompting the user on how to input a sliding trajectory using gestures. The prompt window 1410 indicates the target operation command corresponding to different sliding trajectories.

[0190] The above embodiments include selecting a first fixed point and a next fixed point to determine the execution mode of the target operation command, and determining the next fixed point after performing a sliding operation starting from the first fixed point, thereby determining the execution mode of the target operation command. In one embodiment, the switching between the two operation modes can be achieved through a function selection command.

[0191] It should be noted that the target tissue structure mentioned in the above embodiments can be set as needed. The follicles and blood vessels mentioned in the above embodiments are only illustrative examples. The target tissue structure can also be hair follicles, cysts, kidney cysts, lung nodules, areas affected by emphysema, gallstones, kidney stones, tumors and tumor nodules, or other human tissue structures, or a combination of multiple human tissue structures.

[0192] See Figure 15 As shown in the figure, this application provides a control method for an ultrasonic imaging device, including:

[0193] Step 1510: Send a first ultrasound wave to the ovary and receive the echo of the first ultrasound wave returned by the ovary to obtain the first ultrasound echo signal.

[0194] Step 1520: Obtain an image of ovarian tissue based on the first ultrasound echo signal;

[0195] Step 1530: Perform image recognition on the ovarian tissue image to identify follicles in the ovarian tissue image and obtain a set of identified follicles, the set of identified follicles including at least one identified follicle;

[0196] Step 1540: Display the ovarian tissue image and the outlines of the identified follicles in the identified follicle set;

[0197] Step 1550: Select the first fixed point on the ovarian tissue image;

[0198] Step 1560: Determine the follicle manipulation command based on the positional relationship between the first fixed point and the outline of the identified follicle;

[0199] Step 1570: Display operation prompts for the target operation command and / or execute the follicle operation command, wherein the follicle operation command includes at least one of the following: add follicle command, delete follicle command, split follicle command, merge follicle command, and edit follicle command.

[0200] This invention provides an image processing device that improves the ease of operation and efficiency of editing ultrasound recognition images. For example... Figure 16 The diagram shown is a structural block diagram of an image processing device. The image processing device 20 may include a processor 105, a display 106, and a memory 107. In some embodiments, it may also include a data transmission module 108.

[0201] The processor 105 can control peripheral electronic components according to input instructions or predetermined instructions, or perform data reading and / or saving on the memory 107. It can also process input data by executing programs in the memory 107. The image processing module of the processor 105 can process data output from the beamforming circuit 104 or the IQ demodulation circuit. In other embodiments, existing ultrasound tissue images can be read from the memory 107 or received or processed via the data transmission module 108 to generate a grayscale image reflecting the signal strength variations within the scanning range. This grayscale image reflects the internal anatomical structure of the tissue and is called a B-image. The image processing module can output the B-image to the display 106 of the human-computer interaction device for display. The human-computer interaction device is used for human-computer interaction, i.e., receiving user input and outputting visual information. It can receive user input using a keyboard, operation buttons, mouse, trackball, etc., or a touchscreen integrated with the display. It outputs visual information via the display 106.

[0202] It should be noted that, Figure 16 The structure of the image processing device is for illustrative purposes only and may also include components such as... Figure 16 The more or fewer components shown, or having the same Figure 16 The different configurations shown. Figure 16 The components shown can be implemented in hardware and / or software.

[0203] In one embodiment of this application, the display 106 of the aforementioned image processing device 20 may be a touch screen, a liquid crystal display, or an independent display device such as a liquid crystal display or a television set, separate from the ultrasonic imaging device 10, or a display screen on an electronic device such as a mobile phone or tablet computer.

[0204] The embodiments of the image processing apparatus provided in this application can perform the following image processing methods.

[0205] See Figure 17 As shown, this application provides an image processing method, including:

[0206] Step 1710: Acquire and display ultrasound images, wherein the ultrasound images include tissue images of the target tissue and identified tissue structures, wherein the identified tissue structures are obtained by image recognition of the tissue images.

[0207] In this step, the processor 105 acquires an ultrasound image, which includes image information of a tissue image. The processor 105 processes the image information of the tissue image and displays the tissue image on the display 106. In one embodiment, the ultrasound image can be pre-stored in the memory 107. The ultrasound image can be a two-dimensional image or a three-dimensional image. In one embodiment, the ultrasound image can be obtained through steps 100 to 300 and related steps in the above embodiments.

[0208] Step 1720: Select a first fixed point on the tissue image.

[0209] This step can be implemented using step 500 and related steps from the above embodiments.

[0210] Step 1730: Determine the target operation command based on the positional relationship between the first fixed point and the identified organizational structure.

[0211] This step can be implemented using step 600 and related steps from the above embodiments.

[0212] Step 1740: Display the operation prompt information of the target operation command and / or execute the target operation command.

[0213] In this step, the target operation command includes at least one of the following: add organizational structure command, delete organizational structure command, split organizational structure command, merge organizational structure command, and edit organizational structure command. Specifically, it can be implemented using step 700 and related steps in the above embodiments.

[0214] The image processing method provided in this application determines the corresponding target operation command by identifying the position of a first fixed point selected by the user on the tissue image. This achieves prediction of the user's operation intention. The user does not need to search for and select the required operation controls; the target operation command can be determined based on the position of the selected first fixed point. This allows for prompting and / or execution of the target operation command. The target operation command includes at least one of the following: adding tissue structure, deleting tissue structure, splitting tissue structure, merging tissue structure, and editing tissue structure. This method can operate on the target tissue structure in the tissue image. The control method of the ultrasound imaging device in this application is very simple to operate, saving users time searching for the target operation command on the display interface or operation buttons, reducing editing steps, improving work efficiency, and providing operation guidance for inexperienced users, reducing learning costs, and freeing users from the previously cumbersome manual operation. This is of great significance to medical institutions that pursue work efficiency.

[0215] It should be noted that the target tissue structure mentioned in the above embodiments can be set as needed. The follicles and blood vessels mentioned in the above embodiments are only illustrative examples. The target tissue structure can also be hair follicles, cysts, kidney cysts, lung nodules, areas affected by emphysema, gallstones, kidney stones, tumors and tumor nodules, or other human tissue structures, or a combination of multiple human tissue structures.

[0216] This application provides an ultrasound imaging device, including:

[0217] Ultrasonic probe;

[0218] Transmitter / receiver circuit: The transmitter / receiver circuit is used to control the ultrasound probe to transmit ultrasound waves to the target tissue and receive ultrasound echoes to obtain ultrasound echo signals.

[0219] The processor is used to process ultrasound echo signals, obtain tissue images of the target tissue, and obtain the identified tissue structures and their outlines by performing image recognition on the tissue images.

[0220] A monitor is used to display images of tissue or outlines of identified tissue structures.

[0221] An input device for selecting a point on a tissue image displayed on a monitor;

[0222] The processor is also used to execute the control method or image processing method of the ultrasonic imaging device provided in any of the above embodiments.

[0223] This application provides an image processing apparatus, including:

[0224] A processor for acquiring and processing ultrasound images, wherein the ultrasound images include tissue images of target tissues and identified tissue structures;

[0225] A display for displaying the tissue image or the identified tissue structure;

[0226] An input device for selecting a point on the tissue image displayed on the display;

[0227] The processor is also used to execute the image processing method provided in any of the above embodiments.

[0228] This application provides an electronic device, including a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the ultrasonic emission method as described in the above embodiments, or it is also used to execute the image processing method described in the above embodiments.

[0229] This application provides a computer storage medium storing a computer program applied to an ultrasonic imaging device. When executed by a processor, the computer program implements the ultrasonic emission method as described in the above embodiments, or it is also used to execute the image processing method described in the above embodiments.

[0230] This application provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the ultrasonic emission method as described in the above embodiments, or further to perform the image processing method as described in the above embodiments.

[0231] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces, or indirect coupling or communication connection between apparatuses or units, and may be electrical, mechanical, or other forms.

[0232] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0233] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0234] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0235] It should also be understood that the various implementation methods provided in this application can be combined arbitrarily to achieve different technical effects.

[0236] The above provides a detailed description of the preferred embodiments of this application. However, this application is not limited to the above-described embodiments. Those skilled in the art can make various equivalent modifications or substitutions without departing from the spirit of this application. All such equivalent modifications or substitutions are included within the scope defined by the claims of this application.

Claims

1. A control method for an ultrasonic imaging device, characterized in that, The method includes: A first ultrasonic wave is emitted toward a target tissue, and the echo of the first ultrasonic wave returned by the target tissue is received to obtain a first ultrasonic echo signal; A tissue image of the target tissue is obtained based on the first ultrasound echo signal; Image recognition is performed on the tissue image to identify the target tissue structure in the tissue image, thereby obtaining the identified tissue structure; Display the tissue image and the identified tissue structure; Select a first fixed point on the tissue image; The target operation command is determined based on the positional relationship between the first fixed point and the identified tissue structure. Displaying operation prompts for the target operation command and / or executing the target operation command, wherein the target operation command includes at least one of the following: adding an organizational structure command, deleting an organizational structure command, splitting an organizational structure command, merging an organizational structure command, and editing an organizational structure command.

2. The control method for an ultrasonic imaging device according to claim 1, characterized in that, The step of determining the target operation command based on the positional relationship between the first fixed point and the identified tissue structure includes at least one of the following: If the first fixed point is located outside the identified organizational structure, the target operation command is determined to be an add organizational structure command, wherein the add organizational structure command is used to perform region recognition on the region indicated by the first fixed point selected in the organizational image, so as to identify the target organizational structure in the region indicated by the first fixed point, obtain the new organizational structure and display the new organizational structure; Alternatively, if the first fixed point is located inside the identified organizational structure, the target operation command is determined to be a delete organizational structure command, wherein the delete organizational structure command is used to delete the identified organizational structure indicated by the first fixed point.

3. The control method for an ultrasonic imaging device according to claim 1, characterized in that, After selecting the first fixed point, the method further includes: selecting the next fixed point on the tissue image; The step of determining the target operation command based on the positional relationship between the first fixed point and the identified tissue structure includes: The target operation command is determined based on the positional relationship between the first fixed point, the next fixed point, and the identified organizational structure.

4. The control method for an ultrasonic imaging device according to claim 3, characterized in that, The step of selecting the next point on the tissue image includes one of the following: Click directly on the tissue image to determine the next fixed point; Alternatively, the next fixed point can be determined by performing a sliding operation starting from the first fixed point.

5. A control method for an ultrasonic imaging device according to claim 3 or 4, characterized in that, The step of determining the target operation command based on the positional relationship between the first fixed point, the next fixed point, and the identified tissue structure includes: If the first fixed point and the next fixed point are located outside the identified organizational structure, the target operation command is determined to be a split organizational structure command. The split organizational structure command is used to split the identified organizational structure according to the dividing line formed by the first fixed point and the next fixed point to obtain a first split organizational structure and a second split organizational structure, and to display the first split organizational structure and the second split organizational structure.

6. A control method for an ultrasonic imaging device according to claim 3 or 4, characterized in that, The step of determining the target operation command based on the positional relationship between the first fixed point, the next fixed point, and the identified tissue structure includes: If the first fixed point and the next fixed point are located inside the identified organizational structure, the target operation command is determined to be a merge organizational structure command, wherein the merge organizational structure command is used to merge the identified organizational structure indicated by the first fixed point and the identified organizational structure indicated by the next fixed point to obtain a merged organizational structure and display the merged organizational structure.

7. The control method for an ultrasonic imaging device according to claim 1, characterized in that, The step of determining the target operation command based on the positional relationship between the first fixed point and the identified tissue structure includes: If the first fixed point is located inside, on the edge, or in the extended area of ​​the identified organizational structure, the target operation command is determined to be an edit organizational structure command, wherein the edit organizational structure command is used to edit the identified organizational structure indicated by the first fixed point.

8. The control method for an ultrasonic imaging device according to claim 1, characterized in that, Also includes: Get operation command group information; The step of determining the target operation command based on the positional relationship between the first fixed point and the identified tissue structure includes: The target operation command is determined based on the positional relationship between the first fixed point and the identified organizational structure, as well as the operation command grouping information.

9. The control method for an ultrasonic imaging device according to claim 8, characterized in that, The step of determining the target operation command based on the positional relationship between the first fixed point and the identified tissue structure, and the operation command grouping information, includes at least one of the following: If the first fixed point is located outside the identified organizational structure, and the operation command grouping information is the first group, the target operation command is determined to be the add organizational structure command. The add organizational structure command is used to perform region recognition on the area indicated by the first fixed point selected in the organizational image, so as to identify the target organizational structure in the indicated area of ​​the first fixed point, obtain the new organizational structure, and display the new organizational structure. Alternatively, if the first fixed point is located inside the identified organizational structure, and the operation command grouping information is a first group, the target operation command is determined to be a delete organizational structure command, wherein the delete organizational structure command is used to delete the identified organizational structure indicated by the first fixed point.

10. A control method for an ultrasonic imaging device according to claim 3 or 4, characterized in that, Also includes: Get operation command group information; The step of determining the target operation command based on the positional relationship between the first fixed point, the next fixed point, and the identified tissue structure includes: If the first fixed point and the next fixed point are located outside the identified organizational structure, and the operation command grouping information is the second group, the target operation command is determined to be the split organizational structure command. The split organizational structure command is used to split the identified organizational structure according to the dividing line formed by the first fixed point and the next fixed point to obtain a first split organizational structure and a second split organizational structure, and to display the first split organizational structure and the second split organizational structure.

11. A control method for an ultrasonic imaging device according to claim 3 or 4, characterized in that, Also includes: Get operation command group information; The step of determining the target operation command based on the positional relationship between the first fixed point, the next fixed point, and the identified tissue structure includes: If the first fixed point and the next fixed point are located inside the identified organizational structure, and the operation command grouping information is the second group, the target operation command is determined to be the merge organizational structure command. The merge organizational structure command is used to merge the identified organizational structure indicated by the first fixed point and the identified organizational structure indicated by the next fixed point to obtain a merged organizational structure and display the merged organizational structure.

12. The control method for an ultrasonic imaging device according to claim 1, characterized in that, The step of determining the target operation command based on the positional relationship between the first fixed point and the identified tissue structure includes: If the first fixed point is located outside the identified organizational structure, the target operation command is determined to be a split organizational structure command. The split organizational structure command is used to split the identified organizational structure according to the dividing line to obtain a first split organizational structure and a second split organizational structure, and to display the first split organizational structure and the second split organizational structure. The dividing line is a straight line formed by the first fixed point and the next fixed point on the organizational image that crosses the identified organizational structure.

13. The control method for an ultrasonic imaging device according to claim 1, characterized in that, The step of determining the target operation command based on the positional relationship between the first fixed point and the identified tissue structure includes: If the first fixed point is located inside the identified organizational structure, the target operation command is determined to be a merge organizational structure command, wherein the merge organizational structure command is used to merge the identified organizational structure indicated by the first fixed point and the identified organizational structure indicated by the next fixed point to obtain a merged organizational structure and display the merged organizational structure.

14. The control method for an ultrasonic imaging device according to claim 1, characterized in that, Selecting a first fixed point on the tissue image includes: The cursor's position on the tissue image or the touch input position on the touchscreen is obtained as the first fixed point; The execution of the target operation command includes at least one of the following: Execute the target operation command based on the first confirmation command input when the cursor is stationed at the first fixed point; Alternatively, the target operation command can be executed based on the first confirmation command input when the cursor is stationary at the first fixed point and the second confirmation command input when the cursor is stationary at the next fixed point; Alternatively, the target operation command can be executed based on the first fixed point input on the touchscreen; Alternatively, the target operation command can be executed based on the first fixed point input by the touchscreen and the next fixed point input by the touchscreen.

15. The control method for an ultrasonic imaging device according to claim 4, characterized in that, The sliding operation starting from the first fixed point is obtained by sliding the touch input on the touch screen, or by sliding the cursor while pressing the input confirmation key.

16. The control method for an ultrasonic imaging device according to claim 1, characterized in that, The step of determining the target operation command based on the positional relationship between the first fixed point and the identified tissue structure includes: Determine the positional relationship between the first fixed point and the identified tissue structure; Based on the positional relationship between the first fixed point and the identified organizational structure, the positional relationship type between the first fixed point and the identified organizational structure is determined, and the target operation command is determined based on the positional relationship type.

17. The control method for an ultrasonic imaging device according to claim 1, characterized in that, The identified organizational structures are marked with identification tags.

18. The method according to claim 17, characterized in that, The identification marker includes the outline of the identified tissue structure.

19. A control method for an ultrasonic imaging device according to any one of claims 1 to 4, 7 to 9, and 12 to 18, characterized in that, The target tissue structures include at least one of follicles, blood vessels, hair follicles, cysts, kidney cysts, pulmonary nodules, areas affected by emphysema, gallstones, kidney stones, tumors, and tumor nodules.

20. A control method for an ultrasonic imaging device, characterized in that, The method includes: A first ultrasound wave is emitted toward the ovary, and the echo of the first ultrasound wave returned by the ovary is received to obtain a first ultrasound echo signal. An image of ovarian tissue was obtained based on the first ultrasound echo signal; Image recognition is performed on the ovarian tissue image to identify follicles in the ovarian tissue image, and a set of identified follicles is obtained, wherein the set of identified follicles includes at least one identified follicle. The image shows the ovarian tissue and the outlines of the identified follicles in the set of identified follicles; Select a first fixed point on the ovarian tissue image; The follicle manipulation command is determined based on the positional relationship between the first fixed point and the outline of the identified follicle; Displaying operation prompts for the follicle manipulation commands and / or executing the follicle manipulation commands, wherein the follicle manipulation commands include at least one of the following: add follicle command, delete follicle command, split follicle command, merge follicle command, and edit follicle command.

21. The control method for an ultrasonic imaging device according to claim 20, characterized in that, The command to add follicles is used to identify the region indicated by the first fixed point in the ovary, to identify the follicles in the region indicated by the first fixed point, to obtain the outline of the newly added follicles, and to display the outline of the newly added follicles.

22. The control method for an ultrasonic imaging device according to claim 20, characterized in that, The delete follicle command is used to delete the identified follicle indicated by the first fixed point from the identified follicle set and to unshow the outline of the identified follicle.

23. The control method for an ultrasonic imaging device according to claim 20, characterized in that, The edit follicle command is used to edit the outline of the identified follicles.

24. The control method for an ultrasonic imaging device according to claim 20, characterized in that, After selecting the first fixed point, the method further includes: selecting the next fixed point on the tissue image; The step of determining the follicle manipulation command based on the positional relationship between the first fixed point and the outline of the identified follicle includes: The follicle manipulation command is determined based on the positional relationship between the first fixed point, the next fixed point, and the outline of the identified follicle.

25. The control method for an ultrasonic imaging device according to claim 24, characterized in that, Selecting a specific point on the tissue image includes: Click on the ovarian tissue image to determine the next fixed point; Alternatively, the next fixed point can be determined by performing a sliding operation starting from the first fixed point.

26. A control method for an ultrasonic imaging device according to claim 24 or 25, characterized in that, The split follicle command is used to split the outline of the identified follicle according to the dividing line formed by the first fixed point and the next fixed point, so as to obtain the first split follicle and its outline and the second split follicle and its outline, and to display the outline of the first split follicle and the outline of the second split follicle.

27. A control method for an ultrasonic imaging device according to claim 24 or 25, characterized in that, The follicle merging command is used to merge the outline of the identified follicle indicated by the first fixed point and the outline of the identified follicle indicated by the next fixed point to obtain the merged follicle and its outline, and to display the outline of the merged follicle.

28. The control method for an ultrasonic imaging device according to claim 20, characterized in that, The step of determining the follicle manipulation command based on the positional relationship between the first fixed point and the outline of the identified follicle includes at least one of the following: If the first fixed point is located outside the outline of the identified follicle, the follicle operation command is determined to be an add follicle command. The add follicle command is used to perform region recognition on the area indicated by the first fixed point selected in the ovarian tissue image, so as to identify the follicle in the area indicated by the first fixed point, obtain the newly added follicle and the outline of the newly added follicle, and display the outline of the newly added follicle. Alternatively, if the first fixed point is located inside the outline of the identified follicle, the follicle operation command is determined to be a follicle deletion command, wherein the follicle deletion command is used to delete the identified follicle indicated by the first fixed point from the identified follicle set and delete the outline of the identified follicle.

29. A control method for an ultrasonic imaging device according to claim 24 or 25, characterized in that, The step of determining the follicle manipulation command based on the positional relationship between the first fixed point, the next fixed point, and the outline of the identified follicle includes: If the first fixed point and the next fixed point are located outside the outline of the identified follicle, the follicle operation command is determined to be a follicle splitting command. The follicle splitting command is used to split the identified follicle according to the dividing line determined by the first fixed point and the next fixed point to obtain a first split follicle and its outline and a second split follicle and its outline, and to display the outline of the first split follicle and the outline of the second split follicle.

30. A control method for an ultrasonic imaging device according to claim 24 or 25, characterized in that, The step of determining the follicle manipulation command based on the positional relationship between the first fixed point, the next fixed point, and the outline of the identified follicle includes: If the first fixed point and the next fixed point are located inside the outline of the identified follicle, the follicle operation command is determined to be a follicle merging command. The follicle merging command is used to merge the outline of the identified follicle indicated by the first fixed point and the outline of the identified follicle indicated by the next fixed point to obtain a merged follicle and its outline, and to display the outline of the merged follicle.

31. The control method for an ultrasonic imaging device according to claim 20, characterized in that, The step of determining the follicle manipulation command based on the positional relationship between the first fixed point and the outline of the identified follicle includes: If the first fixed point is located at the edge of the outline of the identified follicle, the follicle operation command is determined to be an edit follicle command, wherein the edit follicle command is used to edit the outline of the identified follicle indicated by the first fixed point.

32. The control method for an ultrasonic imaging device according to claim 20, characterized in that, Also includes: Get operation command group information; The step of determining the follicle manipulation command based on the positional relationship between the first fixed point and the outline of the identified follicle includes: The follicle operation command is determined based on the positional relationship between the first fixed point and the outline of the identified follicle, as well as the operation command grouping information.

33. The control method for an ultrasonic imaging device according to claim 32, characterized in that, The step of determining the follicle manipulation command based on the positional relationship between the first fixed point and the outline of the identified follicle, and the operation command grouping information, includes at least one of the following: If the first fixed point is located outside the outline of the identified follicle, and the operation command grouping information is the first group, the follicle operation command is determined to be the follicle addition command. The follicle addition command is used to perform region recognition on the region indicated by the first fixed point selected in the ovarian tissue image, so as to identify the follicle in the region indicated by the first fixed point, obtain the newly added follicle and the outline of the newly added follicle, and display the outline of the newly added follicle. Alternatively, if the first fixed point is located inside the outline of the identified follicle, and the operation command grouping information is the first group, the follicle operation command is determined to be a follicle deletion command, wherein the follicle deletion command is used to delete the identified follicle indicated by the first fixed point from the identified follicle set and delete the outline of the identified follicle.

34. A control method for an ultrasonic imaging device according to claim 24 or 25, characterized in that, Also includes: Get operation command group information; The step of determining the follicle manipulation command based on the positional relationship between the first fixed point, the next fixed point, and the outline of the identified follicle includes: If the first fixed point and the next fixed point are outside the outline of the identified follicle, and the operation command grouping information is the second group, the follicle operation command is determined to be a follicle splitting command. The follicle splitting command is used to split the identified follicle according to the dividing line formed by the first fixed point and the next fixed point to obtain a first split follicle and its outline and a second split follicle and its outline, and to display the outline of the first split follicle and the outline of the second split follicle.

35. A control method for an ultrasonic imaging device according to claim 24 or 25, characterized in that, Also includes: Get operation command group information; The step of determining the follicle manipulation command based on the positional relationship between the first fixed point, the next fixed point, and the outline of the identified follicle includes: If the first fixed point is located inside the outline of the identified follicle, and the operation command grouping information is the second group, the follicle operation command is determined to be a follicle merging command. The follicle merging command is used to merge the outline of the identified follicle indicated by the first fixed point and the outline of the identified follicle indicated by the next fixed point to obtain the merged follicle and its outline, and to display the outline of the merged follicle.

36. The control method for an ultrasonic imaging device according to claim 20, characterized in that, Selecting a first fixed point on the ovarian tissue image includes: The cursor's position on the ovarian tissue image or the touch input position on the touchscreen is used as the first fixed point; The execution of the follicle manipulation command includes at least one of the following: The follicle manipulation command is executed based on the first confirmation command input when the cursor is stationed at the first fixed point. Alternatively, the follicle manipulation command can be executed based on the first confirmation command input when the cursor is stationary at the first fixed point and the second confirmation command input when the cursor is stationary at the next fixed point; Alternatively, the follicle manipulation command can be executed based on the first fixed point input on the touchscreen; Alternatively, the follicle manipulation command can be executed based on the first fixed point input by the touchscreen and the next fixed point input by the touchscreen.

37. The control method for an ultrasonic imaging device according to claim 25, characterized in that, The sliding operation starting from the first fixed point is obtained by sliding the touch input on the touch screen, or by sliding the cursor while pressing the input confirmation key.

38. A control method for an ultrasonic imaging device according to claim 20, characterized in that, The step of determining the follicle manipulation command based on the positional relationship between the first fixed point and the outline of the identified follicle includes: Determine the positional relationship between the first fixed point and the outline of the identified follicle; Based on the positional relationship between the first fixed point and the outline of the identified follicle, the positional relationship type between the first fixed point and the outline of the identified follicle is determined, and the follicle operation command is determined based on the positional relationship type.

39. An image processing method, characterized in that, The method includes: Acquire and display ultrasound images, wherein the ultrasound images include tissue images of the target tissue and identified tissue structures, wherein the identified tissue structures are obtained by image recognition of the tissue images; Select a first fixed point on the tissue image; The target operation command is determined based on the positional relationship between the first fixed point and the identified tissue structure. Displaying operation prompts for the target operation command and / or executing the target operation command, wherein the target operation command includes at least one of the following: adding an organizational structure command, deleting an organizational structure command, splitting an organizational structure command, merging an organizational structure command, and editing an organizational structure command.

40. An image processing method according to claim 39, characterized in that, The command to add organizational structure is used to perform region recognition on the region indicated by the first fixed point in the organizational image, so as to identify the target organizational structure in the region indicated by the first fixed point, obtain the new organizational structure, and display the new organizational structure. The delete organizational structure command is used to delete the identified organizational structure indicated by the first fixed point; Alternatively, the identified organizational structure indicated by the first fixed-point indication and the identified organizational structure indicated by the next fixed-point indication are merged to obtain a merged organizational structure, which is then displayed. The merge organizational structure command is used to split the identified organizational structure according to the dividing line to obtain a first split organizational structure and a second split organizational structure, and to display the first split organizational structure and the second split organizational structure, wherein the dividing line is a straight line formed by the first fixed point and the next fixed point on the organizational image that crosses the identified organizational structure.

41. An ultrasonic imaging device, characterized in that, include: Ultrasonic probe; A transmitting / receiving circuit is used to control the ultrasound probe to emit ultrasound waves toward the target tissue and receive ultrasound echoes to obtain ultrasound echo signals. A processor, configured to process the ultrasound echo signal, obtain a tissue image of the target tissue, and obtain identified tissue structures by performing image recognition on the tissue image; A display for displaying the tissue image or the identified tissue structure; An input device for selecting a point on the tissue image displayed on the display; The processor is also used to execute the control method of the ultrasonic imaging device according to any one of claims 1 to 38 or the image processing method according to claim 39 or 40.

42. An image processing apparatus, characterized in that, include: A processor for acquiring and processing ultrasound images, wherein the ultrasound images include tissue images of the target tissue and identified tissue structures; A display for displaying the tissue image or the identified tissue structure; An input device for selecting a point on the tissue image displayed on the display; The processor is also used to perform the image processing method as described in claim 39 or 40.

Images