A device and method for realizing ultrasonic imaging control and display

Abstract

The present invention proposes a device and method for realizing ultrasonic imaging control and display, including: an ultrasonic probe is placed on the corresponding part of the body of the person being examined, emitting ultrasonic waves and receiving echo signals; an ultrasonic control and imaging unit calculates and processes the echo signals, converts the echo signals into ultrasonic images, and transmits them to the ultrasonic display screen for display; an eye tracking device collects the user's eye movement information when the user views the ultrasonic image; the eye tracking unit calculates the eye movement information to obtain the user's visual focus, and determines the user's area of ​​interest in the ultrasonic image according to the visual focus; the ultrasonic control and imaging unit is used to determine the first adjustment parameter according to the user's area of ​​interest, generate the first target ultrasonic image, and transmit it to the ultrasonic display screen for display. It is convenient to realize the control and display of the corresponding ultrasonic image based on the user's eye movement information, provide effective assistance for medical diagnosis, and help improve the efficiency and accuracy of diagnosis.

Description

Technical Field

[0001] The present invention relates to the field of display control technology, and in particular to a device and method for realizing ultrasonic imaging control and display. Background Art

[0002] At present, the scanning process of ultrasound doctors is as follows: 1. Prepare equipment: The ultrasound doctor needs to prepare the ultrasound equipment first, including connecting the probe, turning on the equipment, adjusting the image parameters, etc. 2. Prepare the patient: The ultrasound doctor needs to ask and examine the patient, confirm the patient's medical history, chief complaint, symptoms and other information, and let the patient take the corresponding position (such as supine position, lateral position, etc.). 3. Apply gel: The ultrasound doctor will apply a layer of gel on the probe to form a close contact between the probe and the patient's skin, so as to better transmit ultrasound. 4. Scan the image: The ultrasound doctor will place the probe on the corresponding part of the patient's body, and gradually scan the patient's internal organs, tissues, blood vessels and other parts by controlling the operation buttons of the ultrasound equipment, while observing and recording the scanned images and data. 5. Explain the diagnosis: Based on the scan results, the ultrasound doctor will explain and diagnose the patient's condition, and give treatment suggestions and plans as needed. 6. Organize the information: The ultrasound doctor needs to organize the scan results and diagnosis records, and save them in the patient's medical records for subsequent reference and tracking. Among them, in step 5, the ultrasound doctor diagnoses the patient through the image, and the steps are as follows: 1. Observe the image features: The ultrasound doctor needs to observe the scanned image features, such as the size, shape, structure, texture, etc. of the organ, and whether there are abnormal signals, echoes, flow signals, etc. 2. Compare with normal images: The ultrasound doctor needs to compare with the normal image to determine whether there are abnormal changes in the organ or tissue, such as whether there are nodules, lumps, fluid accumulation, etc. 3. Analyze image data: The ultrasound doctor needs to analyze the scanned image data, such as measuring the size, shape, position, etc. of the organ or tissue, and analyzing data such as blood flow velocity and degree of vascular lesions. 4. Comprehensive judgment: The ultrasound doctor needs to make a comprehensive judgment on the observed image features, comparison results and data analysis results to draw the final diagnosis conclusion and treatment recommendations. It should be noted that the diagnosis and judgment of the ultrasound doctor mainly rely on his experience and professional knowledge, so he needs to have a high medical background and professional skills, and at the same time, he needs to keep learning and updating his knowledge.

[0003] In the prior art, ultrasound doctors need to mark the area of ​​interest and the corresponding parameters when making a diagnosis through images, which is extremely troublesome and inconvenient to operate. Eye tracking technology is proposed to automatically perceive the area of ​​interest of ultrasound doctors. Eye tracking technology is a technology that tracks eye movements to reflect the human visual cognitive process. It can analyze the gaze position and gaze time of people when watching images, texts, videos and other media, as well as the process of attention allocation by recording the eye movement trajectory, so as to understand the human visual cognitive process. Eye tracking technology is used in medical diagnosis to diagnose and treat diseases such as eye movement disorders and cognitive disorders by recording the eye movement trajectory of patients in visual tasks. There are two main ways to implement eye tracking technology: contact and non-contact. Contact eye tracking requires the use of special equipment, such as an eye tracker, to record the eye movement trajectory through a contact probe; while non-contact eye tracking can directly use computers or cameras and other equipment to record the eye movement trajectory by detecting features such as eye position and pupil size. With the continuous development of eye tracking technology, it has become a widely used research field, bringing more convenience and benefits to people's lives and work.

[0004] Patent CN 112578903 A describes a detailed implementation description of an eye tracking technology, which calculates whether the observer is scanning and the position of the eye's gaze point by observing and tracking the movement of the subject's pupil position.

[0005] Patent CN114817021A uses eye tracking technology to evaluate the human-computer interaction interface. Combined with the time of capturing user behavior, after the experiment, heat maps and trajectory maps can be generated based on eye movement data, and statistics can be obtained on the first fixation time, dwell time, first fixation duration and other data of the element. It can support access to the HMI system for evaluation without additional development of the HMI end, reducing additional development workload and facilitating rapid testing and iteration of HMI prototypes.

[0006] Patent CN115116303A uses eye tracking technology to track the gaze position of children with dyslexia, attract the gaze of reading children to assist reading, and train children's reading concentration ability.

[0007] The above-mentioned existing technologies are unable to automatically obtain the region of interest through the user's eye movement information, and perform corresponding image optimization, marking, analysis and recording to provide effective assistance for medical diagnosis, which is not conducive to improving diagnostic efficiency and accuracy. Summary of the invention

[0008] The present invention aims to solve at least one of the technical problems in the above-mentioned technologies to a certain extent. To this end, the first purpose of the present invention is to propose a device for realizing ultrasound imaging control and display, which can obtain the user's focus and line of sight movement on the ultrasound display screen in real time during the user's diagnosis and scanning process. Through the user's eye movement information, the region of interest is automatically obtained, and the corresponding image optimization, marking, analysis and recording are performed, so as to facilitate the control and display of the corresponding ultrasound image based on the user's eye movement information, provide effective assistance for medical diagnosis, and help improve the efficiency and accuracy of diagnosis.

[0009] The second object of the present invention is to provide a method for realizing ultrasound imaging control and display.

[0010] To achieve the above-mentioned object, a first embodiment of the present invention provides a device for realizing ultrasonic imaging control and display, comprising:

[0011] An ultrasonic probe is used to be placed at a corresponding part of the body of the person being examined, emit ultrasonic waves and receive echo signals, and transmit the echo signals to an ultrasonic control and imaging unit;

[0012] An ultrasound control and imaging unit, used to calculate and process the echo signal, convert the echo signal into an ultrasound image, and transmit it to an ultrasound display screen for display;

[0013] An eye tracking device, used to collect eye movement information of the user when the user views the ultrasound image;

[0014] An eye tracking unit, used to calculate the eye movement information to obtain the user's visual focus, determine the user's area of ​​interest in the ultrasound image according to the visual focus, and send the area to the ultrasound control and imaging unit;

[0015] The ultrasound control and imaging unit is used to determine the first adjustment parameter according to the user's area of ​​interest, generate a first target ultrasound image, and transmit it to the ultrasound display screen for display.

[0016] According to some embodiments of the present invention, the further comprising:

[0017] The device input unit is used to receive the user's input instruction, modify the region of interest according to the input instruction, obtain the modified region of interest, and send it to the ultrasound control and imaging unit;

[0018] The ultrasound control and imaging unit is used to determine the second adjustment parameter according to the modified region of interest, generate a second target ultrasound image, and transmit it to the ultrasound display screen for display.

[0019] According to some embodiments of the present invention, when displaying an ultrasound image, the ultrasound display screen includes an ultrasound image area, a parameter area, and an information area.

[0020] According to some embodiments of the present invention, the eye tracking unit comprises:

[0021] An acquisition module, used to acquire the position P(t) of the user's visual focus in the ultrasound display screen coordinate system according to the eye movement information;

[0022] A conversion module, used for converting the position P(t) in the ultrasound display screen coordinate system into a region of interest ROI(t);

[0023] The calculation module is used to calculate the position ROI of the region of interest in the ultrasound probe coordinate system according to the coordinate correspondence between the ultrasound image displayed on the ultrasound display screen and the position P(t) of the visual focus in the ultrasound display screen coordinate system. ， (t);

[0024] Identify modules for:

[0025] The position of the region of interest (ROI) in the ultrasound probe coordinate system ， (t) Perform image optimization, multi-mode display, parameter measurement and calculation, and determine the position of the processed region of interest (ROI) in the ultrasound probe coordinate system ， (t);

[0026] According to the region of interest ROI (t) in the ultrasound display screen coordinate system and the processed position ROI in the ultrasound probe coordinate system ， (t), determine the user's region of interest in the ultrasound image.

[0027] According to some embodiments of the present invention, when the ultrasound display screen displays the region of interest of the user, the steps include: determining the image, parameters and information of the region of interest and displaying them on the ultrasound display screen.

[0028] According to some embodiments of the present invention, the eye tracking unit further comprises:

[0029] A judgment module, used for counting the time-varying parameters of the position P(t) of the user's visual focus in the ultrasound display screen coordinate system before the conversion module converts the position P(t) in the ultrasound display screen coordinate system into the region of interest ROI(t);

[0030] The change parameter is compared with a preset threshold. When it is determined that the change parameter is less than the preset threshold, it means that the user's sight focus position is not large during the time period dt. Then it is considered that at time t, the user's area of ​​interest is The preset area of ​​​​ is the mean coordinate of P(t) in the time period dt.

[0031] According to some embodiments of the present invention, the variation parameter may be described by the covariance coefficient of the P(t) position sequence within the time period dt;

[0032]

[0033] Where DP(t) is the covariance coefficient of the P(t) position sequence.

[0034] According to some embodiments of the present invention, the conversion module comprises:

[0035] The first conversion submodule is used for:

[0036] According to the position P(t) in the coordinate system of the ultrasound display screen, the center point CP(t) is determined as the origin of the Gaussian distribution, and the variance σ(t) determines the range information, and then determines the region of interest ROI(t) described by the Gaussian model;

[0037] or

[0038] The second conversion submodule is used for:

[0039] Determine the mean of the sampling position sequence P(t1), P(t2), P(t3)… within the time period dt As the center point CP(t);

[0040] Estimate the extent of the region of interest based on the distribution range of the sampling position sequence;

[0041] According to the center point CP(t) and the range, the region of interest ROI(t) is determined.

[0042] To achieve the above object, a second embodiment of the present invention provides a method for realizing ultrasound imaging control and display, comprising:

[0043] Based on the ultrasound probe placed at the corresponding part of the body of the person being examined, ultrasound waves are emitted and echo signals are received, and the echo signals are transmitted to the ultrasound control and imaging unit;

[0044] The echo signal is calculated and processed based on the ultrasound control and imaging unit, the echo signal is converted into an ultrasound image, and transmitted to an ultrasound display screen for display;

[0045] Based on the eye tracking device, when the user views the ultrasound image, the user's eye movement information is collected;

[0046] The eye tracking unit calculates the eye movement information to obtain the user's visual focus, determines the user's area of ​​interest in the ultrasound image according to the visual focus, and sends the area to the ultrasound control and imaging unit;

[0047] The ultrasound control and imaging unit determines a first adjustment parameter according to the user's region of interest, generates a first target ultrasound image, and transmits the first target ultrasound image to the ultrasound display screen for display.

[0048] According to some embodiments of the present invention, the eye tracking unit calculates the eye movement information to obtain the visual focus of the user, and determines the user's area of ​​interest in the ultrasound image according to the visual focus, including:

[0049] According to the eye movement information, the position P(t) of the user's visual focus in the ultrasound display screen coordinate system is obtained;

[0050] Convert the position P(t) in the ultrasound display screen coordinate system into the region of interest ROI(t);

[0051] According to the coordinate correspondence between the ultrasound image displayed on the ultrasound display screen and the position P(t) of the visual focus in the ultrasound display screen coordinate system, the position ROI of the region of interest in the ultrasound probe coordinate system is calculated. ， (t);

[0052] The position of the region of interest (ROI) in the ultrasound probe coordinate system ， (t) Perform image optimization, multi-mode display, parameter measurement and calculation, and determine the position of the processed region of interest (ROI) in the ultrasound probe coordinate system ， (t);

[0053] According to the region of interest ROI (t) in the ultrasound display screen coordinate system and the processed position ROI in the ultrasound probe coordinate system ， (t), determine the user's region of interest in the ultrasound image.

[0054] Beneficial effects:

[0055] (1) The present invention uses an eye tracking device to automatically obtain the user's focus point on the ultrasound display screen as the region of interest during the ultrasound doctor's scanning process. Compared with the current manual marking method, it can greatly save the doctor's physical strength and time and improve scanning efficiency.

[0056] (2) Based on the automatic annotation of the region of interest, the image of the region of interest can be automatically optimized, such as focus position, sound speed, high-definition magnification, etc., to simplify the doctor's operation process, so that more energy can be spent on patient communication and diagnosis.

[0057] The automatic image optimization strategy for the region of interest can be executed according to a pre-configured strategy, or it can be combined with statistical methods to perform individualized identification of doctors' operating habits and configure different strategies for different users.

[0058] (3) Combined with other user input methods such as voice input, automatic ROI annotation can improve user efficiency in more aspects.

[0059] (4) During ultrasound examination, the correspondence between the user's visual focus and the image is very important diagnostic information and can be used for demonstration, teaching and communication purposes.

[0060] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description and the accompanying drawings.

[0061] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0063] Figure 1 is a schematic diagram of a device for realizing ultrasound imaging control and display according to an embodiment of the present invention;

[0064] Figure 2 is a flow chart of determining a region of interest of a user in an ultrasound image according to one embodiment of the present invention;

[0065] Figure 3 is a display schematic diagram of an ultrasound display screen according to an embodiment of the present invention;

[0066] Figure 4 The present invention is a flowchart of a method for realizing ultrasound imaging control and display according to an embodiment of the present invention.

[0067] Reference numerals:

[0068] Ultrasound display screen 101, ultrasound image area 201, information area 202, parameter area 203, region of interest 208, ultrasound control and imaging unit 102, device input unit 103, ultrasound probe 104, eye tracking unit 108, eye tracking device 110, user 120, and examinee 121. DETAILED DESCRIPTION

[0069] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0070] like Figure 1As shown, the first embodiment of the present invention provides a device for realizing ultrasonic imaging control and display, comprising:

[0071] The ultrasonic probe 104 is used to be placed at a corresponding part of the body of the examinee 121, transmit ultrasonic waves and receive echo signals, and transmit the echo signals to the ultrasonic control and imaging unit 102;

[0072] The ultrasound control and imaging unit 102 is used to calculate and process the echo signal, convert the echo signal into an ultrasound image, and transmit it to the ultrasound display screen 101 for display;

[0073] The eye tracking device 110 is used to collect the user's eye movement information when the user 120 views the ultrasound image;

[0074] The eye tracking unit 108 is used to calculate the eye movement information to obtain the user's visual focus, determine the user's region of interest 208 in the ultrasound image according to the visual focus, and send it to the ultrasound control and imaging unit 102;

[0075] The ultrasound control and imaging unit 102 is used to determine a first adjustment parameter according to the user's region of interest 208, generate a first target ultrasound image, and transmit the first target ultrasound image to the ultrasound display screen 101 for display.

[0076] The working principle of the above technical solution: In this embodiment, the corresponding parts include internal organs, tissues, blood vessels and other parts.

[0077] In this embodiment, the eye tracking device 110 is at least one of an eye tracker, a computer or a camera. The eye tracker records the eye movement trajectory through a contact probe; the computer or camera and other equipment record the eye movement trajectory by detecting features such as eye position and pupil size.

[0078] In this embodiment, the region of interest 208 is a region that the user pays more attention to and focuses on. The user is usually an ultrasound doctor or an examination technician.

[0079] In this embodiment, the first adjustment parameter includes a display parameter, a definition, etc. of expanding the region of interest 208. The first target ultrasound image is an ultrasound image after displaying the corresponding region of interest 208 after adjustment.

[0080] Specifically, the user (usually an ultrasound doctor or examination technician) operates the ultrasound probe 104 to scan and diagnose the subject 121. The ultrasound probe 104 transmits ultrasound to the subject 121, receives echo signals, transmits them to the ultrasound control and imaging unit 102 for calculation and processing, converts the echo signals into images, and displays them on the ultrasound display screen 101.

[0081] The user's eye movement information is collected through the eye tracking device 110, and the eye tracking unit 108 calculates to obtain the user's visual focus point, calculates to obtain the user's area of ​​interest 208, and the ultrasonic control and imaging unit 102 performs feedback control on the ultrasonic system, and the final image or other information is displayed on the ultrasonic display screen 101.

[0082] When doctors diagnose patients through ultrasound images, a very important interactive process is marking the region of interest 208. The main uses of marking the region of interest 208 are: (1) Conducting a comprehensive and in-depth observation of the image of the region of interest 208 to better diagnose the disease. For example, manually delineating the region of interest 208 through input devices such as a mouse or trackball, further optimizing or enlarging the image in the region; or observing other tissue features in the region of interest 208, such as observing the blood flow and tissue hardness information in the region of interest 208. (2) Marking and analyzing the image of the region of interest 208. For example, outlining the scope of the region of interest 208, marking a text description of the region of interest 208 as key information of the case; or measuring certain parameters in the region of interest 208. (3) Recording the location and change information of the region of interest 208 that the ultrasound doctor pays attention to during the scanning and diagnosis process for demonstration and teaching purposes.

[0083] Beneficial effects of the above technical solution: The present invention proposes a device for realizing ultrasound imaging control and display, which can obtain the user's focus point and line of sight movement process on the ultrasound display screen 101 in real time during the user's diagnosis and scanning process. Through the user's eye movement information, the region of interest 208 is automatically obtained, and the corresponding image optimization, marking, analysis and recording are performed, so as to facilitate the control and display of the corresponding ultrasound image based on the user's eye movement information, provide effective assistance for medical diagnosis, and help improve the efficiency and accuracy of diagnosis. (1) The present invention uses an eye tracking device to automatically obtain the user's line of sight on the ultrasound display screen 101 as the region of interest 208 during the ultrasound doctor's scanning process. Compared with the current manual marking method, it can greatly save the doctor's physical strength and time and improve the scanning efficiency. (2) Based on the automatic marking of the region of interest 208, the image of the region of interest 208 can be automatically optimized, such as the focus position, sound speed, high-definition magnification, etc., to simplify the doctor's operation process, so that more energy can be used for patient communication and diagnosis. The automatic image optimization strategy of the region of interest 208 can be executed according to a pre-configured strategy, or it can be combined with statistical methods to perform individualized recognition of the doctor's operating habits and configure different strategies for different users. (3) Combined with other user input methods such as voice input, the automatic region of interest 208 annotation can improve the user's usage efficiency in more aspects. (4) During the ultrasound examination, the correspondence between the user's visual focus and the image is very important diagnostic information, which can be used for demonstration, teaching and communication purposes.

[0084] According to some embodiments of the present invention, the further comprising:

[0085] The device input unit 103 is used to receive an input instruction from a user, modify the region of interest 208 according to the input instruction, obtain the modified region of interest 208, and send it to the ultrasound control and imaging unit 102;

[0086] The ultrasound control and imaging unit 102 is used to determine the second adjustment parameter according to the modified region of interest 208, generate a second target ultrasound image, and transmit the second target ultrasound image to the ultrasound display screen 101 for display.

[0087] Working principle of the above technical solution: In this embodiment, the modified region of interest 208 is the region of interest 208 obtained by modifying the region of interest 208 based on the user's input instruction.

[0088] In this embodiment, the second adjustment parameter includes display parameters, clarity, etc. of the enlarged modified region of interest 208. The second target ultrasound image is an ultrasound image after displaying the corresponding modified region of interest 208.

[0089] The beneficial effects of the above technical solution are as follows: the region of interest 208 determined based on the input instruction according to the eye movement information is corrected, realizing a combination of machine recognition and manual input, which facilitates determining a more accurate corrected region of interest 208 and then displaying it, thereby improving the accuracy of diagnosis.

[0090] like Figure 3 As shown, according to some embodiments of the present invention, when the ultrasound display screen 101 displays an ultrasound image, it includes an ultrasound image area 201 , a parameter area 203 and an information area 202 .

[0091] The working principle of the above technical solution: In this embodiment, information Area represents the information area 202; ultrasound image Area represents the ultrasound image area 201; parameter Area represents the parameter area 203. The region of interest ROI is located in the ultrasound image area 201.

[0092] The beneficial effects of the above technical solution are as follows: when the ultrasound display screen 101 displays an ultrasound image, different information is displayed in different areas, thereby improving the accuracy of image display and facilitating user viewing.

[0093] like Figure 2 As shown, according to some embodiments of the present invention, the eye tracking unit 108 includes:

[0094] An acquisition module, used to acquire the position P(t) of the user's visual focus in the coordinate system of the ultrasound display screen 101 according to the eye movement information;

[0095] A conversion module, used to convert the position P(t) in the coordinate system of the ultrasound display screen 101 into a region of interest ROI(t);

[0096] A calculation module is used to calculate the position ROI of the region of interest 208 in the coordinate system of the ultrasound probe 104 according to the coordinate correspondence between the ultrasound image displayed on the ultrasound display screen 101 and the position P(t) of the visual focus in the coordinate system of the ultrasound display screen 101. ， (t);

[0097] Identify modules for:

[0098] The position ROI of the region of interest 208 in the coordinate system of the ultrasound probe 104 ， (t) Perform image optimization, multi-mode display, parameter measurement and calculation to determine the position ROI of the processed region of interest 208 in the coordinate system of the ultrasound probe 104 ， (t);

[0099] According to the region of interest ROI (t) in the coordinate system of the ultrasound display screen 101 and the processed position ROI in the coordinate system of the ultrasound probe 104 ， (t), determine the user's region of interest 208 in the ultrasound image.

[0100] Working principle of the above technical solution: In this embodiment, a feature of the region of interest ROI(t) is the area where the user's visual focus stays and pays attention to, which is determined by the line of sight focus P(t) in the screen coordinate system of the eye tracker.

[0101] The beneficial effect of the above technical solution is: according to the region of interest ROI (t) in the coordinate system of the ultrasound display screen 101 and the processed position ROI (t) in the coordinate system of the ultrasound probe 104, the region of interest 208 of the user in the ultrasound image is determined. Determining the region of interest 208 in different coordinate systems facilitates viewing and adjustment, thereby improving the diagnosis rate.

[0102] According to some embodiments of the present invention, when the ultrasound display screen 101 displays the region of interest 208 of the user, the following steps are performed: determining the image, parameters and information of the region of interest 208 and displaying them on the ultrasound display screen 101 .

[0103] The beneficial effect of the above technical solution is that it is convenient for users to view and thus facilitates diagnosis.

[0104] According to some embodiments of the present invention, the eye tracking unit 108 further includes:

[0105] A judgment module, used for counting the time-varying parameters of the position P(t) of the user's visual focus in the coordinate system of the ultrasound display screen 101 before the conversion module converts the position P(t) in the coordinate system of the ultrasound display screen 101 into the region of interest ROI(t);

[0106] The change parameter is compared with a preset threshold. When it is determined that the change parameter is less than the preset threshold, it means that the user's sight focus position is not large during the time period dt. Then, it is considered that at time t, the user's area of ​​interest 208 is The preset area of ​​​​ is the mean coordinate of P(t) in the time period dt.

[0107] According to some embodiments of the present invention, the variation parameter may be described by the covariance coefficient of the P(t) position sequence within the time period dt;

[0108]

[0109] Where DP(t) is the covariance coefficient of the P(t) position sequence.

[0110] The working principle of the above technical solution: the judgment module is used to count the time-varying parameters of the position P(t) of the user's visual focus in the coordinate system of the ultrasound display screen 101 before the conversion module converts the position P(t) in the coordinate system of the ultrasound display screen 101 into the region of interest 208ROI(t); set the time window dt, calculate the change of P(t) with time in the time period from t to t+dt, that is, the change parameter, which can be described by the covariance coefficient DP(t) of the position sequence of P(t) in the time period dt. Compare the change parameter with the preset threshold. When it is determined that the change parameter is less than the preset threshold, it means that the user's line of sight focus position is not large in the time period dt, then it is considered that at time t, the user's line of sight is at The user stays nearby, thereby determining the user's area of ​​interest 208. The preset area is A circular area with a center of φ and a preset distance as a radius, which is not specifically limited here.

[0111] The beneficial effect of the above technical solution is that it is convenient to accurately determine the user's area of ​​interest 208 at a certain time.

[0112] According to some embodiments of the present invention, the conversion module comprises:

[0113] The first conversion submodule is used for:

[0114] According to the position P(t) in the coordinate system of the ultrasound display screen 101, the center point CP(t) is determined as the origin of the Gaussian distribution, and the variance σ(t) determines the range information, thereby determining the region of interest ROI(t) described by the Gaussian model;

[0115] or

[0116] The second conversion submodule is used for:

[0117] Determine the mean of the sampling position sequence P(t1), P(t2), P(t3)… within the time period dt As the center point CP(t);

[0118] estimating the range of the region of interest 208 based on the distribution range of the sampling position sequence;

[0119] According to the center point CP(t) and the range, the region of interest ROI(t) is determined.

[0120] The working principle of the above technical solution: According to the characteristics of human visual area, the region of interest 208 that the user is looking at should be an area that is centered on the visual focus and spreads to the surrounding area. The resolution of the central area of ​​the region of interest ROI(t) is the highest, and the resolution of the peripheral area gradually decreases. The position of the ROI(t) area can be described by a Gaussian model, the center point CP(t) is the origin of the Gaussian distribution, and the variance σ(t) determines the range of the ROI. It can also be represented by a set of screen coordinates {P1, P2, P3, ...}. The P(t) sequence within a certain time period can be used to calculate the center point CP(t) and range of the ROI(t), and the mean ˉP(t) of the sampling position sequence P(t1), P(t2), P(t3)... within the dt time period can be used as a way to implement the center point CP(t). The distribution range of the sampling position sequence can be used to estimate the range of the region of interest 208.

[0121] Beneficial effects of the above technical solution: The region of interest 208 ROI(t) is accurately determined based on the above two methods.

[0122] like Figure 4 As shown, the second embodiment of the present invention proposes a method for realizing ultrasound imaging control and display, including steps S1-S5:

[0123] S1, based on the ultrasound probe 104 placed on the corresponding part of the body of the examinee 121, emitting ultrasound waves and receiving echo signals, and transmitting the echo signals to the ultrasound control and imaging unit 102;

[0124] S2, calculating and processing the echo signal based on the ultrasound control and imaging unit 102, converting the echo signal into an ultrasound image, and transmitting the image to the ultrasound display screen 101 for display;

[0125] S3, collecting eye movement information of the user when the user views the ultrasound image based on the eye tracking device 110;

[0126] S4, the eye tracking unit 108 calculates the eye movement information to obtain the user's visual focus, determines the user's region of interest 208 in the ultrasound image according to the visual focus, and sends it to the ultrasound control and imaging unit 102;

[0127] S5. The ultrasound control and imaging unit 102 determines a first adjustment parameter according to the user's region of interest 208, generates a first target ultrasound image, and transmits the first target ultrasound image to the ultrasound display screen 101 for display.

[0128] Beneficial effects of the above technical solution: The present invention proposes a method for realizing ultrasound imaging control and display, which can obtain the user's focus point and line of sight movement process on the ultrasound display screen 101 in real time during the user's diagnosis and scanning process. The region of interest 208 is automatically obtained through the user's eye movement information, and the corresponding image optimization, marking, analysis and recording are performed, so as to facilitate the control and display of the corresponding ultrasound image based on the user's eye movement information, provide effective assistance for medical diagnosis, and help improve the efficiency and accuracy of diagnosis. (1) The present invention uses an eye tracking device to automatically obtain the user's line of sight on the ultrasound display screen 101 as the region of interest 208 during the ultrasound doctor's scanning process. Compared with the current manual marking method, it can greatly save the doctor's physical strength and time and improve the scanning efficiency. (2) Based on the automatic marking of the region of interest 208, the image of the region of interest 208 can be automatically optimized, such as the focus position, sound speed, high-definition magnification, etc., to simplify the doctor's operation process, so that more energy can be used for patient communication and diagnosis. The automatic image optimization strategy of the region of interest 208 can be executed according to a pre-configured strategy, or it can be combined with statistical methods to perform individualized recognition of the doctor's operating habits and configure different strategies for different users. (3) Combined with other user input methods such as voice input, the automatic region of interest 208 annotation can improve the user's usage efficiency in more aspects. (4) During the ultrasound examination, the correspondence between the user's visual focus and the image is very important diagnostic information, which can be used for demonstration, teaching and communication purposes.

[0129] According to some embodiments of the present invention, the eye tracking unit 108 calculates the eye movement information to obtain the visual focus of the user, and determines the user's region of interest 208 in the ultrasound image according to the visual focus, including:

[0130] According to the eye movement information, the position P(t) of the user's visual focus in the coordinate system of the ultrasound display screen 101 is obtained;

[0131] Convert the position P(t) in the coordinate system of the ultrasound display screen 101 into a region of interest ROI(t);

[0132] According to the coordinate correspondence between the ultrasound image displayed on the ultrasound display screen 101 and the position P(t) of the visual focus in the coordinate system of the ultrasound display screen 101, the position ROI of the region of interest 208 in the coordinate system of the ultrasound probe 104 is calculated. ， (t);

[0133] The position ROI of the region of interest 208 in the coordinate system of the ultrasound probe 104 ， (t) Perform image optimization, multi-mode display, parameter measurement and calculation to determine the position ROI of the processed region of interest 208 in the coordinate system of the ultrasound probe 104， (t);

[0134] According to the region of interest ROI (t) in the coordinate system of the ultrasound display screen 101 and the processed position ROI in the coordinate system of the ultrasound probe 104 ， (t), determine the user's region of interest 208 in the ultrasound image.

[0135] The beneficial effect of the above technical solution is: according to the region of interest ROI (t) in the coordinate system of the ultrasound display screen 101 and the processed position ROI (t) in the coordinate system of the ultrasound probe 104, the region of interest 208 of the user in the ultrasound image is determined. Determining the region of interest 208 in different coordinate systems facilitates viewing and adjustment, thereby improving the diagnosis rate.

[0136] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A device for realizing ultrasonic imaging control and display, characterized in that: include: An ultrasonic probe is used to be placed at a corresponding part of the body of the person being examined, emit ultrasonic waves and receive echo signals, and transmit the echo signals to an ultrasonic control and imaging unit; An ultrasound control and imaging unit, used to calculate and process the echo signal, convert the echo signal into an ultrasound image, and transmit it to an ultrasound display screen for display; An eye tracking device, used to collect eye movement information of the user when the user views the ultrasound image; An eye tracking unit, used to calculate the eye movement information to obtain the user's visual focus, determine the user's area of ​​interest in the ultrasound image according to the visual focus, and send the area to the ultrasound control and imaging unit; An ultrasound control and imaging unit, used to determine a first adjustment parameter according to a region of interest of a user, generate a first target ultrasound image, and transmit the image to an ultrasound display screen for display; When the ultrasound display screen displays the region of interest of the user, the steps include: determining the image, parameters and information of the region of interest and displaying them on the ultrasound display screen; Mark the region of interest, further optimize or magnify the image in the region of interest; observe tissue characteristics in the region of interest; mark and analyze the image of the region of interest, outline the scope of the region of interest, mark the region of interest with text descriptions as key information of the case; or measure the parameters in the region of interest; record the location and change information of the region of interest that the ultrasound doctor pays attention to during the scanning and diagnosis process; The eye tracking unit further comprises: A judgment module, used for counting the time-varying parameters of the position P(t) of the user's visual focus in the ultrasound display screen coordinate system before the conversion module converts the position P(t) in the ultrasound display screen coordinate system into the region of interest ROI(t); The change parameter is compared with a preset threshold. When it is determined that the change parameter is less than the preset threshold, it means that the user's sight focus position is not large during the time period dt. Then it is considered that at time t, the user's area of ​​interest is The preset area of ​​​​ is the mean coordinate of P(t) in the time period dt; The variation parameter is described by the covariance coefficient of the P(t) position sequence within the time period dt; Where DP(t) is the covariance coefficient of the P(t) position sequence; The eye tracking unit comprises: An acquisition module, used to acquire the position P(t) of the user's visual focus in the ultrasound display screen coordinate system according to the eye movement information; A conversion module, used for converting the position P(t) in the ultrasound display screen coordinate system into a region of interest ROI(t); A calculation module is used to calculate the position of the region of interest in the ultrasound probe coordinate system according to the coordinate correspondence between the ultrasound image displayed on the ultrasound display screen and the position P(t) of the visual focus in the ultrasound display screen coordinate system. ; Identify modules for: The position of the region of interest in the ultrasound probe coordinate system Perform image optimization, multi-mode display, parameter measurement and calculation to determine the position of the processed region of interest in the ultrasound probe coordinate system ; According to the region of interest ROI (t) in the ultrasound display screen coordinate system and the processed position in the ultrasound probe coordinate system , determining a region of interest of a user in an ultrasound image; The conversion module comprises: The first conversion submodule is used for: According to the position P(t) in the coordinate system of the ultrasound display screen, the center point CP(t) is determined as the origin of the Gaussian distribution, and the variance σ(t) determines the range information, and then the region of interest ROI(t) described by the Gaussian model is determined; or The second conversion submodule is used for: Determine the mean of the sampling position sequence P(t1), P(t2), P(t3)… within the time period dt As the center point CP(t); Estimate the extent of the region of interest based on the distribution range of the sampling position sequence; According to the center point CP(t) and range, the region of interest ROI(t) is determined.

2. The device for realizing ultrasonic imaging control and display according to claim 1, characterized in that: Also includes: The device input unit is used to receive the user's input instruction, modify the region of interest according to the input instruction, obtain the modified region of interest, and send it to the ultrasound control and imaging unit; The ultrasound control and imaging unit is used to determine the second adjustment parameter according to the modified region of interest, generate a second target ultrasound image, and transmit it to the ultrasound display screen for display.

3. The device for realizing ultrasonic imaging control and display according to claim 1, characterized in that: When displaying an ultrasound image, the ultrasound display screen includes an ultrasound image area, a parameter area and an information area.

4. The method for controlling and displaying an apparatus for controlling and displaying ultrasonic imaging according to any one of claims 1 to 3, characterized in that: include: Based on the ultrasound probe placed at the corresponding part of the body of the person being examined, ultrasound waves are emitted and echo signals are received, and the echo signals are transmitted to the ultrasound control and imaging unit; The echo signal is calculated and processed based on the ultrasound control and imaging unit, the echo signal is converted into an ultrasound image, and transmitted to an ultrasound display screen for display; Based on the eye tracking device, when the user views the ultrasound image, the user's eye movement information is collected; The eye tracking unit calculates the eye movement information to obtain the user's visual focus, determines the user's area of ​​interest in the ultrasound image according to the visual focus, and sends the area to the ultrasound control and imaging unit; The ultrasound control and imaging unit determines a first adjustment parameter according to the user's region of interest, generates a first target ultrasound image, and transmits the image to the ultrasound display screen for display; When the ultrasound display screen displays the region of interest of the user, the steps include: determining the image, parameters and information of the region of interest and displaying them on the ultrasound display screen; Mark the region of interest, further optimize or magnify the image in the region of interest; observe tissue characteristics in the region of interest; mark and analyze the image of the region of interest, outline the scope of the region of interest, mark the region of interest with text descriptions as key information of the case; or measure the parameters in the region of interest; record the location and change information of the region of interest that the ultrasound doctor pays attention to during the scanning and diagnosis process; The eye tracking unit further comprises: A judgment module, used for counting the time-varying parameters of the position P(t) of the user's visual focus in the ultrasound display screen coordinate system before the conversion module converts the position P(t) in the ultrasound display screen coordinate system into the region of interest ROI(t); The change parameter is compared with a preset threshold. When it is determined that the change parameter is less than the preset threshold, it means that the user's sight focus position is not large during the time period dt. Then it is considered that at time t, the user's area of ​​interest is The preset area of ​​​​ is the mean coordinate of P(t) in the time period dt; The variation parameter is described by the covariance coefficient of the P(t) position sequence within the time period dt; Where DP(t) is the covariance coefficient of the P(t) position sequence; The eye tracking unit calculates the eye movement information to obtain the user's visual focus, and determines the user's area of ​​interest in the ultrasound image according to the visual focus, including: According to the eye movement information, the position P(t) of the user's visual focus in the ultrasound display screen coordinate system is obtained; Convert the position P(t) in the ultrasound display screen coordinate system into the region of interest ROI(t); According to the coordinate correspondence between the ultrasound image displayed on the ultrasound display screen and the position P(t) of the visual focus in the ultrasound display screen coordinate system, the position of the region of interest in the ultrasound probe coordinate system is calculated. ; The position of the region of interest in the ultrasound probe coordinate system Perform image optimization, multi-mode display, parameter measurement and calculation to determine the position of the processed region of interest in the ultrasound probe coordinate system ; According to the region of interest ROI (t) in the ultrasound display screen coordinate system and the processed position in the ultrasound probe coordinate system , determine the user's region of interest in the ultrasound image.

Images