Image display method, image processing method, auxiliary system, and storage medium
By generating and displaying fetal model images and ultrasound parameters in the ultrasound device, the problem of only being able to output single-scan data in the existing technology is solved, and the effect of facilitating historical data review and accurate evaluation during delivery monitoring is achieved, thereby improving the usability of the device.
Patent Information
- Application Number
- CN202410344648.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-03-25
- Publication Date
- 2025-09-26
AI Technical Summary
Existing ultrasound equipment can only output data from a single scan during intrapartum monitoring. Medical staff have to laboriously search through historical data, which increases their workload and may delay diagnosis and treatment in emergency situations, increasing risks to the mother and fetus.
Provided is an image display method and processing method for intrapartum monitoring. An ultrasound device is used to generate a fetal model image and display ultrasound parameters and fetal model images at different time points on a display interface. The method supports triggering commands to review fetal model images at historical time points and accurately evaluate them in combination with current data.
It enables intuitive reflection of the fetal condition in the womb at different time points during intrapartum monitoring, making it easier for users to use historical data for accurate prediction and evaluation, thereby improving the availability of ultrasound equipment and the accuracy of intrapartum monitoring.
Smart Images

Figure CN120694682A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of medical equipment, and in particular to an image display method for intrapartum monitoring, an image processing method for intrapartum monitoring, and an auxiliary system and storage medium applied to ultrasound equipment. Background Art
[0002] With the advancement of medical testing technology, more and more instruments and equipment are being used in the medical industry. For example, the use of ultrasonic equipment to detect the internal structure of the human body can more accurately detect the patient's internal conditions from the outside, and the risks and pain are relatively small, which helps medical personnel understand the patient's physical condition.
[0003] Continuous observation of the mother and fetus is typically performed, combining data from multiple ultrasound examinations to monitor the entire delivery process and ensure the safety of both mother and fetus. However, most ultrasound devices only allow medical staff to view data from the current scan after a single scan. This significantly increases their workload, delays diagnosis and treatment, and may even increase risks for both mother and fetus. Summary of the Invention
[0004] To solve the above problems, the main purpose of this application is to provide an image display method for intrapartum monitoring, an image processing method for intrapartum monitoring, an auxiliary system and storage medium applied to ultrasound equipment, which can facilitate operators to understand medical test data and improve the usability of ultrasound equipment.
[0005] The present application provides an image display method for intrapartum monitoring, comprising receiving a trigger instruction for a time point of a statistical graph in a display interface, the statistical graph being used to display a number of ultrasound parameters corresponding to a number of time points, the display interface also displaying a fetal model image corresponding to the latest time point, the trigger instruction pointing to a historical time point other than the latest time point among the time points; in response to the trigger instruction, displaying a fetal model image corresponding to the historical time point on the display interface; wherein the ultrasound parameters include fetal position and / or fetal head position.
[0006] The present application provides an image processing method for intrapartum monitoring, comprising: obtaining, by an ultrasound device, a first ultrasound image of a fetus in the abdomen acquired at a first time point, and generating a corresponding first fetal model image using the first ultrasound image; obtaining, by the ultrasound device, a second ultrasound image of the fetus in the abdomen acquired at a second time point, and generating a corresponding second fetal model image using the second ultrasound image, wherein the first fetal model image can be reviewed.
[0007] This application provides an auxiliary system for an ultrasound device, comprising a device body, a communication interface, and an output interface. The communication interface is connected to the device body for connecting to the ultrasound device; the output interface is connected to the device body for connecting to a display device. The device body is configured to execute a computer program to implement any of the methods described above.
[0008] The present application provides a computer-readable storage medium, which stores a computer program. When the computer program is executed in a computer processor, it implements any of the methods described above.
[0009] The beneficial effects of the present application are: different from the existing technology, the present application discloses that the ultrasound parameters at different time points and the fetal model diagram corresponding to the latest time point are displayed in the statistical chart of the display interface, which intuitively reflects the situation of the fetus in the abdomen at different time points, and can review the fetal model diagram at past time points by triggering instructions, so that users can use historical data combined with current data to make more accurate delivery predictions and assessments, thereby improving the usability of delivery monitoring equipment. BRIEF DESCRIPTION OF THE DRAWINGS
[0010] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without inventive efforts. Among them:
[0011] Figure 1 It is a flow chart of an embodiment of an image processing method for production monitoring of the present application.
[0012] Figure 2 It is a flow chart of an embodiment of the image display method for production monitoring of the present application.
[0013] Figure 3 This is a schematic diagram of an interface of the second display area in the image processing method for production monitoring of this application.
[0014] Figure 4 This is a schematic diagram of the display interface in the image processing method for production monitoring in this application.
[0015] Figure 5 This is another interface schematic diagram of the second display area in the image processing method for production monitoring of this application.
[0016] Figure 6 This is a schematic diagram of the interface of the first display area in the image processing method for production monitoring in this application.
[0017] Figure 7It is a structural diagram of an embodiment of the auxiliary system of the ultrasound equipment of the present application.
[0018] Figure 8 It is a circuit structure diagram of an embodiment of a computer-readable storage medium of the present application. DETAILED DESCRIPTION
[0019] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are described in detail below in conjunction with the accompanying drawings. It will be understood that the specific embodiments described herein are only used to explain the present application, rather than to limit the present application. It should also be noted that, for ease of description, only some, rather than all, structures related to the present application are shown in the accompanying drawings. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.
[0020] The terms "first," "second," and the like in this application are used to distinguish between different objects, not to describe a particular order. Furthermore, the terms "including," "comprising," and "provided with," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or elements is not limited to the listed steps or elements, but may optionally include steps or elements not listed, or may optionally include other steps or elements inherent to the process, method, product, or apparatus.
[0021] References herein to "embodiments" mean that a particular feature, structure, or characteristic described in connection with the embodiments may be included in at least one embodiment of the present application. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute an independent or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described herein may be combined with other embodiments.
[0022] If the technical solution of this application involves personal information, the product that applies the technical solution of this application has clearly informed the personal information processing rules and obtained the individual's voluntary consent before processing personal information. If the technical solution of this application involves sensitive personal information, the product that applies the technical solution of this application has obtained the individual's separate consent before processing sensitive personal information, and at the same time meets the "explicit consent" requirement. For example, on personal information collection devices such as cameras, a clear and prominent sign is set to inform that the personal information collection scope has been entered and personal information will be collected. If the individual voluntarily enters the collection scope, it is deemed that they agree to the collection of their personal information; or on the personal information processing device, when the personal information processing rules are notified by obvious signs / information, the individual's authorization is obtained through pop-up information or by asking the individual to upload their personal information; among them, the personal information processing rules may include information such as the personal information processor, the purpose of personal information processing, the processing method, and the type of personal information processed.
[0023] With the advancement of medical testing technology, more and more instruments and equipment are being used in the medical industry. For example, the use of ultrasonic equipment to detect the internal structure of the human body can more accurately detect the patient's internal conditions from the outside, and the risks and pain are relatively small, which helps medical personnel understand the patient's physical condition.
[0024] Parturient monitoring is particularly important. Parturient monitoring is a crucial phase of labor and delivery, encompassing the process by which medical personnel utilize all available means to investigate, monitor, and / or diagnose the condition of the mother and her fetus. Therefore, effective monitoring during this phase is crucial for ensuring the safety of both mother and child. Traditionally, clinicians and midwives have primarily performed parturient monitoring through digital vaginal examinations and clinical experience. However, digital vaginal examinations are not only painful for pregnant women and increase the risk of infection, but also rely heavily on the physician's experience, leading to a high degree of subjectivity in their diagnostic results. Therefore, the addition of ultrasound equipment has played a crucial role in labor monitoring.
[0025] Some studies have shown that the application of ultrasound technology for intrapartum monitoring can, in some respects, be more accurate, objective, and reproducible than clinical examinations. It can accurately and effectively monitor labor progress, enabling clinicians to make effective decisions and intervene promptly, thereby reducing the incidence of adverse pregnancy outcomes and ensuring maternal and fetal safety. Therefore, the development of ultrasound technology for intrapartum monitoring is a hot topic for obstetricians and midwives.
[0026] Because intrapartum monitoring requires continuous observation of both the mother and fetus, it often requires combining data from multiple ultrasound scans to assess the fetal condition and labor progress. However, most ultrasound devices only output data from that single scan. Medical staff must laboriously review past scans to effectively understand the labor process, significantly increasing their workload and delaying diagnosis and treatment in emergencies, potentially increasing risks to both the mother and fetus.
[0027] Based on the problems and inconveniences that currently arise with ultrasound equipment during labor monitoring, the inventors of this application have conducted long-term research and, in order to improve or solve the above technical problems, propose at least the following embodiments.
[0028] Figure 1 It is a flow chart of an embodiment of the image processing method for production monitoring of the present invention. It should be noted that if there is substantially the same result, this embodiment does not necessarily Figure 1 The process sequence shown is limited. Figure 1 As shown, this embodiment includes:
[0029] S100: The ultrasound device acquires a first ultrasound image of the fetus in the abdomen at a first time point, and generates a corresponding first fetal model image using the first ultrasound image.
[0030] The display method embodiment of the medical device of the present application can be executed on a device system of an ultrasound device. The ultrasound device can obtain a first ultrasound image through an ultrasound probe connected thereto.
[0031] The ultrasound probe of the ultrasound device can be interchangeable, with different types of probes used to perform different ultrasound image acquisition tasks. For example, a different ultrasound probe can be used for thyroid ultrasound testing than for intrapartum monitoring to better suit the usage scenario.
[0032] In step S100, the ultrasound device may use an ultrasound probe to collect information about the fetus in the abdomen at a first time point, thereby obtaining a first ultrasound image.
[0033] The first ultrasound image may be an ultrasound image that reflects a specified section. The specified section is a section captured by an ultrasound probe from a specified region of the human body that effectively reflects characteristic anatomical structures. The diagnostic basis and test results required by the user can be obtained by analyzing the specified section.
[0034] Specifically, the ultrasound device may determine whether the ultrasound image can reflect the designated section by acquiring and identifying key anatomical structures in the first ultrasound image.
[0035] The anatomical structure may be a recognizable and common structure in a designated section. When the anatomical structure appears in an ultrasound image, it can be determined that the ultrasound image includes the designated section. The ultrasound device can automatically identify the designated section in the image. When the designated section is identified, the ultrasound device can automatically store it as an ultrasound image for viewing or use by the user.
[0036] For example, during intrapartum monitoring, if the fetal position test result is needed, the ultrasound device, once it determines that the user is using the probe correctly and can identify two eye sockets in the ultrasound image, can determine that the ultrasound image contains key anatomical structures and that the ultrasound image can reflect the specified section, and can therefore determine that the fetal position test result is occiput posterior.
[0037] Optionally, after identifying a designated section, the ultrasound device may also notify the user that the acquisition is complete, prompting the user to proceed to the next step. For example, the ultrasound device may play a reminder via a connected audio player, prompting the user to view the fetal model generated using the ultrasound image.
[0038] Optionally, before step S100, a statistical graph may be displayed in the display interface, the statistical graph being used to display a plurality of ultrasound parameters corresponding to a plurality of time points. If there are no time points and / or ultrasound parameters in the statistical graph, the fetal model image may not be displayed in the display interface.
[0039] After the first fetal model diagram is generated, the first ultrasound parameter can be obtained from the first ultrasound image, so that the first data point can be represented in the area corresponding to the first time point and the first ultrasound parameter in the statistical graph. The generated first fetal model diagram can also be displayed on the display interface.
[0040] Specifically, displaying the first fetus model image on the display interface may be replacing the second fetus model image with the first fetus model image and displaying the image on the display interface.
[0041] Optionally, ultrasound parameters related to fetal head position may be displayed in the statistical graph. The ultrasound parameters related to fetal head position may include at least one of fetal head direction, advancement distance, fetal head advancement angle, head-perineum distance, head-pubic symphysis distance, midline angle, occipital-vertebral angle, and chin-sternal angle.
[0042] Optionally, the fetal model image may be a three-dimensional stereogram, used to simulate fetal position information of the fetus in the abdomen at different time points.
[0043] Specifically, in addition to the fetus itself, the fetal model diagram can also include some of the mother's body structures, such as soft tissues such as the uterus, cervix, pelvic peritoneum, and skeletal structures such as the pelvis, so as to reflect the relative position of the fetus and the mother's body, so that medical personnel can judge the progress of delivery based on the mother's physical condition.
[0044] Optionally, the user can adjust the size, angle, color and other parameters of the three-dimensional image through the human-machine interface connected to the ultrasound device to obtain more detailed delivery information.
[0045] S200: The ultrasound device acquires a second ultrasound image of the fetus in the abdomen at a second time point, and generates a corresponding second fetal model image using the second ultrasound image.
[0046] The ultrasound device can also obtain a second ultrasound image of the fetus at a second time point, and then use the second ultrasound image to generate a corresponding second fetal model image. The user can review the first fetal model image generated in the past.
[0047] Specifically, after acquiring the second ultrasound image, the ultrasound device may use the second ultrasound image to obtain a second ultrasound parameter, display a second data point in the area of the statistical graph corresponding to the second time point and the second ultrasound parameter, and connect the first data point and the second data point to reflect the development of the ultrasound parameter from the first time point to the second time point. The second fetal model image may be displayed on the display interface for user viewing.
[0048] Using the method provided in this embodiment, the ultrasound equipment can use ultrasound images to generate corresponding fetal model images to intuitively reflect the condition of the fetus in the abdomen at different time points, and can review fetal model images at past time points, thereby making it easier for users of the ultrasound equipment to understand the condition of the fetus in the abdomen through fetal model images at different time points, and making it easier for users to use historical data combined with current data to make more accurate delivery predictions and assessments, thereby improving the usability of ultrasound equipment in delivery monitoring.
[0049] Figure 2 It is a flow chart of an embodiment of the image display method for production monitoring of the present application. It should be noted that if there is substantially the same result, this embodiment does not necessarily Figure 2 The process sequence shown is limited. Figure 2 As shown, this embodiment includes:
[0050] S300: Receive a trigger instruction for a statistical graph time point in the display interface. The statistical graph is used to display a number of ultrasound parameters corresponding to a number of time points. The display interface also displays a fetal model diagram corresponding to the latest time point. The trigger instruction points to a historical time point other than the latest time point.
[0051] The trigger command for the statistical graph time point in the ultrasound device display interface. The statistical graph is used to display the corresponding ultrasound parameters at several time points. In addition to the statistical graph, the display interface can also display the fetal model corresponding to the latest time point among the several time points.
[0052] The fetal model image can be generated by an ultrasound device using ultrasound images collected at a certain point in time, so the fetal model image can reflect the actual condition of the fetus in the abdomen at that point in time to a certain extent.
[0053] Optionally, the time point may be the time point when the fetal model image is generated, or the time point when the ultrasound image used to generate the fetal model image is acquired.
[0054] Optionally, before acquiring the first ultrasound image, the ultrasound device may display a statistical graph on the display interface. The ultrasound device may use the first ultrasound image to obtain a first ultrasound parameter, and then display a first data point in an area of the statistical graph corresponding to the first time point and the first ultrasound parameter to reflect the detection result obtained using the first ultrasound image.
[0055] At the same time, the first fetal model diagram generated using the first ultrasound image can also be displayed in the display interface so that the user can view it by comparing it with the statistical diagram.
[0056] Specifically, the statistical graph may be a line graph and / or a bar graph. One of the horizontal and vertical coordinates of the statistical graph may be a time point, and the other may be an ultrasound parameter. The first time point and the second time point are located at different positions on a coordinate axis displaying the time point, and the first ultrasound parameter and the second ultrasound parameter may be located at different positions on a coordinate axis displaying the ultrasound parameter.
[0057] S400: In response to a trigger instruction, a fetal model image corresponding to a historical time point is displayed on a display interface.
[0058] The ultrasound device may respond to the trigger instruction and display a fetal model image corresponding to the historical time point on the display interface.
[0059] Using the method provided in this embodiment, the ultrasound device can display ultrasound parameters at different time points in a statistical chart on the display interface, along with the fetal model corresponding to the latest time point, intuitively reflecting the fetal condition at different time points. Furthermore, the fetal model images at past time points can be reviewed by triggering a command, allowing users to combine historical data with current data for more accurate prediction and assessment of labor time, thereby improving the usability of ultrasound devices for labor monitoring.
[0060] Optionally, when the ultrasound device acquires a second ultrasound image at a second time point after the first time point, the ultrasound device can be used to obtain second ultrasound parameters from the second ultrasound image, thereby displaying a second data point in the area of the statistical chart corresponding to the second time point and the second ultrasound parameter. The first data point and the second data point can be connected to reflect the trend of ultrasound parameter changes from the first time point to the second time point. The second fetal model image can also be displayed in the display interface instead of the first fetal model image. The first data point can be triggered to issue a trigger instruction.
[0061] Optionally, the display interface may include a first display area and a second display area, wherein the fetal model diagram and the statistical diagram may be displayed in the second display area, and the first ultrasound image and the second ultrasound image may be displayed in the first display area of the display interface for the user to view in comparison.
[0062] Specifically, after the second ultrasound image is acquired, the second fetal model image can be displayed in the second display area. After the first data point is triggered, the ultrasound device can respond to the trigger instruction and use the first fetal model image to replace the second fetal model image for display, so that the user can view the fetal model image they want to see.
[0063] Furthermore, when displaying the second fetal model image, the second fetal model image can be used to replace the first fetal model image in the display interface. Alternatively, the first fetal model image and the second fetal model image can be displayed simultaneously, but the second fetal model image can be enlarged to highlight the second fetal model image that reflects the latest fetal status.
[0064] Optionally, the statistical graph, the first fetal model graph, and / or the second fetal model graph can be triggered to be enlarged in the display interface, thereby improving user viewing efficiency. Specifically, the enlarged statistical graph, the first fetal model graph, and / or the second fetal model graph can cover at least a portion of the display interface before the enlargement.
[0065] Optionally, the ultrasound device may identify the anatomical structure in the ultrasound image, and draw a measurement line on the ultrasound image according to the anatomical structure, and then perform fetal measurement with reference to the measurement line to obtain ultrasound parameters.
[0066] Among them, fetal measurement is the identification of anatomical structures in a specified section by the ultrasound device, thereby obtaining the ultrasound parameters of the ultrasound image by measuring the anatomical parameters corresponding to the ultrasound parameters.
[0067] The measurement line can be displayed as an editable area within the ultrasound image in the first display area. The user can edit the measurement line through the human-machine interface. After the measurement line is edited, the ultrasound device can obtain the user's edited content and perform fetal measurements based on the edited content to update the ultrasound parameters.
[0068] Optionally, if the user determines that the ultrasound device's recognition result of the anatomical structure is incorrect, the recognition result can be manually edited based on the user's judgment. The user can also modify the ultrasound parameters directly in the display interface.
[0069] Specifically, in response to receiving the edit of the measurement line in the first display area, the ultrasound device re-measures the fetus with reference to the measurement line and updates the ultrasound parameters, the fetal model diagram, the data points in the statistical diagram and other related content.
[0070] Figure 3 It is a schematic diagram of an interface of the second display area in the image processing method for production monitoring of this application. It should be noted that if there is substantially the same result, this embodiment does not use Figure 6 The interface shown is limited. Figure 3 As shown, in this embodiment, the display content of the second display area is ultrasound parameters, ultrasound images and associated data 6 of time points.
[0071] Related data 6 may specifically include a fetus model Figure 4 and a statistical graph 62. The statistical graph 62 includes coordinate axes, variables, a plurality of data points 61, and line segments connecting the plurality of data points 61.
[0072] The same statistical graph 62 may display multiple vertical axes, and different vertical axes may correspond to different ultrasound parameters, different vertical coordinate values, and different units. In this embodiment, the ultrasound parameters of the left and right vertical axes are cervical dilation and fetal head position, respectively.
[0073] Furthermore, the user can modify the variables on the vertical axis by triggering the ultrasound parameter selection area 5 in the interface. For example, the variable corresponding to the vertical axis on the left side of statistical graph 62 can be changed from cervical dilation to AOP (angle of fetal head progression), HSD (head-pubic symphysis distance), OSA (occipital-cervical angle), CCA (chin-sternum angle), CMA (cerebral midline angle), or CD (degree of cervical dilation), etc.
[0074] The horizontal axis of the statistical graph 62 is the time when the ultrasound device acquires these ultrasound parameters. Specifically, the ultrasound parameters are acquired by the ultrasound device capturing ultrasound images and performing fetal measurements on the ultrasound images to acquire the ultrasound parameters.
[0075] Data points 61 corresponding to different ultrasound parameters can be displayed using icons of different shapes. For example, the icon for a data point 61 corresponding to cervical dilation can be a four-pointed star, while the icon for a data point 61 corresponding to HPD can be a lace circle. This allows the values of different ultrasound parameters at different time points to be displayed using the same horizontal axis, and the changes in ultrasound parameters over time can be displayed in the same statistical graph 62, making it easier for users to understand the mother's delivery status.
[0076] Optionally, the time point on the horizontal axis and the data point 61 in the statistical graph 62 can be selected, and the fetal model corresponding to the time point Figure 4 It can be displayed near the data point 61 at that time point to intuitively reflect the state of the fetus in the abdomen at that time point.
[0077] At the same time, the data point 61 at this time point can be displayed separately from other data points 61, or its corresponding vertical coordinate value can be displayed near the data point 61, so that the user can view the specific ultrasound parameters at this time point.
[0078] Optionally, when the user selects a time point or data point 61 in the second display area, the corresponding fetal model Figure 4 It can be displayed nearby, and the corresponding ultrasound image can also be displayed in the first display area for comparison and viewing.
[0079] Figure 4 It is a schematic diagram of the interface display interface in the image processing method for production monitoring of this application. It should be noted that if there is substantially the same result, this embodiment does not use Figure 4 The interface shown is limited. Figure 4 As shown, in this embodiment, the display interface 1 includes a first display area 11 and a second display area 12 .
[0080] The first display area 11 may include a main image area 111 and a history image area 112. The main image area 111 may be used to display an ultrasound image 113 currently scanned by the ultrasound device, and the history image area 112 may be used to display ultrasound images 113 previously captured by the ultrasound device.
[0081] The acquired ultrasound images 113 may be displayed in the history image area 112 in the form of thumbnails in the order of time points.
[0082] Optionally, the user may trigger a certain ultrasound image 113 / thumbnail in the history image area 112 to cause the corresponding ultrasound image 113 to be displayed in the main image area 111 for easy viewing by the user.
[0083] Alternatively, the ultrasound image 113 may be a captured video or a frozen picture. The video and the picture may be displayed with different identifiers in the first display area 11, for example, a playable identifier or a movie frame may be set in the thumbnail of the ultrasound image 113 in the form of a video.
[0084] The display interface 1 may further include a fourth area 13. The fourth area 13 includes an acquisition mode selection area 131, which is configured to be triggered by a user to select an image acquisition mode. For example, a user triggering the acquisition mode selection area 131 displays a window on the display interface 1 that includes at least one mode selection element. Each mode selection element corresponds to an image acquisition mode, and the user can enter the corresponding image acquisition mode by triggering the mode selection element in the window.
[0085] Optionally, the mode selection element selected by the user may be displayed in the acquisition mode selection area 131 in thumbnail form, so that the user can understand the current image acquisition mode.
[0086] Optionally, the display interface 1 may further include a first editing element 132, which is triggered by a user to edit the ultrasound image 113 in the first display area 11. Editing may include at least one of lateral gain compensation, time gain compensation, measurement, freezing, recording, deletion, refreshing, and ultrasound image collection.
[0087] The lateral gain compensation and the time gain compensation are used to compensate for the attenuation of the ultrasonic signal caused by different reasons, so as to improve the quality of the ultrasonic image 113 . Both the lateral gain compensation and the time gain compensation may include eight adjustable items.
[0088] Measure is used to measure the ultrasound image 113 to obtain ultrasound parameters. Freeze is used to capture a specific image from the main image area 111 as the ultrasound image 113. Record is used to capture a specific video segment from the main image area 111 as the ultrasound image 113. Delete is used to delete a specific ultrasound image 113 from the history image area 112. Refresh is used to refresh the ultrasound image 113 displayed in the main image area 111. Ultrasound Image Set is used to open an area that includes all ultrasound images 113 in the history image area 112.
[0089] As shown in the figure, the first editing elements 132 located in the fourth area 13 are, from left to right, Measure, Freeze, Record, Ultrasound Image Collection, and Delete. When the ultrasound image 113 in the main image area 111 is a video, the first editing element 132 located between the fourth area 13 and the historical image area 112 can be used to adjust the progress of the video.
[0090] Optionally, the first editing element 132 located between the fourth area 13 and the historical image area 112 may also be used to refresh the ultrasound image 113 displayed in the main image area 111 .
[0091] Optionally, the first editing element 132 located in the main image area 111 is used to edit gain compensation of the ultrasound image 113 in the main image area 111 , such as TGC (time gain compensation) and / or LGC (lateral gain compensation).
[0092] Optionally, display interface 1 may further include a second editing element 133 corresponding to the current image acquisition mode. This second editing element 133 changes with changes in the image acquisition mode. Second editing element 133 is configured to be triggered by the user to activate the image acquisition function for the current image acquisition mode. For example, if the current image acquisition mode is on-production monitoring, the image acquisition function may include displaying acquisition instructions and / or analysis results 124 for the current image acquisition mode in the second display area 12 or the third area.
[0093] It should be noted that different image acquisition modes may acquire different ultrasound parameters, and the content that users want to focus on is also different. Therefore, the image acquisition functions of different image acquisition modes are also different.
[0094] Optionally, if an image acquisition mode does not have the corresponding image acquisition function, the second editing element 133 may not be displayed in the display interface 1 when the image acquisition mode is executed.
[0095] Optionally, the second editing element 133 can be displayed in a suspended manner near the first editing element 132. The second editing element 133 can also partially cover the first editing element 132 to be highlighted within the display interface 1. As shown in the figure, the second editing element 133 can be located in the fourth area 13 and near the first editing element 132.
[0096] Optionally, after selecting an image acquisition mode, the corresponding image acquisition function can be directly triggered by default. In this embodiment, the second editing element 133 can be the same element as the mode selection element displayed in the acquisition mode selection area 131. When the user selects the mode selection element, the second editing element 133 is triggered at the same time. After determining the image acquisition mode, the ultrasound device can automatically display the acquisition instructions and / or analysis results 124 corresponding to the image acquisition mode in the second display area 12.
[0097] The acquisition instructions can be an image, text description, or a video. The text can be played to the user via voice. The acquisition instructions are used to guide the user in acquiring ultrasound images using the ultrasound device.
[0098] Optionally, the display interface 1 may further include functional elements 14 for performing common operations on the ultrasound device. In this embodiment, functional elements 14 are located at the bottom of the display interface 1 and, from left to right, include Scanned Object Information, Probe Scan, Current Report, Historical Report, Settings, and End Current Scan.
[0099] The scanned subject information is used by the user to trigger registration and viewing of the scanned subject information. This allows the ultrasound device to subsequently acquire ultrasound images 113, ultrasound parameters, and analysis results 124 that can be associated with the scanned subject, facilitating service and management of the scanned subject. Scanned subject information may include the subject's ID, name, gender, age, attending physician, and / or examining physician. For intrapartum monitoring, scanned subject information may also include fetal number, fetal position, placental position, gestational age, expected date of delivery, and / or gestational age.
[0100] The probe scan is used to be triggered by the user to enter the process of acquiring the ultrasound image 113 . After the probe scan is triggered, the ultrasound device can start outputting to the display device to enter the display interface 1 .
[0101] This report is used by the user to trigger the generation, viewing, and / or storage of a test report generated using the ultrasound images 113 acquired during the current scan. Optionally, the test report may include the ultrasound images 113, ultrasound parameters, and more detailed analysis results 124 to fully demonstrate the results of the current scan to the user.
[0102] The historical report is used to trigger the display of inspection reports generated by other scanning processes that the scanned object underwent before the current scan. Specifically, this display method can be a second interface displayed on a display device. The second interface includes a table of report information, where the report information corresponds one-to-one with the inspection reports generated by other scanning processes. The user can trigger a specific report information to view the corresponding inspection report.
[0103] This setting allows users to trigger edits to the ultrasound device's system and / or operating status. The End Current Scan button allows users to trigger the end of the current scan. Optionally, after the current scan is complete, a test report for the scan can be automatically generated and / or stored.
[0104] Alternatively, the user may trigger the command by inputting an audio signal. For example, the user inputs the voice message "check the analysis results" through the human-machine interface of the ultrasound device, and the ultrasound device automatically displays the analysis results in the second display area 12 .
[0105] Figure 5 This is another interface diagram of the second display area in the image processing method for production monitoring of this application. It should be noted that if there is substantially the same result, this embodiment does not use Figure 5 The interface shown is limited. Figure 5 As shown, the highlighted switching element 125 in this embodiment is “Analysis Result”, and the “Analysis Result” corresponds to the analysis result 124 obtained by the ultrasound device through analysis based on the collected ultrasound image 113 .
[0106] Specifically, the analysis result 124 in this embodiment may include associated data, such as a statistical graph 62 generated using ultrasound parameters. The statistical graph 62 is used to display a number of ultrasound parameters corresponding to a number of time points. The analysis result 124 may also include a fetal model. Figure 4 and / or production probability maps Figure 7 .
[0107] Statistical chart 62 can use an ultrasound parameter as the vertical axis and time as the horizontal axis to intuitively display the progress of the labor process to the user in the form of a broken line chart. The ultrasound parameter used as the vertical axis can be multiple ultrasound parameters related to the position of the fetal head. Different ultrasound parameters are displayed as different lines in the chart.
[0108] Production Probability Mapping Figure 7 It can be a grayscale bar and an arrow pointing to a position in the grayscale bar. The different grayscale shades of the grayscale bar can be used to reflect the smoothness of the delivery process. For example, the lighter the grayscale, the safer the delivery.
[0109] Fetal model Figure 4 It is generated by the ultrasound equipment based on the ultrasound image 113 and ultrasound parameters, and is used to reflect the relative position of the fetus and the mother's body at a certain moment, and can intuitively reflect the ultrasound value and delivery progress.
[0110] Furthermore, when the user selects a data point in the statistical graph 62, the fetal model Figure 4 and production probability mapping Figure 7 And / or the ultrasound image 113 in the main image area 111 can be changed according to the ultrasound parameters at the data point, so that the user can easily view the production status at a certain moment.
[0111] Figure 6 It is a schematic diagram of the interface of the first display area in the image processing method for production monitoring of this application. It should be noted that if there is substantially the same result, this embodiment does not use Figure 6 The interface shown is limited. Figure 6 As shown, this embodiment may be the main image area 111 of the first display area 11 , including the ultrasound image 113 , the measurement line 114 , the first editing element 132 and the editable area 123 .
[0112] The medical device can identify and mark the measurement line 114 within the ultrasound image 113 in the main imaging area 111. The ultrasound parameters within the editable area 123 are calculated by the medical device based on fetal measurements of the measurement line 114. A user can edit the ultrasound parameters within the measurement line 114 and the editable area 123 to modify the medical device's identification results. For example, a user can trigger the measurement line 114 to adjust the position of the measurement line 114 and the feature points on it. Another example is a user triggering a specific ultrasound parameter within the editable area 123 and editing it through the human-machine interface connected to the medical device.
[0113] Specifically, the ultrasound parameters displayed in the editable area 123 in this embodiment include: angle of advancement (AOP) of 97.59°, head position (Head Station) of -17.67 mm, head-to-pubic symphysis distance (HSD) of 45.73 mm, and progression distance (PD) of 71.37 mm. It should be noted that the ultrasound image 113, specific types of ultrasound parameters, specific values of ultrasound parameters, and measurement line 114 provided in this embodiment are provided for illustrative purposes only and do not limit actual implementations.
[0114] Optionally, the position of the editable area 123 displaying ultrasound parameters can be actively adjusted by the user and is not limited to the main image area 111 of the first display area 11. The user can move the editable area 123 to a position in the display interface 1 that does not block the line of sight and / or facilitates editing operations to improve the usability of the medical device.
[0115] Figure 7 It is a schematic diagram of the structure of the auxiliary system embodiment of the ultrasonic device of the present application. It should be noted that if there is substantially the same result, this embodiment is not based on Figure 7 The structure shown is limited. Figure 7 As shown, the auxiliary system 2 for an ultrasound device described in the embodiment of the auxiliary system for an ultrasound device of the present application may include an ultrasound device 21 and a display device 24. The ultrasound device 21 may include a device body 21a, a communication interface 22, and an output interface 23. The communication interface 22 is connected to the device body 21a and is used to connect to the ultrasound device 21 to obtain ultrasound images and analysis data from the ultrasound device 21. The output interface 23 is connected to the device body 21a and is used to connect to the display device 24 to transmit the ultrasound images and analysis data obtained from the ultrasound device 21 to the display device 24 for display.
[0116] The device body 21a may specifically include a memory, which is used to store computer programs and may be a ROM (Read-Only Memory), a RAM (Random Access Memory), or other types of storage devices. Specifically, the memory may include one or more computer-readable storage media, which may be non-transitory. The memory may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory is used to store at least one program code.
[0117] The device body 21a may further include a processor, which is used to control the operation of the ultrasound device 21. The processor may also be referred to as a CPU (Central Processing Unit). The processor may be an integrated circuit chip with signal processing capabilities. The processor may also be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. The general-purpose processor may be a microprocessor or any conventional processor.
[0118] The processor is used to execute the computer program stored in the memory to implement the image processing method for production monitoring described in any embodiment of the present application.
[0119] For a detailed description of the functions and execution processes of the various functional modules or components in the computer device embodiment of the present application, please refer to the description in the embodiment of the image processing method for production-time monitoring of the present application mentioned above, and no further details will be given here.
[0120] In the several embodiments provided in the present application, it should be understood that the disclosed auxiliary system 2 for ultrasound equipment and the image processing method for production monitoring can be implemented in other ways. For example, the various embodiments of the auxiliary system 2 for ultrasound equipment described above are merely schematic. For example, the division of modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.
[0121] Units described as separate components may or may not be physically separate, and components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.
[0122] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.
[0123] Optionally, the method provided in this application can be executed in device-side software. The device-side can be an ultrasound device running on a medical device with ultrasound function, which can be integrated or run on a device other than a medical device. When the device-side software is running, a human-computer interaction interface is generated. The user can use a human-computer interface such as a touch screen, mouse, keyboard, etc. to operate on the human-computer interaction interface or directly use a gesture detection device to operate. In this embodiment, the device-side software is used as the main body of the display method for the medical device of this application.
[0124] The device where the device-side software resides and the electronic device where the server and / or client software resides can transmit data via Ethernet, WLAN (wireless local area network), etc. Of course, the device-side software can also be run on a device that is not connected to the Internet.
[0125] The device-side software can obtain an ultrasound image from the ultrasound device. Specifically, the ultrasound device may include an ultrasound probe, and the ultrasound probe has a collection area. The ultrasound device can collect ultrasound images, such as ultrasound images, through the collection area of the ultrasound probe.
[0126] See Figure 8 , Figure 8: It is a circuit structure diagram of an embodiment of a computer-readable storage medium of the present application. If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium 200. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions / computer programs to enable a computer device (which can be a personal computer, server, or network device, etc.) or a processor (processor) to perform all or part of the steps of the various embodiments of the present invention. The aforementioned storage medium includes various media such as a USB flash drive, a mobile hard disk, a read-only memory, a random access memory, a magnetic disk or an optical disk, and electronic terminals such as computers, mobile phones, laptops, tablet computers, cameras, etc. having the above-mentioned storage medium.
[0127] The description of the execution process of the program data in the computer-readable storage medium can be made with reference to the above-mentioned description of the image processing method for production monitoring in the present application, and will not be repeated here.
[0128] The above is only an implementation method of the present application and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the description and drawings of this application, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.
Claims
1. A method for displaying images during labor monitoring, characterized in that: include receiving a trigger instruction for a time point of a statistical graph on a display interface, wherein the statistical graph is used to display a plurality of ultrasound parameters corresponding to a plurality of said time points, the display interface also displays a fetal model image corresponding to the latest said time point, and the trigger instruction points to a historical time point among the said time points except the latest said time point; In response to the trigger instruction, displaying the fetal model image corresponding to the historical time point on the display interface; The ultrasound parameters include fetal position and / or fetal head position.
2. The image display method for production monitoring according to claim 1, characterized in that: The step of receiving a trigger instruction for a time point of a statistical graph in a display interface includes: Displaying the statistical graph on a display interface; A first ultrasound parameter is obtained by using a first ultrasound image acquired by an ultrasound device at a first time point, a first data point is displayed in an area of the statistical graph corresponding to the first time point and the first ultrasound parameter, and the first fetal model diagram is displayed in the display interface.
3. The image display method for production monitoring according to claim 2, characterized in that: After displaying the first fetus model image on the display interface, the method further includes: obtaining a second ultrasound parameter from the second ultrasound image using the ultrasound device, displaying a second data point in an area of the statistical graph corresponding to the second time point and the second ultrasound parameter, connecting the first data point and the second data point, and replacing the first fetal model image with the second fetal model image for display; The first data point can be triggered to issue the trigger instruction.
4. The image display method for production monitoring according to claim 3, characterized in that: The statistical graph is a line graph or a bar graph, the horizontal axis of the statistical graph is the time point, and the vertical axis is the ultrasound parameter, the first time point and the second time point are located at different positions of the horizontal axis, and the first ultrasound parameter and the second ultrasound parameter are located at different positions of the vertical axis.
5. The image display method for production monitoring according to claim 4, characterized in that: The first fetal model image and the second fetal model image are three-dimensional stereoscopic images, which are used to simulate the fetal position and / or fetal head position of the fetus in the abdomen at different time points.
6. The image display method for production monitoring according to claim 3, characterized in that: The display interface includes a first display area and a second display area, the first ultrasound image and / or the second ultrasound image is displayed in the first display area, the first fetal model image or the second fetal model image is displayed in the second display area, and the statistical graph is displayed in the second display area.
7. The image processing method for production monitoring according to claim 6, characterized in that: The step of responding to the trigger instruction further includes: In response to the trigger instruction issued when the first data point is triggered, the second ultrasound image is replaced by the first ultrasound image and displayed in the first display area.
8. The image processing method for production monitoring according to claim 2, characterized in that: The statistical graph, the first fetal model graph and / or the second fetal model graph can be triggered to be enlarged in the display interface.
9. The image processing method for production monitoring according to claim 1, characterized in that: The fetal model image is displayed near the corresponding time point; Displaying the fetal model image corresponding to the historical time point on the display interface includes: The fetus model image corresponding to the historical time point is displayed near the historical time point.
10. An image processing method for intrapartum monitoring, characterized in that: include: The ultrasound device acquires a first ultrasound image of the fetus in the abdomen at a first time point, and generates a corresponding first fetal model image using the first ultrasound image; The ultrasound device obtains a second ultrasound image of the fetus in the abdomen at a second time point, and generates a corresponding second fetal model image using the second ultrasound image, wherein the first fetal model image can be reviewed.
11. The image processing method for production monitoring according to claim 10, characterized in that: Before the ultrasound device acquires a first ultrasound image of the fetus in the abdomen at a first time point, the method includes: Display statistical graphs on the display interface; After the ultrasound device acquires a first ultrasound image of the fetus in the abdomen at a first time point, the method further includes: A first ultrasound parameter is obtained using the first ultrasound image, a first data point is displayed in an area of the statistical graph corresponding to the first time point and the first ultrasound parameter, and the first fetal model image is displayed in the display interface.
12. The image processing method for production monitoring according to claim 11, characterized in that: Displaying the first fetus model image on the display interface includes: The second fetus model image is replaced by the first fetus model image and displayed on the display interface.
13. An auxiliary system for ultrasonic equipment, characterized in that: include: Equipment body; A communication interface connected to the device body and used for connecting to an ultrasound device; An output interface, connected to the device body, for connecting to a display device; The device body is configured to execute the computer program to implement the method according to any one of claims 1 to 12.
14. A computer-readable storage medium storing a computer program, characterized in that: The computer program implements the method according to any one of claims 1 to 12 when executed in a computer processor.