A bearing chart generation method and device, and a storage medium

Abstract

The application discloses a method and device for generating an azimuth map and a storage medium, and is applied to the technical field of ultrasound, and comprises the following steps: determining a reference object and the contour of each target object based on an ultrasonic image of a measured part; determining the size of each target object and the relative position relationship between each target object and the reference object; obtaining the classification information of each target object; adding each identifier corresponding to each target object in the azimuth map added with a template control; the template control is used for representing the reference shape of the reference object; the overlapping relationship and the relative position relationship between each identifier and the template control respectively meet the classification information of the corresponding target object and the relative position relationship of the reference object of the corresponding target object. According to the scheme, the visual display of the target object can be intuitively and accurately realized, and the situation of multiple target objects can be effectively coped with.

Description

Technical Field

[0001] This invention relates to the field of ultrasound technology, and in particular to a method, apparatus and storage medium for generating azimuth maps. Background Technology

[0002] Currently, ultrasound screening typically requires a doctor's visual inspection to obtain results. For example, ultrasound is used for screening uterine fibroids, breast nodules, thyroid nodules, and follicular tissue analysis. The screening results are recorded as charts or ultrasound reports as important reference material for subsequent work. However, doctors often struggle to connect these reports to the actual screening objectives, leading to potential errors.

[0003] Taking uterine fibroid screening as an example, current ultrasound screening for uterine fibroids requires doctors to visually inspect for fibroids. If present, the doctor manually measures the size of the fibroid and takes an image. The doctor then classifies the fibroid by observing its relationship to the mucosa and serosa, and records its approximate location using charts or an ultrasound report. This provides crucial reference data for subsequent follow-up, examinations, and treatment. While the ultrasound report provides a general textual description of the fibroid's size and location, which is helpful for subsequent work, doctors may find it difficult to connect this information with the actual shape and location of the fibroid, leading to errors. Furthermore, some protocols use clock hands to mark the fibroid's location. This method only indicates the approximate location and distance of the fibroid relative to a designated reference point, providing limited information and offering limited assistance to doctors. Furthermore, if there are multiple fibroids, a corresponding clock pointer diagram needs to be generated for each different uterine fibroid. The selected reference points may not be the same, and doctors need to combine and associate the locations of each uterine fibroid themselves. Therefore, such a simple marking method is difficult to deal with the common situation of multiple fibroids in clinical practice.

[0004] In summary, how to effectively achieve intuitive and accurate visualization of target objects, and how to effectively handle situations with multiple target objects, are technical problems that urgently need to be solved by those skilled in the art. Summary of the Invention

[0005] The purpose of this invention is to provide a method, device, and storage medium for generating a location map, so as to effectively achieve intuitive and accurate visualization of target objects and effectively handle situations involving multiple target objects.

[0006] To solve the above-mentioned technical problems, the present invention provides the following technical solution:

[0007] In a first aspect, the present invention provides a method for generating a location map, comprising:

[0008] Based on the ultrasound images of the tested area, the reference objects in the ultrasound images and the outlines of each target object are determined.

[0009] Based on the reference object in the ultrasound image and the outline of each of the target objects, the size of each of the target objects and the relative positional relationship between each of the target objects and the reference object are determined.

[0010] Obtain the classification information of each target object;

[0011] In the orientation map with added template controls, add identifiers that correspond one-to-one with each of the target objects;

[0012] The template control is a control used to represent the reference shape of the reference object; the relative positional relationship between each identifier and the template control conforms to the relative positional relationship between the corresponding target object and the reference object, and the overlap relationship between each identifier and the template control conforms to the classification information of the corresponding target object.

[0013] In one implementation, it further includes:

[0014] When an adjustment operation is detected for any identifier, the size and / or position of the identifier is adjusted based on the adjustment operation, and the overlap relationship between the adjusted identifier and the template control conforms to the classification information of the corresponding target object.

[0015] In one implementation, it further includes:

[0016] When an adjustment operation is detected for any identifier, a movable region for the identifier is generated based on the size of the identifier and the classification information of the target object corresponding to the identifier.

[0017] Wherein, when the boundary of the identifier does not exceed the movable area, the overlap relationship between the identifier and the template control conforms to the classification information of the corresponding target object;

[0018] The movable area is displayed in the orientation map, and the display of the movable area is turned off when the adjustment operation ends.

[0019] In one implementation, upon detecting an adjustment operation for any identifier, the size and / or position of the identifier is adjusted based on the adjustment operation, and the overlap relationship between the adjusted identifier and the template control conforms to the classification information of the corresponding target object, including:

[0020] Upon detecting an adjustment operation for any identifier, the size and / or position of the identifier are adjusted based on the adjustment operation;

[0021] Determine whether the overlap between the adjusted identifier and the template control matches the classification information of the corresponding target object;

[0022] If not, the adjustment operation is revoked to restore the identifier to its state before the adjustment operation was performed, and an alarm message is output.

[0023] In one implementation, it further includes:

[0024] For each target object, description data of the target object is generated based on the size of the target object, the relative positional relationship between the target object and the reference object, and the classification information of the target object;

[0025] When a description information display operation is detected for any identifier, the description data of the target object corresponding to the identifier is obtained and displayed in the orientation map.

[0026] In one embodiment, the target object is a uterine fibroid, the reference object is the uterus, and the step of determining the contours of the reference object and each target object in the ultrasound image based on the ultrasound image of the measured site includes:

[0027] Based on the ultrasound images of the tested area, the outlines of the uterine peritoneum, the uterine endometrium, and each uterine fibroid are determined in the ultrasound images.

[0028] Obtain the classification information for each target object, including:

[0029] Obtain the triadic or FIGO classification information for each uterine fibroid;

[0030] Each of the added identifiers is either a circular identifier or a spherical identifier.

[0031] In one implementation, adding identifiers corresponding one-to-one with each of the target objects to the orientation map with added template controls includes:

[0032] In the 2D or 3D orientation map with added template controls, add identifiers that correspond one-to-one with each of the target objects.

[0033] In one implementation, the size ratio of each of the identifiers to the corresponding abnormal object conforms to a set ratio, which is a pre-set initial ratio or a ratio obtained based on the initial ratio and a ratio adjustment rule.

[0034] The ratio adjustment rule includes: enlarging or reducing the initial ratio so that the obtained ratio is within a preset ratio range, and so that the area of ​​each identifier is within a preset area range or the volume of each identifier is within a preset volume range.

[0035] Secondly, the present invention provides an apparatus for generating a azimuth map, comprising:

[0036] Memory, used to store computer programs;

[0037] A processor for executing the computer program to implement the steps of the orientation map generation method as described above.

[0038] Thirdly, the present invention provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the steps of the orientation map generation method described above.

[0039] By applying the technical solution provided in this invention, the visualization of each target object is achieved based on the generated orientation map, resulting in an intuitive and accurate display effect, and effectively handling situations with multiple target objects. Specifically, based on the ultrasound image of the measured area, the outlines of the reference object and each target object in the ultrasound image can be determined, thereby determining the size of each target object and its relative positional relationship with the reference object.

[0040] The generated orientation map requires the addition of a template control, which represents the reference shape of a reference object, providing a valid reference when viewing the orientation map. Furthermore, identifiers corresponding to each target object need to be added to the orientation map. The relative positional relationship between the added identifiers and the template control must conform to the relative positional relationship between the corresponding target object and the reference object, and the overlap relationship between the identifiers and the template control must conform to the classification information of the corresponding target object. In other words, using the template control as a reference, the orientation map, through the added identifiers, can effectively reflect the size, relative positional relationship, and classification information of the corresponding target objects in the ultrasound image, allowing for a direct and accurate determination of the situation of each target object when viewing the orientation map provided by this application. Moreover, it is understood that by default, the size ratio of each identifier to its corresponding target object is consistent, i.e., the scale is uniform, and the position of each identifier in the orientation map is also fixed. Therefore, whether there is one or multiple target objects, the size relationship and relative position of each target object can be easily determined when viewing the orientation map provided by this application. In summary, the solution proposed in this application can effectively achieve intuitive and accurate visualization of the target object, and can effectively handle situations involving multiple target objects. Attached Figure Description

[0041] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0042] Figure 1 This is a flowchart illustrating the implementation of a method for generating a location map according to a specific embodiment of the present invention.

[0043] Figure 2 This is a functional schematic diagram of an ultrasonic device in a specific embodiment of the present invention;

[0044] Figure 3 This is a schematic diagram illustrating the principle of generating an orientation map in a specific embodiment of the present invention.

[0045] Figure 4 This is a schematic diagram of the outline of each object in the measured part of one specific embodiment of the present invention.

[0046] Figure 5 A schematic diagram of the structure of a location map generation system provided in a specific embodiment of the present invention;

[0047] Figure 6This is a schematic diagram of the structure of a location map generation device provided in a specific embodiment of the present invention. Detailed Implementation

[0048] The core of this invention is to provide a method, device and storage medium for generating a location map, which can effectively realize intuitive and accurate visualization of target objects and can effectively deal with the situation of multiple target objects.

[0049] To enable those skilled in the art to better understand the present invention, the invention will be further described in detail below with reference to the accompanying drawings and specific embodiments. Obviously, the described embodiments are only a part of the embodiments of the present invention, and not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0050] Please refer to Figure 1 , Figure 1 This is a flowchart illustrating an embodiment of a method for generating a location map according to a specific embodiment of the present invention. The method for generating a location map may include the following steps:

[0051] Step S101: Based on the ultrasound image of the tested area, determine the reference objects in the ultrasound image and the contours of each target object.

[0052] The solution proposed in this application can be applied in a variety of situations. Therefore, the area to be tested can be set according to actual needs. For example, it can be applied in various situations such as uterine fibroid screening, breast nodule screening, thyroid nodule screening, and follicle tissue detection. In other words, as long as ultrasound detection of the area to be tested can be performed to obtain ultrasound images, and reference objects and the outlines of each target object can be determined from them, the solution proposed in this application can be used to generate a directional map.

[0053] The following text will use the case of uterine fibroid screening as an example. In this case, the area being tested is the patient's abdomen, the reference point is the uterus, and the target object is the uterine fibroid.

[0054] Ultrasound images are typically acquired and subsequently processed using ultrasound equipment. (See also...) Figure 2This is a functional diagram of an ultrasound device in one specific embodiment, including a probe, a system control module, a pulse transceiver module, an imaging module, an intelligent processing module, a data management and storage module, and a display and interaction module. The probe can transmit ultrasound signals and receive echo signals. In some cases, by configuring relevant sensors, switches, and other components, functions such as probe motion monitoring and event triggering can be achieved. The system control module can control the transmission of ultrasound pulses and the reception of echo signals, and can implement control functions such as function initiation and preset event timing triggering. Under the control of the system control module, the pulse transceiver module can generate probe excitation signals and receive and process echo signals. The imaging module can perform a series of processes on the received echo signals to achieve ultrasound image reconstruction. The intelligent processing module can realize intelligent functions such as real-time detection of objects such as tumors and nodules, and automatic capture of standard sections. In this application, the intelligent processing module can be used to generate a location map. The data management and storage module can realize functions such as case management and data storage, callback, marking, and indexing. The display and interaction module can include devices such as a monitor, keyboard, touch screen, and speakers to realize display and interaction functions. In addition, in some cases, it can also include audio input, camera and other audio and video interaction interfaces, and can be equipped with wireless control switches and mobile APP deployment functions.

[0055] After obtaining the ultrasound image of the area to be tested, the contours of reference objects and individual target objects in the ultrasound image can be determined based on the ultrasound image. There are various ways to achieve this; for example, machine learning models can be used to automatically segment and recognize the contours of each target object, offering high accuracy and efficiency. Figure 3 This is a schematic diagram illustrating the principle of orientation map generation in a specific embodiment of the present invention. Figure 3 In the example, the fibroid segmentation measurement model determines the outlines of the reference object (when the reference object is the uterus, the uterus specifically includes structures such as the endometrium and periuterine lining) and each target object (uterine fibroid) in the ultrasound image, and determines the size of each target object and the relative positional relationship between each target object and the reference object, which are used as the measurement results obtained by the fibroid segmentation measurement model.

[0056] In one specific embodiment of the present invention, when the target object is a uterine fibroid and the reference object is the uterus, step S101 may include: determining the contour of the uterine peritoneum, the contour of the uterine endometrium, and the contour of each uterine fibroid in the ultrasound image based on the ultrasound image of the tested area.

[0057] Understandably, in specific situations, once the area to be measured is set, the reference object and target object in the ultrasound image can be determined. For example, in this implementation, the reference object is the uterus, and its outline is the uterine outline. The uterine outline can specifically include the outline of the periderm and the outline of the endometrium. The periderm outline, also known as the serosal outline, is the outline of the uterine body, while the endometrial outline is the mucosal outline. The outlines of each target object are the individual outlines of each uterine fibroid. See also... Figure 4 , Figure 4 In the example, the contours of the uterine peritoneum, the uterine endometrium, and the individual contours of the three uterine fibroids were determined based on the ultrasound images of the tested area.

[0058] Step S102: Based on the reference object in the ultrasound image and the outline of each target object, determine the size of each target object and the relative positional relationship between each target object and the reference object.

[0059] Once the reference object and the outlines of each target object in the ultrasound image are determined, the size of each target object and its relative position to the reference object can be determined. Taking the uterus as an example, the size of each uterine fibroid and its relative position to the reference object can be determined based on the outline of the uterine body, the outline of the endometrium, and the outlines of each uterine fibroid. This step can also be achieved using a fibroid segmentation measurement model.

[0060] Step S103: Obtain the classification information of each target object.

[0061] In this application, the classification information of the target object is used to reflect the overlapping relationship between the target object and the reference object, and there can be multiple classification methods. For example, for uterine fibroids, the three-type method and FIGO classification method are commonly used. That is, for uterine fibroids, step S103 may include: obtaining the three-type information or FIGO classification information of each uterine fibroid.

[0062] For uterine fibroids, the three-category classification method is a relatively rough approach. Specifically, it divides uterine fibroids into three types: subserosal fibroids, submucosal fibroids, and intramural fibroids. These represent fibroids that intersect with the serosa, fibroids that intersect with the mucosa, and fibroids located within the myometrium between the serosa and mucosa, without intersecting with either the serosa or mucosa.

[0063] The FIGO (International Federation of Gynecology and Obstetrics) classification of uterine fibroids is more detailed, as follows: Type 0: Submucosal fibroids completely located within the uterine cavity. Type 1: Fibroids mostly located within the uterine cavity, with ≤50% of the fibroid residing within the myometrium. Type 2: Fibroids protruding from the myometrium into the submucosa, with >50% of the fibroid residing within the myometrium. Types 2-5: Mixed type, where fibroids intersect with both the mucosa and serosa. Type 3: Fibroids completely located within the myometrium, but closely adhering to the mucosa. Type 4: Fibroids completely located within the myometrium, neither protruding into the serosa nor the mucosa. Type 5: Fibroids protruding into the serosa, but with ≥50% residing within the myometrium. Type 6: Fibroids protruding into the serosa, but with <50% residing within the myometrium. Type 7: Pedunculated subserosal fibroids. Type 8: Non-uterine myometrial type, that is, uterine fibroids in special locations, such as fibroids in the cervix or broad ligament. Figure 3 In the example, the FIGO fractal method is illustrated in the orientation diagram.

[0064] The classification information for each target object can be automatically confirmed through a classification model, or staff can manually input the classification information for each target object.

[0065] Step S104: In the orientation map with added template controls, add identifiers that correspond one-to-one with each target object.

[0066] The template control is a control used to represent the reference shape of the reference object; the relative positional relationship between each identifier and the template control conforms to the relative positional relationship between the corresponding target object and the reference object, and the size ratio of each identifier and the corresponding target object conforms to the set ratio, and the overlap relationship between each identifier and the template control conforms to the classification information of the corresponding target object.

[0067] The orientation map generated by this application can be composed of a template control and various identifiers. The template control is a control used to represent the reference shape of a reference object. For the uterus, the template control is the reference shape of the uterus, including the serosa and mucosa. In practical applications, it is usually not necessary to adjust the template control; that is, the template control can use its default size and shape. Of course, in practical applications, if necessary, the size and shape of the template control can be adjusted as needed.

[0068] In one specific embodiment of the present invention, step S104 may specifically include: adding identifiers corresponding one-to-one with each of the target objects to the 2D or 3D orientation map with added template controls. This embodiment takes into account that the orientation map generated by this application can be a 2D orientation map or a 3D orientation map, to ensure the flexibility of implementation of the solution of this application. Furthermore, it is understood that if a 3D orientation map is generated, then when determining the outline of each object in the aforementioned steps, the outline of the reference object and each target object in three-dimensional space is determined. This usually requires determination based on multiple ultrasound images, resulting in relatively high computational complexity and the need for a more accurate segmentation measurement model. Similarly, determining the size of each target object and the relative positional relationship between each target object and the reference object involves determining the size of each target object in three-dimensional space and the relative positional relationship between each target object and the reference object in three-dimensional space. A 3D orientation map is more three-dimensional, intuitive, and has a better display effect. In contrast, if a 2D orientation map is used, the steps described above for determining the outlines of each object involve determining the outlines of the reference object and each target object in the planar space, thus obtaining the size of each target object in the planar space and the relative positional relationship between each target object and the reference object. The segmentation measurement model used will be simpler and easier to implement. In practical applications, either a 3D orientation map or a 2D orientation map can be selected according to actual needs.

[0069] When adding identifiers to the orientation map, the number of identifiers added corresponds to the number of target objects identified in the ultrasound image; that is, each identifier corresponds one-to-one with each target object. Taking any identifier as an example, the size of the identifier reflects the size of its corresponding target object, and the relative position of the identifier to the template control reflects the relative position of its corresponding target object to the reference object. The overlap between the identifier and the template control reflects the overlap between its corresponding target object and the reference object, which in turn reflects the classification information of its corresponding target object.

[0070] Furthermore, it is important to emphasize that the size of the identifier reflects the size of its corresponding target object. Since there may be one or more target objects, the scale used should be consistent by default. That is, the size ratio of each identifier to its corresponding target object should be consistent and conform to the set ratio. This ensures that when viewing the orientation map provided by this application, regardless of whether there is one or more target objects, the relative positional relationship between each target object and the reference object can be clearly understood based on the identifiers in the orientation map. It also allows for a clear understanding of the size relationships and relative positions of each target object. Of course, in some embodiments, the size ratio of one or more identifiers to their corresponding target objects can be adjusted according to actual needs.

[0071] It should also be noted that in practical applications, the shape and color of the identifiers can be set as needed. For example, for the uterus area, if the target object is a uterine fibroid, and uterine fibroids are usually approximately spherical, then each added identifier can be either a circular identifier or a spherical identifier. Furthermore, different shapes of the identifiers can be set according to the different classification information of the target object. The colors of the identifiers can be, for example, the default color, or a color selected by the doctor. Alternatively, the colors of the identifiers can be set according to the classification information of the target object, allowing the doctor to quickly determine the classification information of the target object reflected by the identifier based directly on its color. Figure 3 The example shown illustrates a location map obtained in one scenario, where each identifier is a circular identifier.

[0072] Furthermore, since the classification information of each target object is obtained in this application, in order to intuitively display the classification information of each target object, the classification information of each target object can be directly displayed in the orientation map. For example, in each identifier, the classification information of the target object corresponding to the identifier can be displayed in the form of numbers.

[0073] In one specific embodiment of the present invention, it may further include:

[0074] When an adjustment operation is detected for any identifier, the size and / or position of the identifier is adjusted based on the adjustment operation, and the overlap relationship between the adjusted identifier and the template control conforms to the classification information of the corresponding target object.

[0075] This implementation takes into account that the present application can automatically generate a location map composed of template controls and various identifiers. Under normal circumstances, the size and position of the corresponding target object reflected by each identifier are more in line with the actual situation of the patient. However, in some implementations, the size and position of the target object automatically identified by the model may deviate from the actual situation. Therefore, the present application allows manual adjustment of the identifiers.

[0076] Specifically, doctors can operate the system using touchscreens, mouse wheels, trackballs, or keyboard input. When an adjustment operation is detected for any identifier, the size and / or position of the identifier can be adjusted based on that operation. For example, a doctor can double-click to select an identifier on a location map and then scroll the mouse wheel to enlarge the identifier. Alternatively, a doctor can double-click to select an identifier on a location map and drag it to a new position, thus adjusting the identifier's location.

[0077] It should also be noted that this implementation takes into account that, for a given target object, whether the classification information is automatically determined by the classification model or manually entered, the classification information is generally accurate and should not be arbitrarily adjusted. Therefore, in this implementation, when adjusting the size and / or position of the identifier, the overlap between the identifier and the template control should still conform to the classification information of the corresponding target object to ensure the accuracy of the orientation map.

[0078] In one specific embodiment of the present invention, when an adjustment operation is detected for any identifier, the size and / or position of the identifier is adjusted based on the adjustment operation, and the overlap relationship between the adjusted identifier and the template control conforms to the classification information of the corresponding target object, including:

[0079] When an adjustment operation is detected for any identifier, the size and / or position of the identifier are adjusted based on the adjustment operation;

[0080] Determine whether the overlap between the adjusted identifier and the template control matches the classification information of the corresponding target object;

[0081] If not, the adjustment operation will be revoked to restore the identifier to its state before the adjustment operation was performed, and an alarm message will be output.

[0082] This implementation takes into account that in order to ensure that the overlapping relationship between the adjusted identifier and the template control conforms to the classification information of the corresponding target object, there are multiple ways to achieve this. For example, the movement range of the identifier can be restricted based on the classification information so that the overlapping relationship between the identifier and the template control after the position adjustment still conforms to the classification information of the corresponding target object.

[0083] This implementation takes into account that whether the overlap between the identifier and the template control conforms to the classification information of the corresponding target object is affected by the size and position of the identifier. Furthermore, in practical applications, doctors' adjustment operations are diverse. Therefore, a more convenient implementation is to determine whether the overlap between the adjusted identifier and the template control conforms to the classification information of the corresponding target object after the adjustment. If it does, the adjustment is allowed; otherwise, if it does not, the adjustment operation can be directly revoked, restoring the identifier to its state before the adjustment operation. An alarm message can also be output to clarify the reason for the revocation of the adjustment operation for the doctor.

[0084] In one specific embodiment of the present invention, it may further include:

[0085] When an adjustment operation is detected for any identifier, a movable area for the identifier is generated based on the size of the identifier and the classification information of the target object corresponding to the identifier.

[0086] When the boundary of the identifier does not exceed the movable area, the overlap between the identifier and the template control conforms to the classification information of the corresponding target object;

[0087] Display the movable area on the orientation map, and turn off the display of the movable area when the adjustment operation is finished.

[0088] This implementation takes into account that whether the overlap between the identifier and the template control conforms to the classification information of the corresponding target object is affected by the size and position of the identifier. Therefore, in order to facilitate doctors to adjust the identifier, when an adjustment operation for any identifier is detected, a movable area of ​​the identifier can be generated based on the size of the identifier and the classification information of the target object corresponding to the identifier. That is, given the current size of the identifier, if the position of the identifier is moved within the movable area, the overlap between the identifier and the template control after the movement will still conform to the classification information of the corresponding target object.

[0089] For example, type 0 uterine fibroids refer to submucosal fibroids located entirely within the uterine cavity. This means that while the size and position of the corresponding identifier can be adjusted, the identifier can only move within the uterine cavity. In this example, the movable area set for the identifier is the area within the uterine cavity. Similarly, for type 1 uterine fibroids, regardless of how the identifier is adjusted, it must be a submucosal fibroid, and the portion within the myometrium (the muscle layer between the mucosa and serosa) must be ≤50%. Therefore, based on the mucosal contour and the size of the identifier, the movable area of ​​the identifier can be determined such that when the identifier reaches the boundary of the movable area, the portion within the myometrium is exactly 50%.

[0090] In one specific embodiment of the present invention, it may further include:

[0091] For each target object, descriptive data of the target object is generated based on the size of the target object, the relative position of the target object to the reference object, and the classification information of the target object.

[0092] When a descriptive information display operation is detected for any identifier, the descriptive data of the target object corresponding to the identifier is obtained and displayed in the orientation map.

[0093] This implementation takes into account that the orientation map of this application can achieve intuitive and accurate visualization of each target object, and can also effectively handle situations with multiple target objects. In order to enable doctors or patients to further clarify the information conveyed by the orientation map through text description when viewing it, this implementation generates descriptive data for each target object. For example, based on the size of a target object, its classification information, and its relative position to a reference object, the generated descriptive data for that target object is: "The uterine fibroid is type 2, located on the left side of the fundus of the uterus, intersecting with the endometrium by 30%, and the remainder distributed in the myometrium."

[0094] When a descriptive information display operation is detected for any identifier, such as when a doctor right-clicks an identifier, it is considered that a descriptive information display operation for that identifier has been detected. The descriptive data of the target object corresponding to the identifier, such as "This uterine fibroid is type 2, located at the left side of the bottom of the uterus, intersecting with the endometrium by 30%, and the rest distributed in the myometrium", can be displayed in the orientation map.

[0095] Furthermore, in some implementations, the description data can be displayed directly without detecting a description information display operation. For example, multiple lines of description data can be displayed at the bottom of the location map, with each line corresponding to a uterine fibroid. This allows doctors or patients to more easily and accurately understand the information conveyed by the location map by combining graphic and textual information, clarifying the size, location, and classification information of each uterine fibroid.

[0096] In one specific embodiment of the present invention, the size ratio of each identifier to the corresponding abnormal object conforms to a set ratio, which is a pre-set initial ratio or a ratio obtained based on the initial ratio and ratio adjustment rules.

[0097] The scaling rules include: enlarging or reducing the initial scaling ratio so that the obtained scaling ratio is within a preset scaling ratio range, and so that the area of ​​each identifier is within a preset area range or the volume of each identifier is within a preset volume range.

[0098] As described above, when adding identifiers to a location map, there may be one or multiple target objects. Therefore, by default, the scale used should be consistent, meaning that the size ratio of each identifier to the corresponding target object should be consistent and conform to the set scale. This implementation further considers that a simple approach is to directly use the initial scale as the required scale, which is simple to implement and less prone to errors.

[0099] Of course, in some cases, the required ratio can be obtained based on the initial ratio and the ratio adjustment rules. This is because in practical applications, some uterine fibroids may be very large, while others may be very small. If a pre-fixed initial ratio is used every time, in some cases, the identifier for smaller uterine fibroids may be very small, making it difficult for doctors to observe them, or the identifier for larger uterine fibroids may be very large, which is also difficult for doctors to observe. Therefore, in this implementation, it is permissible to adjust the initial ratio to a certain extent according to the ratio adjustment rules.

[0100] Specifically, you can enlarge or reduce the initial ratio, but there are limits to how much you can enlarge or reduce it, ensuring that the adjusted ratio remains within the preset range. For example, in one scenario, the initial ratio is 1:5, while the preset ratio range is 1:1 to 1:20.

[0101] For 2D orientation maps, the area of ​​each marker must be within a preset area range; for 3D orientation maps, the volume of each marker must be within a preset volume range. It can be seen that since the area or volume of each marker is within the preset area or volume range, the adjusted scale is appropriate and beneficial for doctors to observe the orientation map.

[0102] By applying the technical solution provided in this invention, the visualization of each target object is achieved based on the generated orientation map, resulting in an intuitive and accurate display effect, and effectively handling situations with multiple target objects. Specifically, based on the ultrasound image of the measured area, the outlines of the reference object and each target object in the ultrasound image can be determined, thereby determining the size of each target object and its relative positional relationship with the reference object.

[0103] The generated orientation map requires the addition of a template control, which represents the reference shape of a reference object, providing a valid reference when viewing the orientation map. Furthermore, identifiers corresponding to each target object need to be added to the orientation map. The relative positional relationship between the added identifiers and the template control must conform to the relative positional relationship between the corresponding target object and the reference object, and the overlap relationship between the identifiers and the template control must conform to the classification information of the corresponding target object. In other words, using the template control as a reference, the orientation map, through the added identifiers, can effectively reflect the size, relative positional relationship, and classification information of the corresponding target objects in the ultrasound image, allowing for a direct and accurate determination of the situation of each target object when viewing the orientation map provided by this application. Moreover, it is understood that by default, the size ratio of each identifier to its corresponding target object is consistent, i.e., the scale is uniform, and the position of each identifier in the orientation map is also fixed. Therefore, whether there is one or multiple target objects, the size relationship and relative position of each target object can be easily determined when viewing the orientation map provided by this application. In summary, the solution proposed in this application can effectively achieve intuitive and accurate visualization of the target object, and can effectively handle situations involving multiple target objects.

[0104] Corresponding to the above method embodiments, this invention also provides a system for generating a azimuth map, which can be referred to in conjunction with the above.

[0105] See Figure 5 The diagram shown is a structural schematic of a location map generation system according to the present invention, comprising:

[0106] The contour segmentation unit 501 is used to determine the reference objects and the contours of each target object in the ultrasound image based on the ultrasound image of the measured part.

[0107] Size and position determination unit 502 is used to determine the size of each target object and the relative positional relationship between each target object and the reference object based on the reference object in the ultrasound image and the outline of each target object.

[0108] The classification information acquisition unit 503 is used to acquire the classification information of each target object.

[0109] The orientation map generation unit 504 is used to add identifiers corresponding to each target object in the orientation map with added template controls;

[0110] The template control is a control used to represent the reference shape of the reference object; the relative positional relationship between each identifier and the template control conforms to the relative positional relationship between the corresponding target object and the reference object, and the size ratio of each identifier and the corresponding target object conforms to the set ratio, and the overlap relationship between each identifier and the template control conforms to the classification information of the corresponding target object.

[0111] In one specific embodiment of the present invention, an identifier adjustment unit is further included, for:

[0112] When an adjustment operation is detected for any identifier, the size and / or position of the identifier is adjusted based on the adjustment operation, and the overlap relationship between the adjusted identifier and the template control conforms to the classification information of the corresponding target object.

[0113] In one specific embodiment of the present invention, a movable area prompting unit is further included, for:

[0114] When an adjustment operation is detected for any identifier, a movable area for the identifier is generated based on the size of the identifier and the classification information of the target object corresponding to the identifier.

[0115] When the boundary of the identifier does not exceed the movable area, the overlap between the identifier and the template control conforms to the classification information of the corresponding target object;

[0116] Display the movable area on the orientation map, and turn off the display of the movable area when the adjustment operation is finished.

[0117] In one specific embodiment of the present invention, the identifier adjustment unit is specifically used for:

[0118] When an adjustment operation is detected for any identifier, the size and / or position of the identifier are adjusted based on the adjustment operation;

[0119] Determine whether the overlap between the adjusted identifier and the template control matches the classification information of the corresponding target object;

[0120] If not, the adjustment operation will be revoked to restore the identifier to its state before the adjustment operation was performed, and an alarm message will be output.

[0121] In one specific embodiment of the present invention, a description data display unit is further included, for:

[0122] For each target object, descriptive data of the target object is generated based on the size of the target object, the relative position of the target object to the reference object, and the classification information of the target object.

[0123] When a descriptive information display operation is detected for any identifier, the descriptive data of the target object corresponding to the identifier is obtained and displayed in the orientation map.

[0124] In one specific embodiment of the present invention, the target object is a uterine fibroid, the reference object is the uterus, and the contour segmentation unit 501 is specifically used for:

[0125] Based on the ultrasound images of the tested area, the outlines of the uterine peritoneum, endometrium, and each uterine fibroid in the ultrasound images are determined.

[0126] The classification information acquisition unit 503 is specifically used for:

[0127] Obtain the triadic or FIGO classification information for each uterine fibroid;

[0128] Each of the added identifiers is either a circular identifier or a spherical identifier.

[0129] In one specific embodiment of the present invention, the orientation map generation unit 504 is specifically used for:

[0130] In the 2D or 3D orientation map with added template controls, add identifiers that correspond one-to-one with each of the target objects.

[0131] In one specific embodiment of the present invention, the size ratio of each identifier to the corresponding abnormal object conforms to a set ratio, which is a pre-set initial ratio or a ratio obtained based on the initial ratio and ratio adjustment rules.

[0132] The scaling rules include: enlarging or reducing the initial scaling ratio so that the obtained scaling ratio is within a preset scaling ratio range, and so that the area of ​​each identifier is within a preset area range or the volume of each identifier is within a preset volume range.

[0133] Corresponding to the above methods and system embodiments, this invention also provides a location map generation device and a computer-readable storage medium, which can be referred to in conjunction with the above.

[0134] See Figure 6 As shown, the device may include:

[0135] Memory 601 is used to store computer programs;

[0136] Processor 602 is configured to execute a computer program to implement the steps of the orientation map generation method as described in any of the above embodiments.

[0137] The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the orientation map generation method as described in any of the above embodiments. The computer-readable storage medium referred to herein includes random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disks, removable disks, CD-ROMs, or any other form of storage medium known in the art.

[0138] It should also be noted that, in this application, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0139] Those skilled in the art will further recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed in this application can be implemented in electronic hardware, computer software, or a combination of both. To clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the foregoing description. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this invention. Specific examples have been used in this application to illustrate the principles and implementation methods of the invention. The description of the above embodiments is only for the purpose of helping to understand the technical solution and core ideas of the invention. It should be noted that those skilled in the art can make several improvements and modifications to the invention without departing from the principles of the invention, and these improvements and modifications also fall within the protection scope of the invention.

Claims

1. A method for generating a azimuth map, characterized in that, include: Based on the ultrasound images of the tested area, the reference objects in the ultrasound images and the outlines of each target object are determined. Based on the reference object in the ultrasound image and the outline of each of the target objects, the size of each of the target objects and the relative positional relationship between each of the target objects and the reference object are determined. Obtain the classification information of each target object; In the orientation map with added template controls, add identifiers that correspond one-to-one with each of the target objects; The template control is a control used to represent the reference shape of the reference object; the relative positional relationship between each identifier and the template control conforms to the relative positional relationship between the corresponding target object and the reference object, and the overlap relationship between each identifier and the template control conforms to the classification information of the corresponding target object.

2. The method for generating a azimuth map according to claim 1, characterized in that, The method further includes: When an adjustment operation is detected for any identifier, the size and / or position of the identifier is adjusted based on the adjustment operation, and the overlap relationship between the adjusted identifier and the template control conforms to the classification information of the corresponding target object.

3. The method for generating a azimuth map according to claim 2, characterized in that, The method further includes: When an adjustment operation is detected for any identifier, a movable region for the identifier is generated based on the size of the identifier and the classification information of the target object corresponding to the identifier. Wherein, when the boundary of the identifier does not exceed the movable area, the overlap relationship between the identifier and the template control conforms to the classification information of the corresponding target object; The movable area is displayed in the orientation map, and the display of the movable area is turned off when the adjustment operation ends.

4. The method for generating a azimuth map according to claim 2, characterized in that, Upon detecting an adjustment operation on any identifier, the size and / or position of the identifier are adjusted based on the adjustment operation, and the overlap between the adjusted identifier and the template control conforms to the classification information of the corresponding target object, including: Upon detecting an adjustment operation for any identifier, the size and / or position of the identifier are adjusted based on the adjustment operation; Determine whether the overlap between the adjusted identifier and the template control matches the classification information of the corresponding target object; If not, the adjustment operation is revoked to restore the identifier to its state before the adjustment operation was performed, and an alarm message is output.

5. The method for generating a azimuth map according to claim 1, characterized in that, The method further includes: For each target object, description data of the target object is generated based on the size of the target object, the relative positional relationship between the target object and the reference object, and the classification information of the target object; When a description information display operation is detected for any identifier, the description data of the target object corresponding to the identifier is obtained and displayed in the orientation map.

6. The method for generating a azimuth map according to claim 1, characterized in that, The target object is a uterine fibroid, the reference object is the uterus, and the process of determining the contours of the reference object and each target object in the ultrasound image based on the ultrasound image of the measured site includes: Based on the ultrasound images of the tested area, the outlines of the uterine peritoneum, the uterine endometrium, and each uterine fibroid are determined in the ultrasound images. Obtain the classification information for each target object, including: Obtain the triadic or FIGO classification information for each uterine fibroid; Each of the added identifiers is either a circular identifier or a spherical identifier.

7. The method for generating a azimuth map according to claim 1, characterized in that, In the location map with added template controls, identifiers corresponding one-to-one with each of the target objects are added, including: In the 2D or 3D orientation map with added template controls, add identifiers that correspond one-to-one with each of the target objects.

8. The method for generating a azimuth map according to any one of claims 1 to 7, characterized in that, The size ratio of each of the aforementioned identifiers to the corresponding abnormal objects conforms to a set ratio, which is either a pre-set initial ratio or a ratio obtained based on the initial ratio and ratio adjustment rules. The ratio adjustment rule includes: enlarging or reducing the initial ratio so that the obtained ratio is within a preset ratio range, and so that the area of ​​each identifier is within a preset area range or the volume of each identifier is within a preset volume range.

9. A device for generating a azimuth map, characterized in that, include: Memory, used to store computer programs; A processor for executing the computer program to implement the steps of the method for generating a azimuth map as described in any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the steps of the orientation map generation method as described in any one of claims 1 to 8.

Images