Information auxiliary display method and device, equipment and storage medium
By performing lesion analysis on image frames and generating auxiliary enhanced information display, the problem of low diagnosis efficiency in multi-device switching is solved, and image processing efficiency and lesion review performance are improved.
Patent Information
- Application Number
- CN202411053429.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-01
- Publication Date
- 2024-11-26
AI Technical Summary
During the diagnosis process, doctors need to switch multiple types of medical testing equipment to obtain comprehensive lesion information, resulting in low diagnostic efficiency and reduced image processing efficiency.
By obtaining the image frame to be processed for lesion analysis, determining the target lesion area and description, generating auxiliary enhancement information, and displaying it in the image frame, improving the efficiency of lesion determination and reference performance.
It improves the efficiency of lesion determination and image processing efficiency, reduces dependence on different devices, and simplifies the process of lesion information review.
Smart Images

Figure CN119028537A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of medical technology, and in particular to an information auxiliary display method, device, equipment and storage medium. Background Art
[0002] With the rapid development of medical testing technology, various testing methods have emerged one after another. For example, DSA scanning, ultrasound scanning, CT scanning, etc. can provide more comprehensive examinations of patients and present the pathological conditions earlier and more comprehensively.
[0003] Depending on the patient's lesion condition, it may be necessary to use multiple instruments for testing in order to obtain more comprehensive lesion information. However, while the information is comprehensive, the burden on doctors to review it is also increased. Doctors need to switch between multiple types of information devices for a long time to observe image information and lesion information, which reduces image processing efficiency. Summary of the invention
[0004] The present application provides an information auxiliary display method, device, equipment and storage medium, aiming to solve the above-mentioned problem of low diagnostic efficiency.
[0005] In a first aspect, the present application provides an information auxiliary display method, comprising:
[0006] Acquire a first image frame to be processed, perform lesion analysis processing on the first image frame, and obtain a target lesion region corresponding to the first image frame and a target lesion description corresponding to the target lesion region;
[0007] For each of the target lesion regions, generating auxiliary enhancement information according to the target lesion region and the target lesion description;
[0008] The auxiliary enhancement information is displayed in the target lesion area corresponding to the first image frame.
[0009] In a possible implementation of the present application, the generating of auxiliary enhancement information according to the target lesion region and the target lesion description includes:
[0010] Determining a target user corresponding to the first image frame according to processing information of a first device displaying the first image frame;
[0011] Acquire an auxiliary lesion description of an auxiliary image corresponding to the target user, where the auxiliary image includes: an image acquired based on a second device and / or an image acquired based on the first device;
[0012] According to the auxiliary lesion description and the target lesion description and the correlation, the target lesion description and the target lesion area are updated;
[0013] Auxiliary enhancement information is generated according to the updated target lesion description and the target lesion area.
[0014] In a possible implementation of the present application, the method further includes:
[0015] In response to the auxiliary image analysis request sent by the third device, feeding back the auxiliary image to the third device so that the third device displays the auxiliary image;
[0016] Determine, according to the updated target lesion description and the target lesion region, an auxiliary lesion region in the auxiliary image and a target lesion description corresponding to the auxiliary lesion region;
[0017] Analysis enhancement information is generated according to the auxiliary lesion area and the corresponding target lesion description, and the analysis enhancement information is displayed corresponding to the auxiliary image.
[0018] In a possible implementation of the present application, displaying the auxiliary enhancement information in the target lesion area corresponding to the first image frame includes:
[0019] generating a projection image according to the auxiliary enhancement information;
[0020] Determine projection position information corresponding to the target lesion area according to calibration information between the first device and the projection device corresponding to the first image frame, and internal reference information of the first device;
[0021] The projection image is projected into the first image frame according to the projection position information.
[0022] In a possible implementation of the present application, the method further includes:
[0023] If the task processing type corresponding to the first image frame is a real-time monitoring type, a medical scene image frame acquired at an acquisition time corresponding to the first image frame is acquired, wherein the medical scene image frame includes a target user corresponding to the first image frame, and a scanning device that scans the target user to obtain the first image frame;
[0024] Determine a lesion auxiliary identification area in the medical scene image frame according to the location area of the scanning device in the medical scene image frame and the target lesion area;
[0025] Determine the projection identification image corresponding to the auxiliary lesion identification area and the projection position of the projection identification image according to the calibration information between the acquisition device and the projection device for acquiring the medical scene image frame;
[0026] The projection logo image is projected to the projection position corresponding to the projection logo image, so as to display the projection logo image corresponding to the target user.
[0027] In a possible implementation of the present application, determining the auxiliary lesion identification area in the medical scene image frame according to the location area of the scanning device in the medical scene image frame and the target lesion area includes:
[0028] Determining, according to a location area of the scanning device in the medical scene image frame, a target sub-image of the medical scene image frame corresponding to the first image frame;
[0029] According to the position correspondence between the target sub-image and the first image frame, a lesion auxiliary identification area corresponding to the target lesion area in the target sub-image is determined.
[0030] In a possible implementation of the present application, the acquiring of a first image frame to be processed, performing lesion analysis processing on the first image frame, and obtaining a target lesion region corresponding to the first image frame and a target lesion description corresponding to the target lesion region include:
[0031] In response to the auxiliary processing request sent by the first device, obtaining a first image frame corresponding to the auxiliary processing request;
[0032] The first image frame is subjected to lesion analysis using a lesion analysis model to obtain a target lesion region corresponding to the first image frame and a target lesion description corresponding to the target lesion region.
[0033] In a second aspect, the present application provides an information auxiliary display device, the device comprising:
[0034] an acquisition module, configured to acquire a first image frame to be processed, perform lesion analysis on the first image frame, and obtain a target lesion region corresponding to the first image frame and a target lesion description corresponding to the target lesion region;
[0035] A generating module, configured to generate auxiliary enhancement information for each target lesion region according to the target lesion region and the target lesion description;
[0036] A display module is used to display the auxiliary enhancement information in the target lesion area corresponding to the first image frame.
[0037] In a third aspect, the present application provides an electronic device, the electronic device comprising:
[0038] one or more processors;
[0039] Memory; and
[0040] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement any one of the information auxiliary display methods.
[0041] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program is loaded by a processor to execute the steps in any one of the information auxiliary display methods.
[0042] The present application provides an information auxiliary display method, device, equipment and storage medium, which obtains a first image frame to be processed, performs lesion analysis on the first image frame, obtains a target lesion area corresponding to the first image frame and a target lesion description corresponding to the target lesion area; for each target lesion area, generates auxiliary enhancement information according to the target lesion area and the target lesion description; and displays the auxiliary enhancement information in the target lesion area corresponding to the first image frame. This solution performs lesion analysis on the acquired first image frame, generates auxiliary enhancement information corresponding to the target lesion area and the corresponding target lesion description obtained by analysis, and displays the auxiliary enhancement information in an auxiliary enhancement manner, abandoning the technical solution in the traditional technical solution that requires image observation of different devices to determine the lesion, thereby improving the efficiency of lesion determination, and at the same time displays the auxiliary enhancement information corresponding to the lesion in an enhanced display manner, thereby improving the lesion search performance and thus improving the image processing efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0044] Figure 1 is a schematic diagram of a scenario of an information auxiliary display method provided in an embodiment of the present application;
[0045] Figure 2 It is a schematic diagram of an embodiment of the information auxiliary display method provided in the embodiments of the present application;
[0046] Figure 3 It is a schematic diagram of an embodiment of the flow chart of the generation of auxiliary enhancement information in the information auxiliary display method provided in the embodiment of the present application;
[0047] Figure 4 A schematic diagram of a flow chart of one implementation scheme of assisting enhanced information display in the information auxiliary display method provided in the implementation scheme of the present application;
[0048] Figure 5 is a schematic diagram of the structure of an embodiment of an information auxiliary display device provided in an embodiment of the present application;
[0049] Figure 6 It is a schematic diagram of the structure of an embodiment of the information auxiliary display device provided in the embodiments of the present application. DETAILED DESCRIPTION
[0050] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.
[0051] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicate positions or positional relationships based on the positions or positional relationships shown in the accompanying drawings, which are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.
[0052] In the embodiment of the present application, "and / or" describes the association relationship of the associated objects, indicating that three relationships may exist. For example, A and / or B may represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / ", unless otherwise specified, generally indicates that the associated objects before and after are in an "or" relationship.
[0053] In this application, the word "exemplary" is used to mean "serving as an example, illustration, or illustration." Any embodiment described in this application as "exemplary" is not necessarily to be construed as being preferred or advantageous over other embodiments. The following description is given to enable any person skilled in the art to implement and use the invention. In the following description, details are listed for the purpose of explanation. It should be understood that a person of ordinary skill in the art can recognize that the invention can be implemented without using these specific details. In other instances, well-known structures and processes are not elaborated in detail to avoid obscuring the description of the invention with unnecessary details. Therefore, the present invention is not intended to be limited to the embodiments shown, but is consistent with the widest scope consistent with the principles and features disclosed in this application.
[0054] The embodiments of the present application provide an information auxiliary display method, device, equipment and computer-readable storage medium, which are described in detail below.
[0055] The information-assisted display method in the embodiment of the present invention is applied to an information-assisted display device, and the information-assisted display device is arranged in the information-assisted display device. The information-assisted display device is provided with one or more processors, memories, and one or more applications, wherein the one or more applications are stored in the memories and configured to be executed by the processor to implement the information-assisted display method; the information-assisted display device can be a terminal, such as a mobile phone or a tablet computer, and the information-assisted display device can also be a server, or a service cluster composed of multiple servers, or an information-assisted enhancement device, such as a projector, a CR / VR device, etc.
[0056] like Figure 1 As shown, Figure 1 This is a scene diagram of the information auxiliary display method of an embodiment of the present application. The information auxiliary display scene in the embodiment of the present invention includes an information auxiliary display device 100 (an information auxiliary display device is integrated in the information auxiliary display device 100), and a computer-readable storage medium corresponding to the information auxiliary display runs in the information auxiliary display device 100 to execute the steps of information auxiliary display.
[0057] Understandably, Figure 1 The information auxiliary display device in the scenario of the information auxiliary display method shown, or the devices included in the information auxiliary display device, does not constitute a limitation on the embodiments of the present invention. That is, the number of devices and types of devices included in the scenario of the information auxiliary display method, or the number of devices and types of devices included in each device, do not affect the overall implementation of the technical solution in the embodiments of the present invention, and can all be regarded as equivalent replacements or derivatives of the technical solution claimed to be protected in the embodiments of the present invention.
[0058] The information auxiliary display device 100 in the embodiment of the present invention is mainly used for: acquiring a first image frame to be processed, performing lesion analysis processing on the first image frame, obtaining a target lesion area corresponding to the first image frame and a target lesion description corresponding to the target lesion area; for each target lesion area, generating auxiliary enhancement information according to the target lesion area and the target lesion description; and displaying the auxiliary enhancement information in the target lesion area corresponding to the first image frame.
[0059] In the embodiment of the present invention, the information auxiliary display device 100 may be an independent information auxiliary display device, or an information auxiliary display device network or information auxiliary display device cluster composed of information auxiliary display devices. For example, the information auxiliary display device 100 described in the embodiment of the present invention includes but is not limited to a computer, a network host, a single network information auxiliary display device, a set of multiple network information auxiliary display devices, or a cloud information auxiliary display device composed of multiple information auxiliary display devices. The cloud information auxiliary display device is composed of a large number of computers or network information auxiliary display devices based on cloud computing.
[0060] Those skilled in the art will understand that Figure 1 The application environment shown in the figure is only one application scenario of the present application solution and does not constitute a limitation on the application scenario of the present application solution. Other application environments may also include Figure 1 More or fewer information auxiliary display devices, or network connection relationships of information auxiliary display devices, such as Figure 1 Only one information auxiliary display device is shown. It can be understood that the scenario of the information auxiliary display method can also include one or more other information auxiliary display devices, which are not limited here. The information auxiliary display device 100 can also include a memory for storing data, for example, storing image information obtained by shooting, etc.
[0061] In addition, the scenario of the information-assisted display method of the present application also includes an image acquisition device 200, and the image acquisition device 200 may include multiple ones, and the information-assisted display device 100 is used to perform information-assisted enhanced display on the image acquisition device 200. The information-assisted display device 100 can access a background database 300 (the background database can be in the local memory of the information-assisted display device, and the background database can also be set in the cloud), and the background database 300 stores information related to information-assisted display, for example, the initial image in the background database 300, or pre-set filtering parameters.
[0062] It should be noted that Figure 1The scene diagram of the information auxiliary display method shown is only an example. The scene of the information auxiliary display method described in the embodiment of the present invention is to more clearly illustrate the technical solution of the embodiment of the present invention, and does not constitute a limitation on the technical solution provided by the embodiment of the present invention.
[0063] Based on the scenario of the above-mentioned information auxiliary display method, an embodiment of the information auxiliary display method is proposed.
[0064] like Figure 2 FIG. 2 is a flow chart of an embodiment of the information auxiliary display method in the embodiment of the present application. The information auxiliary display method includes steps S201-S203:
[0065] S201. Acquire a first image frame to be processed, perform lesion analysis on the first image frame, and obtain a target lesion region corresponding to the first image frame and a target lesion description corresponding to the target lesion region.
[0066] Among them, the first image frame is a medical image acquired by a medical image acquisition device. For example, the first image frame is a DSA scanning image, an ultrasound scanning image or a CT scanning image acquired by a DSA scanning device, an ultrasound scanning device, a CT scanning device or the like.
[0067] Specifically, in the implementation scheme of the present application, the information auxiliary display method is applied to an information auxiliary display device, and the information auxiliary display device is applied to an information auxiliary display device. The information auxiliary display device may include a projection device, a VR device, a CR device, etc., or the medical image acquisition device may also be an electronic device, a computer, etc.
[0068] Specifically, the information auxiliary display device and each medical image acquisition device realize data connection through a local area network, a wireless network or a server, etc., and create a data connection link. In the actual processing process, the first image frame is acquired through the data connection link, and after acquiring the first image frame, the first image frame is subjected to image analysis processing to determine the target lesion area where the lesion exists in the first image frame, and the target lesion description corresponding to the target lesion area.
[0069] Specifically, in one embodiment of the present application, the first image frame carries a lesion description corresponding to the first image frame (the lesion information can be obtained by analysis by the image acquisition device), and the information-assisted display device determines the target lesion area in the first image frame and the target lesion description displayed in the target lesion area by performing lesion analysis on the first image frame in combination with the lesion description carried.
[0070] In some other implementation schemes of the present application, the first image frame may not carry lesion information, and the target lesion area and the target lesion information corresponding to the target lesion area can be obtained directly by performing lesion analysis on the first image frame.
[0071] It can be understood that the specific implementation method of performing lesion analysis on the first image frame and the lesion information carried by the first image frame is not specifically limited in this application. Exemplarily, it can be implemented through a lesion analysis model, and the lesion analysis model can have this function through training.
[0072] S202: For each target lesion region, generate auxiliary enhancement information according to the target lesion region and the target lesion description.
[0073] The auxiliary enhancement information is used to mark the target lesion area and the target lesion information in the first image frame; that is, it can be understood that the auxiliary enhancement information is used to mark and display the target lesion area in the first image frame and the target lesion information corresponding to the target lesion area. The display position includes but is not limited to displaying the auxiliary enhancement information in the first image frame, or displaying the auxiliary enhancement information on the detection object corresponding to the first image frame. For example, if the target detection object is a human body and the target lesion area is the spleen in the human body, the auxiliary enhancement information can be projected on the spleen area corresponding to the human body.
[0074] It can be understood that the auxiliary enhancement information may correspond to different types of enhancement methods. For example, the corresponding enhancement method is projection enhancement through a projector, that is, the auxiliary enhancement information is projection enhancement information. If the enhancement method is through AR enhancement, that is, the auxiliary enhancement information is AR enhancement information. Alternatively, the device displaying the first image frame has an information enhancement display function, and the auxiliary enhancement information is display information corresponding to the information enhancement display function.
[0075] Specifically, in the implementation scheme of the present application, after the information auxiliary display device obtains the first image frame and performs lesion analysis based on the first image frame to obtain the target lesion area corresponding to the first image frame and the target lesion information corresponding to the target lesion area, auxiliary enhancement information corresponding to the auxiliary display of the first image frame is generated for the target lesion area and the target lesion information.
[0076] S203: Display the auxiliary enhancement information in the target lesion area corresponding to the first image frame.
[0077] Specifically, in an embodiment of the present application, the first image frame is displayed on a display device, and a user performs image analysis and processing on the first image frame based on the display device. The information auxiliary display device obtains the first image frame in response to the analysis and processing, and determines its corresponding auxiliary enhancement information, and marks the auxiliary enhancement information as marking information in the first image frame displayed by the display device. For example, the auxiliary enhancement information includes a labeling box corresponding to the target lesion area in the first image frame, and a description of the target lesion displayed corresponding to the labeling box.
[0078] It can be understood that the first image frame can be displayed on different types of display devices corresponding to different application scenarios, and the auxiliary enhancement information is enhanced and displayed on the display device corresponding to the display of the first image frame.
[0079] Exemplarily, in some embodiments of the present application, the information auxiliary display device is a computer, the display device is a display screen corresponding to the information auxiliary display device, and the user performs image lesion analysis and processing corresponding to the first image frame based on the computer and the display device.
[0080] Alternatively, in some other embodiments of the present application, the display device is an image acquisition device that acquires the first image frame. When the image acquisition device acquires one of the first image frames, the first image frame is sent to an information-assisted display device for lesion analysis, and the auxiliary enhancement information corresponding to the first image frame obtained by analysis is sent to the image acquisition device, so that the image acquisition device displays the auxiliary enhancement information corresponding to the first image frame; alternatively, in this implementation scenario, after the information-assisted display device obtains the auxiliary enhancement information corresponding to the first image frame by analysis, the information-assisted display device displays the auxiliary enhancement information in the first image frame through the information-assisted display device.
[0081] Alternatively, in some other embodiments of the present application, a detection device, a display device and an information auxiliary display device are included, and a first image frame is collected by the detection device, and the first image frame is displayed on the display device. In this scenario, the information auxiliary display device can project the auxiliary enhancement information to the corresponding position (corresponding position such as the position corresponding to the target detection area) on the detected user by means of projection, and / or send the auxiliary enhancement information to the first image frame corresponding to the display device to display the auxiliary enhancement information in the form of a mark. That is, the observer can intuitively observe the actual position area corresponding to the lesion and observe the image lesion information through the display device during observation.
[0082] It can be understood that, in the above embodiment, the specific positioning method of projecting the auxiliary enhancement information to the corresponding position on the detected user can determine the projection position of the target lesion display area corresponding to the projection device through the position calibration relationship between the position of the projection device and the position of the image detection area corresponding to the detection device (during detection, the detected user is located in the area position).
[0083] This solution performs lesion analysis on the first acquired image frame, generates auxiliary enhancement information for the target lesion area and the corresponding target lesion description obtained by analysis, and displays the auxiliary enhancement information in an auxiliary enhancement manner, abandoning the traditional technical solution that requires image observation of different devices to determine the lesion, thereby improving the efficiency of lesion determination. At the same time, the auxiliary enhancement information corresponding to the lesion is displayed in an enhanced display manner, which improves the lesion search performance and thus improves the image processing efficiency.
[0084] Furthermore, in some other embodiments of the present application, an embodiment of auxiliary enhancement information generation is also provided, see Figure 3 , Figure 3 This is a schematic flow chart of an embodiment of the generation of auxiliary enhancement information in the information auxiliary display method provided in the embodiment of the present application, which specifically includes steps S301-S304:
[0085] S301. Determine a target user corresponding to the first image frame according to processing information of a first device that displays the first image frame.
[0086] The processing information of the first device at least includes a target user identifier corresponding to the first image frame.
[0087] It is understandable that when the analyst processes the first image analysis matter, the analyst will enter the user information of the analyzed object. Specifically, the user information may at least include the target user identifier.
[0088] Specifically, in the implementation scheme of the present application, the first device may be the image acquisition device described in the above implementation scheme, obtaining the display device.
[0089] S302: Obtain an auxiliary lesion description of the auxiliary image corresponding to the target user.
[0090] The auxiliary image includes: an image acquired based on the second device and / or an image acquired based on the first device. It is understandable that the first image frame can be acquired by the first device, and the auxiliary image is a medical image acquired based on the second device, that is, the medical image acquired by other image acquisition devices corresponding to the target user except the first image frame, or also includes historically acquired medical images of the same type as the first image frame except the first image frame, that is, images acquired by the first device.
[0091] The first device and the second device are the medical image acquisition devices mentioned above.
[0092] Among them, the auxiliary lesion description, that is, includes the lesion description obtained by performing lesion analysis processing on each of the auxiliary images. Exemplarily, the lesion description of the auxiliary image may include the lesion area in the auxiliary image and the lesion information corresponding to the lesion area.
[0093] S303: Update the target lesion description and target lesion region according to the auxiliary lesion description, the target lesion description and the correlation.
[0094] Specifically, in the implementation scheme of the present application, the information auxiliary display device is connected to each image acquisition device to obtain a first image frame and each auxiliary image, and a correlation analysis is performed on the target lesion area and the target lesion description corresponding to the first image frame and the auxiliary lesion description, and the target lesion description and the target lesion area are updated to obtain more complete auxiliary enhancement information, that is.
[0095] Exemplarily, by aggregating the auxiliary lesion description and the target lesion description, the updated target lesion description and target lesion area contain the lesion information detected by the target user, thereby avoiding the need for the detector to view different devices and perform image analysis based on different image acquisition devices, thereby improving data integration efficiency.
[0096] S304: Generate auxiliary enhancement information according to the updated target lesion description and the target lesion area.
[0097] Furthermore, after obtaining the updated target lesion description and the target lesion area, the updated target lesion description and the target lesion area are further used to generate auxiliary enhancement information that can be enhanced for display, so as to correspond to the first image frame, or the detected user corresponding to the first image frame for enhanced display, thereby ensuring the comprehensiveness of the auxiliary enhancement information and improving the data integration efficiency between the various acquisition devices.
[0098] Further, on the basis of any of the above implementation schemes, the present application further provides a parallel auxiliary enhancement information display method. Specifically, in the implementation scheme of the present application, when the corresponding auxiliary enhancement information is displayed for the first image frame, an analysis request for the auxiliary image can be further responded to, and the auxiliary image can be auxiliary enhanced. The auxiliary image is specifically displayed, which includes the steps of:
[0099] (1) responding to an auxiliary image analysis request sent by a third device, feeding back the auxiliary image to the third device so that the third device displays the auxiliary image;
[0100] (2) determining, according to the updated target lesion description and the target lesion region, an auxiliary lesion region in the auxiliary image and a target lesion description corresponding to the auxiliary lesion region;
[0101] (3) Generate analysis enhancement information according to the auxiliary lesion area and the corresponding target lesion description, and display the analysis enhancement information corresponding to the auxiliary image.
[0102] Specifically, in the implementation scheme of the present application, when the corresponding auxiliary enhancement information is displayed for the first image frame, if the auxiliary image analysis request sent by the third device is received, the auxiliary image is sent to the third device for display. It can be understood that the third device can be an image acquisition device corresponding to the auxiliary image, or it can be the above-mentioned display device. It should be further explained that the display device can include multiple devices, that is, multiple analysts can analyze different images through different display devices (different images include the first image frame and the auxiliary image). Further, for the updated target lesion description and target lesion area, the auxiliary lesion area corresponding to the auxiliary image is determined (it can be converted by model recognition, or determined by area recognition, and is not specifically limited), that is, the auxiliary lesion area in the auxiliary image is determined according to the target lesion area in the first image frame, and the target lesion description corresponding to the auxiliary lesion area is determined. Further, according to the target lesion description, analysis enhancement information is generated, and the analysis enhancement information is displayed corresponding to the auxiliary image.
[0103] It can be understood that the analysis enhancement information in the implementation scheme of the present application is of the same type as the auxiliary enhancement information described in any of the above implementation schemes, that is, the generation and display method of the analysis enhancement information can refer to the implementation method of the generation and display of the auxiliary enhancement information described in any of the above implementation schemes.
[0104] In the implementation scheme of the present application, the medical imaging information corresponding to the target user can be aggregated to determine a comprehensive target lesion area and a corresponding target lesion description (updated). When analyzing any medical image, the comprehensive target lesion area and the corresponding target lesion description can be used to generate auxiliary enhancement information or analysis enhancement information corresponding to a certain image and displayed, so that the analyzing user can have a more comprehensive understanding of all the medical imaging test results of the user, thereby improving data processing efficiency and detection accuracy.
[0105] Further, based on any of the above implementations, the present application also provides an implementation scheme for assisting in enhancing information display, see Figure 4 , Figure 4 A schematic flow chart of one implementation scheme of assisting enhanced information display in the information auxiliary display method provided in the implementation scheme of the present application, specifically including steps S401-S403:
[0106] S401: Generate a projection image according to the auxiliary enhancement information.
[0107] S402: Determine projection position information corresponding to the target lesion area according to calibration information between the first device corresponding to the first image frame and the projection device, and internal reference information of the first device.
[0108] Specifically, in an embodiment of the present application, the information auxiliary display device is a projection device. The embodiment of the present application generates a projection image according to the auxiliary enhancement information, and determines the projection position information according to the internal reference information of the first device and the calibration information. Exemplarily, the image position corresponding to the target lesion area in the first image frame is converted to the world coordinate system according to the internal reference information of the first device, and the position information converted to the world coordinate system is converted to the position in the projector coordinate system according to the calibration information, so as to obtain the projection position information corresponding to the target lesion area.
[0109] S403: Project the projection image into the first image frame according to the projection position information.
[0110] Specifically, in the implementation scheme of the present application, after obtaining the projection position information corresponding to the target lesion area, the projection image corresponding to each lesion area is projected to the corresponding lesion area according to the projection position information corresponding to the target lesion area.
[0111] Furthermore, the present application also provides an auxiliary enhancement information display implementation scheme for different task processing types of the first image frame, which specifically includes the steps of:
[0112] (1) If the task processing type corresponding to the first image frame is a real-time monitoring type, obtaining a medical scene image frame acquired at an acquisition time corresponding to the first image frame, wherein the medical scene image frame includes a target user corresponding to the first image frame, and a scanning device that scans the target user to obtain the first image frame;
[0113] (2) determining a lesion auxiliary identification area in the medical scene image frame according to the location area of the scanning device in the medical scene image frame and the target lesion area;
[0114] (3) determining a projection identification image corresponding to the auxiliary lesion identification area and a projection position of the projection identification image according to calibration information between an acquisition device for acquiring the medical scene image frame and a projection device;
[0115] (4) Projecting the projection logo image to the projection position corresponding to the projection logo image, so as to display the projection logo image corresponding to the target user.
[0116] Specifically, in the implementation scheme of the present application, the task processing type corresponding to the first image frame is a real-time monitoring type, that is, the detector scans the person being detected (target user) through a scanning device, and generates a scanned image in real time to obtain a real-time first image frame, and simultaneously collects a medical scene image frame, and determines the image area in the medical scene image frame corresponding to the target lesion area in the first image frame as the lesion auxiliary identification area according to the position area of the scanning device corresponding to the target user scanned in the medical scene image frame, and the target lesion area in the first image frame obtained at the corresponding moment, and further, generates a projection identification image corresponding to the projection position according to the target lesion area and / or the target lesion description corresponding to the target lesion area, and displays the projection position corresponding to the projection identification image on the target user.
[0117] It is understandable that the projection identification image may be the same as the projection image in the above-mentioned embodiment, that is, the projection identification image includes the region identification corresponding to the target lesion region and the target lesion description; or the projection identification image may only include the region identification corresponding to the target lesion region. Specifically, in the embodiment of the present application, the projection identification image includes the region identification corresponding to the target lesion region. Exemplarily, the region identification may be a red circle. During the projection process, the red circle is projected on the target user at the projection position corresponding to the target lesion region.
[0118] Specifically, in one embodiment of the present application, the lesion auxiliary identification area in the medical scene image frame is determined based on the position area of the scanning device in the medical scene image frame and the target lesion area, including firstly determining the target sub-image of the medical scene image frame corresponding to the first image frame based on the position area of the scanning device in the medical scene image frame; and secondly, determining the lesion auxiliary identification area of the target lesion area in the target sub-image corresponding to the target lesion area based on the position correspondence between the target sub-image and the first image frame.
[0119] That is, the first image frame is a scanning result corresponding to the target sub-image, and further, a lesion auxiliary identification area corresponding to the target lesion area is identified in the target sub-image, and then the projection position is determined according to the lesion auxiliary identification area.
[0120] It can be understood that the projection identification image corresponding to the lesion auxiliary identification area is determined based on the calibration information between the acquisition device and the projection device that acquires the medical scene image frame, which is a conventional position conversion relationship. There is no specific limitation. For example, the image position of the lesion auxiliary identification area is first converted into the three-dimensional space position corresponding to the acquisition device by the internal parameter of the acquisition device corresponding to the medical scene image frame. Further, according to the calibration information between the acquisition device and the projection device, the three-dimensional space position is converted into the projection coordinate system. Further, the projection position can be determined according to the lesion auxiliary identification area in the projection coordinate system.
[0121] Specifically, in one embodiment of the present application, obtaining a first image frame to be processed, performing lesion analysis processing on the first image frame, and obtaining a target lesion area corresponding to the first image frame and a target lesion description corresponding to the target lesion area, specifically includes the steps of:
[0122] (1) in response to an auxiliary processing request sent by a first device, obtaining a first image frame corresponding to the auxiliary processing request;
[0123] (2) Performing lesion analysis on the first image frame using a lesion analysis model to obtain a target lesion region corresponding to the first image frame and a target lesion description corresponding to the target lesion region.
[0124] In the implementation manner of the present application, the first image frame is subjected to lesion analysis processing by utilizing a lesion analysis model to obtain a target lesion region corresponding to the first image frame and a target lesion description corresponding to the target lesion region. It can be understood that the lesion analysis model can have this function through training.
[0125] The implementation scheme of this application provides a variety of auxiliary enhanced information display methods, including:
[0126] Method 1: Different types of medical images on different display screens for the lesions of the same target user. According to the auxiliary information corresponding to the user (obtaining the auxiliary lesion description of the auxiliary image corresponding to the target user), the auxiliary information is projected to the lesion position on the doctor's display screen or a predetermined position on the screen, that is, obtaining the auxiliary lesion description of the auxiliary image corresponding to the target user, the auxiliary image including: images acquired based on the second device and / or images acquired based on the first device; according to the auxiliary lesion description and the target lesion description and correlation, the target lesion description and target lesion area are updated; according to the updated target lesion description and the target lesion area, auxiliary enhancement information is generated. For example, the doctor is observing the DSA image (first image frame) on the current screen and obtains a CT image that needs auxiliary observation. At this time, the projector projects the CT image corresponding to the lesion corresponding to the first image frame onto the DSA image (i.e., based on the auxiliary lesion description and the target lesion description and the correlation, the target lesion description and the target lesion area are updated; based on the updated target lesion description and the target lesion area, auxiliary enhancement information is generated, and the auxiliary enhancement information is displayed in the target lesion area corresponding to the first image frame).
[0127] Method 2: For the same patient (target user), the same lesion (different angles) or different physiological areas of the same image type are displayed on different display screens. The information displayed on other screens is used as auxiliary information and projected to the lesion position on the doctor's display screen or the predetermined position on the screen (i.e., auxiliary enhancement information and analysis enhancement information are displayed on different devices).
[0128] In some other embodiments of the present application, if the maximum parallel information enhancement processing corresponding to the information auxiliary display device has reached the maximum value, that is, different doctors (testers) can use the screen to do their own things, and the required auxiliary enhancement information or analysis enhancement information can be projected to different doctors in turn according to the order of request and waiting time.
[0129] This embodiment provides an information auxiliary display method, which obtains a first image frame to be processed, performs lesion analysis on the first image frame, obtains a target lesion area corresponding to the first image frame and a target lesion description corresponding to the target lesion area; for each target lesion area, generates auxiliary enhancement information according to the target lesion area and the target lesion description; and displays the auxiliary enhancement information in the target lesion area corresponding to the first image frame. This scheme performs lesion analysis on the acquired first image frame, generates auxiliary enhancement information corresponding to the target lesion area and the corresponding target lesion description obtained by analysis, and displays the auxiliary enhancement information in an auxiliary enhancement manner, abandoning the technical scheme in the traditional technical scheme that requires image observation of different devices to determine the lesion, thereby improving the efficiency of lesion determination, and at the same time displays the auxiliary enhancement information corresponding to the lesion in an enhanced display manner, thereby improving the lesion search performance and thus improving the image processing efficiency.
[0130] In order to better implement the information auxiliary display method in the embodiment of the present application, based on the information auxiliary display method, the embodiment of the present application also provides an information auxiliary display device, such as Figure 5 As shown, the information auxiliary display device includes modules 501-503:
[0131] An acquisition module 501 is used to acquire a first image frame to be processed, perform lesion analysis processing on the first image frame, and obtain a target lesion region corresponding to the first image frame and a target lesion description corresponding to the target lesion region;
[0132] A generating module 502, configured to generate auxiliary enhancement information for each target lesion region according to the target lesion region and the target lesion description;
[0133] The display module 503 is used to display the auxiliary enhancement information in the target lesion area corresponding to the first image frame.
[0134] In some embodiments of the present application, the generating module 502 is used to generate auxiliary enhancement information according to the target lesion area and the target lesion description, including:
[0135] Determining a target user corresponding to the first image frame according to processing information of a first device displaying the first image frame;
[0136] Acquire an auxiliary lesion description of an auxiliary image corresponding to the target user, where the auxiliary image includes: an image acquired based on a second device and / or an image acquired based on the first device;
[0137] According to the auxiliary lesion description and the target lesion description and the correlation, the target lesion description and the target lesion area are updated;
[0138] Auxiliary enhancement information is generated according to the updated target lesion description and the target lesion area.
[0139] In some embodiments of the present application, the display module 503 is further used for:
[0140] In response to the auxiliary image analysis request sent by the third device, feeding back the auxiliary image to the third device so that the third device displays the auxiliary image;
[0141] Determine, according to the updated target lesion description and the target lesion region, an auxiliary lesion region in the auxiliary image and a target lesion description corresponding to the auxiliary lesion region;
[0142] Analysis enhancement information is generated according to the auxiliary lesion area and the corresponding target lesion description, and the analysis enhancement information is displayed corresponding to the auxiliary image.
[0143] In some embodiments of the present application, the display module 503 is used to display the auxiliary enhancement information in the target lesion area corresponding to the first image frame, including:
[0144] generating a projection image according to the auxiliary enhancement information;
[0145] Determine projection position information corresponding to the target lesion area according to calibration information between the first device and the projection device corresponding to the first image frame, and internal reference information of the first device;
[0146] The projection image is projected into the first image frame according to the projection position information.
[0147] In some embodiments of the present application, the display module 503 is further used for:
[0148] If the task processing type corresponding to the first image frame is a real-time monitoring type, a medical scene image frame acquired at an acquisition time corresponding to the first image frame is acquired, wherein the medical scene image frame includes a target user corresponding to the first image frame, and a scanning device that scans the target user to obtain the first image frame;
[0149] Determine a lesion auxiliary identification area in the medical scene image frame according to the location area of the scanning device in the medical scene image frame and the target lesion area;
[0150] Determine the projection identification image corresponding to the auxiliary lesion identification area and the projection position of the projection identification image according to the calibration information between the acquisition device and the projection device for acquiring the medical scene image frame;
[0151] The projection logo image is projected to the projection position corresponding to the projection logo image, so as to display the projection logo image corresponding to the target user.
[0152] In some embodiments of the present application, the display module 503 is used to determine the lesion auxiliary identification area in the medical scene image frame according to the position area of the scanning device in the medical scene image frame and the target lesion area, including:
[0153] Determining, according to a location area of the scanning device in the medical scene image frame, a target sub-image of the medical scene image frame corresponding to the first image frame;
[0154] According to the position correspondence between the target sub-image and the first image frame, a lesion auxiliary identification area corresponding to the target lesion area in the target sub-image is determined.
[0155] In some embodiments of the present application, the acquisition module 501 is used to acquire a first image frame to be processed, perform lesion analysis on the first image frame, and obtain a target lesion area corresponding to the first image frame and a target lesion description corresponding to the target lesion area, including:
[0156] In response to the auxiliary processing request sent by the first device, obtaining a first image frame corresponding to the auxiliary processing request;
[0157] The first image frame is subjected to lesion analysis using a lesion analysis model to obtain a target lesion region corresponding to the first image frame and a target lesion description corresponding to the target lesion region.
[0158] This embodiment provides an information auxiliary display device, which is provided with an acquisition module for acquiring a first image frame to be processed, performing lesion analysis on the first image frame, and obtaining a target lesion area corresponding to the first image frame and a target lesion description corresponding to the target lesion area; a generation module for generating auxiliary enhancement information for each target lesion area according to the target lesion area and the target lesion description; and a display module for displaying the auxiliary enhancement information in the target lesion area corresponding to the first image frame. This scheme performs lesion analysis on the acquired first image frame, generates auxiliary enhancement information corresponding to the target lesion area and the corresponding target lesion description obtained by analysis, and displays the auxiliary enhancement information in an auxiliary enhancement manner, thereby abandoning the technical scheme in the traditional technical scheme that requires image observation of different devices to determine the lesion, thereby improving the efficiency of lesion determination, and at the same time displays the auxiliary enhancement information corresponding to the lesion in an enhanced display manner, thereby improving the lesion search performance, and thus improving the image processing efficiency.
[0159] Based on the above implementation scheme, the embodiment of the present invention also provides an information auxiliary display device, such as Figure 6 As shown, Figure 6 It is a schematic diagram of the structure of an embodiment of the information auxiliary display device provided in the embodiments of the present application.
[0160] Information auxiliary display devices include:
[0161] one or more processors;
[0162] Memory; and
[0163] One or more applications, wherein the one or more applications are stored in a memory and are configured to be executed by a processor to execute the steps of the information auxiliary display method in any of the above-mentioned information auxiliary display method embodiments.
[0164] Specifically, the information auxiliary display device may include one or more processing core processors 1001, one or more computer-readable storage media memories 1002, a power supply 1003, an input unit 1004 and other components. Those skilled in the art will understand that Figure 6 The information auxiliary display device structure shown in the figure does not constitute a limitation on the information auxiliary display device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.
[0165] The processor 1001 is the information auxiliary display center, which uses various interfaces and lines to connect various parts of the entire information auxiliary display device, and executes various functions and processes data of the information auxiliary display device by running or executing software programs and / or modules stored in the memory 1002, and calling data stored in the memory 1002, so as to monitor the information auxiliary display device as a whole. It can be understood that the processor 1001 transmits signals with the controller. Optionally, the processor 1001 may include one or more processing cores; preferably, the processor 1001 can integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc., and the modem processor mainly processes wireless communications. It can be understood that the above-mentioned modem processor may not be integrated into the processor 1001.
[0166] The memory 1002 can be used to store software programs and modules. The processor 1001 executes various functional applications and data processing by running the software programs and modules stored in the memory 1002. The memory 1002 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the information auxiliary display device, etc. In addition, the memory 1002 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 1002 may also include a memory controller to provide the processor 1001 with access to the memory 1002.
[0167] In some embodiments of the present application, the information auxiliary display device can be implemented in the form of a computer program. The computer program can be Figure 6 The information auxiliary display device is operated on the information auxiliary display device shown. The memory of the information auxiliary display device can store various program modules constituting the information auxiliary display method device, for example, Figure 5 The acquisition module 501, the generation module 502, and the display module 503 are shown. The computer program composed of various program modules enables the processor to execute the steps of the information auxiliary display method of each embodiment of the present application described in this specification.
[0168] For example, Figure 6 The information auxiliary display device shown can be Figure 5The acquisition module 501 in the information auxiliary display method device shown executes step S201. The information auxiliary display device can execute step S202 through the generation module 502. The information auxiliary display device can execute step S203 through the display module 503. The information auxiliary display device includes a processor, a memory and a network interface connected through a system bus. Among them, the processor of the information auxiliary display device is used to provide computing and control capabilities. The memory of the information auxiliary display device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the information auxiliary display device is used to communicate with an external information auxiliary display device through a network connection. When the computer program is executed by the processor, an information auxiliary display method is implemented.
[0169] The information auxiliary display device also includes a power supply 1003 for supplying power to various components. Preferably, the power supply 1003 can be logically connected to the processor 1001 through a power management system, so as to manage charging, discharging, and power consumption through the power management system. The power supply 1003 can also include any components such as one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, and power status indicators.
[0170] The information auxiliary display device may also include an input unit 1004, which can be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.
[0171] Although not shown, the information auxiliary display device may further include a display unit, etc., which will not be described in detail herein. Specifically in this embodiment, the processor 1001 in the information auxiliary display device will load the executable files corresponding to the processes of one or more application programs into the memory 1002 according to the following instructions, and the processor 1001 will run the application programs stored in the memory 1002, thereby realizing various functions, as follows:
[0172] Acquire a first image frame to be processed, perform lesion analysis processing on the first image frame, and obtain a target lesion region corresponding to the first image frame and a target lesion description corresponding to the target lesion region;
[0173] For each of the target lesion regions, generating auxiliary enhancement information according to the target lesion region and the target lesion description;
[0174] The auxiliary enhancement information is displayed in the target lesion area corresponding to the first image frame.
[0175] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.
[0176] To this end, an embodiment of the present invention provides a computer-readable storage medium (hereinafter referred to as a storage medium), which may include: a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, etc. A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps in any one of the information auxiliary display methods provided in the embodiments of the present invention. For example, the computer program may be loaded by a processor to execute the following steps:
[0177] Acquire a first image frame to be processed, perform lesion analysis processing on the first image frame, and obtain a target lesion region corresponding to the first image frame and a target lesion description corresponding to the target lesion region;
[0178] For each of the target lesion regions, generating auxiliary enhancement information according to the target lesion region and the target lesion description;
[0179] The auxiliary enhancement information is displayed in the target lesion area corresponding to the first image frame.
[0180] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the detailed description of other embodiments above, and will not be repeated here.
[0181] In specific implementation, the above units or structures can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation of the above units or structures can refer to the previous method embodiments, which will not be repeated here.
[0182] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.
[0183] The above is a detailed introduction to an information auxiliary display method, device, equipment and storage medium provided in the embodiments of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for technical personnel in this field, according to the idea of the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.
Claims
1. An information auxiliary display method, characterized in that: include: Acquire a first image frame to be processed, perform lesion analysis processing on the first image frame, and obtain a target lesion region corresponding to the first image frame and a target lesion description corresponding to the target lesion region; For each of the target lesion regions, generating auxiliary enhancement information according to the target lesion region and the target lesion description; The auxiliary enhancement information is displayed in the target lesion area corresponding to the first image frame.
2. The information auxiliary display method according to claim 1, characterized in that: The generating of auxiliary enhancement information according to the target lesion area and the target lesion description includes: Determining a target user corresponding to the first image frame according to processing information of a first device displaying the first image frame; Acquire an auxiliary lesion description of an auxiliary image corresponding to the target user, where the auxiliary image includes: an image acquired based on a second device and / or an image acquired based on the first device; According to the auxiliary lesion description and the target lesion description and the correlation, the target lesion description and the target lesion area are updated; Auxiliary enhancement information is generated according to the updated target lesion description and the target lesion area.
3. The information auxiliary display method according to claim 2, characterized in that: The method further comprises: In response to the auxiliary image analysis request sent by the third device, feeding back the auxiliary image to the third device so that the third device displays the auxiliary image; Determine, according to the updated target lesion description and the target lesion region, an auxiliary lesion region in the auxiliary image and a target lesion description corresponding to the auxiliary lesion region; Analysis enhancement information is generated according to the auxiliary lesion area and the corresponding target lesion description, and the analysis enhancement information is displayed corresponding to the auxiliary image.
4. The information auxiliary display method according to claim 1, characterized in that: The step of displaying the auxiliary enhancement information in the target lesion area corresponding to the first image frame includes: generating a projection image according to the auxiliary enhancement information; Determine projection position information corresponding to the target lesion area according to calibration information between the first device and the projection device corresponding to the first image frame, and internal reference information of the first device; The projection image is projected into the first image frame according to the projection position information.
5. The information auxiliary display method according to claim 1, characterized in that: The method further comprises: If the task processing type corresponding to the first image frame is a real-time monitoring type, a medical scene image frame acquired at an acquisition time corresponding to the first image frame is acquired, wherein the medical scene image frame includes a target user corresponding to the first image frame, and a scanning device that scans the target user to obtain the first image frame; Determine a lesion auxiliary identification area in the medical scene image frame according to the location area of the scanning device in the medical scene image frame and the target lesion area; Determine the projection identification image corresponding to the auxiliary lesion identification area and the projection position of the projection identification image according to the calibration information between the acquisition device and the projection device for acquiring the medical scene image frame; The projection logo image is projected to the projection position corresponding to the projection logo image, so as to display the projection logo image corresponding to the target user.
6. The information auxiliary display method according to claim 5, characterized in that: The determining, according to the location area of the scanning device in the medical scene image frame and the target lesion area, of the lesion auxiliary identification area in the medical scene image frame comprises: Determining, according to a location area of the scanning device in the medical scene image frame, a target sub-image of the medical scene image frame corresponding to the first image frame; According to the position correspondence between the target sub-image and the first image frame, a lesion auxiliary identification area corresponding to the target lesion area in the target sub-image is determined.
7. The information auxiliary display method according to any one of claims 1 to 6, characterized in that: The step of acquiring a first image frame to be processed, performing lesion analysis processing on the first image frame, and obtaining a target lesion region corresponding to the first image frame and a target lesion description corresponding to the target lesion region includes: In response to the auxiliary processing request sent by the first device, obtaining a first image frame corresponding to the auxiliary processing request; The first image frame is subjected to lesion analysis using a lesion analysis model to obtain a target lesion region corresponding to the first image frame and a target lesion description corresponding to the target lesion region.
8. An information auxiliary display device, characterized in that: The device comprises: an acquisition module, configured to acquire a first image frame to be processed, perform lesion analysis on the first image frame, and obtain a target lesion region corresponding to the first image frame and a target lesion description corresponding to the target lesion region; A generating module, configured to generate auxiliary enhancement information for each target lesion region according to the target lesion region and the target lesion description; A display module is used to display the auxiliary enhancement information in the target lesion area corresponding to the first image frame.
9. An electronic device, characterized in that: The electronic device comprises: one or more processors; Memory; and One or more application programs, wherein the one or more application programs are stored in the memory and are configured to be executed by the processor to implement the information auxiliary display method according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps in the information auxiliary display method according to any one of claims 1 to 7.
