Mark painting method and system based on browsing digital pathological image

Abstract

The invention provides a marking and painting method and system based on browsing of a digital pathological image, and the method comprises the steps: carrying out the analysis of a to-be-marked and painted digital pathological image displayed on a display interface of a browser, and obtaining an analysis result; based on the analysis result, constructing a mark painting mode list; and outputting the marking drawing mode list. According to the mark painting method based on browsing of the digital pathological image, the digital pathological image to be marked and painted is analyzed, and then the mark painting mode list is configured, so that a user can conveniently call the mark painting mode, simple and rapid mark painting is realized, and the digital pathological image processing efficiency of a doctor is improved.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a method and system for marking and painting based on browsing digital pathological images. Background Art

[0002] In the medical field, the development of digital pathology enables doctors to use digitized pathological images for disease diagnosis and research. Digital pathological images are usually stored in high-resolution image formats and contain detailed information about tissue structure, cell morphology, and lesion characteristics. However, simply observing and analyzing images may not fully discover and record doctors' observations and judgments.

[0003] Therefore, the marking and painting method has become an important tool in the analysis of digital pathology images. By marking and painting digital pathology images, doctors can accurately identify and mark areas of interest, lesion characteristics, cell structures, etc., and make detailed annotations and explanations. These marks can help doctors better understand the image content, guide disease diagnosis and treatment decisions, and support research and educational activities. The existing marking and painting methods at that time required doctors to have certain skills and expertise and might require cumbersome operating steps; how to achieve simple and fast marking and painting will help improve the efficiency of doctors in processing digital pathology images. Summary of the invention

[0004] One of the purposes of the present invention is to provide a method for marking and painting based on browsing digital pathology images, based on analyzing the digital pathology images to be marked and painted, and then configuring a list of marking and painting methods, so as to facilitate users to call the marking and painting methods, realize simple and fast annotation and painting, and help improve the doctor's processing efficiency of digital pathology images.

[0005] An embodiment of the present invention provides a method for marking and painting based on browsing a digital pathology image, comprising:

[0006] Analyze the digital pathological image to be marked and painted displayed on the display interface of the browser to obtain the analysis result;

[0007] Based on the analysis results, a list of marking methods is constructed;

[0008] Outputs a list of marker drawing modes.

[0009] Preferably, analyzing the digital pathological image to be marked and painted displayed on the display interface of the browser to obtain the analysis result includes:

[0010] Recognize the digital pathology image and determine the tissue number corresponding to the digital pathology image;

[0011] and / or;

[0012] Identify abnormal areas in digital pathology images and determine parameter information of abnormal areas;

[0013] and / or;

[0014] Identify the markers in the digital pathology image and determine the marker type and number;

[0015] and / or;

[0016] Determine the position parameters of the current display window in the digital pathology image.

[0017] Preferably, based on the analysis results, a list of marking methods is constructed, including:

[0018] Based on the organization number, a preset marking method determination library is queried to determine the marking method corresponding to the organization number;

[0019] Based on the determined marking and painting methods, a marking and painting method list is constructed;

[0020] and / or,

[0021] Based on the parameter information, determine the total number of marks corresponding to each mark painting method;

[0022] The list of marker painting methods is updated based on the marker type, marker quantity, and total number of markers.

[0023] Preferably, the method for marking and painting based on browsing digital pathology images further includes:

[0024] Get the user's historical marking record;

[0025] Build a quick call list based on historical marking records and marking method lists;

[0026] Based on the preset shortcut calling method, call each mark painting method in the shortcut calling list;

[0027] Among them, based on the historical marking record and the marking method list, a quick call list is constructed, including:

[0028] Parse the marking mode list to determine the current marking process;

[0029] Based on the analysis results, the historical marking records are screened to obtain the record data to be analyzed;

[0030] Parsing each record data to be analyzed, and determining a tag sequence parameter set corresponding to each record data to be analyzed;

[0031] Calculate the similarity between each marker sequence parameter set and each other marker sequence parameter set;

[0032] The parameter set of the labeled sequence with the largest sum of similarities is taken as the reference set;

[0033] Based on the current marking process, parameter values ​​corresponding to the marking painting method are extracted from the reference set and a shortcut call list is constructed based on the extracted parameter values.

[0034] Preferably, before marking, the marking method based on browsing the digital pathology image further includes:

[0035] When receiving the user's application for assistance, an assistance process selection interface is output;

[0036] Based on the process selected by the user in the auxiliary process selection interface, a marking painting method is determined and the determined marking painting method is placed first in the marking painting method list.

[0037] The present invention also provides a system for marking and painting based on browsing digital pathological images, comprising:

[0038] An analysis module is used to analyze the digital pathology image to be marked and painted displayed on the display interface of the browser to obtain the analysis result;

[0039] The first building module is used to build a list of marking painting methods based on the analysis results;

[0040] Output module, used to output the list of marked image modes.

[0041] Preferably, the analysis module analyzes the digital pathology image to be marked and painted displayed on the display interface of the browser, obtains the analysis result, and performs the following operations:

[0042] Recognize the digital pathology image and determine the tissue number corresponding to the digital pathology image;

[0043] and / or;

[0044] Identify abnormal areas in digital pathology images and determine parameter information of abnormal areas;

[0045] and / or;

[0046] Identify the markers in the digital pathology image and determine the marker type and number;

[0047] and / or;

[0048] Determine the position parameters of the current display window in the digital pathology image.

[0049] Preferably, the first construction module constructs a list of marking and painting methods based on the analysis results, and performs the following operations:

[0050] Based on the organization number, a preset marking method determination library is queried to determine the marking method corresponding to the organization number;

[0051] Based on the determined marking and painting methods, a marking and painting method list is constructed;

[0052] and / or,

[0053] Based on the parameter information, determine the total number of marks corresponding to each mark painting method;

[0054] The list of marker painting methods is updated based on the marker type, marker quantity, and total number of markers.

[0055] Preferably, the system for marking and painting based on browsing digital pathology images further includes:

[0056] The acquisition module is used to obtain the user's historical marking records;

[0057] The second building module is used to build a quick call list based on the historical marking records and the marking method list;

[0058] A quick call module is used to call each mark painting method in the quick call list based on a preset quick call method;

[0059] The second construction module constructs a quick call list based on the historical marking records and the marking method list, and performs the following operations:

[0060] Parse the marking mode list to determine the current marking process;

[0061] Based on the analysis results, the historical marking records are screened to obtain the record data to be analyzed;

[0062] Parsing each record data to be analyzed, and determining a tag sequence parameter set corresponding to each record data to be analyzed;

[0063] Calculate the similarity between each marker sequence parameter set and each other marker sequence parameter set;

[0064] The parameter set of the labeled sequence with the largest sum of similarities is taken as the reference set;

[0065] Based on the current marking process, parameter values ​​corresponding to the marking painting method are extracted from the reference set and a shortcut call list is constructed based on the extracted parameter values.

[0066] Preferably, before marking, the first building module further performs the following operations:

[0067] When receiving the user's application for assistance, an assistance process selection interface is output;

[0068] Based on the process selected by the user in the auxiliary process selection interface, a marking painting method is determined and the determined marking painting method is placed first in the marking painting method list.

[0069] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention can be realized and obtained by the structures particularly pointed out in the written description and the accompanying drawings.

[0070] The technical solution of the present invention is further described in detail below through the accompanying drawings and embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0071] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings:

[0072] Figure 1 A schematic diagram of a marking method based on browsing a digital pathology image in an embodiment of the present invention;

[0073] Figure 2 Schematic diagram of a system for marking and painting based on browsing digital pathology images in an embodiment of the present invention. DETAILED DESCRIPTION

[0074] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0075] The embodiment of the present invention provides a method for marking and painting based on browsing digital pathology images, such as Figure 1 As shown, including:

[0076] Step S1: Analyze the digital pathological image to be marked and painted displayed on the display interface of the browser to obtain the analysis result;

[0077] Step S2: constructing a list of marking methods based on the analysis results;

[0078] Step S3: Output a list of marking image modes.

[0079] The working principle and beneficial effects of the above technical solution are:

[0080] The method for marking and painting based on browsing digital pathology images of the present invention is based on analyzing the digital pathology images to be marked and painted, and then configuring a list of marking and painting methods, so that users can call the marking and painting methods conveniently, realize simple and fast marking and painting, and help improve the processing efficiency of digital pathology images by doctors.

[0081] In order to implement the analysis of the digital pathology image, in one embodiment, the digital pathology image to be marked and painted displayed on the display interface of the browser is analyzed to obtain the analysis result, including:

[0082] Identify the digital pathology image and determine the tissue number corresponding to the digital pathology image; match the digital pathology image with each standard tissue image in the standard tissue recognition library, and determine the digital pathology based on the tissue number corresponding to the matched standard tissue image;

[0083] and / or;

[0084] Identify the abnormal area of ​​the digital pathology image and determine the parameter information of the abnormal area; specifically, the digital pathology image can be first divided into blocks of preset sizes; each block is matched with each abnormal block stored in the abnormal block library to determine whether the segmented block is abnormal, and the area composed of the abnormal blocks in the digital pathology image is taken as the abnormal area, and the parameter information of the abnormal area includes: abnormal type (the type pre-configured in the abnormal block library corresponding to the abnormal block), the number of blocks in the area, the area of ​​the abnormal area, the shape of the abnormal area, etc.;

[0085] and / or;

[0086] Identify the marks in the digital pathology image and determine the mark type and the number of marks; mark identification is to identify the marks formed by the marks already marked in the digital pathology image to determine the state of the marks in the current digital pathology image;

[0087] and / or;

[0088] The position parameters of the current display window in the digital pathology image are determined. The position parameters are mainly the coordinates of the center of the display window on the coordinate axis corresponding to the digital pathology image.

[0089] In order to realize the construction of the mark painting method list, based on the analysis results, a mark painting method list is constructed, including:

[0090] Based on the organization number, query a preset marking method determination library to determine the marking method corresponding to the organization number; in the marking method determination library, the organization number corresponds to one or more marking methods and the quantity corresponding to each marking method;

[0091] Based on the determined marking and painting methods, a marking and painting method list is constructed;

[0092] and / or,

[0093] Based on the parameter information, determine the total number of marks corresponding to each mark painting method;

[0094] The list of marker painting methods is updated based on the marker type, marker quantity, and total number of markers.

[0095] In one embodiment, the method for marking and painting based on browsing a digital pathology image further includes:

[0096] Get the user's historical marking record;

[0097] Build a quick call list based on historical marking records and marking method lists;

[0098] Based on the preset shortcut calling method, call each mark painting method in the shortcut calling list;

[0099] Among them, based on the historical marking record and the marking method list, a quick call list is constructed, including:

[0100] Parse the marking mode list to determine the current marking process;

[0101] Based on the analysis results, the historical marking records are screened to obtain the record data to be analyzed;

[0102] Parsing each record data to be analyzed, and determining a tag sequence parameter set corresponding to each record data to be analyzed;

[0103] Calculate the similarity between each marker sequence parameter set and each other marker sequence parameter set;

[0104] The parameter set of the labeled sequence with the largest sum of similarities is taken as the reference set;

[0105] Based on the current marking process, parameter values ​​corresponding to the marking painting method are extracted from the reference set and a shortcut call list is constructed based on the extracted parameter values.

[0106] By comprehensively analyzing the user's historical marking records and determining a quick call list based on the current marking process, it is convenient for users to implement quick calls based on preset quick call methods, thereby improving the marking speed.

[0107] In order to implement a quick call of the marking mode when the user joins the assisting marking, in one embodiment, before marking, the marking method based on browsing the digital pathology image further includes:

[0108] When receiving the user's application for assistance, an assistance process selection interface is output;

[0109] Based on the process selected by the user in the auxiliary process selection interface, a marking painting method is determined and the determined marking painting method is placed first in the marking painting method list.

[0110] This embodiment aims at multiple people collaborating to mark and paint digital pathology images, that is, each person completes one or more painting tasks in the marking and painting process. The initiator constructs the marking and painting process, sets the number of people to complete each process, the operations that the people can perform, the flow method between the various processes, etc.; when the configuration of the assisting painting work is completed, the assisting task is issued, and other people can join in to assist, thereby realizing multi-person assistance and quickly completing the painting work.

[0111] In addition, the marking method corresponding to the previous process of the user's current process is placed in the second position of the marking method list and marked prominently in the upper right corner as a prompt, so that the user can check and fill in the gaps of the previous shared drawing. Among them, the prominent marking can be carried out in the form of marking the word "fill".

[0112] In one embodiment, when multiple people collaborate to mark and paint, when the mark corresponding to the process corresponding to the user has been marked on the digital pathology image, it is displayed in the digital pathology image in a highlighted manner to facilitate the user to confirm the mark corresponding to his process, and to facilitate the user to review and modify it.

[0113] In addition, it monitors the user's review and modification and generates modification records;

[0114] Analyze the modification records and determine the corresponding personnel information of the previous process;

[0115] Configure a credit value for the previous process personnel and set the credit value as the initial value;

[0116] Determine the credit adjustment object based on the previous process personnel information in the modification record;

[0117] Modify the record again to confirm the user's modification behavior;

[0118] Determine the adjustment value based on the modified behavior and a preset behavior and adjustment value correspondence table;

[0119] Based on the adjustment value, the credit value of the credit adjustment object is adjusted;

[0120] When the credit value of the personnel in the previous process exceeds the preset first threshold, the personnel is prohibited from operating the marking painting method belonging to the first threat level in the next process;

[0121] When the credit value of the personnel in the previous process exceeds the preset second threshold, they are prohibited from operating all marking and painting methods in the next process.

[0122] The steps for determining the marking method of the first threat level are as follows:

[0123] Parse the modification record and determine the marking method corresponding to the modification record;

[0124] Count the frequency of the marking method in the next process appearing in the modification record;

[0125] The marking patterns with a frequency greater than or equal to a preset threshold are used as marking patterns of the first threat level, those with a frequency of zero are set as marking patterns of the third threat level, and the rest are set as marking patterns of the second threat level.

[0126] This embodiment analyzes the user's pre-operation on the next process in collaboration and the next sharing person's approval of the operation of the previous process person, thereby limiting the pre-operation of the previous process person and improving the efficiency of collaboration.

[0127] The present invention also provides a system for marking and painting based on browsing digital pathological images, such as Figure 2 As shown, including:

[0128] Analysis module 1, used for analyzing the digital pathological image to be marked and painted displayed on the display interface of the browser to obtain the analysis result;

[0129] The first construction module 2 is used to construct a list of marking and painting methods based on the analysis results;

[0130] The output module 3 is used to output a list of marking image modes.

[0131] Preferably, the analysis module 1 analyzes the digital pathology image to be marked and painted displayed on the display interface of the browser, obtains the analysis result, and performs the following operations:

[0132] Recognize the digital pathology image and determine the tissue number corresponding to the digital pathology image;

[0133] and / or;

[0134] Identify abnormal areas in digital pathology images and determine parameter information of abnormal areas;

[0135] and / or;

[0136] Identify the markers in the digital pathology image and determine the marker type and number;

[0137] and / or;

[0138] Determine the position parameters of the current display window in the digital pathology image.

[0139] Preferably, the first construction module 2 constructs a list of marking and painting methods based on the analysis results, and performs the following operations:

[0140] Based on the organization number, a preset marking method determination library is queried to determine the marking method corresponding to the organization number;

[0141] Based on the determined marking and painting methods, a marking and painting method list is constructed;

[0142] and / or,

[0143] Based on the parameter information, determine the total number of marks corresponding to each mark painting method;

[0144] The list of marker painting methods is updated based on the marker type, marker quantity, and total number of markers.

[0145] Preferably, the system for marking and painting based on browsing digital pathology images further includes:

[0146] The acquisition module is used to obtain the user's historical marking records;

[0147] The second building module is used to build a quick call list based on the historical marking records and the marking method list;

[0148] A quick call module is used to call each mark painting method in the quick call list based on a preset quick call method;

[0149] The second construction module constructs a quick call list based on the historical marking records and the marking method list, and performs the following operations:

[0150] Parse the marking mode list to determine the current marking process;

[0151] Based on the analysis results, the historical marking records are screened to obtain the record data to be analyzed;

[0152] Parsing each record data to be analyzed, and determining a tag sequence parameter set corresponding to each record data to be analyzed;

[0153] Calculate the similarity between each marker sequence parameter set and each other marker sequence parameter set;

[0154] The parameter set of the labeled sequence with the largest sum of similarities is taken as the reference set;

[0155] Based on the current marking process, parameter values ​​corresponding to the marking painting method are extracted from the reference set and a shortcut call list is constructed based on the extracted parameter values.

[0156] Preferably, before marking, the first building module further performs the following operations:

[0157] When receiving the user's application for assistance, an assistance process selection interface is output;

[0158] Based on the process selected by the user in the auxiliary process selection interface, a marking painting method is determined and the determined marking painting method is placed first in the marking painting method list.

[0159] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. A method for marking and painting based on browsing digital pathological images, characterized in that: include: Analyzing the digital pathological image to be marked and painted displayed on the display interface of the browser; Based on the analysis results, a list of marking methods is constructed and output.

2. The method for marking and painting based on browsing digital pathological images as claimed in claim 1, characterized in that: Analysis of digital pathology images includes: Perform tissue identification and determine the tissue number corresponding to the digital pathology image.

3. The method for marking and painting based on browsing digital pathological images as claimed in claim 1, characterized in that: Analysis of digital pathology images includes: Identify abnormal areas and determine parameter information of abnormal areas.

4. The method for marking and painting based on browsing digital pathological images as claimed in claim 1, characterized in that: Analysis of digital pathology images includes: Perform tissue identification and determine the tissue number corresponding to the digital pathology image; Identify abnormal areas and determine parameter information of abnormal areas; Perform mark recognition to determine the mark type and the number of marks; Determine the position parameters of the current display window in the digital pathology image.

5. The method for marking and painting based on browsing digital pathological images as claimed in claim 4, characterized in that: The list of marker painting methods is constructed as follows: According to the organization number, a preset marking and painting method determination library is searched to determine the marking and painting method corresponding to the organization number; According to the determined marking method, a marking method list is constructed.

6. A system for marking and painting based on browsing digital pathology images, characterized in that: include: An analysis module, a first construction module and an output module; wherein the analysis module analyzes the digital pathology image to be marked and painted displayed on the display interface of the browser; the first construction module constructs a marking and painting method list based on the analysis results; and the output module outputs the marking and painting method list.

7. The system for marking and painting based on browsing digital pathological images as claimed in claim 6, characterized in that: The analysis module performs the following operations: Perform tissue identification and determine the tissue number corresponding to the digital pathology image.

8. The system for marking and painting based on browsing digital pathological images as claimed in claim 6, characterized in that: The analysis module performs the following operations: Identify abnormal areas and determine parameter information of abnormal areas.

9. The system for marking and painting based on browsing digital pathological images as claimed in claim 6, characterized in that: The analysis module performs the following operations: Perform tissue identification and determine the tissue number corresponding to the digital pathology image; Identify abnormal areas and determine parameter information of abnormal areas; Perform mark recognition to determine the mark type and the number of marks; Determine the position parameters of the current display window in the digital pathology image.

10. The system for marking and painting based on browsing digital pathological images as claimed in claim 9, characterized in that: The first building block performs the following operations: According to the organization number, a preset marking and painting method determination library is searched to determine the marking and painting method corresponding to the organization number; According to the determined marking method, a marking method list is constructed.

Images