Display method and device of focus area and computer equipment

Abstract

The invention relates to a focus area display method and device, computer equipment and a storage medium. The method comprises the steps of obtaining a plurality of focus areas of a to-be-displayed object; the plurality of focus areas comprise a focus area of a primary organ, a focus area of at least one metastatic organ and focus areas of other organs; according to the sequence of the primary organs, the metastatic organs and other organs from high to low, sorting the plurality of focus areas to obtain a display sequence; the grade of the primary organ is higher than that of the metastatic organ, and the grade of the metastatic organ is higher than that of other organs; and displaying the plurality of focus areas in the display area of the current interface according to the display sequence. By adopting the method, the display accuracy can be improved when the focus areas are sequenced and displayed.

Description

Technical Field

[0001] This application relates to the field of medical technology, and particularly to a method, apparatus, and computer device for displaying lesion regions. Background Art

[0002] With the development of medical technology, the segmented lesion regions can be displayed in a certain order for doctors to view the regions where the lesion regions are located.

[0003] Currently, the lesion regions can be sorted based on anatomical structures and displayed in sequence according to the sorting results.

[0004] However, the current method of sorting and displaying lesion regions based on anatomical structures has the problem of inaccurate display. Summary of the Invention

[0005] Based on this, it is necessary to provide a method, apparatus, computer device, and storage medium for displaying lesion regions that can improve the display accuracy in view of the above technical problems.

[0006] In a first aspect, this application provides a method for displaying lesion regions, including:

[0007] Obtaining multiple lesion regions of an object to be displayed; the multiple lesion regions include lesion regions of a primary organ, lesion regions of at least one metastatic organ, and lesion regions of other organs;

[0008] Sorting the multiple lesion regions according to the order from high to low of the grades of the primary organ, the metastatic organ, and the other organs to obtain a display order; the grade of the primary organ is higher than that of the metastatic organ, and the grade of the metastatic organ is higher than that of the other organs;

[0009] Displaying the multiple lesion regions within a display area of the current interface according to the display order.

[0010] In one embodiment, the multiple lesion regions include lesion regions of multiple metastatic organs, and the step of sorting the multiple lesion regions according to the order from high to low of the grades of the primary organ, the metastatic organ, and the other organs to obtain a display order includes:

[0011] Determining the grades of the metastatic organs according to the distance values between the metastatic organs and the primary organ;

[0012] Sorting the multiple lesion regions according to the order from high to low of the grades of the primary organ, the multiple metastatic organs, and the other organs to obtain the display order.

[0013] In one embodiment, the multiple lesion regions include lesion regions of multiple other organs. Sorting the multiple lesion regions according to the descending order of the grades of the primary organ, the metastatic organ, and the other organs to obtain a display order includes:

[0014] Determining the grades of the other organs according to the anatomical structure of the object to be displayed;

[0015] Sorting the multiple lesion regions according to the descending order of the grades of the primary organ, the metastatic organ, and the multiple other organs to obtain the display order.

[0016] In one embodiment, the method further includes:

[0017] Determining the primary organ according to the registration information of the object to be displayed;

[0018] Determining the metastatic organ associated with the primary organ according to the association relationship between organs.

[0019] In one embodiment, determining the primary organ according to the registration information of the object to be displayed includes:

[0020] Determining and displaying candidate primary organs on the current interface according to the registration information of the object to be displayed;

[0021] Responding to a confirmation instruction generated by the user's touch on the current interface to determine whether the type of the candidate primary organ is accurate; if the confirmation instruction indicates that the type of the candidate primary organ is accurate, determining the candidate primary organ as the primary organ; if the confirmation instruction indicates that the type of the candidate primary organ is inaccurate, responding to an input instruction generated by the user's touch on the current interface and determining the organ indicated by the input instruction as the primary organ.

[0022] In one embodiment, the method further includes:

[0023] Obtaining a segmented image of the primary organ of the object to be displayed and a segmented image of the metastatic organ of the object to be displayed;

[0024] The displaying the multiple lesion regions in the display area of the current interface according to the display order includes:

[0025] Displaying the multiple lesion regions in the display area of the current interface according to the display order, and displaying the segmented image of the primary organ and the segmented image of the metastatic organ on the current interface.

[0026] In one embodiment, the display area includes a first area and a second area. Displaying the multiple lesion areas in the display area of the current interface according to the display order includes:

[0027] Displaying the multiple lesion areas in the first area according to the display order;

[0028] Displaying a list of organs corresponding to the multiple lesion areas in the second area.

[0029] In one embodiment, the method further includes:

[0030] In response to a click instruction generated by a user's touch in the second area, performing a marked display on the lesion area and / or organ indicated by the click instruction in the first area.

[0031] In a second aspect, the present application further provides a display device for lesion areas, including:

[0032] An acquisition module, configured to acquire multiple lesion areas of an object to be displayed; the multiple lesion areas include lesion areas of a primary organ, lesion areas of at least one metastatic organ, and lesion areas of other organs;

[0033] A sorting module, configured to sort the multiple lesion areas according to the order from high to low of the ranks of the primary organ, the metastatic organ, and the other organs, to obtain a display order; the rank of the primary organ is higher than the rank of the metastatic organ, and the rank of the metastatic organ is higher than the rank of the other organs;

[0034] A display module, configured to display the multiple lesion areas in the display area of the current interface according to the display order.

[0035] In a third aspect, the present application further provides a computer device. The computer device includes a memory and a processor. The memory stores a computer program, and when the processor executes the computer program, the steps of the method in any one of the embodiments in the first aspect are implemented.

[0036] In a fourth aspect, the present application further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method in any one of the embodiments in the first aspect are implemented.

[0037] In a fifth aspect, the present application further provides a computer program product. The computer program product includes a computer program, and when the computer program is executed by a processor, the steps of the method in any one of the embodiments in the first aspect are implemented.

[0038] The above display method, device, computer device and storage medium for lesion regions obtain multiple lesion regions of an object to be displayed; the multiple lesion regions include lesion regions of the primary organ, lesion regions of at least one metastatic organ, and lesion regions of other organs; sort the multiple lesion regions according to the order from high to low of the levels of the primary organ, metastatic organ and other organs to obtain a display order; the level of the primary organ is higher than that of the metastatic organ, and the level of the metastatic organ is higher than that of the other organs; display the multiple lesion regions within the display area of the current interface according to the display order. In this application, the multiple lesion regions can be sorted according to the order of the primary organ, metastatic organ and other organs from first to last to obtain a display order, and the multiple lesion regions are displayed within the display area of the current interface according to this display order. Since the prediction accuracy of the lesion regions located on the primary organ and metastatic organ is relatively high, therefore, arranging the lesion regions with higher prediction accuracy in the front for display can enable the doctor to see the lesion regions with accurate prediction first. Thus, when sorting and displaying the lesion regions, the accuracy of display can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the following will briefly introduce the drawings required for use in the description of the embodiments or related technologies. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0040] Figure 1 It is an application environment diagram of the display method for lesion regions in an embodiment;

[0041] Figure 2 It is a flowchart of the display method for lesion regions in an embodiment;

[0042] Figure 3 It is a flowchart of the sorting step in an embodiment;

[0043] Figure 4 It is a flowchart of the process for determining the primary organ and metastatic organ in another embodiment;

[0044] Figure 5 It is a flowchart of the process for sorting and displaying the lesion regions in an embodiment;

[0045] Figure 6 It is a schematic diagram of the interface for displaying the first region and the second region in an embodiment;

[0046] Figure 7 It is a block diagram of the display device for lesion regions in an embodiment. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0047] In order to make the objectives, technical solutions and advantages of the present application more clear and understandable, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0048] With the development of medical technology, a lesion area segmentation algorithm can be used to implement lesion area segmentation, and the segmented lesion areas can be displayed in a certain order to facilitate doctors to view the areas where the lesion areas are located. Therefore, it is necessary to sort each lesion area.

[0049] Currently, the lesion areas can be sorted based on the anatomical structure, and the lesion areas can be displayed in sequence according to the sorting result. Among them, the anatomical structure can be "head, neck, chest, abdomen, pelvis", that is, the segmented lesion areas are sorted according to "head, neck, chest, abdomen, pelvis". However, the current method of sorting and displaying the lesion areas based on the anatomical structure not only does not conform to the diagnosis and treatment habits of most doctors; moreover, since currently, in order to predict the true lesion areas as comprehensively as possible, usually more false lesion areas will be segmented. Therefore, the accuracy of lesion area prediction will be reduced. Thus, when sorting the lesion areas based on the anatomical structure, the mispredicted lesion areas may be ranked in the front, while the accurately predicted lesion areas may be ranked in the back. Furthermore, using the above sorting method will cause doctors to see the mispredicted lesion areas first. Therefore, the current method of sorting and displaying the lesion areas based on the anatomical structure has the problem of inaccurate display. In addition, when doctors view a certain number of mispredicted lesion areas in the order obtained by the above sorting method, the trust in the lesion area segmentation algorithm by doctors will also be reduced.

[0050] After the background technology of the lesion area display method provided in the embodiments of the present application is introduced above, below, the implementation environment involved in the lesion area display method provided in the embodiments of the present application will be briefly described. The lesion area display method provided in the embodiments of the present application can be applied to, for example Figure 1In the computer device shown. The computer device can be a terminal or a server. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit, and an input device. Among them, the processor, the memory, and the input / output interface are connected through a system bus, and the communication interface, the display unit, and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and external devices. The communication interface of the computer device is used to communicate with external terminals in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (Near Field Communication), or other technologies. The computer program, when executed by the processor, implements a data processing method. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer covering the display screen, or a button, a trackball, or a touchpad provided on the housing of the computer device, or an external keyboard, touchpad, or mouse, etc.

[0051] Those skilled in the art can understand that Figure 1 the structure shown in is only a block diagram of some structures related to the solution of this application, and does not constitute a limitation on the computer device to which the solution of this application is applied. A specific terminal may include more or fewer components than those shown in the figure, or combine some components, or have a different component layout.

[0052] In an embodiment, as Figure 2 shown, a method for displaying a lesion area is provided. Taking the method applied to the Figure 1 computer device in as an example, it includes the following steps:

[0053] S201, obtain multiple lesion areas of the object to be displayed; the multiple lesion areas include the lesion area of the primary organ, the lesion areas of at least one metastatic organ, and the lesion areas of other organs.

[0054] Among them, the object to be displayed refers to an object that has been segmented into multiple lesion regions. The object to be displayed may include, but is not limited to, a patient or an object to be scanned, etc. The multiple lesion regions include the lesion regions of the primary organ, the lesion regions of at least one metastatic organ, and the lesion regions of other organs. The primary organ refers to the organ or tissue where the lesion first occurred. The metastatic organ refers to the organ or tissue that has become diseased after metastasizing from the primary organ along the metastatic path of malignant tumors. Other organs refer to the organs of the object to be displayed other than the primary organ and the metastatic organs.

[0055] In the embodiments of the present application, the computer device may use a preset segmentation algorithm to segment the lesion regions in the medical image of the object to be displayed, and obtain multiple lesion regions of the segmented object to be displayed. Among them, the medical image of the object to be displayed may include, but is not limited to, PET (positron emission tomography) images, CT (computed tomography) images, etc. The preset segmentation algorithm may be any deep learning algorithm, and the embodiments of the present application do not limit the preset segmentation algorithm. It should be noted that each lesion region corresponds to an organ of the object to be displayed, and the organs corresponding to each lesion region may be the same, or the organs corresponding to each lesion region may also be different. That is, it can be understood that, by way of example, organ 1 may correspond to lesion region 1 and lesion region 2, and the organs include the primary organ, at least one metastatic organ, and other organs.

[0056] S202, sort the multiple lesion regions according to the order from high to low of the grades of the primary organ, the metastatic organ, and the other organs, to obtain the display order; the grade of the primary organ is higher than the grade of the metastatic organ, and the grade of the metastatic organ is higher than the grade of the other organs.

[0057] In the embodiments of the present application, it should be noted that common malignant tumors or cancers may include, but are not limited to, lung cancer, gastric cancer, liver cancer, esophageal cancer, colorectal cancer, pancreatic cancer, breast cancer, brain cancer, leukemia (blood cancer), lymphoma, etc. Since different types of cancers generally metastasize along fixed paths corresponding to each type, the computer device can pre-determine the primary organ, at least one metastatic organ, and other organs corresponding to each cancer type, and sort multiple lesion regions according to the order of the levels of the primary organ, at least one metastatic organ, and other organs from high to low to obtain the display order. Among them, the level of the primary organ is higher than that of the metastatic organ, and the level of the metastatic organ is higher than that of other organs. Such sorting not only conforms to the doctor's habit, but also can ensure that the prediction accuracy of the lesion regions located on the primary organ and the metastatic organ is relatively high, and the lesion regions with higher prediction accuracy are arranged in the front, so that the doctor can see the lesion regions with accurate prediction first, and can also improve the doctor's trust in the preset segmentation algorithm. In addition, the cancer can be further staged by TNM (tumor node metastasis classification) according to the lesion regions corresponding to the primary organ and the metastatic organ.

[0058] Optionally, since there can be one or more metastatic organs, the levels of the metastatic organs can be the same; or, the levels of the metastatic organs can also be different. Exemplarily, the levels of the metastatic organs can be set according to the metastatic path corresponding to the cancer type. Optionally, since there can be one or more other organs, the levels of the other organs can be random; or, the levels of the other organs can also be the same; or, the levels of the other organs can also be sorted according to the anatomical structure. Of course, the embodiments of the present application do not limit the specific level sorting of the metastatic organs and other organs.

[0059] S203. Display multiple lesion regions in the display area of the current interface according to the display order.

[0060] In the embodiments of the present application, the computer device can display multiple lesion regions in the display area of the current interface according to the display order, that is, it can be understood that the computer device can display multiple lesion regions in the display area of the current interface according to the display order of the primary organ, at least one metastatic organ, and other organs from first to last. Since the prediction accuracy of the lesion regions located on the primary organ and the metastatic organ is relatively high, arranging the lesion regions with higher prediction accuracy in the front can enable the doctor to see the lesion regions with accurate prediction first. Among them, the current interface is the interface in the computer device, and the current interface includes a display area.

[0061] Optionally, for each metastatic organ, if the grades of the metastatic organs are the same, then after displaying the primary organ, each metastatic organ can be displayed simultaneously; if the grades of the metastatic organs are different, then after displaying the primary organ, each metastatic organ can be displayed according to the grades of the metastatic organs. Optionally, for each other organ, if the grades of the other organs are random, then after all the metastatic organs are displayed, each other organ can be randomly displayed; if the grades of the other organs are the same, then after all the metastatic organs are displayed, each other organ can be displayed simultaneously; if the grades of the other organs are ranked according to the anatomical structure, then after all the metastatic organs are displayed, each other organ can be displayed in the order of the anatomical structure.

[0062] In the above method for displaying the lesion area, multiple lesion areas of the object to be displayed are obtained; the multiple lesion areas include the lesion area of the primary organ, the lesion areas of at least one metastatic organ, and the lesion areas of other organs; according to the order from high to low of the grades of the primary organ, the metastatic organs, and the other organs, the multiple lesion areas are sorted to obtain the display order; the grade of the primary organ is higher than the grade of the metastatic organ, and the grade of the metastatic organ is higher than the grade of the other organ; the multiple lesion areas are displayed in the display area of the current interface according to the display order. In this application, the multiple lesion areas can be sorted according to the order of the primary organ, the metastatic organs, and the other organs from first to last to obtain the display order, and the multiple lesion areas are displayed in the display area of the current interface according to this display order. Since the prediction accuracy of the lesion areas located on the primary organ and the metastatic organs is relatively high, therefore, the lesion areas with higher prediction accuracy are ranked in the front for display, which enables the doctor to see the lesion areas with accurate prediction first. Thus, the accuracy of the display can be improved when sorting and displaying the lesion areas.

[0063] In one embodiment, the above multiple lesion areas include the lesion areas of multiple metastatic organs. Based on this, as Figure 3 shown, an implementation method for obtaining the display order is provided, that is, the "sorting the multiple lesion areas according to the order from high to low of the grades of the primary organ, the metastatic organs, and the other organs to obtain the display order" in S202 above includes:

[0064] S301, determining the grades of the metastatic organs according to the distance values between the metastatic organs and the primary organ.

[0065] In the embodiments of the present application, since multiple lesion regions include lesion regions of multiple metastatic organs, the computer device can determine the distance values between each metastatic organ and the primary organ, and determine the grades of each metastatic organ according to the distance values between each metastatic organ and the primary organ. Optionally, the computer device can determine the grades of each metastatic organ from high to low according to the ascending order of the distance values between each metastatic organ and the primary organ. That is, it can be understood that the smaller the distance value between the metastatic organ and the primary organ, the higher the grade of the metastatic organ. Alternatively, the computer device can also pre-set multiple distance intervals, and set the same grade for the metastatic organs in the same distance interval, and if the distance value between any position in the distance interval and the primary organ is farther, the grade of the distance interval is lower.

[0066] Exemplarily, assume that distance interval 1 is that the distance value d1 from the position where the primary organ is located is in the range of 0 < d1 < 10 cm, distance interval 2 is that the distance value d2 from the position where the primary organ is located is in the range of 10 ≤ d2 < 20 cm, and distance interval 3 is that the distance value d3 from the position where the primary organ is located is in the range of 20 ≤ d3 < 30 cm. Then the grades of the metastatic organs in distance interval 1 are the same, the grades of the metastatic organs in distance interval 2 are the same, the grades of the metastatic organs in distance interval 3 are the same, and the grade of the metastatic organs in distance interval 1 is higher than the grade of the metastatic organs in distance interval 2, and the grade of the metastatic organs in distance interval 2 is higher than the grade of the metastatic organs in distance interval 3.

[0067] S302. Sort the multiple lesion regions according to the descending order of the grades of the primary organ, the multiple metastatic organs, and other organs to obtain the display order.

[0068] In the embodiments of the present application, after determining the grades of each metastatic organ, the computer device can sort the multiple lesion regions according to the descending order of the grades of the primary organ, the multiple metastatic organs, and other organs to obtain the display order. Exemplarily, if the smaller the distance value between the metastatic organ and the primary organ, the higher the grade of the metastatic organ, the computer device can determine the descending order of the grades as: the primary organ, the metastatic organ with a small distance value from the primary organ, the metastatic organ with a large distance value from the primary organ, and other organs. Thus, it can be determined that the display order of the multiple lesion regions from first to last is: the lesion region corresponding to the primary organ, the lesion region corresponding to the metastatic organ with a small distance value from the primary organ, the lesion region corresponding to the metastatic organ with a large distance value from the primary organ, and the lesion region corresponding to other organs.

[0069] In this embodiment, according to the distance values between each metastatic organ and the primary organ, the grades of each metastatic organ are determined; according to the grades of the primary organ, multiple metastatic organs, and other organs from high to low, the multiple lesion regions are sorted to obtain the display order. It is possible to accurately determine the grades of each metastatic organ according to the distance values between each metastatic organ and the primary organ, so that the lesion regions with higher prediction accuracy can be ranked in the front for display, enabling the doctor to see the lesion regions with accurate predictions first. Therefore, when sorting and displaying the lesion regions, the display accuracy can be improved.

[0070] In one embodiment, the above-mentioned multiple lesion regions include lesion regions of multiple other organs. Based on this, an implementation manner for obtaining the display order is provided, that is, the "sorting the multiple lesion regions according to the grades of the primary organ, metastatic organs, and other organs from high to low to obtain the display order" in S202 above includes:

[0071] Determine the grades of each other organ according to the anatomical structure of the object to be displayed.

[0072] Sort the multiple lesion regions according to the grades of the primary organ, metastatic organs, and multiple other organs from high to low to obtain the display order.

[0073] In the embodiment of the present application, since the multiple lesion regions include lesion regions of multiple other organs, the computer device can pre-determine the anatomical structure of the object to be displayed and determine the grades of each other organ according to the anatomical structure of the object to be displayed. Then, the computer device can sort the multiple lesion regions according to the grades of the primary organ, at least one metastatic organ, and multiple other organs from high to low to obtain the display order. Exemplarily, assuming the anatomical structure is "head, neck, chest, abdomen, pelvis", the order of the grades of multiple other organs from high to low can be determined as: head, neck, chest, abdomen, pelvis. Thus, the display order of the multiple lesion regions from first to last can be determined as: the lesion region corresponding to the primary organ, the lesion region corresponding to at least one metastatic organ, the lesion region corresponding to the head, the lesion region corresponding to the neck, the lesion region corresponding to the chest, the lesion region corresponding to the abdomen, and the lesion region corresponding to the pelvis.

[0074] In this embodiment, the grades of each other organ can be accurately determined according to the anatomical structure of the object to be displayed, and the multiple lesion regions can be sorted according to the grades of the primary organ, metastatic organs, and multiple other organs from high to low to obtain the display order, so that the lesion regions with higher prediction accuracy can be ranked in the front for display, enabling the doctor to see the lesion regions with accurate predictions first. Therefore, when sorting and displaying the lesion regions, the display accuracy can be improved.

[0075] In one embodiment, asFigure 4 As shown, an implementation method for determining the primary organ and the metastatic organ is provided. The method for displaying the above-mentioned lesion area further includes:

[0076] S401. Determine the primary organ according to the registration information of the object to be displayed.

[0077] Among them, the registration information refers to the diagnosis and treatment information of the object to be displayed. The registration information may include, but is not limited to, the medical record of the object to be displayed, the historical drug purchase record of the object to be displayed, etc. In the embodiment of the present application, optionally, the computer device may automatically determine the cancer type of the object to be displayed according to the registration information of the object to be displayed, and automatically determine the primary organ according to the cancer type of the object to be displayed; or, the computer device may also display the registration information of the object to be displayed and all the primary organs on the current interface, so that the user can select the primary organ of the object to be displayed from all the primary organs according to the registration information of the object to be displayed, trigger the generation of a screening instruction, and send the screening instruction to the computer device. Thus, the computer device may determine the primary organ of the object to be displayed according to the received screening instruction.

[0078] In one embodiment, S401 includes:

[0079] Determine and display candidate primary organs on the current interface according to the registration information of the object to be displayed.

[0080] Respond to the confirmation instruction generated by the user's trigger on the current interface, and determine whether the type of the candidate primary organ is accurate; if the confirmation instruction indicates that the type of the candidate primary organ is accurate, determine the candidate primary organ as the primary organ; if the confirmation instruction indicates that the type of the candidate primary organ is inaccurate, respond to the input instruction generated by the user's trigger on the current interface, and determine the organ indicated by the input instruction as the primary organ.

[0081] Among them, the candidate primary organ refers to the primary organ automatically determined by the computer device, and there may be a problem of inaccuracy in the candidate primary organ. The confirmation instruction refers to an instruction generated by the user's trigger and used to indicate whether the type of the candidate primary organ is accurate. The input instruction refers to an instruction generated by the user's trigger and used to select the primary organ. Optionally, the input instruction may be an instruction to select the primary organ from multiple organs; or the input instruction may also be an instruction to directly input the organ name or code.

[0082] In the embodiments of the present application, the computer device can automatically determine the cancer type of the object to be displayed according to the registration information of the object to be displayed, thereby automatically determining the candidate primary organ according to the cancer type of the object to be displayed, and displaying the candidate primary organ and the registration information of the object to be displayed on the current interface. After that, the user can view the candidate primary organ and the registration information of the object to be displayed on the current interface, and determine whether the type of the candidate primary organ is accurate, thereby triggering the generation of a confirmation instruction according to whether the type of the candidate primary organ determined is accurate, and sending the confirmation instruction to the computer device. The computer device can determine whether the type of the candidate primary organ is accurate in response to the confirmation instruction triggered and generated by the user on the current interface. If the confirmation instruction indicates that the type of the candidate primary organ is accurate, the computer device can determine the candidate primary organ as the primary organ; if the confirmation instruction indicates that the type of the candidate primary organ is inaccurate, the computer device can display the registration information of the object to be displayed on the current interface, so that the user can determine the primary organ of the object to be displayed according to the registration information of the object to be displayed, trigger the generation of an input instruction, and send the input instruction to the computer device. Thus, the computer device can respond to the input instruction triggered and generated by the user on the current interface, and determine the organ indicated by the input instruction as the primary organ of the object to be displayed.

[0083] S402. Determine the metastatic organs associated with the primary organ according to the association relationship between the organs.

[0084] Based on the above embodiments, it can be known that different types of cancers basically metastasize along the fixed paths corresponding to each type. Therefore, each cancer type can correspond to a primary organ, at least one metastatic organ, and other organs. Thus, there is an association relationship between the primary organ corresponding to the cancer type and at least one metastatic organ. In the embodiments of the present application, the computer device can pre-store the association relationship between the primary organ corresponding to each cancer type and at least one metastatic organ, and determine the metastatic organs associated with the primary organ according to the association relationship between the primary organ corresponding to each cancer type and at least one metastatic organ described above.

[0085] In this embodiment, the primary organ can be determined more accurately according to the registration information of the object to be displayed, and the metastatic organs associated with the more accurate primary organ can be determined according to the association relationship between the organs. Therefore, a more accurate primary organ and more accurate metastatic organs can be determined.

[0086] In one embodiment, an implementation method for obtaining the segmentation image of the primary organ and the segmentation image of the metastatic organ is provided. The above method for displaying the lesion area further includes:

[0087] Obtain the segmentation image of the primary organ of the object to be displayed, and the segmentation image of the metastatic organ of the object to be displayed.

[0088] In the embodiments of the present application, the computer device may use an organ segmentation algorithm to segment the primary organ in the medical image of the object to be displayed, and obtain a segmentation image of the primary organ of the object to be displayed. After determining the metastatic organ of the object to be displayed, the computer device may also use an organ segmentation algorithm to segment the metastatic organ in the medical image of the object to be displayed, and obtain a segmentation image of the metastatic organ of the object to be displayed. Among them, the organ segmentation algorithm may be any one or more deep learning algorithms. Optionally, the organ segmentation algorithms corresponding to each organ may be the same, or the organ segmentation algorithms corresponding to each organ may also be different. Of course, the embodiments of the present application do not limit the organ segmentation algorithm.

[0089] S203. Display multiple lesion regions in the display area of the current interface according to the display order, including:

[0090] Display multiple lesion regions in the display area of the current interface according to the display order, and display the segmentation image of the primary organ and the segmentation image of the metastatic organ on the current interface.

[0091] In the embodiments of the present application, the computer device may display multiple lesion regions in the display area of the current interface according to the display order, and may display the segmentation image of the primary organ and the segmentation image of the metastatic organ on the current interface.

[0092] In an exemplary embodiment, as Figure 5 shown, Figure 5 is a schematic flowchart of sorting and displaying lesion regions in an embodiment. S501. The user may input the medical image of the object to be displayed on the current interface. Thus, the computer device may receive the medical image of the object to be displayed, and segment the lesion regions in the medical image of the object to be displayed, and obtain multiple lesion regions of the object to be displayed. S502. The user may also input the registration information of the object to be displayed on the current interface. Thus, the computer device may receive the registration information of the object to be displayed, and automatically determine the cancer type of the object to be displayed according to the registration information of the object to be displayed, and then automatically determine the candidate primary organ according to the cancer type of the object to be displayed. S503. The user may also select on the current interface whether to confirm the primary organ by the user, trigger the generation of a selection instruction. Thus, the computer device may receive the selection instruction triggered and generated by the user, and determine whether it is necessary to confirm the primary organ by the user according to the selection instruction triggered and generated by the user.

[0093] S504. If the selection instruction indicates that the primary organ does not need to be confirmed by the user, the computer device may determine the candidate primary organ as the primary organ. S505. If the selection instruction indicates that the primary organ needs to be confirmed by the user, the computer device may display the registration information of the candidate primary organ and the object to be displayed on the current interface, so that the user can view the registration information of the candidate primary organ and the object to be displayed on the current interface, and determine whether the type of the candidate primary organ is accurate. Thus, according to whether the type of the determined candidate primary organ is accurate, a confirmation instruction is triggered and sent to the computer device. The computer device may determine whether the type of the candidate primary organ is accurate in response to the confirmation instruction generated by the user on the current interface. S506. If the confirmation instruction indicates that the type of the candidate primary organ is accurate, the computer device may determine the candidate primary organ as the primary organ; S507. If the confirmation instruction indicates that the type of the candidate primary organ is inaccurate, the computer device may display the registration information of the object to be displayed on the current interface, so that the user can determine the primary organ of the object to be displayed according to the registration information of the object to be displayed, and trigger the generation of an input instruction and send the input instruction to the computer device. Thus, the computer device may respond to the input instruction generated by the user on the current interface and determine the organ indicated by the input instruction as the primary organ of the object to be displayed.

[0094] S508. The computer device may segment the primary organ to obtain a segmented image of the primary organ of the object to be displayed. S509. The computer device may determine the metastatic organ associated with the primary organ according to the association relationship between the organs, and segment the metastatic organ to obtain a segmented image of the metastatic organ of the object to be displayed. S510. The computer device may display multiple lesion regions in the display area of the current interface according to the display order, and may display the segmented image of the primary organ and the segmented image of the metastatic organ on the current interface.

[0095] In one embodiment, the above display area includes a first area and a second area. Based on this, an implementation manner of displaying multiple lesion regions is provided, that is, "displaying multiple lesion regions in the display area of the current interface according to the display order" in the above S203 includes:

[0096] Displaying multiple lesion regions in the first area according to the display order.

[0097] Displaying a list of organs corresponding to the multiple lesion regions in the second area.

[0098] In the embodiments of the present application, since the display area includes a first area and a second area, the computer device can display multiple lesion areas in the first area according to the display order, and can also display an organ list corresponding to the multiple lesion areas in the second area. The organ list refers to a list composed of the organs corresponding to each lesion area. Of course, the embodiments of the present application do not limit the display order of the first area and the second area, that is, it can be understood that the content in the first area can be displayed first, and then the content in the second area; or, the content in the second area can be displayed first, and then the content in the first area; or, the content in the first area and the second area can also be displayed simultaneously.

[0099] In one embodiment, the method for displaying the first area and the second area further includes:

[0100] In response to a click instruction generated by the user's touch in the second area, the lesion area and / or organ indicated by the click instruction is marked and displayed in the first area.

[0101] In the embodiments of the present application, the computer device can, in response to a click instruction generated by the user's touch in the second area, mark and display the lesion area and / or organ indicated by the click instruction in the first area. The click instruction is an instruction generated by the user's touch for indicating the lesion area and / or organ that needs to be marked and displayed. The marking and display methods can include but are not limited to highlighting, underlining, etc.

[0102] Exemplarily, as Figure 6 shown, Figure 6 is a schematic diagram of the interface for displaying the first area and the second area in one embodiment. Figure 6 The left area in Figure 6 is the first area, and the right area in

[0103] is the second area. The computer device can display multiple lesion areas of the object to be displayed in the first area according to the display order, and display an organ list corresponding to the multiple lesion areas in the second area. The organ list includes the primary organ, metastatic organ 1,..., metastatic organ N, other organs, etc. of the object to be displayed, and each organ in the organ list corresponds to at least one lesion area. For example, the primary organ corresponds to lesion areas n1 and n2, metastatic organ 1 corresponds to lesion areas n3 and n4, metastatic organ 2 corresponds to lesion areas n5 and n6, and other organs correspond to lesion areas n7 and n8.

[0103] In addition, when the user clicks on a certain lesion area or organ in the second area, a click instruction can be generated and sent to the computer device. Thus, the computer device can, in response to the click instruction generated by the user's touch in the second area, mark and display the lesion area and / or organ indicated by the click instruction in the first area. Exemplarily, in combination withFigure 6 As shown, if the user clicks on the lesion area n3 within the second region, the computer device can mark and display both the lesion area n3 and the corresponding metastatic organ 1 of the lesion area n3 within the first region. Similarly, if the user clicks on a certain organ within the second region, the computer device can mark and display both the organ and all the corresponding lesion areas of the organ within the first region.

[0104] In this embodiment, multiple lesion areas are displayed in the first region according to the display order; a list of organs corresponding to multiple lesion areas is displayed in the second region. In response to a click instruction generated by the user's touch within the second region, the lesion area and / or organ indicated by the click instruction is marked and displayed in the first region. This application can not only display each organ and lesion area in the first region, but also mark and display the lesion area and / or organ through the second region, so that doctors can view each organ and lesion area according to actual needs.

[0105] It should be understood that although each step in the flowcharts involved in the above embodiments is displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in the order indicated by the arrows. Unless there is a clear indication in this article, the execution of these steps has no strict order limit, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same moment, but can be executed at different moments. The execution order of these steps or stages is not necessarily sequential, but can be executed alternately or in turn with at least a part of other steps or steps or stages in other steps.

[0106] Based on the same inventive concept, the embodiment of the present application also provides a display device for lesion areas for implementing the display method of lesion areas involved above. The solution provided by this device to solve the problem is similar to the solution described in the above method. Therefore, the specific limitations in one or more embodiments of the display device for lesion areas provided below can refer to the limitations on the display method of lesion areas in the above text, and will not be elaborated here.

[0107] In an exemplary embodiment, as Figure 7 shown, a display device for lesion areas is provided, including: an acquisition module 71, a sorting module 72, and a display module 73, where:

[0108] The acquisition module 71 is used to acquire multiple lesion areas of the object to be displayed; the multiple lesion areas include lesion areas of the primary organ, lesion areas of at least one metastatic organ, and lesion areas of other organs.

[0109] A sorting module 72, configured to sort a plurality of lesion regions in descending order of the ranks of the primary organ, the metastatic organ, and other organs, so as to obtain a display order; the rank of the primary organ is higher than that of the metastatic organ, and the rank of the metastatic organ is higher than that of other organs.

[0110] A display module 73, configured to display a plurality of lesion regions within a display area of the current interface according to the display order.

[0111] In one embodiment, the plurality of lesion regions include lesion regions of a plurality of metastatic organs, and the sorting module 72 includes:

[0112] A first rank determination unit, configured to determine the ranks of the respective metastatic organs according to the distance values between the respective metastatic organs and the primary organ;

[0113] A first sorting unit, configured to sort a plurality of lesion regions in descending order of the ranks of the primary organ, the plurality of metastatic organs, and other organs, so as to obtain a display order.

[0114] In one embodiment, the plurality of lesion regions include lesion regions of a plurality of other organs, and the sorting module 72 includes:

[0115] A second rank determination unit, configured to determine the ranks of the respective other organs according to the anatomical structure of the object to be displayed;

[0116] A second sorting unit, configured to sort a plurality of lesion regions in descending order of the ranks of the primary organ, the metastatic organ, and the plurality of other organs, so as to obtain a display order.

[0117] In one embodiment, the display device for the lesion region further includes:

[0118] A primary organ determination module, configured to determine the primary organ according to the registration information of the object to be displayed;

[0119] A metastatic organ determination module, configured to determine the metastatic organs associated with the primary organ according to the association relationships between the organs.

[0120] In one embodiment, the primary organ determination module includes:

[0121] A candidate primary organ determination unit, configured to determine and display a candidate primary organ on the current interface according to the registration information of the object to be displayed;

[0122] A primary organ determination unit is configured to determine whether the type of a candidate primary organ is accurate in response to a confirmation instruction generated by a user's touch on the current interface; if the confirmation instruction indicates that the type of the candidate primary organ is accurate, the candidate primary organ is determined as the primary organ; if the confirmation instruction indicates that the type of the candidate primary organ is inaccurate, an input instruction generated by the user's touch on the current interface is responded to, and the organ indicated by the input instruction is determined as the primary organ.

[0123] In one embodiment, the display device for lesion regions further includes:

[0124] A segmented image acquisition module is configured to acquire a segmented image of the primary organ of an object to be displayed and a segmented image of the metastatic organ of the object to be displayed.

[0125] The display module 73 includes:

[0126] A first display unit is configured to display a plurality of lesion regions in the display area of the current interface according to the display order, and display the segmented image of the primary organ and the segmented image of the metastatic organ on the current interface.

[0127] In one embodiment, the display area includes a first area and a second area, and the display module 73 includes:

[0128] A second display unit is configured to display a plurality of lesion regions in the first area according to the display order.

[0129] A third display unit is configured to display a list of organs corresponding to the plurality of lesion regions in the second area.

[0130] In one embodiment, the display device for lesion regions further includes:

[0131] A marking display module is configured to perform marking display on the lesion region and / or organ indicated by the click instruction in the first area in response to a click instruction generated by the user's touch in the second area.

[0132] Each module in the above display device for lesion regions can be implemented in whole or in part by software, hardware, and their combination. The above modules can be embedded in or independent of a processor in a computer device in the form of hardware, or stored in a memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above respective modules.

[0133] In an exemplary embodiment, a computer device is provided. The computer device can be a terminal, and its internal structural diagram can be as Figure 1As shown in the figure. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit, and an input device. Among them, the processor, the memory, and the input / output interface are connected through a system bus, and the communication interface, the display unit, and the input device are connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and computer programs. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and external devices. The communication interface of the computer device is used to communicate with external terminals in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, NFC (Near Field Communication), or other technologies. When the computer program is executed by the processor, it realizes a method for displaying lesion regions. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer covering the display screen, or a button, a trackball, or a touchpad provided on the computer device housing, or an external keyboard, touchpad, or mouse, etc.

[0134] Those skilled in the art can understand that Figure 1 the structure shown in the figure is only a block diagram of some structures related to the solution of this application, and does not constitute a limitation on the computer device to which the solution of this application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.

[0135] In an exemplary embodiment, a computer device is provided, including a memory and a processor. A computer program is stored in the memory. When the processor executes the computer program, the following steps are implemented:

[0136] Obtain multiple lesion regions of the object to be displayed; the multiple lesion regions include lesion regions of the primary organ, lesion regions of at least one metastatic organ, and lesion regions of other organs;

[0137] Sort the multiple lesion regions according to the order from high to low of the levels of the primary organ, the metastatic organ, and the other organs to obtain a display order; the level of the primary organ is higher than the level of the metastatic organ, and the level of the metastatic organ is higher than the level of the other organs;

[0138] Display the multiple lesion regions within the display area of the current interface according to the display order.

[0139] In one embodiment, the multiple lesion regions include the lesion regions of multiple metastatic organs. The multiple lesion regions are sorted according to the descending order of the ranks of the primary organ, the metastatic organs, and other organs to obtain a display order. When the processor executes the computer program, the following steps are further implemented:

[0140] Determine the rank of each metastatic organ according to the distance value between each metastatic organ and the primary organ;

[0141] Sort the multiple lesion regions according to the descending order of the ranks of the primary organ, the multiple metastatic organs, and other organs to obtain a display order.

[0142] In one embodiment, the multiple lesion regions include the lesion regions of multiple other organs. The multiple lesion regions are sorted according to the descending order of the ranks of the primary organ, the metastatic organs, and other organs to obtain a display order. When the processor executes the computer program, the following steps are further implemented:

[0143] Determine the rank of each other organ according to the anatomical structure of the object to be displayed;

[0144] Sort the multiple lesion regions according to the descending order of the ranks of the primary organ, the metastatic organs, and the multiple other organs to obtain a display order.

[0145] In one embodiment, when the processor executes the computer program, the following steps are further implemented:

[0146] Determine the primary organ according to the registration information of the object to be displayed;

[0147] Determine the metastatic organs associated with the primary organ according to the association relationship between the organs.

[0148] In one embodiment, the primary organ is determined according to the registration information of the object to be displayed. When the processor executes the computer program, the following steps are further implemented:

[0149] Determine and display the candidate primary organ on the current interface according to the registration information of the object to be displayed;

[0150] Respond to the confirmation instruction generated by the user's touch on the current interface, and determine whether the type of the candidate primary organ is accurate; if the confirmation instruction indicates that the type of the candidate primary organ is accurate, determine the candidate primary organ as the primary organ; if the confirmation instruction indicates that the type of the candidate primary organ is inaccurate, respond to the input instruction generated by the user's touch on the current interface, and determine the organ indicated by the input instruction as the primary organ.

[0151] In one embodiment, when the processor executes the computer program, the following steps are further implemented:

[0152] Obtain the segmentation image of the primary organ of the object to be displayed and the segmentation image of the metastatic organ of the object to be displayed;

[0153] Display multiple lesion regions in the display area of the current interface according to the display order. When the processor executes the computer program, the following steps are also implemented:

[0154] Display multiple lesion regions in the display area of the current interface according to the display order, and display the segmentation image of the primary organ and the segmentation image of the metastatic organ on the current interface.

[0155] In one embodiment, the display area includes a first area and a second area. When displaying multiple lesion regions in the display area of the current interface according to the display order, the following steps are also implemented by the processor when executing the computer program:

[0156] Display multiple lesion regions in the first area according to the display order;

[0157] Display the organ list corresponding to multiple lesion regions in the second area.

[0158] In one embodiment, the following steps are also implemented by the processor when executing the computer program:

[0159] In response to the click instruction generated by the user's touch in the second area, perform marked display on the lesion region and / or organ indicated by the click instruction in the first area.

[0160] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above method embodiments are implemented.

[0161] In one embodiment, a computer program product is provided, including a computer program. When the computer program is executed by a processor, the steps in the above method embodiments are implemented.

[0162] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use, and processing of relevant data need to comply with relevant regulations.

[0163] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, database, or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memories. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The databases involved in the embodiments provided in the present application can include at least one of relational databases and non-relational databases. Non-relational databases can include distributed databases based on blockchain, etc., without limitation. The processors involved in the embodiments provided in the present application can be general-purpose processors, central processing units, graphics processing units, digital signal processors, programmable logic devices, data processing logics based on quantum computing, etc., without limitation.

[0164] The technical features of the above embodiments can be combined arbitrarily. For the sake of brevity of description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope described in this specification.

[0165] The above embodiments only represent several implementation manners of the present application. The description is relatively specific and detailed, but it should not be construed as a limitation on the patent scope of the present application. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.

Claims

1. A method for displaying a lesion area, characterized in that The method includes: Obtaining multiple lesion regions of the object to be displayed; the multiple lesion regions include lesion regions of the primary organ, lesion regions of at least one metastatic organ, and lesion regions of other organs; Sorting the multiple lesion regions according to the order of the primary organ, the metastatic organ, and the other organs from high to low to obtain a display order; the level of the primary organ is higher than that of the metastatic organ, and the level of the metastatic organ is higher than that of the other organs; Displaying the multiple lesion regions within the display area of the current interface according to the display order.

2. The method according to claim 1, characterized in that, The multiple lesion regions include lesion regions of multiple metastatic organs. The step of sorting the multiple lesion regions according to the order of the primary organ, the metastatic organ, and the other organs from high to low to obtain a display order includes: Determining the level of each metastatic organ according to the distance value between each metastatic organ and the primary organ; Sorting the multiple lesion regions according to the order of the primary organ, the multiple metastatic organs, and the other organs from high to low to obtain the display order.

3. The method according to claim 1 or 2, characterized in that, The multiple lesion regions include lesion regions of multiple other organs. The step of sorting the multiple lesion regions according to the order of the primary organ, the metastatic organ, and the other organs from high to low to obtain a display order includes: Determining the level of each other organ according to the anatomical structure of the object to be displayed; Sorting the multiple lesion regions according to the order of the primary organ, the metastatic organ, and the multiple other organs from high to low to obtain the display order.

4. The method according to claim 1 or 2, characterized in that The method further includes: Determining the primary organ according to the registration information of the object to be displayed; Determining the metastatic organ associated with the primary organ according to the association relationship between organs.

5. The method according to claim 4, wherein The step of determining the primary organ according to the registration information of the object to be displayed includes: Determining and displaying a candidate primary organ on the current interface according to the registration information of the object to be displayed; Responding to a confirmation instruction generated by the user's touch on the current interface to determine whether the type of the candidate primary organ is accurate; if the confirmation instruction indicates that the type of the candidate primary organ is accurate, determining the candidate primary organ as the primary organ; if the confirmation instruction indicates that the type of the candidate primary organ is inaccurate, responding to an input instruction generated by the user's touch on the current interface and determining the organ indicated by the input instruction as the primary organ.

6. The method according to claim 1 or 2, characterized in that, The method further includes: Obtaining a segmentation image of the primary organ of the object to be displayed and a segmentation image of the metastatic organ of the object to be displayed; The step of displaying the multiple lesion regions within the display area of the current interface according to the display order includes: Displaying the multiple lesion regions within the display area of the current interface according to the display order, and displaying the segmentation image of the primary organ and the segmentation image of the metastatic organ on the current interface.

7. The method according to claim 1 or 2, characterized in that, The display area includes a first area and a second area. Displaying the multiple lesion areas in the display area of the current interface according to the display order includes: Displaying the multiple lesion areas in the first area according to the display order; Displaying a list of organs corresponding to the multiple lesion areas in the second area.

8. The method according to claim 7, characterized in that, The method further includes: In response to a click instruction generated by a user's touch in the second area, performing marked display on the lesion area and / or organ indicated by the click instruction in the first area.

9. A display device for a lesion area, characterized in that The apparatus includes: An acquisition module, configured to acquire multiple lesion areas of an object to be displayed; the multiple lesion areas include lesion areas of a primary organ, lesion areas of at least one metastatic organ, and lesion areas of other organs; A sorting module, configured to sort the multiple lesion areas according to the order from high to low of the levels of the primary organ, the metastatic organ, and the other organs, to obtain a display order; the level of the primary organ is higher than the level of the metastatic organ, and the level of the metastatic organ is higher than the level of the other organs; A display module, configured to display the multiple lesion areas in the display area of the current interface according to the display order.

10. A computer device, comprising a memory and a processor, the memory storing a computer program, characterized in that, When the processor executes the computer program, the steps of the method according to any one of claims 1 to 8 are implemented.

Images