Urinary calculus component report generation method and system

Abstract

The invention relates to a urinary calculus component report generation method and system, and relates to the technical field of urinary calculus component report generation. The urinary calculus component report generation method comprises the following steps: acquiring a dual-energy abdomen image and a urinary calculus component report template corresponding to the dual-energy abdomen image; according to a set output item corresponding to the urinary calculus component report template, calculus information corresponding to the set output item is extracted from the dual-energy abdomen image; and inserting the set output item and the calculus information corresponding to the set output item into the dual-energy abdomen image to generate a urinary calculus component report. According to the embodiment of the invention, the generation of the urinary calculus composition report can be realized.

Description

Technical Field

[0001] The present disclosure relates to the technical field of generating reports on the components of urinary system stones, and particularly to a method and system for generating reports on the components of urinary system stones. Background Art

[0002] The CT values of conventional CT examinations cannot further distinguish the types of non-uric acid stones. This is because even for non-uric acid stones with a single component, there is still an overlap in the CT values of stones with components such as calcium oxalate monohydrate, calcium oxalate dihydrate, carbonate apatite, struvite, and calcium carbonate phosphate, and it is impossible to distinguish and identify them solely based on CT values. Moreover, in clinical practice, mixed-component stones are far more numerous than single-component stones. For stones formed by mixing the same two components, if the proportions of the two components are different, the final values obtained according to the calculation formula of the average CT value are different. Therefore, it is impossible to accurately identify mixed stones with different components.

[0003] The average atomic number value of spectral CT can not only accurately identify uric acid stones and non-uric acid stones, but also has a certain diagnostic specificity for the components of non-uric acid stones with a single component. However, the average atomic number value of spectral CT is not applicable to the mixed-component stones that account for the largest proportion clinically. The reason is that the calculation method of the average atomic number value of mixed components is also closely related to the composition percentage and types of different components. Therefore, the average atomic number value cannot accurately identify mixed urinary system stones with different components either.

[0004] In addition, when using CT values and average atomic number values to diagnose the components of stones at present, radiologists need to measure and analyze the corresponding values by themselves, and then make a rough judgment based on literature reports and their own experience to complete the report writing. This not only takes a lot of time and energy of radiologists, but also cannot guarantee the accuracy of the diagnosis of the components of urinary system stones. Summary of the Invention

[0005] The present disclosure proposes a technical solution corresponding to a method and system for generating reports on the components of urinary system stones.

[0006] According to one aspect of the present disclosure, there is provided a method for generating a report on the components of urinary system stones, including:

[0007] Obtaining a dual-energy abdominal image and its corresponding report template for the components of urinary system stones; wherein, the dual-energy abdominal image is a dual-energy abdominal CT image; extracting, from the dual-energy abdominal image, the stone information corresponding to the set output items according to the set output items corresponding to the report template for the components of urinary system stones; wherein, the set output items include one or several pieces of information such as stone type, stone location, stone shape, stone gray value, major axis and minor axis corresponding to the stone, and stone volume; inserting the set output items and their corresponding stone information into the dual-energy abdominal image to generate a report on the components of urinary system stones.

[0008] Preferably, the method for extracting the stone information corresponding to the set output item from the dual-energy abdominal image according to the set output item corresponding to the urinary tract stone composition report template includes: if the set output item is configured as one or more of the stone shape, the major axis and minor axis corresponding to the stone, and the stone volume, then

[0009] calculate the stone area corresponding to each stone type in each two-dimensional slice stone mask image of the stone mask image corresponding to the dual-energy abdominal image respectively; obtain a plurality of stone areas; calculate the major axis and minor axis corresponding to the largest stone area among the plurality of stone areas corresponding to each stone type respectively, to obtain the major axis and minor axis corresponding to each stone type; and / or, perform edge detection on the stones corresponding to each stone type on the stone mask image corresponding to the dual-energy abdominal image respectively, to obtain a stone edge mask line; fit the stone edge mask line corresponding to each stone type respectively, to obtain the stone shape corresponding to each stone type; and / or, reconstruct the mask images corresponding to each stone type in the stone mask image corresponding to the dual-energy abdominal image respectively, to obtain the stone volume corresponding to each stone type.

[0010] Preferably, the method for extracting the stone information corresponding to the set output item from the dual-energy abdominal image according to the set output item corresponding to the urinary tract stone composition report template includes: if the set output item is configured as the lesion location, then segment the dual-energy abdominal image for the kidney and / or ureter and / or bladder, to obtain a kidney and / or ureter and / or bladder mask image; according to the kidney and / or ureter and / or bladder mask image, configure the kidney and / or ureter and / or bladder mask in the kidney and / or ureter and / or bladder mask image as the left kidney and / or ureter and / or bladder mask and the right kidney and / or ureter and / or bladder mask; based on the spatial position relationship between the stone mask in the stone mask image and the left kidney and / or ureter and / or bladder mask and the right kidney and / or ureter and / or bladder mask in the kidney and / or ureter and / or bladder mask image, determine the stone position corresponding to each stone type.

[0011] Preferably, the method for determining the stone position corresponding to each stone type based on the spatial position relationship between the stone mask in the stone mask image and the left kidney and / or ureter and / or bladder mask and the right kidney and / or ureter and / or bladder mask in the kidney and / or ureter and / or bladder mask image includes: extracting a plurality of two-dimensional slice stone mask images corresponding to each stone type from the stone mask image; if the spatial position of the stone mask corresponding to the plurality of two-dimensional slice stone mask images is within the left kidney and / or ureter and / or bladder mask spatial position of the two-dimensional slice stone mask image corresponding to the corresponding slice of the kidney and / or ureter and / or bladder mask image, the stone corresponding to the stone mask spatial position is configured as a left kidney and / or ureter and / or bladder stone; if the spatial position of the stone mask corresponding to the plurality of two-dimensional slice stone mask images is within the right kidney and / or ureter and / or bladder mask spatial position of the two-dimensional slice stone mask image corresponding to the corresponding slice of the kidney and / or ureter and / or bladder mask image, the stone corresponding to the stone mask spatial position is configured as a right kidney and / or ureter and / or bladder stone.

[0012] Preferably, the method for extracting the stone information corresponding to the set output item from the dual-energy abdominal image according to the set output item corresponding to the urinary tract stone composition report template includes: if the set output item is configured as the stone gray value, respectively based on each two-dimensional slice dual-energy abdominal image in the dual-energy abdominal image and the two-dimensional slice stone mask image in the stone mask image corresponding to the corresponding slice, extracting a stone image with the original gray value from the dual-energy abdominal image; respectively calculating the average gray value corresponding to each stone type in the stone mask image to determine the stone gray value corresponding to each stone type.

[0013] Preferably, the method for extracting a stone image with the original gray value from the dual-energy abdominal image respectively based on each two-dimensional slice dual-energy abdominal image in the dual-energy abdominal image and the two-dimensional slice stone mask image in the stone mask image corresponding to the corresponding slice includes: performing a multiplication operation on each two-dimensional slice dual-energy abdominal image in the dual-energy abdominal image and the two-dimensional slice stone mask image in the stone mask image corresponding to the corresponding slice to obtain a stone gray value image; based on the mask value and stone spatial position corresponding to each stone type in the stone gray value image and the two-dimensional slice stone mask image of the stone mask image corresponding to the corresponding slice, performing gray value restoration on the stone gray value image to obtain a stone image with the original gray value.

[0014] Preferably, the method for restoring the gray value of the stone gray value image to obtain a stone image with the original gray value based on the mask values and stone spatial positions corresponding to each stone type in the two-dimensional slice stone mask image of the stone mask image corresponding to the stone gray value image and its corresponding slice includes: respectively extracting the mask values and stone spatial positions corresponding to each stone type in the two-dimensional slice stone mask image of the stone mask image; based on the stone spatial positions corresponding to each stone type, respectively performing stone type spatial position positioning on the stone gray value image to obtain spatial position positioning images corresponding to each stone type in the two-dimensional slice stone gray value image of the stone gray value image; dividing the spatial position positioning images corresponding to each stone type in the two-dimensional slice stone gray value image of the stone gray value image by the mask values corresponding to the stone spatial positions to obtain a stone image with the original gray value.

[0015] Preferably, the method for extracting the stone information corresponding to the set output item from the dual-energy abdominal image according to the set output item corresponding to the urinary stone composition report template includes: if the set output item is configured as the stone type, obtaining the urinary stone atomic number image corresponding to the dual-energy abdominal image; based on the urinary stone atomic number image, identifying the stone type corresponding to the dual-energy abdominal image.

[0016] Preferably, the method for identifying the stone type corresponding to the dual-energy abdominal image based on the urinary stone atomic number image includes: extracting the multiple component percentages corresponding to the peaks of the multiple strip charts corresponding to the effective atomic numbers in the urinary stone atomic number image; based on the multiple component percentages corresponding to the multiple strip charts and the multiple set stone type component percentage ranges, identifying the stone type corresponding to the dual-energy abdominal image.

[0017] Preferably, the method for extracting the multiple component percentages corresponding to the peaks of the multiple strip charts corresponding to the effective atomic numbers in the urinary stone atomic number image includes: obtaining the set strip chart color and / or the set strip chart width; according to the set strip chart color and / or the set strip chart width, extracting the multiple strip charts corresponding to the effective atomic numbers in the urinary stone atomic number image that meet the set strip chart color and / or the set strip chart width; according to the multiple strip charts corresponding to the set strip chart color and / or the set strip chart width in the urinary stone atomic number image, determining the multiple component percentages corresponding to the peaks of the multiple strip charts.

[0018] Preferably, the method for identifying the stone type corresponding to the dual-energy abdominal image based on the multiple component percentages corresponding to the multiple bar charts and the multiple preset stone type component percentage ranges includes: obtaining a preset component percentage smaller than the minimum value of the preset stone type component percentage range; if the component percentages corresponding to the multiple bar charts are smaller than the preset component percentage, deleting the component percentages smaller than the preset component percentage from the multiple component percentages corresponding to the multiple bar charts; otherwise, retaining the component percentages greater than or equal to the preset component percentage; and identifying the stone type corresponding to the dual-energy abdominal image based on the retained multiple component percentages and the multiple preset stone type component percentage ranges.

[0019] Preferably, the method for identifying the stone type corresponding to the dual-energy abdominal image based on the multiple component percentages corresponding to the multiple bar charts and the multiple preset stone type component percentage ranges further includes: if there is an overlapping range in the multiple preset stone type component percentage ranges corresponding to at least two of the multiple component percentages corresponding to the multiple bar charts, obtaining the iodine-based image corresponding to the dual-energy abdominal image; and identifying the stone type corresponding to the overlapping range based on the iodine-based image corresponding to the dual-energy abdominal image.

[0020] Preferably, the method for identifying the stone type corresponding to the overlapping range based on the iodine-based image corresponding to the dual-energy abdominal image includes: determining the stone gray value corresponding to the iodine-based image corresponding to the dual-energy abdominal image; respectively calculating the average gray value and the uniformity corresponding to the stone gray value; if the average gray value is greater than the preset average gray value and the uniformity is greater than the preset uniformity, configuring the stone type as calcium oxalate dihydrate stone; otherwise, configuring the stone type as struvite stone or carbonate apatite stone.

[0021] Preferably, the multiple preset stone type component percentage ranges include one or more of: uric acid stone component percentage range, calcium oxalate monohydrate stone component percentage range, calcium oxalate dihydrate stone component percentage range, carbonate apatite stone component percentage range, calcium carbonate phosphate stone component percentage range, struvite stone component percentage range.

[0022] Preferably, the uric acid stone component percentage range is configured as 6.5 - 10.5, the calcium oxalate monohydrate stone component percentage range is configured as 13.3 - 14.0, the calcium oxalate dihydrate stone component percentage range is configured as 12.0 - 13.3, the carbonate apatite stone component percentage range is configured as 14.0 - 15.0, the calcium carbonate phosphate stone component percentage range is configured as greater than 12.5, and the struvite stone component percentage range is configured as less than 12.5.

[0023] Preferably, the method for extracting the stone information corresponding to the set output item from the dual-energy abdominal image according to the set output item corresponding to the urinary tract stone composition report template includes: If the set output item is configured as one or several of the main peak of atomic number, the secondary peak of atomic number, and the third peak of atomic number, then

[0024] Obtain the urinary tract stone atomic number image corresponding to the dual-energy abdominal image; extract multiple strip charts corresponding to the effective atomic numbers in the urinary tract stone atomic number image; determine multiple component percentages corresponding to the peaks of multiple strip charts according to the multiple strip charts in the urinary tract stone atomic number image that meet the set strip chart color and / or set strip chart width; based on the multiple component percentages corresponding to the peaks of the multiple strip charts, determine one or several of the main peak of atomic number corresponding to the largest component percentage among the multiple component percentages, the secondary peak of atomic number corresponding to the second largest component percentage among the multiple component percentages, and the third peak of atomic number corresponding to the third largest component percentage among the multiple component percentages.

[0025] Preferably, the method for extracting multiple strip charts corresponding to the effective atomic numbers in the urinary tract stone atomic number image includes: obtaining the set strip chart color and / or set strip chart width; extracting multiple strip charts corresponding to the effective atomic numbers in the urinary tract stone atomic number image that meet the set strip chart color and / or set strip chart width according to the set strip chart color and / or set strip chart width.

[0026] Preferably, the method for inserting the set output item and its corresponding stone information into the dual-energy abdominal image to generate a urinary tract stone composition report includes: adding the stone information to the corresponding position of the set output item to generate a urinary tract stone composition report to be inserted; inserting the urinary tract stone composition report to be inserted into the dual-energy abdominal image to generate a urinary tract stone composition report.

[0027] Preferably, the method for adding the stone information to the corresponding position of the set output item to generate a urinary tract stone composition report to be inserted includes: respectively obtaining the corresponding positions where the areas to be filled of the set output item are located; respectively adding the corresponding stone information to the corresponding positions of the set output item to generate a urinary tract stone composition report to be inserted.

[0028] According to one aspect of the present disclosure, there is provided a device or system for generating a urinary calculus composition report, including: an acquisition unit configured to acquire a dual-energy abdominal image and a corresponding urinary calculus composition report template; an extraction unit configured to extract calculus information corresponding to the set output items from the dual-energy abdominal image according to the set output items corresponding to the urinary calculus composition report template; a first generation unit configured to add the calculus information to corresponding positions of the set output items to generate a urinary calculus composition report to be inserted; and a second generation unit configured to insert the urinary calculus composition report to be inserted into the dual-energy abdominal image to generate a urinary calculus composition report.

[0029] According to one aspect of the present disclosure, there is provided a device or system for generating a urinary calculus composition report, including: an electronic device configured with a processor and a memory for storing instructions executable by the processor; wherein, the processor is configured to call the instructions stored in the memory to execute the above-mentioned method for generating a urinary calculus composition report.

[0030] According to one aspect of the present disclosure, there is provided a device or system for generating a urinary calculus composition report, including: a processor; a memory for storing instructions executable by the processor; wherein, the processor is configured to call the instructions stored in the memory to execute the above-mentioned method for generating a urinary calculus composition report.

[0031] According to one aspect of the present disclosure, there is provided a device or system for generating a urinary calculus composition report, including: a computer-readable storage medium having computer program instructions stored thereon, and when the computer program instructions are executed by a processor, the above-mentioned method for generating a urinary calculus composition report is implemented.

[0032] According to one aspect of the present disclosure, there is provided a device or system for generating a urinary calculus composition report, including: a computer program product including a computer program / instructions, and when the computer program / instructions are executed by a processor, the above-mentioned method for generating a urinary calculus composition report is implemented.

[0033] In an embodiment of the present disclosure, a technical solution corresponding to a method and system for generating a urinary calculus composition report is proposed to solve the technical problem that for a urinary calculus composition report, a radiologist needs to measure and analyze corresponding values by himself / herself, and then make a rough judgment based on literature reports and his / her own experience to complete the report writing, which takes a large amount of time and energy of the radiologist and cannot guarantee the accuracy of the diagnosis of urinary calculus composition.

[0034] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and do not limit the present disclosure.

[0035] Other features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the technical solutions of the present disclosure.

[0037] Figure 1 A flowchart showing a method for generating a report on the composition of urinary tract stones according to an embodiment of the present disclosure;

[0038] Figure 2 A block diagram of an electronic device 800 shown according to an exemplary embodiment;

[0039] Figure 3 A block diagram of an electronic device 1900 shown according to an exemplary embodiment. DETAILED DESCRIPTION

[0040] Various exemplary embodiments, features, and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. Like reference numerals in the drawings denote like or similar elements. Although various aspects of the embodiments are shown in the drawings, the drawings are not necessarily drawn to scale unless otherwise specified.

[0041] The term "exemplary" used herein means "serving as an example, embodiment, or illustration". Any embodiment described as "exemplary" herein is not necessarily to be construed as superior or better than other embodiments.

[0042] The term "and / or" as used herein merely describes an associated relationship between associated objects and indicates that three relationships may exist. For example, A and / or B may represent: A exists alone, A and B exist simultaneously, and B exists alone. In addition, the term "at least one" as used herein means any one of a plurality or any combination of at least two of a plurality. For example, including at least one of A, B, and C may represent including any one or more elements selected from the set composed of A, B, and C.

[0043] In addition, for a better description of the present disclosure, numerous specific details are given in the following detailed description. Those skilled in the art should understand that the present disclosure can be implemented without some of these specific details. In some instances, methods, means, elements, and circuits well known to those skilled in the art are not described in detail so as to highlight the gist of the present disclosure.

[0044] It can be understood that the above-described embodiments of the method for generating a report on the composition of urinary tract stones of the present disclosure can be combined with each other to form a combined embodiment without violating the principle logic. For the sake of brevity, the present disclosure will not elaborate further.

[0045] In addition, the present disclosure also provides a urinary calculus composition report generation device or system, an electronic device, a computer-readable storage medium, and a program, all of which can be used to implement any one of the urinary calculus composition report generation methods provided by the present disclosure. For the corresponding technical solutions and descriptions, reference can be made to the corresponding records in the method section, which will not be elaborated herein.

[0046] Figure 1 The flowchart of the urinary calculus composition report generation method according to an embodiment of the present disclosure is shown. As Figure 1 shown, the urinary calculus composition report generation method includes: Step S101: Obtain a dual-energy abdominal image and its corresponding urinary calculus composition report template; wherein, the dual-energy abdominal image is a dual-energy abdominal CT image; Step S102: Extract the calculus information corresponding to the set output items from the dual-energy abdominal image according to the set output items corresponding to the urinary calculus composition report template; wherein, the set output items include one or several pieces of information among calculus type, calculus location, calculus shape, calculus gray value, major axis and minor axis corresponding to the calculus, and calculus volume; Step S103: Insert the set output items and their corresponding calculus information into the dual-energy abdominal image to generate a urinary calculus composition report. This solves the technical problem that for a urinary calculus composition report, a radiologist needs to measure and analyze the corresponding values by himself / herself, and then make a rough judgment based on literature reports and his / her own experience to complete the report writing, which takes a lot of time and energy of the radiologist and cannot guarantee the accuracy of the diagnosis of urinary calculus composition.

[0047] Step S101: Obtain a dual-energy abdominal image and its corresponding urinary calculus composition report template; wherein, the dual-energy abdominal image is a dual-energy abdominal CT image.

[0048] In the embodiments of the present disclosure and other possible embodiments, an energy spectrum CT device (dual-energy CT device, energy spectrum CT device) is used to scan the abdomen of a patient to obtain a three-dimensional dual-energy abdominal image (dual-energy abdominal image / dual-energy energy spectrum abdominal image / dual-energy abdominal CT image / dual-energy energy spectrum abdominal CT image / energy spectrum abdominal image / energy spectrum abdominal CT image).

[0049] In the embodiments of the present disclosure and other possible embodiments, the energy spectrum CT device (dual-energy CT device, energy spectrum CT device), that is, a fast tube voltage switching dual-source CT device, adopts an instantaneous kVp switching technology to complete the switching of high and low single energies within an extremely short time (<0.25 ms), realizing the triple identity (simultaneous, in the same direction, and from the same source) of dual energy. It overcomes the defects of the dual-tube dual-source CT, thereby avoiding the subtle angular differences between the scanning planes of the two tubes, improving the accuracy of the acquired data to provide more excellent CT scan images.

[0050] In the embodiments of the present disclosure and other possible embodiments, spectral CT scanning and three-dimensional reconstruction can not only clearly display the density and morphology of the renal parenchyma, the orientation and contour of the renal pelvis and calyces, the course and lumen of the ureter, and the condition of the bladder wall and lumen, but also show the shape and position of renal calculi and renal pelvis and calyces, and further measure the volume of the calculi and renal pelvis and calyces. The imaging quality is far superior to that of traditional CT three-dimensional multi-planar reconstruction. In particular, the effective atomic number (Zeff value) of spectral CT can be used to analyze the compositional characteristics of renal calculi, display the numerical differences in different regions, and clarify the specific spatial distribution patterns of different components in mixed calculi based on these differences.

[0051] Step S102: Extract the calculus information corresponding to the set output item from the dual-energy abdominal image according to the set output item corresponding to the urinary calculus composition report template; wherein, the set output item includes one or several pieces of information among calculus type, calculus position, calculus shape, calculus gray value, major axis and minor axis corresponding to the calculus, and calculus volume.

[0052] In the embodiment of the present disclosure, the method for extracting the calculus information corresponding to the set output item from the dual-energy abdominal image according to the set output item corresponding to the urinary calculus composition report template includes: if the set output item is configured as one or several pieces of information among calculus shape, major axis and minor axis corresponding to the calculus, and calculus volume, calculate the calculus area corresponding to each calculus type in each two-dimensional slice of the calculus mask image corresponding to the dual-energy abdominal image respectively; obtain multiple calculus areas; calculate the major axis and minor axis corresponding to the largest calculus area among the multiple calculus areas corresponding to each calculus type respectively, to obtain the major axis and minor axis corresponding to each calculus type; and / or, perform edge detection on the calculi corresponding to each calculus type on the calculus mask image corresponding to the dual-energy abdominal image respectively, to obtain calculus edge mask lines; fit the calculus edge mask lines corresponding to each calculus type respectively, to obtain the calculus shape corresponding to each calculus type; and / or, perform three-dimensional reconstruction on the mask images corresponding to each calculus type in the calculus mask image corresponding to the dual-energy abdominal image respectively, to obtain the calculus volume corresponding to each calculus type.

[0053] In an embodiment of the present disclosure, the method for extracting stone information corresponding to the set output item from the dual-energy abdominal image according to the set output item corresponding to the urinary stone composition report template includes: if the set output item is configured as the lesion location, segmenting the dual-energy abdominal image for the kidney and / or ureter and / or bladder to obtain a kidney and / or ureter and / or bladder mask image; according to the kidney and / or ureter and / or bladder mask image, configuring the kidney and / or ureter and / or bladder mask in the kidney and / or ureter and / or bladder mask image as the left kidney and / or ureter and / or bladder mask and the right kidney and / or ureter and / or bladder mask; based on the spatial position relationship between the stone mask in the stone mask image and the left kidney and / or ureter and / or bladder mask and the right kidney and / or ureter and / or bladder mask in the kidney and / or ureter and / or bladder mask image, determining the stone position corresponding to each stone type.

[0054] In this and other possible embodiments of the present disclosure, using a preset segmentation model (kidney / bladder / ureter / stone segmentation model), segmenting the medical image for the kidney and / or ureter and / or bladder to obtain a three-dimensional kidney and / or ureter and / or bladder mask image.

[0055] In an embodiment of the present disclosure and other possible embodiments, the method for segmenting stones in the kidney, ureter, and bladder of the dual-energy abdominal image to obtain a stone mask image includes: obtaining a preset segmentation network, dual-energy abdominal training images for training the preset segmentation network, and a multi-mask label fusion image corresponding to the dual-energy abdominal training image and representing the kidney, ureter, and stones; training the preset segmentation network with the dual-energy abdominal training image and its corresponding multi-mask label fusion image to obtain a corresponding stone segmentation model (preset segmentation model, kidney / bladder / ureter / stone segmentation model).

[0056] In an embodiment of the present disclosure and other possible embodiments, based on the stone segmentation model (preset segmentation model, kidney / bladder / ureter / stone segmentation model), segmenting the stones in the kidney, ureter, and bladder of the dual-energy abdominal image to obtain a stone mask image.

[0057] In the embodiments of the present disclosure and other possible embodiments, the method for constructing the multi-mask label image fusion image respectively representing the kidney, bladder, ureter, and stone includes: obtaining the kidney mask label image, bladder mask label image, ureter mask label image, and stone mask image corresponding to the dual-energy abdominal training image; respectively assigning a first mask value, a second mask value, a third mask value, and a fourth mask value to the kidney mask label image, the bladder mask label image, the ureter mask label image, and the stone mask image; fusing the kidney mask label image corresponding to the first mask value, the bladder mask label image corresponding to the second mask value, the ureter mask image corresponding to the third mask value, and the stone mask image corresponding to the fourth mask value to obtain the multi-mask label fusion image respectively representing the kidney, bladder, ureter, and stone corresponding to the dual-energy abdominal training image.

[0058] In the embodiments of the present disclosure and other possible embodiments, the method for fusing the kidney mask label image corresponding to the first mask value, the bladder mask label image corresponding to the second mask value, the ureter mask image corresponding to the third mask value, and the stone mask image corresponding to the fourth mask value to obtain the multi-mask label fusion image respectively representing the kidney, bladder, ureter, and stone corresponding to the dual-energy abdominal training image includes: respectively determining a first spatial position corresponding to the first mask value in the kidney mask label image, a second spatial position corresponding to the second mask value in the bladder mask label image, a third spatial position corresponding to the third mask value in the ureter mask label image, and a fourth spatial position corresponding to the fourth mask value in the stone mask image; if the first spatial position, the second spatial position, and the third spatial position overlap with the fourth spatial position, updating the mask value corresponding to the overlapping spatial position to the fourth mask value corresponding to the fourth spatial position; otherwise, retaining the first mask value corresponding to the first spatial position, the second mask value corresponding to the second spatial position, and the third mask value corresponding to the third spatial position to obtain the multi-mask label fusion image respectively representing the kidney, bladder, ureter, and stone corresponding to the dual-energy abdominal training image.

[0059] In the embodiments of the present disclosure and other possible embodiments, before obtaining the organ mask label image corresponding to at least one organ of the kidney, ureter, and bladder in the dual-energy abdominal training image and the stone mask label image within the organ, the stone mask label image is determined based on the iodine-based image corresponding to the dual-energy abdominal training image, and the organ mask label image is determined based on the water-based image corresponding to the dual-energy abdominal training image.

[0060] In the embodiments of the present disclosure and other possible embodiments, the method for determining the stone mask label image based on the iodine-based image corresponding to the dual-energy abdominal training image includes: performing stone delineation on the iodine-based image corresponding to the dual-energy abdominal training image to determine the stone mask label image.

[0061] In the embodiments of the present disclosure and other possible embodiments, the method for determining the organ mask label image based on the water-based image corresponding to the dual-energy abdominal training image includes: performing organ delineation on the water-based image corresponding to the dual-energy abdominal training image to determine the organ mask label image.

[0062] In the embodiments of the present disclosure and other possible embodiments, during the process of training the preset segmentation network by using the dual-energy abdominal training image and its corresponding multi-mask label fusion image, it includes: obtaining the organ loss function corresponding to the organ and its corresponding organ loss weight value, the stone loss function corresponding to the stone and its corresponding stone loss weight value smaller than the organ loss weight value; during the process of training the preset segmentation network, if the organ loss value corresponding to the organ loss function is less than the first set loss value and / or the total loss value corresponding to the organ loss function and the stone loss function is less than the second set loss value, then during each training process of continuing to train the preset segmentation network, according to a set ratio, increase and regulate the stone loss weight value to obtain the stone loss regulation weight value; according to the stone loss regulation weight value, determine the organ loss regulation weight value corresponding to the organ loss weight value; based on the stone loss regulation weight value and the organ loss regulation weight value, calculate the stone loss value corresponding to the stone loss function and the total loss value corresponding to the organ loss function and the stone loss function; if the stone loss value is less than the third set loss value and / or the total loss value corresponding to the organ loss function and the stone loss function is less than the fourth set loss value, then stop training the preset segmentation network.

[0063] In the embodiments of the present disclosure and other possible embodiments, the method for determining the organ loss regulation weight value corresponding to the organ loss weight value according to the stone loss regulation weight value includes: obtaining the set configuration value corresponding to the sum of the organ loss weight value and the stone loss weight value; subtracting the stone loss regulation weight value from the set configuration value to determine the organ loss regulation weight value corresponding to the organ loss weight value.

[0064] Wherein, in the embodiments of the present disclosure and other possible embodiments, the set configuration value corresponding to the sum of the organ loss weight value and the stone loss weight value is configured to be 1.

[0065] Among the embodiments of the present disclosure and other possible embodiments, the organ loss function and the calculus loss function are respectively configured as one or more of a cross-entropy loss function, a Dice loss function, a Focal loss function, a Tversky loss function, a Tversky loss function, and an IoU loss function.

[0066] Among the embodiments of the present disclosure and other possible embodiments, the preset segmentation network is configured as one or more of segmentation networks such as Unet, ResUnet, Unet++, ResUnet++, nnUnet, SegNet, PSPNet, DeepLab, RefineNet, Medformer, or an improved segmentation network thereof.

[0067] In the embodiments of the present disclosure and other possible embodiments, the method for determining the calculus position corresponding to each calculus type based on the spatial position relationship between the calculus mask in the calculus mask image and the left kidney and / or ureter and / or bladder mask and the right kidney and / or ureter and / or bladder mask in the kidney and / or ureter and / or bladder mask image includes: extracting a plurality of two-dimensional slice calculus mask images corresponding to each calculus type from the calculus mask image; if the spatial position of the calculus mask corresponding to the plurality of two-dimensional slice calculus mask images is within the spatial position of the left kidney and / or ureter and / or bladder mask of the two-dimensional slice calculus mask image corresponding to the corresponding slice of the kidney and / or ureter and / or bladder mask image, the calculus corresponding to the spatial position of the calculus mask is configured as a left kidney and / or ureter and / or bladder calculus; if the spatial position of the calculus mask corresponding to the plurality of two-dimensional slice calculus mask images is within the spatial position of the right kidney and / or ureter and / or bladder mask of the two-dimensional slice calculus mask image corresponding to the corresponding slice of the kidney and / or ureter and / or bladder mask image, the calculus corresponding to the spatial position of the calculus mask is configured as a right kidney and / or ureter and / or bladder calculus.

[0068] In the embodiments of the present disclosure, the method for extracting calculus information corresponding to the set output item from the dual-energy abdominal image according to the set output item corresponding to the urinary calculus composition report template includes: if the set output item is configured as the calculus gray value, respectively based on each two-dimensional slice dual-energy abdominal image in the dual-energy abdominal image and the two-dimensional slice calculus mask image in the calculus mask image corresponding to the corresponding slice, extracting a calculus image with the original gray value from the dual-energy abdominal image; respectively calculating the average gray value corresponding to each calculus type in the calculus mask image to determine the calculus gray value corresponding to each calculus type.

[0069] In the embodiments of the present disclosure and other possible embodiments, the method for extracting a stone image with original gray values from the dual-energy abdominal image based on each two-dimensional slice of the dual-energy abdominal image and the two-dimensional slice stone mask image of its corresponding slice includes: performing a multiplication operation on each two-dimensional slice of the dual-energy abdominal image and the two-dimensional slice stone mask image of its corresponding slice in the dual-energy abdominal image to obtain a stone gray value image; based on the mask values and stone spatial positions corresponding to each stone type in the two-dimensional slice stone mask image of the stone gray value image and its corresponding slice, performing gray value restoration on the stone gray value image to obtain a stone image with original gray values.

[0070] In the embodiments of the present disclosure and other possible embodiments, the method for performing gray value restoration on the stone gray value image based on the mask values and stone spatial positions corresponding to each stone type in the two-dimensional slice stone mask image of the stone gray value image and its corresponding slice to obtain a stone image with original gray values includes: respectively extracting the mask values and stone spatial positions corresponding to each stone type in the two-dimensional slice stone mask image of the stone mask image; based on the stone spatial positions corresponding to each stone type, respectively performing stone type spatial position localization on the stone gray value image to obtain spatial position localization images corresponding to each stone type in the two-dimensional slice stone gray value image of the stone gray value image; dividing the spatial position localization images corresponding to each stone type in the two-dimensional slice stone gray value image of the stone gray value image by the mask values corresponding to the stone spatial positions to obtain a stone image with original gray values.

[0071] In the embodiments of the present disclosure, the method for extracting stone information corresponding to the set output item from the dual-energy abdominal image according to the set output item corresponding to the urinary system stone composition report template includes: if the set output item is configured as the stone type, obtaining the urinary system stone atomic number image corresponding to the dual-energy abdominal image; based on the urinary system stone atomic number image, identifying the stone type corresponding to the dual-energy abdominal image. To solve the technical problem that it is difficult to distinguish or identify mixed urinary system stones with different components, so that the diagnostic requirements for mixed component stones more than single component stones in clinical practice cannot be met.

[0072] In the embodiments of the present disclosure and other possible embodiments, the method for identifying the stone type corresponding to the dual-energy abdominal image based on the atomic number image of urinary system stones includes: extracting multiple component percentages corresponding to the peaks of multiple strip charts corresponding to the effective atomic numbers in the atomic number image of urinary system stones; and identifying the stone type corresponding to the dual-energy abdominal image based on the multiple component percentages corresponding to the multiple strip charts and multiple preset component percentage ranges of stone types.

[0073] In the embodiments of the present disclosure and other possible embodiments, the method for identifying the stone type corresponding to the dual-energy abdominal image based on the multiple component percentages corresponding to the multiple strip charts and multiple preset component percentage ranges of stone types includes: if the component percentage in the multiple component percentages is within the range of a certain preset component percentage range of the multiple preset component percentage ranges of stone types; configuring the stone type corresponding to the certain preset component percentage range as the stone type corresponding to the component percentage within the range.

[0074] In the embodiments of the present disclosure and other possible embodiments, the method for extracting multiple component percentages corresponding to the peaks of multiple strip charts corresponding to the effective atomic numbers in the atomic number image of urinary system stones includes: obtaining a preset strip chart color and / or a preset strip chart width; extracting, according to the preset strip chart color and / or the preset strip chart width, multiple strip charts corresponding to the effective atomic numbers in the atomic number image of urinary system stones that meet the preset strip chart color and / or the preset strip chart width; and determining multiple component percentages corresponding to the peaks of the multiple strip charts according to the multiple strip charts corresponding to the effective atomic numbers in the atomic number image of urinary system stones that meet the preset strip chart color and / or the preset strip chart width.

[0075] In the embodiments of the present disclosure and other possible embodiments, those skilled in the art can configure the preset strip chart color configuration and / or the preset strip chart width according to actual needs. For example, the preset strip chart color is configured as yellow.

[0076] In the embodiments of the present disclosure and other possible embodiments, before extracting multiple bar graphs corresponding to the effective atomic numbers in the atomic number image of the urinary system stones or extracting multiple bar graphs corresponding to the effective atomic numbers that meet the set bar graph color and / or set bar graph width in the atomic number image of the urinary system stones, the atomic number image of the urinary system stones is corrected to obtain a corrected atomic number image of the urinary system stones; multiple component percentages corresponding to the peaks of the multiple bar graphs corresponding to the effective atomic numbers in the corrected atomic number image of the urinary system stones are extracted, or multiple component percentages corresponding to the peaks of the multiple bar graphs corresponding to the effective atomic numbers that meet the set bar graph color and / or set bar graph width in the corrected atomic number image of the urinary system stones are extracted.

[0077] In the embodiments of the present disclosure and other possible embodiments, the method for correcting the atomic number image of the urinary system stones to obtain a corrected atomic number image of the urinary system stones includes: performing at least one correction processing operation such as angle adjustment, contrast enhancement, and scaling on the atomic number image of the urinary system stones to obtain a corrected atomic number image of the urinary system stones, so as to facilitate the extraction of multiple bar graphs corresponding to the effective atomic numbers in the later stage.

[0078] In the embodiments of the present disclosure and other possible embodiments, multiple component percentages corresponding to the peaks of the multiple bar graphs corresponding to the effective atomic numbers in the atomic number image of the urinary system stones are extracted by using optical character recognition technology; or, multiple component percentages corresponding to the peaks of the multiple bar graphs corresponding to the effective atomic numbers that meet the set bar graph color and / or set bar graph width in the corrected atomic number image of the urinary system stones are extracted by using optical character recognition technology.

[0079] In the embodiments of the present disclosure and other possible embodiments, optical character recognition technology (OCR) is a computer vision technology that recognizes and extracts the text content in an image through image processing and machine learning algorithms, and converts it into a machine-readable and editable text format.

[0080] In an embodiment of the present disclosure, the method for identifying the stone type corresponding to the dual-energy abdominal image based on the multiple component percentages corresponding to the multiple bar graphs and the multiple set stone type component percentage ranges includes: obtaining a set component percentage corresponding to the minimum value in the set stone type component percentage range; if the component percentages corresponding to the multiple bar graphs are less than the set component percentage, deleting the component percentages corresponding to less than the set component percentage from the multiple component percentages corresponding to the multiple bar graphs; otherwise, retaining the component percentages corresponding to greater than or equal to the set component percentage; and identifying the stone type corresponding to the dual-energy abdominal image based on the retained multiple component percentages and the multiple set stone type component percentage ranges.

[0081] In the embodiments of the present disclosure and other possible embodiments, those skilled in the art can configure the set component percentage corresponding to the minimum value in the set stone type component percentage range according to actual needs. For example, the set component percentage corresponding to the minimum value in the set stone type component percentage range is configured to 5%.

[0082] In the embodiments of the present disclosure and other possible embodiments, the implementation of OCR requires calling the API of the GOT_OCR2 tool and setting its parameters such as language and text box positioning; the atomic number peak recognition and morphological calculation need to use the NumPy, SciPy or OpenCV libraries of Python to perform the extraction of the multiple component percentages corresponding to the peaks of the multiple bar graphs corresponding to the effective atomic numbers in the urinary system stone atomic number image or the multiple component percentages corresponding to the peaks of the multiple bar graphs corresponding to the effective atomic numbers that meet the set bar graph color and / or set bar graph width in the urinary system stone atomic number image.

[0083] In an embodiment of the present disclosure, the method for identifying the stone type corresponding to the dual-energy abdominal image based on the multiple component percentages corresponding to the multiple bar graphs and the multiple set stone type component percentage ranges includes: obtaining a set component percentage corresponding to the minimum value in the set stone type component percentage range; if the component percentages corresponding to the multiple bar graphs are less than the set component percentage, deleting the component percentages corresponding to less than the set component percentage from the multiple component percentages corresponding to the multiple bar graphs; otherwise, retaining the component percentages corresponding to greater than or equal to the set component percentage; and identifying the stone type corresponding to the dual-energy abdominal image based on the retained multiple component percentages and the multiple set stone type component percentage ranges.

[0084] In embodiments of the present disclosure and other possible embodiments, the method for identifying the stone type corresponding to the dual-energy abdominal image based on the multiple component percentages corresponding to the multiple bar graphs and the multiple preset stone type component percentage ranges further includes: if there is an overlapping range in the preset stone type component percentage ranges corresponding to at least two component percentages among the multiple component percentages corresponding to the multiple bar graphs, obtaining an iodine-based image corresponding to the dual-energy abdominal image; and identifying the stone type corresponding to the overlapping range based on the iodine-based image corresponding to the dual-energy abdominal image.

[0085] In embodiments of the present disclosure and other possible embodiments, the method for identifying the stone type corresponding to the overlapping range based on the iodine-based image corresponding to the dual-energy abdominal image includes: determining the stone gray value corresponding to the iodine-based image corresponding to the dual-energy abdominal image; respectively calculating the average gray value and the uniformity corresponding to the stone gray value; if the average gray value is greater than the preset average gray value and the uniformity is greater than the preset uniformity, configuring the stone type as calcium oxalate dihydrate stone; otherwise, configuring the stone type as struvite stone or carbonate apatite stone.

[0086] In embodiments of the present disclosure and other possible embodiments, those skilled in the art can configure the preset average gray value and the preset uniformity according to actual needs.

[0087] In embodiments of the present disclosure and other possible embodiments, uniformity = (maximum value - minimum value) / (2 * average value) × 100%. Wherein, the maximum value represents the maximum value corresponding to the stone gray value, the minimum value represents the minimum value corresponding to the stone gray value, and the average value represents the average gray value corresponding to the stone gray value.

[0088] In embodiments of the present disclosure and other possible embodiments, the multiple preset stone type component percentage ranges include one or several of: uric acid stone component percentage range, calcium oxalate monohydrate stone component percentage range, calcium oxalate dihydrate stone component percentage range, carbonate apatite stone component percentage range, calcium carbonate phosphate stone component percentage range, struvite stone component percentage range.

[0089] In embodiments of the present disclosure and other possible embodiments, the uric acid stone component percentage range is configured as 6.5 - 10.5, the calcium oxalate monohydrate stone component percentage range is configured as 13.3 - 14.0, the calcium oxalate dihydrate stone component percentage range is configured as 12.0 - 13.3, the carbonate apatite stone component percentage range is configured as 14.0 - 15.0, the calcium carbonate phosphate stone component percentage range is configured as greater than 12.5, and the struvite stone component percentage range is configured as less than 12.5.

[0090] In embodiments of the present disclosure and other possible embodiments, the Zeff peak value (component percentage range) of uric acid stones is between 6.5 and 10.5; the Zeff peak value of calcium oxalate monohydrate stones is between 13.3 and 14.0; the Zeff peak value of calcium oxalate dihydrate stones is between 12.0 and 13.3; the Zeff peak value of carbonate apatite stones is between 14.0 and 15.0; the Zeff peak value of calcium carbonate phosphate stones is greater than 12.5 and all have CT value images with uneven density; the Zeff peak of struvite stones is less than 12.5 and all have CT value images with uneven density.

[0091] In embodiments of the present disclosure and other possible embodiments, the method for identifying the stone type corresponding to the dual-energy abdominal image based on the multiple component percentages corresponding to the multiple bar graphs and the multiple set stone type component percentage ranges includes: constructing a stone component comparison table according to the multiple set stone type component percentage ranges; based on the stone component comparison table, performing a look-up and comparison operation on the multiple component percentages corresponding to the multiple bar graphs to identify the stone type corresponding to the dual-energy abdominal image.

[0092] In an embodiment of the present disclosure, the method for extracting the stone information corresponding to the set output item from the dual-energy abdominal image according to the set output item corresponding to the urinary tract stone composition report template includes: if the set output item is configured as one or several of the main peak value of atomic number, the sub-peak value of atomic number, and the third peak value of atomic number, obtaining the urinary tract stone atomic number image corresponding to the dual-energy abdominal image; extracting multiple bar graphs corresponding to the effective atomic numbers in the urinary tract stone atomic number image; determining multiple component percentages corresponding to the peaks of the multiple bar graphs according to the multiple bar graphs that meet the set bar graph color and / or set bar graph width in the urinary tract stone atomic number image; based on the multiple component percentages corresponding to the peaks of the multiple bar graphs, determining one or several of the main peak value of atomic number corresponding to the largest component percentage among the multiple component percentages, the sub-peak value of atomic number corresponding to the second largest component percentage among the multiple component percentages, and the third peak value of atomic number corresponding to the third largest component percentage among the multiple component percentages.

[0093] In embodiments of the present disclosure and other possible embodiments, the method for extracting multiple bar graphs corresponding to the effective atomic numbers in the urinary tract stone atomic number image includes: obtaining the set bar graph color and / or set bar graph width; extracting multiple bar graphs corresponding to the effective atomic numbers that meet the set bar graph color and / or set bar graph width in the urinary tract stone atomic number image according to the set bar graph color and / or set bar graph width.

[0094] In an embodiment of the present disclosure, the method of inserting the set output items and their corresponding stone information into the dual-energy abdominal image to generate a urinary stone composition report includes: adding the stone information to the corresponding positions of the set output items to generate a urinary stone composition report to be inserted; inserting the urinary stone composition report to be inserted into the dual-energy abdominal image to generate a urinary stone composition report.

[0095] In an embodiment of the present disclosure, the method of adding the stone information to the corresponding positions of the set output items to generate a urinary stone composition report to be inserted includes: respectively obtaining the corresponding positions where the areas to be filled of the set output items are located; respectively adding the corresponding stone information to the corresponding positions of the set output items to generate a urinary stone composition report to be inserted.

[0096] Step S103: Insert the set output items and their corresponding stone information into the dual-energy abdominal image to generate a urinary stone composition report.

[0097] The execution subject of the urinary stone composition report generation method may be an image processing device. For example, the urinary stone composition report generation method may be executed by a terminal device, a server, or other processing devices. Among them, the terminal device may be a user equipment (UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, etc. In some possible implementation manners, the urinary stone composition report generation method may be implemented by a processor calling computer-readable instructions stored in a memory.

[0098] Those skilled in the art can understand that in the above-mentioned urinary stone composition report generation method in the specific implementation manner, the writing order of each step does not mean a strict execution order and does not impose any limitation on the implementation process. The specific execution order of each step should be determined according to its function and possible internal logic.

[0099] According to one aspect of the embodiments of the present disclosure, there is provided a urinary calculus composition report generation device or system, including: an acquisition unit, configured to acquire a dual-energy abdominal image and its corresponding urinary calculus composition report template; an extraction unit, configured to extract calculus information corresponding to the set output items from the dual-energy abdominal image according to the set output items corresponding to the urinary calculus composition report template; a first generation unit, configured to add the calculus information to the corresponding positions of the set output items to generate a urinary calculus composition report to be inserted; a second generation unit, configured to insert the urinary calculus composition report to be inserted into the dual-energy abdominal image to generate a urinary calculus composition report. To solve the technical problem that the urinary calculus composition report requires a radiologist to measure and analyze the corresponding values by himself / herself, and then make a rough judgment based on literature reports and his / her own experience to complete the report writing, which causes a lot of time and energy of the radiologist and cannot guarantee the accuracy of the urinary calculus composition diagnosis.

[0100] According to one aspect of the embodiments of the present disclosure, there is provided a urinary calculus composition report generation device or system, including: an electronic device, the electronic device being configured with a processor and a memory for storing instructions executable by the processor; wherein, the processor is configured to call the instructions stored in the memory to execute the above-mentioned urinary calculus composition report generation method. To solve the technical problem that the urinary calculus composition report requires a radiologist to measure and analyze the corresponding values by himself / herself, and then make a rough judgment based on literature reports and his / her own experience to complete the report writing, which causes a lot of time and energy of the radiologist and cannot guarantee the accuracy of the urinary calculus composition diagnosis.

[0101] According to one aspect of the embodiments of the present disclosure, there is provided a urinary calculus composition report generation device or system, including: a processor; a memory for storing instructions executable by the processor; wherein, the processor is configured to call the instructions stored in the memory to execute the above-mentioned urinary calculus composition report generation method. To solve the technical problem that the urinary calculus composition report requires a radiologist to measure and analyze the corresponding values by himself / herself, and then make a rough judgment based on literature reports and his / her own experience to complete the report writing, which causes a lot of time and energy of the radiologist and cannot guarantee the accuracy of the urinary calculus composition diagnosis.

[0102] According to one aspect of the embodiments of the present disclosure, there is provided a device or system for generating a report on the composition of urinary system stones, including: a computer-readable storage medium storing computer program instructions thereon, and when the computer program instructions are executed by a processor, the above-described method for generating a report on the composition of urinary system stones is implemented. This is to solve the technical problem that for a report on the composition of urinary system stones, a radiologist needs to measure and analyze corresponding values by himself / herself, and then make a rough judgment based on literature reports and his / her own experience to complete the report writing, which takes a large amount of time and energy of the radiologist and cannot guarantee the accuracy of the diagnosis of the composition of urinary system stones.

[0103] According to one aspect of the embodiments of the present disclosure, there is provided a device or system for generating a report on the composition of urinary system stones, including: a computer program product including a computer program / instructions, and when the computer program / instructions are executed by a processor, the above-described method for generating a report on the composition of urinary system stones is implemented. This is to solve the technical problem that for a report on the composition of urinary system stones, a radiologist needs to measure and analyze corresponding values by himself / herself, and then make a rough judgment based on literature reports and his / her own experience to complete the report writing, which takes a large amount of time and energy of the radiologist and cannot guarantee the accuracy of the diagnosis of the composition of urinary system stones.

[0104] The technical solution provided by the embodiments of the present disclosure does not require a radiologist to measure and analyze corresponding values by himself / herself and write a diagnosis report on the composition of urinary system stones, thus greatly saving the time and energy of the radiologist and at the same time ensuring the accuracy of the diagnosis of the composition of urinary system stones.

[0105] In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the methods described in the above method embodiments. The specific implementation can refer to the description of the above method embodiments for generating a report on the composition of urinary system stones. For the sake of brevity, it will not be repeated here.

[0106] The embodiments of the present disclosure also propose a computer-readable storage medium storing computer program instructions thereon, and when the computer program instructions are executed by a processor, the above-described method for generating a report on the composition of urinary system stones is implemented. The computer-readable storage medium can be a non-volatile computer-readable storage medium.

[0107] The embodiments of the present disclosure also propose an electronic device, including: a processor; a memory for storing instructions executable by the processor; wherein, the processor is configured to execute the above-described method for generating a report on the composition of urinary system stones. Among them, the electronic device can be provided as a terminal, a server or other forms of devices.

[0108] Figure 2FIG. 0 is a block diagram of an electronic device 800 shown in accordance with an exemplary embodiment. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like.

[0109] Referring Figure 2 to FIG. 5, the electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0110] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-described methods. In addition, the processing component 802 may include one or more modules to facilitate interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

[0111] The memory 804 is configured to store various types of data to support the operation of the electronic device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, and the like. The memory 804 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, a disk, or an optical disc.

[0112] The power component 806 provides power to the various components of the electronic device 800. The power component 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the electronic device 800.

[0113] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can sense not only the boundaries of the touch or swipe actions but also detect the duration and pressure associated with the touch or swipe operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the electronic device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each of the front camera and the rear camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

[0114] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC) that is configured to receive external audio signals when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, the audio component 810 further includes a speaker for outputting audio signals.

[0115] The I / O interface 812 provides an interface between the processing component 802 and a peripheral interface module, and the peripheral interface module can be a keyboard, a click wheel, buttons, etc. These buttons can include but are not limited to: a home button, a volume button, a power button, and a lock button.

[0116] The sensor component 814 includes one or more sensors for providing a status assessment of various aspects of the electronic device 800. For example, the sensor component 814 can detect the on / off state of the electronic device 800, the relative positioning of components, such as the display and the keypad of the electronic device 800. The sensor component 814 can also detect a change in the position of the electronic device 800 or a component of the electronic device 800, the presence or absence of user contact with the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor component 814 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor component 814 can also include a light sensor, such as a CMOS or a CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 814 can further include an acceleration sensor, a gyro sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0117] The communication component 816 is configured to facilitate communication between the electronic device 800 and other devices in a wired or wireless manner. The electronic device 800 can access a communication standard-based wireless network, such as WiFi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0118] In an exemplary embodiment, the electronic device 800 can be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the above method.

[0119] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 804 including computer program instructions, and the above computer program instructions can be executed by a processor 820 of the electronic device 800 to complete the above method.

[0120] Figure 3 is a block diagram of an electronic device 1900 shown according to an exemplary embodiment. For example, the electronic device 1900 can be provided as a server. Referring to Figure 3 , the electronic device 1900 includes a processing component 1922, which further includes one or more processors, and memory resources represented by a memory 1932 for storing instructions executable by the processing component 1922, such as application programs. The application programs stored in the memory 1932 can include one or more modules each corresponding to a set of instructions. In addition, the processing component 1922 is configured to execute instructions to perform the above method.

[0121] The electronic device 1900 may further include a power component 1926 configured to perform power management of the electronic device 1900, a wired or wireless network interface 1950 configured to connect the electronic device 1900 to a network, and an input / output (I / O) interface 1958. The electronic device 1900 can operate based on an operating system stored in the memory 1932, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, or the like.

[0122] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 1932 including computer program instructions, and the computer program instructions can be executed by a processing component 1922 of the electronic device 1900 to complete the above method.

[0123] The present disclosure may be a system, a method, and / or a computer program product. The computer program product may include a computer-readable storage medium having thereon computer-readable program instructions for causing a processor to implement various aspects of the present disclosure.

[0124] A computer-readable storage medium may be a tangible device that can retain and store instructions for use by an instruction execution device. A computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disc (DVD), a memory stick, a floppy disk, a mechanically encoded device such as a punch card or raised structures in a groove having instructions stored thereon, and any suitable combination of the foregoing. The computer-readable storage medium as used herein is not construed as being a transitory signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., an optical pulse through an optical fiber cable), or an electrical signal transmitted through a wire.

[0125] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to respective computing / processing devices, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network may include a copper transmission cable, an optical fiber transmission, a wireless transmission, a router, a firewall, a switch, a gateway computer, and / or an edge server. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in each computing / processing device.

[0126] The computer program instructions for performing the operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine - related instructions, microcode, firmware instructions, state - setting data, or source code or object code written in any combination of one or more programming languages, including object - oriented programming languages such as Smalltalk, C++, etc., and conventional procedural programming languages such as the "C" language or similar programming languages. The computer - readable program instructions may be executed entirely on the user's computer, partially on the user's computer, executed as a stand - alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider). In some embodiments, by using the state information of the computer - readable program instructions to customize an electronic circuit, such as a programmable logic circuit, a field - programmable gate array (FPGA), or a programmable logic array (PLA), the electronic circuit can execute the computer - readable program instructions to implement various aspects of the present disclosure.

[0127] Aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present disclosure. It should be understood that each block of the flowcharts and / or block diagrams, and combinations of blocks in the flowcharts and / or block diagrams, can be implemented by computer - readable program instructions.

[0128] These computer - readable program instructions can be provided to a processor of a general - purpose computer, a special - purpose computer, or other programmable data - processing apparatus to produce a machine such that the instructions, when executed by the processor of the computer or other programmable data - processing apparatus, create a means for implementing the functions / acts specified in one or more blocks of the flowchart and / or block diagram. These computer - readable program instructions can also be stored in a computer - readable storage medium, which causes a computer, a programmable data - processing apparatus, and / or other devices to operate in a particular manner, so that the computer - readable medium storing the instructions includes a manufacture that includes instructions for implementing various aspects of the functions / acts specified in one or more blocks of the flowchart and / or block diagram.

[0129] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device, causing a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process such that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in one or more boxes of the flowchart and / or block diagram.

[0130] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a segment of code, or a portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions noted in the blocks may occur out of the order noted in the figures. For example, two consecutive blocks may in fact be executed substantially in parallel, or they may sometimes be executed in the reverse order, depending upon the functionality involved. It should also be noted that each block of the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented by a dedicated hardware-based system that performs the specified function or act, or by a combination of dedicated hardware and computer instructions.

[0131] The embodiments of the present disclosure have been described above. The above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The choice of terms used herein is intended to best explain the principles of the embodiments, the practical application, or the technical improvement of technologies in the market, or to enable other ordinary skilled persons in the art to understand the embodiments disclosed herein.

Claims

1. A method for generating a report on the composition of urinary tract stones, characterized in that, Including: Obtain dual-energy abdominal images and their corresponding urinary stone composition report templates; Extract the stone information corresponding to the set output items from the dual-energy abdominal images according to the set output items corresponding to the urinary stone composition report templates; Insert the set output items and their corresponding stone information into the dual-energy abdominal images to generate a urinary stone composition report.

2. The method for generating a urinary calculus composition report according to claim 1, wherein The method of extracting the stone information corresponding to the set output items from the dual-energy abdominal images according to the set output items corresponding to the urinary stone composition report templates includes: If the set output item is configured as one or several pieces of information among stone shape, major axis and minor axis corresponding to the stone, and stone volume, then Calculate the stone areas corresponding to each stone type in each two-dimensional slice of the stone mask image corresponding to the dual-energy abdominal image respectively; obtain multiple stone areas; calculate the major axis and minor axis corresponding to the largest stone area among the multiple stone areas corresponding to each stone type respectively, to obtain the major axis and minor axis corresponding to each stone type; and / or, Perform edge detection on the stones corresponding to each stone type on the stone mask image corresponding to the dual-energy abdominal image respectively to obtain stone edge mask lines; fit the stone edge mask lines corresponding to each stone type respectively to obtain the stone shapes corresponding to each stone type; and / or, Reconstruct the mask images corresponding to each stone type in the stone mask image corresponding to the dual-energy abdominal image respectively to obtain the stone volumes corresponding to each stone type.

3. The method for generating a urinary calculus composition report according to any one of claims 1-2, characterized in that, The method of extracting the stone information corresponding to the set output items from the dual-energy abdominal images according to the set output items corresponding to the urinary stone composition report templates includes: If the set output item is configured as the lesion location, segment the dual-energy abdominal image for the kidney and / or ureter and / or bladder to obtain a kidney and / or ureter and / or bladder mask image; According to the kidney and / or ureter and / or bladder mask image, configure the kidney and / or ureter and / or bladder mask in the kidney and / or ureter and / or bladder mask image as the left kidney and / or ureter and / or bladder mask and the right kidney and / or ureter and / or bladder mask; Based on the spatial position relationship between the stone masks in the stone mask image and the left and right kidney and / or ureter and / or bladder masks in the kidney and / or ureter and / or bladder mask image, determine the stone positions corresponding to each stone type.

4. The method for generating a urinary calculus composition report according to any one of claims 1-3, characterized in that, The method of extracting the stone information corresponding to the set output items from the dual-energy abdominal images according to the set output items corresponding to the urinary stone composition report templates includes: If the set output item is configured as the stone gray value, based on each two-dimensional slice of the dual-energy abdominal image in the dual-energy abdominal image and the two-dimensional slice stone mask image in the corresponding slice of the stone mask image respectively, extract the stone image with the original gray value from the dual-energy abdominal image; calculate the average gray value corresponding to each stone type in the stone mask image respectively to determine the stone gray value corresponding to each stone type.

5. The method for generating a urinary calculus composition report according to any one of claims 1-4, characterized in that, The method for extracting stone information corresponding to the set output item from the dual-energy abdominal image according to the set output item corresponding to the urinary tract stone composition report template includes: If the set output item is configured as the stone type, obtain the atomic number image of the urinary tract stone corresponding to the dual-energy abdominal image; based on the atomic number image of the urinary tract stone, identify the stone type corresponding to the dual-energy abdominal image.

6. The method for generating a urinary calculus composition report according to any one of claims 1-5, characterized in that, The method for extracting stone information corresponding to the set output item from the dual-energy abdominal image according to the set output item corresponding to the urinary tract stone composition report template includes: If the set output item is configured as one or several of the main peak of atomic number, the secondary peak of atomic number, and the third peak of atomic number, then Obtain the atomic number image of the urinary tract stone corresponding to the dual-energy abdominal image; Extract multiple strip charts corresponding to the effective atomic numbers in the atomic number image of the urinary tract stone; According to the atomic number image of the urinary tract stone, determine the component percentages of multiple peaks corresponding to the multiple strip charts; Based on the component percentages of multiple peaks corresponding to the multiple strip charts, determine one or several of the main peak of atomic number corresponding to the largest component percentage among the multiple component percentages, the secondary peak of atomic number corresponding to the second largest component percentage among the multiple component percentages, and the third peak of atomic number corresponding to the third largest component percentage among the multiple component percentages.

7. The method for generating a urinary calculus composition report according to any one of claims 1-6, characterized in that, The method for inserting the set output item and its corresponding stone information into the dual-energy abdominal image to generate a urinary tract stone composition report includes: adding the stone information to the corresponding position of the set output item to generate a urinary tract stone composition report to be inserted; inserting the urinary tract stone composition report to be inserted into the dual-energy abdominal image to generate a urinary tract stone composition report; and / or, The method for adding the stone information to the corresponding position of the set output item to generate a urinary tract stone composition report to be inserted includes: respectively obtaining the corresponding positions where the areas to be filled of the set output item are located; Respectively add the corresponding stone information to the corresponding position of the set output item to generate a urinary tract stone composition report to be inserted.

8. A urinary calculus composition report generation system, characterized in that, Includes: An acquisition unit for acquiring a dual-energy abdominal image and its corresponding urinary tract stone composition report template; An extraction unit for extracting stone information corresponding to the set output item from the dual-energy abdominal image according to the set output item corresponding to the urinary tract stone composition report template; A first generation unit for adding the stone information to the corresponding position of the set output item to generate a urinary tract stone composition report to be inserted; A second generation unit for inserting the urinary tract stone composition report to be inserted into the dual-energy abdominal image to generate a urinary tract stone composition report.

9. A urinary calculus composition report generation system, characterized in that, Includes: An electronic device, the electronic device is configured with a processor and a memory for storing instructions executable by the processor; wherein, the processor is configured to call the instructions stored in the memory to execute the method for generating a urinary tract stone composition report according to any one of claims 1 to 7; or, Comprising: a processor; a memory for storing instructions executable by the processor; wherein the processor is configured to call the instructions stored in the memory to execute the urinary calculus composition report generation method according to any one of claims 1 to 7.

10. A urinary calculus composition report generation system, characterized in that, Comprising: A computer-readable storage medium having computer program instructions stored thereon, the computer program instructions, when executed by a processor, implement the urinary calculus composition report generation method according to any one of claims 1 to 7; or, Comprising: a computer program product, including a computer program / instructions, the computer program / instructions, when executed by a processor, implement the urinary calculus composition report generation method according to any one of claims 1 to 7.

Images