Urinary stone composition report generation method and system

Abstract

The present disclosure relates to a urinary stone composition report generation method and system, and relates to the technical field of urinary stone composition report generation. The urinary stone composition report generation method comprises the following steps: acquiring a dual-energy abdominal image and a corresponding urinary stone composition report template; extracting stone information corresponding to a set output item from the dual-energy abdominal image according to the set output item corresponding to the urinary stone composition report template; inserting the set output item and the corresponding stone information into the dual-energy abdominal image to generate a urinary stone composition report. The present disclosure can realize the generation of a urinary stone composition report.

Description

Technical Field

[0001] This disclosure relates to the field of urinary tract stone composition report generation technology, and in particular to a method and system for generating urinary tract stone composition reports. Background Technology

[0002] Routine CT scans cannot further differentiate between non-uric acid stones because even among single-component non-uric acid stones, there is still overlap in the CT values ​​of stones containing components such as calcium oxalate monohydrate, calcium oxalate dihydrate, carbonate apatite, struvite, and calcium carbonate. Therefore, CT values ​​alone cannot differentiate them. Furthermore, mixed-component stones are far more common clinically than single-component stones. Even stones formed from a mixture of two components will yield different average CT values ​​depending on the proportions of the two components, making it impossible to accurately identify mixed stones with different components.

[0003] The average atomic number value of spectral CT can accurately distinguish between uric acid stones and non-uric acid stones, and also has a certain diagnostic specificity for single-component non-uric acid stones. However, the average atomic number value of spectral CT is not applicable to mixed-component stones, which account for the largest proportion in clinical practice. This is because the calculation method of the average atomic number value for mixed components is closely related to the percentage and type of different components. Therefore, the average atomic number value cannot accurately distinguish between mixed urinary tract stones of different components.

[0004] Furthermore, when using CT values ​​and average atomic number values ​​to diagnose the composition of urinary tract stones, radiologists need to measure and analyze the corresponding values ​​themselves, and then make a rough judgment based on literature reports and their own experience to complete the report writing. This not only consumes a lot of time and energy for radiologists, but also cannot guarantee the accuracy of the diagnosis of the composition of urinary tract stones. Summary of the Invention

[0005] This disclosure presents a technical solution for a method and system for generating a report on the composition of urinary tract stones.

[0006] According to one aspect of this disclosure, a method for generating a urinary tract stone composition report is provided, comprising:

[0007] Obtain a dual-energy abdominal image and its corresponding urinary tract stone composition report template; wherein the dual-energy abdominal image is a dual-energy abdominal CT image; according to the set output items corresponding to the urinary tract stone composition report template, extract the stone information corresponding to the set output items from the dual-energy abdominal image; wherein the set output items include one or more of the following: stone type, stone location, stone shape, stone calorific value, the long and short diameters of the stone, and stone volume; insert the set output items and their corresponding stone information into the dual-energy abdominal image to generate a urinary tract stone composition report.

[0008] Preferably, the method for extracting stone information corresponding to the set output item from the dual-energy abdominal image based on the set output item corresponding to the urinary tract stone composition report template includes: if the set output item is configured as one or more of the following information: stone shape, the major and minor diameters of the stone, and stone volume, then

[0009] Calculate the area of ​​each stone type in each two-dimensional slice stone mask image in the stone mask image corresponding to the dual-energy abdominal image; obtain multiple stone areas; calculate the major and minor axes corresponding to the largest stone area among the multiple stone areas corresponding to each stone type; obtain the major and minor axes corresponding to each stone type; and / or, perform edge detection on the stones corresponding to each stone type in the stone mask image corresponding to the dual-energy abdominal image to obtain stone edge mask lines; fit the stone edge mask lines corresponding to each stone type to obtain the stone shape corresponding to each stone type; and / or, reconstruct the mask images corresponding to each stone type in the stone mask image corresponding to the dual-energy abdominal image to obtain the stone volume corresponding to each stone type.

[0010] Preferably, the method for extracting stone information corresponding to the set output item from the dual-energy abdominal image based on the set output item corresponding to the urinary tract stone composition report template includes: if the set output item is configured as lesion location, then the dual-energy abdominal image is segmented into kidney and / or ureter and / or bladder to obtain kidney and / or ureter and / or bladder mask images; based on the kidney and / or ureter and / or bladder mask images, the kidney and / or ureter and / or bladder masks in the kidney and / or ureter and / or bladder mask images are configured as left kidney and / or ureter and / or bladder masks and right kidney and / or ureter and / or bladder masks; based on the spatial positional relationship between the stone masks in the stone mask images and the left kidney and / or ureter and / or bladder masks and right kidney and / or ureter and / or bladder masks in the kidney and / or ureter and / or bladder mask images, the stone location corresponding to each stone type is determined.

[0011] Preferably, the method for determining the location of stones corresponding to each stone type based on the spatial relationship between the stone mask in the stone mask image and the masks of the lateral kidney and / or ureter and / or bladder in the kidney and / or ureter and / or bladder mask image includes: extracting multiple two-dimensional slice stone mask images corresponding to each stone type from the stone mask image; if the spatial location of the stone mask corresponding to the multiple two-dimensional slice stone mask images is in the corresponding slice of the kidney and / or ureter and / or bladder mask image... If the spatial location of the left kidney and / or ureter and / or bladder is within the mask space of the two-dimensional slice stone mask image, then the stone corresponding to the stone mask space location is configured as a left kidney and / or ureter and / or bladder stone; if the spatial location of the stone mask corresponding to the plurality of two-dimensional slice stone mask images is within the spatial location of the right kidney and / or ureter and / or bladder mask of the two-dimensional slice stone mask image of the corresponding slice of the kidney and / or ureter and / or bladder mask image, then the stone corresponding to the stone mask space location is configured as a right kidney and / or ureter and / or bladder stone.

[0012] Preferably, the method for extracting stone information corresponding to the set output item from the dual-energy abdominal image based on the set output item corresponding to the urinary tract stone composition report template includes: if the set output item is configured as a stone gray value, then extracting stone images with original gray values ​​from the dual-energy abdominal image based on the two-dimensional slice stone mask image in the stone mask image of each two-dimensional slice dual-energy abdominal image and its corresponding slice; calculating the average gray value corresponding to each stone type in the stone mask image, and determining the stone gray value corresponding to each stone type.

[0013] Preferably, the method for extracting a stone image with original grayscale values ​​from the dual-energy abdominal image based on the two-dimensional slice stone mask image of each two-dimensional slice dual-energy abdominal image and the stone mask image of its corresponding slice includes: performing a multiplication operation on the two-dimensional slice stone mask image of each two-dimensional slice dual-energy abdominal image and the stone mask image of its corresponding slice to obtain a stone grayscale value image; and performing grayscale value recovery on the stone grayscale value image based on the mask values ​​corresponding to each stone type and the spatial position of the stone in the two-dimensional slice stone mask image of the stone grayscale value image and the stone mask image of its corresponding slice to obtain a stone image with original grayscale values.

[0014] Preferably, the method for restoring grayscale values ​​of the calcined stone image based on the grayscale value image of the calcined stone and the corresponding stone mask image of the stone mask image of the two-dimensional slice stone mask image, and the stone spatial position, to obtain a stone image with original grayscale values, includes: extracting the mask values ​​and stone spatial positions corresponding to each stone type in the two-dimensional slice stone mask image of the calcined stone mask image; locating the spatial position of the calcined stone in the calcined stone image based on the stone spatial position corresponding to each stone type, to obtain a spatial position positioning image corresponding to each stone type in the two-dimensional slice calcined stone grayscale value image of the calcined stone grayscale value image; dividing the spatial position positioning image corresponding to each stone type in the two-dimensional slice calcined stone grayscale value image of the calcined stone grayscale value image by the mask value corresponding to the stone spatial position to obtain a stone image with original grayscale values.

[0015] Preferably, the method for extracting stone information corresponding to the set output item from the dual-energy abdominal image based on the set output item corresponding to the urinary tract stone composition report template includes: if the set output item is configured as a stone type, then obtaining the atomic number image of the urinary tract stone corresponding to the dual-energy abdominal image; and identifying the stone type corresponding to the dual-energy abdominal image based on the atomic number image of the urinary tract stone.

[0016] Preferably, the method for identifying the stone type corresponding to the dual-energy abdominal image based on the atomic number image of the urinary tract stone includes: extracting multiple component percentages of multiple bar charts corresponding to the effective atomic number in the atomic number image of the urinary tract stone from the peak values; and identifying the stone type corresponding to the dual-energy abdominal image based on the multiple component percentages corresponding to the multiple bar charts and multiple set stone type component percentage intervals.

[0017] Preferably, the method for extracting multiple component percentages of peak values ​​corresponding to multiple bar charts corresponding to valid atomic numbers in the atomic number image of urinary tract stones includes: obtaining a set bar chart color and / or a set bar chart width; extracting multiple bar charts corresponding to valid atomic numbers that satisfy the set bar chart color and / or set bar chart width in the atomic number image of urinary tract stones according to the set bar chart color and / or set bar chart width; and determining multiple component percentages of peak values ​​corresponding to multiple bar charts according to the multiple bar charts that satisfy the set bar chart color and / or set bar chart width in the atomic number image of urinary tract stones.

[0018] Preferably, the method for identifying the stone type corresponding to the dual-energy abdominal image based on the multiple component percentages corresponding to the multiple bar charts and multiple set stone type component percentage intervals includes: obtaining the set component percentage corresponding to the minimum value of the intervals of the set stone type component percentages; if the component percentages corresponding to the multiple bar charts are less than the set component percentages, then deleting the component percentages less than the set component percentages from the multiple component percentages corresponding to the multiple bar charts; otherwise, retaining the component percentages greater than or equal to the set component percentages; and identifying the stone type corresponding to the dual-energy abdominal image based on the retained multiple component percentages and multiple set stone type component percentage intervals.

[0019] Preferably, the method for identifying the stone type corresponding to the dual-energy abdominal image based on the multiple component percentages corresponding to the multiple bar charts and multiple set stone type component percentage intervals further includes: if at least two component percentages corresponding to the multiple component percentages of the multiple bar charts have overlapping intervals, then obtain the iodine-based image corresponding to the dual-energy abdominal image; and identify the stone type corresponding to the overlapping interval based on the iodine-based image corresponding to the dual-energy abdominal image.

[0020] Preferably, the method for identifying the stone type corresponding to the overlapping region based on the iodine-based image corresponding to the dual-energy abdominal image includes: determining the calorific value of the stone corresponding to the iodine-based image of the dual-energy abdominal image; calculating the average gray value and uniformity corresponding to the calorific value of the stone respectively; if the average gray value is greater than a set average gray value and the uniformity is greater than a set uniformity, then the stone type is configured as calcium oxalate dihydrate stone; otherwise, the stone type is configured as struvite stone or carbonate apatite stone.

[0021] Preferably, the plurality of set stone type component percentage ranges include one or more of the following: uric acid stone component percentage range, calcium oxalate monohydrate stone component percentage range, calcium oxalate dihydrate stone component percentage range, carbonate apatite stone component percentage range, calcium carbonate stone component percentage range, and struvite stone component percentage range.

[0022] Preferably, the percentage range of uric acid stone components is configured as 6.5-10.5, the percentage range of calcium oxalate monohydrate stone components is configured as 13.3-14.0, the percentage range of calcium oxalate dihydrate stone components is configured as 12.0-13.3, the percentage range of carbonate apatite stone components is configured as 14.0-15.0, the percentage range of calcium carbonate phosphate stone components is configured as greater than 12.5, and the percentage range of struvite stone components is configured as less than 12.5.

[0023] Preferably, the method for extracting stone information corresponding to the set output item from the dual-energy abdominal image based on the set output item corresponding to the urinary tract stone composition report template includes: if the set output item is configured as one or more of the atomic number main peak, atomic number secondary peak, and atomic number tertiary peak, then

[0024] Obtain an atomic number image of urinary tract stones corresponding to a dual-energy abdominal image; extract multiple bar charts corresponding to the effective atomic numbers in the atomic number image of urinary tract stones; determine multiple component percentages of the peak values ​​corresponding to the multiple bar charts that satisfy the set bar chart color and / or set bar chart width in the atomic number image of urinary tract stones; based on the multiple component percentages of the peak values ​​corresponding to the multiple bar charts, determine one or more of the following: the main peak value of atomic number corresponding to the largest component percentage among the multiple component percentages, the second peak value of atomic number corresponding to the second largest component percentage among the multiple component percentages, and the third peak value of atomic number corresponding to the third largest component percentage among the multiple component percentages.

[0025] Preferably, the method for extracting multiple bar charts corresponding to valid atomic numbers in the atomic number image of urinary tract stones includes: obtaining a set bar chart color and / or a set bar chart width; and extracting multiple bar charts corresponding to valid atomic numbers that satisfy the set bar chart color and / or set bar chart width in the atomic number image of urinary tract stones according to the set bar chart color and / or set bar chart width.

[0026] Preferably, the method of inserting the set output item and its corresponding stone information into the dual-energy abdominal image to generate a urinary tract stone composition report includes: adding the stone information to the corresponding position of the set output item to generate a urinary tract stone composition report to be inserted; and inserting the urinary tract stone composition report to be inserted into the dual-energy abdominal image to generate a urinary tract stone composition report.

[0027] Preferably, the method of adding the stone information to the corresponding position of the set output item to generate a urinary tract stone composition report includes: obtaining the corresponding position of the area to be filled in the set output item; adding the corresponding stone information to the corresponding position of the set output item to generate a urinary tract stone composition report.

[0028] According to one aspect of this disclosure, a device or system for generating a urinary tract stone composition report is provided, comprising: an acquisition unit for acquiring a dual-energy abdominal image and its corresponding urinary tract stone composition report template; an extraction unit for extracting stone information corresponding to a set output item from the dual-energy abdominal image based on the set output item corresponding to the urinary tract stone composition report template; a first generation unit for adding the stone information to the corresponding position of the set output item to generate a urinary tract stone composition report to be inserted; and a second generation unit for inserting the urinary tract stone composition report to be inserted into the dual-energy abdominal image to generate a urinary tract stone composition report.

[0029] According to one aspect of this disclosure, a device or system for generating a urinary tract stone composition report is provided, comprising: an electronic device, the electronic device being configured with a processor and a memory for storing processor-executable instructions; wherein the processor is configured to invoke the instructions stored in the memory to execute the urinary tract stone composition report generation method described above.

[0030] According to one aspect of this disclosure, a device or system for generating a urinary tract stone composition report is provided, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke the instructions stored in the memory to execute the above-described method for generating a urinary tract stone composition report.

[0031] According to one aspect of this disclosure, a device or system for generating a urinary tract stone composition report is provided, comprising: a computer-readable storage medium having computer program instructions stored thereon, wherein the computer program instructions, when executed by a processor, implement the above-described method for generating a urinary tract stone composition report.

[0032] According to one aspect of this disclosure, a device or system for generating a urinary tract stone composition report is provided, comprising: a computer program product including a computer program / instructions that, when executed by a processor, implement the above-described method for generating a urinary tract stone composition report.

[0033] In this disclosure, a technical solution is proposed for a method and system for generating urinary tract stone composition reports. This solution addresses the technical problem that radiologists need to measure and analyze relevant values ​​themselves, and then make rough judgments based on literature reports and their own experience to complete the report writing. This results in radiologists spending a lot of time and energy, and still cannot guarantee the accuracy of urinary tract stone composition diagnosis.

[0034] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure.

[0035] Other features and aspects of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0036] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the specification, serve to illustrate the technical solutions of this disclosure.

[0037] Figure 1 A flowchart illustrating a method for generating a urinary tract stone composition report according to an embodiment of the present disclosure is shown;

[0038] Figure 2 This is a block diagram illustrating an electronic device 800 according to an exemplary embodiment;

[0039] Figure 3 This is a block diagram illustrating an electronic device 1900 according to an exemplary embodiment. Detailed Implementation

[0040] Various exemplary embodiments, features, and aspects of this disclosure will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.

[0041] The term “exemplary” as used herein means “serving as an example, embodiment, or illustration.” Any embodiment illustrated herein as “exemplary” is not necessarily to be construed as superior to or better than other embodiments.

[0042] In this document, the term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. Furthermore, the term "at least one" in this document means any combination of at least two of any one or more elements. For example, including at least one of A, B, and C can mean including any one or more elements selected from the set consisting of A, B, and C.

[0043] Furthermore, to better illustrate this disclosure, numerous specific details are set forth in the following detailed description. Those skilled in the art will understand that this disclosure can be practiced without certain specific details. In some instances, methods, means, components, and circuits well known to those skilled in the art have not been described in detail in order to highlight the main points of this disclosure.

[0044] It is understood that the various embodiments of the methods for generating urinary tract stone composition reports mentioned in this disclosure can be combined with each other to form combined embodiments without violating the principle and logic. Due to space limitations, this disclosure will not elaborate further.

[0045] In addition, this disclosure also provides a device or system for generating a urinary tract stone composition report, electronic equipment, computer-readable storage medium, and program, all of which can be used to implement any of the urinary tract stone composition report generation methods provided in this disclosure. The corresponding technical solutions and descriptions are described in the corresponding section of the method and will not be repeated here.

[0046] Figure 1 A flowchart illustrating a method for generating a urinary tract stone composition report according to an embodiment of this disclosure is shown. Figure 1 As shown, the method for generating a urinary tract stone composition report includes: Step S101: acquiring a dual-energy abdominal image and its corresponding urinary tract stone composition report template; wherein, the dual-energy abdominal image is a dual-energy abdominal CT image; Step S102: extracting stone information corresponding to the set output items from the dual-energy abdominal image according to the set output items corresponding to the urinary tract stone composition report template; wherein, the set output items include one or more of the following: stone type, stone location, stone shape, stone calorific value, the long and short diameters of the stone, and stone volume; Step S103: inserting the set output items and their corresponding stone information into the dual-energy abdominal image to generate a urinary tract stone composition report. This method addresses the technical problem that radiologists need to measure and analyze the corresponding values ​​themselves, and then make a rough judgment based on literature reports and their own experience to complete the report writing, which consumes a lot of time and energy for radiologists and still cannot guarantee the accuracy of the diagnosis of urinary tract stone composition.

[0047] Step S101: Obtain dual-energy abdominal images and their corresponding urinary tract stone composition report templates; wherein, the dual-energy abdominal images are configured as dual-energy abdominal CT images.

[0048] In the embodiments of this disclosure and other possible embodiments, a spectral CT device (dual-energy CT device, spectral CT device) is used to scan the patient's abdomen to obtain a three-dimensional dual-energy abdominal image (dual-energy abdominal image / dual-energy spectral abdominal image / dual-energy abdominal CT image / dual-energy spectral abdominal CT image / spectral abdominal image / spectral abdominal CT image).

[0049] In the embodiments of this disclosure and other possible embodiments, the spectral CT device (dual-energy CT device, spectral CT device), namely the fast tube voltage switching dual-source CT device, adopts instantaneous kVp switching technology to complete the switching between high and low single energy in an extremely short time (<0.25ms), achieving three-in-one (simultaneous, same direction, same source) dual energy. It overcomes the defects of dual-tube dual-source CT, thereby avoiding the subtle angular differences between the scanning planes of the two tubes, improving the accuracy of data acquisition to provide superior CT scan images.

[0050] In the embodiments of this disclosure and other possible embodiments, spectral CT scanning and three-dimensional reconstruction can not only clearly display the density and morphology of renal parenchyma, the orientation and contour of the renal pelvis and calyces, the course and lumen of the ureter, and the condition of the bladder wall and lumen, but also display the morphology and location of kidney stones and renal pelvis and calyces, and further measure the volume of stones and renal pelvis and calyces. The imaging quality is far superior to that of traditional CT three-dimensional multiplanar reconstruction. In particular, the effective atomic number (Zeff value) of spectral CT can be used to analyze the compositional characteristics of kidney stones, display the numerical differences in different regions, and clarify the specific spatial distribution of different components in mixed stones based on these differences.

[0051] Step S102: Extract stone information corresponding to the set output items from the dual-energy abdominal image according to the set output items corresponding to the urinary tract stone composition report template; wherein, the set output items include one or more of the following: stone type, stone location, stone shape, stone calorific value, the long and short diameters of the stone, and stone volume.

[0052] In embodiments of this disclosure, the method for extracting stone information corresponding to the set output item from the dual-energy abdominal image based on the set output item corresponding to the urinary tract stone composition report template includes: if the set output item is configured as one or more of the following: stone shape, the major and minor diameters of the stone, and stone volume, then the stone area corresponding to each stone type in each two-dimensional slice stone mask image in the stone mask image corresponding to the dual-energy abdominal image is calculated respectively; multiple stone areas are obtained; and the multiple stone areas corresponding to each stone type are calculated respectively. The major and minor axes corresponding to the largest stone area in the stone area are obtained to obtain the major and minor axes corresponding to each stone type; and / or, edge detection is performed on the stones corresponding to each stone type in the stone mask image corresponding to the dual-energy abdominal image to obtain stone edge mask lines; the stone edge mask lines corresponding to each stone type are fitted to obtain the stone shape corresponding to each stone type; and / or, three-dimensional reconstruction is performed on the mask images corresponding to each stone type in the stone mask image corresponding to the dual-energy abdominal image to obtain the stone volume corresponding to each stone type.

[0053] In embodiments of this disclosure, the method for extracting stone information corresponding to the set output item from the dual-energy abdominal image based on the set output item corresponding to the urinary tract stone composition report template includes: if the set output item is configured as lesion location, then the dual-energy abdominal image is segmented into kidney and / or ureter and / or bladder to obtain kidney and / or ureter and / or bladder mask images; based on the kidney and / or ureter and / or bladder mask images, the kidney and / or ureter and / or bladder masks in the kidney and / or ureter and / or bladder mask images are configured as left kidney and / or ureter and / or bladder masks and right kidney and / or ureter and / or bladder masks; based on the spatial positional relationship between the stone masks in the stone mask images and the left kidney and / or ureter and / or bladder masks and right kidney and / or ureter and / or bladder masks in the kidney and / or ureter and / or bladder mask images, the stone location corresponding to each stone type is determined.

[0054] In this disclosure and other possible embodiments, a preset segmentation model (kidney / bladder / ureter / stone segmentation model) is used to segment the medical image into kidney and / or ureter and / or bladder to obtain a three-dimensional masked image of the kidney and / or ureter and / or bladder.

[0055] In embodiments of this disclosure and other possible embodiments, the method for segmenting kidney, ureter, and bladder stones from the dual-energy abdominal image to obtain a stone mask image includes: acquiring a preset segmentation network, a dual-energy abdominal training image corresponding to the preset segmentation network, and a multi-mask label fusion image representing the kidney, ureter, and stones corresponding to the dual-energy abdominal training image; training the preset segmentation network on the dual-energy abdominal training image and its corresponding multi-mask label fusion image to obtain a corresponding stone segmentation model (preset segmentation model, kidney / bladder / ureter / stone segmentation model).

[0056] In the embodiments of this disclosure and other possible embodiments, based on the stone segmentation model (preset segmentation model, kidney / bladder / ureter / stone segmentation model), the stones in the kidney, ureter and bladder are segmented from the dual-energy abdominal image to obtain a stone mask image.

[0057] In embodiments of this disclosure and other possible embodiments, the method for constructing the multi-mask label image fusion image representing the kidney, bladder, ureter, and stones respectively includes: acquiring the kidney mask label image, bladder mask label image, ureter mask label image, and stone mask image corresponding to the dual-energy abdominal training image; assigning a first mask value, a second mask value, a third mask value, and a fourth mask value to the kidney mask label image, the bladder mask label image, the ureter mask label image, and the stone mask image respectively; fusing the kidney mask label image corresponding to the first mask value, the bladder mask label image corresponding to the second mask value, the ureter mask image corresponding to the third mask value, and the stone mask image corresponding to the fourth mask value to obtain the multi-mask label fusion image representing the kidney, bladder, ureter, and stones respectively corresponding to the dual-energy abdominal training image.

[0058] In embodiments of this disclosure and other possible embodiments, the method of fusing the kidney mask label image corresponding to the first mask value, the bladder mask label image corresponding to the second mask value, the ureter mask image corresponding to the third mask value, and the stone mask image corresponding to the fourth mask value to obtain the multi-mask label fused image corresponding to the dual-energy abdominal training image, representing the kidney, bladder, ureter, and stone respectively, includes: determining the first spatial position corresponding to the first mask value in the kidney mask label image, the second spatial position corresponding to the second mask value in the bladder mask label image, and the third spatial position corresponding to the stone in the ureter mask label image, respectively. The third spatial position corresponding to the third mask value and the fourth spatial position corresponding to the fourth mask value in the stone mask image; if the first spatial position, the second spatial position, and the third spatial position overlap with the fourth spatial position, then the mask value corresponding to the overlapping spatial position is updated to the fourth mask value corresponding to the fourth spatial position; otherwise, the first mask value corresponding to the first spatial position, the second mask value corresponding to the second spatial position, and the third mask value corresponding to the third spatial position are retained to obtain the multi-mask label fusion image corresponding to the dual-energy abdominal training image, which respectively represents the kidney, bladder, ureter, and stone.

[0059] In embodiments of this disclosure and other possible embodiments, before obtaining organ mask label images corresponding to at least one organ (kidney, ureter, bladder) and stone mask label images within the organs in the dual-energy abdominal training image, a stone mask label image is determined based on an iodine-based image corresponding to the dual-energy abdominal training image, and an organ mask label image is determined based on a water-based image corresponding to the dual-energy abdominal training image.

[0060] In embodiments of this disclosure and other possible embodiments, the method for determining a stone mask label image based on an iodine-based image corresponding to the dual-energy abdominal training image includes: delineating stones in the iodine-based image corresponding to the dual-energy abdominal training image to determine a stone mask label image.

[0061] In embodiments of this disclosure and other possible embodiments, the method for determining organ mask label images based on water-based images corresponding to dual-energy abdominal training images includes: delineating organs in water-based images corresponding to dual-energy abdominal training images to determine organ mask label images.

[0062] In embodiments of this disclosure and other possible embodiments, the process of training the preset segmentation network using the dual-energy abdominal training image and its corresponding multi-mask label fusion image includes: obtaining the organ loss function and its corresponding organ loss weight value for the organ, and the stone loss function and its corresponding stone loss weight value that is less than the organ loss weight value for the stone; during the training of the preset segmentation network, if the organ loss value corresponding to the organ loss function is less than a first preset loss value and / or the total loss value corresponding to the organ loss function and the stone loss function is less than a second preset loss value, then during the training of the preset segmentation network... During each training session of the network, the stone loss weight value is increased and adjusted according to a set ratio to obtain a stone loss adjustment weight value. Based on the stone loss adjustment weight value, the organ loss weight value corresponding to the organ loss weight value is determined. Based on the stone loss adjustment weight value and the organ loss adjustment weight value, the stone loss value corresponding to the stone loss function and the total loss value corresponding to the organ loss function and the stone loss function are calculated. If the stone loss value is less than a third set loss value and / or the total loss value corresponding to the organ loss function and the stone loss function is less than a fourth set loss value, then the training of the preset segmentation network is stopped.

[0063] In embodiments of this disclosure and other possible embodiments, the method for determining the organ loss control weight value corresponding to the organ loss weight value based on the stone loss control weight value includes: obtaining a set configuration value corresponding to the sum of the organ loss weight value and the stone loss weight value; subtracting the stone loss control weight value from the set configuration value to determine the organ loss control weight value corresponding to the organ loss weight value.

[0064] In the embodiments of this disclosure and other possible embodiments, the set configuration value corresponding to the sum of the organ loss weight value and the stone loss weight value is configured to be 1.

[0065] In the embodiments of this disclosure and other possible embodiments, the organ loss function and the stone loss function are respectively configured as one or more of the following: cross-entropy loss function, Dice loss function, Focal loss function, Tversky loss function, and IoU loss function.

[0066] In the embodiments of this disclosure and other possible embodiments, the preset segmentation network is configured as one or more of the following segmentation networks: Unet, ResUnet, Unet++, ResUnet++, nnUnet, SegNet, PSPNet, DeepLab, RefineNet, Medformer, or improved segmentation networks thereof.

[0067] In embodiments of this disclosure and other possible embodiments, the method for determining the location of stones corresponding to each stone type based on the spatial positional relationship between the stone mask in the stone mask image and the mask of the lateral kidney and / or ureter and / or bladder in the kidney and / or ureter and / or bladder mask image, includes: extracting multiple two-dimensional slice stone mask images corresponding to each stone type from the stone mask image; if the spatial position of the stone mask corresponding to the multiple two-dimensional slice stone mask images is within the kidney and / or ureter and / or bladder mask image... If the stone mask space location corresponding to the two-dimensional slice stone mask image of the corresponding slice of the code image is within the mask space location of the left kidney and / or ureter and / or bladder, then the stone corresponding to the mask space location is configured as a left kidney and / or ureter and / or bladder stone; if the stone mask space location corresponding to the multiple two-dimensional slice stone mask images is within the mask space location of the right kidney and / or ureter and / or bladder of the two-dimensional slice stone mask image of the corresponding slice of the kidney and / or ureter and / or bladder mask image, then the stone corresponding to the mask space location is configured as a right kidney and / or ureter and / or bladder stone.

[0068] In an embodiment of this disclosure, the method for extracting stone information corresponding to the set output item from the dual-energy abdominal image based on the set output item corresponding to the urinary tract stone composition report template includes: if the set output item is configured as a stone gray value, then extracting stone images with original gray values ​​from the dual-energy abdominal image based on the two-dimensional slice stone mask image in the stone mask image of each two-dimensional slice dual-energy abdominal image and its corresponding slice; calculating the average gray value corresponding to each stone type in the stone mask image to determine the stone gray value corresponding to each stone type.

[0069] In embodiments of this disclosure and other possible embodiments, the method for extracting a stone image with original grayscale values ​​from the dual-energy abdominal image based on the two-dimensional slice stone mask image of each two-dimensional slice dual-energy abdominal image and the stone mask image of the corresponding slice includes: performing a multiplication operation on the two-dimensional slice stone mask image of each two-dimensional slice dual-energy abdominal image and the stone mask image of the corresponding slice to obtain a stone grayscale value image; and performing grayscale value recovery on the stone grayscale value image based on the mask value corresponding to each stone type and the spatial position of the stone in the two-dimensional slice stone mask image of the stone grayscale value image and the stone mask image of the corresponding slice to obtain a stone image with original grayscale values.

[0070] In embodiments of this disclosure and other possible embodiments, the method for restoring grayscale values ​​of the calcined stone image based on the mask values ​​and spatial positions of stones corresponding to each stone type in the two-dimensional sliced ​​calcined stone mask image of the calcined stone grayscale image and its corresponding slices, to obtain a calcined stone image with original grayscale values, includes: extracting the mask values ​​and spatial positions of stones corresponding to each stone type in the two-dimensional sliced ​​calcined stone mask image of the calcined stone mask image; locating the spatial positions of stones corresponding to each stone type in the calcined stone grayscale image based on the spatial positions of stones corresponding to each stone type, to obtain spatial position positioning images corresponding to each stone type in the two-dimensional sliced ​​calcined stone grayscale image of the calcined stone grayscale image; dividing the spatial position positioning images corresponding to each stone type in the two-dimensional sliced ​​calcined stone grayscale image of the calcined stone grayscale image by the mask values ​​corresponding to the spatial positions of the stones to obtain a calcined stone image with original grayscale values.

[0071] In embodiments of this disclosure, the method for extracting stone information corresponding to a set output item from a dual-energy X-ray ablation (DEXA) image based on the set output item corresponding to the urinary tract stone composition report template includes: if the set output item is configured as a stone type, obtaining an atomic number image of the urinary tract stone corresponding to the DEXA image; and identifying the stone type corresponding to the DEXA image based on the atomic number image of the urinary tract stone. This addresses the technical problem of difficulty in identifying or distinguishing mixed urinary tract stones of different components, thus failing to meet the clinical diagnostic needs when mixed-component stones outnumber single-component stones.

[0072] In embodiments of this disclosure and other possible embodiments, the method for identifying the stone type corresponding to the dual-energy abdominal image based on the atomic number image of the urinary tract stone includes: extracting multiple component percentages of multiple bar charts corresponding to the effective atomic numbers in the atomic number image of the urinary tract stone from the peak values; and identifying the stone type corresponding to the dual-energy abdominal image based on the multiple component percentages corresponding to the multiple bar charts and multiple set stone type component percentage intervals.

[0073] In embodiments of this disclosure and other possible embodiments, the method for identifying the stone type corresponding to the dual-energy abdominal image based on the multiple component percentages corresponding to the multiple bar charts and multiple set stone type component percentage intervals includes: if the component percentage in the multiple component percentages is within the range of a certain set stone type component percentage interval in the multiple set stone type component percentage intervals; configuring the stone type corresponding to the certain set stone type component percentage interval as the stone type corresponding to the component percentage within the range.

[0074] In embodiments of this disclosure and other possible embodiments, the method for extracting multiple component percentages of peak values ​​corresponding to multiple bar charts in the atomic number image of urinary tract stones includes: obtaining a set bar chart color and / or a set bar chart width; extracting multiple bar charts in the atomic number image of urinary tract stones that satisfy the set bar chart color and / or set bar chart width according to the set bar chart color and / or set bar chart width; and determining multiple component percentages of peak values ​​corresponding to multiple bar charts according to the multiple bar charts in the atomic number image of urinary tract stones that satisfy the set bar chart color and / or set bar chart width.

[0075] In the embodiments of this disclosure and other possible embodiments, those skilled in the art can configure the setting bar chart color and / or setting bar chart width according to actual needs. For example, the setting bar chart color is configured as yellow.

[0076] In the embodiments of this disclosure and other possible embodiments, before extracting multiple bar charts corresponding to the effective atomic numbers in the atomic number image of urinary tract stones, or before extracting multiple bar charts corresponding to the effective atomic numbers in the atomic number image of urinary tract stones that satisfy the set bar chart color and / or set bar chart width, the atomic number image of urinary tract stones is corrected to obtain a corrected atomic number image of urinary tract stones; multiple component percentages of the peak values ​​corresponding to the multiple bar charts corresponding to the effective atomic numbers in the corrected atomic number image of urinary tract stones are extracted, or multiple component percentages of the peak values ​​corresponding to the multiple bar charts corresponding to the effective atomic numbers in the corrected atomic number image of urinary tract stones that satisfy the set bar chart color and / or set bar chart width are extracted.

[0077] In the embodiments of this disclosure and other possible embodiments, the method for correcting the atomic number image of the urinary tract stones to obtain a corrected atomic number image of the urinary tract stones includes: performing at least one correction processing operation on the atomic number image of the urinary tract stones, such as angle adjustment, contrast enhancement, scaling, etc., to obtain a corrected atomic number image of the urinary tract stones, so as to extract multiple bar charts corresponding to the effective atomic numbers in the later stage.

[0078] In the embodiments of this disclosure and other possible embodiments, optical character recognition technology is used to extract multiple component percentages of the peak values ​​corresponding to multiple bar charts of the effective atomic number in the atomic number image of the urinary tract stone; or, optical character recognition technology is used to extract multiple component percentages of the peak values ​​corresponding to multiple bar charts of the effective atomic number in the corrected atomic number image of the urinary tract stone that satisfy the set bar chart color and / or set bar chart width.

[0079] In the embodiments of this disclosure and other possible embodiments, Optical Character Recognition (OCR) is a computer vision technology that uses image processing and machine learning algorithms to recognize and extract text content in images and convert it into machine-readable and editable text format.

[0080] In embodiments of this disclosure, the method for identifying the stone type corresponding to the dual-energy abdominal image based on the multiple component percentages corresponding to the multiple bar charts and multiple set stone type component percentage intervals includes: obtaining a set component percentage corresponding to a value less than the minimum value of the set stone type component percentage intervals; if the component percentages corresponding to the multiple bar charts are less than the set component percentages, deleting the component percentages less than the set component percentages from the multiple component percentages corresponding to the multiple bar charts; otherwise, retaining the component percentages greater than or equal to the set component percentages; and identifying the stone type corresponding to the dual-energy abdominal image based on the retained multiple component percentages and the multiple set stone type component percentage intervals.

[0081] In the embodiments of this disclosure and other possible embodiments, those skilled in the art can configure the percentage of the set component corresponding to the minimum value in the range of the set stone type component percentage according to actual needs. For example, the percentage of the set component corresponding to the minimum value in the range of the set stone type component percentage is configured as 5%.

[0082] In the embodiments disclosed herein and other possible embodiments, the implementation of OCR requires calling the API of the GOT_OCR2 tool and setting its parameters such as language and text box positioning; atomic number peak recognition and morphological calculation require using Python's NumPy, SciPy or OpenCV libraries to extract multiple component percentages of peaks corresponding to multiple bar charts corresponding to the effective atomic numbers in the atomic number image of urinary tract stones, or to extract multiple component percentages of peaks corresponding to multiple bar charts corresponding to the effective atomic numbers in the atomic number image of urinary tract stones that satisfy the setting of bar chart color and / or setting of bar chart width.

[0083] In embodiments of this disclosure and other possible embodiments, the method for identifying the stone type corresponding to the dual-energy abdominal image based on the multiple component percentages corresponding to the multiple bar charts and multiple set stone type component percentage intervals includes: obtaining the set component percentage corresponding to the minimum value of the intervals of the set stone type component percentages; if the component percentages corresponding to the multiple bar charts are less than the set component percentages, then deleting the component percentages less than the set component percentages from the multiple component percentages corresponding to the multiple bar charts; otherwise, retaining the component percentages greater than or equal to the set component percentages; and identifying the stone type corresponding to the dual-energy abdominal image based on the retained multiple component percentages and the multiple set stone type component percentage intervals.

[0084] In embodiments of this disclosure and other possible embodiments, the method for identifying the stone type corresponding to the dual-energy abdominal image based on the multiple component percentages corresponding to the multiple bar charts and multiple set stone type component percentage intervals further includes: if at least two component percentage intervals corresponding to the set stone type component percentage intervals among the multiple component percentages corresponding to the multiple bar charts have overlapping intervals, then obtaining the iodine-based image corresponding to the dual-energy abdominal image; and identifying the stone type corresponding to the overlapping interval based on the iodine-based image corresponding to the dual-energy abdominal image.

[0085] In embodiments of this disclosure and other possible embodiments, the method for identifying the stone type corresponding to the overlapping region based on the iodine-based image corresponding to the dual-energy abdominal image includes: determining the calorific value of the stone corresponding to the iodine-based image of the dual-energy abdominal image; calculating the average gray value and uniformity corresponding to the calorific value of the stone respectively; if the average gray value is greater than a set average gray value and the uniformity is greater than a set uniformity, then the stone type is configured as calcium oxalate dihydrate stone; otherwise, the stone type is configured as struvite stone or carbonate apatite stone.

[0086] In the embodiments of this disclosure and other possible embodiments, those skilled in the art can configure the set average gray value and the set uniformity according to actual needs.

[0087] In the embodiments of this disclosure and other possible embodiments, uniformity = (maximum value - minimum value) / (2 * average value) × 100%. Wherein, the maximum value represents the maximum value corresponding to the calorific value, the minimum value represents the minimum value corresponding to the calorific value, and the average value represents the average calorific value corresponding to the calorific value.

[0088] In the embodiments of this disclosure and other possible embodiments, the plurality of set stone type component percentage ranges include one or more of the following: uric acid stone component percentage range, calcium oxalate monohydrate stone component percentage range, calcium oxalate dihydrate stone component percentage range, carbonate apatite stone component percentage range, calcium carbonate phosphate stone component percentage range, and struvite stone component percentage range.

[0089] In the embodiments and other possible embodiments disclosed herein, the percentage range of uric acid stone components is configured to be 6.5-10.5, the percentage range of calcium oxalate monohydrate stone components is configured to be 13.3-14.0, the percentage range of calcium oxalate dihydrate stone components is configured to be 12.0-13.3, the percentage range of carbonate apatite stone components is configured to be 14.0-15.0, the percentage range of calcium carbonate phosphate stone components is configured to be greater than 12.5, and the percentage range of struvite stone components is configured to be less than 12.5.

[0090] In the embodiments and other possible embodiments disclosed herein, the Zeff peak value (component percentage range) of uric acid stones is between 6.5 and 10.5; the Zeff peak value of calcium oxalate monohydrate stones is between 13.3 and 14.0; the Zeff peak value of calcium oxalate dihydrate stones is between 12.0 and 13.3; the Zeff peak value of carbonate apatite stones is between 14.0 and 15.0; the Zeff peak value of calcium carbonate stones is greater than 12.5 and all have CT images showing uneven density; the Zeff peak value of struvite stones is less than 12.5 and all have CT images showing uneven density.

[0091] In embodiments of this disclosure and other possible embodiments, the method for identifying the stone type corresponding to the dual-energy abdominal image based on the multiple component percentages corresponding to the multiple bar charts and multiple set stone type component percentage intervals includes: constructing a stone component reference table according to the multiple set stone type component percentage intervals; and performing a table lookup and comparison operation on the multiple component percentages corresponding to the multiple bar charts based on the stone component reference table to identify the stone type corresponding to the dual-energy abdominal image.

[0092] In embodiments of this disclosure, the method for extracting stone information corresponding to the set output item from the dual-energy abdominal image based on the set output item corresponding to the urinary tract stone component report template includes: if the set output item is configured as one or more of the atomic number main peak, atomic number secondary peak, and atomic number third peak, then obtaining the urinary tract stone atomic number image corresponding to the dual-energy abdominal image; extracting multiple bar charts corresponding to the effective atomic numbers in the urinary tract stone atomic number image; determining multiple component percentages of the peaks corresponding to the multiple bar charts based on the multiple bar charts in the urinary tract stone atomic number image that satisfy the set bar chart color and / or set bar chart width; and determining one or more of the atomic number main peak corresponding to the largest component percentage, the atomic number secondary peak corresponding to the second largest component percentage, and the atomic number third peak corresponding to the third largest component percentage among the multiple component percentages based on the multiple component percentages of the multiple component percentages.

[0093] In embodiments of this disclosure and other possible embodiments, the method for extracting multiple bar charts corresponding to valid atomic numbers in the atomic number image of urinary tract stones includes: obtaining a set bar chart color and / or a set bar chart width; and extracting multiple bar charts corresponding to valid atomic numbers in the atomic number image of urinary tract stones that satisfy the set bar chart color and / or the set bar chart width, based on the set bar chart color and / or the set bar chart width.

[0094] In an embodiment of this disclosure, the method of inserting the set output item and its corresponding stone information into the dual-energy abdominal image to generate a urinary tract stone composition report includes: adding the stone information to the corresponding position of the set output item to generate a urinary tract stone composition report to be inserted; and inserting the urinary tract stone composition report to be inserted into the dual-energy abdominal image to generate a urinary tract stone composition report.

[0095] In an embodiment of this disclosure, the method of adding the stone information to the corresponding position of the set output item to generate a urinary tract stone composition report includes: obtaining the corresponding position of the area to be filled in the set output item; adding the corresponding stone information to the corresponding position of the set output item to generate a urinary tract stone composition report.

[0096] Step S103: Insert the set output items and their corresponding stone information into the dual-energy abdominal image to generate a urinary tract stone composition report.

[0097] The execution entity of the method for generating a urinary tract stone composition report can be an image processing device. For example, the method can be executed by a terminal device, a server, or other processing devices. The terminal device can be a user equipment (UE), mobile device, user terminal, terminal, cellular phone, cordless phone, personal digital assistant (PDA), handheld device, computing device, vehicle-mounted device, wearable device, etc. In some possible implementations, the method for generating a urinary tract stone composition report can be implemented by a processor calling computer-readable instructions stored in memory.

[0098] Those skilled in the art will understand that in the above-described method for generating a urinary tract stone composition report in the specific implementation, the order in which each step is written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0099] According to one aspect of the embodiments of this disclosure, a device or system for generating a urinary tract stone composition report is provided, comprising: an acquisition unit for acquiring a dual-energy abdominal image and its corresponding urinary tract stone composition report template; an extraction unit for extracting stone information corresponding to a set output item from the dual-energy abdominal image based on a set output item corresponding to the urinary tract stone composition report template; a first generation unit for adding the stone information to the corresponding position of the set output item to generate a urinary tract stone composition report to be inserted; and a second generation unit for inserting the urinary tract stone composition report to be inserted into the dual-energy abdominal image to generate a urinary tract stone composition report. This addresses the technical problem that radiologists need to measure and analyze relevant values ​​themselves, and then make rough judgments based on literature reports and their own experience to complete the report writing, resulting in a significant expenditure of time and energy for radiologists, and still failing to guarantee the accuracy of urinary tract stone composition diagnosis.

[0100] According to one aspect of the embodiments of this disclosure, a device or system for generating a urinary tract stone composition report is provided, comprising: an electronic device, the electronic device being configured with a processor and a memory for storing processor-executable instructions; wherein the processor is configured to invoke the instructions stored in the memory to execute the aforementioned method for generating a urinary tract stone composition report. This addresses the technical problem that urinary tract stone composition reports require radiologists to measure and analyze relevant values ​​themselves, then make rough judgments based on literature reports and their own experience to complete the report writing, resulting in a significant expenditure of time and effort for radiologists, and still failing to guarantee the accuracy of urinary tract stone composition diagnosis.

[0101] According to one aspect of the embodiments of this disclosure, a device or system for generating a urinary tract stone composition report is provided, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to invoke the instructions stored in the memory to execute the aforementioned method for generating a urinary tract stone composition report. This addresses the technical problem that urinary tract stone composition reports require radiologists to measure and analyze relevant values ​​themselves, then make rough judgments based on literature reports and their own experience to complete the report writing, resulting in a significant expenditure of time and effort for radiologists, and still failing to guarantee the accuracy of urinary tract stone composition diagnosis.

[0102] According to one aspect of the embodiments of this disclosure, a device or system for generating a urinary tract stone composition report is provided, comprising: a computer-readable storage medium storing computer program instructions thereon, wherein the computer program instructions, when executed by a processor, implement the aforementioned method for generating a urinary tract stone composition report. This addresses the technical problem that urinary tract stone composition reports require radiologists to measure and analyze relevant values ​​themselves, then make rough judgments based on literature reports and their own experience to complete the report writing, resulting in a significant expenditure of time and effort for radiologists, and still failing to guarantee the accuracy of urinary tract stone composition diagnosis.

[0103] According to one aspect of the embodiments of this disclosure, a device or system for generating a urinary tract stone composition report is provided, comprising: a computer program product, including a computer program / instructions, which, when executed by a processor, implements the aforementioned method for generating a urinary tract stone composition report. This addresses the technical problem that urinary tract stone composition reports require radiologists to measure and analyze relevant values ​​themselves, then make rough judgments based on literature reports and their own experience to complete the report writing, resulting in a significant expenditure of time and effort for radiologists, and still failing to guarantee the accuracy of urinary tract stone composition diagnosis.

[0104] The technical solution provided in this disclosure eliminates the need for radiologists to measure and analyze relevant values ​​and write diagnostic reports on the composition of urinary tract stones, thereby greatly saving radiologists' time and energy while ensuring the accuracy of urinary tract stone composition diagnosis.

[0105] In some embodiments, the functions or modules of the apparatus provided in this disclosure can be used to perform the methods described in the above method embodiments. The specific implementation can be referred to the description of the above method embodiments for generating urinary tract stone composition reports. For the sake of brevity, it will not be repeated here.

[0106] This disclosure also proposes a computer-readable storage medium storing computer program instructions that, when executed by a processor, implement the aforementioned method for generating a urinary tract stone composition report. The computer-readable storage medium may be a non-volatile computer-readable storage medium.

[0107] This disclosure also proposes an electronic device, including: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured for the above-described method for generating a urinary tract stone composition report. The electronic device may be provided as a terminal, a server, or other form of device.

[0108] Figure 2This is a block diagram illustrating an electronic device 800 according to an exemplary embodiment. For example, the electronic device 800 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, or other terminal.

[0109] Reference Figure 2 The electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0110] Processing component 802 typically controls the overall operation of electronic device 800, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the methods described above. Furthermore, processing component 802 may include one or more modules to facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

[0111] Memory 804 is configured to store various types of data to support the operation of electronic device 800. Examples of this data include instructions for any application or method operating on electronic device 800, contact data, phonebook data, messages, pictures, videos, etc. Memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0112] Power supply component 806 provides power to various components of electronic device 800. Power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 800.

[0113] Multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 808 includes a front-facing camera and / or a rear-facing camera. When the electronic device 800 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0114] Audio component 810 is configured to output and / or input audio signals. For example, audio component 810 includes a microphone (MIC) configured to receive external audio signals when electronic device 800 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 804 or transmitted via communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

[0115] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0116] Sensor assembly 814 includes one or more sensors for providing state assessments of various aspects of electronic device 800. For example, sensor assembly 814 can detect the on / off state of electronic device 800, the relative positioning of components such as the display and keypad of electronic device 800, changes in position of electronic device 800 or a component of electronic device 800, the presence or absence of user contact with electronic device 800, orientation or acceleration / deceleration of electronic device 800, and temperature changes of electronic device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 814 may also include an accelerometer, gyroscope, magnetometer, pressure sensor, or temperature sensor.

[0117] Communication component 816 is configured to facilitate wired or wireless communication between electronic device 800 and other devices. Electronic device 800 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 816 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0118] In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0119] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 804 including computer program instructions that can be executed by a processor 820 of an electronic device 800 to perform the above-described method.

[0120] Figure 3 This is a block diagram illustrating an electronic device 1900 according to an exemplary embodiment. For example, the electronic device 1900 may be provided as a server. (Refer to...) Figure 3 The electronic device 1900 includes a processing component 1922, which further includes one or more processors, and memory resources represented by memory 1932 for storing instructions, such as application programs, that can be executed by the processing component 1922. The application programs stored in memory 1932 may include one or more modules, each corresponding to a set of instructions. Furthermore, the processing component 1922 is configured to execute instructions to perform the methods described above.

[0121] Electronic device 1900 may also include a power supply component 1926 configured to perform power management of electronic device 1900, a wired or wireless network interface 1950 configured to connect electronic device 1900 to a network, and an input / output (I / O) interface 1958. Electronic device 1900 can operate on an operating system stored in memory 1932, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, or similar.

[0122] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 1932 including computer program instructions that can be executed by a processing component 1922 of an electronic device 1900 to perform the above-described method.

[0123] This disclosure can be a system, method, and / or computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of this disclosure.

[0124] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination thereof. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0125] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0126] Computer program instructions used to perform the operations of this disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuitry, such as programmable logic circuitry, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), is personalized by utilizing the status information of the computer-readable program instructions to implement various aspects of this disclosure.

[0127] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0128] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0129] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0130] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0131] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or technical improvements to the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. A urinary stone composition report generation method characterized by comprising: The method comprises the following steps: acquiring a dual-energy abdominal image and a corresponding urinary stone composition report template; extracting stone information corresponding to a set output item from the dual-energy abdominal image according to the set output item of the urinary stone composition report template, including: if the set output item is configured as a stone type, extracting a plurality of component percentages of a plurality of peak values corresponding to a plurality of strip graphs corresponding to an effective atomic number in a urinary stone atomic number image corresponding to the dual-energy abdominal image; if there is an overlapping interval in at least two component percentages corresponding to a set stone type component percentage interval in the plurality of component percentages corresponding to the plurality of strip graphs, determining a stone gray value of an iodine-based image corresponding to the dual-energy abdominal image; calculating an average gray value and uniformity corresponding to the stone gray value respectively; if the average gray value is greater than a set average gray value and the uniformity is greater than a set uniformity, configuring the stone type as calcium oxalate dihydrate stone; otherwise, configuring the stone type as bird dropping stone or carbonated apatite stone; inserting the set output item and the corresponding stone information into the dual-energy abdominal image to generate a urinary stone composition report.

2. The urinary stone composition report generation method according to claim 1, characterized by, The method further comprises the following steps: if the set output item is configured as one or more of a stone shape, a long diameter and a short diameter corresponding to a stone, a stone volume, or other information, then calculating a stone area corresponding to each stone type in each two-dimensional slice stone mask image in a stone mask image corresponding to the dual-energy abdominal image respectively to obtain a plurality of stone areas; calculating a long diameter and a short diameter corresponding to a maximum stone area in the plurality of stone areas corresponding to each stone type respectively to obtain the long diameter and the short diameter corresponding to each stone type; and / or performing edge detection on the stone corresponding to each stone type on the stone mask image corresponding to the dual-energy abdominal image respectively to obtain a stone edge mask line; fitting the stone edge mask line corresponding to each stone type respectively to obtain a stone shape corresponding to each stone type; and / or reconstructing a mask graph corresponding to each stone type in the stone mask image corresponding to the dual-energy abdominal image respectively to obtain a stone volume corresponding to each stone type.

3. The urinary stone composition report generation method according to any one of claims 1 or 2, characterized by, The method further comprises the following steps: if the set output item is configured as a lesion location, then segmenting one or more of a kidney, a ureter, and a bladder in the dual-energy abdominal image to obtain one or more mask images corresponding to a kidney mask image, a ureter mask image, and a bladder mask image; According to the kidney mask image, the ureter mask image, one or more of the bladder mask image, the kidney mask image, the ureter mask image, and the bladder mask image are configured as one or more of a left kidney mask, a ureter mask, and a bladder mask, and one or more of a right kidney mask, a ureter mask, and a bladder mask; Based on the stone mask in the stone mask image corresponding to the dual-energy abdominal image and the spatial position relationship of one or more of the left kidney mask, the ureter mask, and the bladder mask in one or more of the kidney mask image, the ureter mask image, and the bladder mask image and one or more of the right kidney mask, the ureter mask, and the bladder mask, the position of each stone type is determined.

4. The urinary stone composition report generation method according to any one of claims 1 or 2, characterized by, According to the set output item corresponding to the urinary stone composition report template, the stone information corresponding to the set output item is extracted from the dual-energy abdominal image, and the method further comprises: If the set output item is configured as a stone gray value, a stone image with an original gray value is extracted from the dual-energy abdominal image based on each two-dimensional slice dual-energy abdominal image in the dual-energy abdominal image and a two-dimensional slice stone mask image corresponding to the slice of the stone mask image; the average gray value corresponding to each stone type in the stone image corresponding to the two-dimensional slice stone mask image is calculated to determine the stone gray value corresponding to each stone type.

5. The urinary stone composition report generation method according to claim 3, characterized by, According to the set output item corresponding to the urinary stone composition report template, the stone information corresponding to the set output item is extracted from the dual-energy abdominal image, and the method further comprises: If the set output item is configured as a stone gray value, a stone image with an original gray value is extracted from the dual-energy abdominal image based on each two-dimensional slice dual-energy abdominal image in the dual-energy abdominal image and a two-dimensional slice stone mask image corresponding to the slice of the stone mask image; the average gray value corresponding to each stone type in the stone image corresponding to the two-dimensional slice stone mask image is calculated to determine the stone gray value corresponding to each stone type.

6. The urinary stone composition report generation method according to any one of claims 1 or 2 or 5, characterized by, According to the set output item corresponding to the urinary stone composition report template, the stone information corresponding to the set output item is extracted from the dual-energy abdominal image, and the method further comprises: If the set output item is configured as one or more of the main peak value of atomic number, the secondary peak value of atomic number, and the third peak value of atomic number, Obtain a urinary stone atomic number image corresponding to the dual-energy abdominal image; Extract a plurality of bar graphs corresponding to the effective atomic number in the urinary stone atomic number image; According to the urinary stone atomic number image, determine the composition percentage of the peak value corresponding to the plurality of bar graphs; Based on the composition percentage of the peak value corresponding to the plurality of bar graphs, determine one or more of the main peak value of atomic number corresponding to the maximum composition percentage in the plurality of composition percentages, the secondary peak value of atomic number corresponding to the second largest composition percentage in the plurality of composition percentages, and the third peak value of atomic number corresponding to the third largest composition percentage in the plurality of composition percentages.

7. The urinary stone composition report generation method according to claim 3, characterized by, The method further comprises: If the set output item is configured as one or more of the primary atomic number peak value, the secondary atomic number peak value, and the third atomic number peak value, Obtaining a urinary stone atomic number image corresponding to the dual-energy abdominal image; Extracting a plurality of bar graphs corresponding to effective atomic numbers in the urinary stone atomic number image; Determining a plurality of component percentages corresponding to peak values of the plurality of bar graphs according to the urinary stone atomic number image; Determining one or more of the primary atomic number peak value corresponding to the largest component percentage in the plurality of component percentages, the secondary atomic number peak value corresponding to the second largest component percentage in the plurality of component percentages, and the third atomic number peak value corresponding to the third largest component percentage in the plurality of component percentages based on the plurality of component percentages corresponding to the peak values of the plurality of bar graphs.

8. The urinary stone composition report generation method according to claim 4, characterized by, The method further comprises: If the set output item is configured as one or more of the primary atomic number peak value, the secondary atomic number peak value, and the third atomic number peak value, Obtaining a urinary stone atomic number image corresponding to the dual-energy abdominal image; Extracting a plurality of bar graphs corresponding to effective atomic numbers in the urinary stone atomic number image; Determining a plurality of component percentages corresponding to peak values of the plurality of bar graphs according to the urinary stone atomic number image; Determining one or more of the primary atomic number peak value corresponding to the largest component percentage in the plurality of component percentages, the secondary atomic number peak value corresponding to the second largest component percentage in the plurality of component percentages, and the third atomic number peak value corresponding to the third largest component percentage in the plurality of component percentages based on the plurality of component percentages corresponding to the peak values of the plurality of bar graphs.

9. The urinary stone composition report generation method according to any one of claims 1 or 2 or 5 or 7, characterized by, The method further comprises: If the set output item is configured as one or more of the primary atomic number peak value, the secondary atomic number peak value, and the third atomic number peak value, Obtaining a urinary stone atomic number image corresponding to the dual-energy abdominal image; 10. The urinary stone composition report generation method according to claim 3, characterized by, Extracting a plurality of bar graphs corresponding to effective atomic numbers in the urinary stone atomic number image; Determining a plurality of component percentages corresponding to peak values of the plurality of bar graphs according to the urinary stone atomic number image; Determining one or more of the primary atomic number peak value corresponding to the largest component percentage in the plurality of component percentages, the secondary atomic number peak value corresponding to the second largest component percentage in the plurality of component percentages, and the third atomic number peak value corresponding to the third largest component percentage in the plurality of component percentages based on the plurality of component percentages corresponding to the peak values of the plurality of bar graphs.

11. The urinary stone composition report generation method according to claim 4, characterized by, The method further comprises: If the set output item is configured as one or more of the primary atomic number peak value, the secondary atomic number peak value, and the third atomic number peak value, Obtaining a urinary stone atomic number image corresponding to the dual-energy abdominal image; Extracting a plurality of bar graphs corresponding to effective atomic numbers in the urinary stone atomic number image; Determining a plurality of component percentages corresponding to peak values of the plurality of bar graphs according to the urinary stone atomic number image; Determining one or more of the primary atomic number peak value corresponding to the largest component percentage in the plurality of component percentages, the secondary atomic number peak value corresponding to the second largest component percentage in the plurality of component percentages, and the third atomic number peak value corresponding to the third largest component percentage in the plurality of component percentages based on the plurality of component percentages corresponding to the peak values of the plurality of bar graphs. The method further comprises: If the set output item is configured as one or more of the primary atomic number peak value, the secondary atomic number peak value, and the third atomic number peak value, Obtaining a urinary stone atomic number image corresponding to the dual-energy abdominal image; Extracting a plurality of bar graphs corresponding to effective atomic numbers in the urinary stone atomic number image; Determining a plurality of component percentages corresponding to peak values of the plurality of bar graphs according to the urinary stone atomic number image; Determining one or more of the primary atomic number peak value corresponding to the largest component percentage in the plurality of component percentages, the secondary atomic number peak value corresponding to the second largest component percentage in the plurality of component percentages, and the third atomic number peak value corresponding to the third largest component percentage in the plurality of component percentages based on the plurality of component percentages corresponding to the peak values of the plurality of bar graphs.

12. The urinary stone composition report generation method according to claim 6, characterized by, The method for inserting the set output item and the corresponding stone information into the dual-energy abdominal image to generate a urinary stone composition report comprises: adding the stone information to the corresponding position of the set output item to generate a urinary stone composition report to be inserted; inserting the urinary stone composition report to be inserted into the dual-energy abdominal image to generate a urinary stone composition report.

13. The urinary stone composition report generation method according to claim 8, characterized by, The method for adding the stone information to the corresponding position of the set output item to generate a urinary stone composition report to be inserted comprises: respectively acquiring the corresponding positions of the to-be-filled areas of the set output item; respectively adding the corresponding stone information to the corresponding positions of the set output item to generate a urinary stone composition report to be inserted.

14. The urinary stone composition report generation method according to any one of claims 9 to 11, characterized by, The method for adding the stone information to the corresponding position of the set output item to generate a urinary stone composition report to be inserted comprises: respectively acquiring the corresponding positions of the to-be-filled areas of the set output item; respectively adding the corresponding stone information to the corresponding positions of the set output item to generate a urinary stone composition report to be inserted.

15. A urinary stone composition report generation system characterized by comprising: comprise: an acquisition unit, configured to acquire a dual-energy abdominal image and a corresponding urinary stone composition report template; an extraction unit, configured to extract, according to a set output item corresponding to the urinary stone composition report template, stone information corresponding to the set output item from the dual-energy abdominal image, including: if the set output item is configured as a stone type, extracting a plurality of composition percentages of a plurality of peak values corresponding to a plurality of strip charts corresponding to an effective atomic number in a urinary stone atomic number image corresponding to the dual-energy abdominal image; if there is an overlapping interval in at least two composition percentage intervals corresponding to a set stone type composition percentage interval in the plurality of composition percentages corresponding to the plurality of strip charts, determining a stone gray scale value of an iodine-based image corresponding to the dual-energy abdominal image; respectively calculating an average gray scale value and uniformity corresponding to the stone gray scale value; if the average gray scale value is greater than a set average gray scale value and the uniformity is greater than a set uniformity, configuring the stone type as calcium oxalate dihydrate stone; otherwise, configuring the stone type as struvite stone or carbonate apatite stone; a first generation unit, configured to add the stone information to the corresponding position of the set output item to generate a urinary stone composition report to be inserted; a second generation unit, configured to insert the urinary stone composition report to be inserted into the dual-energy abdominal image to generate a urinary stone composition report.

16. A urinary stone composition report generation system characterized by comprising: comprise: an electronic device configured with a processor and a memory for storing processor-executable instructions; wherein the processor is configured to invoke the instructions stored in the memory to execute the urinary stone composition report generation method in any one of claims 1 to 14.

17. A urinary stone composition report generation system characterized by, comprise: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to invoke the instructions stored in the memory to execute the urinary stone composition report generation method in any one of claims 1 to 14.

18. A urinary stone composition report generation system characterized by comprising: comprise: A computer-readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement the urinary stone composition report generation method of any one of claims 1 to 14.

19. A urinary stone composition report generation system characterized by comprising: Comprising: A computer program product comprising computer programs / instructions which, when executed by a processor, implement the urinary stone composition report generation method of any one of claims 1 to 14.

Images