Image report display method and device, equipment, storage medium and program product

Abstract

The invention relates to an image report display method and device, equipment, a storage medium and a program product. The method comprises the following steps: acquiring and displaying a medical image of a to-be-detected object and an image report corresponding to the medical image; obtaining a trigger operation of a first user on a target text in the image report; and in response to the trigger operation, displaying related image information corresponding to the target text in the medical image. By adopting the method, the accuracy of the analysis result obtained after the medical image is analyzed can be improved.

Description

Technical Field

[0001] The present application relates to the field of medical information technology, and in particular to an imaging report display method, device, equipment, storage medium and program product. Background Art

[0002] With the continuous development of imaging reporting technology, clinicians currently mostly analyze patients based on their imaging reports when examining them to obtain corresponding analysis results.

[0003] In related technologies, patients usually take medical images first, and then the imaging doctor outputs a report based on the taken medical images to obtain an imaging report; after that, the clinician can obtain the imaging report and analyze it based on the relevant content in the imaging report combined with the medical images to finally obtain the analysis results.

[0004] However, the information transmission method in the above-mentioned technology is relatively inefficient, resulting in low accuracy of the analysis results obtained by clinicians after analyzing the information transmitted in the imaging report. Summary of the invention

[0005] Based on this, it is necessary to provide an image report display method, device, equipment, storage medium and program product that can improve the accuracy of analysis results obtained after analyzing medical images in response to the above technical problems.

[0006] In a first aspect, the present application provides an imaging report display method, the method comprising:

[0007] Acquire and display the medical images of the object to be tested and the image report corresponding to the medical images;

[0008] Acquire a trigger operation of the first user on the target text in the image report;

[0009] In response to the triggering operation, relevant image information corresponding to the target text is displayed in the medical image.

[0010] In one embodiment, in response to the trigger operation, displaying relevant image information corresponding to the target text in the medical image includes:

[0011] In response to a trigger operation, controlling the medical image to jump from a current position to a target position corresponding to the target text;

[0012] Displays relevant image information at the target location.

[0013] In one embodiment, the medical image includes a two-dimensional tomographic image and / or a three-dimensional stereoscopic image, and the related image information includes the medical image and / or an image mask of a region of interest.

[0014] In one embodiment, the method further comprises:

[0015] In response to a trigger operation, detecting whether the target text includes professional terms;

[0016] If the target text includes professional terms, relevant description information corresponding to the professional terms is obtained from a preset database;

[0017] Displays relevant descriptive information at set positions around professional terms.

[0018] In one embodiment, the method further comprises:

[0019] Detecting whether the text input by the second user includes the professional term to be described;

[0020] If the text includes the professional term to be described, prompt information is output to the second user; the prompt information is used to instruct the second user to input relevant description information corresponding to the professional term to be described in the database.

[0021] In one embodiment, the above-mentioned related description information includes at least one of explanation information corresponding to the professional terminology, representative images corresponding to the professional terminology, and case information corresponding to the professional terminology.

[0022] In one embodiment, the method for generating the above-mentioned imaging report includes:

[0023] Obtaining an initial image report generated by artificial intelligence; the initial image report includes a link relationship between initial text and image candidate locations of relevant image information;

[0024] In response to the second user's review operation on the link relationship, an image report is generated.

[0025] In one embodiment, the generating of the image report in response to the second user's review operation on the link relationship includes:

[0026] In response to the second user's review operation on the link relationship, update information for updating the link relationship is obtained; the review operation includes at least one of a adding operation, a deleting operation, a modifying operation, and a searching operation;

[0027] The link relationship is updated according to the updated information and an image report is generated.

[0028] In one embodiment, the method for generating the above-mentioned imaging report includes:

[0029] Obtain third-party imaging reports;

[0030] Performing text recognition on the third-party imaging report to obtain candidate texts in the third-party imaging report; and performing image recognition on the third-party imaging report to obtain candidate images in the third-party imaging report;

[0031] Determine the image candidate position of the candidate image in the medical image, establish a link relationship between the candidate text and the image candidate position, and generate an image report.

[0032] In a second aspect, the present application also provides an imaging report display device, the device comprising:

[0033] A data acquisition module, used to acquire and display the medical images of the object to be tested and the image report corresponding to the medical images;

[0034] An operation acquisition module, used to acquire a trigger operation of the first user on the target text in the image report;

[0035] The display module is used to display relevant image information corresponding to the target text in the medical image in response to a trigger operation.

[0036] In a third aspect, the present application further provides a computer device, the computer device comprising a memory and a processor, the memory storing a computer program, and the processor implementing the following steps when executing the computer program:

[0037] Acquire and display the medical images of the object to be tested and the image report corresponding to the medical images;

[0038] Acquire a trigger operation of the first user on the target text in the image report;

[0039] In response to the triggering operation, relevant image information corresponding to the target text is displayed in the medical image.

[0040] In a fourth aspect, the present application further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0041] Acquire and display the medical images of the object to be tested and the image report corresponding to the medical images;

[0042] Acquire a trigger operation of the first user on the target text in the image report;

[0043] In response to the triggering operation, relevant image information corresponding to the target text is displayed in the medical image.

[0044] In a fifth aspect, the present application further provides a computer program product, the computer program product comprising a computer program, and when the computer program is executed by a processor, the following steps are implemented:

[0045] Acquire and display the medical images of the object to be tested and the image report corresponding to the medical images;

[0046] Acquire a trigger operation of the first user on the target text in the image report;

[0047] In response to the triggering operation, relevant image information corresponding to the target text is displayed in the medical image.

[0048] The above-mentioned image report display method, device, equipment, storage medium and program product obtain and display the medical image of the object to be tested and the corresponding image report, then obtain the user's trigger operation on the target text in the image report, and display the relevant image information corresponding to the target text in the medical image in response to the trigger operation. In this method, since the relevant image information corresponding to the target text can be displayed in the medical image in response to the user's trigger operation on the target text in the image report, it is convenient for the user to display the relevant image information required by the user in real time when observing the image report. In this way, the information provided to the user is more and more efficient, and the displayed information also meets the real-time needs of the user. Therefore, when the user conducts a comprehensive analysis on these relevant image information and medical images, the analysis results obtained are more accurate. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 is an internal structure diagram of a computer device in one embodiment;

[0050] Figure 2 It is a flowchart of an image report display method in one embodiment;

[0051] Figure 3 A schematic diagram of a flow chart of an imaging report display method in another embodiment;

[0052] Figure 4 A schematic diagram of a flow chart of an imaging report display method in another embodiment;

[0053] Figure 5 A schematic diagram of a flow chart of an imaging report display method in another embodiment;

[0054] Figure 6 A schematic diagram of a flow chart of an imaging report display method in another embodiment;

[0055] Figure 7 It is a structural block diagram of an image report display device in an embodiment. DETAILED DESCRIPTION

[0056] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0057] The image report display method provided in the embodiment of the present application can be applied to a computer device, which can be a terminal or a server. Taking the terminal as an example, its internal structure diagram can be as follows: Figure 1 As shown. The computer device includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be achieved through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, an image report display method is implemented. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covered on the display screen, or a button, trackball or touchpad set on the computer device housing, or an external keyboard, touchpad or mouse, etc.

[0058] Those skilled in the art will understand that Figure 1 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0059] In one embodiment, Figure 2 As shown, a method for displaying an image report is provided, and the method is applied to Figure 1 Taking the computer device in the example as an example, the method may include the following steps:

[0060] S202, obtaining and displaying the medical image of the object to be tested and the image report corresponding to the medical image.

[0061] The object to be detected may be a human body, an animal body, or a plant, etc. In addition, the object to be detected may also be a part or an organ of a human body or an animal body, etc.

[0062] The method for obtaining the medical image of the object to be tested may be to use a scanning device to scan the object to be tested and obtain the medical image after image reconstruction, or to obtain the medical image of the object to be tested pre-stored from the cloud or server, or other acquisition methods, which are not specifically limited here. The medical image here can be any single-modality image, such as CT image, PET image, MR image, etc., or the medical image here can also be a multi-modality fusion image, such as an image fused with a PET image and a CT image.

[0063] The image report corresponding to the medical image may be an image report generated based on the image features on the medical image, and used to describe the image features on the medical image and provide corresponding conclusive text, etc. For example, the radiologist may fill in relevant information in the image template on the computer device based on the medical image to generate the corresponding image report, or the image report of the medical image may be generated in other ways, such as handwritten, etc., as long as the impact report of the medical image can be generated.

[0064] After obtaining the medical images and the corresponding image reports, they can be uploaded to a computer device, which can then display the medical images and the corresponding image reports for users to view. The users here may be clinicians, radiologists, related scientific researchers, and the like.

[0065] The display mode of the above-mentioned medical images can be set according to user needs. For example, the user can input the display mode required on the display page of the computer device. The display mode here can include, for example, displaying PET MIP (Maximum Intensity Projection) images, CT SSD (shaded surface display, surface covered display technology or surface covered three-dimensional reconstruction) images or VR (Virtual Reality) images, or displaying medical images of different modalities after fusion, etc. Of course, the display mode here can also be switched according to user needs.

[0066] In addition, the above-mentioned imaging reports and medical images can be displayed in different positions on the same display page. At the same time, other information can also be displayed on the display page. For example, stereoscopic medical images can be displayed on the left side of the display page, tomographic medical images can be displayed in the middle, and imaging reports can be displayed on the right side.

[0067] S204: Acquire a triggering operation of the first user on the target text in the image report.

[0068] In this step, a general imaging report will include text content such as descriptive text and concluding text, and will also include some displayed partial images. The imaging report of the medical image in the present embodiment is different from the common imaging report. In the present embodiment, for the text content and partial images in the imaging report, a link relationship between the text content and partial images and a specific position in the medical image can be established in advance, or a link relationship between the text content and partial images and related imaging information can be established, or other link relationships can be established. The link relationship here can also be called a corresponding relationship. The established link relationship can then be embedded in the imaging report of the medical image, and the configured medical images can also be linked based on the link relationship.

[0069] At the same time, some images and text contents in the image report can be pre-configured to support user triggering, so that the user can use the link relationship to jump to the image or display related image information after triggering the image report.

[0070] Specifically, when the user is viewing an imaging report, if the information in the imaging report is not rich and complete enough or the user wants to view the medical image corresponding to the text content in the imaging report, the user can trigger the target text in the imaging report for which the user wants to view more information. The trigger here can be an operation such as the user clicking or selecting the target text in the imaging report with a mouse. After the user triggers the target text, the computer device can also receive the user's corresponding trigger operation, which can specifically be to learn that the user wants to view the target text and other information corresponding to the target text.

[0071] S206: In response to the triggering operation, relevant image information corresponding to the target text is displayed in the medical image.

[0072] In this step, after the computer device obtains the user's trigger operation, it can respond to the trigger operation. In the specific response, the computer device can determine the relevant image information corresponding to the target text based on the link relationship embedded in the image report, and display the corresponding relevant image information in the medical image; or it can determine the display position corresponding to the target text in the medical image based on the embedded link relationship, and then automatically jump the medical image to the display position for display, so that the doctor can observe the medical image.

[0073] For the above-mentioned medical images, as an optional embodiment, the above-mentioned medical images may include two-dimensional tomographic images and / or three-dimensional stereoscopic images, wherein the two-dimensional tomographic images may be multiple different two-dimensional slice images, and the three-dimensional stereoscopic images may be, for example, MIP images of PET, SSD images of CT or VR images, etc.

[0074] For the above-mentioned related image information displayed in the medical image, it may include possible information such as measurement primitives, for example, optionally, it may include medical images and / or image masks of regions of interest. That is to say, as mentioned above, only the medical image at the display position corresponding to the target text may be displayed, and the image mask of the corresponding region of interest may also be displayed at the display position, and the medical image at the display position may also be presented in the form of flashing, etc. In addition, if the medical image at the display position is a lesion area, an identifier is added near the medical image at the position, and when the user clicks the identifier, an image comparison box can be popped up to display the comparison between the lesion image at the position and the normal image, so as to assist the user (such as a clinician) in making a diagnosis. Among them, the image mask refers to an image mask, that is, a mask of the region of interest can be displayed at the display position. Here, a variety of different types of image information are displayed at the display position of the medical image, which can provide users with richer image information, thereby more helpful for users to obtain more accurate analysis results. In addition, users can set in advance the risk level of the display location and the priority of multiple diseases. For example, when there are multiple diseases in a certain part of the body, such as three diseases, the risk level of this part is generally higher than the risk level of one disease. The part can be highlighted or otherwise marked prominently, and the diseases can be prioritized according to information such as severity and duration of illness. For example, when linking to the body part through target text information, while displaying the medical image of the part, a pop-up window displays the risk level of the part, multiple disease conditions sorted by disease priority, etc., and different diseases are displayed differently, such as through masking, flashing, color marking, etc.

[0075] For example, if the radiologist fills in the imaging report that a lesion was found at a certain location, the lesion outlined by the radiologist will be recorded as a mask. When it is displayed to the clinician, it will be displayed as a mask of the lesion. When the clinician clicks on the corresponding text in the imaging report, the mask will appear, informing the clinician that the lesion reported by the radiologist is this lesion.

[0076] In the above-mentioned image report display method, the medical image of the object to be tested and the corresponding image report are obtained and displayed, and then the user's trigger operation on the target text in the image report is obtained, and the relevant image information corresponding to the target text is displayed in the medical image in response to the trigger operation. In this method, since the relevant image information corresponding to the target text can be displayed in the medical image in response to the user's trigger operation on the target text in the image report, it is convenient for the user to display the relevant image information required by the user in real time when observing the image report. In this way, the information provided to the user is more and more efficient, and the displayed information also meets the real-time needs of the user. Therefore, when the user conducts a comprehensive analysis of these relevant image information and medical images, the analysis results obtained are more accurate.

[0077] The above embodiments mentioned that different link relationships can be established in advance, and then different contents can be displayed in the medical image based on the different link relationships. The following embodiments describe the specific display process when the link relationship is a link relationship between text content and a partial image and a specific location in the medical image.

[0078] In another embodiment, another imaging report display method is provided. Based on the above embodiment, Figure 3 As shown, the above S206 may include the following steps:

[0079] S302, in response to a trigger operation, controlling the medical image to jump from a current position to a target position corresponding to the target text.

[0080] In this step, after the computer device obtains the user's trigger operation on the target text, it can retrieve the previously established link relationship, that is, retrieve the link relationship between the text content and the partial image and the specific position in the medical image, and then determine the specific position in the medical image corresponding to the target text based on the link relationship, which is recorded as the target position.

[0081] S304, displaying relevant image information at the target location.

[0082] In this step, after obtaining the corresponding position of the target text in the medical image, the computer device can control the medical image to jump from the current display position to the target position, which is the position where the imaging doctor looks at the image in the process of generating an imaging report. At this time, relevant image information at the target position can be displayed, such as medical images and image masks.

[0083] In this embodiment, by responding to the user's trigger operation, the medical image is controlled to jump from the current position to the target position corresponding to the target text, and the relevant image information at the target position is displayed. This allows the user to efficiently view the required image information and improves the efficiency and accuracy of medical image analysis.

[0084] When actual users view imaging reports, the words used in the imaging reports may be relatively professional. If users cannot know the true meaning in time, the subsequent image analysis process may not proceed smoothly or some misjudgments may occur. In order to solve this problem, a solution is proposed, and the following embodiment illustrates this solution.

[0085] In another embodiment, another imaging report display method is provided. Based on the above embodiment, Figure 4 As shown, the above method may further include the following steps:

[0086] S402: In response to a trigger operation, detecting whether the target text includes professional terms.

[0087] In this step, after the computer device obtains the user's triggering operation on the target text, the text content corresponding to the target text triggered by the user can also be obtained, and then it can be detected whether the text content of the target text includes professional terms.

[0088] The professional terms here may be medical terms or imaging terms related to medical imaging. For example, some imaging terms such as "such and such sign" may be very easy for imaging doctors to understand. They may quickly learn that they may represent the manifestation of a certain disease and obtain image analysis results. However, clinicians may not have relevant knowledge of the imaging terms. When they see the relevant professional terms in the imaging report, they may not be able to accurately understand their meanings, resulting in the subsequent image analysis process being unable to proceed smoothly, or they may speculate based on experience that the professional terms may lead to misjudgment of the image analysis results.

[0089] The method for detecting whether professional terms are included here can be to pre-establish a database of professional terms, which can include medical terms and imaging terms related to medical images and imaging reports, and can also include explanation information or description information corresponding to these medical terms or imaging terms and other professional terms, which can be recorded as relevant description information of professional terms. The professional terms and related description information in the professional term database can be pre-set by the user, and can also be updated according to actual conditions later, such as adding, deleting, modifying and other update operations.

[0090] When detecting whether the target text includes professional terms, the text content of the target text may be matched with the professional terms in the professional term library. If the match is successful, it means that the professional terms are included. If not, it means that the professional terms are not included.

[0091] S404: If the target text includes professional terms, relevant description information corresponding to the professional terms is obtained from a preset database.

[0092] In this step, if it is detected that the target text includes professional terms, the professional terms can be found in the database of the professional terms, and the relevant description information corresponding to the professional terms can be found in the database.

[0093] S406, displaying relevant description information at a set position around the professional term.

[0094] In this step, after obtaining the relevant descriptive information corresponding to the professional term as mentioned above, the relevant descriptive information can be displayed at a preset position around the professional term in the image report. The preset position can be, for example, a position around the professional term that is close to it, or it can also be a blank position in the image report, etc.

[0095] As an optional embodiment, the above-mentioned related description information includes at least one of the explanation information corresponding to the professional term, the representative image corresponding to the professional term, and the case information corresponding to the professional term. The explanation information here can be information that explains the popular meaning of the professional term; the representative image can be a typical image related to the professional term, which can well illustrate the professional term, such as a typical image of myocardial hypertrophy; the case information may include image information and examination information associated with the professional term. By setting more relevant description information for professional terms, it is convenient for users to view more information, reduce the knowledge reserve requirements for doctors, and assist doctors to better perform image analysis based on the relevant description information, thereby improving the efficiency and accuracy of doctors' image analysis.

[0096] In this embodiment, by responding to the user's trigger operation, it is detected whether the target text triggered by the user includes professional terms, and when professional terms exist, the corresponding relevant descriptive information is obtained from the database and displayed around the professional terms. In this way, more professional information can be provided to doctors when they view imaging reports and medical images, reducing the difficulty of doctors' image analysis, while improving the efficiency and accuracy of doctors' image analysis.

[0097] It was mentioned above that relevant descriptive information of professional terms in imaging reports can be displayed to users. This is mainly for clinical doctors who view imaging reports. For radiologists who generate reports, in order to ensure that the professional terms in the imaging reports they generate will have corresponding relevant descriptive information, corresponding relevant descriptive information can be added to the professional terms included by the radiologists in the process of generating imaging reports.

[0098] In another embodiment, another imaging report display method is provided. Based on the above embodiment, the above method may further include the following steps:

[0099] Step A1: Detect whether the text input by the second user includes the professional term to be described.

[0100] In this step, the first user may be a clinician and the second user may be a radiologist. When the second user generates an imaging report, he or she generally enters relevant text in the imaging report template, so that the computer device can obtain the text entered by the second user in real time, and then detect whether the text includes professional terms.

[0101] If professional terms are included, you can search whether the professional terms exist in the professional term database. If the professional terms exist in the database, it means that the professional terms already have relevant description information, and you don’t need to use the professional terms as the professional terms to be described. If the professional terms do not exist in the database, it means that the professional terms have no relevant description information, and you can use the professional terms as the professional terms to be described.

[0102] Step A2: if the text includes the professional term to be described, a prompt message is output to the second user; the prompt message is used to instruct the second user to input relevant description information corresponding to the professional term to be described in the database.

[0103] In this step, if it is detected that the input text includes the professional term to be described, it indicates that the professional term to be described has no relevant description information, and a prompt message can be output to the second user to instruct the second user to input the professional term to be described and the relevant description information corresponding to the professional term to be described in the professional term database. The prompt message can be output by voice, by sound and light, or by outputting display information on a display page, or by other methods, which are not specifically limited here.

[0104] After the second user obtains the prompt information, he can enter the professional term to be described and the relevant description information corresponding to the professional term to be described in the database of professional terms to complete the explanation of the term to be described.

[0105] Furthermore, the database of professional terms can also support radiologists to upload typical images and even case information corresponding to the professional terms, and support radiologists to like or score the images in the database, so that the most typical images can be highlighted. In this way, when clinicians conduct searches, they can not only understand the meaning of the professional terms, but also observe related images and cases, so as to facilitate the understanding of professional terms and conduct more accurate image analysis.

[0106] From the above description, it can be seen that the database of professional terms in the embodiment of the present application not only supports clinicians to retrieve professional terms in a timely manner and view example images to facilitate clinicians' understanding, but also supports prompting radiologists to complete the relevant description of professional terms when writing imaging reports.

[0107] In this embodiment, by detecting whether the text input by the user contains professional terms to be described, and outputting a prompt message to the user to instruct the user to enter relevant descriptive information when there are professional terms to be described, the explanation of the terms to be described can be improved, so that other subsequent users (such as clinicians, etc.) can better understand the professional terms to be described, thereby improving the accuracy and efficiency of analysis of imaging reports, etc.

[0108] It is mentioned above that there are multiple ways to generate an image report. The following two embodiments respectively illustrate two possible ways to generate an image report.

[0109] In another embodiment, another imaging report display method is provided. Based on the above embodiment, Figure 5 As shown, the generation method of the above imaging report may include the following steps:

[0110] S502, obtaining an initial image report generated by artificial intelligence; the initial image report includes a link relationship between an initial text and image candidate positions of relevant image information.

[0111] In this step, after obtaining the medical image, an image report of the medical image can be generated by artificial intelligence. The artificial intelligence here can be a neural network or deep learning method, which extracts features on the medical image and generates descriptive text, and fills the generated descriptive text into the corresponding position in the image template to obtain the initial texts in the initial image report, such as "image findings", "conclusion description" and other initial texts; at the same time, a link relationship can be established between each initial text in the initial image report and a specific position in the medical image, that is, a link relationship can be established between each initial text and the image candidate position of the relevant image information, and finally the generated initial image report can be obtained.

[0112] The relevant image information here refers to the above-mentioned medical image and image mask information. The image candidate position here is the initial position corresponding to the initial text in the medical image, which is recorded as the candidate position.

[0113] S504: Generate an image report in response to the second user's review operation on the link relationship.

[0114] In this step, when generating the initial imaging report, since the initial imaging report generated by artificial intelligence may contain a generated link relationship that does not meet the requirements, this embodiment proposes that the generated link relationship can be adjusted or updated. When adjusting or updating, as an optional embodiment, it can be in response to a second user's review operation on the link relationship, obtaining update information for updating the link relationship; the above review operation includes at least one of a new operation, a deletion operation, a modification operation, and a search operation; the link relationship is updated according to the updated information to generate an imaging report.

[0115] That is to say, after the initial imaging report is generated by artificial intelligence, the second user can review the initial imaging report. Specifically, the second user can check whether the correspondence between the initial text and the relevant imaging information at the image candidate position is accurate through the link relationship on the initial imaging report, such as whether the description of the initial text is correct, whether the image candidate position corresponding to the initial text is correct, or whether the relevant imaging information at the image candidate position is correct. At the same time, it also supports the second user to view images and / or description texts of similar cases by keywords.

[0116] The website and APP corresponding to the radiological image report generation system also support the second user to input update information through voice or typing during the review process. That is, when the second user reviews the link relationship, if it is found that the link relationship needs to be added, deleted, modified and searched, the corresponding review operation can be entered on the display page of the website and APP, including at least one of the addition operation, deletion operation, modification operation and search operation, wherein the review operation includes specific information on how to operate, which is recorded as update information. In this way, the computer device can receive the review operation of the second user, and at the same time, the review operation can be parsed to obtain the update information therein, until the link relationship can be operated accordingly according to the specific information included in the update information. For example, the update information includes the modification of the image candidate position in the link relationship, and the update information can include the position to be modified. The computer device can modify the corresponding image candidate position based on the position to be modified, thereby updating the link relationship and obtaining an updated image report.

[0117] In this embodiment, an image report is generated by obtaining an initial image report generated by artificial intelligence and responding to a user's review operation of the link relationship therein. In this way, when the initial image report generated by artificial intelligence has errors and other problems, the initial image report can be updated through review to obtain a more accurate and more realistic image report. In addition, by responding to the user's review operation on the initial image report to obtain updated information and modifying the link relationship accordingly, user operations can be supported, so that the user can quickly update the link relationship and improve the user experience.

[0118] It is mentioned above that there are multiple ways to generate image reports, and the above embodiments mainly mention the use of artificial intelligence to generate the content of image reports including link relationships. When actually generating image reports, it is also possible that the radiological image report generation system in this embodiment will not be used, that is, the link relationship will not be directly generated. Regarding how to generate an image report in this case, the following embodiments will explain this.

[0119] In another embodiment, another imaging report display method is provided. Based on the above embodiment, Figure 6 As shown, the generation method of the above imaging report may include the following steps:

[0120] S602, obtaining a third-party imaging report.

[0121] Among them, the third-party imaging report can be an imaging report obtained after the object to be tested is examined in other hospitals or other departments. Compared with the above-mentioned generated images, the third-party imaging report does not include the generated link relationship, and the other contents are similar, that is, including text content, partial images and other contents.

[0122] S604, performing text recognition on the third-party image report to obtain candidate texts in the third-party image report; and performing image recognition on the third-party image report to obtain candidate images in the third-party image report.

[0123] In this step, after obtaining the third-party image report, a text recognition algorithm (such as OCR (Optical Character Recognition) technology, etc.) can be used to recognize the text content in the third-party image report to obtain the text content included in the third-party image report, which is recorded as candidate text. At the same time, an image recognition algorithm or a neural network can be used to perform image recognition processing on some images in the third-party image report to obtain candidate images.

[0124] S606, determining the candidate image position of the candidate image in the medical image, and establishing a link relationship between the candidate text and the candidate image position, and generating an image report.

[0125] In this step, by comparing which part of the medical image the candidate image is selected from, the position information of the candidate image in the medical image can be obtained, which is recorded as the image candidate position; then, it can be detected which content in the candidate text corresponds to which candidate image, and a link relationship between the candidate text and the image candidate position of the candidate image is established accordingly to generate an image report. When the user views the image report, the link relationship can jump to the image position corresponding to the clicked text, so as to provide the user with more information for image analysis and improve the accuracy of image analysis.

[0126] In this embodiment, by performing text recognition and image recognition on a third-party image report, candidate texts and candidate images are obtained, and a link relationship between the candidate image position and the candidate text of the candidate image is established to generate an image report. In this way, image reports providing a variety of information can be generated for image reports from different sources, so that more information can be provided to users for image analysis, thereby improving the accuracy of image analysis.

[0127] A detailed embodiment is given below to illustrate the technical solution of the present application. Based on the above embodiment, the method may include the following steps:

[0128] S1, acquiring and displaying medical images of the object to be tested and image reports corresponding to the medical images; the medical images include two-dimensional tomographic images and / or three-dimensional stereo images;

[0129] S2, obtaining a triggering operation of the first user on the target text in the image report;

[0130] S3, in response to the trigger operation, controlling the medical image to jump from the current position to the target position corresponding to the target text;

[0131] S4, displaying relevant image information at the target location; the relevant image information includes medical images and / or image masks of the region of interest;

[0132] S5, in response to the trigger operation, detecting whether the target text includes professional terms;

[0133] S6, if the target text includes professional terms, then obtaining relevant description information corresponding to the professional terms in a preset database;

[0134] S7, displaying relevant description information at a set position around the professional term; the relevant description information includes at least one of explanation information corresponding to the professional term, representative images corresponding to the professional term, and case information corresponding to the professional term;

[0135] S8, detecting whether the text input by the second user includes the professional term to be described;

[0136] S9, if the text includes the professional term to be described, outputting prompt information to the second user; the prompt information is used to instruct the second user to input relevant description information corresponding to the professional term to be described in the database;

[0137] S10, obtaining an initial image report generated by artificial intelligence; the initial image report includes a link relationship between an initial text and image candidate positions of relevant image information;

[0138] S11, in response to a review operation of the second user on the link relationship, obtaining update information for updating the link relationship; the review operation includes at least one of a adding operation, a deleting operation, a modifying operation, and a searching operation;

[0139] S12, updating the link relationship according to the update information and generating an image report;

[0140] S13, obtain third-party imaging report;

[0141] S14, performing text recognition on the third-party imaging report to obtain candidate texts in the third-party imaging report; and performing image recognition on the third-party imaging report to obtain candidate images in the third-party imaging report;

[0142] S15, determining the candidate image position of the candidate image in the medical image, and establishing a link relationship between the candidate text and the candidate image position, and generating an image report.

[0143] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0144] Based on the same inventive concept, the embodiment of the present application also provides an image report display device for implementing the image report display method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more image report display device embodiments provided below can refer to the limitations of the image report display method above, and will not be repeated here.

[0145] In one embodiment, Figure 7 As shown, an image report display device is provided, comprising: a data acquisition module, an operation acquisition module and a display module, wherein:

[0146] A data acquisition module, used to acquire and display the medical images of the object to be tested and the image report corresponding to the medical images;

[0147] An operation acquisition module, used to acquire a trigger operation of the first user on the target text in the image report;

[0148] The display module is used to display relevant image information corresponding to the target text in the medical image in response to a trigger operation.

[0149] Optionally, the medical image includes a two-dimensional tomographic image and / or a three-dimensional stereoscopic image, and the related image information includes a medical image and / or an image mask of a region of interest.

[0150] In another embodiment, another imaging report display device is provided. Based on the above embodiment, the display module may include:

[0151] A jump unit, used for controlling the medical image to jump from a current position to a target position corresponding to the target text in response to a trigger operation;

[0152] The display unit is used to display relevant image information at the target position.

[0153] In another embodiment, another imaging report display device is provided. Based on the above embodiment, the above device may further include:

[0154] A first detection module, configured to detect whether the target text includes professional terms in response to a trigger operation;

[0155] An information acquisition module is used to acquire relevant description information corresponding to the professional terms in a preset database if the target text includes professional terms;

[0156] The set position display module is used to display relevant description information at a set position around the professional term.

[0157] Optionally, the above device may further include:

[0158] A second detection module is used to detect whether the text input by the second user includes the professional term to be described;

[0159] The prompt module is used to output prompt information to the second user if the text includes the professional term to be described; the above prompt information is used to instruct the second user to enter relevant description information corresponding to the professional term to be described in the database.

[0160] Optionally, the above-mentioned related descriptive information includes at least one of the explanatory information corresponding to the professional terms, the representative images corresponding to the professional terms, and the case information corresponding to the professional terms.

[0161] In another embodiment, another imaging report display device is provided. Based on the above embodiment, the above device may further include a first report generation module. The first report generation module may include:

[0162] An initial report acquisition unit, used to acquire an initial image report generated by artificial intelligence; the initial image report includes a link relationship between an initial text and an image candidate position of relevant image information;

[0163] The first generating unit is used to generate an image report in response to a review operation of the second user on the link relationship.

[0164] Optionally, the above-mentioned first generation unit is specifically used to obtain update information for updating the link relationship in response to the second user's review operation on the link relationship; the above-mentioned review operation includes at least one of a new operation, a deletion operation, a modification operation and a search operation; the link relationship is updated according to the update information to generate an image report.

[0165] In another embodiment, another imaging report display device is provided. Based on the above embodiment, the above device may further include a second report generation module. The second report generation module may include:

[0166] An image acquisition unit, used to obtain third-party image reports;

[0167] A recognition unit, configured to perform text recognition on a third-party imaging report to obtain candidate texts in the third-party imaging report; and perform image recognition on the third-party imaging report to obtain candidate images in the third-party imaging report;

[0168] The second generating unit is used to determine the candidate image position of the candidate image in the medical image, establish a link relationship between the candidate text and the candidate image position, and generate an image report.

[0169] Each module in the above-mentioned imaging report display device can be implemented in whole or in part by software, hardware and a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute the operations corresponding to each module above.

[0170] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0171] Acquire and display the medical image of the object to be tested and the image report corresponding to the medical image; obtain the trigger operation of the first user on the target text in the image report; and display the relevant image information corresponding to the target text in the medical image in response to the trigger operation.

[0172] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0173] In response to a trigger operation, the medical image is controlled to jump from a current position to a target position corresponding to the target text; and relevant image information at the target position is displayed.

[0174] In one embodiment, the medical image includes a two-dimensional tomographic image and / or a three-dimensional stereoscopic image, and the related image information includes a medical image and / or an image mask of a region of interest.

[0175] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0176] In response to a trigger operation, it is detected whether the target text includes professional terms; if the target text includes professional terms, relevant descriptive information corresponding to the professional terms is obtained from a preset database; and the relevant descriptive information is displayed at a set position around the professional terms.

[0177] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0178] Detect whether the text input by the second user includes the professional terms to be described; if the text includes the professional terms to be described, output prompt information to the second user; the above prompt information is used to instruct the second user to enter relevant description information corresponding to the professional terms to be described in the database.

[0179] In one embodiment, the above-mentioned related description information includes at least one of explanation information corresponding to the professional terminology, representative images corresponding to the professional terminology, and case information corresponding to the professional terminology.

[0180] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0181] An initial image report generated by artificial intelligence is obtained; the initial image report includes a link relationship between an initial text and an image candidate position of related image information; and an image report is generated in response to a second user's review operation on the link relationship.

[0182] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0183] In response to the second user's review operation on the link relationship, update information for updating the link relationship is obtained; the review operation includes at least one of a adding operation, a deleting operation, a modifying operation and a searching operation; the link relationship is updated according to the update information, and an image report is generated.

[0184] In one embodiment, when the processor executes the computer program, the processor further implements the following steps:

[0185] Obtain a third-party imaging report; perform text recognition on the third-party imaging report to obtain candidate texts in the third-party imaging report; and perform image recognition on the third-party imaging report to obtain candidate images in the third-party imaging report; determine the candidate image position of the candidate image in the medical image, and establish a link relationship between the candidate text and the candidate image position to generate an imaging report.

[0186] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0187] Acquire and display the medical image of the object to be tested and the image report corresponding to the medical image; obtain the trigger operation of the first user on the target text in the image report; and display the relevant image information corresponding to the target text in the medical image in response to the trigger operation.

[0188] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0189] In response to a trigger operation, the medical image is controlled to jump from a current position to a target position corresponding to the target text; and relevant image information at the target position is displayed.

[0190] In one embodiment, the medical image includes a two-dimensional tomographic image and / or a three-dimensional stereoscopic image, and the related image information includes a medical image and / or an image mask of a region of interest.

[0191] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0192] In response to a trigger operation, it is detected whether the target text includes professional terms; if the target text includes professional terms, relevant descriptive information corresponding to the professional terms is obtained from a preset database; and the relevant descriptive information is displayed at a set position around the professional terms.

[0193] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0194] Detect whether the text input by the second user includes the professional terms to be described; if the text includes the professional terms to be described, output prompt information to the second user; the above prompt information is used to instruct the second user to enter relevant description information corresponding to the professional terms to be described in the database.

[0195] In one embodiment, the above-mentioned related description information includes at least one of explanation information corresponding to the professional terminology, representative images corresponding to the professional terminology, and case information corresponding to the professional terminology.

[0196] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0197] An initial image report generated by artificial intelligence is obtained; the initial image report includes a link relationship between an initial text and an image candidate position of related image information; and an image report is generated in response to a second user's review operation on the link relationship.

[0198] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0199] In response to the second user's review operation on the link relationship, update information for updating the link relationship is obtained; the review operation includes at least one of a adding operation, a deleting operation, a modifying operation and a searching operation; the link relationship is updated according to the update information, and an image report is generated.

[0200] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0201] Obtain a third-party imaging report; perform text recognition on the third-party imaging report to obtain candidate texts in the third-party imaging report; and perform image recognition on the third-party imaging report to obtain candidate images in the third-party imaging report; determine the candidate image position of the candidate image in the medical image, and establish a link relationship between the candidate text and the candidate image position to generate an imaging report.

[0202] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:

[0203] Acquire and display the medical image of the object to be tested and the image report corresponding to the medical image; obtain the trigger operation of the first user on the target text in the image report; and display the relevant image information corresponding to the target text in the medical image in response to the trigger operation.

[0204] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0205] In response to a trigger operation, the medical image is controlled to jump from a current position to a target position corresponding to the target text; and relevant image information at the target position is displayed.

[0206] In one embodiment, the medical image includes a two-dimensional tomographic image and / or a three-dimensional stereoscopic image, and the related image information includes a medical image and / or an image mask of a region of interest.

[0207] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0208] In response to a trigger operation, it is detected whether the target text includes professional terms; if the target text includes professional terms, relevant descriptive information corresponding to the professional terms is obtained from a preset database; and the relevant descriptive information is displayed at a set position around the professional terms.

[0209] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0210] Detect whether the text input by the second user includes the professional terms to be described; if the text includes the professional terms to be described, output prompt information to the second user; the above prompt information is used to instruct the second user to enter relevant description information corresponding to the professional terms to be described in the database.

[0211] In one embodiment, the above-mentioned related description information includes at least one of explanation information corresponding to the professional terminology, representative images corresponding to the professional terminology, and case information corresponding to the professional terminology.

[0212] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0213] An initial image report generated by artificial intelligence is obtained; the initial image report includes a link relationship between an initial text and an image candidate position of related image information; and an image report is generated in response to a second user's review operation on the link relationship.

[0214] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0215] In response to the second user's review operation on the link relationship, update information for updating the link relationship is obtained; the review operation includes at least one of a adding operation, a deleting operation, a modifying operation and a searching operation; the link relationship is updated according to the update information, and an image report is generated.

[0216] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0217] Obtain a third-party imaging report; perform text recognition on the third-party imaging report to obtain candidate texts in the third-party imaging report; and perform image recognition on the third-party imaging report to obtain candidate images in the third-party imaging report; determine the candidate image position of the candidate image in the medical image, and establish a link relationship between the candidate text and the candidate image position to generate an imaging report.

[0218] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.

[0219] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0220] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0221] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A method for displaying an image report, characterized in that: The method comprises: Acquire and display the medical image of the object to be tested and the image report corresponding to the medical image; Acquire a triggering operation of the first user on the target text in the image report; In response to the trigger operation, relevant image information corresponding to the target text is displayed in the medical image.

2. The method according to claim 1, characterized in that The step of displaying relevant image information corresponding to the target text in the medical image in response to the trigger operation includes: In response to the trigger operation, controlling the medical image to jump from a current position to a target position corresponding to the target text; Display relevant image information at the target location.

3. The method according to any one of claims 1 to 2, characterized in that: The method further comprises: In response to the trigger operation, detecting whether the target text includes professional terms; If the target text includes professional terms, then obtaining relevant description information corresponding to the professional terms in a preset database; The relevant description information is displayed at a set position around the professional term.

4. The method according to claim 3, characterized in that The method further comprises: Detecting whether the text input by the second user includes the professional term to be described; If the text includes the professional term to be described, a prompt message is output to the second user; the prompt message is used to instruct the second user to input relevant description information corresponding to the professional term to be described in the database.

5. The method according to any one of claims 1-2, characterized in that: The imaging report is generated in the following manner: Obtaining an initial image report generated by artificial intelligence; the initial image report includes a link relationship between an initial text and image candidate positions of relevant image information; In response to the second user's review operation on the link relationship, the image report is generated.

6. The method according to any one of claims 1-2, characterized in that: The imaging report is generated in the following manner: Obtain third-party imaging reports; Performing text recognition on the third-party imaging report to obtain candidate texts in the third-party imaging report; and performing image recognition on the third-party imaging report to obtain candidate images in the third-party imaging report; The candidate image position of the candidate image in the medical image is determined, and a link relationship between the candidate text and the candidate image position is established to generate the image report.

7. An image report display device, characterized in that: The device comprises: A data acquisition module, used to acquire and display the medical image of the object to be tested and the image report corresponding to the medical image; An operation acquisition module, used to acquire a trigger operation of the first user on the target text in the image report; A display module is used to display relevant image information corresponding to the target text in the medical image in response to the trigger operation.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images