Information display method and device, electronic equipment and storage medium

Abstract

The invention provides an information display method and device, electronic equipment and a storage medium. At least one initial medical image is displayed through a preset interface; in response to a display adjustment operation on the physiological tissues in the initial medical image, acquiring image feature parameters of the adjusted first physiological tissues; and predicting a second physiological tissue according to the image feature parameter, and displaying a target medical image corresponding to the second physiological tissue to the preset interface. The lesion recognition efficiency is effectively improved.

Description

Technical Field

[0001] The present application relates to the field of image display technology, and in particular to an information display method, device, electronic device, and computer-readable storage medium. Background Art

[0002] With the rapid development of medical imaging scanning technology, DSA scanning, ultrasound scanning, MR scanning, CT scanning and other methods can be used to diagnose patients, and then the results of multiple examinations can be combined to fully display the lesions, so as to conduct a more complete and detailed examination of the lesions.

[0003] For medical images, doctors can manually adjust the window width and window position of medical images to optimize the image display effect, but this will lead to low efficiency in lesion diagnosis. Summary of the invention

[0004] The embodiments of the present application provide an information display method, device, electronic device and computer-readable storage medium, aiming to effectively improve the efficiency of lesion identification.

[0005] In a first aspect, an embodiment of the present application provides an information display method, comprising:

[0006] Displaying at least one initial medical image via a preset interface;

[0007] In response to a display adjustment operation on the physiological tissue in the initial medical image, acquiring an adjusted image characteristic parameter of the first physiological tissue;

[0008] A second physiological tissue is predicted according to the image feature parameters, and a target medical image corresponding to the second physiological tissue is displayed on the preset interface.

[0009] Optionally, the image feature parameter includes a visualized visual feature, and predicting the second physiological tissue according to the image feature parameter includes:

[0010] Determining a corresponding target visual response curve according to the type of the visualized visual feature;

[0011] A second physiological tissue is predicted according to the visualized visual feature and the target visual response curve.

[0012] Optionally, the type of the visualized visual feature includes at least one of a contrast feature type, an edge feature type, a brightness feature type, and a color feature type;

[0013] The predicting of the second physiological tissue according to the visualized visual feature and the target visual response curve comprises:

[0014] Obtaining a target visualization visual feature of at least one type among the contrast feature type, the edge feature type, the brightness feature type, and the color feature type, and performing statistics on the target visualization visual feature to obtain a corresponding target statistical result;

[0015] If the target statistical result meets the corresponding target visual response curve, the first physiological tissue is set as the predicted second physiological tissue.

[0016] Optionally, in response to the display adjustment operation on the physiological tissue in the initial medical image, obtaining the adjusted image characteristic parameters of the first physiological tissue includes:

[0017] In response to a display adjustment operation on the physiological tissue in the initial medical image, acquiring an adjusted first physiological tissue;

[0018] The visualized visual features in the initial medical image are extracted according to the display parameters of the medical image corresponding to the first physiological tissue.

[0019] Optionally, the image feature parameter includes the amount of the first physiological tissue in the initial medical image after adjustment, and the predicting the second physiological tissue according to the image feature parameter includes:

[0020] Obtaining an initial quantity of the first physiological tissue in the initial medical image before adjustment;

[0021] A second physiological tissue is predicted according to the initial quantity and the adjusted quantity of the first physiological tissue in the initial medical image.

[0022] Optionally, the image feature parameters include image feature parameters corresponding to a first physiological tissue in a plurality of initial medical images, and predicting the second physiological tissue according to the image feature parameters includes:

[0023] Acquire an initial medical image containing the image characteristic parameters of the first physiological tissue;

[0024] If a plurality of the initial medical images are arranged consecutively, the first physiological tissue is set as the predicted second physiological tissue.

[0025] Optionally, displaying the target medical image corresponding to the second physiological tissue on the preset interface includes:

[0026] determining, according to the physiological characteristic parameter corresponding to the second physiological tissue, whether there is a target medical image corresponding to the second physiological tissue in the initial medical image;

[0027] If a target medical image corresponding to the second physiological tissue exists in the initial medical image, the target medical image is extracted for display.

[0028] Optionally, after determining whether there is a target medical image corresponding to the second physiological tissue in the initial medical image, the method further includes:

[0029] If the target medical image corresponding to the second physiological tissue does not exist in the initial medical image, inputting the initial medical image into a preset physiological information recognition model to obtain a new medical image output by the physiological information recognition model;

[0030] According to the physiological characteristic parameters of the second physiological tissue, a target medical image corresponding to the second physiological tissue is extracted from the new medical image for display.

[0031] Optionally, displaying the target medical image corresponding to the second physiological tissue further includes:

[0032] Determining whether the target medical image corresponding to the second physiological tissue meets a preset display condition, wherein the preset display condition represents the completeness of the display of the second physiological tissue;

[0033] If the second physiological tissue does not meet the preset display condition, extracting a local image corresponding to the supplementary information from the segmented medical image according to the image feature parameters of the second physiological tissue, wherein the segmented medical image is obtained by inputting the initial medical image into a pre-trained physiological information segmentation model for segmentation;

[0034] The target medical image is repaired according to the local image, and the repaired target medical image is displayed.

[0035] In a second aspect, an embodiment of the present application provides an information display device, including:

[0036] A display module, used for displaying at least one initial medical image via a preset interface;

[0037] an acquisition module, in response to a display adjustment operation of the physiological tissue in the initial medical image, to acquire an adjusted image characteristic parameter of the first physiological tissue;

[0038] The prediction module is used to predict the second physiological tissue according to the image characteristic parameters, and display the target medical image corresponding to the second physiological tissue on the preset interface.

[0039] In a third aspect, an embodiment of the present application provides an electronic device, including a processor and a memory, wherein the memory stores a plurality of instructions; the processor loads instructions from the memory to execute the steps of the above-mentioned information display method.

[0040] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, including a processor and a memory, wherein the memory stores a plurality of instructions; the processor loads instructions from the memory to execute the steps of the above-mentioned information display method.

[0041] According to the fifth aspect of the present application, a computer program product is provided, comprising a computer program, wherein the computer program is stored in a computer-readable storage medium; when a processor of an electronic device reads the computer program from the computer-readable storage medium, the processor executes the computer program, so that the electronic device performs the steps of the above-mentioned information display method.

[0042] Beneficial effects of the embodiments of the present application:

[0043] In an embodiment of the present application, at least one initial medical image can be displayed through a preset interface, and in response to a display adjustment operation triggered by a user, image feature parameters of physiological information adjusted by the user are obtained, and the physiological information can be specifically physiological tissues. After obtaining the image feature parameters of the physiological information adjusted by the user, the second physiological tissue that the user wants to observe can be predicted based on the image feature parameters and the adjusted physiological information, and the target medical image corresponding to the second physiological tissue can be displayed. It can be seen that compared with the display effect of the medical image manually adjusted by the user in the prior art, the present application can predict the second physiological tissue that the user may be concerned about based on the user's display adjustment operation of the physiological information, and display the second physiological tissue to the user, thereby increasing the amount of effective medical information in the medical image, improving the efficiency of lesion identification, and eliminating the need for the user to repeatedly adjust the display parameters of the medical image, effectively improving the diagnostic efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0045] Figure 1 It is a schematic diagram of the first process of information display provided in an embodiment of the present application;

[0046] Figure 2 A second physiological tissue display schematic diagram is provided in an embodiment of the present application;

[0047] Figure 3 It is a schematic diagram of the second process of information display provided in an embodiment of the present application;

[0048] Figure 4 is a schematic diagram of the structure of an information display device provided in an embodiment of the present application;

[0049] Figure 5 It is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0050] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application. In addition, it should be understood that the specific implementation methods described herein are only used to illustrate and explain the present application, and are not used to limit the present application. In the present application, unless otherwise specified, the directional words such as "upper" and "lower" used generally refer to the upper and lower parts of the device in actual use or working state, specifically the drawing direction in the drawings; while "inside" and "outside" refer to the outline of the device. At the same time, in the description of the embodiments of the present application, the terms "first", "second", etc. are only used to distinguish the description, and cannot be understood as indicating or implying relative importance. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more features. In the description of the embodiments of the present application, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined.

[0051] According to the above background technology, with the rapid development of medical imaging scanning technology, DSA scanning, ultrasound scanning, MR scanning, CT scanning and other methods can be used to diagnose patients, and then the results of multiple examinations can be combined to fully display the lesion situation, so as to conduct a more complete and detailed examination of the lesion.

[0052] Doctors can manually adjust the window width and window position of medical images. By adjusting the window width, the contrast of the image can be changed. For example, if the window width is set wider, the contrast of the image will be reduced, and more grayscale values ​​will be displayed, which helps to observe the subtle differences between different tissues. On the contrary, if the window width is set narrower, the contrast of the image will be improved, and only a small part of the grayscale value will be displayed, which helps to highlight specific tissues and optimize the image display effect. The window position refers to the grayscale value at the center of the window width. By adjusting the window position, the brightness of the image can be changed to make specific tissue structures clearer. For example, when observing lung tissue, doctors can use a wider window width and a higher window position to obtain a clear lung image, and when observing bones, narrower window widths and lower window positions can be used to highlight the details of the bones.

[0053] However, the above manual adjustment method will affect the diagnostic efficiency. The doctor needs to repeatedly adjust the display parameters such as the window width and window position until a clear lesion image is displayed. In addition, this manual adjustment method cannot guarantee that the lesion details can be clearly displayed, which affects the diagnostic accuracy.

[0054] In order to solve the above problems, improve diagnostic efficiency and accuracy, and assist doctors in consultation, the embodiments of the present application propose an information display method, device, electronic device, computer-readable storage medium and computer program product, which aim to predict the physiological information of concern to the user based on the user's manual adjustment of medical images, and automatically adjust the physiological information displayed in the display area so that the physiological information of concern to the user can be highlighted. For example, the physiological information of concern to the user can be extracted and displayed separately.

[0055] Specifically, for example, the information display method in the embodiment of the present application can be applied to medical devices, such as Figure 1 As shown, the following steps may be included:

[0056] S10, displaying at least one initial medical image via a preset interface;

[0057] It should be noted that, in this embodiment, the medical device may be a medical device including a display interface, such as an ultrasound scanner, a CT scanner, an MRI scanner, etc., and the preset interface is the display interface of the medical device.

[0058] In this embodiment, the preset interface of the medical device can display at least one initial medical image.

[0059] In this embodiment, the physiological part where the target physiological tissue is located can be scanned (such as CT, MR, 4D ultrasound, etc.) to obtain an initial medical image.

[0060] Optionally, in this embodiment, a pre-trained physiological information segmentation model can be used to segment the initial medical image to obtain a segmented medical image of the physiological tissue (the medical image of each physiological tissue can be clearly displayed in the segmented medical image), so that the image of the physiological tissue that the user is concerned about can be extracted from the segmented medical image and / or the initial medical image for display. The subsequent embodiments will explain in detail.

[0061] S20, in response to the display adjustment operation of the physiological tissue in the initial medical image, obtaining an adjusted image characteristic parameter of the first physiological tissue;

[0062] It should be noted that, in the present embodiment, according to the above description, since some physiological tissues are in a relatively complex, narrow position that is not easy to observe, or, due to the limitation of the detection capability of the scanning device, some physiological tissues cannot be completely presented in the medical image, which will cause these physiological tissues to be not very clear from the overall initial medical image, and the lesions present on these physiological tissues, or whether they are lesions, will be more difficult to identify. Due to the influence of the human eye observation curve, the information on the medical image cannot be completely seen or observed by the human eye, so some physiological tissue images can be recognized by the human eye by adjusting the window width and window level, thereby increasing effective medical image information. For example, the user can manually adjust the window width and window level of the target area (such as the lesion area), triggering the corresponding display adjustment operation, so that the lesion image can be adjusted to the best observation state, and the window width and window level value at this time is the best observation window width and window level value of the target area.

[0063] The medical device can respond to the display adjustment operation triggered by the user and obtain the image feature parameters of the first physiological information adjusted by the user. The physiological information can specifically be physiological tissue, such as brain arteries, pericardial fat, vascular soft tissue, etc., which will not be elaborated later.

[0064] Among them, in this embodiment, the image feature parameters can be used by the user to adjust the contrast change, grayscale change, physiological tissue quantity change and other identification information of the physiological information in the area when adjusting the initial medical image. Through these identification information, the second physiological tissue that the user currently wants to observe can be confirmed in the initial medical image.

[0065] S30, predicting a second physiological tissue according to the image feature parameters, and displaying a target medical image corresponding to the second physiological tissue on the preset interface.

[0066] In this embodiment, after obtaining the image feature parameters of the physiological information adjusted by the user, the medical device can predict the second physiological tissue that the user wants to observe based on the image feature parameters and the adjusted first physiological information, and display the target medical image corresponding to the second physiological tissue.

[0067] For example, Figure 2 As shown, in this embodiment, the target medical image corresponding to the second physiological tissue can be extracted, and a new display window can be called to display the target medical image. The display size of the display window can be smaller than the preset interface and cover part of the preset interface.

[0068] Therefore, in an embodiment of the present application, the preset interface of the medical device can display at least one initial medical image. The medical device can respond to the display adjustment operation triggered by the user to obtain the image feature parameters of the physiological information adjusted by the user, and the physiological information can specifically be a physiological tissue. After obtaining the image feature parameters of the physiological information adjusted by the user, the medical device can predict the second physiological tissue that the user wants to observe based on the image feature parameters and the adjusted physiological information, and display the target medical image corresponding to the second physiological tissue. It can be seen that compared with the display effect of the medical image manually adjusted by the user in the prior art, the embodiment of the present application can predict the second physiological tissue that the user may be concerned about based on the user's display adjustment operation of the physiological information, and display the second physiological tissue to the user, thereby increasing the amount of effective medical information in the medical image, eliminating the need for the user to repeatedly adjust the display parameters of the medical image, and effectively improving the user's diagnostic efficiency and accuracy.

[0069] In one embodiment, the image feature parameters include visual features. In the above S30, “predicting the second physiological tissue according to the image feature parameters”, for example Figure 3 As shown, it may include:

[0070] S301, determining a corresponding target visual response curve according to the type of the visualized visual feature;

[0071] S302: predicting a second physiological tissue according to the visualized visual feature and the target visual response curve.

[0072] It should be noted that, in this embodiment, the image feature parameters may include visual features, such as contrast, edge features, brightness, color, etc. of physiological information in medical images.

[0073] On this basis, the medical device can extract the medical image corresponding to the physiological information adjusted by the user, and obtain the display parameters of the medical image, wherein the display parameters can be the gray value, contrast, overall brightness, resolution, time interval between consecutive medical images, image thickness (in CT and MRI, image thickness refers to slice thickness), etc. displayed on the medical image. Then, according to the display parameters, the visualized visual features in the medical image can be extracted, and the visualized visual features include but are not limited to changes that can be observed by the user's naked eye, such as contrast features, edge features, brightness features, and color features.

[0074] It should be noted that, in this embodiment, the target visual response curve is used to describe the function of the visual system's response to different stimulus intensities. For example, the brightness response curve is used to show the sensitivity of the human eye to light of different wavelengths.

[0075] On this basis, the medical device can determine the corresponding target visual response curve according to the type of the above-mentioned visualized visual features. For example, contrast features, edge features, brightness features and color features can all have corresponding visual response curves. Then, the second physiological tissue can be predicted from the adjusted physiological information according to the visualized visual features and the target visual response curve.

[0076] Furthermore, the type of the visualized visual feature includes at least one of a contrast feature type, an edge feature type, a brightness feature type, and a color feature type;

[0077] On this basis, in the above S302, “predicting the second physiological tissue according to the visualized visual feature and the target visual response curve” may include:

[0078] S3021, obtaining a target visualized visual feature of at least one type among the contrast feature type, the edge feature type, the brightness feature type, and the color feature type, and performing statistics on the target visualized visual feature to obtain a corresponding target statistical result;

[0079] S3022: If the target statistical result meets the corresponding target visual response curve, the first physiological tissue is set as the predicted second physiological tissue.

[0080] It should be noted that, in this embodiment, the type of visualized visual features includes but is not limited to at least one of a contrast feature type, an edge feature type, a brightness feature type, and a color feature type, and each type of visualized visual feature may have a corresponding target visual response curve.

[0081] On this basis, the medical device can determine at least one type of target visualization visual features among contrast feature types, edge feature types, brightness feature types and color feature types, and count the target visualization visual features to obtain corresponding target statistical results. For example, a heat map of the target visualization visual features can be drawn, which can be used to represent the feature distribution, and the feature distribution can be used as the target statistical result.

[0082] Furthermore, the above target statistical result is compared with the target visual response curve. If the target statistical result conforms to the corresponding target visual response curve, the first physiological information adjusted by the user can be used as the second physiological information.

[0083] It is worth noting that in this embodiment, the visual response curve is used to predict the physiological information that the user may be concerned about, and the physiological information of the user adjusting display parameters such as contrast and grayscale can be keenly captured. The medical image of the physiological information can be directly extracted and displayed to the user. The medical image of relevant physiological information can also be extracted from the initial image based on the physiological information and displayed to the user, thereby assisting the user in diagnosing the lesion. There is no need for the user to repeatedly adjust display parameters such as window width and window position, which effectively improves the diagnostic efficiency.

[0084] Optionally, in the above S20, “in response to the display adjustment operation of the physiological tissue in the initial medical image, obtaining the adjusted image characteristic parameters of the first physiological tissue” may include:

[0085] S201, in response to a display adjustment operation of a physiological tissue in the initial medical image, obtaining an adjusted first physiological tissue;

[0086] S202: extracting visualized visual features in the initial medical image according to display parameters of the medical image corresponding to the first physiological tissue.

[0087] In this embodiment, the user can adjust the window width, window level, etc. of the initial medical image to trigger a corresponding display adjustment operation.

[0088] The medical device can respond to the display adjustment operation to obtain the adjusted first physiological tissue, wherein the first physiological tissue can be a physiological tissue that can be easily found by the human eye in the medical image due to the adjustment of the window width and the window position.

[0089] The display parameters may include grayscale value, contrast, overall brightness, resolution, time interval between consecutive medical images, image thickness (in CT and MRI, image thickness refers to slice thickness), etc. of the first physiological tissue in the medical image. Furthermore, the visualized visual features in the medical image may be extracted based on the display parameters, and the visualized visual features include but are not limited to changes that can be observed by the naked eye of the user, such as contrast features, edge features, brightness features, and color features.

[0090] Optionally, the image feature parameter includes the amount of physiological information adjusted in the initial medical image. On this basis, in the above S30, “predicting the second physiological tissue according to the image feature parameter” may include:

[0091] S303, obtaining an initial quantity of the first physiological tissue in the initial medical image before adjustment;

[0092] S304: predicting a second physiological tissue according to the initial quantity and the adjusted quantity of the first physiological tissue in the initial medical image.

[0093] It should be noted that in this embodiment, according to the above description, the user can manually adjust the display effect of the medical image to make the details of the physiological tissue of concern clearer. For example, the number of physiological tissues in the lesion area can be increased from 4 to 12, making the lesion information richer.

[0094] On this basis, the medical device in this embodiment can obtain the initial quantity of physiological information in the initial medical image before adjustment, and then compare the initial quantity of physiological information before adjustment with the quantity after adjustment, and take the physiological information whose quantity change is greater than a preset threshold as the second physiological tissue. For example, if the increase in the quantity of the physiological information is greater than 8, the physiological information can be taken as the second physiological tissue.

[0095] Optionally, the image feature parameters include image feature parameters corresponding to the first physiological tissue in a plurality of initial medical images. In the above S30, “predicting the second physiological tissue according to the image feature parameters” may include:

[0096] S305, obtaining an initial medical image containing the image characteristic parameters of the first physiological tissue;

[0097] S306: If the plurality of initial medical images are arranged continuously, the first physiological tissue is set as the predicted second physiological tissue.

[0098] It should be noted that in this embodiment, the initial medical image can be an image slice, which refers to a two-dimensional image of the internal structure of the human body obtained by various imaging technologies (such as X-ray, CT, MRI, PET, etc.), and these switches can be a continuous series of images, each image representing a cross-section of a specific layer of the body. The user can switch and browse multiple initial medical images to observe more comprehensive physiological information of the lesion.

[0099] It is understandable that since the diseased physiological tissue is generally localized, the diseased physiological tissue only exists continuously in a few image slices. Therefore, when observing the diseased physiological tissue, the user will focus on the few image slices where the lesion exists, such as adjusting the window width and window position.

[0100] On this basis, the medical device can obtain the initial medical images containing image feature parameters corresponding to multiple first physiological tissues. If multiple initial medical images are displayed continuously, it means that the first physiological tissue exists in multiple consecutive initial medical images. If the user pays attention to the first physiological tissue in multiple consecutive initial medical images, it can be predicted that the first physiological tissue is the physiological tissue that the user may pay attention to (i.e., the second physiological tissue in this embodiment).

[0101] Optionally, in the above S30, “displaying the target medical image corresponding to the second physiological tissue on the preset interface” may include:

[0102] S307, judging whether there is a target medical image corresponding to the second physiological tissue in the initial medical image according to the physiological characteristic parameter corresponding to the second physiological tissue;

[0103] S308: If a target medical image corresponding to the second physiological tissue exists in the initial medical image, extract the target medical image for display.

[0104] In this embodiment, after predicting the second physiological tissue that the user may be concerned about based on the image feature parameters, the medical device can determine whether there is a target medical image corresponding to the second physiological tissue in the initial medical image based on the physiological feature parameters of the second physiological tissue.

[0105] Among them, the physiological characteristic parameters may include the sign information of the second physiological tissue (morphological signs, functional signs, density signs, etc.), key node information (location of lesions, number of lesions, edge characteristics of lesions, etc.) and other identification information of the physiological tissue.

[0106] It is understandable that the second physiological tissue predicted by the medical device may not exist in the initial medical image. If it is determined that the target medical image corresponding to the second physiological tissue does not exist in the initial medical image, it is necessary to obtain the target medical image from other channels.

[0107] If it is determined that the target medical image corresponding to the predicted second physiological tissue exists in the initial medical image, the target medical image can be directly extracted from the initial medical image for display.

[0108] Optionally, after the above S307, “determining whether there is a target medical image corresponding to the second physiological tissue in the initial medical image according to the physiological characteristic parameter corresponding to the second physiological tissue”, the following may also be included:

[0109] S309, if the target medical image corresponding to the second physiological tissue does not exist in the initial medical image, inputting the initial medical image into a preset physiological information recognition model to obtain a new medical image output by the physiological information recognition model;

[0110] S310: Acquire a target medical image from the new medical image for display according to the physiological characteristic parameters of the second physiological tissue.

[0111] In this embodiment, according to the above description, after the medical device predicts the second physiological tissue that the user may be concerned about based on the image feature parameters, it can determine whether there is a target medical image corresponding to the second physiological tissue in the initial medical image based on the physiological feature parameters of the second physiological tissue.

[0112] If it is determined that the target medical image corresponding to the second physiological tissue does not exist in the initial medical image, the initial medical image can be input into a preset physiological information recognition model to obtain a new medical image output by the physiological information recognition model, in which new physiological tissue that does not exist in the initial medical image is added. The preset physiological information recognition model can be used to expand the scope of the extracted physiological tissue based on the physiological tissue in the initial medical image, so that more physiological tissue can be recorded in the new medical image.

[0113] Furthermore, the medical device may obtain a target medical image corresponding to the second physiological tissue from the new medical image for display according to the physiological characteristic parameters of the second physiological tissue. The parameters are described in the above embodiment and will not be repeated here.

[0114] It is worth noting that in this embodiment, the new medical image can be extracted and spliced ​​from the patient's historical medical images by the physiological information recognition model. If the target medical image cannot be extracted from the new medical image, an abnormal reminder can be displayed, and the associated text information of the second physiological tissue can be output, such as the sign information of the second physiological tissue, etc., to remind the user to rescan the second physiological tissue to avoid missing the lesion.

[0115] Optionally, in the above S30, “displaying the target medical image corresponding to the second physiological tissue on the preset interface” may include:

[0116] S311, if the second physiological tissue does not meet the preset display condition, extracting a local image corresponding to the supplementary information from the segmented medical image according to the image feature parameters of the second physiological tissue, wherein the segmented medical image is obtained by inputting the initial medical image into a pre-trained physiological information segmentation model for segmentation;

[0117] S312: Repair the target medical image according to the local image, and display the repaired target medical image.

[0118] In this embodiment, in order to ensure the integrity of the display of the second physiological tissue, the medical device can determine whether the target medical image meets the preset display conditions after predicting the second physiological information and extracting the target medical image corresponding to the second physiological information.

[0119] The preset display conditions can characterize the display integrity of the second physiological tissue, thereby avoiding the problem of missing display of the physiological tissue and affecting the accuracy of diagnosis.

[0120] If it is determined that the second physiological tissue does not meet the preset display conditions, the local image corresponding to the supplementary information can be extracted from the segmented medical image based on the image feature parameters of the second physiological tissue, wherein the supplementary information can be understood as the missing part of the second physiological tissue, such as the contour of the second physiological tissue.

[0121] The segmented medical image is obtained by inputting the initial medical image into a pre-trained physiological information segmentation model for segmentation. For example, the pre-trained physiological information segmentation model can be used to segment the initial medical image to obtain a segmented medical image of the physiological tissue (in the segmented medical image, the medical image of each physiological tissue can be clearly displayed).

[0122] Furthermore, the target medical image can be completed based on the local image, and the completed target medical image can be displayed, thereby ensuring the integrity and authenticity of the extracted physiological tissue.

[0123] In a specific embodiment, taking the observation of arterial cerebral vascular calcification as an example, after the brain region is scanned and imaged, the calcified lesions in a certain area of ​​the brain arterial vessels may have artifacts. At this time, it is difficult for the doctor to clearly observe the degree of calcification of the blood vessels, and the window width and window position of the calcified area need to be adjusted to make the information of the calcification position displayed more clearly. Specifically, the brain region is subjected to medical scanning imaging to obtain the initial medical image of the arterial vessels (including the image of the calcified lesion), and the doctor manually adjusts the window width and window position of the candidate area. When the window width and window position are adjusted to the doctor's best observation state, some sign information will be observed. According to these sign information, the physiological tissue in the carotid artery segmentation medical image corresponding to the lesion candidate area is determined, and the physiological tissue corresponding to these sign information in the lesion candidate area is extracted and displayed to the doctor.

[0124] Optionally, if some sign information cannot find corresponding physiological tissues in the initial medical image, it is necessary to use a calcification recognition model (i.e., the physiological information recognition model in this embodiment) to further detect the initial medical image, extract the newly detected medical images (some new possible calcified tissues) and the previously detected medical images that may be calcified, and then show them to the doctor.

[0125] In another specific embodiment, the observation of pericardial fat is taken as an example. The pericardial fat is thin and difficult to observe in medical images. It is necessary to adjust the window width and window position of the area where the pericardium is located so that the information of the location of the pericardial fat can be displayed more clearly. Specifically, the heart area is scanned and imaged, and the medical image of the heart area is segmented using the heart tissue segmentation model to obtain a myocardial segmentation medical image (which contains pericardial fat). The doctor manually adjusts the window width and window position of the area where the pericardium is located in the myocardium. During the adjustment process, some tissue areas in the adjustment area with large contrast changes are detected. Based on this part of the tissue area, it can be determined from the heart medical image that the area that the doctor should pay attention to at this time is the pericardium. At this time, the medical images of the pericardium and pericardial fat in the heart segmentation medical image are retrieved and presented to the doctor.

[0126] Preferably, the contour boundary of the pericardium and pericardial fat is finely adjusted according to the identification information and the myocardial segmentation medical image, so as to make the contour boundary of the pericardium and pericardial fat clearer. After the contour boundary is finely adjusted, it is presented to the doctor.

[0127] In another specific embodiment, the screening of vascular soft plaques is taken as an example. Non-calcified plaques on blood vessels are soft plaques. These soft plaques are easily confused with calcification, which is not conducive to observation. It is necessary to adjust the window width and window position of the candidate area to make the information of the candidate area displayed more clearly. Specifically, the heart and neck area is scanned and imaged, and the medical image of the neck is segmented using the neck artery tissue segmentation model to obtain a carotid artery segmentation medical image (which contains lesions such as calcification and soft plaques). The doctor manually adjusts the window width and window position of the lesion candidate area in the carotid artery. When it is adjusted to the doctor's best observation state, some sign information can be clearly observed at the window width and window position value at this time. According to these sign information, the physiological tissue in the carotid artery segmentation medical image corresponding to the lesion candidate area is determined. The physiological tissue corresponding to these sign information in the lesion candidate area is extracted and displayed to the doctor.

[0128] Preferably, if these physiological tissues need to be repaired, a pre-trained physiological information segmentation model is used to detect these physiological tissues, complete the medical information (in order to be able to show the lesion characteristics more completely and clearly), and then present it to the doctor.

[0129] In another specific embodiment, for liver regional lesions, after the lesion characteristics of important physiological tissues are discovered through the window width and window position, the lesion characteristics can be marked and displayed to remind the doctor to focus on the lesions there.

[0130] This embodiment also provides an image display device, which can be integrated into a terminal medical device, for example, Figure 4As shown, the image display device may include:

[0131] Display module 1001, used to display at least one initial medical image via a preset interface;

[0132] An acquisition module 1002, in response to a display adjustment operation of the physiological tissue in the initial medical image, acquires an adjusted image characteristic parameter of the first physiological tissue;

[0133] The prediction module 1003 is used to predict the second physiological tissue according to the image feature parameters, and display the target medical image corresponding to the second physiological tissue on the preset interface.

[0134] Optionally, the image feature parameters include visual features, and the prediction module 1003 is further used to:

[0135] Determining a corresponding target visual response curve according to the type of the visualized visual feature;

[0136] A second physiological tissue is predicted according to the visualized visual feature and the target visual response curve.

[0137] Optionally, the type of the visualized visual feature includes at least one of a contrast feature type, an edge feature type, a brightness feature type, and a color feature type;

[0138] The prediction module 1003 is further used for:

[0139] Obtaining a target visualization visual feature of at least one type among the contrast feature type, the edge feature type, the brightness feature type, and the color feature type, and performing statistics on the target visualization visual feature to obtain a corresponding target statistical result;

[0140] If the target statistical result meets the corresponding target visual response curve, the first physiological tissue is set as the predicted second physiological tissue.

[0141] Optionally, the acquisition module 1002 is further configured to:

[0142] In response to a display adjustment operation on the physiological tissue in the initial medical image, acquiring an adjusted first physiological tissue;

[0143] The visualized visual features in the initial medical image are extracted according to the display parameters of the medical image corresponding to the first physiological tissue.

[0144] Optionally, the image feature parameter includes the amount of the first physiological tissue in the initial medical image after adjustment, and the prediction module 1003 is further configured to:

[0145] Obtaining an initial quantity of the first physiological tissue in the initial medical image before adjustment;

[0146] A second physiological tissue is predicted according to the initial quantity and the adjusted quantity of the first physiological tissue in the initial medical image.

[0147] Optionally, the image feature parameters include image feature parameters corresponding to the first physiological tissue in a plurality of initial medical images, and the prediction module 1003 is further configured to:

[0148] Acquire an initial medical image containing the image characteristic parameters of the first physiological tissue;

[0149] If a plurality of the initial medical images are arranged consecutively, the first physiological tissue is set as the predicted second physiological tissue.

[0150] Optionally, the prediction module 1003 is further configured to:

[0151] determining, according to the physiological characteristic parameter corresponding to the second physiological tissue, whether there is a target medical image corresponding to the second physiological tissue in the initial medical image;

[0152] If a target medical image corresponding to the second physiological tissue exists in the initial medical image, the target medical image is extracted for display.

[0153] Optionally, the prediction module 1003 is further configured to:

[0154] If the target medical image corresponding to the second physiological tissue does not exist in the initial medical image, inputting the initial medical image into a preset physiological information recognition model to obtain a new medical image output by the physiological information recognition model;

[0155] According to the physiological characteristic parameters of the second physiological tissue, a target medical image corresponding to the second physiological tissue is extracted from the new medical image for display.

[0156] Optionally, the prediction module 1003 is further configured to:

[0157] Determining whether the target medical image corresponding to the second physiological tissue meets a preset display condition, wherein the preset display condition represents the completeness of the display of the second physiological tissue;

[0158] If the second physiological tissue does not meet the preset display condition, extracting a local image corresponding to the supplementary information from the segmented medical image according to the image feature parameters of the second physiological tissue, wherein the segmented medical image is obtained by inputting the initial medical image into a pre-trained physiological information segmentation model for segmentation;

[0159] The target medical image is repaired according to the local image, and the repaired target medical image is displayed.

[0160] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0161] Accordingly, the present application also provides an electronic device, such as Figure 5 As shown, Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device 1100 includes a processor 1101 having one or more processing cores, a memory 1102 having one or more computer-readable storage media, and a computer program stored in the memory 1102 and executable on the processor. The processor 1101 is electrically connected to the memory 1102. It will be understood by those skilled in the art that the electronic device structure shown in the figure does not constitute a limitation on the electronic device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0162] The processor 1101 is the control center of the electronic device 1100, and uses various interfaces and lines to connect various parts of the entire electronic device 1100. By running or loading software programs and / or units stored in the memory 1102, and calling data stored in the memory 1102, the processor 1101 executes various functions of the electronic device 1100 and processes data, thereby monitoring the electronic device 1100 as a whole. The processor 1101 can be a processor CPU, a graphics processor GPU, a network processor (Network Processor, NP), etc., and can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application.

[0163] In the embodiment of the present application, the processor 1101 in the electronic device 1100 will load instructions corresponding to the processes of one or more application programs into the memory 1102 according to the following steps, and the processor 1101 will run the application programs stored in the memory 1102 to implement various functions, such as:

[0164] Displaying at least one initial medical image via a preset interface;

[0165] In response to a display adjustment operation on the physiological tissue in the initial medical image, acquiring an adjusted image characteristic parameter of the first physiological tissue;

[0166] A second physiological tissue is predicted according to the image feature parameters, and a target medical image corresponding to the second physiological tissue is displayed on the preset interface.

[0167] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0168] Optional, such as Figure 5 As shown, the electronic device 1100 further includes: a touch screen 1103, a radio frequency circuit 1104, an audio circuit 1105, an input unit 1106, and a power supply 1107. The processor 1101 is electrically connected to the touch screen 1103, the radio frequency circuit 1104, the audio circuit 1105, the input unit 1106, and the power supply 1107, respectively. Those skilled in the art can understand that Figure 5 The electronic device structure shown in the figure does not constitute a limitation of the electronic device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0169] The touch display screen 1103 can be used to display a graphical user interface and receive operation instructions generated by the user acting on the graphical user interface. The touch display screen 1103 may include a display panel and a touch panel. Among them, the display panel can be used to display information input by the user or information provided to the user and various graphical user interfaces of the electronic device, and these graphical user interfaces can be composed of graphics, text, icons, videos and any combination thereof. Optionally, the display panel can be configured in the form of a liquid crystal display (LCD, Liquid Crystal Display), an organic light-emitting diode (OLED, Organic Light-EmittingDiode) and the like. The touch panel can be used to collect the user's touch operation on or near it (such as the user uses any suitable object or attachment such as a finger, a stylus, etc. on the touch panel or near the touch panel), and generate corresponding operation instructions, and the operation instructions execute corresponding programs. Optionally, the touch panel may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 1101, and can receive the command sent by the processor 1101 and execute it. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it is transmitted to the processor 1101 to determine the type of touch event, and then the processor 1101 provides a corresponding visual output on the display panel according to the type of touch event. In an embodiment of the present application, the touch panel and the display panel can be integrated into the touch display screen 1103 to realize the input and output functions. However, in some embodiments, the touch panel and the touch panel can be used as two independent components to realize the input and output functions. That is, the touch display screen 1103 can also be used as a part of the input unit 1106 to realize the input function.

[0170] The radio frequency circuit 1104 may be used to send and receive radio frequency signals, so as to establish wireless communication with a network device or other electronic devices through wireless communication, and to send and receive signals between the network device or other electronic devices.

[0171] The audio circuit 1105 can be used to provide an audio interface between the user and the electronic device through a speaker and a microphone. The audio circuit 1105 can transmit the electrical signal converted from the received audio data to the speaker, which is converted into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 1105 and converted into audio data, and then the audio data is output to the processor 1101 for processing, and then sent to another electronic device through the radio frequency circuit 1104, or the audio data is output to the memory 1102 for further processing. The audio circuit 1105 may also include an earplug jack to provide communication between an external headset and an electronic device.

[0172] The input unit 1106 may be used to receive input numbers, character information or user feature information (such as fingerprint, iris, facial information, etc.), and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0173] The power supply 1107 is used to supply power to various components of the electronic device 1100. Optionally, the power supply 1107 can be logically connected to the processor 1101 through a power management device, so that the power management device can manage charging, discharging, power consumption and other functions. The power supply 1107 can also include one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, power status indicators and other arbitrary components.

[0174] although Figure 5 Not shown, the electronic device 1100 may also include a camera, a sensor, a wireless fidelity module, a Bluetooth module, etc., which will not be described in detail here.

[0175] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0176] A person of ordinary skill in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be completed by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0177] To this end, an embodiment of the present application provides a computer-readable storage medium, in which a plurality of computer programs are stored. The computer program can be loaded by a processor to execute any of the methods provided in the embodiments of the present application. The computer program can execute the steps of the following method:

[0178] Displaying at least one initial medical image via a preset interface;

[0179] In response to a display adjustment operation on the physiological tissue in the initial medical image, acquiring an adjusted image characteristic parameter of the first physiological tissue;

[0180] A second physiological tissue is predicted according to the image feature parameters, and a target medical image corresponding to the second physiological tissue is displayed on the preset interface.

[0181] The specific implementation of the above operations can be found in the previous embodiments, which will not be described in detail here.

[0182] The computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0183] Since the computer program stored in the computer-readable storage medium can execute any of the methods provided in the embodiments of the present application, the beneficial effects that can be achieved by any of the methods provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0184] In the above-mentioned information display device, electronic device, computer-readable storage medium and computer program product, the description of each embodiment has its own emphasis. For the part that is not described in detail in a certain embodiment, refer to the relevant description of other embodiments. A person skilled in the art can clearly understand that for the convenience and simplicity of description, the above-mentioned information display device, electronic device, computer-readable storage medium and computer program product and the specific working process and beneficial effects that can be brought about by the corresponding units thereof can refer to the description of each method in the above embodiment, and will not be repeated here. In the above-mentioned information display method, device, electronic device, computer-readable storage medium and computer program product, the description of each embodiment has its own emphasis. For the part that is not described in detail in a certain embodiment, refer to the relevant description of other embodiments. A person skilled in the art can clearly understand that for the convenience and simplicity of description, the above-mentioned information display device, electronic device, computer-readable storage medium and computer program product and the specific working process and beneficial effects that can be brought about by the corresponding units thereof can refer to the description of the information display method in the above embodiment, and will not be repeated here.

[0185] The above is a detailed introduction to an information display method, device, electronic device, computer-readable storage medium and computer program product provided in the embodiments of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, according to the ideas of the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. An information display method, characterized in that: The method comprises: Displaying at least one initial medical image via a preset interface; In response to a display adjustment operation on the physiological tissue in the initial medical image, acquiring an adjusted image characteristic parameter of the first physiological tissue; A second physiological tissue is predicted according to the image feature parameters, and a target medical image corresponding to the second physiological tissue is displayed on the preset interface.

2. The information display method according to claim 1, characterized in that: The image feature parameters include visual features, and predicting the second physiological tissue according to the image feature parameters includes: Determining a corresponding target visual response curve according to the type of the visualized visual feature; A second physiological tissue is predicted according to the visualized visual feature and the target visual response curve.

3. The information display method according to claim 2, characterized in that: The type of the visualized visual feature includes at least one of a contrast feature type, an edge feature type, a brightness feature type, and a color feature type; The predicting of the second physiological tissue according to the visualized visual feature and the target visual response curve comprises: Obtaining a target visualization visual feature of at least one type among the contrast feature type, the edge feature type, the brightness feature type, and the color feature type, and performing statistics on the target visualization visual feature to obtain a corresponding target statistical result; If the target statistical result meets the corresponding target visual response curve, the first physiological tissue is set as the predicted second physiological tissue.

4. The information display method according to claim 3, characterized in that: The step of obtaining the adjusted image characteristic parameters of the first physiological tissue in response to the display adjustment operation of the physiological tissue in the initial medical image includes: In response to a display adjustment operation on the physiological tissue in the initial medical image, acquiring an adjusted first physiological tissue; The visualized visual features in the initial medical image are extracted according to the display parameters of the medical image corresponding to the first physiological tissue.

5. The information display method according to claim 1, characterized in that: The image feature parameter includes the amount of the first physiological tissue in the initial medical image after adjustment, and the predicting the second physiological tissue according to the image feature parameter includes: Obtaining an initial quantity of the first physiological tissue in the initial medical image before adjustment; A second physiological tissue is predicted according to the initial quantity and the adjusted quantity of the first physiological tissue in the initial medical image.

6. The information display method according to claim 1, characterized in that: The image feature parameters include image feature parameters corresponding to a first physiological tissue in a plurality of initial medical images, and predicting a second physiological tissue according to the image feature parameters includes: Acquire an initial medical image containing the image characteristic parameters of the first physiological tissue; If a plurality of the initial medical images are arranged consecutively, the first physiological tissue is set as the predicted second physiological tissue.

7. The information display method according to claim 1, characterized in that: The step of displaying the target medical image corresponding to the second physiological tissue on the preset interface includes: determining, according to the physiological characteristic parameter corresponding to the second physiological tissue, whether there is a target medical image corresponding to the second physiological tissue in the initial medical image; If a target medical image corresponding to the second physiological tissue exists in the initial medical image, the target medical image is extracted for display.

8. The information display method according to claim 7, characterized in that: After determining whether the target medical image corresponding to the second physiological tissue exists in the initial medical image, the following steps are included: If the target medical image corresponding to the second physiological tissue does not exist in the initial medical image, inputting the initial medical image into a preset physiological information recognition model to obtain a new medical image output by the physiological information recognition model; According to the physiological characteristic parameters of the second physiological tissue, a target medical image corresponding to the second physiological tissue is extracted from the new medical image for display.

9. The information display method according to claim 1, characterized in that: The displaying of the target medical image corresponding to the second physiological tissue also includes: Determining whether the target medical image corresponding to the second physiological tissue meets a preset display condition, wherein the preset display condition represents the completeness of the display of the second physiological tissue; If the second physiological tissue does not meet the preset display condition, extracting a local image corresponding to the supplementary information from the segmented medical image according to the image feature parameters of the second physiological tissue, wherein the segmented medical image is obtained by inputting the initial medical image into a pre-trained physiological information segmentation model for segmentation; The target medical image is repaired according to the local image, and the repaired target medical image is displayed.

10. An information display device, characterized in that: include: A display module, used for displaying at least one initial medical image via a preset interface; an acquisition module, in response to a display adjustment operation of the physiological tissue in the initial medical image, to acquire an adjusted image characteristic parameter of the first physiological tissue; The prediction module is used to predict the second physiological tissue according to the image characteristic parameters, and display the target medical image corresponding to the second physiological tissue on the preset interface.

11. An electronic device, characterized in that: It comprises a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor executes the steps of any one of the methods of claims 1 to 9.

12. A computer-readable storage medium, characterized in that: It comprises a computer program. When the computer program is run on an electronic device, the computer program is used to enable the electronic device to execute the steps of any method described in claims 1 to 9.

Images