Image display method, device, terminal, and storage medium

Abstract

The method includes: displaying an object information interface including at least one object (401); acquiring a pathology image of the target object in response to a selection action on the target object in the object information interface (402); determining at least one pathology sub-image belonging to a target type in the pathology image (403); and displaying at least one pathology sub-image belonging to the target type in the object information interface (404). Determining the pathology sub-image belonging to the target type in the pathology image and displaying the pathology sub-image belonging to the target type displays key information with higher reference value in the pathology image, improving the suitability, and improving the display effect of the pathology image.

Description

[Technical Field]

[0001] This application claims priority from a Chinese patent application filed on February 11, 2022, application number 202210129761.1, entitled "Image display method, device, terminal and storage medium," the entire contents of which are incorporated herein by reference.

[0002] The present application relates to the field of computer technology, and in particular to an image display method, device, terminal, and storage medium. [Background technology]

[0003] With the rapid development of imaging technology, a pathological image of an object can be obtained by photographing or scanning the object, and the pathological image is an image showing the pathological morphology of the biological organs, tissues or cells of the object.

[0004] In related art, after obtaining a pathological image of an object, the pathological image can be directly displayed to the user, but the display effect of this mode is not satisfactory. Summary of the Invention [Means for solving the problem]

[0005] The embodiments of the present application provide an image display method, apparatus, computer device and storage medium, which can improve the display effect of pathological images.

[0006] In one aspect, an image display method is provided, comprising: displaying an object information interface including at least one object; acquiring a pathology image of the target object in response to a selection action on the target object in the object information interface; determining at least one pathology sub-image belonging to a target type among the pathology images; and displaying at least one of the pathology sub-images belonging to the target type in the object information interface; Includes:

[0007] In another aspect, an image display device is provided, comprising: an interface display module for displaying an object information interface including at least one object; an image acquisition module for acquiring a pathology image of the target object in response to a selection action on the target object in the object information interface; a sub-image determination module for determining at least one pathology sub-image belonging to a target type among the pathology images; and a sub-image display module for displaying at least one of the pathology sub-images belonging to the target type in the object information interface. Includes:

[0008] As an option, the sub-image display module includes a first display unit for displaying at least one pathology sub-image belonging to the target type in an image display area of ​​the target information interface, or a second display unit for displaying the pathology image in the target information interface and displaying a frame of at least one pathology sub-image on the pathology image; Includes:

[0009] As one option, the first display unit displays the plurality of pathological sub-images in sections according to differences in a plurality of subtypes to which the plurality of pathological sub-images belong; the target type includes a plurality of subtypes, and displays the plurality of pathological sub-images in order of the number of cells included in the plurality of pathological sub-images; or displays the plurality of pathological sub-images in order of quality parameters of the plurality of pathological sub-images; or displays the plurality of pathological sub-images in order of reliability of the plurality of pathological sub-images; The confidence level of the pathology sub-image indicates the degree to which it can be trusted that the pathology sub-image belongs to the target type.

[0010] As one option, the target type includes a plurality of subtypes, and the number of pathology sub-images corresponding to any one of the subtypes in the image display area is equal to or less than a target number; The first display unit further responds to an expansion operation for a first subtype by canceling the display of pathological sub-images belonging to other subtypes in the image display area and displaying each of the pathological sub-images belonging to the first subtype.

[0011] Optionally, the device further includes a magnification display module for displaying the first pathology sub-image after magnification by a target number of times in response to a selection action on the displayed first pathology sub-image.

[0012] Optionally, the magnification module further comprises: displaying image information corresponding to the first pathology sub-image in a first region within the enlarged first pathology sub-image; The image information includes at least one of the target type to which the first pathology sub-image belongs or the reliability of the first pathology sub-image.

[0013] As one option, the enlarged display module further displays the image information in a second area outside the enlarged first pathology sub-image when the display time of the image information in the first area reaches a target time, and the size of the second area is smaller than the size of the first area.

[0014] Alternatively, the magnification display module may include a first magnification unit that is responsive to a touch operation on the first pathology sub-image and is configured to display the first pathology sub-image after being magnified by the target number of times; or the target information interface may further display at least one image indicator corresponding to the pathology sub-image, and a second magnification unit that is responsive to a touch operation on the image indicator corresponding to the first pathology sub-image and is configured to display the first pathology sub-image after being magnified by the target number of times. Includes:

[0015] As an option, the sub-image display module includes a third display unit for displaying at least one of the pathology sub-images belonging to the target type in the target information interface and displaying a confidence marker for at least one of the pathology sub-images; The confidence marker of the pathology sub-image indicates the confidence of the pathology sub-image, the confidence indicating the degree to which it can be trusted that the pathology sub-image belongs to the target type.

[0016] As an option, the sub-image determination module determines from the pathology image at least one of the pathology sub-images containing abnormal cells; determines from the pathology image at least one of the pathology sub-images containing cells belonging to a target state, including a negative state or a positive state; and determines from the pathology image at least one of the pathology sub-images whose quality parameters meet a target quality condition. The method includes at least one of the following:

[0017] Optionally, the sub-image determination module: an identification unit for performing identification on the pathology image and obtaining at least one piece of position information indicating an area in the pathology image that belongs to the target type; and a cutting unit for cutting out at least one area indicated by the position information from the pathology image and determining the cut-out area as the pathology sub-image; Includes:

[0018] Optionally, the pathology images include liquid-based cytology pathology images or histopathology pathology images.

[0019] In another aspect, a terminal is provided that includes a memory in which at least one computer program is stored, and a processor that loads and executes the at least one computer program to perform the operations performed by the image display method described above.

[0020] Another aspect of the present invention provides a computer-readable storage medium having at least one computer program stored therein, the at least one computer program being loaded and executed by a processor to realize the operations performed by the image display method described above.

[0021] Another aspect of the computer program product includes a computer program, which, when loaded and executed by a processor, performs the operations performed by the image display method described above.

[0022] The method, device, terminal, and storage medium according to the embodiments of the present application display at least one object on an object information interface, and when a user selects a target object, obtain a pathology image of the target object, first determine at least one pathology sub-image belonging to a target type in the pathology image, and then display the at least one pathology sub-image belonging to the target type, thereby displaying key information with higher reference value in the pathology image and improving the suitability of the pathology image display, thereby improving the display effect of the pathology image. [Brief explanation of the drawings]

[0023] [Figure 1] 1 is a schematic diagram of an implementation environment according to an embodiment of the present application; [Figure 2] 1 is a schematic diagram of an application scene according to an embodiment of the present application; [Figure 3] FIG. 2 is a schematic diagram of another application scenario according to an embodiment of the present application; [Figure 4] 1 is a flowchart of an image display method according to an embodiment of the present application. [Figure 5] 1 is a flowchart of another image display method according to an embodiment of the present application. [Figure 6] FIG. 2 is a schematic diagram of a target information interface according to an embodiment of the present application. [Figure 7] 1 is a flowchart for acquiring a pathology image according to an embodiment of the present application. [Figure 8]FIG. 1 is a schematic diagram of a method for classifying pathological images according to an embodiment of the present application. [Figure 9] FIG. 10 is a schematic diagram of another target information interface according to an embodiment of the present application. [Figure 10] FIG. 1 is a schematic diagram of a pathology sub-image according to an embodiment of the present application. [Figure 11] 1 is a schematic diagram of a method for displaying a pathology sub-image according to an embodiment of the present application; [Figure 12] 10 is a flowchart of another image display method according to an embodiment of the present application. [Figure 13] FIG. 10 is a schematic diagram of another target information interface according to an embodiment of the present application. [Figure 14] FIG. 10 is a schematic diagram of another target information interface according to an embodiment of the present application; [Figure 15] 4 is a flowchart of another image display method according to an embodiment of the present application. [Figure 16] FIG. 1 is a schematic diagram of a display of a pathology image according to an embodiment of the present application. [Figure 17] 4 is a flowchart of another image display method according to an embodiment of the present application. [Figure 18] FIG. 10 is a schematic diagram of another target information interface according to an embodiment of the present application; [Figure 19] FIG. 10 is a schematic diagram of another target information interface according to an embodiment of the present application; [Figure 20] FIG. 10 is a schematic diagram of another target information interface according to an embodiment of the present application; [Figure 21] 4 is a flowchart of another image display method according to an embodiment of the present application. [Figure 22] 1 is a schematic diagram illustrating a configuration of an image display device according to an embodiment of the present application. [Figure 23] FIG. 10 is a schematic diagram illustrating the configuration of another image display device according to an embodiment of the present application. [Figure 24] 1 is a schematic diagram of the configuration of a terminal according to an embodiment of the present application; DETAILED DESCRIPTION OF THE INVENTION

[0024] In order to make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the embodiments of the present application will be described in more detail below with reference to the accompanying drawings.

[0025] The terms "first," "second," and the like used in this application can describe various concepts in this disclosure, and unless otherwise specified, it is understood that these concepts are not limited to these terms. These terms are used only to distinguish one concept from another. For example, if it deviates from the scope of this application, the first region can be referred to as the second region, and similarly, the second region can be referred to as the first region.

[0026] Here, "at least one" means one or more than one, and for example, "at least one pathological subimage" may be one pathological subimage, two pathological subimages, three pathological subimages, or any other integer number of one or more. "Plural" means two or more, and for example, "multiple pathological subimages" may be two pathological subimages, three pathological subimages, or any other integer number of two or more. "Each" means at least one, and for example, "each pathological subimage" means a pathological subimage among the multiple pathological subimages, and if the multiple pathological subimages are three pathological subimages, "each pathological subimage" means a pathological subimage among the three pathological subimages.

[0027] In addition, the user information (including, but not limited to, subject information, pathological images, etc.) related to this application may be information authorized by the user or information for which sufficient authorization has been obtained from various parties.

[0028] An image display method according to an embodiment of the present application is executed by a terminal, which displays at least one object on an object information interface, and when a user selects an object, the terminal retrieves a pathology image of the object and displays at least one pathology sub-image of the pathology image that belongs to a target type on the object information interface, thereby displaying key information of the pathology image that has higher reference value and improving the purposefulness of the pathology image display.

[0029] In one possible implementation, the embodiment of the present application also provides an implementation environment for the image display method, and Fig. 1 is a schematic diagram of the implementation environment according to the embodiment of the present application. As shown in Fig. 1, the implementation environment includes a terminal 101 and a server 102, and the terminal 101 and the server 102 are connected via a wireless or wired network.

[0030] Here, the terminal 101 requests the server 102 to perform classification on the pathological image, the server 102 identifies pathological sub-images from the pathological image that belong to the target type, and transmits the identified pathological sub-images to the terminal 101, and the terminal 101 presents the pathological sub-images that belong to the target type to the user.

[0031] Alternatively, the terminal 101 may have a target client installed thereon that is provided by the server 102, and the target client may provide functions such as image recognition, data transfer, and message exchange. Alternatively, the target client may be a client in the operating system of the terminal 101, or a client provided by a third party. Alternatively, the server 102 may be a background server for the target client, or a cloud server that provides services such as cloud computing and cloud storage.

[0032] As an option, the terminal 101 may include a smartphone, a tablet, a laptop, a desktop computer, a smart speaker, a smart watch, a smart voice interaction device, or a smart home appliance, and the server 102 may be a single server, a server cluster consisting of several servers, or a cloud computing service center.

[0033] The image display method according to the embodiment of the present application can be applied to any scene in which a pathological image is displayed.

[0034] For example, this application may be used in situations where a doctor is assisting in a diagnosis. In this scenario, the pathology sub-image belonging to the target type may be a pathology sub-image containing abnormal cells. The terminal displays patient information corresponding to multiple patients on a patient information interface. When a doctor or nurse wants to diagnose a patient's condition, the doctor or nurse selects the patient on the patient information interface. As shown in FIG. 2 , the terminal acquires the pathology images of the patient and determines and displays the pathology sub-image containing abnormal cells from the pathology images. The doctor or nurse can view the pathology sub-image displayed on the terminal and diagnose the patient's condition in conjunction with other related information of the patient. Therefore, when using the method according to the embodiment of the present application, the doctor or nurse can directly view the pathology sub-image containing abnormal cells without having to analyze and study all of the patient's pathology images, which improves the suitability of pathology image display and is advantageous for assisting doctors and nurses in making quick diagnoses.

[0035] Another application is, for example, sorting pathological images. In this case, pathological sub-images belonging to a target type may be pathological sub-images whose quality parameters meet the target quality conditions. Because the image quality of different regions in a pathological image varies, related technologies generally require users to manually view the entire pathological image to understand and select the image quality of the pathological images. When using the method according to an embodiment of the present application, when a user wants to view a pathological image of a certain object, the user performs a selection operation for the object. As shown in FIG. 3, the terminal acquires the pathological image of the object and determines and displays pathological sub-images whose quality parameters meet the target quality conditions from the pathological image, thereby selecting pathological sub-images with relatively good quality and filtering out pathological sub-images with relatively poor quality. This facilitates user inspection and analysis, realizes automatic understanding and selection of image quality, and reduces labor costs.

[0036] 4 is a flowchart of an image display method according to an embodiment of the present application. The embodiment of the present application is performed by a terminal. Referring to FIG. 4, the method includes the following steps:

[0037] In 401, the terminal displays an object information interface, which includes at least one object.

[0038] Alternatively, the object may be a person, an animal, a plant, or the like, although embodiments of the present application are not limited thereto. Here, the object information interface is used to display information of the at least one object. For example, the object information interface can be divided into multiple different regions, each region being used to display a different type of information.

[0039] At 402, the terminal acquires a pathological image of the target object in response to a selection operation for the target object in the object information interface.

[0040] The target object in the object information interface is any one of the at least one objects, and a selection action on the target object is used to request the display of a pathology image of the target object, so that after a user views an object in the object information interface, if the user wants to view the pathology image of the target object, the user can perform a selection action on the target object, and the terminal acquires the pathology image of the target object in response to the selection action on the target object.

[0041] Here, the pathology image may also be referred to as a pathology section image or a digital section image, and the pathology image of the target object is intended to represent an image of the pathological morphology of the target's biological organ, tissue, or cell. For example, the pathology image may be a digital whole slide image (WSI), which is an image obtained by scanning a pathology microsection using a digital pathology scanner, and the digital pathology scanner is composed of an optical system, a linear scanning camera, etc.

[0042] In one possible embodiment, the pathology image includes a liquid-based cytology pathology image or a histopathology pathology image, or the pathology image may be another type of pathology image, and examples of the present application are not limited thereto.

[0043] In 403, the terminal determines at least one pathological sub-image of the pathological image that belongs to a target type.

[0044] The terminal performs classification on the pathology image and determines at least one pathology sub-image belonging to a target type in the pathology image, where a pathology sub-image is a region in the pathology image, i.e., the terminal identifies a region in the pathology image that belongs to a target type and crops the identified region to become a pathology sub-image, where the pathology sub-image of the target type contains important information that is of reference value, i.e., this information is of interest to the user.

[0045] Here, the pathological sub-images of the pathological image may include various different classification criteria, and the target types may also be various accordingly, and the terminal may adopt different identification methods to determine pathological sub-images of different target types, but the embodiments of the present application are not limited to the target types.

[0046] At 404, the terminal displays at least one pathology sub-image belonging to the target type on the object information interface.

[0047] After determining the at least one pathology sub-image belonging to the target type, the terminal displays the at least one pathology sub-image on the target information interface for the user to view, so that the user can directly view the pathology sub-images belonging to the target type displayed by the terminal without having to browse and search for pathology sub-images belonging to the target type in all pathology images.

[0048] In a method according to an embodiment of the present application, at least one object is displayed on an object information interface, and when a user selects a target object, a pathology image of the target object is acquired, and at least one pathology sub-image belonging to a target type is first determined in the pathology image, and then the at least one pathology sub-image belonging to the target type is displayed, thereby displaying key information with higher reference value in the pathology image and improving the purposefulness of the pathology image display, thereby improving the display effect of the pathology image.

[0049] The above embodiment of FIG. 2 briefly describes the process of displaying a pathology image and a pathology sub-image. In some embodiments, after determining a pathology sub-image belonging to a target type, the terminal displays the pathology sub-image belonging to the target type in the image display area of ​​the target information interface, so that the user can quickly recognize these pathology sub-images. For detailed processes, please refer to the embodiment of FIG. 5 below. FIG. 5 is a flowchart of another image display method according to an embodiment of the present application, where the execution entity of the embodiment of the present application is a terminal, and the embodiment of the present application takes as an example displaying a pathology sub-image in the image display area of ​​the target information interface. Referring to FIG. 5, the method includes the following steps:

[0050] In 501, the terminal displays an object information interface, which includes at least one object.

[0051] Alternatively, the object may be a person, an animal, a plant, etc., and embodiments of the present application are not limited thereto. Here, the object information interface is used to display information of the at least one object.

[0052] For example, if the object is a user and the object information interface is a user information interface, the user information interface may display the user's name, age, photo, contact information, pathology images, or medical record reports, etc., and the embodiments of the present application are not limited thereto.

[0053] FIG. 6 is a schematic diagram of a target information interface according to an embodiment of the present application, which is a patient information interface in the medical field for recording patient information. As shown in FIG. 6 , the patient information interface includes four areas: area 601, area 602, area 603, and area 604. Area 601 is used to display at least one patient identifier, such as the patient's name or number. Clicking on the patient identifier in area 601 allows the user to view the patient's medical record or pathology image. Area 602 is a "command bar" in the patient information interface, and includes multiple touch options, allowing users to perform actions such as submitting a medical record, reviewing a medical record, printing a medical record, viewing a previous example, viewing a next example, or exiting the patient information interface. Area 603 is used to display the patient's medical record, allowing users to perform actions such as filling out, modifying, or viewing the patient's medical record. Area 604 is used to display pathology sub-images of the patient's pathology image that belong to a target type.

[0054] In 502, the terminal acquires a pathological image of the target object in response to a selection action on the target object in the object information interface.

[0055] The target object in the object information interface is any one of the at least one objects, and a selection action on the target object is used to request the display of a pathology image of the target object, so that after viewing an object in the object information interface, if the user wants to view the pathology image of the target object, the user can perform a selection action on the target object, and the terminal will obtain the pathology image of the target object in response to the selection action on the target object.

[0056] In one possible embodiment, the terminal stores pathological images of each object displayed on the object information interface, and stores a pathological image of any one of the objects corresponding to an object label of the object, and in response to a selection action for the target object, the terminal queries the stored pathological images for a pathological image corresponding to the object label of the target object and obtains the pathological image that is the pathological image of the target object. Alternatively, the server stores pathological images of each object, and stores a pathological image of any one of the objects corresponding to the object label of the target object, and in response to a selection action for the target object, the terminal sends an image acquisition request carrying the object label of the target object to the server, and the server responds to the image acquisition request by querying the stored pathological images for a pathological image that corresponds to the object label of the target object, obtains the pathological image, and sends the pathological image to the terminal, and the terminal receives the pathological image that is the pathological image of the target object.

[0057] In one possible embodiment, the terminal responds to a selection operation on a target object in the object information interface, obtains a pathology file of the target object, analyzes the pathology file, and obtains a pathology image in the pathology file.

[0058] Here, the pathology file can be understood as a pathology image stored in a file format. The target pathology file includes pathology images with different scaling levels, i.e., the content of the pathology images in the pathology file is the same, but the sizes of the pathology images are different. Analyzing the pathology file refers to obtaining the pathology images in the pathology file in a structured format to facilitate subsequent processing of the pathology images. For example, the terminal can obtain pathology images with a target scaling level and perform the following steps 503-504 based on the obtained pathology images. Alternatively, the terminal can analyze the pathology file using a software development kit (SDK) compatible with the format of the pathology file, or the terminal can analyze the pathology file according to its own file structure corresponding to the pathology file. Alternatively, the pathology file is in SVS format (a type of file format), and the terminal performs the analysis using OpenSlide (a type of open source library).

[0059] As an option, after the terminal obtains the pathology file, it verifies the pathology file and obtains a verification result indicating whether the pathology file is corrupted, and if the verification result indicates that the pathology file is not corrupted, it analyzes the pathology file and obtains a pathology image.

[0060] Because the pathology file may be corrupted during storage or transfer, before analyzing the pathology file, the terminal first verifies the pathology file to determine whether it is corrupted. If the verification result indicates that the pathology file is not corrupted, it indicates that the pathology image can be parsed into the pathology file. Therefore, the terminal analyzes the pathology file. If the verification result indicates that the pathology file is corrupted, it indicates that the pathology image cannot be parsed into the pathology file or that the analyzed pathology image contains an error. Therefore, the terminal does not need to analyze the pathology file. As an option, the terminal can verify the pathology file using methods such as MD5 (a type of message digest algorithm) or file flag bits.

[0061] In one option, the terminal stores pathology files for each object displayed on the object information interface, and stores a pathology file for one of the objects corresponding to an object label for the object, and in response to a selection action for the target object, the terminal queries the stored pathology files for the pathology file corresponding to the object label for the target object to obtain the pathology file for the target object. Alternatively, the server stores pathology files for each object, and stores a pathology file for one of the objects corresponding to the object label for the target object, and in response to a selection action for the target object, the terminal sends an image acquisition request carrying the object label for the target object to the server, and the server responds to the image acquisition request by querying the stored pathology files for the pathology file corresponding to the object label for the target object to obtain the pathology file and sending the pathology file to the terminal, and the terminal receives the pathology file for the target object.

[0062] 7 is a flowchart of acquiring a pathology image according to an embodiment of the present application. As shown in FIG. 7, acquiring a pathology image in a pathology file includes two steps, which are a file verification step and a file analysis step. The terminal first performs file verification on the pathology file, and if the verification is successful, performs file analysis on the pathology file to acquire a pathology image in the pathology file.

[0063] In the embodiments of the present application, the pathology file is verified to ensure its validity, thereby ensuring the accuracy of the pathology image obtained by analyzing the pathology file, and avoiding the processing of erroneously analyzed pathology images if the pathology file is corrupted.

[0064] In 503, the terminal determines at least one pathological sub-image of the pathological image that belongs to a target type.

[0065] After the terminal obtains the pathology image, it performs classification on the pathology image and determines at least one pathology sub-image belonging to a target type in the pathology image, which pathology sub-image of the target type contains important information that is worth referring to, i.e., important information that is worth referring to is information that the user is interested in.

[0066] In one possible embodiment, the terminal's determining at least one pathological sub-image of the pathological image that belongs to a target type includes at least one of the following determining manners:

[0067] First determination mode: The terminal determines at least one pathological sub-image containing abnormal cells from the pathological image.

[0068] The terminal identifies abnormal cells in the pathology image, and determines at least one pathology sub-image containing abnormal cells from the pathology image according to the identification result. In the medical field, whether abnormal cells exist in a patient's body, what type of abnormal cells exist, and the degree of lesion of the abnormal cells are all key information to assist doctors in diagnosing diseases, so the terminal determines at least one pathology sub-image containing abnormal cells, and subsequently displays it to doctors and nurses to help doctors and nurses make quick diagnoses.

[0069] Here, the abnormal cells are cells that are abnormal, and the abnormality of cells includes a variety of situations, including different abnormal types such as glandular epithelial abnormalities, high-level squamous cell lesions, and low-level squamous cell lesions.

[0070] As an option, the terminal employs an abnormal cell identification and classification algorithm to perform identification on the pathology image to obtain at least one pathology sub-image containing abnormal cells.

[0071] Second determination manner: the terminal determines from the pathological image at least one pathological sub-image in which the cells contained therein belong to a target state, including a negative state or a positive state.

[0072] The terminal identifies cells belonging to a target state in the pathology image, and determines at least one pathology sub-image containing cells belonging to the target state from the pathology image according to the identification result. In the medical field, whether the cells in a patient's body are in a negative state or a positive state is key information to assist doctors in diagnosing diseases, so the terminal can determine a pathology sub-image containing cells in a negative state or a pathology sub-image containing cells in a positive state.

[0073] As an option, the terminal employs a slice negative / positive interpretation algorithm to perform classification on the pathology image to obtain at least one pathology sub-image containing cells belonging to the target state.

[0074] Third determination manner: The terminal determines, from the pathological image, at least one pathological sub-image whose quality parameter meets the target quality condition.

[0075] The terminal performs a quality inspection on the pathological image, and determines at least one pathological sub-image from the pathological image, whose quality parameters meet the target quality conditions, according to the inspection result.

[0076] Alternatively, the quality parameter may indicate the quality of the pathology sub-image, e.g., a larger quality parameter indicates a better quality of the pathology sub-image. Alternatively, the target quality condition may be that the quality parameter is lower than a first threshold, thereby selecting pathology sub-images of relatively poor quality. Alternatively, the target quality condition may be that the quality parameter is higher than a second threshold, thereby selecting pathology sub-images of relatively good quality. The first threshold is lower than the second threshold.

[0077] As an option, the quality parameter indicates whether a quality problem exists in the pathology sub-image and the type of the quality problem that exists. For example, a quality parameter of 1 indicates a blur problem in the pathology sub-image, a quality parameter of 2 indicates a stitching discontinuity problem in the pathology sub-image, a quality parameter of 3 indicates a foreign object occlusion problem in the pathology sub-image, a quality parameter of 4 indicates no quality problem in the pathology sub-image, etc. Accordingly, the target quality condition may include a quality parameter of 4, a quality parameter less than 4, or a quality parameter of 1, etc. By setting different target quality conditions, different types of pathology sub-images can be selected based on image quality, and the quality of the pathology sub-images can be understood.

[0078] 8 is a schematic diagram of a pathology image classification method according to an embodiment of the present application. As shown in FIG. 8, the classification of pathology images includes at least three modes: identifying abnormal cells, interpreting cells as negative or positive, and inspecting image quality. Although the embodiment of the present application only uses the above three modes as an example, the terminal may also use other classification algorithms to classify pathology images and determine pathology sub-images belonging to a target type from among them; the embodiment of the present application is not limited thereto.

[0079] In one possible embodiment, the terminal performs classification on the pathology image to obtain at least one region of the pathology image that belongs to a target type, and then cuts out the at least one region from the pathology image to obtain at least one pathology sub-image that belongs to the target type. Optionally, pixel points in the pathology sub-image that belongs to the target type have specific features, and the terminal performs feature extraction on the pathology image to obtain the features of the pixel points in the pathology image, and the terminal determines at least one region that belongs to the target type based on the features of each pixel point.

[0080] In another possible embodiment, the terminal performs classification on the pathology image to obtain at least one location information indicating an area in the pathology image that belongs to a target type, and then the terminal cuts out at least one area indicated by the location information from the pathology image and determines the cut-out area as a pathology sub-image.

[0081] The terminal performs classification on the pathology image to obtain location information, and then positions the area in the image belonging to the target type according to the location information. Here, the area indicated by the location information may be rectangular, circular, or have other shapes. Since it is inconvenient to directly present the location information to the user, the terminal can extract the pathology sub-image belonging to the target type from the pathology image based on the location information, and subsequently present the pathology sub-image to the user, making it easier for the user to view.

[0082] As an option, the terminal performs identification on the pathology image to obtain position information and corresponding type information. The type information is used to indicate a target type, and the type to which the area indicated by the position information belongs is the target type indicated by the type information. The terminal stores the position information and type information in correspondence with each other, and subsequently, based on the position information, cuts out a pathology sub-image from the pathology image, and based on the type information corresponding to the position information, determines that the type to which the pathology sub-image belongs is the target type indicated by the type information.

[0083] In 504, the terminal displays at least one pathology sub-image belonging to the target type in an image display area of ​​the target information interface.

[0084] After the terminal determines that at least one pathology sub-image belongs to the target type, it displays the at least one pathology sub-image in the image display area of ​​the target information interface, so that the user can view the pathology sub-image in the image display area without having to browse and search for pathology sub-images that belong to the target type in all pathology images.

[0085] 9 is a schematic diagram of another object information interface according to an embodiment of the present application. As shown in FIG. 9, the object information interface is similar to the object information interface shown in FIG. 6 above, and includes an image display area 901. After the terminal acquires multiple pathology sub-images containing abnormal cells, the multiple pathology sub-images are displayed in the image display area 901.

[0086] In one possible embodiment, the terminal displays at least one pathology sub-image belonging to a target type in the image display area of ​​the target information interface, and includes the following four display modes:

[0087] First display style: The target type includes a plurality of subtypes, and the terminal displays the plurality of pathological subimages in sections according to the differences in the subtypes to which the plurality of pathological subimages belong.

[0088] Since the multiple pathological sub-images belonging to the target type include pathological sub-images belonging to any one of the subtypes, the subtypes to which any two of the multiple pathological sub-images determined in the above step 503 belong may be the same or different. Therefore, the terminal displays the multiple pathological sub-images in sections in the image display area according to the differences in the subtypes to which the multiple pathological sub-images belong.

[0089] That is, the terminal divides the image display area into multiple sub-areas, one for each sub-type, and displays at least one pathology sub-image belonging to the sub-type in the sub-area corresponding to the sub-type. In the embodiment of the present application, by displaying pathology sub-images belonging to different sub-types in separate sections, the user can collectively view pathology sub-images belonging to the same sub-type, and the display effect of the pathology sub-images is further improved.

[0090] For example, the target type is that the pathology sub-image contains abnormal cells, and the target type includes multiple subtypes, which are divided into glandular epithelial abnormalities, high-level squamous cell lesions, and low-level squamous cell lesions. Therefore, as shown in Figure 10, the terminal displays the multiple pathology sub-images containing abnormal cells in the order of glandular epithelial abnormalities, high-level squamous cell lesions, and low-level squamous cell lesions.

[0091] Second display format: The terminal displays the plurality of pathological sub-images in order of the number of cells contained in the plurality of pathological sub-images.

[0092] The terminal determines the number of cells contained in each pathological sub-image and then displays the pathological sub-images in order of the number of cells contained in each pathological sub-image. For example, the terminal displays the pathological sub-images in order of the number of cells contained in each pathological sub-image, thereby preferentially presenting pathological sub-images with a large number of cells. Alternatively, the terminal may display the pathological sub-images in order of the number of cells contained in each pathological sub-image, although the embodiments of the present application are not limited thereto.

[0093] Third display style: The terminal displays the plurality of pathological sub-images in accordance with the order of the quality parameters of the plurality of pathological sub-images.

[0094] The terminal determines a quality parameter for each pathological subimage. The quality parameter indicates the quality of the pathological subimage, for example, a larger quality parameter indicates a better quality of the pathological subimage. The terminal displays the pathological subimages in order of their quality parameters. For example, the terminal displays the pathological subimages in order of the largest reference quality parameter, thereby preferentially presenting clear pathological subimages. Alternatively, the terminal may display the pathological subimages in order of the smallest reference quality parameter, although the embodiment of the present application is not limited thereto.

[0095] Fourth display style: The terminal displays the plurality of pathological sub-images in order of the reliability of the plurality of pathological sub-images.

[0096] The terminal determines a reliability for each pathology subimage. The reliability of the pathology subimage indicates the degree to which it is reliable that the pathology subimage belongs to the target type, i.e., the possibility that the pathology subimage belongs to the target type. For example, a higher reliability indicates a higher degree to which it is reliable that the pathology subimage belongs to the target type. The terminal displays the pathology subimages in order of their reliability. For example, the terminal displays the pathology subimages in descending order of reliability, thereby preferentially presenting pathology subimages that are more likely to belong to the target type. Alternatively, the terminal may display the pathology subimages in descending order of reliability, although the embodiment of the present application is not limited thereto.

[0097] In the embodiment of the present application, multiple pathological sub-images are displayed in an ordered order according to the number of cells, quality parameters, or reliability, which makes it easier for users to directly view the features in order, quickly find the key images among the multiple pathological sub-images, and further improve the display effect of the pathological sub-images.

[0098] 11 is a schematic diagram of a method for displaying pathology sub-images according to an embodiment of the present application. As shown in FIG. 11, displaying pathology sub-images includes four modes: displaying by subtype, displaying by quality parameter, displaying by cell count, and displaying by reliability. Although the embodiment of the present application only uses these four modes as examples, the terminal may also display other modes or display other ordering modes, and the embodiment of the present application is not limited thereto.

[0099] In the embodiment of the present application, only the pathology sub-image is displayed in the image display area as an example, but in other embodiments, other ways may be adopted to display at least one pathology sub-image belonging to a target type in the target information interface.

[0100] In the method according to the embodiment of the present application, at least one object is displayed on an object information interface, and when a user selects a target object, a pathology image of the target object is acquired, and at least one pathology sub-image belonging to a target type is first determined in the pathology image, and then the at least one pathology sub-image belonging to the target type is displayed, thereby displaying key information with higher reference value in the pathology image and improving the purposefulness of the pathology image display, thereby improving the display effect of the pathology image.

[0101] Furthermore, by displaying pathological sub-images belonging to different sub-types in sections, it becomes easier for the user to view pathological sub-images belonging to the same sub-type all at once, and the display effect of the pathological sub-images is further improved.

[0102] In addition, by displaying a plurality of pathological sub-images in order according to the number of cells, quality parameters, or reliability, it is easy for users to view them directly in the order of their features, quickly find the key images among the plurality of pathological sub-images, and further improve the display effect of the pathological sub-images.

[0103] In addition, by verifying the pathology file and ensuring its validity, the accuracy of the pathology image obtained by analyzing the pathology file is ensured, and processing of pathology images that have been analyzed incorrectly in the event that the pathology file is corrupted is avoided.

[0104] In some embodiments, in addition to the embodiment of Figure 5 above, the target type includes multiple subtypes, and the terminal displays a limited number of pathological sub-images belonging to each subtype, and can perform an unfolding operation to unfold and display each pathological sub-image belonging to a certain subtype, and cancel the display of pathological sub-images belonging to other subtypes. For detailed processes, please refer to the embodiment of Figure 12 below. Figure 12 is a flowchart of another image display method according to an embodiment of the present application, where the execution entity of the embodiment of the present application is a terminal, and the embodiment of the present application will be described by taking the example that the target type includes multiple subtypes. Referring to Figure 12, the method includes the following steps:

[0105] In 1201, the terminal displays an object information interface, which includes at least one object.

[0106] In 1202, the terminal acquires a pathological image of the target object in response to a selection action on the target object in the object information interface.

[0107] The process of step 1201-step 1202 is the same as the process of step 501-step 502 described above, and the description thereof will be omitted here.

[0108] In 1203, the terminal determines at least one pathology sub-image among the pathology images that belongs to a target type including multiple sub-types.

[0109] Here, the process of step 1203 is similar to the process of step 503 above, except that the target type includes multiple subtypes.

[0110] For example, the target type is the presence of abnormalities in the pathology sub-image, and according to the different abnormality types, the target type is further divided into multiple subtypes, for example, the subtypes include glandular epithelial abnormalities, high-level squamous cell lesions, low-level squamous cell lesions, etc.

[0111] For example, the target type is that there is a quality problem in the pathology sub-image, and according to different types of quality problems, the target type is further divided into multiple sub-types, for example, the sub-types include blurred image, non-smooth image stitching, foreign objects in the image, or missing image.

[0112] In 1204, the terminal displays at least one pathology sub-image belonging to any one subtype in an image display area of ​​the target information interface, and the number of pathology sub-images corresponding to any one subtype in the image display area is less than or equal to a target number.

[0113] The process of step 1204 is similar to the process of step 504, except that the number of pathology sub-images corresponding to any one subtype in the image display area is equal to or less than a target number, i.e., for each subtype, only a limited number of pathology sub-images are currently displayed in the image display area. Optionally, the target number is a number preset by the terminal, such as 6 or 8.

[0114] 13 is a schematic diagram of another object information interface according to an embodiment of the present application. As shown in FIG. 13, the object information interface is similar to the object information interface shown in FIG. 6 above. The object information interface includes an image display area 1301, which is divided into multiple sub-areas, including a sub-area 1311 corresponding to glandular epithelial abnormalities, a sub-area 1321 corresponding to high-level squamous cell lesions, a sub-area 1331 corresponding to low-level squamous cell lesions, and a sub-area 1341 corresponding to microbial abnormalities. Each sub-area displays only four pathological sub-images belonging to the corresponding sub-category.

[0115] In 1205, in response to the unfold operation for the first subtype, the terminal cancels the display of pathological sub-images belonging to other subtypes in the image display area and displays each pathological sub-image belonging to the first subtype.

[0116] Here, the first subtype is any one of a plurality of subtypes, and the unfolding operation for the first subtype is used to request the display of each pathological subimage belonging to the subtype. Therefore, when the user wants to view other pathological subimages belonging to the first subtype, the unfolding operation for the first subtype is performed, and the terminal responds to the unfolding operation for the first subtype by canceling the display of the pathological subimages belonging to the other subtypes and displaying each pathological subimage belonging to the first subtype.

[0117] In an embodiment of the present application, a limited number of pathological sub-images corresponding to each sub-type are displayed in the image display area, and when the expansion operation for any sub-type is checked, the display of pathological sub-images belonging to other sub-types in the image display area can be canceled and each pathological sub-image belonging to that sub-type can be displayed, thereby improving the flexibility of displaying pathological sub-images.

[0118] In one possible embodiment, the image display area also displays type indicators corresponding to the first subtype, and the terminal, in response to a trigger operation on the type indicator corresponding to the first subtype, cancels the display of pathological sub-images belonging to other subtypes and displays the pathological sub-images belonging to the first subtype in the image display area. For example, the trigger operation may be a click operation or a drag operation.

[0119] In another possible embodiment, the image display area displays expansion options corresponding to each subtype, and the terminal responds to a trigger operation on the expansion option corresponding to the first subtype by canceling the display of pathological sub-images belonging to other subtypes and displaying each pathological sub-image belonging to the first subtype in the image display area.

[0120] In another possible embodiment, in response to an expand operation for the first subtype, the terminal cancels the display of pathological sub-images belonging to other subtypes in the image display area and displays a slide list corresponding to the first subtype, the slide list including each pathological sub-image belonging to the first subtype.

[0121] For example, as shown in Figure 13, if a user wants to view multiple pathological sub-images belonging to glandular epithelial abnormalities, an expansion operation for "glandular epithelial abnormalities" is performed in the target information interface shown in Figure 13, and the terminal responds to the expansion operation by displaying the target information interface shown in Figure 14. Referring to Figure 14, the image display area 1301 does not display pathological sub-images belonging to high-level squamous cell lesions, pathological sub-images belonging to low-level squamous cell lesions, or pathological sub-images belonging to microbial abnormalities, but only includes multiple pathological sub-images belonging to glandular epithelial abnormalities.

[0122] In the present embodiment, only the pathology sub-image is displayed in the image display area as an example, but in other embodiments, other ways may be adopted to display at least one pathology sub-image belonging to a target type in the target information interface.

[0123] In the method according to the embodiment of the present application, at least one object is displayed on an object information interface, and when a user selects a target object, a pathology image of the target object is acquired, and at least one pathology sub-image belonging to a target type is first determined in the pathology image, and then the at least one pathology sub-image belonging to the target type is displayed, thereby displaying key information with higher reference value in the pathology image and improving the purposefulness of the pathology image display, thereby improving the display effect of the pathology image.

[0124] In addition, a limited number of pathological sub-images corresponding to each sub-type are displayed in the image display area, and when the expansion operation for any sub-type is checked, the display of pathological sub-images belonging to other sub-types in the image display area can be canceled and each pathological sub-image belonging to that sub-type can be displayed, thereby improving the flexibility of displaying pathological sub-images.

[0125] The above embodiments of Figures 5 and 12 are described by taking the example of displaying pathological sub-images belonging to a target type in an image display area. In another embodiment, the terminal may display a complete pathological image and display a frame of a pathological sub-image belonging to a target type on the pathological image. For detailed processes, please refer to the embodiment of Figure 15 below. Figure 15 is a flowchart of another image display method according to an embodiment of the present application, where the execution entity of the embodiment of the present application is a terminal. This embodiment is described by taking the example of displaying a frame of a pathological sub-image on a pathological image. Referring to Figure 15, the method includes the following steps:

[0126] In 1501, the terminal displays an object information interface, which includes at least one object.

[0127] In 1502, the terminal acquires a pathology image of the target object in response to a selection action on the target object in the object information interface.

[0128] In 1503, the terminal determines at least one pathology sub-image of the pathology image that belongs to a target type.

[0129] The process of steps 1501 to 1503 is the same as the process of steps 501 to 503 described above, and the description thereof will be omitted here.

[0130] In 1504, the terminal displays the pathology image on the object information interface, and displays a frame of at least one pathology sub-image on the pathology image.

[0131] Considering that the user may want to view other areas of the pathology image besides the at least one pathology sub-image, the terminal directly displays the pathology image on the target information interface. To allow the user to quickly view the at least one pathology sub-image, the terminal displays a frame for the at least one pathology sub-image on the pathology image. The frame can serve as a marker and reminder, ensuring the completeness of the pathology image display and the purposefulness of the pathology sub-image display, thereby improving the overall display effect.

[0132] 16 is a schematic diagram of a pathology image display according to an embodiment of the present application. As shown in FIG. 16, the pathology image in the target information interface displays frames for multiple pathology sub-images. In addition, the target information interface also displays image information corresponding to each pathology sub-image, including the target type and reliability of the pathology sub-image. For example, as can be seen from FIG. 16, the pathology image includes eight pathology sub-images belonging to high-level squamous cell lesions, and the reliability of these eight pathology sub-images is 66%, 65%, 63%, 62%, 60%, 59%, 58%, and 56%, respectively. The pathology image also includes six pathology sub-images belonging to low-level squamous cell lesions, and the target information interface only displays image information corresponding to three pathology sub-images belonging to low-level squamous cell lesions, and the reliability of these three pathology sub-images is 47%, 43%, and 42%, respectively.

[0133] In the method according to the embodiment of the present application, at least one object is displayed on an object information interface, and when a user selects a target object, a pathology image of the target object is acquired, and at least one pathology sub-image belonging to a target type is first determined in the pathology image, and then the at least one pathology sub-image belonging to the target type is displayed, thereby displaying key information with higher reference value in the pathology image and improving the purposefulness of the pathology image display, thereby improving the display effect of the pathology image.

[0134] In addition, the pathology image is displayed on the target information interface, and a frame of at least one pathology sub-image is displayed on the pathology image, and the frame can serve as a marker and reminder, thereby ensuring the completeness of the display of the pathology image and the purposefulness of the display of the pathology sub-image, thereby improving the overall display effect.

[0135] In some embodiments, in any one of the above embodiments, the terminal may also display any one of the enlarged pathology sub-images, and for detailed processes, see the embodiment in Figure 17 below. Figure 17 is a flowchart of another image display method according to an embodiment of the present application, where the embodiment of the present application is performed by a terminal, and the embodiment of the present application is described by displaying the enlarged pathology sub-image. Referring to Figure 17, the method includes the following steps:

[0136] In 1701, the terminal displays an object information interface, which includes at least one object.

[0137] In 1702, the terminal acquires a pathology image of the target object in response to a selection action on the target object in the object information interface.

[0138] In 1703, the terminal determines at least one pathology sub-image of the pathology image that belongs to the target type.

[0139] The process of steps 1701 to 1703 is the same as the process of steps 501 to 503 described above, and the description thereof will be omitted here.

[0140] In 1704, the terminal displays at least one pathology sub-image belonging to the target type on the target information interface.

[0141] In one possible embodiment, the terminal displays at least one pathological sub-image belonging to the target type in the target information interface, and displays a confidence marker for the at least one pathological sub-image, the confidence marker for the pathological sub-image indicating the confidence level of the pathological sub-image, and the confidence level of the pathological sub-image indicating the degree to which it is reliable that the pathological sub-image belongs to the target type.

[0142] Alternatively, the reliability marker may be the color of the border of the pathology subimage. For example, the device may divide the reliability of the pathology subimage into multiple levels based on the reliability of the pathology subimage, and the border colors may be different for different levels of reliability. For example, a reliability below a third threshold may be determined as a low level, a reliability equal to or greater than the third threshold but less than a fourth threshold may be determined as a medium level, and a reliability equal to or greater than the fourth threshold may be determined as a high level, with the borders of pathology subimages with low reliability levels being green, those with medium reliability levels being yellow, and those with high reliability levels being red.

[0143] In addition, the display format of the pathological sub-image in step 1704 is the same as the display format of the pathological sub-image in step 504, step 1204-step 1205 or step 1504, and therefore the description thereof will be omitted here.

[0144] At 1705, the terminal responds to a selection action on the displayed first pathology sub-image by displaying the first pathology sub-image after being enlarged by a target number of times.

[0145] Here, the first pathology subimage may be any one of the pathology subimages currently being displayed. A selection action on the first pathology subimage is used to request the display of the first pathology subimage after enlargement. Therefore, if the user wishes to view the first pathology subimage after enlargement, the selection action on the first pathology subimage is performed. In response to the selection action on the first pathology subimage, the terminal displays the first pathology subimage after enlarging it by a target number of times. As one option, the target number of times is a number preset by the terminal, such as 2 times or 2.5 times.

[0146] In one possible embodiment, the terminal responds to a selection operation on the displayed first pathology sub-image by displaying the first pathology sub-image after enlarging it by a target number of times, and includes three enlargement modes as follows:

[0147] First enlargement mode: In response to a touch action on the first pathology sub-image, the terminal displays the first pathology sub-image after enlarging it by a target number of times.

[0148] Optionally, the touch action may include a click action or a drag action on the first pathology sub-image, although embodiments of the present application are not limited thereto.

[0149] Second enlargement mode: The target information interface further displays an image marker corresponding to at least one pathology sub-image, and the terminal responds to a touch operation on the image marker corresponding to the first pathology sub-image and displays the first pathology sub-image after being enlarged by a target number of times.

[0150] Third enlargement mode: The target information interface also displays an enlargement option corresponding to at least one pathology sub-image, and the terminal responds to a touch operation on the enlargement option corresponding to the first pathology sub-image and displays the first pathology sub-image after being enlarged by a target number of times.

[0151] For example, as shown in FIG. 16, the left side of FIG. 16 is a pathology image, the area where each frame on the pathology image is located is the area where the pathology sub-image is located, and the right side of FIG. 16 is an image marker corresponding to each pathology sub-image and the corresponding enlargement option "View." The image marker includes the target type to which the pathology sub-image belongs and the correspondence reliability. There is a correspondence between the image marker and the pathology sub-image, and there is also a correspondence between the enlargement option and the pathology sub-image. When a user clicks on an image marker, the terminal confirms the pathology sub-image corresponding to the image marker and displays the pathology sub-image after being enlarged by the target number of times. Alternatively, when a user clicks on a enlargement option, the terminal confirms the pathology sub-image corresponding to the enlargement option and displays the pathology sub-image after being enlarged by the target number of times.

[0152] In another possible embodiment, the device displays image information corresponding to the first pathology sub-image in a first region within the enlarged first pathology sub-image, where the image information includes at least one of a target type to which the first pathology sub-image belongs or a reliability of the first pathology sub-image. Optionally, the first region is a middle region, a region near the top edge, or a region near the left edge of the first pathology sub-image.

[0153] As an option, when the display time of the image information in the first area reaches a target time, the image information is displayed in a second area outside the enlarged first pathology sub-image, where the size of the second area is smaller than the size of the first area. As an option, the target time is a time preset by the terminal, for example, the target time is 3 seconds.

[0154] 18 is a schematic diagram of another object information interface according to an embodiment of the present application. As shown in FIG. 18, the object information interface displays a plurality of pathology sub-images. After a user clicks on a pathology sub-image 1801, the terminal displays the object information interface shown in FIG. 19. As shown in FIG. 19, the enlarged pathology sub-image 1801 is displayed on the object information interface. In addition, the image information "glandular epithelium abnormality 80%" corresponding to the pathology sub-image 1801 is displayed in a first region of the pathology sub-image 1801. When the display time of the image information in the first region reaches 3 seconds, the terminal displays the object information interface shown in FIG. 20. As shown in FIG. 20, the enlarged pathology sub-image 1801 is displayed on the object information interface. In addition, the image information "glandular epithelium abnormality 80%" corresponding to the pathology sub-image 1801 is displayed in a second region outside the pathology sub-image 1801. In response to reducing the image information from the middle region of the pathology sub-image 1801, the image information "glandular epithelium abnormality 80%" is displayed in the upper region of the object information interface.

[0155] In the method according to the embodiment of the present application, at least one object is displayed on an object information interface, and when a user selects a target object, a pathology image of the target object is acquired, and at least one pathology sub-image belonging to a target type is first determined in the pathology image, and then the at least one pathology sub-image belonging to the target type is displayed, thereby displaying key information with higher reference value in the pathology image and improving the purposefulness of the pathology image display, thereby improving the display effect of the pathology image.

[0156] Furthermore, in response to a selection operation on a displayed pathological sub-image, the pathological sub-image is displayed after being enlarged by a target number of times, thereby improving the degree of freedom in displaying the pathological sub-image.

[0157] Furthermore, image information corresponding to the first pathology sub-image is also displayed in the first region within the enlarged first pathology sub-image, thereby increasing the amount of information that can be displayed.

[0158] Pathological examination medicine is developing towards the "five modernizations" of standardization, automation, informationization, humanization, and clinicalization. With the emergence of high-definition and high-resolution pathological images, the transformation from optical microscopic images to digital microscopic images has been completed, and pathological image and pathological image analysis technology is gradually becoming more widely used.

[0159] In related art, doctors and nurses view pathological images with the naked eye and perform analysis and diagnosis based on experience. Different doctors and nurses make different judgments about the same pathological image, and the differences that can be judged with the naked eye are limited, making it difficult to comprehensively observe pathological phenomena in the pathological image. In addition, the quality of pathological images varies, and there may be cluttered, unnecessary areas, or unclear areas in the scanned pathological image. All of these problems make it difficult for doctors and nurses to quickly and accurately grasp key information in the pathological image.

[0160] The image display method according to an embodiment of the present application can present key information in a pathological image to a user. Figure 21 is a flowchart of another image display method according to an embodiment of the present application. As shown in Figure 21, the method includes the following five steps:

[0161] (1) File verification and analysis: After obtaining the pathology file, the terminal verifies the pathology file, and after passing the verification, analyzes the pathology file to obtain a pathology image.

[0162] (2) Classifying the pathological images: The terminal adopts various pathological image classification algorithms to select areas belonging to the target type from the pathological images, such as an abnormal cell identification algorithm, a cell negative / positive interpretation algorithm, or an image quality inspection algorithm.

[0163] (3) Cutting out a pathological sub-image belonging to the target type: The terminal cuts out an area belonging to the target type from the pathological image to obtain a pathological sub-image belonging to the target type.

[0164] (4) Segmenting or ordering the pathological sub-images: the terminal segments the pathological sub-images based on the subtype they belong to, or the terminal orders them based on quality parameters, the number of cells or the reliability.

[0165] (5) Displaying the pathological sub-images: The terminal displays the pathological sub-images after segmentation or ordering.

[0166] 22 is a schematic diagram of the configuration of an image display device according to an embodiment of the present application. Referring to FIG. 22, the device includes an interface display module 2201 for displaying an object information interface including at least one object, an image acquisition module 2202 for acquiring a pathological image of the target object in response to a selection operation on the target object in the object information interface, and It includes a sub-image determination module 2203 for determining at least one pathological sub-image belonging to the target type among the pathological images, and a sub-image display module 2204 for displaying at least one pathological sub-image belonging to the target type on the target information interface.

[0167] The image display device according to the embodiment of the present application displays at least one object on an object information interface, and when a user selects a target object, obtains a pathology image of the target object, first determines at least one pathology sub-image belonging to a target type in the pathology image, and then displays the at least one pathology sub-image belonging to the target type, thereby displaying key information with higher reference value in the pathology image and improving the suitability of the pathology image display, thereby improving the display effect of the pathology image.

[0168] Optionally, referring to FIG. 23 , the sub-image display module 2204 includes a first display unit 2214 for displaying at least one pathology sub-image belonging to a target type in the image display area of ​​the target information interface; or and a second display unit 2224 for displaying the pathology image on the object information interface and displaying a frame of at least one pathology sub-image on the pathology image.

[0169] As an option, referring to FIG. 23 , the first display unit 2214 displays the plurality of pathological sub-images in sections according to the different subtypes to which the plurality of pathological sub-images belong, the target type includes a plurality of subtypes, and displays the plurality of pathological sub-images in the order of the number of cells contained in the plurality of pathological sub-images, or displays the plurality of pathological sub-images in the order of the quality parameters of the plurality of pathological sub-images, or displays the plurality of pathological sub-images in the order of the reliability of the plurality of pathological sub-images; The confidence level of a pathology sub-image is the degree to which it is possible to be confident that the pathology sub-image belongs to the target type.

[0170] As one option, referring to FIG. 23 , the target type includes multiple subtypes, and the number of pathology sub-images corresponding to any one subtype in the image display area is less than or equal to the target number, and the first display unit 2214 responds to an expansion operation for the first subtype by canceling the display of pathology sub-images belonging to other subtypes in the image display area and displaying each pathology sub-image belonging to the first subtype.

[0171] As one option, referring to FIG. 23, the device further includes a magnification display module 2205 for displaying the first pathology sub-image after being magnified by a target number of times in response to a selection action on the displayed first pathology sub-image.

[0172] As one option, referring to FIG. 23, the magnified display module 2205 further displays image information corresponding to the first pathology sub-image in a first area within the magnified first pathology sub-image, wherein the image information includes at least one of the target type to which the first pathology sub-image belongs or the reliability of the first pathology sub-image.

[0173] As one option, referring to FIG. 23, the enlarged display module 2205 further displays the image information in a second area outside the enlarged first pathology sub-image when the display time of the image information in the first area reaches a target time, where the size of the second area is smaller than the size of the first area.

[0174] As one option, referring to FIG. 23, the magnification display module 2205 includes a first magnification unit 2215 for responding to a touch operation on the first pathology sub-image and displaying the first pathology sub-image after being magnified by a target number of times, or a second magnification unit 2225 for further displaying an image marker corresponding to at least one pathology sub-image on the target information interface and for responding to a touch operation on the image marker corresponding to the first pathology sub-image and displaying the first pathology sub-image after being magnified by a target number of times.

[0175] As an option, referring to FIG. 23 , the sub-image display module 2204 includes a third display unit 2234 for displaying at least one pathology sub-image belonging to a target type in the target information interface, and displaying a confidence level marker of the at least one pathology sub-image; A confidence marker on the pathology sub-image indicates the confidence of the pathology sub-image, which indicates the degree to which it is reliable that the pathology sub-image belongs to the target type.

[0176] As one option, referring to FIG. 23, the sub-image determination module 2203 performs at least one of the following: determining from the pathology image at least one pathology sub-image containing abnormal cells; determining from the pathology image at least one pathology sub-image containing cells belonging to a target state, the target state including a negative state or a positive state; and determining from the pathology image at least one pathology sub-image whose quality parameters meet the target quality conditions.

[0177] As one option, referring to FIG. 23, the sub-image determination module 2203 includes an identification unit 2213 for performing identification on the pathological image and obtaining at least one piece of location information indicating an area in the pathological image that belongs to a target type, and a cutting unit 2223 for cutting out the area indicated by the at least one piece of location information from the pathological image and determining the cut-out area as a pathological sub-image.

[0178] Optionally, the pathology image comprises a liquid-based cytology pathology image or a histopathology pathology image.

[0179] Although the image display device provided in the above embodiments has been described by taking only the division of the above functional modules as an example when displaying an image, in actual applications, the allocation of the above functions can be achieved by different functional modules as needed, that is, by dividing the internal configuration of the terminal into different functional modules, all or part of the above functions can be achieved. Furthermore, the image display device provided in the above embodiments belongs to the same idea as the image display method embodiments, and the specific implementation process thereof shall be described in detail with reference to the method embodiments, and the description thereof will be omitted here.

[0180] An embodiment of the present application provides a terminal, the terminal including a processor and a memory, wherein at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor to realize the operations performed in the image display method of the above embodiment.

[0181] FIG. 24 shows a schematic diagram of the configuration of a terminal 2400 provided by one exemplary embodiment of the present application.

[0182] The terminal 2400 includes a processor 2401 and a memory 2402. The processor 2401 may include one or more processing cores, such as a 4-core processor or an 8-core processor. The processor 2401 may be implemented using at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), or a PLA (Programmable Logic Array). The processor 2401 may include a main processor and a coprocessor. The main processor is a processor for processing data in a wake-up state and is also called a CPU (Central Processing Unit). The coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor 2401 may be integrated with a GPU (Graphics Processing Unit) for rendering and drawing display content. In some embodiments, the processor 2401 may further include an AI (Artificial Intelligence) processor for processing computational operations related to machine learning.

[0183] The memory 2402 may include one or more computer-readable storage media, which may be non-transitory. The memory 2402 may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash storage devices. In some embodiments, the non-transitory computer-readable storage media in the memory 2402 are used to store at least one computer program that the processor 2401 executes to implement the image display method provided by the method embodiments herein.

[0184] In some embodiments, terminal 2400 optionally includes a peripheral device interface 2403 and at least one peripheral device. A bus or signal lines may be connected between processor 2401 and memory 2402 and peripheral device interface 2403. Each peripheral device may be connected to peripheral device interface 2403 via a bus, signal lines, or circuit board. Optionally, the peripheral device includes at least one of radio frequency circuitry 2404, display 2405, camera component 2406, audio circuitry 2407, and power supply 2408.

[0185] The peripheral device interface 2403 can be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 2401 and the memory 2402. In some embodiments, the processor 2401, the memory 2402, and the peripheral device interface 2403 are integrated on the same chip or circuit board, and in other embodiments, any one or two of the processor 2401, the memory 2402, and the peripheral device interface 2403 can be implemented on separate chips or circuit boards, although this embodiment is not limited thereto.

[0186] The radio frequency circuit 2404 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 2404 communicates with communication networks and other communication devices via electromagnetic signals. The radio frequency circuit 2404 converts electrical signals into electromagnetic signals for transmission and converts received electromagnetic signals into electrical signals. Optionally, the radio frequency circuit 2404 includes an antenna system, an RF transceiver, one or more amplifiers, tuners, oscillators, digital signal processors, codec chipsets, user identity module cards, etc. The radio frequency circuit 2404 can communicate with other devices via at least one wireless communication protocol, including, but not limited to, metropolitan area networks, mobile communication networks of various generations (2G, 3G, 4G, and 5G), wireless local area networks, and / or wireless fidelity (WiFi) networks. In some embodiments, radio frequency circuitry 2404 may further include circuitry related to Near Field Communication (NFC), although the present application is not limited thereto.

[0187] The display 2405 is used to display a user interface (UI). The UI may include graphics, text, icons, video, and any combination thereof. If the display 2405 is a touch display, the display 2405 is also capable of collecting touch signals on or above the surface of the display 2405. The touch signals may be input to the processor 2401 as control signals and processed. In this case, the display 2405 is further used to provide virtual buttons and / or a virtual keyboard, also referred to as soft buttons and / or a soft keyboard. In some embodiments, the display 2405 may be a single display or may be configured on the front panel of the terminal 2400. In other embodiments, the display 2405 may be at least two displays, each configured on a different surface of the terminal 2400 or designed to be foldable. In other embodiments, the display 2405 may be a flexible display configured on a curved or foldable surface of the terminal 2400. Furthermore, the display 2405 may be configured to have a non-rectangular, irregular shape, i.e., an irregularly shaped display. The display 2405 may be manufactured using materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0188] The camera component 2406 captures images or videos. Optionally, the camera component 2406 includes a front camera and a rear camera. The front camera is located on the front panel of the device 2400, and the rear camera is located on the back of the device 2400. In some embodiments, there are at least two rear cameras, each of which is one of a main camera, a depth camera, a wide-angle camera, and a telephoto camera. This enables a background blur function realized by integrating the main camera and the depth camera, a panoramic photography and virtual reality (VR) photography function realized by integrating the main camera and the wide-angle camera, or other integrated photography functions. In some embodiments, the camera component 2406 further includes a flash. The flash may be a single color temperature flash or a dual color temperature flash. A dual color temperature flash is a combination of a warm-colored flash and a cool-colored flash, and can be used to compensate for light at different color temperatures.

[0189] The audio circuit 2407 includes a microphone and a speaker. The microphone collects sound waves from the user and the environment and converts them into electrical signals that are input to the processor 2401 for processing or to the radio frequency circuit 2404 for voice communication. For purposes of stereophonic pickup or noise reduction, multiple microphones may be installed at different locations on the terminal 2400. The microphone may be an array microphone or an omnidirectional microphone. The speaker is used to convert electrical signals from the processor 2401 or the radio frequency circuit 2404 into sound waves. The speaker may be a conventional film speaker or a piezoelectric ceramic speaker. If the speaker is a piezoelectric ceramic speaker, it can convert electrical signals into sound waves that are audible to humans as well as into sound waves that are inaudible to humans for purposes such as distance measurement. In some embodiments, the audio circuit 2407 may further include an earphone jack.

[0190] The power source 2408 is used to provide power to each component in the terminal 2400. The power source 2408 may be AC ​​power, DC power, a primary battery, or a rechargeable battery. If the power source 2408 includes a rechargeable battery, the rechargeable battery may support wired or wireless charging. The rechargeable battery may be used to support fast charging technology.

[0191] As will be appreciated by those skilled in the art, the configuration shown in FIG. 24 is not intended to limit terminal 2400 and may include more or fewer components than those shown, may combine some components, or may employ a different component arrangement.

[0192] An embodiment of the present application further provides a computer-readable storage medium having at least one computer program stored therein, the at least one computer program being loaded and executed by a processor to realize the operations performed in the image display method of the above embodiment.

[0193]

[0013] Embodiments of the present application further provide a computer program product, including a computer program, which, when loaded and executed by a processor, performs operations performed in the image display method as in the above embodiments. In some embodiments, the computer program according to the embodiments of the present application may be arranged to be executed in a single computer device, or in multiple computer devices located in a single location, or in multiple computer devices interconnected via a communication network distributed across multiple locations, and the multiple computer devices interconnected via a communication network distributed across multiple locations may constitute a blockchain system.

[0194] As can be understood by those skilled in the art, all or part of the steps of the above embodiments can be realized by hardware, or by instructing relevant hardware through a program. The program can be stored in a computer-readable storage medium, and the storage medium can be a read-only memory, a disk, an optical disk, etc.

[0195] The above are only optional examples of the embodiments of the present application and are not intended to limit the embodiments of the present application. Any modifications, equivalent substitutions, improvements, etc. within the spirit and principles of the embodiments of the present application are included in the scope of the claims of the present invention. [Explanation of symbols]

[0196] 101 terminals 102 Server 501 steps 502 steps 503 steps 503 steps 504 steps 601 area 602 areas 603 area 604 area 901 Image display area 1201 steps 1202 steps 1203 steps 1204 steps 1204 steps 1205 steps 1301 Image display area 1311 sub-areas 1321 sub-areas 1331 sub-areas 1341 sub-areas 1501 steps 1503 steps 1504 steps 1701 steps 1703 steps 1704 steps 1801 Pathology sub-images 2201 Interface Display Module 2202 Image Acquisition Module 2203 Sub-image determination module 2204 Sub-image display module 2205 Magnified Display Module 2213 Identification Unit 2214 1st display unit 2215 First Expansion Unit 2223 Cutting unit 2224 Second display unit 2225 Second Expansion Unit 2234 Third display unit 2400 Front Camera Terminal 2401 processor 2402 memory 2403 Peripheral Device Interface 2404 Radio Frequency Circuits 2405 Display 2406 Camera Component 2407 Audio Circuit 2408 Power supply

Claims

1. displaying an object information interface including at least one object; acquiring a pathology image of a target object in response to a selection action on the target object in the object information interface; determining at least one pathology sub-image of the pathology image that belongs to a target type; Displaying at least one of the pathology sub-images belonging to the target type on the target information interface; In response to a selection action on the displayed first pathology sub-image, displaying the first pathology sub-image after enlarging the first pathology sub-image by a target number of times, and displaying image information corresponding to the first pathology sub-image in a first region within the enlarged first pathology sub-image; When a display time of the image information in the first area reaches a target time, the image information is displayed in a second area outside the enlarged first pathological sub-image. Including, the image information includes at least one of the target type to which the first pathological sub-image belongs or a reliability of the first pathological sub-image, the reliability of the first pathological sub-image indicating a degree of reliability that the first pathological sub-image belongs to the target type; 2. An image display method, wherein the size of the second region is smaller than the size of the first region.

2. Displaying at least one of the pathology sub-images belonging to the target type on the target information interface includes: Displaying at least one of the pathology sub-images belonging to the target type in an image display area of ​​the target information interface; or displaying the pathology image on the target information interface and displaying a frame of at least one of the pathology sub-images on the pathology image; 2. The image display method according to claim 1, further comprising:

3. Displaying at least one pathology sub-image belonging to the target type in an image display area of ​​the target information interface includes: displaying the plurality of pathological sub-images in sections according to differences in sub-types to which the plurality of pathological sub-images belong; 3. The method of claim 2, wherein the target type includes a plurality of subtypes.

4. Displaying at least one pathology sub-image belonging to the target type in an image display area of ​​the target information interface includes: Displaying the plurality of pathological sub-images in order of the number of cells contained in the plurality of pathological sub-images; or Displaying the plurality of pathology sub-images according to an order of the quality parameters of the plurality of pathology sub-images; or displaying the plurality of pathological sub-images in order of reliability of the plurality of pathological sub-images; Including, The image display method according to claim 2 , wherein the reliability of the pathological sub-image indicates a degree of reliability that the pathological sub-image belongs to the target type.

5. the target type includes a plurality of subtypes, and the number of pathological sub-images corresponding to any one of the subtypes in the image display area is equal to or less than a target number; The method further comprises: In response to an expansion operation for a first subtype, canceling the display of pathological sub-images belonging to other subtypes in the image display area and displaying each of the pathological sub-images belonging to the first subtype; 3. The image display method according to claim 2, further comprising:

6. Displaying the first pathology sub-image after enlarging it by a target number of times in response to a selection action on the displayed first pathology sub-image includes: In response to a touch action on the first pathology sub-image, displaying the first pathology sub-image after enlarging it by the target number of times; or an image marker corresponding to at least one of the pathology sub-images is further displayed on the target information interface, and the first pathology sub-image is displayed after being enlarged by the target number of times in response to a touch operation on the image marker corresponding to the first pathology sub-image; 2. The image display method according to claim 1, further comprising:

7. Displaying at least one of the pathology sub-images belonging to the target type on the target information interface includes: displaying at least one of the pathology sub-images belonging to the target type in the target information interface, and displaying a confidence marker for at least one of the pathology sub-images; Including, a confidence marker for the pathology sub-image indicates a confidence level for the pathology sub-image, the confidence level indicating a degree to which it is possible to trust that the pathology sub-image belongs to the target type; 2. The image display method according to claim 1.

8. Determining at least one pathology sub-image belonging to a target type among the pathology images includes: determining, from the pathology image, at least one pathology sub-image containing abnormal cells; determining from the pathology image at least one pathology sub-image in which cells contained therein belong to a target state, including a negative state or a positive state; determining from the pathology image at least one pathology sub-image whose quality parameters meet a target quality condition; 8. The image display method according to claim 1, further comprising at least one of the following:

9. Determining at least one pathology sub-image belonging to a target type among the pathology images includes: performing classification on the pathology image to obtain at least one piece of position information indicating an area in the pathology image that belongs to the target type; cutting out at least one region indicated by the position information from the pathology image, and determining the cut-out region as the pathology sub-image; 8. The image display method according to claim 1, further comprising:

10. The pathology image includes a liquid-based cytology pathology image or a histopathology pathology image.

8. The image display method according to claim 1, wherein the image is displayed in a plurality of rows.

11. an interface display module for displaying an object information interface including at least one object; an image acquisition module for acquiring a pathology image of a target object in response to a selection action on the target object in the object information interface; a sub-image determination module for determining at least one pathology sub-image belonging to a target type among the pathology images; a sub-image display module for displaying at least one of the pathology sub-images belonging to the target type on the target information interface; an enlargement display module for displaying the first pathology sub-image after being enlarged by a target number of times in response to a selection action on the displayed first pathology sub-image, and displaying image information corresponding to the first pathology sub-image in a first region within the enlarged first pathology sub-image; Including, the image information includes at least one of the target type to which the first pathological sub-image belongs or a reliability of the first pathological sub-image, the reliability of the first pathological sub-image indicating a degree of reliability that the first pathological sub-image belongs to the target type; the enlarged display module is further used to display the image information in a second area outside the enlarged first pathological sub-image when the display time of the image information in the first area reaches a target time; The image display device is characterized in that the size of the second region is smaller than the size of the first region.

12. a memory having at least one computer program stored therein; a processor that loads and executes the at least one computer program to realize the image display method according to any one of claims 1 to 7; Contains A terminal characterized by:

13. A computer-readable storage medium having stored thereon at least one computer program, The at least one computer program is loaded and executed by a processor to realize the image display method according to any one of claims 1 to 7. A computer-readable storage medium comprising:

14. A computer program comprising: The image display method according to any one of claims 1 to 7 is realized by loading and executing the computer program by a processor. A computer program characterized by:

Images