Image interaction method, apparatus and device, and storage medium

Abstract

Provided in the present application are an image interaction method, apparatus and device, and a storage medium. The method in the present application comprises: extracting medical image data transmitted by a preset target image source; identifying a target region of interest and / or a target object of interest in the medical image data, and generating medical auxiliary information corresponding to the target region of interest and / or the target object of interest; and adjusting the medical image data on the basis of the medical auxiliary information, and displaying the adjusted medical image data and / or the medical auxiliary information in a target display region. By means of the technical solution of the present application, the information richness and interactivity during the presentation of a medical image can be improved, thereby improving the auxiliary diagnosis accuracy and the diagnosis efficiency.

Description

Image interaction method, device, equipment and storage medium

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on January 31, 2024, with application number 202410140713.1 and invention name “Image interaction method, device, equipment and storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of medical image processing technology, and in particular to an image interaction method, apparatus, device and storage medium. Background Art

[0003] Currently, with the rapid development of artificial intelligence technology, AI-assisted diagnosis has become an indispensable diagnostic tool in the doctor's diagnosis and treatment process. AI-assisted diagnosis can provide doctors with more medical information for reference, which can effectively improve the efficiency of doctors' diagnosis and treatment. However, existing diseases are relatively complex. When diagnosing patients, doctors need to combine multiple examination information to accurately diagnose patients. This means that doctors need to scan and view the scanned video images at the same time. However, if doctors need to obtain more medical information while viewing the images, they need to manually retrieve the relevant information, resulting in low auxiliary efficiency and increasing the operational burden on doctors to view the images, which may affect the accuracy and efficiency of doctors' diagnosis of patients. SUMMARY OF THE INVENTION

[0004] The embodiments of the present application provide an image interaction method, apparatus, device and storage medium, which aim to solve the technical problem in the prior art that medical scanning images require manual retrieval of associated information, resulting in low auxiliary diagnosis efficiency.

[0005] In one aspect, an embodiment of the present application provides an image interaction method, the image interaction method comprising the following steps:

[0006] Extracting medical imaging data transmitted by a preset target imaging source;

[0007] Identifying a target region of interest and / or a target object of interest in the medical image data, and generating medical auxiliary information corresponding to the target region of interest and / or the target object of interest;

[0008] The medical image data is adjusted based on the medical auxiliary information, and the adjusted medical image data and / or the medical auxiliary information is displayed in a target display area.

[0009] In a possible implementation of the present application, displaying the adjusted medical image data and / or the medical auxiliary information in the target display area includes:

[0010] transmitting the adjusted medical image data to the target display area, and displaying the adjusted medical image data in a first display area of ​​the target display area;

[0011] The medical auxiliary information is transmitted to a first display area in the target display area and / or a second display area in the target display area, and the medical auxiliary information is displayed in the first display area and / or the second display area.

[0012] In a possible implementation of the present application, displaying the auxiliary medical information in the first display area and / or the second display area includes:

[0013] Acquire auxiliary marking information in the medical auxiliary information, and display the auxiliary marking information in a superimposed manner on a target region of interest and / or target object of interest corresponding to the medical image data in the first display area;

[0014] And / or, obtaining auxiliary image information and auxiliary interactive controls in the medical auxiliary information, and displaying the auxiliary image information and the auxiliary interactive controls in the second display area.

[0015] In a possible implementation of the present application, displaying the auxiliary image information and the auxiliary interactive control in the second display area includes:

[0016] Determining a target interactive control to be displayed in the auxiliary interactive control according to the lesion type and lesion degree in the auxiliary image information;

[0017] In response to a control display event, the auxiliary image information and the target interactive control are displayed in the second display area.

[0018] In a possible implementation of the present application, after adjusting the medical image data based on the medical auxiliary information and displaying the adjusted medical image data and / or the medical auxiliary information in the target display area, the method further includes:

[0019] In response to an interactive operation triggered on the medical image data and / or the medical auxiliary information, obtaining an image interaction event corresponding to the medical image data and / or the medical auxiliary information;

[0020] The medical image data and / or the medical auxiliary information are adjusted based on the image interaction event to obtain a target interaction result.

[0021] In a possible implementation of the present application, adjusting the medical image data and / or the medical auxiliary information based on the image interaction event to obtain a target interaction result includes:

[0022] collecting selection operation information for each auxiliary interactive control in the medical auxiliary information, and determining a target interactive control in the auxiliary interactive controls based on selection position information in the selection operation information;

[0023] Determining an image interaction event based on the selection interaction type in the selection operation information and the target interaction control;

[0024] The medical image data and / or the medical auxiliary information are adjusted based on the image interaction event to obtain a target interaction result.

[0025] In a possible implementation of the present application, adjusting the medical image data and / or the medical auxiliary information based on the image interaction event to obtain a target interaction result includes:

[0026] If it is determined that the image interaction event is an image switching event, obtaining a target auxiliary image of the auxiliary image information in the second display area;

[0027] The target auxiliary image is projected onto the first display area for display based on the image type and target lesion information of the target auxiliary image to obtain an image switching result.

[0028] In a possible implementation of the present application, adjusting the medical image data and / or the medical auxiliary information based on the image interaction event to obtain a target interaction result includes:

[0029] If the image interaction event is a lesion analysis event, obtaining lesion information associated with the auxiliary image information in the second display area;

[0030] Performing lesion analysis based on the associated lesion information and the medical imaging data to obtain lesion analysis data of the target area of ​​interest and / or target object of interest;

[0031] The lesion analysis data is displayed in the first display area and / or the second display area to obtain a lesion analysis result.

[0032] In a possible implementation of the present application, identifying the target region of interest and / or target object of interest in the medical image data and generating medical auxiliary information corresponding to the target region of interest and / or target object of interest includes:

[0033] In response to an image processing event for the medical image data, locating a target area of ​​interest and / or a target object of interest corresponding to the image processing event;

[0034] Image processing is performed on the target area of ​​interest and / or the target object of interest to obtain medical auxiliary information corresponding to the target area of ​​interest and / or the target object of interest.

[0035] In another aspect, the present application provides an image interaction device, comprising:

[0036] An image acquisition module is configured to extract medical image data transmitted by a preset target image source;

[0037] an information extraction module configured to identify a target region of interest and / or a target object of interest in the medical image data, and generate medical auxiliary information corresponding to the target region of interest and / or the target object of interest;

[0038] The information display module is configured to adjust the medical image data based on the medical auxiliary information and display the adjusted medical image data and / or the medical auxiliary information in a target display area.

[0039] On the other hand, the present application also provides an image interaction device, the image interaction device comprising:

[0040] one or more processors;

[0041] Memory; and

[0042] One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the steps of the image interaction method.

[0043] On the other hand, the present application also provides a computer-readable storage medium having a computer program stored thereon, and the computer program is loaded by a processor to execute the steps in the image interaction method. Beneficial effects

[0044] In the present application, by responding to an image display event for medical image data, the medical image data transmitted by the target image source is extracted; the target area of ​​interest and / or target object of interest in the medical image data are identified, and medical auxiliary information corresponding to the target area of ​​interest and / or target object of interest is generated, and the medical auxiliary information includes auxiliary display information and auxiliary interactive controls; based on a preset projection module, the medical image data and the medical auxiliary information are projected onto a target display area for display. In the process of medical scanning, the area of ​​interest in the medical image data transmitted by the target image source is identified, the medical auxiliary information corresponding to the target area of ​​interest is extracted, and the auxiliary display information and auxiliary interactive controls in the medical auxiliary information are projected onto a target display area for display, and in response to an image interaction event triggered for the medical image data and / or medical auxiliary information, the medical image data and / or auxiliary display information are adjusted based on the image interaction event, thereby improving the richness and interactivity of the medical image display information, and thereby improving the accuracy and efficiency of auxiliary diagnosis. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] FIG1 is a schematic diagram of a scene of an image interaction method according to an embodiment of the present application;

[0046] FIG2 is a schematic flow chart of an embodiment of an image interaction method according to an embodiment of the present application;

[0047] FIG3 is a schematic diagram of a scenario of an embodiment of the image interaction method provided in the present application for displaying image data and medical auxiliary information;

[0048] FIG4 is a flow chart of an embodiment of image interaction in the image interaction method provided in an embodiment of the present application;

[0049] FIG5 is a flow chart of an embodiment of the image interaction method for performing lesion analysis interaction according to an embodiment of the present application;

[0050] FIG6 is a schematic structural diagram of an embodiment of an image interaction device provided in an embodiment of the present application;

[0051] FIG7 is a schematic structural diagram of an embodiment of an image interaction device provided in an embodiment of the present application. Modes for Carrying Out the Invention

[0052] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts are within the scope of protection of this application.

[0053] In the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present application. In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the said features. In the description of the present application, "multiple" means two or more, unless otherwise clearly and specifically defined.

[0054] In this application, the word "exemplary" is used to mean "serving as an example, illustration, or illustration." Any embodiment described in this application as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments. The following description is given to enable any person skilled in the art to implement and use the present application. In the following description, details are listed for the purpose of explanation. It should be understood that one of ordinary skill in the art can recognize that the present application can be implemented without using these specific details. In other instances, well-known structures and processes are not elaborated in detail to avoid obscuring the description of the present application with unnecessary details. Therefore, the present application is not intended to be limited to the embodiments shown, but is consistent with the widest scope consistent with the principles and features disclosed in this application.

[0055] Currently, with the rapid development of artificial intelligence technology, AI-assisted diagnosis has become an indispensable diagnostic tool in the doctor's diagnosis and treatment process. AI-assisted diagnosis can provide doctors with more medical information for reference, which can effectively improve the efficiency of doctors' diagnosis and treatment. However, existing diseases are relatively complex. When diagnosing patients, doctors need to combine multiple examination information to accurately diagnose patients. This means that doctors need to scan and view the scanned video images at the same time. However, if doctors need to obtain more medical information while viewing the images, they need to manually retrieve the relevant information, resulting in low auxiliary efficiency and increasing the operational burden on doctors to view the images, which may affect the accuracy and efficiency of doctors' diagnosis of patients.

[0056] Based on this, the present application proposes an image interaction method, device, equipment and computer-readable storage medium to solve the technical problem in the prior art that medical scanning images require manual retrieval of related information, resulting in low auxiliary diagnosis efficiency.

[0057] The image interaction method in the embodiment of the present application is applied to an image interaction device, and the image interaction device is arranged in the image interaction device. The image interaction device is provided with one or more processors, memories, and one or more applications, wherein the one or more applications are stored in the memories and are configured to be executed by the processor to implement the image interaction method; wherein the image interaction device can be an intelligent projection terminal, such as an intelligent projector, a virtual reality device, an augmented reality device, etc.; optionally, the image interaction device can also be an image interaction system that at least includes an intelligent projection device and an AI (artificial intelligence) black box.

[0058] As shown in Figure 1, Figure 1 is a schematic diagram of a scenario for the image interaction method according to an embodiment of the present application. The image interaction scenario according to the embodiment of the present application includes an image interaction device 100 (with an image interaction device integrated therein) and a target image source 200. A computer-readable storage medium corresponding to the image interaction method is running on the image interaction device 100 to execute the steps of the image interaction method. The target image source 200 is a medical scanning device that is communicatively connected to the image interaction device 100 and is capable of scanning a target object and displaying a target medical image on a designated display screen. For example, the target image source 200 can be any imaging system, such as computed tomography (CT), 4D ultrasound, magnetic resonance imaging (MR), angiography, DR scanning, and ultrasound scanning.

[0059] It can be understood that the image interaction equipment in the image interaction method scenario shown in Figure 1, or the devices included in the image interaction equipment, does not constitute a limitation on the embodiments of the present application, that is, the number of devices and types of devices of the image interaction equipment included in the scene of the image interaction method, or the number and types of devices included in each device do not affect the overall implementation of the technical solution in the embodiments of the present application, and can all be regarded as equivalent replacements or derivatives of the technical solution claimed to be protected in the embodiments of the present application.

[0060] In the embodiment of the present application, the image interaction device 100 is mainly used to: extract medical image data transmitted by a preset target image source; identify the target area of ​​interest and / or target object of interest in the medical image data, and generate medical auxiliary information corresponding to the target area of ​​interest and / or the target object of interest; adjust the medical image data based on the medical auxiliary information, and display the adjusted medical image data and / or the medical auxiliary information in the target display area.

[0061] The image interaction device 100 in the embodiment of the present application can be an independent smart projection terminal, such as a smart projector, a virtual reality device, an augmented reality device, etc., or it can be an image interaction system that at least includes a smart projection device and an AI (artificial intelligence) black box.

[0062] The embodiments of the present application provide an image interaction method, apparatus, device, and computer-readable storage medium, which are described in detail below.

[0063] Those skilled in the art will understand that the application environment shown in FIG1 is merely one of the application scenarios related to the present application solution, and does not constitute a limitation on the application scenario of the present application solution. Other application environments may also include more or fewer image interaction devices than shown in FIG1 , or image interaction network connection relationships. For example, FIG1 shows only one image interaction device, and it can be understood that the scenario of the image interaction method may also include one or more image interaction devices, which are not specifically limited here; the image interaction device 100 may also include a memory for storing medical auxiliary information and other data.

[0064] It should be noted that the scene diagram of the image interaction method shown in Figure 1 is only an example. The scene of the image interaction method described in the embodiment of the present application is to more clearly illustrate the technical solution of the embodiment of the present application, and does not constitute a limitation on the technical solution provided by the embodiment of the present application.

[0065] Based on the scenarios of the above-mentioned image interaction method, various embodiments of the image interaction method disclosed in this application are proposed.

[0066] As shown in FIG2 , FIG2 is a flow chart of an embodiment of an image interaction method according to an embodiment of the present application. The image interaction method includes the following steps 201 to 203:

[0067] 201. Extracting medical image data transmitted by a preset target image source;

[0068] The image interaction method in this embodiment is applied to image interaction devices. The type and number of image interaction devices are not specifically limited. That is, the image interaction device can be one or more intelligent projection terminals, such as intelligent projectors, virtual reality devices, augmented reality devices, etc. Optionally, the image interaction device can also be an image interaction system comprising at least an intelligent projection device and an AI (artificial intelligence) black box. For example, in one specific embodiment, the image interaction device includes an AI black box installed between a target image source and a preset display unit, and a projection module capable of projecting a display onto a target display area of ​​the preset display unit. The preset display unit can be the display device of the target image source, or a display area such as an independent display device, a canvas, or a screen. In an optional embodiment, the preset display unit can also be a wall area capable of being projected. The target image source can be any imaging system, such as computed tomography (CT), 4D ultrasound, magnetic resonance imaging (MR), angiography, DR scanning, and ultrasound scanning.

[0069] Specifically, during operation, the image interaction device responds to an image display event for medical image data, wherein the image display event is an operation event that drives the image interaction device to display medical auxiliary information of the medical image data, and performs image interaction based on the medical auxiliary information. Optionally, the triggering method of the image display event is not specifically limited here. For example, in an auxiliary diagnosis scenario, the user actively triggers an image display event for specified medical image data by clicking an image display button in the image interaction device. Optionally, the image display event can also be actively triggered by the image interaction device. For example, an automatic enhancement process is pre-set in the image interaction device, and when the image data transmitted by the target image source associated with the automatic enhancement process is received, the display enhancement request is actively triggered.

[0070] Specifically, after receiving an image display event, the image interaction device extracts the medical image data transmitted by the preset target image source. The medical image data can be a medical scan image to be displayed after the target image source scans the target object in real time, or it can be a medical scan image to be displayed stored in the target image source. The medical image data can be a medical scan image scanned and displayed on the target display screen by an imaging system such as CT (Computed Tomography), DSA (Digital Subtraction Angiography), DR (digital radiography), and ultrasound. The target object is a patient in a clinical scenario such as a doctor performing surgery or diagnosis.

[0071] Specifically, the AI ​​black box in the image interaction device can also be set between the target image source and the preset display unit. After obtaining the image display event, it intercepts the medical image data transmitted by the target image source.

[0072] 202. Identify a target region of interest and / or a target object of interest in the medical image data, and generate medical auxiliary information corresponding to the target region of interest and / or the target object of interest;

[0073] Specifically, after acquiring the medical image data transmitted by the target image source, the image interaction device further identifies the target region of interest and / or target object of interest in the medical image data and generates medical auxiliary information corresponding to the target region of interest and / or target object of interest. The medical auxiliary information is any one or more of auxiliary prompt information, associated medical images, enhanced medical information, and supplementary medical information corresponding to the target region of interest and / or target object of interest. The target object of interest is the physiological tissue or lesion tissue specified in the medical image data. The target region of interest is a specific image area specified in the medical image data.

[0074] Specifically, after acquiring the medical image data, the image interaction device further responds to an image processing event for the medical image data and locates the target area of ​​interest and / or target object of interest corresponding to the image processing event.

[0075] Specifically, the video interaction device parses the image processing event, obtains an image selection operation triggered by the user on the medical image data, reads the selection location information of the image selection operation, and locates the target area of ​​interest and / or target object of interest corresponding to the image processing event in the medical image data using the selection location information. The image selection operation can be an instruction for the user to select the medical image data within the display area of ​​the medical image data. Alternatively, the video selection operation can be an instruction for the user to select the medical image data within the display area of ​​a mobile terminal client in communication with the image interaction device.

[0076] Optionally, in other embodiments, the image processing event can also be automatically triggered by the image interaction device, that is, any one or more image recognition models among the lesion recognition model, medical information association table and medical reconstruction model are pre-set in the image interaction device, and the target area of ​​interest and / or target object of interest where lesions may exist in the medical image data are automatically located through the preset recognition strategy in the image recognition model.

[0077] Specifically, after locating the target area of ​​interest and / or target object of interest in the medical image data, the image interaction device also performs image processing on the target area of ​​interest and / or target object of interest to obtain medical auxiliary information of the target area of ​​interest and / or target object of interest.

[0078] Optionally, after locating the target area of ​​interest, the image interaction device performs image segmentation on the medical image data to obtain regional image data of the target area of ​​interest, and inputs the regional medical image data into the image recognition model, performs image processing on the regional medical image data through the image recognition model, and extracts medical auxiliary information of the target area of ​​interest.

[0079] Optionally, after locating the target object, the image interaction device performs image segmentation on the medical image data to obtain object image data of the target object, and performs object analysis on the object image data and historical object image data through the image recognition model to determine the lesion type and lesion change information of the target object, etc., and generate medical auxiliary information of the target object.

[0080] 203. Adjust the medical image data based on the medical auxiliary information, and display the adjusted medical image data and / or the medical auxiliary information in a target display area.

[0081] Specifically, after acquiring the medical image data and the medical auxiliary information corresponding to the target area of ​​interest and / or the target object of interest in the medical image data, the image interaction device also transmits the medical image data and / or the medical auxiliary information to the target display area for display. The image interaction device can project the medical auxiliary information and medical image data onto the target display area for display via a preset projection module. The preset projection module can be any one or more of a projector, a virtual reality device, an augmented reality device, and a hybrid display device. The target display area can be a display terminal such as a display device or a canvas device. Optionally, in other embodiments, the image interaction device can also transmit the medical auxiliary information and medical image data to the target display area for auxiliary enhanced display via a wired transmission link or a wireless transmission link (WiFi / 2.4G / NFC, etc.).

[0082] Specifically, after acquiring medical image data and medical auxiliary information, the image interaction device can also adjust the medical image information using the medical auxiliary information. For example, the medical auxiliary information can be used to highlight a designated area in the medical image data (e.g., mark a lesion, enlarge the image, and mark the outline), or the medical image data can be reconstructed using the medical auxiliary information. Adjusting the medical image information using the medical auxiliary information can be performed before displaying the medical image data, or in real time while the medical image data is displayed in the target display area.

[0083] Specifically, the image interaction device projects the processed medical image data into the target display area for display through a preset projection module, and / or projects the medical auxiliary information into the target display area for display, thereby enhancing the display information richness of the medical image data.

[0084] Optionally, in a specific embodiment, the image interaction device transmits the medical image data to the target display area, and displays the medical image data in the first display area of ​​the target display area. The transmission method may be to transmit the medical image data to the target display area for display via a wired communication link or a wireless communication link. Optionally, the transmission method may also be a screen projection transmission method, that is, projecting the medical image data onto the target display area for display via a preset projection module.

[0085] The medical auxiliary information is projected onto a first display area and / or a second display area of ​​the target display area based on a preset projection module, and the medical auxiliary information is displayed in the first display area and / or the second display area. The first display area is a main display area with a larger size in the target display area, and the second display area is an auxiliary display area with a smaller size than the first display area in the target display area.

[0086] Optionally, in a specific embodiment, displaying the medical auxiliary information in the first display area and / or the second display area includes: after the image interaction device obtains the medical auxiliary information, obtaining the auxiliary marking information in the medical auxiliary information, projecting the auxiliary marking information onto the target focus area and / or the corresponding area of ​​the target focus object corresponding to the medical image data in the first display area, and superimposing the auxiliary marking information on the target focus area and / or the corresponding area of ​​the target focus object corresponding to the medical image data in the first display area.

[0087] Optionally, in a specific embodiment, the image interaction device can also obtain auxiliary image information and auxiliary interaction controls in the medical auxiliary information, project the auxiliary image information and auxiliary interaction controls to a second display area in the target display area, and display the auxiliary image information and auxiliary interaction controls in the second display area according to a preset arrangement strategy.

[0088] Optionally, the image interaction device further displays different auxiliary interaction controls corresponding to different physiological tissues, physiological objects, and lesion severity in the auxiliary image information. That is, after acquiring the auxiliary image information, the image interaction device obtains the lesion type and lesion severity in the auxiliary image information and selects target interaction controls to be displayed in the auxiliary interaction controls based on the lesion type and lesion severity. Furthermore, during the display of the auxiliary image information and medical image data, the auxiliary image information and target interaction controls are displayed in the second display area in response to a control display event triggered by the user.

[0089] For example, in one specific embodiment, the image interaction device obtains the lesion type from the auxiliary image information and selects the corresponding target interaction control based on the lesion type. For example, if the lesion type is a breast nodule, the image interaction device determines the target interaction controls to be the image rotation interaction control, the measurement interaction component, and the image contrast component. If the lesion type is a vascular plaque, the image interaction device determines the target interaction controls to be the section display control (i.e., an interaction control for displaying a section image of the lesion vessel) and the mask rendering control.

[0090] For example, after selecting the corresponding target interaction control according to the lesion type, the image interaction device can further filter the target interaction controls in the auxiliary interaction controls according to the degree of the lesion. For example, when the lesion degree is mild, the marking interaction control is set as the target interaction control. If the lesion degree is severe, the size interaction control, measurement interaction control, sign display control and parameter display control are set as target interaction controls.

[0091] Specifically, after determining the target interactive control, the image interactive device responds to the user's specified interactive operation in the target display area, triggers a control display event based on the interactive operation, and displays the target interactive control in the second display area. Optionally, in other embodiments, the image interactive device can also overlay the target interactive control on the medical image data.

[0092] Optionally, as shown in FIG3 , FIG3 is a scene diagram of an embodiment of the image interaction method provided in the embodiment of the present application for displaying image data and medical auxiliary information. Optionally, in the image interaction scene shown in FIG3 , the target display area includes a first display area set in the main display area of ​​the target display area (the display area with a larger size on the left) and a second display area other than the first display area. The image interaction device displays the medical image data in the first display area, and projects the auxiliary marking information in the medical auxiliary information onto the target focus area and / or the associated area of ​​the target focus object in the first display area for superimposed display, projects the auxiliary image information in the medical auxiliary information onto the auxiliary image area in the second display area for display (the display area on the right side of the first display area), and displays the auxiliary interaction controls in the medical auxiliary information on the control display area of ​​the second display area (the lower display area of ​​the first display area) according to the specified arrangement method.

[0093] Optionally, in other embodiments, the first and second display areas of the target display area can also be customized based on actual application scenarios. For example, in other embodiments, the target display area can be symmetrically divided into the first and second display areas, with the display area to the left (upper) of the target display area set as the first display area and the display area to the right (lower) of the target display area set as the second display area.

[0094] Specifically, after transmitting the medical imaging data and / or medical auxiliary information to the target display area for display, the image interaction device also responds to the interactive operation triggered by the user through the medical imaging data and / or medical auxiliary information, and adjusts the medical imaging data or medical auxiliary information according to the interactive operation, thereby adjusting the display effect of the medical imaging data and / or medical auxiliary information.

[0095] In this embodiment, the image interaction device extracts the medical image data transmitted by the target image source by responding to an image display event for the medical image data; identifies the target area of ​​interest and / or target object of interest in the medical image data, and generates medical auxiliary information corresponding to the target area of ​​interest and / or target object of interest, wherein the medical auxiliary information includes auxiliary display information and auxiliary interaction controls; and projects the medical image data and the medical auxiliary information onto a target display area for display based on a preset projection module. During a medical scan, the device identifies the area of ​​interest in the medical image data transmitted by the target image source, extracts the medical auxiliary information corresponding to the target area of ​​interest, and projects the auxiliary display information and auxiliary interaction controls in the medical auxiliary information onto a target display area for display. Furthermore, the device responds to an image interaction event triggered for the medical image data and / or medical auxiliary information, and adjusts the medical image data and / or auxiliary display information based on the image interaction event, thereby improving the richness and interactivity of the medical image display information, and thereby improving the accuracy and efficiency of auxiliary diagnosis.

[0096] As shown in FIG4 , FIG4 is a flow chart of an embodiment of image interaction in the image interaction method provided in an embodiment of the present application. Specifically, in this embodiment, the image interaction method further includes steps 301 to 302:

[0097] 301. Responding to an interactive operation triggered on the medical image data and / or the medical auxiliary information, obtaining an image interaction event corresponding to the medical image data and / or the medical auxiliary information;

[0098] 302. Adjust the medical image data and / or the medical auxiliary information based on the image interaction event, and display the adjusted target interaction result in the target display area.

[0099] Based on the above embodiments, in this embodiment, after the image interaction device transmits the medical imaging data and / or medical auxiliary information to the target display area for display, it also responds to the interactive operation triggered by the user through the medical imaging data and / or medical auxiliary information, and adjusts the medical imaging data or medical auxiliary information according to the interactive operation.

[0100] Specifically, the image interaction device can collect interactive operations triggered by the user on medical imaging data and / or medical auxiliary information by means of a shooting module or reading interactive information of a touch screen. For example, the interactive operation can be an interactive operation of selecting medical imaging data and triggering an interactive operation on a specific auxiliary interactive control by the user through a target interaction method. The image interaction device determines the image interaction event corresponding to the medical imaging data and / or medical auxiliary information through the interactive operation, and adjusts the medical imaging data and / or medical auxiliary information based on the image interaction event, and synchronously displays the adjusted target interaction result in the target display area. Among them, the target interaction method can be the control operation of a controller such as a keyboard, mouse, stylus, and any one or more of gesture interaction operations and touch screen interaction operations.

[0101] Optionally, in a specific embodiment, user-triggered interactive operations on medical imaging data and / or medical auxiliary information may include dragging, dropping, clicking (single / double-click / long press), and sliding. Image interaction events may include any one or more of the following: lesion re-examination events, image adjustment events, image supplementation events, lesion analysis events, and image switching events. In other words, users can trigger specific image interaction events by interacting with medical imaging data or projected medical auxiliary information.

[0102] The lesion supplementary inspection event is an operation event that requests the terminal to perform supplementary inspection on the target area of ​​interest and / or target object of interest.

[0103] The image adjustment event is an operation event that requests the terminal to adjust the size and / or angle of medical image data.

[0104] The image supplement event is an operation event for requesting the terminal to project an associated supplementary image associated with the target area of ​​interest and / or the target object of interest.

[0105] The lesion analysis event is an operation event that requests the terminal to perform fusion calculation on the target area of ​​interest and / or the target object of interest based on the medical auxiliary information.

[0106] The image switching event is an operation event that requests the terminal to switch and display the medical image data and the auxiliary medical image.

[0107] Optionally, in a specific embodiment, the image interaction device can collect the user's selection operation information for the auxiliary interaction control projected onto the target display area, and obtain the selection position information in the selection operation information, and determine the target interaction control in the auxiliary interaction control through the selection position information.

[0108] After determining the target interaction control, the image interaction device further determines an image interaction event based on the selection interaction type of the selection operation information and the target interaction control, and adjusts the medical image data and / or auxiliary display information through the image interaction event to obtain a target interaction result. The selection interaction type includes a first selection interaction type and a second selection interaction type. The first selection interaction type is an interaction type that adjusts the target interaction control. For example, a user triggers a control adjustment interaction type for the target interaction control itself by long pressing the target interaction control (for example, changing the control layout and control size of the target interaction control). The second selection interaction type is an interaction type that triggers the image interaction event pointed to by the target interaction control. That is, if the selection interaction type is the first selection interaction type, the image interaction event is determined to be a control adjustment event for the target interaction control and associated controls. The projection position and / or control size of the target interaction event are adjusted based on the control adjustment event to obtain the adjusted target interaction control. If the selection interaction type is the second selection interaction type, the image interaction event corresponding to the target interaction control is triggered to adjust the medical image data.

[0109] Optionally, in a specific embodiment, after the image interaction device collects the interactive operations triggered by the user on the medical imaging data and / or medical auxiliary information and determines that the image interaction event is an image switching event, it reads the target auxiliary image in the auxiliary image information in the second display area, wherein the target auxiliary image is an auxiliary image associated with the target object of interest or target area of ​​interest in the medical imaging data selected by the image switching event.

[0110] Specifically, after obtaining the target auxiliary image, the image interaction device also obtains the image type and target lesion information of the target medical image, and renders the target auxiliary image according to the image type and target lesion information, projects the rendered target auxiliary image to the first display area for display, switches the medical image data to the second display area for display, and obtains the image switching result.

[0111] In this embodiment, the image interaction device responds to interactive operations triggered on the medical image data and / or the medical auxiliary information to obtain image interaction events corresponding to the medical image data and / or the medical auxiliary information; adjusts the medical image data and / or the medical auxiliary information based on the image interaction events, and displays the adjusted target interaction results in the target display area. This enables interactive operations on the medical image data and medical auxiliary information, improves the richness and interactivity of the auxiliary information in the medical image display process, and enhances the efficiency of medical image observation.

[0112] As shown in FIG5 , FIG5 is a flow chart of an embodiment of the image interaction method for lesion analysis interaction provided in an embodiment of the present application. Specifically, in this embodiment, the image interaction method further includes steps 401 to 403:

[0113] 401. If the image interaction event is a lesion analysis event, obtain lesion information associated with the auxiliary image information in the second display area;

[0114] 402. Perform lesion analysis based on the associated lesion information and the medical image data to obtain lesion analysis data of the target area of ​​interest and / or target object of interest;

[0115] 403. Display the lesion analysis data in the first display area and / or the second display area to obtain a lesion analysis result.

[0116] Based on the above embodiments, in this embodiment, after the image interaction device transmits the medical imaging data and / or medical auxiliary information to the target display area for display, it also responds to the interactive operation triggered by the user through the medical imaging data and / or medical auxiliary information, and adjusts the medical imaging data or medical auxiliary information according to the interactive operation.

[0117] Specifically, if the image interaction device collects a user's interactive operation on medical image data and / or medical auxiliary information by capturing the image through a capture module or reading interactive information on a touch screen, and determines that the image interaction event corresponding to the interactive operation is a lesion analysis event for a target area of ​​interest and / or a target object of interest, the image interaction device obtains associated lesion information from the auxiliary image information in the second display area. The associated lesion information is historical lesion images or analysis information of historical lesion images associated with the target area of ​​interest and / or the target object of interest.

[0118] Specifically, after acquiring the associated lesion information, the image interaction device performs lesion analysis based on the associated lesion information and the medical image data to obtain lesion analysis data of the target area of ​​interest and / or target object of interest.

[0119] Optionally, in a specific embodiment, a lesion analysis model for performing lesion analysis on medical imaging data is pre-set in the image interaction device. After obtaining the associated lesion information, the associated lesion information and the medical imaging data are input into the lesion analysis model for joint analysis to obtain the lesion analysis data of the target area of ​​interest and / or target object of interest.

[0120] Specifically, after acquiring the lesion analysis data, the image interaction device displays the lesion analysis data in the first display area and / or the second display area to obtain the lesion analysis result.

[0121] Optionally, in other embodiments, after acquiring the lesion analysis data, the image interaction device also highlights the target area of ​​interest and / or target object of interest in the medical image data through the lesion analysis data to obtain rendered medical image data, and projects the rendered medical image data to the first display area, and displays the lesion analysis data in the first display area and / or the second display area to obtain the lesion analysis results.

[0122] In this embodiment, the image interaction device determines that the image interaction event is a lesion analysis event, obtains lesion information associated with the auxiliary image information in the second display area, performs lesion analysis based on the associated lesion information and the medical image data, and obtains lesion analysis data for the target area of ​​interest and / or target object of interest; and displays the lesion analysis data in the first display area and / or the second display area to obtain a lesion analysis result. This implements interactive lesion analysis operations for medical image data and medical auxiliary information, improves the richness and interactivity of auxiliary information during medical image display, and enhances the efficiency of medical image observation.

[0123] In order to better implement the image interaction method in the embodiment of the present application, based on the image interaction method, the embodiment of the present application further provides an image interaction device, as shown in FIG6 . FIG6 is a structural diagram of the image interaction device provided in the embodiment of the present application. Specifically, the image interaction device 500 includes:

[0124] The image acquisition module 501 is configured to extract medical image data transmitted by a preset target image source;

[0125] An information extraction module 502 is configured to identify a target region of interest and / or a target object of interest in the medical image data, and generate medical auxiliary information corresponding to the target region of interest and / or the target object of interest;

[0126] The information display module 503 is configured to adjust the medical image data based on the medical auxiliary information, and display the adjusted medical image data and / or the medical auxiliary information in a target display area.

[0127] In a possible implementation of this embodiment, the image interaction device displays the adjusted medical image data and / or the medical auxiliary information in the target display area, including:

[0128] transmitting the adjusted medical image data to the target display area, and displaying the adjusted medical image data in a first display area of ​​the target display area;

[0129] The medical auxiliary information is transmitted to a first display area in the target display area and / or a second display area in the target display area, and the medical auxiliary information is displayed in the first display area and / or the second display area.

[0130] In a possible implementation of this embodiment, the image interaction device displays the medical auxiliary information in the first display area and / or the second display area, including:

[0131] Acquire auxiliary marking information in the medical auxiliary information, and display the auxiliary marking information in a superimposed manner on a target region of interest and / or target object of interest corresponding to the medical image data in the first display area;

[0132] And / or, obtaining auxiliary image information and auxiliary interactive controls in the medical auxiliary information, and displaying the auxiliary image information and the auxiliary interactive controls in the second display area.

[0133] In a possible implementation of this embodiment, the image interaction device displays the auxiliary image information and the auxiliary interaction control in the second display area, including:

[0134] Determining a target interactive control to be displayed in the auxiliary interactive control according to the lesion type and lesion degree in the auxiliary image information;

[0135] In response to a control display event, the auxiliary image information and the target interactive control are displayed in the second display area.

[0136] In a possible implementation of this embodiment, the image interaction device adjusts the medical image data based on the medical auxiliary information, and after displaying the adjusted medical image data and / or the medical auxiliary information in the target display area, further includes:

[0137] In response to an interactive operation triggered on the medical image data and / or the medical auxiliary information, obtaining an image interaction event corresponding to the medical image data and / or the medical auxiliary information;

[0138] The medical image data and / or the medical auxiliary information are adjusted based on the image interaction event, and the adjusted target interaction result is displayed in the target display area.

[0139] In a possible implementation of this embodiment, the image interaction device adjusts the medical image data and / or the medical auxiliary information based on the image interaction event to obtain a target interaction result, including:

[0140] collecting selection operation information for each auxiliary interactive control in the medical auxiliary information, and determining a target interactive control in the auxiliary interactive controls based on selection position information in the selection operation information;

[0141] Determining an image interaction event based on the selection interaction type in the selection operation information and the target interaction control;

[0142] The medical image data and / or the medical auxiliary information are adjusted based on the image interaction event to obtain a target interaction result.

[0143] In a possible implementation of this embodiment, the image interaction device adjusts the medical image data and / or the medical auxiliary information based on the image interaction event to obtain a target interaction result, including:

[0144] If it is determined that the image interaction event is an image switching event, obtaining a target auxiliary image of the auxiliary image information in the second display area;

[0145] The target auxiliary image is projected onto the first display area for display based on the image type and target lesion information of the target auxiliary image to obtain an image switching result.

[0146] In a possible implementation of this embodiment, the image interaction device adjusts the medical image data and / or the medical auxiliary information based on the image interaction event to obtain a target interaction result, including:

[0147] If the image interaction event is a lesion analysis event, obtaining lesion information associated with the auxiliary image information in the second display area;

[0148] Performing lesion analysis based on the associated lesion information and the medical imaging data to obtain lesion analysis data of the target area of ​​interest and / or target object of interest;

[0149] The lesion analysis data is displayed in the first display area and / or the second display area to obtain a lesion analysis result.

[0150] In a possible implementation of this embodiment, the image interaction device identifies the target region of interest and / or target object of interest in the medical image data, and generates medical auxiliary information corresponding to the target region of interest and / or target object of interest, including:

[0151] In response to an image processing event for the medical image data, locating a target area of ​​interest and / or a target object of interest corresponding to the image processing event;

[0152] Image processing is performed on the target area of ​​interest and / or the target object of interest to obtain medical auxiliary information corresponding to the target area of ​​interest and / or the target object of interest.

[0153] In this embodiment, the image interaction device extracts the medical image data transmitted by the target image source by responding to an image display event for the medical image data; identifies the target area of ​​interest and / or target object of interest in the medical image data, and generates medical auxiliary information corresponding to the target area of ​​interest and / or target object of interest, wherein the medical auxiliary information includes auxiliary display information and auxiliary interaction controls; and projects the medical image data and the medical auxiliary information onto a target display area for display based on a preset projection module. During a medical scan, the device identifies the area of ​​interest in the medical image data transmitted by the target image source, extracts the medical auxiliary information corresponding to the target area of ​​interest, and projects the auxiliary display information and auxiliary interaction controls in the medical auxiliary information onto a target display area for display. Furthermore, the device responds to an image interaction event triggered by the auxiliary interaction controls and adjusts the medical image data and / or auxiliary display information based on the image interaction event, thereby improving the richness and interactivity of the medical image display information, and thereby improving the accuracy and efficiency of auxiliary diagnosis.

[0154] An embodiment of the present application further provides an image interaction device, as shown in FIG7 , which is a schematic structural diagram of an embodiment of the image interaction device provided in an embodiment of the present application.

[0155] The image interaction device integrates any one of the image interaction devices provided in the embodiments of the present application, and the image interaction device includes:

[0156] one or more processors;

[0157] Memory; and

[0158] One or more applications, wherein the one or more applications are stored in the memory and configured so that the processor executes the steps of the image interaction method described in any of the above-mentioned image interaction method embodiments.

[0159] Specifically, the image interaction device may include one or more processing cores (processors 601), one or more computer-readable storage media (memory 602), a power supply 603, and an input unit 604. Those skilled in the art will appreciate that the image interaction device structure shown in FIG7 does not limit the image interaction device, and may include more or fewer components than shown, or combine certain components, or arrange the components differently. Among them:

[0160] The processor 601 is the control center of the image interaction device. It uses various interfaces and lines to connect the various parts of the entire image interaction device. By running or executing software programs and / or modules stored in the memory 602 and calling data stored in the memory 602, it performs various functions of the image interaction device and processes data, thereby monitoring the image interaction device as a whole. Optionally, the processor 601 may include one or more processing cores; preferably, the processor 601 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 601.

[0161] Memory 602 can be used to store software programs and modules. Processor 601 executes various functional applications and data processing by running the software programs and modules stored in memory 602. Memory 602 may primarily include a program storage area and a data storage area. The program storage area may store an operating system and at least one application required for a function (such as sound playback or image playback); the data storage area may store data generated based on the use of the video interaction device. Furthermore, memory 602 may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, memory 602 may also include a memory controller to provide processor 601 with access to memory 602.

[0162] The image interaction device also includes a power supply 603 for supplying power to various components. Preferably, the power supply 603 can be logically connected to the processor 601 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The power supply 603 can also include one or more DC or AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components.

[0163] The image interaction device may further include an input unit 604, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0164] Although not shown, the image interaction device may further include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 601 in the image interaction device will load the executable files corresponding to one or more application processes into the memory 602 according to the following instructions, and the processor 601 will run the application stored in the memory 602 to implement various functions as follows:

[0165] Extracting medical imaging data transmitted by a preset target imaging source;

[0166] Identifying a target region of interest and / or a target object of interest in the medical image data, and generating medical auxiliary information corresponding to the target region of interest and / or the target object of interest;

[0167] The medical image data is adjusted based on the medical auxiliary information, and the adjusted medical image data and / or the medical auxiliary information is displayed in a target display area.

[0168] To this end, embodiments of the present application provide a computer-readable storage medium, which may include a read-only memory (ROM), random access memory (RAM), a disk, or an optical disk. A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps of any of the image interaction methods provided in embodiments of the present application. For example, the computer program loaded by the processor may execute the following steps:

[0169] Extracting medical imaging data transmitted by a preset target imaging source;

[0170] Identifying a target region of interest and / or a target object of interest in the medical image data, and generating medical auxiliary information corresponding to the target region of interest and / or the target object of interest;

[0171] The medical image data is adjusted based on the medical auxiliary information, and the adjusted medical image data and / or the medical auxiliary information is displayed in a target display area.

[0172] In the above embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in a certain embodiment, please refer to the detailed description of other embodiments above and will not be repeated here.

[0173] In specific implementation, the above units or structures can be implemented as independent entities, or can be arbitrarily combined to implement as the same or several entities. The specific implementation of the above units or structures can refer to the previous method embodiments and will not be repeated here.

[0174] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.

[0175] The above is a detailed introduction to an image interaction method provided in an embodiment of the present application. Specific embodiments are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for technical personnel in this field, based on the ideas of the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. An image interaction method, wherein: The image interaction method includes: Extracting medical imaging data transmitted by a preset target imaging source; Identifying a target region of interest and / or a target object of interest in the medical image data, and generating medical auxiliary information corresponding to the target region of interest and / or the target object of interest; The medical image data is adjusted based on the medical auxiliary information, and the adjusted medical image data and / or the medical auxiliary information is displayed in a target display area.

2. The image interaction method according to claim 1, wherein: Displaying the adjusted medical image data and / or the medical auxiliary information in the target display area includes: transmitting the adjusted medical image data to the target display area, and displaying the adjusted medical image data in a first display area of the target display area; The medical auxiliary information is transmitted to a first display area in the target display area and / or a second display area in the target display area, and the medical auxiliary information is displayed in the first display area and / or the second display area.

3. The image interaction method according to claim 2, wherein: The displaying of the auxiliary medical information in the first display area and / or the second display area includes: Acquire auxiliary marking information in the medical auxiliary information, and display the auxiliary marking information in a superimposed manner on a target region of interest and / or target object of interest corresponding to the medical image data in the first display area; And / or, obtaining auxiliary image information and auxiliary interactive controls in the medical auxiliary information, and displaying the auxiliary image information and the auxiliary interactive controls in the second display area.

4. The image interaction method according to claim 3, wherein: The displaying of the auxiliary image information and the auxiliary interactive control in the second display area includes: Determining a target interactive control to be displayed in the auxiliary interactive control according to the lesion type and lesion degree in the auxiliary image information; In response to a control display event, the auxiliary image information and the target interactive control are displayed in the second display area.

5. The image interaction method according to claim 1, wherein: After adjusting the medical image data based on the medical auxiliary information and displaying the adjusted medical image data and / or the medical auxiliary information in the target display area, the method further includes: In response to an interactive operation triggered on the medical image data and / or the medical auxiliary information, obtaining an image interaction event corresponding to the medical image data and / or the medical auxiliary information; The medical image data and / or the medical auxiliary information are adjusted based on the image interaction event, and the adjusted target interaction result is displayed in the target display area.

6. The image interaction method according to claim 5, wherein: The adjusting the medical image data and / or the medical auxiliary information based on the image interaction event to obtain a target interaction result includes: collecting selection operation information for each auxiliary interactive control in the medical auxiliary information, and determining a target interactive control in the auxiliary interactive controls based on selection position information in the selection operation information; Determining an image interaction event based on the selection interaction type in the selection operation information and the target interaction control; The medical image data and / or the medical auxiliary information are adjusted based on the image interaction event to obtain a target interaction result.

7. The image interaction method according to claim 5, wherein: The adjusting the medical image data and / or the medical auxiliary information based on the image interaction event to obtain a target interaction result includes: If it is determined that the image interaction event is an image switching event, obtaining a target auxiliary image of the auxiliary image information in the second display area; The target auxiliary image is projected onto the first display area for display based on the image type and target lesion information of the target auxiliary image to obtain an image switching result.

8. The image interaction method according to claim 5, wherein: The adjusting the medical image data and / or the medical auxiliary information based on the image interaction event to obtain a target interaction result includes: If the image interaction event is a lesion analysis event, obtaining lesion information associated with the auxiliary image information in the second display area; Performing lesion analysis based on the associated lesion information and the medical imaging data to obtain lesion analysis data of the target area of interest and / or target object of interest; The lesion analysis data is displayed in the first display area and / or the second display area to obtain a lesion analysis result.

9. The image interaction method according to claim 1, wherein: The identifying the target region of interest and / or target object of interest in the medical image data and generating medical auxiliary information corresponding to the target region of interest and / or target object of interest includes: In response to an image processing event for the medical image data, locating a target area of interest and / or a target object of interest corresponding to the image processing event; Image processing is performed on the target area of interest and / or the target object of interest to obtain medical auxiliary information corresponding to the target area of interest and / or the target object of interest.

10. An image interaction device, wherein: The image interaction device includes: An image acquisition module is configured to extract medical image data transmitted by a preset target image source; an information extraction module configured to identify a target region of interest and / or a target object of interest in the medical image data, and generate medical auxiliary information corresponding to the target region of interest and / or the target object of interest; The information display module is configured to adjust the medical image data based on the medical auxiliary information and display the adjusted medical image data and / or the medical auxiliary information in a target display area.

11. The image interaction device according to claim 10, wherein: The information display module is used for: transmitting the adjusted medical image data to the target display area, and displaying the adjusted medical image data in a first display area of the target display area; The medical auxiliary information is transmitted to a first display area in the target display area and / or a second display area in the target display area, and the medical auxiliary information is displayed in the first display area and / or the second display area.

12. The image interaction device according to claim 11, wherein: The information display module is used for: Acquire auxiliary marking information in the medical auxiliary information, and display the auxiliary marking information in a superimposed manner on a target region of interest and / or target object of interest corresponding to the medical image data in the first display area; And / or, obtaining auxiliary image information and auxiliary interactive controls in the medical auxiliary information, and displaying the auxiliary image information and the auxiliary interactive controls in the second display area.

13. The image interaction device according to claim 12, wherein: The information display module is used for: Determining a target interactive control to be displayed in the auxiliary interactive control according to the lesion type and lesion degree in the auxiliary image information; In response to a control display event, the auxiliary image information and the target interactive control are displayed in the second display area.

14. The image interaction device according to claim 10, wherein: The information display module is used for: In response to an interactive operation triggered on the medical image data and / or the medical auxiliary information, obtaining an image interaction event corresponding to the medical image data and / or the medical auxiliary information; The medical image data and / or the medical auxiliary information are adjusted based on the image interaction event, and the adjusted target interaction result is displayed in the target display area.

15. The image interaction device according to claim 14, wherein: The information display module is used for: collecting selection operation information for each auxiliary interactive control in the medical auxiliary information, and determining a target interactive control in the auxiliary interactive controls based on selection position information in the selection operation information; Determining an image interaction event based on the selection interaction type in the selection operation information and the target interaction control; The medical image data and / or the medical auxiliary information are adjusted based on the image interaction event to obtain a target interaction result.

16. The image interaction device according to claim 14, wherein: The information display module is used for: If it is determined that the image interaction event is an image switching event, obtaining a target auxiliary image of the auxiliary image information in the second display area; The target auxiliary image is projected onto the first display area for display based on the image type and target lesion information of the target auxiliary image to obtain an image switching result.

17. The image interaction device according to claim 14, wherein: The information display module is used for: If the image interaction event is a lesion analysis event, obtaining lesion information associated with the auxiliary image information in the second display area; Performing lesion analysis based on the associated lesion information and the medical imaging data to obtain lesion analysis data of the target area of interest and / or target object of interest; The lesion analysis data is displayed in the first display area and / or the second display area to obtain a lesion analysis result.

18. The image interaction device according to claim 10, wherein: The information extraction module is used to: In response to an image processing event for the medical image data, locating a target area of interest and / or a target object of interest corresponding to the image processing event; Image processing is performed on the target area of interest and / or the target object of interest to obtain medical auxiliary information corresponding to the target area of interest and / or the target object of interest.

19. An image interaction device, wherein: The image interaction device includes: one or more processors; Memory; and One or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the steps of the image interaction method according to any one of claims 1 to 9.

20. A computer-readable storage medium, wherein: A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps of the image interaction method according to any one of claims 1 to 9.

Images