Image processing method and device
By extracting and processing medical image data and generating and presenting medical auxiliary information, the problem that doctors need to retrieve a large amount of information during the diagnosis process is solved, and diagnostic efficiency and accuracy are improved.
Patent Information
- Application Number
- CN202510124252.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-26
- Publication Date
- 2025-05-06
AI Technical Summary
In the prior art, doctors need to retrieve a large amount of examination information during the diagnosis process, resulting in low diagnostic efficiency, high operational burden and low diagnostic accuracy.
By extracting the medical image data transmitted by the preset target display device, positioning the target focus area and/or target focus object corresponding to the image processing event, matching the corresponding processing components, and generating medical auxiliary information related to the target focus area and/or target focus object using the processing model in the processing component, and transmitting it to the target display device for presentation.
It improves the diagnostic efficiency of doctors, provides more medical information, and enhances the accuracy and efficiency of diagnosis.
Smart Images
Figure CN119943295A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of medical image processing, and in particular to an image processing method and device. Background Art
[0002] At present, existing diseases are highly complex and require the combination of multiple examination information. Doctors need to retrieve a large amount of examination information during the diagnosis of patients, and then process and analyze it to obtain the final diagnosis result. Therefore, doctors have low diagnostic efficiency, heavy operation burden, and low diagnostic accuracy. Summary of the invention
[0003] In view of this, an embodiment of the present invention provides an image processing method and device, which can at least provide doctors with more medical information and effectively improve the diagnosis efficiency of doctors.
[0004] To achieve the above-mentioned purpose, according to one aspect of an embodiment of the present invention, there is provided an image processing method, comprising: extracting medical image data transmitted by a preset target display device, and in response to an image processing event for the medical image data, locating a target area of interest and / or a target object of interest corresponding to the image processing event; determining a display position of the target area of interest and / or the target object of interest, identifying an image area to which the display position belongs, and matching a corresponding processing component; calling the processing component, and using a processing model in the processing component to generate medical auxiliary information related to the target area of interest and / or the target object of interest; and transmitting the medical auxiliary information to the target display device and presenting it.
[0005] Optionally, locating the target area of interest and / or target object of interest corresponding to the image processing event includes: obtaining the user's image operation on medical image data, and determining that the image processing event is a trigger event for generating medical auxiliary information based on the category of the image operation; reading the location information of the image operation, and locating the target area of interest and / or target object of interest corresponding to the image processing event.
[0006] Optionally, before matching the corresponding processing component, the following is further included:
[0007] Obtain display data of the target area of interest and / or target object of interest, and determine whether the target area of interest and / or target object of interest are medical auxiliary information; if so, extract medical image data corresponding to the target area of interest and / or target object of interest from a local database; if not, generate a data request based on the display data and send it to a preset target image source to receive medical image data corresponding to the target area of interest and / or target object of interest.
[0008] Optionally, matching corresponding processing components includes:
[0009] Determine whether the display position belongs to a single image area; if so, match the corresponding processing component according to the image area; if not, split the target focus area and / or target focus object until the display positions of each sub-target focus area and / or target focus object belong to a single image area, and match the corresponding processing component according to the image area to which each sub-target focus area and / or target focus object belongs.
[0010] Optionally, matching corresponding processing components includes:
[0011] According to the image area to which the display position belongs, a corresponding processing component class is matched; the type of the target attention area and / or the target attention object is identified, and a processing component is determined in the processing component class.
[0012] Optionally, using the processing model in the processing component to generate medical auxiliary information related to the target region of interest and / or the target object of interest includes:
[0013] Acquire medical image data associated with the target area of interest and / or the target object of interest; match the corresponding processing model according to the scene to which the target area of interest and / or the target object of interest belongs, and use the processing model to calculate the associated medical image data to obtain corresponding medical auxiliary information.
[0014] Optionally, using the processing model in the processing component to generate medical auxiliary information related to the target region of interest and / or the target object of interest includes:
[0015] Obtain medical image data associated with the target area of interest and / or target object of interest, classify the associated medical image data into scenes, and calculate and sort the similarities of each scene; select a processing model, calculate the medical image data associated with each scene to obtain corresponding medical auxiliary information, and present the corresponding medical auxiliary information in sorted order.
[0016] Optionally, it also includes:
[0017] Obtain various display parameters of the medical auxiliary information, and determine the optimization models corresponding to the various display parameters respectively; based on the display data of the target area of interest and / or the target object of interest, use the various optimization models to adjust the values of the various display parameters.
[0018] Optionally, before transmitting the medical auxiliary information to a target display device and presenting it, the method further comprises:
[0019] According to the type of the medical auxiliary information, a corresponding processing component is mapped; the processing component class to which the processing component belongs is determined, and the display position of the medical auxiliary information is located in the image area corresponding to the processing component class.
[0020] Optionally, it also includes:
[0021] In response to mapping multiple processing components according to the type of the medical auxiliary information, determine whether the multiple processing components belong to the same processing component class; if so, locate the display position of the medical auxiliary information in the image area corresponding to the processing component class; otherwise, use the intersection position of the image areas of the multiple processing component classes as the display position of the medical auxiliary information.
[0022] To achieve the above object, according to another aspect of an embodiment of the present invention, there is provided an image processing apparatus, comprising: an acquisition module, configured to extract medical image data transmitted by a preset target display device, and in response to an image processing event for the medical image data, locate a target area of interest and / or a target object of interest corresponding to the image processing event;
[0023] A matching module, configured to determine the display position of the target focus area and / or the target focus object, identify the image area to which the display position belongs, and match the corresponding processing component;
[0024] A generating module is configured to call the processing component and generate medical auxiliary information related to the target region of interest and / or the target object of interest using the processing model in the processing component;
[0025] The display module is configured to transmit the medical auxiliary information to a target display device for presentation.
[0026] Optionally, the acquisition module locates the target attention area and / or target attention object corresponding to the image processing event, including:
[0027] Acquire the user's image operation on medical image data, and determine the image processing event as a trigger event for generating medical auxiliary information according to the category of the image operation; read the position information of the image operation, and locate the target area of interest and / or target object of interest corresponding to the image processing event.
[0028] Optionally, before the matching module matches the corresponding processing component, the method further includes:
[0029] Obtain display data of the target area of interest and / or target object of interest, and determine whether the target area of interest and / or target object of interest are medical auxiliary information; if so, extract medical image data corresponding to the target area of interest and / or target object of interest from a local database; if not, generate a data request based on the display data and send it to a preset target image source to receive medical image data corresponding to the target area of interest and / or target object of interest.
[0030] Optionally, the matching module matches the corresponding processing component, including:
[0031] Determine whether the display position belongs to a single image area; if so, match the corresponding processing component according to the image area; if not, split the target focus area and / or target focus object until the display positions of each sub-target focus area and / or target focus object belong to a single image area, and match the corresponding processing component according to the image area to which each sub-target focus area and / or target focus object belongs.
[0032] Optionally, the matching module matches the corresponding processing component, including:
[0033] According to the image area to which the display position belongs, a corresponding processing component class is matched; the type of the target attention area and / or the target attention object is identified, and a processing component is determined in the processing component class.
[0034] Optionally, the generating module generates medical auxiliary information related to the target region of interest and / or the target object of interest by using the processing model in the processing component, including:
[0035] Acquire medical image data associated with the target area of interest and / or the target object of interest; match the corresponding processing model according to the scene to which the target area of interest and / or the target object of interest belongs, and use the processing model to calculate the associated medical image data to obtain corresponding medical auxiliary information.
[0036] Optionally, the generating module generates medical auxiliary information related to the target region of interest and / or the target object of interest by using the processing model in the processing component, including:
[0037] Obtain medical image data associated with the target area of interest and / or target object of interest, classify the associated medical image data into scenes, and calculate and sort the similarities of each scene; select a processing model, calculate the medical image data associated with each scene to obtain corresponding medical auxiliary information, and present the corresponding medical auxiliary information in sorted order.
[0038] Optionally, the display module is further configured as:
[0039] Obtain various display parameters of the medical auxiliary information, and determine the optimization models corresponding to the various display parameters respectively; based on the display data of the target area of interest and / or the target object of interest, use the various optimization models to adjust the values of the various display parameters.
[0040] Optionally, before the display module transmits the medical auxiliary information to the target display device and presents it, the display module includes:
[0041] According to the type of the medical auxiliary information, a corresponding processing component is mapped; the processing component class to which the processing component belongs is determined, and the display position of the medical auxiliary information is located in the image area corresponding to the processing component class.
[0042] Optionally, the display module is further configured as:
[0043] In response to mapping multiple processing components according to the type of the medical auxiliary information, determine whether the multiple processing components belong to the same processing component class; if so, locate the display position of the medical auxiliary information in the image area corresponding to the processing component class; otherwise, use the intersection position of the image areas of the multiple processing component classes as the display position of the medical auxiliary information.
[0044] To achieve the above objective, according to another aspect of an embodiment of the present invention, an image processing device is provided.
[0045] The image processing device of an embodiment of the present invention includes: one or more processors, a memory, and one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the steps of any of the above-mentioned image processing methods.
[0046] To achieve the above objective, according to another aspect of an embodiment of the present invention, a computer-readable storage medium is provided, on which a computer program is stored, and the computer program is loaded by a processor to execute the steps of any of the above-mentioned image processing methods.
[0047] According to the solution provided by the present invention, one embodiment of the above invention has the following advantages or beneficial effects: it can solve the technical problems of low utilization rate of existing AI-assisted diagnosis, low diagnostic accuracy and efficiency, thereby improving the richness and utilization rate of medical image display information, and achieving accurate and efficient assisted diagnosis.
[0048] The further effects of the above-mentioned non-conventional optional manner will be described below in conjunction with the specific implementation manner. BRIEF DESCRIPTION OF THE DRAWINGS
[0049] The accompanying drawings are used to better understand the present invention and do not constitute an improper limitation of the present invention.
[0050] Figure 1 is a scene schematic diagram of an image processing method according to an embodiment of the present invention;
[0051] Figure 2 is a schematic diagram of the main flow of an image processing method according to an embodiment of the present invention;
[0052] Figure 3is a schematic diagram of an optional process of locating a target area of interest and / or a target object of interest according to an embodiment of the present invention;
[0053] Figure 4 is a schematic diagram of a flow chart of an optional matching processing component according to an embodiment of the present invention;
[0054] Figure 5 is a schematic diagram of an optional first process of generating medical auxiliary information according to an embodiment of the present invention;
[0055] Figure 6 is a schematic diagram of an optional second process of generating medical auxiliary information according to an embodiment of the present invention;
[0056] Figure 7 is a schematic diagram of an optional process of displaying medical auxiliary information according to an embodiment of the present invention;
[0057] Figure 8 is a schematic diagram of main modules of an image processing device according to an embodiment of the present invention;
[0058] Fig. 9 is an exemplary system architecture diagram to which embodiments of the present invention may be applied;
[0059] Fig.10 It is a schematic diagram of the structure of a computer system of a mobile device or a server suitable for implementing an embodiment of the present invention. DETAILED DESCRIPTION
[0060] The following is a description of exemplary embodiments of the present invention in conjunction with the accompanying drawings, including various details of the embodiments of the present invention to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for clarity and conciseness, the description of well-known functions and structures is omitted in the following description.
[0061] It should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned, and they should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.
[0062] In the absence of conflict, the embodiments and features of the embodiments of the present invention can be combined with each other. The acquisition, transmission, storage, use, and processing of data in the technical solution of the present invention are in compliance with the relevant provisions of national laws and regulations, and are used for legal and reasonable purposes, and are not shared, disclosed, or sold outside of these legal uses, and are subject to supervision and management by regulatory authorities.
[0063] In addition, the terms "first" and "second" are used only for descriptive purposes and cannot be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present invention, the meaning of "multiple" is two or more, unless otherwise clearly and specifically defined. In this application, the word "example" is used to mean "used as an example, illustration or description". Any embodiment described as "example" in this application is not necessarily interpreted as being more preferred or more advantageous than other embodiments. In order to enable any technician in the field to implement and use the present invention, the following description is given. In the following description, details are listed for the purpose of explanation. It should be understood that a person of ordinary skill in the art can recognize that the present invention can be implemented without using these specific details. In other examples, well-known structures and processes will not be elaborated in detail to avoid unnecessary details that make the description of the present invention obscure. Therefore, the present invention is not intended to be limited to the embodiments shown, but is consistent with the widest range of principles and features disclosed in this application.
[0064] See also Figure 1, which shows a scene schematic diagram of an image processing method provided by an embodiment of the present invention. In the embodiment of the present invention, the image interaction scene includes an image processing host 100, a target image source 200 and a target display device 300. The image processing method is applied to an image processing device, and the image processing device is arranged in the image processing host 100. The image processing host 100 is provided with one or more processors, memories, and one or more applications, wherein the one or more applications are stored in the memories and are configured to be executed by the processor to implement the image processing method. The image processing device 100 may also include a memory for storing medical auxiliary information and other data. For example, the image processing device may be an image processing system of an AI (artificial intelligence) black box, and a computer-readable storage medium corresponding to the image processing method is run in the image processing host 100 to execute the steps of the image processing method. The target image source 200 can be connected to the image processing host 100 and the target display device 300 for communication, and can scan the target object to obtain medical image data and transmit it to the medical scanning device in the target display device 300 for displaying the target medical image, or can scan the target object to obtain medical image data and transmit it to the image processing host 100. For example, the target image source 200 can be any imaging system such as computed tomography (CT), 4D ultrasound and magnetic resonance (MR), angiography scanning, DR scanning and ultrasound scanning, ultrasound host, etc. The target display device 300 can be connected to the image processing host 100 and the target image source 200 for communication, and can not only receive the display data of the image processing host 100 and the target image source 200, but also transmit the display data to the image processing host 100. For example, the target display device 300 can be any display device such as an ultrasound display, angiography display, etc.
[0065] Understandably, Figure 1 The image processing device in the image processing method scenario shown, or the devices included in the image processing device, does not constitute a limitation on the embodiments of the present invention, that is, the number and type of image processing devices included in the image processing method scenario, or the number and type of devices included in each device, do not affect the overall implementation of the technical solution in the embodiments of the present invention, and can be regarded as an equivalent replacement or derivative of the technical solution claimed for protection in the embodiments of the present invention. In addition, Figure 1 The application environment shown in is only one of the application scenarios related to the present application solution and does not constitute a limitation on the application scenario of the present application solution. Other application environments may also include Figure 1The more or fewer image processing devices shown, or the image processing network connection relationship, are not specifically limited here.
[0066] Based on the above-mentioned scenario of the image processing method, various embodiments of the image processing method disclosed in the present invention are proposed.
[0067] See also Figure 2 , which shows a main flow chart of an image processing method provided by an embodiment of the present invention, comprising the following steps:
[0068] S201: extracting medical image data transmitted by a preset target display device, and in response to an image processing event for the medical image data, locating a target area of interest and / or a target object of interest corresponding to the image processing event.
[0069] In an embodiment, the image processing host 100 extracts medical image data transmitted by the target display device 300, and the image processing host 100 responds to an image processing event for the medical image data to locate a target area of interest and / or a target object of interest corresponding to the image processing event, wherein the target object of interest is a physiological tissue or lesion tissue specified in the medical image data, and the target area of interest is a specific image area specified in the medical image data.
[0070] In a further embodiment, the user can trigger different image data events for the target area of interest and / or the target object of interest, and the specific implementation process of step S201 in the process of locating the target area of interest and / or the target object of interest corresponding to the image processing event includes: obtaining the user's image operation on the medical image data, determining the image processing event as a trigger event for generating medical auxiliary information according to the category of the image operation, and then reading the position information of the image operation, locating the target area of interest and / or the target object of interest corresponding to the image processing event. Example: The operation instructions for generating medical auxiliary information can be pre-configured, such as but not limited to double-clicking the image object, framing the image area, etc.
[0071] S202: Determine the display position of the target attention area and / or the target attention object, identify the image area to which the display position belongs, and match corresponding processing components.
[0072] In an embodiment, the image processing host 100 can pre-divide the image screen into regions, and configure corresponding processing components for different image regions. In a further embodiment, when matching the corresponding processing components in step S202, it can also be determined whether the display position belongs to a single image region. If so, the corresponding processing components are matched according to the image region. Otherwise, the target focus region and / or target focus object are split until the display positions of each sub-target focus region and / or target focus object obtained belong to a single image region, and the corresponding processing components are matched according to the image regions to which each sub-target focus region and / or target focus object belongs. In other words, the target focus region and / or target focus object may belong to a single image region, or may belong to at least two image regions, and each image region to which it belongs can match a processing component.
[0073] In a further embodiment, the processing components configured for the image area in step S202 can also be more flexible and rich to adapt to different business needs and expansions. The specific implementation process includes: matching the corresponding processing component class according to the image area to which the display position belongs, then identifying the type of the target focus area and / or the target focus object, and determining the processing component in the processing component class. It can be seen that in the embodiment, a processing component class is configured for the image area, and different processing components can be configured for different types of target focus areas and / or target focus objects in the processing component class. Of course, one or more processing components can also be configured for each type of target focus area and / or target focus object. In the example, when multiple processing components are matched for each type of target focus area and / or target focus object, the processing component can be automatically and intelligently recommended (for example, recommended and determined according to historical utilization sorting) or provided to the user for selection.
[0074] In a further embodiment, before executing the matching processing component, step S202 may also obtain display data of the target area of interest and / or the target object of interest, determine whether the target area of interest and / or the target object of interest is medical auxiliary information, and if so, extract the medical image data corresponding to the target area of interest and / or the target object of interest from the local database, and if not, generate a data request according to the display data and send it to the preset target image source to receive the medical image data corresponding to the target area of interest and / or the target object of interest. It can be seen that the target area of interest and / or the target object of interest may be the medical image data generated by the target image source 200, or may be the medical auxiliary information generated by the image processing host 100. When the target area of interest and / or the target object of interest is processed to generate medical auxiliary information, it is necessary to determine whether it is medical image data or medical auxiliary information, and then obtain the data for generating medical auxiliary information from different terminals.
[0075] S203: calling the processing component, and using the processing model in the processing component to generate medical auxiliary information related to the target region of interest and / or the target object of interest.
[0076] In an embodiment, the image processing host 100 calls the processing component and can generate medical auxiliary information related to the target region of interest and / or the target object of interest using the processing model.
[0077] In a further embodiment, the process of step S203 of using the processing model in the processing component to generate medical auxiliary information related to the target area of interest and / or the target object of interest can be to generate medical auxiliary information based on the scene to which the target area of interest and / or the target object of interest belongs. The specific implementation process includes: obtaining medical imaging data associated with the target area of interest and / or the target object of interest, and matching the corresponding processing model according to the scene to which the target area of interest and / or the target object of interest belongs, and then using the processing model to calculate the associated medical imaging data to obtain the corresponding medical auxiliary information.
[0078] In some further embodiments, the process of generating medical auxiliary information related to the target area of interest and / or the target object of interest by using the processing model in the processing component in step S203 may not be based on the scene of the target area of interest and / or the target object of interest or the target area of interest and / or the target object of interest does not have a clear belonging scene, then the specific implementation process includes: obtaining all medical image data associated with the target area of interest and / or the target object of interest, and then classifying all the associated medical image data into scenes, so as to obtain medical image data belonging to different scenes, and then calculating the similarity of each scene and sorting them, and the example can be but not limited to the similarity calculation using a multivariate linear regression model, a cosine similarity model, etc. according to the medical image data in the scene. Finally, step S203 can select the same or different processing models for each scene to calculate the associated medical image data to obtain the corresponding medical auxiliary information, so that the medical auxiliary information corresponding to each scene can be displayed and presented in the sorting order. For example: in response to the multi-dimensional display scene of the lesion, the medical image data in the scene can be generated according to different items using the processing model. As another example, in response to a functional presentation scenario, a structured report analysis may be performed on the medical imaging data in the scenario using a processing model.
[0079] It is worth noting that step S203 can optimize the display presentation of the generated medical auxiliary information. The specific implementation process includes: obtaining various display parameters of the medical auxiliary information, respectively determining the optimization models corresponding to each display parameter, and adjusting the values of each display parameter based on the display data of the target area of interest and / or the target object of interest using each optimization model. Example: calling the optimization model for processing the grayscale parameters, background exposure parameters, etc. in the display parameters, for example, calling the parameter value step adjustment model to optimize the grayscale parameter value and the background exposure parameter value, that is, selecting a value corresponding to a step data in the preset grayscale or background exposure step value to replace it with the display parameter. Of course, the intelligent adjustment model can also be called to adjust the display parameters according to the grayscale value or background exposure value of the key information in the current page.
[0080] S204: Transmitting the medical auxiliary information to a target display device and presenting it.
[0081] In an embodiment, the image processing host 100 transmits the medical auxiliary information to the target display device 300 so that the target display device 300 presents the medical auxiliary information. In a further embodiment, before the step S204 transmits the medical auxiliary information to the target display device and presents it, the display position of the medical auxiliary information on the target display device 300 can be determined, and the specific implementation process includes: mapping the corresponding processing component according to the type of the medical auxiliary information, and then determining the processing component class to which the processing component belongs, and locating the display position of the medical auxiliary information in the image area corresponding to the processing component class. It can be seen that this embodiment cleverly determines the display position by the processing component that the generated medical auxiliary information can map, and at the same time, the mapping relationship can be dynamically configured to make the display of the medical auxiliary information more flexible and meet higher requirements.
[0082] In a further embodiment, if the type of medical auxiliary information can be mapped to multiple processing components, then when determining the display position of the medical auxiliary information, multiple processing components can be mapped in response to the type of the medical auxiliary information, and it is determined whether the multiple processing components belong to the same processing component class. If so, the display position of the medical auxiliary information is located in the image area corresponding to the processing component class. Otherwise, the intersection of the image areas of multiple processing component classes is used as the display position of the medical auxiliary information.
[0083] See also Figure 3 , shows a schematic diagram of an optional process of locating a target area of interest and / or a target object of interest according to an embodiment of the present invention, comprising the following steps:
[0084] S301: extracting medical image data transmitted by a preset target display device.
[0085] S302: Responding to an image processing event for the medical image data.
[0086] S303: Acquire the image operation of the user on the medical image data, and determine, according to the category of the image operation, that the image processing event is a triggering event for generating medical auxiliary information.
[0087] S304: Read the position information of the image operation, and locate the target attention area and / or target attention object corresponding to the image processing event.
[0088] See also Figure 4 , shows a schematic flow chart of an optional matching processing component according to an embodiment of the present invention, comprising the following steps:
[0089] S401: Determine the display position of the target attention area and / or the target attention object.
[0090] S402: Identify the image area to which the display position belongs.
[0091] S403: Determine whether the display position belongs to a single image area, if yes, execute step S404, if no, execute step S405.
[0092] S404: According to the image area matching corresponding processing component class, execute step S406.
[0093] S405: Split the target focus area and / or target focus object until the display positions of each sub-target focus area and / or target focus object belong to a single image area, match the corresponding processing component class according to the image area to which each sub-target focus area and / or target focus object belongs, and execute step S406.
[0094] S406: Identify the type of the target concerned area and / or the target concerned object, and determine a processing component in the processing component class.
[0095] See also Figure 5 , shows a schematic diagram of an optional first process of generating medical auxiliary information according to an embodiment of the present invention, including the following steps:
[0096] S501: Calling the processing component to obtain medical image data associated with the target area of interest and / or the target object of interest.
[0097] S502: Determine the scene to which the target attention area and / or the target attention object belongs, and match the corresponding processing model.
[0098] S503: Utilize the processing model to calculate the associated medical image data to obtain corresponding medical auxiliary information.
[0099] See also Figure 6 , shows a schematic diagram of an optional second process of generating medical auxiliary information according to an embodiment of the present invention, including the following steps:
[0100] S601: Calling the processing component to obtain medical image data associated with the target area of interest and / or the target object of interest.
[0101] S602: Classify the associated medical image data into scenes, calculate the similarity of each scene and sort them.
[0102] S603: Select a processing model to calculate the medical image data associated with each scene to obtain corresponding medical auxiliary information.
[0103] S604: Acquire various display parameters of the medical auxiliary information, and respectively determine the optimization model corresponding to each display parameter.
[0104] S605: Based on the display data of the target attention area and / or the target attention object, adjust the values of various display parameters using various optimization models.
[0105] S606: Present corresponding medical auxiliary information in sorted order.
[0106] See also Figure 7 , shows a schematic diagram of an optional process of displaying medical auxiliary information according to an embodiment of the present invention, comprising the following steps:
[0107] S701: Map corresponding processing components according to the type of the medical auxiliary information.
[0108] S702: Determine whether the type of the medical auxiliary information maps multiple processing components, if so, execute step S703, if not, execute step S704.
[0109] S703: Determine whether the multiple processing components belong to the same processing component class, if yes, execute step S704, if no, execute step S705.
[0110] S704: Locate the display position of the medical auxiliary information in the image area corresponding to the processing component class, and execute step S706.
[0111] S705: Using the intersection position of the image areas of the multiple processing component classes as the display position of the medical auxiliary information, and executing step S706.
[0112] S706: Transmit the medical auxiliary information to the target display device to be presented at the display position.
[0113] See also Figure 8 , which shows a schematic diagram of main modules of an image processing device 800 provided by an embodiment of the present invention, including:
[0114] The acquisition module 801 is configured to extract medical image data transmitted by a preset target display device, and in response to an image processing event for the medical image data, locate a target area of interest and / or a target object of interest corresponding to the image processing event;
[0115] A matching module 802 is configured to determine the display position of the target focus area and / or the target focus object, identify the image area to which the display position belongs, and match the corresponding processing component;
[0116] A generating module 803 is configured to call the processing component and generate medical auxiliary information related to the target region of interest and / or the target object of interest using the processing model in the processing component;
[0117] The display module 804 is configured to transmit the medical auxiliary information to a target display device for presentation.
[0118] In the implementation device of the present invention, the acquisition module 801 locates the target attention area and / or target attention object corresponding to the image processing event, including:
[0119] Acquire the user's image operation on medical image data, and determine the image processing event as a trigger event for generating medical auxiliary information according to the category of the image operation; read the position information of the image operation, and locate the target area of interest and / or target object of interest corresponding to the image processing event.
[0120] In the implementation device of the present invention, before the matching module 802 matches the corresponding processing component, it also includes:
[0121] Obtain display data of the target area of interest and / or target object of interest, and determine whether the target area of interest and / or target object of interest are medical auxiliary information; if so, extract medical image data corresponding to the target area of interest and / or target object of interest from a local database; if not, generate a data request based on the display data and send it to a preset target image source to receive medical image data corresponding to the target area of interest and / or target object of interest.
[0122] In the implementation device of the present invention, the matching module 802 matches the corresponding processing components, including:
[0123] Determine whether the display position belongs to a single image area; if so, match the corresponding processing component according to the image area; if not, split the target focus area and / or target focus object until the display positions of each sub-target focus area and / or target focus object belong to a single image area, and match the corresponding processing component according to the image area to which each sub-target focus area and / or target focus object belongs.
[0124] In the implementation device of the present invention, the matching module 802 matches the corresponding processing components, including:
[0125] According to the image area to which the display position belongs, a corresponding processing component class is matched; the type of the target attention area and / or the target attention object is identified, and a processing component is determined in the processing component class.
[0126] In the implementation device of the present invention, the generating module 803 generates medical auxiliary information related to the target area of interest and / or the target object of interest using the processing model in the processing component, including:
[0127] Acquire medical image data associated with the target area of interest and / or the target object of interest; match the corresponding processing model according to the scene to which the target area of interest and / or the target object of interest belongs, and use the processing model to calculate the associated medical image data to obtain corresponding medical auxiliary information.
[0128] In the implementation device of the present invention, the generating module 803 generates medical auxiliary information related to the target area of interest and / or the target object of interest using the processing model in the processing component, including:
[0129] Obtain medical image data associated with the target area of interest and / or target object of interest, classify the associated medical image data into scenes, and calculate and sort the similarities of each scene; select a processing model, calculate the medical image data associated with each scene to obtain corresponding medical auxiliary information, and present the corresponding medical auxiliary information in sorted order.
[0130] In the implementation device of the present invention, the display module 804 is further configured as follows:
[0131] Obtain various display parameters of the medical auxiliary information, and determine the optimization models corresponding to the various display parameters respectively; based on the display data of the target area of interest and / or the target object of interest, use the various optimization models to adjust the values of the various display parameters.
[0132] In the implementation device of the present invention, before the display module 804 transmits the medical auxiliary information to the target display device and presents it, it includes:
[0133] According to the type of the medical auxiliary information, a corresponding processing component is mapped; the processing component class to which the processing component belongs is determined, and the display position of the medical auxiliary information is located in the image area corresponding to the processing component class.
[0134] In the implementation device of the present invention, the display module 804 is further configured as follows:
[0135] In response to mapping multiple processing components according to the type of the medical auxiliary information, determine whether the multiple processing components belong to the same processing component class; if so, locate the display position of the medical auxiliary information in the image area corresponding to the processing component class; otherwise, use the intersection position of the image areas of the multiple processing component classes as the display position of the medical auxiliary information.
[0136] In addition, the specific implementation content of the device described in the embodiment of the present invention has been described in detail in the method described above, so the repeated content will not be described again here.
[0137] Fig. 9 An exemplary system architecture 900 to which embodiments of the present invention may be applied is shown, including terminal devices 901 , 902 , 903 , a network 904 and a server 905 (only an example).
[0138] Terminal devices 901, 902, 903 can be various electronic devices with display screens and supporting web browsing, and various communication client applications are installed. Users can use terminal devices 901, 902, 903 to interact with server 905 through network 904 to receive or send messages, etc.
[0139] The network 904 is used to provide a medium for communication links between the terminal devices 901, 902, 903 and the server 905. The network 904 may include various connection types, such as wired, wireless communication links or optical fiber cables.
[0140] The server 905 may be a server that provides various services, such as a background management server that provides support for websites browsed by users using terminal devices 901, 902, and 903 (only as an example). The background management server may analyze and process the received information query request and other data, and feed back the processing results (such as target push information, product information - only as an example) to the terminal device. It should be noted that the method provided in the embodiment of the present invention is generally executed by the server 905, and accordingly, the device is generally set in the server 905.
[0141] It should be understood that Fig. 9 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to the implementation requirements.
[0142] Reference below Fig.10 , which shows a schematic diagram of the structure of a computer system 1000 of a terminal device suitable for implementing an embodiment of the present invention. Fig.10 The terminal device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.
[0143] like Fig.10 As shown, the computer system 1000 includes a central processing unit (CPU) 1001, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 1002 or a program loaded from a storage part 1008 into a random access memory (RAM) 1003. In the RAM 1003, various programs and data required for the operation of the system 1000 are also stored. The CPU 1001, the ROM 1002, and the RAM 1003 are connected to each other through a bus 1004. An input / output (I / O) interface 1005 is also connected to the bus 1004.
[0144] The following components are connected to the I / O interface 1005: an input section 1006 including a keyboard, a mouse, etc.; an output section 1007 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1008 including a hard disk, etc.; and a communication section 1009 including a network interface card such as a LAN card, a modem, etc. The communication section 1009 performs communication processing via a network such as the Internet. A drive 1010 is also connected to the I / O interface 1005 as needed. A removable medium 1011, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1010 as needed, so that a computer program read therefrom is installed into the storage section 1008 as needed.
[0145] In particular, according to the embodiments disclosed in the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present invention include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 1009, and / or installed from the removable medium 1011. When the computer program is executed by the central processing unit (CPU) 1001, the above-mentioned functions defined in the system of the present invention are executed.
[0146] It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.
[0147] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0148] The modules involved in the embodiments of the present invention may be implemented in software or hardware. The modules described may also be arranged in a processor, for example, it may be described as follows: a processor includes an acquisition module, a matching module, a generation module, and a display module. The names of these modules do not constitute a limitation on the modules themselves in some cases, for example, the generation module may also be described as a determination module or a processing module, etc.
[0149] As another aspect, the present invention further provides a computer-readable medium, which may be included in the device described in the above embodiment; or may exist independently without being assembled into the device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by a device, the device executes any of the above image processing methods.
[0150] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.
Claims
1. An image processing method, characterized in that: include: Extracting medical image data transmitted by a preset target display device, and locating a target area of interest and / or a target object of interest corresponding to an image processing event for the medical image data in response to the image processing event; Determine the display position of the target attention area and / or the target attention object, identify the image area to which the display position belongs, and match the corresponding processing component; Calling the processing component, and using the processing model in the processing component to generate medical auxiliary information related to the target area of interest and / or the target object of interest; The medical auxiliary information is transmitted to a target display device and presented.
2. The method according to claim 1, characterized in that Locating the target attention area and / or target attention object corresponding to the image processing event includes: Acquiring an image operation of a user on medical image data, and determining, according to a category of the image operation, that the image processing event is a triggering event for generating medical auxiliary information; The position information of the image operation is read to locate the target attention area and / or target attention object corresponding to the image processing event.
3. The method according to claim 1, characterized in that Before matching the corresponding processing component, it also includes: Acquire display data of the target area of interest and / or the target object of interest, and determine whether the target area of interest and / or the target object of interest are medical auxiliary information; If yes, extracting medical image data corresponding to the target area of interest and / or the target object of interest from the local database; If not, a data request is generated according to the display data and sent to a preset target image source to receive medical image data corresponding to the target area of interest and / or the target object of interest.
4. The method according to claim 1, characterized in that: Match the corresponding processing components, including: Determining whether the display position belongs to a single image area; If yes, matching the corresponding processing component according to the image area; Otherwise, split the target focus area and / or target focus object until the display positions of each sub-target focus area and / or target focus object belong to a single image area, and match the corresponding processing components according to the image area to which each sub-target focus area and / or target focus object belongs.
5. The method according to claim 1, characterized in that Match the corresponding processing components, including: Matching a corresponding processing component class according to the image area to which the display position belongs; A type of a target area of interest and / or a target object of interest is identified, and a processing component is determined within the processing component class.
6. The method according to claim 1, characterized in that Generating medical auxiliary information related to the target region of interest and / or the target object of interest using the processing model in the processing component includes: Acquiring medical imaging data associated with a target region of interest and / or a target object of interest; According to the scene to which the target area of interest and / or the target object of interest belongs, a corresponding processing model is matched, and the processing model is used to calculate the associated medical image data to obtain corresponding medical auxiliary information.
7. The method according to claim 1, characterized in that Generating medical auxiliary information related to the target region of interest and / or the target object of interest using the processing model in the processing component includes: Acquire medical image data associated with the target area of interest and / or the target object of interest, classify the associated medical image data by scene, and calculate and sort the similarity of each scene; A processing model is selected to calculate the medical image data associated with each scene to obtain the corresponding medical auxiliary information, so as to present the corresponding medical auxiliary information in a sorted order.
8. The method according to claim 6 or 7, characterized in that: Also includes: Acquire various display parameters of the medical auxiliary information, and respectively determine the optimization model corresponding to each display parameter; Based on the display data of the target region of interest and / or the target object of interest, the values of the display parameters are adjusted using the optimization models.
9. The method according to claim 1, characterized in that: Before transmitting the medical auxiliary information to the target display device and presenting it, the method includes: According to the type of the medical auxiliary information, mapping corresponding processing components; The processing component class to which the processing component belongs is determined, and a display position of the medical auxiliary information is located in an image area corresponding to the processing component class.
10. The method according to claim 9, characterized in that Also includes: In response to mapping a plurality of processing components according to the type of the medical auxiliary information, determining whether the plurality of processing components belong to the same processing component class; If so, locating the display position of the medical auxiliary information in the image area corresponding to the processing component class; Otherwise, the intersection position of the image areas of the multiple processing component classes is used as the display position of the medical auxiliary information.
11. An image processing device, characterized in that: include: An acquisition module is configured to extract medical image data transmitted by a preset target display device, and in response to an image processing event for the medical image data, locate a target area of interest and / or a target object of interest corresponding to the image processing event; A matching module, configured to determine the display position of the target focus area and / or the target focus object, identify the image area to which the display position belongs, and match the corresponding processing component; A generating module is configured to call the processing component and generate medical auxiliary information related to the target region of interest and / or the target object of interest using the processing model in the processing component; The display module is configured to transmit the medical auxiliary information to a target display device for presentation.
12. An image processing device, characterized in that: The image processing device comprises: one or more processors; Memory; and One or more application programs, wherein the one or more application programs are stored in the memory and configured to be executed by the processor to implement the steps of the image processing method according to any one of claims 1 to 10.
13. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps of the image processing method according to any one of claims 1 to 10.