Interaction method and system of medical image and medical report

Abstract

The invention discloses a medical image and medical report interaction method and system. The method comprises the following steps: displaying a medical image on a medical image display interface; displaying the medical report on a report display interface; in response to the operation of the user on the medical image, generating operation information containing the measurement data and the layer position data; the operation information is transmitted to a report display interface through a communication module; and in response to the operation of the user on the report display interface, establishing a link between the operation information and the medical image. A user can copy measurement data to a specified position of a medical report, and an operable mark linked to a corresponding layer position of a medical image is automatically generated. And triggering the mark to control the medical image display interface to jump to the position of the corresponding layer. The invention further provides a corresponding interaction system which comprises a report processing module, a medical image processing module and a communication module. According to the invention, efficient interaction between the medical image and the medical report is realized, and the medical diagnosis efficiency and accuracy are improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of medical image information processing, in particular to a medical image and medical report interaction method and system. BACKGROUND

[0002] With the rapid development of medical informatization, medical images and medical reports are two core elements of clinical diagnosis, and their collaborative work efficiency directly affects medical quality and diagnosis efficiency. Currently, hospitals generally use PACS (Picture Archiving and Communication System) for medical image storage, transmission and display, and use RIS (Radiology Information System) for medical report writing and management. However, these two systems usually operate independently and lack effective interaction mechanisms.

[0003] The prior art has the following problems: first, when a primary doctor uses a measurement tool to measure a lesion during PACS Viewer reading, the doctor needs to manually write the measurement information in the RIS medical report. This manual transcription method not only consumes time and effort, but also is prone to data transcription errors. Second, when an auditing doctor audits a medical report, the doctor needs to manually find the measurement location in hundreds of images to confirm the accuracy of the report, which greatly increases the auditing burden and time cost. Third, the existing system lacks a direct linking mechanism between medical images and medical reports. When a doctor sees a lesion point, the doctor cannot quickly locate the relevant description in the medical report, and vice versa, which seriously affects the doctor's work efficiency and diagnosis accuracy. SUMMARY

[0004] The technical problem to be solved by the present application is to provide a solution for the current problems that a primary doctor needs to manually write measurement information in a RIS medical report after using a measurement tool or positioning or framing an image during PACS Viewer reading, an auditing doctor needs to manually find a measurement location in a large number of images to confirm the accuracy of a report, or a doctor cannot accurately link a medical report content when seeing a lesion point.

[0005] The technical solution adopted by the present application to solve the technical problem is to provide a medical image measurement-based image-text linkage interaction method, comprising: displaying a medical image on a medical image display interface; displaying a medical report on a report display interface; generating operation information in response to user operation on the medical image; transmitting the operation information to the report display interface through a communication module; and establishing a link between the operation or operation information and the medical image in response to user operation on the report display interface.

[0006] Preferably, the operation of the user on the medical image comprises a measurement operation, and the operation information comprises measurement data, the measurement data comprising at least one of a distance, an area, a volume, or a CT value.

[0007] Further, the operation of the user on the report display interface comprises copying the measurement data to a designated position in the medical report.

[0008] Still further, the operation information further comprises layer position data of the medical image; and when the layer position data is copied to the medical report, a clickable marker linked to a corresponding layer position of the medical image is automatically generated.

[0009] Preferably, in response to a triggering operation on the clickable marker, a jump instruction is sent to the medical image display interface to control the medical image display interface to jump to the corresponding layer position.

[0010] Optionally, when the display style of the clickable marker is edited, the link between the clickable marker and the layer position data is removed.

[0011] Further, the operation information comprises position or region data labeled by the user on the medical image; and in response to an operation of selecting a text and implanting a link on the report display interface, a link between the text and the position or region data is established.

[0012] Preferably, in response to an operation of triggering the text link, a positioning instruction is sent to the medical image display interface to highlight the corresponding position or region on the medical image display interface.

[0013] Still further, the communication module is implemented by an independent communication client, and the medical image display interface and the report display interface are respectively connected to the communication client in a bidirectional communication manner.

[0014] The application further provides an interactive system of medical images and medical reports, characterized in that the system comprises: a report processing module configured to display a medical report; a medical image processing module configured to display a medical image; and a communication module configured to establish bidirectional communication links with the report processing module and the medical image processing module respectively; wherein the system is configured to: in response to an operation of a user on the medical image processing module, generate operation information and transmit the operation information to the report processing module through the communication module; and in response to an operation of the user on the report processing module, establish a link between the operation or the operation information and the medical image.

[0015] Further, the report processing module is an RIS client; the medical image processing module is a medical image browser client; and the communication module is an independently deployed communication middleware.

[0016] Preferably, the communication module comprises: a message forwarding unit for transmitting operation information across modules; and a link management unit for maintaining the association between the medical image and the medical report.

[0017] The present application has the advantages that: by establishing a communication connection between the medical image display interface and the medical report display interface, the automatic copying and pasting function of measurement information is realized, the doctor does not need to manually write the measurement result, and the work efficiency is greatly improved; by embedding an operable link marker in the medical report, clicking can automatically locate to the corresponding medical image layer and measurement position, so that the reviewing doctor does not need to manually find the measurement position, and the reviewing burden is significantly reduced; by establishing a bidirectional link relationship between the medical report text and the medical image area, the linkage of text and image is realized, so that the doctor can accurately link to the related content in the medical report when seeing the lesion point, and the diagnosis and review efficiency is improved. Compared with the prior art, the present application not only simplifies the operation process of the doctor, but also improves the accuracy and efficiency of medical diagnosis through the linkage mechanism of text and image. BRIEF DESCRIPTION OF DRAWINGS

[0018] The accompanying drawings, which are included to provide a further understanding of the present application, form a part of the specification and are included to further explain the present application and, together with the description, serve to explain the present application. In the drawings:

[0019] Figure 1 A medical image and medical report interaction method flowchart in the present application;

[0020] Figure 2 A block diagram of a medical image and medical report interaction system in the present application. DETAILED DESCRIPTION

[0021] The technical solutions of the present application will be described below in conjunction with the embodiments and the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all the embodiments. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative work fall within the scope of the present application.

[0022] In one embodiment, as shown in Figure 1 The present application discloses a medical image and medical report interaction method, comprising: displaying a medical image 110 on a medical image display interface; displaying a medical report 120 on a report display interface; generating operation information 130 in response to user operation on the medical image; transmitting the operation information to the report display interface through a communication module 140; and establishing a link between the operation or operation information and the medical image in response to user operation on the report display interface 150.

[0023] Specifically, the medical image and medical report interaction method provided by the embodiment first loads and displays the patient's medical image data on the medical image display interface. The medical image can be image data generated by various medical imaging technologies such as CT (Computed Tomography), MRI (Magnetic Resonance Imaging), X-ray, ultrasound, etc. The medical image display interface usually includes image display area, toolbar, thumbnail navigation area and other functional areas for doctors to view and analyze medical images.

[0024] At the same time, the medical report related to the patient is displayed on the report display interface. The medical report usually includes patient basic information, clinical symptoms, examination findings, diagnosis opinions and other contents, and the report display interface provides text editing function to allow doctors to input, modify and save report content.

[0025] When the doctor operates on the medical image, the system will capture these operations and generate corresponding operation information. For example, the doctor may mark the lesion location on the image, measure the lesion size, adjust the window width and window level, etc. These operations will be recorded by the system and converted into structured operation information, including operation type, operation parameter, operation position and other data.

[0026] The generated operation information is transmitted to the report display interface through the communication module. The communication module is responsible for establishing a data channel between the medical image display interface and the report display interface to ensure that the operation information can be transmitted from the image interface to the report interface in real time and accurately. The communication module can be implemented by various technologies such as WebSocket, HTTP request, inter-process communication, etc.

[0027] When the operation information is transmitted to the report display interface, the doctor can operate on the report interface to link the image operation information with the medical report. For example, the doctor can choose to insert the measurement result into a specific position of the report, or associate the marked lesion location with the description text in the report. After such link is established, the relevant content in the report forms a correlation relationship with the specific area in the medical image or the operation result.

[0028] In this embodiment, the user's operations on the medical image include measurement operations, and the operation information includes measurement data, which includes at least one of distance, area, volume, or CT value. Specifically, the physician can use the measurement tools provided by the medical image display interface to perform various measurement operations on the image. For example, using a straight-line measurement tool to measure the length or diameter of a lesion, using an area measurement tool to calculate the cross-sectional area of a lesion, using a volume measurement tool to estimate the three-dimensional volume of a lesion, or using a density measurement tool to obtain the CT value of a specific region (to represent tissue density). These measurement operations will generate corresponding measurement data. Distance measurement is usually in millimeters (mm) or centimeters (cm), area measurement is in square millimeters (mm²) or square centimeters (cm²), volume measurement is in cubic millimeters (mm³) or cubic centimeters (cm³), and CT value is in Hounsfield units (HU). The system will automatically calculate these measurement values and include them as part of the operation information. In addition to numerical results, measurement data also includes metadata such as measurement location information, measurement tool type, and measurement time, which together constitute complete measurement operation information.

[0029] In this embodiment, the user's operations on the report display interface include copying measurement data to a specified location in the medical report. Specifically, after the measurement data is transmitted to the report display interface through the communication module, the physician can select to insert these measurement data into a specific location in the report on the report interface. The report display interface can provide multiple ways to achieve this function: the physician can position the cursor in the report to the location where the measurement data needs to be inserted, and then copy the measurement data to that location through the right-click menu, shortcut button, or drag-and-drop operation. The report interface can display a list or panel of measurement data from which the physician can select the desired measurement data and then specify the insertion location. The report interface can provide pre-set report templates that contain fields or tables specifically designed for placing measurement data, and the physician only needs to select the corresponding measurement data to match the fields. When the measurement data is copied into the report, the system will automatically format these data to ensure that they are displayed in the report in a clear and consistent manner. For example, length measurement may be displayed as "Tumor maximum diameter: 32.5 mm", area measurement may be displayed as "Lesion area: 245.7 mm²", and CT value may be displayed as "Liver average density: 58 HU".

[0030] In this embodiment, the operation information also includes layer position data of the medical image; when copying the layer position data to the medical report, a clickable marker linked to the corresponding layer position of the medical image is automatically generated, such as the text of IM144 layer position. Specifically, in multi-layer medical images (such as CT or MRI sequences), each measurement or annotation is associated with a specific layer position. The layer position data usually includes sequence number, layer index, layer thickness, layer spacing, etc. These information can uniquely identify a specific position in the image. When the doctor operates on the medical image, the system not only records the measurement data, but also records the layer position data of the current operation. These layer position data, as part of the operation information, are transmitted to the report display interface together with the measurement data.

[0031] When the doctor copies the measurement data to the medical report, the system automatically associates the layer position data with it and generates a clickable marker in the report. This marker can be a special format of text, such as a text with a hyperlink, or an icon, which is visually distinguished from ordinary text, indicating that it is an interactive element.

[0032] The clickable marker contains link information pointing to a specific layer of the medical image, and this link is achieved by encoding the layer position data into the marker, such as IM144 which represents the layer position in the form of a hyperlink. The marker can also be displayed as "view image (sequence 2, layer 45)" or a simple combination of icon and text, such as a magnifying glass icon for tumor measurement (32.5mm)".

[0033] In this embodiment, in response to the triggering operation of the clickable marker, a jump instruction is sent to the medical image display interface to control the medical image display interface to jump to the corresponding layer position. Specifically, when the doctor or other medical personnel views the medical report, they can trigger the clickable marker in the report by clicking, double-clicking, or hovering, etc. This triggering operation is captured and processed by the report display interface. The report display interface will analyze the layer position data contained in the clickable marker, and then send a jump instruction to the medical image display interface through the communication module. The jump instruction contains detailed position information of the target layer, such as sequence number, layer index, etc. After receiving the jump instruction, the medical image display interface will automatically position to the layer position specified in the instruction. This includes selecting the correct image sequence, scrolling to the specific layer, and possibly adjusting the display parameters such as window width and window level to ensure that the relevant area is clearly visible. If the medical image display interface is not currently open or is not displaying the image of the relevant patient, the system may automatically open the image viewer and load the corresponding image data, and then perform the jump operation. After the jump is completed, the medical image display interface may highlight, flash or use other visual cues to mark the measurement or annotation associated with the clickable marker in the report, helping the doctor quickly locate the area of interest.

[0034] In this embodiment, when editing the display style of the actionable marker, the system disassociates the actionable marker from the layer position data. Specifically, actionable markers in medical reports often have specific display styles, such as special colors, fonts, underlines, or icons, to distinguish them from ordinary text and to prompt users of their interactivity. These styles are system defaults that identify valid linkages. When a physician or report editor modifies the display style of an actionable marker, for example, by changing its color, font, size, or removing the underline, the system interprets this editing action as an intervention in the linkage. To maintain data consistency and accuracy, the system automatically disassociates the actionable marker from the layer position data when it detects that the display style has been edited. This means that the marker will no longer be able to trigger the jump function of the medical image, and will become ordinary text content. The system may display a warning dialog before disassociating the link, reminding the user of the consequences of this operation and providing a cancellation option. It may also provide a function to restore the default style, allowing the user to re-establish the link when needed. The text after disassociation retains the original measurement data information, but loses the ability to interact with the medical image. The system may visually indicate that the link has been disabled by removing the special icon or changing the text format.

[0035] In another embodiment of the present application, the operation information includes location or region data marked by the user on the medical image; and in response to the operation of selecting the text and implanting the link in the report display interface, the text and the location or region data are linked.

[0036] Specifically, when analyzing medical images, physicians often need to mark important anatomical structures, lesion areas, or other points of interest on the images. These marks can be point markers, lines, arrows, circles, or irregularly shaped outlines, etc. When the physician creates these marks on the medical image, the system records the type, location, size, shape, etc. of the marks, forming location or region data. These data accurately describe the spatial location and range of the marks in the image. Location data usually includes two-dimensional or three-dimensional coordinate points, such as (x, y) or (x, y, z), to represent the location of point markers or lines. Region data may be a series of coordinate points forming a polygon, the center point and radius of a circle, or other data structures describing a closed region.

[0037] These location or region data, as part of the operation information, are transmitted to the report display interface through the communication module. In the report interface, these data may be presented in the form of a list, thumbnail, or other forms for the physician to choose from.

[0038] When a physician is writing a report, he or she can first enter or select a descriptive text in the report, such as "a high-density nodule is visible in the right upper lobe of the lung", and then trigger the "implant link" function through a specific operation (such as a right-click menu, a toolbar button, or a shortcut key).

[0039] The system will display a list of available annotations, and the physician can select an annotation that is relevant to the current text. The system will then establish a link between the text and the location or region data in the background. After the link is established, the selected text becomes an actionable text, which usually has a visual change, such as a color change, an underline, or the addition of a small icon, to indicate that it is associated with a specific region in the image.

[0040] In this embodiment, in response to the operation that triggers the text link, a positioning instruction is sent to the medical image display interface, which highlights the corresponding location or region in the medical image display interface. Specifically, when a user (such as a physician, radiology technician, or other medical personnel) is reading a medical report, he or she can trigger a text link in the report by clicking, double-clicking, or hovering over it. These text links are previously established and are associated with specific locations or regions in the medical image.

[0041] When the text link is triggered, the report display interface identifies the location or region data associated with the link and sends a positioning instruction to the medical image display interface through the communication module. The positioning instruction contains detailed information about the target location or region, such as coordinates, shape, size, etc. After receiving the positioning instruction, the medical image display interface first ensures that the correct image sequence and layer are displayed. If the currently displayed image is not the one where the target region is located, the system will automatically switch to the corresponding sequence and layer.

[0042] Then, the medical image display interface applies a highlight display effect to the specified location or region. The highlight display can take various forms, such as displaying a flashing circle or cross around the point location; marking the region with a colored outline or semi-transparent overlay; temporarily zooming in on the target region; adjusting the window width and window level parameters to enhance the contrast of the target region; the highlight display usually lasts for a certain period of time (such as a few seconds) and then gradually fades out or remains displayed until the user performs the next operation. This visual feedback helps the user quickly locate the image region mentioned in the report, improving the efficiency of reading the film. If the positioning instruction points to a location or region in three-dimensional space, the system may automatically adjust the multi-planar reconstruction (MPR) view to display the target region at the best angle.

[0043] In these embodiments, the communication module is implemented through an independent communication client, and the medical image display interface and the report display interface each establish a bidirectional communication connection with the communication client. Specifically, in order to achieve efficient and reliable communication between the medical image display interface and the report display interface, the present embodiment adopts an independent communication client architecture design. The independent communication client is a separate software component that is responsible for coordinating and managing data exchange between different interfaces.

[0044] The independent communication client usually runs as an intermediate layer in the system, and it establishes a bidirectional communication connection with the medical image display interface and the report display interface. This connection can be implemented based on various technologies, such as local sockets, WebSockets, HTTP long connections, inter-process communication (IPC) mechanisms, etc.

[0045] When the system starts, the medical image display interface and the report display interface will each initialize the connection with the communication client. This process includes steps such as identity verification, handshake protocol, and connection parameter negotiation to ensure the security and reliability of communication. After the connection is established, both parties can send and receive messages through the communication client. This bidirectional communication connection allows the medical image display interface to send operation information, measurement data, and annotation information to the report display interface; the report display interface to send jump instructions, positioning requests, and query commands to the medical image display interface; and both parties to send status updates, confirmation messages, and heartbeat packets to each other.

[0046] The communication client is responsible for message routing, forwarding, caching, and retrying to ensure that messages can be reliably delivered even in the case of network instability or temporary unavailability of one party. It may also implement message priority queues, traffic control, and load balancing functions. Another important role of the independent communication client is protocol conversion. When the medical image display interface and the report display interface use different data formats or communication protocols, the communication client can act as a converter to ensure that both parties can understand each other's messages. The communication client can also implement logging, monitoring, and diagnostic functions to help system administrators troubleshoot communication problems and optimize performance.

[0047] As shown in Figure 2 The present application also discloses an interactive system for medical images and medical reports, comprising: a report processing module for displaying medical reports; a medical image processing module for displaying medical images; a communication module for establishing a bidirectional communication link with the report processing module and the medical image processing module, respectively; wherein the system is configured to establish a link between operation information and images, including: in response to user operations on the medical image processing module, generating operation information and transmitting it to the report processing module through the communication module; and in response to user operations on the report processing module, establishing a link between the operation or operation information and the medical images.

[0048] Specifically, the medical image and medical report interaction system provided by the embodiment includes three core modules: a report processing module, a medical image processing module, and a communication module. These three modules work together to achieve seamless interaction between medical images and medical reports.

[0049] The report processing module is a component in the system responsible for displaying and editing medical reports. It provides a user interface that allows doctors to view, create, edit, and save medical reports. The report processing module typically includes features such as text editors, formatting tools, template management, spell check, and more to support efficient writing of medical reports. The report processing module is also responsible for processing operation information received from the communication module and establishing a link between these information and the content of the report based on user operations.

[0050] The medical image processing module is a component in the system responsible for displaying and analyzing medical images. It provides a professional medical image viewer that supports loading, displaying, and processing various medical image formats such as DICOM. The medical image processing module usually includes various image processing tools such as window width and window level adjustment, measurement tools, labeling tools, multi-planar reconstruction (MPR), maximum intensity projection (MIP), and more to support detailed analysis of medical images by doctors. The medical image processing module is responsible for capturing user operations on the image, generating operation information, and passing it to the report processing module through the communication module.

[0051] The communication module is a bridge connecting the report processing module and the medical image processing module. It establishes a bidirectional communication link with these two modules and is responsible for transmitting data and instructions between them. The communication module implements a set of communication protocols that define the format, transmission method, and processing flow of messages to ensure accurate, timely, and reliable data exchange between the two modules.

[0052] The workflow of the system is as follows: when the user (usually a doctor) views the image and performs operations in the medical image processing module, such as measuring lesion size, marking areas of interest, etc., the medical image processing module captures these operations and generates operation information containing operation type, parameters, location, etc. These operation information is transmitted to the report processing module through the communication module.

[0053] In the report processing module, the user can see the operation information transmitted from the medical image processing module and can establish a link between these information and the text or location in the medical report through specific operations (such as clicking, dragging, menu selection, etc.). For example, the user can insert the measurement results into a specific paragraph of the report, or associate the marked area in the image with the description text in the report.

[0054] After the link is established, the relevant content in the report is associated with a specific region in the medical image or the result of an operation. The user can click on the linked content in the report to trigger the system to display the corresponding image location or highlight the relevant area in the medical image processing module, achieving bidirectional navigation between the report and the image.

[0055] In this embodiment, the report processing module is an RIS client, and the browser is implemented. The medical image processing module is a medical image viewer client. The communication module is an independently deployed communication middleware. Specifically, the report processing module is implemented by an RIS (Radiology Information System) client. The RIS is an information management system specially designed for radiology departments, responsible for managing patient radiological examination information, workflow and report generation. The RIS client is an application program used by radiologists to access the RIS system, which provides functions such as report editing, review, signature and query. The RIS client usually integrates structured report templates, speech recognition, automatic text completion and other functions to improve the efficiency and standardization of report writing. It also integrates with the hospital's HIS (Hospital Information System) and EMR (Electronic Medical Record) systems, and can obtain patient basic information, clinical data and examination application forms and other data.

[0056] The medical image processing module is implemented by a medical image viewer client. It is a professional DICOM (Digital Imaging and Communications) viewer specially designed for displaying and processing medical images. The medical image viewer client is usually integrated with PACS (Picture Archiving and Communication System) and can retrieve and display stored medical images from the PACS server. The medical image viewer client provides rich image processing and analysis tools, such as multi-planar reconstruction, three-dimensional reconstruction, measurement tools, labeling tools, window width and window level adjustment, etc. It supports various medical imaging modalities such as CT, MRI, X-ray, ultrasound, nuclear medicine, etc., and can handle large image data sets.

[0057] The communication module is implemented by an independently deployed communication middleware. The communication middleware is a software system that runs independently and is responsible for data exchange and communication coordination between different application programs. It is deployed separately from the RIS client and the medical image viewer client as an intermediate layer in the system architecture.

[0058] The independently deployed communication middleware has the following characteristics: loose coupling architecture: RIS clients and medical image viewer clients do not directly depend on each other, but interact through the communication middleware, reducing system complexity and maintenance costs. Cross-platform compatibility: The communication middleware can handle communication between applications developed in different operating systems and different programming languages, improving system compatibility and extensibility. Centralized management: Communication strategies, security controls, message conversion and other functions are implemented in the communication middleware, facilitating unified management and upgrades. High availability: The communication middleware can implement load balancing, failover and other high availability mechanisms to ensure system communication stability and reliability. The communication middleware usually uses standard communication protocols (such as HTTP and WebSocket) or custom protocols to implement data exchange between RIS clients and medical image viewer clients. It can be deployed on dedicated servers or run as a microservice in the cloud environment.

[0059] In this embodiment, the communication module includes a message forwarding unit for transmitting operation information across modules, and a link management unit for maintaining the association between medical images and medical reports. Specifically, the communication module is the core component of the entire interactive system, which is responsible for not only data transmission, but also management of the association between medical images and medical reports. The communication module internally contains two main functional units: the message forwarding unit and the link management unit. The message forwarding unit is specifically responsible for transmitting operation information between the medical image processing module and the report processing module. It implements a complete message processing mechanism, including: message reception: receiving messages sent from the source module, verifying the validity of message format and content. Message routing: determine the delivery path of the message according to the message type and target, ensure that the message can accurately reach the target module. Message conversion: convert the message from the format used by the source module to the format that the target module can understand when necessary, handle protocol differences between different modules. Message queue: implement message caching and queuing mechanism, handle a large number of burst messages, ensure stable operation of the system. Message confirmation: implement message confirmation mechanism, ensure successful message delivery, retry if necessary. Message filtering: filter or prioritize processing of specific types of messages according to configured rules, improve system efficiency. The message forwarding unit supports multiple communication modes, such as request-response mode, publish-subscribe mode, point-to-point message forwarding mechanism, etc., to adapt to different scenarios. It also implements security mechanisms such as message encryption, identity verification and access control to protect sensitive medical data.

[0060] The link management unit is responsible for maintaining the association between medical images and medical reports. It implements a relational database or in-memory data structure that stores and manages the mapping relationships between image elements (such as specific locations, regions, measurements, etc.) and report elements (such as text paragraphs, table cells, etc.). The main functions of the link management unit include: link creation: when the user associates operation information with report content in the report processing module, record and store this association relationship. Link query: provide an interface to allow the module to query the associated objects of a specific report element or image element. Link update: when the report or image changes, update the corresponding link relationship to ensure the accuracy of the association. Link deletion: when the user deletes report content or image annotation, clear the corresponding link relationship. Link verification: periodically check the validity of the link and mark or clean up the invalid link. Link export / import: support exporting link relationships to a standard format or importing link relationships from an external source. The link management unit also implements a version control mechanism to record the history changes of the link relationship, supports undo and redo operations. It also provides visualization tools for link relationships to help users understand and manage complex association networks. The message forwarding unit and the link management unit work closely together to support the interaction between medical images and medical reports. When the user operates on the medical image, the operation information is first delivered to the report processing module by the message forwarding unit; when the user establishes a link in the report, the link relationship is recorded and maintained by the link management unit; when the user clicks on the link in the report, the link management unit finds the associated image element, and the message forwarding unit is responsible for sending positioning or highlighting instructions to the medical image processing module.

[0061] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for part of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A method of medical image and medical report interaction, characterized in that, The system comprises: displaying a medical image in a medical image display interface; displaying a medical report in a report display interface; generating operation information in response to a user operation on the medical image; transmitting the operation information to the report display interface through a communication module; establishing a link between the operation or operation information and the medical image in response to a user operation on the report display interface.

2. The method of claim 1, wherein, The user operation on the medical image comprises a measurement operation, and the operation information comprises measurement data, which comprises at least one of distance, area, volume or CT value.

3. The method of claim 2, wherein, The user operation on the report display interface comprises copying the measurement data to a specified position in the medical report.

4. The method of claim 3, wherein, The operation information further comprises layer position data of the medical image; when the layer position data is copied to the medical report, an operable marker linked to the corresponding layer position of the medical image is automatically generated.

5. The method of claim 4, wherein, In response to a triggering operation on the operable marker, a jump instruction is sent to the medical image display interface to control the medical image display interface to jump to the corresponding layer position.

6. The method of claim 4, wherein, When the display style of the operable marker is edited, the link between the operable marker and the layer position data is removed.

7. The method of claim 1, wherein, The operation information comprises position or region data marked by the user on the medical image; in response to an operation of selecting a text and implanting a link in the report display interface, a link between the text and the position or region data is established.

8. The method of claim 7, wherein, In response to an operation of triggering the text link, a positioning instruction is sent to the medical image display interface to highlight the corresponding position or region in the medical image display interface.

9. The method according to any one of claims 1 to 8, wherein, The communication module is implemented by an independent communication client, and the medical image display interface and the report display interface are respectively connected to the communication client in a bidirectional communication manner.

10. An interactive system of medical images and medical reports, characterized by, The system comprises: a report processing module for displaying a medical report; a medical image processing module for displaying a medical image; a communication module for establishing bidirectional communication links with the report processing module and the medical image processing module respectively; wherein the system is configured to: generate operation information in response to a user operation on the medical image processing module and transmit the operation information to the report processing module through the communication module; establish a link between the operation or operation information and the medical image in response to a user operation on the report processing module.

Images