A remote collaborative interactive system for medical imaging

Abstract

The present invention provides a remote collaborative interaction system for medical images, which relates to the field of data communication technology, including: opening a corresponding instance, the instance includes an initiator and multiple responders; providing real-time network services between each instance; the initiator loads the medical image associated with the image link, and sends the image link, the first audio and video information generated by itself during the reading operation, and the first reading operation to each responder; the responder obtains and synchronously displays the first audio and video information, loads the medical image and the first reading operation, and sends the second audio and video information generated by itself during the reading operation and the second reading operation to other instances; the initiator obtains and synchronously displays the second audio and video information; the responder obtains and synchronously displays the second audio and video information of other responders, so as to realize remote collaborative interaction of medical images. The beneficial effect is to realize decentralized medical image teaching and collaborative reading.

Description

Technical Field

[0001] The present invention relates to the field of data communication technology, and in particular to a remote collaborative interaction system for medical images. Background Art

[0002] Medical imaging examinations use technical means to display the internal structure and organs of the human body on medical images. Information such as the human body's anatomical and physiological function and pathological changes are stored and displayed in the form of digital images. Professionally trained radiologists can make more accurate judgments by browsing these medical images (reading films) and combining them with other diagnostic and treatment information. Generally, imaging examinations are painless, relatively safe, and non-invasive, making medical imaging examinations one of the important examination methods for medical institutions to understand the source, nature, and severity of diseases.

[0003] Since medical imaging requires radiologists to read and interpret films, and different radiologists may have different interpretations, the medical imaging community has formed standards for reading, reviewing, and centralized reading in the long-term practice of reading films to improve the standardization and accuracy of image interpretation. At the same time, these forms are also used to continuously improve the reading ability of junior doctors.

[0004] Traditional film reading and teaching are conducted face-to-face in the film reading room or conference room of the imaging department. With the development of network technology, especially 5G network technology, remote film reading and teaching or film reading has become possible. The prevalence of large-scale infectious diseases has greatly increased the demand for remote medical image communication. In addition, with the rise of national strength and increasingly close foreign exchanges, cross-regional and even cross-international exchanges in the field of medical imaging are also increasing. Through remote film reading or film reading, not only can we obtain the assistance of domestic and foreign experts in a timely manner on a larger scale, but we can also provide cross-international medical image exchanges and observations, which has positive significance for jointly improving the level of imaging, fighting large-scale epidemic diseases, and enhancing people-to-people friendship.

[0005] Most of the existing remote medical image communication systems are built on the basis of traditional Internet technology, using a server-multi-client model. Video conversations and image browsing are independent of each other and are independent of each other. They place high demands on servers and their networks, impose heavy burdens, and have significant audio and video delays. Images are obtained from the hospital's system, and it is cumbersome to connect to the network across networks, which poses a security risk. The collaborative film reading function is also transferred through servers, and there is a possibility of losing intermediate steps in the operation. Summary of the invention

[0006] In view of the problems existing in the prior art, the present invention provides a remote collaborative interaction system for medical images, comprising:

[0007] An instance opening module, used to open a corresponding instance according to an external opening instruction, wherein the instance includes an initiator and multiple responders;

[0008] A communication service module, used for providing real-time network services between the instances;

[0009] A first operation module, configured to allow the initiator to load a medical image associated with an image link, and receive a first image reading operation applied by the initiator to the medical image;

[0010] A first interaction module is used for the initiator to send the image link, the first audio and video information generated by itself during the film reading operation, and the first film reading operation to each of the responders;

[0011] A first display module, used for sending the first audio and video information to the responder, so as to synchronously display the first audio and video information on the responder;

[0012] A second operation module is configured to allow the responder to load the medical image associated with the image link and the first image reading operation, and then receive a second image reading operation applied by the responder to the medical image to which the first image reading operation has been applied;

[0013] A second interaction module is used for the responding party to send a second audio and video information generated by itself during the film reading operation and the second film reading operation to each of the other instances;

[0014] A second display module, used for sending the second audio and video information to the initiator, so as to synchronously display the second audio and video information on the initiator;

[0015] The first operation module is further used for the initiator to receive and load the second image reading operation, and then receive the first image reading operation applied by the initiator to the medical image to which the second image reading operation has been applied;

[0016] The second operation module is further used for the responder to receive and load the second image reading operation of other responders, and then receive the second image reading operation applied by the responder to the medical image to which the second image reading operation has been applied;

[0017] The first display module is also used to send the second audio and video information of other responders to the responder to achieve remote collaborative interaction of the medical images.

[0018] Preferably, it also includes a shared storage server, which is connected to each of the instances, and is used to store the first image reading operation and the second image reading operation applied to the medical image in sequence by the initiator and each of the responders during the remote collaborative interaction process.

[0019] Preferably, it also includes an operation reconstruction module, which is used for each of the instances to load the first image reading operation and the second image reading operation that have been applied from the shared storage server when the remote collaborative interaction is abnormal, so as to reconstruct the first image reading operation and the second image reading operation that have been applied to the medical image.

[0020] Preferably, the shared storage server is a blockchain.

[0021] Preferably, it further includes a third display module, which is used to send the first audio and video information generated by itself during the film reading operation to the initiator, so as to synchronously display the first audio and video information of itself on the initiator.

[0022] Preferably, the instance further comprises at least one viewing party, and the initiator is connected to each of the viewing parties respectively through a distribution server;

[0023] It also includes an audio and video synthesis module, which is used for the initiator to obtain the audio and video information of the instance of the current film viewing operation to synthesize it into a media stream, and send the media stream to each viewer through the distribution server for viewing.

[0024] Preferably, a third interaction module is further included, for allowing the viewer to remotely interact with the initiator via text during the viewing process.

[0025] Preferably, it further comprises a link acquisition module, which is used for the initiator to upload the medical image to a cloud server and obtain the image link of the medical image in the cloud server;

[0026] The first operation module and the second operation module are further used to allow the initiator and the responder to access the cloud server through the image link and load the corresponding medical image.

[0027] Preferably, the communication service module includes:

[0028] A communication server, after each of the instances is started, registers a communication address of itself to the communication server;

[0029] The communication establishing unit is used for each of the instances to obtain the communication addresses of other instances from the communication server, and to establish real-time network connections with the other instances according to its own communication addresses and the communication addresses of the other instances.

[0030] Preferably, the communication server is a STUN server.

[0031] The above technical solution has the following advantages or beneficial effects:

[0032] 1. Provide medical images required for teaching and collaborative film reading through cloud services. Each instance obtains medical images independently, ensuring the consistency of discussion topics and being less affected by the complexity of regions and network structures.

[0033] 2. Through real-time audio and video networks, decentralized medical imaging teaching and collaborative film reading are realized. While browsing images, you can see and hear the operator's operations, explanations and comments;

[0034] 3. Through the real-time network, each instance's reading operation on medical images is transmitted to achieve collaborative reading. At the same time, all reading operations generated during the remote interaction process are saved in the blockchain, ensuring the order and integrity of the operations. When the operation is out of sync, all operation steps can be reconstructed from the blockchain;

[0035] 4. By opening an instance as a viewer, you can communicate with the initiator through text while observing the teaching; and when necessary, you can create an instance as a responder and switch to audio and video to participate in the discussion, ensuring the orderliness and participation of teaching and collaborative film reading. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] Figure 1 The structure diagram of a remote collaborative interaction system for medical images in a preferred embodiment of the present invention is shown. DETAILED DESCRIPTION

[0037] The present invention is described in detail below in conjunction with the accompanying drawings and specific embodiments. The present invention is not limited to this embodiment, and other embodiments may also fall within the scope of the present invention as long as they conform to the gist of the present invention.

[0038] In a preferred embodiment of the present invention, based on the above problems existing in the prior art, a remote collaborative interaction system for medical images is provided. Figure 1 As shown, including:

[0039] The instance start module 1 is used to start the corresponding instance according to the external start instruction, and the instance includes an initiator and multiple responders;

[0040] The communication service module is used to provide real-time network services between each instance;

[0041] The first operation module 3 is used for allowing the initiator to load a medical image associated with an image link, and receive a first image reading operation applied by the initiator to the medical image;

[0042] The first interaction module 4 is used for the initiator to send the image link, the first audio and video information generated by itself during the film reading operation, and the first film reading operation to each responder;

[0043] A first display module 5, used to send the first audio and video information to the responder, so as to synchronously display the first audio and video information on the responder;

[0044] A second operation module 6 is used for the responder to load the medical image associated with the image link and the first image reading operation, and then receive a second image reading operation applied by the responder to the medical image to which the first image reading operation has been applied;

[0045] The second interaction module 7 is used for the responding party to send a second audio and video information and a second film reading operation generated by itself during the film reading operation to other instances;

[0046] A second display module 8, used to send the second audio and video information to the initiator, so as to synchronously display the second audio and video information on the initiator;

[0047] The first operation module 3 is also used for the initiator to receive and load the second image reading operation, and then receive the first image reading operation applied by the initiator to the medical image to which the second image reading operation has been applied;

[0048] The second operation module 6 is also used for the responder to receive and load the second image reading operation of other responders, and then receive the second image reading operation applied by the responder to the medical image to which the second image reading operation has been applied;

[0049] The first display module 5 is also used to send the second audio and video information of other responders to the responder, so as to realize the remote collaborative interaction of medical images.

[0050] Specifically, the remote collaborative interaction system of the present technical solution includes but is not limited to being implemented through a Web application or an APP application. In this embodiment, the initiator and the responder log in to the Web application or the APP application on the remote device to open the corresponding instance. Among them, for the initiator, the present technical solution also provides a remote control module for the initiator to control including but not limited to the start and end of the remote collaborative interaction, and to determine the responders and viewers of the remote collaborative interaction, so as to determine the participation qualifications of the responders and viewers of the remote collaborative interaction.

[0051] Among them, the responder is a remote film reading participant of remote collaborative interaction, and has the same medical image operation authority as the initiator. The audio and video information generated during the film reading operation includes but is not limited to the film reading operation interface of the corresponding instance and the explanation and comments during the film reading operation. Through the remote collaborative interaction system of medical images of the present invention, the initiator sends its own first audio and video information and first film reading operation to each responder during operation, and each responder sends its own second audio and video information and second film reading operation to the main initiator and other responders during operation. The initiator and each responder and each responder can realize real-time audio and video information interaction and synchronization of film reading operations, so as to realize decentralized remote collaborative film reading. Since each instance communicates with each other through a real-time network and does not rely on a central server, when a network problem occurs in any instance, other instances can still maintain normal communication.

[0052] In this embodiment, when any responder performs the second film reading operation, the initiator and other responders can see and hear the film reading operation interface, explanations and comments of the responder as the operator while browsing the images. Similarly, when any responder performs the first film reading operation when the initiator performs the first film reading operation, he can also see and hear the film reading operation, explanations and comments of the initiator as the operator while browsing the images.

[0053] Specifically, in this embodiment, in addition to being able to synchronously display the first audio and video information of the initiator, the responder can also synchronously display the second audio and video information of other responders, thereby achieving audio and video synchronization of all participants. Furthermore, each responder can also display its own second audio and video information, so that the responder can promptly discover whether there is any abnormality in its own audio and video generation process.

[0054] In a preferred embodiment of the present invention, a shared storage server 9 is further included, which is connected to each instance and is used to store the first reading operation and the second reading operation applied to the medical image in sequence by the initiator and each responder during the remote collaborative interaction process.

[0055] Specifically, in this embodiment, timely backup of the film reading operation in the collaborative interaction process is achieved by setting up a shared storage server 9. It can be understood that each first film reading operation and each second film reading operation in the shared storage server 9 are saved in sequence according to the operation order in the remote collaborative interaction process for subsequent reconstruction and use.

[0056] In a preferred embodiment of the present invention, an operation reconstruction module 10 is further included, which is used for each instance to load the first image reading operation and the second image reading operation that have been applied from the shared storage server when the remote collaborative interaction is abnormal, so as to reconstruct the first image reading operation and the second image reading operation that have been applied to the medical image.

[0057] Specifically, collaborative reading can be achieved by transmitting the reading operations of the initiator and each responder on medical images through a real-time network. However, intermediate steps of the operation may be lost during the transmission process. Based on this, in this embodiment, a shared storage server 9 and an operation reconstruction module 10 are set up to ensure the order and integrity of the reading operations, so that when the remote collaborative interaction is abnormal, the operation reconstruction module 10 can load and reconstruct all the applied reading operations from the shared storage server 9.

[0058] Among them, the above-mentioned abnormal remote collaborative interaction may be the loss of an intermediate operation step during the transmission process, or a new responder joining the remote collaborative interaction process, or any instance reconnecting after a network interruption during the remote collaborative interaction process.

[0059] In a preferred embodiment of the present invention, the shared storage server 9 is a blockchain.

[0060] In a preferred embodiment of the present invention, a third display module 11 is further included, which is used to send the first audio and video information generated by itself during the film reading operation to the initiator, so as to synchronously display its first audio and video information on the initiator.

[0061] In a preferred embodiment of the present invention, the instance further includes at least one viewing party, and the initiator is connected to each viewing party through a distribution server 12;

[0062] The system also includes an audio and video synthesis module 13, which is used for the initiator to obtain the audio and video information of the current instance of the film viewing operation, synthesize it into a media stream, and send the media stream to each viewer through the distribution server for viewing.

[0063] Specifically, in this embodiment, the remote collaborative interactive system of the technical solution can not only realize remote collaborative film reading, but also provide a remote teaching function of medical images. At this time, the initiator and each responder can serve as a teaching end, and the above-mentioned viewing party is a learning end. Among them, the initiator can receive the second audio and video information of all responders, and each viewing party only needs to establish remote communication with the initiator through the distribution server 12 to realize real-time viewing of the audio and video information of the instance of the current film reading operation, thereby realizing the remote teaching function of medical images.

[0064] Furthermore, by providing an instance as a viewer, in addition to providing remote teaching functions, the number of responders can also be effectively reduced during the remote collaborative film reading process. In other words, during the remote collaborative film reading process, if the instance as a responder does not actually need to participate in the film reading operation and only needs to watch, then it can participate in the remote collaborative film reading as a viewer to meet the needs, without having to participate as a responder, thereby effectively reducing network pressure.

[0065] In a preferred embodiment of the present invention, a third interaction module 14 is further included, which is used for the viewer to remotely interact with the initiator through text during the viewing process.

[0066] Specifically, in this embodiment, through the third interactive module 14, during the teaching process, the viewer can send text messages to the initiator for communication. Furthermore, if the viewer needs to participate in the discussion in audio and video mode, a new responder can be created to switch to the audio and video mode to participate in the discussion, thereby ensuring the orderliness and participation of teaching and collaborative film reading. The above process of creating a new responder is to establish real-time network communication with other instances through the communication service module, thereby realizing the identity switching from the viewer to the responder.

[0067] In a preferred embodiment of the present invention, a link acquisition module 15 is further included, which is used for the initiator to upload the medical image to a cloud server 16 and obtain the image link of the medical image in the cloud server 16;

[0068] The first operation module 3 and the second operation module 6 are further used to allow the initiator and the responder to access the cloud server 16 through the image link and load the corresponding medical images.

[0069] Specifically, in this embodiment, before remote collaborative interaction, the initiator uploads the medical images required for remote collaborative reading or teaching to the cloud server 16 through the link acquisition module 15. The above-mentioned image link is used to represent the storage location of the uploaded medical image in the cloud server 16. When conducting remote collaborative interaction, only the image link is transmitted between the initiator and each responder, which effectively reduces the network transmission burden. Furthermore, through the cloud service, the medical images required for teaching and collaborative reading are provided, and each instance independently loads and obtains the medical image through the image link, which ensures the consistency of the discussion subject and is less affected by the complexity of the region and network structure.

[0070] In a preferred embodiment of the present invention, the communication service module includes:

[0071] Communication server 21, after each instance is started, registers its own communication address to communication server 21;

[0072] The communication establishing unit 22 is used for each instance to obtain the communication addresses of other instances from the communication server 21, and to establish real-time network connections with other instances according to its own communication addresses and the communication addresses of other instances.

[0073] Specifically, in this embodiment, after the initiator initiates the remote collaborative interaction and determines the responder of the remote collaborative interaction, the initiator and each responder register their own communication addresses to the communication server 21 by registration. The initiator and the responder of the remote collaborative interaction determined by the initiator can obtain the communication addresses of other instances except themselves from the communication server 21, and then establish a network connection.

[0074] During the remote collaborative interaction process, if a new responder registers to the communication server 21 and has the participation qualifications determined by the initiator, each instance currently performing the remote collaborative interaction process obtains the communication address of the new responder and then establishes a real-time network connection, and so on.

[0075] In a preferred embodiment of the present invention, the communication server is a STUN server.

[0076] The above description is only a preferred embodiment of the present invention, and does not limit the implementation mode and protection scope of the present invention. For those skilled in the art, it should be aware that all solutions obtained by equivalent substitutions and obvious changes made using the contents of this specification and illustrations should be included in the protection scope of the present invention.

Claims

1. A remote collaborative interaction system for medical imaging, characterized in that: include: An instance opening module, used to open a corresponding instance according to an external opening instruction, wherein the instance includes an initiator and multiple responders; A communication service module, used for providing real-time network services between the instances; A first operation module, configured to allow the initiator to load a medical image associated with an image link, and receive a first image reading operation applied by the initiator to the medical image; A first interaction module is used for the initiator to send the image link, the first audio and video information generated by itself during the film reading operation, and the first film reading operation to each of the responders; A first display module, used for sending the first audio and video information to the responder, so as to synchronously display the first audio and video information on the responder; A second operation module is configured to allow the responder to load the medical image associated with the image link and the first image reading operation, and then receive a second image reading operation applied by the responder to the medical image to which the first image reading operation has been applied; A second interaction module is used for the responding party to send a second audio and video information generated by itself during the film reading operation and the second film reading operation to each of the other instances; A second display module, used for sending the second audio and video information to the initiator, so as to synchronously display the second audio and video information on the initiator; The first operation module is further used for the initiator to receive and load the second image reading operation, and then receive the first image reading operation applied by the initiator to the medical image to which the second image reading operation has been applied; The second operation module is further used for the responder to receive and load the second image reading operation of other responders, and then receive the second image reading operation applied by the responder to the medical image to which the second image reading operation has been applied; The first display module is also used to send the second audio and video information of other responders to the responder to achieve remote collaborative interaction of the medical images.

2. The remote collaborative interaction system according to claim 1, characterized in that: It also includes a shared storage server, which is connected to each of the instances and is used to store the first image reading operation and the second image reading operation applied to the medical image in sequence by the initiator and each of the responders during the remote collaborative interaction process.

3. The remote collaborative interaction system according to claim 2, characterized in that: It also includes an operation reconstruction module, which is used for each of the instances to load the first and second image reading operations that have been applied from the shared storage server when the remote collaborative interaction is abnormal, so as to reconstruct the first and second image reading operations that have been applied to the medical image.

4. The remote collaborative interaction system according to claim 2 or 3, characterized in that: The shared storage server is a blockchain.

5. The remote collaborative interaction system according to claim 1, characterized in that: It also includes a third display module, which is used to send the first audio and video information generated by itself during the film reading operation to the initiator, so as to synchronously display the first audio and video information of itself on the initiator.

6. The remote collaborative interaction system according to claim 1, characterized in that: The example further includes at least one viewing party, and the initiator is connected to each of the viewing parties respectively through a distribution server; It also includes an audio and video synthesis module, which is used for the initiator to obtain the audio and video information of the instance of the current film viewing operation to synthesize it into a media stream, and send the media stream to each viewer through the distribution server for viewing.

7. The remote collaborative interaction system according to claim 6, characterized in that: It also includes a third interaction module, which is used for the viewer to remotely interact with the initiator through text during the viewing process.

8. The remote collaborative interaction system according to claim 1, characterized in that: It also includes a link acquisition module, which is used for the initiator to upload the medical image to a cloud server and obtain the image link of the medical image in the cloud server; The first operation module and the second operation module are further used to allow the initiator and the responder to access the cloud server through the image link and load the corresponding medical image.

9. The remote collaborative interaction system according to claim 1, characterized in that: The communication service module includes: A communication server, after each of the instances is started, registers a communication address of itself to the communication server; The communication establishing unit is used for each of the instances to obtain the communication addresses of other instances from the communication server, and to establish real-time network connections with the other instances according to its own communication addresses and the communication addresses of the other instances.

10. The remote collaborative interaction system according to claim 8, characterized in that: The communication server is a STUN server.

Images