Remote data transmission method, server, client and navigation intervention visualization system

Abstract

The present invention discloses a remote data transmission method, a server, a client, and a navigation intervention visualization system, comprising: obtaining target transmission data; wherein the target transmission data includes point cloud data, two-dimensional image data, MRI data, and text data; packaging and compressing the target transmission data to obtain a target transmission data compressed package; and transmitting the target transmission data compressed package to one or more clients of the navigation intervention visualization system via network communication. The present invention can simultaneously realize multi-dimensional display of surgical scenes on both the server and the client, meeting diverse needs, resolving the drawback of existing technologies that incompletely display surgical scenes, and avoiding the loss of surgical details.

Description

Technical Field

[0001] The present invention relates to the technical field of point cloud data transmission, and in particular to a remote data transmission method, a server, a client, and a navigation intervention visualization system. Background Art

[0002] Existing MRI navigation interventional systems primarily serve local environments, limiting physicians' mobility to the immediate vicinity of the system equipment. This makes it difficult to obtain expert assistance for emergency treatment of difficult and complex medical conditions due to geographic constraints. Furthermore, most existing MRI navigation interventional systems can only display MRI and 2D image data. MRI displays the progress of the interventional procedure within the patient, while 2D image data records the surgical scene. These systems only minimally meet the functional requirements of remote navigation interventional platforms and fail to address diverse needs. Furthermore, the display of complex surgical environments often loses significant surgical details. Summary of the Invention

[0003] In order to solve the technical problems existing in the background technology, the present invention proposes a remote data transmission method, a server, a client and a navigation intervention visualization system.

[0004] The present invention proposes a remote data transmission method, which is applied to a server of a navigation intervention visualization system, comprising:

[0005] Acquire target transmission data; wherein the target transmission data includes point cloud data, two-dimensional image data, MRI data and text data;

[0006] Packing and compressing the target transmission data to obtain a target transmission data compression package;

[0007] The target transmission data compression package is sent to one or more clients of the navigation intervention visualization system in a network communication manner.

[0008] Preferably, the target transmission data is packaged and compressed to obtain a target transmission data compressed package, specifically including:

[0009] monitoring the network speed of one or more clients of the navigation intervention visualization system to receive the target transmission data compressed packet;

[0010] When the network speed is greater than or equal to a first preset threshold, the target transmission data is packaged to obtain a target transmission data packet, and the target transmission data packet is compressed to obtain a target transmission data compressed packet;

[0011] When the network speed is less than a first preset threshold, the point cloud data in the target transmission data is compressed to obtain a point cloud data compression package, and the point cloud data compression package is packaged with all other data in the target transmission data to obtain a target transmission data packet, and the target transmission data packet is compressed to obtain a target transmission data compression package.

[0012] Preferably, while monitoring the network speed of one or more clients of the navigation intervention visualization system to receive the target transmission data compression packet, the method further includes:

[0013] monitoring CPU usage of one or more clients of the navigation intervention visualization system to receive the target transmission data compression packet;

[0014] When the network speed is greater than or equal to a first preset threshold and the CPU usage is lower than a second preset threshold, losslessly compressing the target transmission data packet according to a preset lossless compression level to obtain a target transmission data compressed packet;

[0015] When the network speed is less than the first preset threshold and the CPU usage is lower than the second preset threshold, the user is prompted whether to perform manual lossless compression;

[0016] If so, prompting the user to manually set a lossless compression level, and performing lossless compression on the point cloud data in the target transmission data in response to the lossless compression level manually set by the user to obtain a lossless point cloud data compression package, and packaging the lossless point cloud data compression package with all other data in the target transmission data to obtain a target transmission data package, and performing lossless compression on the target transmission data package according to the preset lossless compression level to obtain a target transmission data compression package;

[0017] If not, the point cloud data in the target transmission data is adaptively lossily compressed to obtain a lossy point cloud data compression package, and the lossy point cloud data compression package is packaged with all other data in the target transmission data to obtain a target transmission data package, and the target transmission data package is losslessly compressed according to a preset lossless compression level to obtain a target transmission data compression package.

[0018] Preferably, when adaptive lossy compression is performed on the point cloud data in the target transmission data to obtain a lossy point cloud data compression package, the method specifically includes:

[0019] Calculate the maximum value of the data packet that the current network allows to transmit based on the network speed;

[0020] The lossy compression ratio of the point cloud data is calculated based on the size of the target transmission data, the maximum size of the data packet allowed to be transmitted by the current network, and the preset lossless compression level;

[0021] Determine the lossy compression level of the point cloud data according to the lossy compression ratio of the point cloud data;

[0022] The point cloud data is lossily compressed according to the lossy compression level of the point cloud data to obtain a lossy compressed package of the point cloud data.

[0023] Preferably, after sending the target transmission data compressed package to one or more clients of the navigation intervention visualization system in a network communication manner, the method further includes:

[0024] receiving a command data packet sent by one or more clients of the navigation intervention visualization system in a network communication manner;

[0025] Parse the command data packet to obtain command data;

[0026] And send the command data to the corresponding module in the server.

[0027] The present invention also proposes a remote data transmission method, which is applied to a client of a navigation intervention visualization system, comprising:

[0028] Receiving a target transmission data compression package sent by a server of a navigation intervention visualization system using any one of the above-mentioned remote data transmission methods;

[0029] The target transmission data compression package is decompressed and parsed to obtain the target transmission data; wherein the target transmission data includes point cloud data, two-dimensional image data, MRI data and text data.

[0030] Preferably, decompressing and parsing the target transmission data compressed package to obtain the target transmission data specifically includes:

[0031] Determine whether each data in the target transmission data packet is compressed;

[0032] If not, each data in the target transmission data packet is parsed separately, and all the parsed data are used as the target transmission data;

[0033] If so, decompress the compressed data in the target transmission data packet to obtain corresponding decompressed data;

[0034] The corresponding decompressed data and the uncompressed data in the target transmission data packet are parsed respectively, and all the parsed data are used as the target transmission data.

[0035] Preferably, after decompressing and parsing the target transmission data compressed package to obtain the target transmission data, the method further includes:

[0036] Get command data;

[0037] Pack the commands into command data packets;

[0038] The command data packet is sent to the server of the navigation intervention visualization system via network communication.

[0039] The present invention also proposes a server of a navigation intervention visualization system, comprising:

[0040] A first data transmission module, configured to implement any of the above-mentioned remote data transmission methods;

[0041] The first data display module is used to display target transmission data.

[0042] The present invention also proposes a client of a navigation intervention visualization system, comprising:

[0043] A second data transmission module, configured to implement any of the above-mentioned remote data transmission methods;

[0044] The second data display module is used to display target transmission data.

[0045] The present invention further proposes a navigation intervention visualization system, comprising a server of any one of the navigation intervention visualization systems described above and one or more clients of any one of the navigation intervention visualization systems described above.

[0046] In the present invention, the proposed remote data transmission method, server, client and navigation intervention visualization system packages and compresses the target output data such as point cloud data, two-dimensional image data, MRI data and text data obtained by the server, and then sends it from the server to one or more clients via network communication. It can simultaneously realize multi-dimensional display of surgical scenes on the local server and remote clients, meet diversified needs, solve the disadvantage of incomplete display of surgical scenes in existing technologies, and avoid the loss of surgical details. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 The figure is a flow chart of the Yuncheng data transmission method in one embodiment of the present invention.

[0048] Figure 2 This is a schematic structural diagram of a navigation intervention visualization system combined with point cloud data in one embodiment of the present invention. DETAILED DESCRIPTION

[0049] It should be noted that, in the absence of conflict, the embodiments and features of the embodiments of the present invention can be combined with each other. The present invention will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0050] Reference Figure 1 ,A remote data transmission method proposed in the present invention is applied to the ,server of a navigation intervention visualization system, comprising:

[0051] Acquire target transmission data; wherein the target transmission data includes point cloud data, two-dimensional image data, MRI data and text data;

[0052] Packing and compressing the target transmission data to obtain a target transmission data compression package;

[0053] The target transmission data compression package is sent to one or more clients of the navigation intervention visualization system in a network communication manner.

[0054] The server in this embodiment is a user server. During data transmission, the user server first obtains target transmission data, then packages and compresses the acquired target transmission data to obtain a compressed target transmission data package. The compressed target transmission data package is then sent via network communication to one or more clients of the navigation intervention visualization system. Therefore, the remote data transmission method in this embodiment not only transmits two-dimensional image data but also point cloud data used to render three-dimensional point cloud models. This allows for a multi-dimensional display of complex surgeries on both the local server and the remote client, facilitating the subsequent combined display of three-dimensional point clouds and MRI on the remote client, and enhancing the visualization of navigation interventional surgeries on the remote client.

[0055] The "network communication mode" in this embodiment includes one or more of a wired network communication mode, a wireless network communication mode, a local area network, and a wide area network.

[0056] In one specific embodiment, obtaining target transmission data specifically includes:

[0057] Acquire target transmission data in real time to ensure real-time display on the server and client during surgery.

[0058] Therefore, the remote data transmission method in this embodiment is preferably a real-time remote data transmission method.

[0059] It should be noted that the server in this embodiment is the user server, and the client is the user client.

[0060] Among them, point cloud data can intuitively and clearly display the three-dimensional model of the surgical scene, allowing the user interaction module to display details of its operations; two-dimensional image data can assist in displaying the surgical scene in a traditional way; MRI information displays information inside the patient's body and the real-time position of interventional surgical instruments in the patient's body; text data is attached to the corners of various data windows to display information such as the attribute status of various data, such as the operation panel information for user interaction.

[0061] Since the target transmission data includes multiple types of data such as point cloud data, two-dimensional image data, MRI data, and text data, these data need to be serialized (converted into data streams) and other operations when they are sent. If they are sent one by one when they need to be sent, they must be processed one by one, which is not conducive to data management, processing, and expansion, and even affects real-time performance. In order to solve this problem, in this embodiment, the target transmission data is packaged and compressed to obtain a target transmission data compression package, which specifically includes:

[0062] monitoring the network speed of one or more clients of the navigation intervention visualization system to receive the target transmission data compressed packet;

[0063] When the network speed is greater than or equal to a first preset threshold, the target transmission data is packaged to obtain a target transmission data packet, and the target transmission data packet is compressed to obtain a target transmission data compressed packet;

[0064] When the network speed is less than a first preset threshold, the point cloud data in the target transmission data is compressed to obtain a point cloud data compression package, and the point cloud data compression package is packaged with all other data in the target transmission data to obtain a target transmission data packet, and the target transmission data packet is compressed to obtain a target transmission data compression package.

[0065] Among the target transmission data, the size of the point cloud data occupies a major position. This embodiment can perform multi-layer and multi-level compression on the point cloud data according to the network speed to ensure data transmission.

[0066] However, during the data transmission process, the CPU usage of the client also affects the data transmission. To solve this problem, in a further embodiment, while monitoring the network speed of one or more clients of the navigation intervention visualization system to receive the target transmission data compressed packet, the system also includes:

[0067] monitoring CPU usage of one or more clients of the navigation intervention visualization system to receive the target transmission data compression packet;

[0068] When the network speed is greater than or equal to a first preset threshold and the CPU usage is lower than a second preset threshold, losslessly compressing the target transmission data packet according to a preset lossless compression level to obtain a target transmission data compressed packet;

[0069] When the network speed is less than the first preset threshold and the CPU usage is lower than the second preset threshold, the user is prompted whether to perform manual lossless compression;

[0070] If so, prompting the user to manually set a lossless compression level, and performing lossless compression on the point cloud data in the target transmission data in response to the lossless compression level manually set by the user to obtain a lossless point cloud data compression package, and packaging the lossless point cloud data compression package with all other data in the target transmission data to obtain a target transmission data package, and performing lossless compression on the target transmission data package according to the preset lossless compression level to obtain a target transmission data compression package;

[0071] If not, the point cloud data in the target transmission data is adaptively lossily compressed to obtain a lossy point cloud data compression package, and the lossy point cloud data compression package is packaged with all other data in the target transmission data to obtain a target transmission data package, and the target transmission data package is losslessly compressed according to a preset lossless compression level to obtain a target transmission data compression package.

[0072] In a further embodiment, when adaptive lossy compression is performed on the point cloud data in the target transmission data to obtain a lossy point cloud data compression package, the method specifically includes:

[0073] Calculate the maximum value of the data packet that the current network allows to transmit based on the network speed;

[0074] The lossy compression ratio of the point cloud data is calculated based on the size of the target transmission data, the maximum size of the data packet allowed to be transmitted by the current network, and the preset lossless compression level;

[0075] Determine the lossy compression level of the point cloud data according to the lossy compression ratio of the point cloud data;

[0076] The point cloud data is lossily compressed according to the lossy compression level of the point cloud data to obtain a lossy compressed package of the point cloud data.

[0077] With such a configuration, this embodiment can perform adaptive lossy compression on point cloud data during data transmission to cope with lower and variable network speeds.

[0078] It should be noted that lossless compression occupies more CPU, but lossy compression also occupies a small amount of CPU. Therefore, when the CPU usage is higher than or equal to the second preset threshold, if the network speed is greater than or equal to the first preset threshold, the target transmission data is directly packaged to obtain a target transmission data packet, and the target transmission data packet is lossily compressed to obtain a target transmission data compression packet. Then, the server sends the target transmission data compression packet to one or more clients of the navigation intervention visualization system via network communication as usual; at the same time, a pop-up window warning is issued to the client, and no other operations will be performed, but there is no guarantee whether the client can receive it or how much delay there is in receiving it.

[0079] Similarly, when the CPU usage is greater than or equal to the second preset threshold, if the network speed is greater than or equal to the first preset threshold, adaptive lossy compression is performed on the point cloud data in the target transmission data to obtain a lossy point cloud data compression package, and the lossy point cloud data compression package is packaged with all other data in the target transmission data to obtain a target transmission data packet, and the target transmission data packet is losslessly compressed according to a preset lossless compression level to obtain a target transmission data compression package. The server then sends the target transmission data compression package to one or more clients of the navigation intervention visualization system via network communication as usual; at the same time, a pop-up window warning is displayed to the client. If the client's software freezes and fails to transmit data due to excessive CPU usage during the data transmission process, the user shall handle the situation.

[0080] In this embodiment, after the target transmission data compressed package is sent to one or more clients of the navigation intervention visualization system in a network communication manner, the method further includes:

[0081] receiving a command data packet sent by one or more clients of the navigation intervention visualization system in a network communication manner;

[0082] The command data packet is parsed to obtain the command data; the command data is sent to the corresponding module in the server, so that the corresponding module performs the specified operation or reaches the specified state according to the command. When necessary, the remote user client is allowed to command and control the local user server to better assist the surgical process.

[0083] In this embodiment, the target transmission data compression package is sent to one or more clients of the navigation intervention visualization system in a network communication manner, specifically including:

[0084] According to the TCP protocol, the target transmission data compression package is sent to one or more clients of the navigation intervention visualization system in a network communication manner.

[0085] Specifically, the network communication method in this embodiment is a TCP socket communication connection. TCP is reliable and stable, and can guarantee data availability to a certain extent. It is most suitable for such a scenario where data loss is easily minimized.

[0086] The target transmission data compression package is sent to one or more clients of the navigation intervention visualization system in a network communication manner according to the TCP protocol, specifically including:

[0087] According to the TCP protocol, the target transmission data compressed packet is pushed to the communication data stack, so that the client can extract the target transmission data compressed packet from the communication data stack.

[0088] Of course, the target data compression package can also be transmitted according to other transmission protocols, such as a protocol based on TCP, such as the WebSocket protocol.

[0089] In addition, before obtaining the target transmission data, it also includes:

[0090] A network communication connection is established between a client of the navigation intervention visualization system and a server of the navigation intervention visualization system.

[0091] The present invention also proposes a remote data transmission method, which is applied to a client of a navigation intervention visualization system, comprising:

[0092] Receiving a target transmission data compression package sent by a server of a navigation intervention visualization system using any one of the above-mentioned remote data transmission methods;

[0093] The target transmission data compression package is decompressed and parsed to obtain the target transmission data; wherein the target transmission data includes point cloud data, two-dimensional image data, MRI data and text data.

[0094] The client in this embodiment is a user client. During data transmission, the user client first receives the target transmission data compressed package sent by the server, then decompresses and parses the target transmission data compressed package to obtain the target transmission data, and then displays the target transmission data. Therefore, the remote data transmission method in this embodiment is conducive to the simultaneous real-time display of the surgical scene on the local server and the remote client. It not only displays two-dimensional images, but also three-dimensional point cloud models rendered from point cloud data, realizing a multi-dimensional display of complex surgeries, facilitating the combined display of three-dimensional point clouds and MRI on the remote client, and enhancing the visibility of navigation interventional surgery on the remote client.

[0095] In order to obtain the target transmission data, in this embodiment, the target transmission data compressed packet is decompressed and parsed to obtain the target transmission data, specifically including:

[0096] Decompressing the target transmission data compression package to obtain the target transmission data packet;

[0097] Determine whether each data in the target transmission data packet is compressed;

[0098] If not, each data in the target transmission data packet is parsed separately, and all the parsed data are used as the target transmission data;

[0099] If so, decompress the compressed data in the target transmission data packet to obtain corresponding decompressed data;

[0100] The corresponding decompressed data and the uncompressed data in the target transmission data packet are parsed respectively, and all the parsed data are used as the target transmission data.

[0101] In this embodiment, before receiving the target transmission data compression package sent by the server of the navigation intervention visualization system, the method further includes:

[0102] A network communication connection is established between a client of the navigation intervention visualization system and a server of the navigation intervention visualization system.

[0103] The “network communication mode” in this embodiment includes one or more of a wired network communication mode, a wireless network communication mode, a local area network, and a wide area network.

[0104] Specifically, the network communication connection is a TCP socket connection, using the TCP protocol to establish a communication connection between the client and the server, binding the server's IP address and port number. TCP is reliable and stable, ensuring data availability to a certain extent, making it most suitable for scenarios where data loss is likely to be minimized.

[0105] Of course, in other embodiments, the network communication connection is a communication connection method using TCP as the underlying protocol, such as a WebSocket connection.

[0106] In this embodiment, after decompressing and parsing the target transmission data compressed packet to obtain the target transmission data, the following steps are further included:

[0107] Get command data;

[0108] Pack the commands into command data packets;

[0109] The command data packet is sent to the server of the navigation intervention visualization system via network communication, so that the server can perform the specified operation or reach the specified state according to the command, and allow the remote user client to command and control the local user server when necessary, so as to better assist the surgical process.

[0110] The present invention also proposes a server of a navigation intervention visualization system, comprising:

[0111] A first data transmission module, configured to implement any one of the above-mentioned remote data transmission methods;

[0112] The first data display module is used to display target transmission data.

[0113] The server in this embodiment is a user server, which is installed in the local environment of the navigation interventional surgery. The first data display module is used to display various data of the navigation interventional surgery, providing a visual platform for doctors or other local users who are performing the surgery. At the same time, the server is connected to the remote client via network communication, and the data source is provided to the client through the first data transmission module. This is conducive to the simultaneous display of multi-dimensional surgical scenes on the server and the client, solving the problem of incomplete display of surgical scenes in the existing technology.

[0114] In this embodiment, the first data transmission module includes:

[0115] an acquisition unit, configured to acquire target transmission data;

[0116] A data packing and compression unit is used to pack and compress the target transmission data to obtain a target transmission data compression package;

[0117] The first communication unit is configured to send the target transmission data compression package to one or more clients of the navigation intervention visualization system in a network communication manner.

[0118] During the data packaging and compression process, the data packaging and compression unit is used to monitor the network speed of one or more clients of the navigation intervention visualization system to receive the target transmission data compression package;

[0119] When the network speed is greater than or equal to a first preset threshold, the target transmission data is packaged to obtain a target transmission data packet, and the target transmission data packet is compressed to obtain a target transmission data compressed packet;

[0120] When the network speed is less than a first preset threshold, the point cloud data in the target transmission data is compressed to obtain a point cloud data compression package, and the point cloud data compression package is packaged with all other data in the target transmission data to obtain a target transmission data packet, and the target transmission data packet is compressed to obtain a target transmission data compression package.

[0121] In this embodiment, multi-level and multi-layer compression is performed on the target transmission data during the data transmission process, which solves the challenge of large-scale remote transmission of large amounts of data to the network environment and indirectly improves the quality of network communication.

[0122] In the further data packaging and compression process, the data packaging and compression unit is further used to monitor the CPU usage of one or more clients of the navigation intervention visualization system to receive the target transmission data compression package;

[0123] When the network speed is greater than or equal to a first preset threshold and the CPU usage is lower than a second preset threshold, losslessly compressing the target transmission data packet according to a preset lossless compression level to obtain a target transmission data compressed packet;

[0124] When the network speed is less than the first preset threshold and the CPU usage is lower than the second preset threshold, the user is prompted whether to perform manual lossless compression;

[0125] If so, prompting the user to manually set a lossless compression level, and performing lossless compression on the point cloud data in the target transmission data in response to the lossless compression level manually set by the user to obtain a lossless point cloud data compression package, and packaging the lossless point cloud data compression package with all other data in the target transmission data to obtain a target transmission data package, and performing lossless compression on the target transmission data package according to the preset lossless compression level to obtain a target transmission data compression package;

[0126] If not, the point cloud data in the target transmission data is adaptively lossily compressed to obtain a lossy point cloud data compression package, and the lossy point cloud data compression package is packaged with all other data in the target transmission data to obtain a target transmission data package, and the target transmission data package is losslessly compressed according to a preset lossless compression level to obtain a target transmission data compression package.

[0127] Specifically, when adaptive lossy compression is performed on the point cloud data in the target transmission data to obtain a lossy point cloud data compression package, it specifically includes:

[0128] Calculate the maximum value of the data packet that the current network allows to transmit based on the network speed;

[0129] The lossy compression ratio of the point cloud data is calculated based on the size of the target transmission data, the maximum size of the data packet allowed to be transmitted by the current network, and the preset lossless compression level;

[0130] Determine the lossy compression level of the point cloud data according to the lossy compression ratio of the point cloud data;

[0131] The point cloud data is lossily compressed according to the lossy compression level of the point cloud data to obtain a lossy compressed package of the point cloud data.

[0132] In this embodiment, a command processing module is also included. The first communication unit is also used to receive command data packets sent by one or more clients of the navigation intervention visualization system in a network communication manner. The command processing module parses the command data packets to obtain command data, and sends the command data to the corresponding module in the server, so that the corresponding module performs the specified operation or reaches the specified state according to the command, so as to allow the remote client to command and control the local server when necessary, so as to better assist the surgical process, solving the problem that it is difficult for the remote client to assist the local server.

[0133] The first communication unit sends the target transmission data compression package to one or more clients of the navigation intervention visualization system in a network communication manner according to the TCP protocol.

[0134] In this embodiment, a first user interaction module is further included, and the first user interaction module is used to provide an operation page for the server user to facilitate interaction with the server user.

[0135] The present invention also proposes a client of a navigation intervention visualization system, comprising:

[0136] A second data transmission module, configured to implement any of the above-mentioned remote data transmission methods;

[0137] The second data display module is used to display target transmission data.

[0138] The client in this embodiment is a user client, which is installed in a remote host environment and does not rely on a navigation interventional surgery environment. It directly establishes a network communication connection with the user server and receives server data through the second data transmission module, and displays three-dimensional point cloud data, two-dimensional images, text data, fields and other target transmission data through the second data display module, thereby realizing multi-dimensional display of surgical scenes and solving the problem of incomplete display of surgical scenes in existing technologies.

[0139] In this embodiment, the second data transmission module includes:

[0140] The second communication unit is used to receive the target transmission data compression package sent by the server of the navigation intervention visualization system;

[0141] The decompression and parsing unit is used to decompress and parse the target transmission data compressed package to obtain the target transmission data.

[0142] In a further embodiment, the decompression and parsing unit decompresses and parses the target transmission data compressed packet to obtain the target transmission data, specifically including:

[0143] Decompressing the target transmission data compression package to obtain the target transmission data packet;

[0144] Determine whether each data in the target transmission data packet is compressed;

[0145] If not, each data in the target transmission data packet is parsed separately, and all the parsed data are used as the target transmission data;

[0146] If so, decompress the compressed data in the target transmission data packet to obtain corresponding decompressed data;

[0147] The corresponding decompressed data and the uncompressed data in the target transmission data packet are parsed respectively, and all the parsed data are used as the target transmission data.

[0148] In this embodiment, the target transmission data compression package using multi-level and multi-layer compression can be decompressed and parsed, so that the target transmission data compression package using multi-level and multi-layer compression can be used for transmission during the data transmission between the client and the server, solving the challenges posed by remote data transmission of large amounts of data to the network environment, and indirectly improving the quality of remote communication between the client and the server.

[0149] The second communication unit is further configured to establish a network communication connection with the first communication unit before receiving the target transmission data compression package sent by the server of the navigation intervention visualization system.

[0150] Specifically, the network communication connection is a TCP connection. Of course, the network communication connection can also adopt other wireless transmission methods, such as a WebSocket connection with TCP as the underlying protocol.

[0151] In this embodiment, a second user interaction module is also included. The second user interaction module is used to provide an operation page for the client user to facilitate setting commands on the client, thereby realizing the remote end's control over the local end and solving the problem that it is difficult for the remote end to assist the local end.

[0152] The text data includes user operation panel information. The decompression and parsing unit extracts the user operation panel information from the text data in the target transmission data and sends it to the user interaction module for synchronous display.

[0153] In this embodiment, a command sending module is also included. The command sending module is used to obtain command data, package the commands into command data packets and send them to the second communication unit. The second communication unit is also used to send the command data packets to the server of the navigation intervention visualization system in a network communication manner, so that the server can perform specified operations or reach a specified state according to the commands, so as to allow the remote user client to perform command control on the local user server when necessary, so as to better assist the surgical process.

[0154] The present invention further proposes a navigation intervention visualization system, comprising a server as described in any one of the above items and one or more clients as described in any one of the above items.

[0155] like Figure 1 and Figure 2 As shown, the navigation intervention visualization system proposed in the present invention can simultaneously display the surgical scene on the local server and the remote client through the remote data transmission method described in any one of the above items, and can display not only two-dimensional images but also three-dimensional point cloud models rendered by point cloud data, thereby realizing multi-dimensional display of complex surgeries, being conducive to the combined display of three-dimensional point clouds and MRI on the remote client, and being conducive to enhancing the visibility of navigation intervention surgeries on the remote client.

[0156] The above description is only a preferred specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any technician familiar with the technical field, within the technical scope disclosed by the present invention, who makes equivalent replacements or changes based on the technical solution and inventive concept of the present invention, should be covered by the scope of protection of the present invention.

Claims

1. A remote data transmission method, applied to the server of a navigation intervention visualization system, characterized in that: include: Acquire target transmission data; wherein the target transmission data includes point cloud data, two-dimensional image data, MRI data and text data; monitoring the network speed of one or more clients of the navigation intervention visualization system to receive the target transmission data compressed packet; When the network speed is greater than or equal to a first preset threshold, the target transmission data is packaged to obtain a target transmission data packet, and the target transmission data packet is compressed to obtain a target transmission data compressed packet; When the network speed is less than a first preset threshold, compressing the point cloud data in the target transmission data to obtain a point cloud data compression package, packaging the point cloud data compression package with all other data in the target transmission data to obtain a target transmission data packet, and compressing the target transmission data packet to obtain a target transmission data compression package; The target transmission data compression package is sent to one or more clients of the navigation intervention visualization system in a network communication manner.

2. The remote data transmission method according to claim 1, characterized in that: While monitoring the network speed of one or more clients of the navigation intervention visualization system to receive the target transmission data compression packet, the method further includes: monitoring CPU usage of one or more clients of the navigation intervention visualization system to receive the target transmission data compression packet; When the network speed is greater than or equal to a first preset threshold and the CPU usage is lower than a second preset threshold, losslessly compressing the target transmission data packet according to a preset lossless compression level to obtain a target transmission data compressed packet; When the network speed is less than the first preset threshold and the CPU usage is lower than the second preset threshold, the user is prompted whether to perform manual lossless compression; If so, prompting the user to manually set a lossless compression level, and performing lossless compression on the point cloud data in the target transmission data in response to the lossless compression level manually set by the user to obtain a lossless point cloud data compression package, and packaging the lossless point cloud data compression package with all other data in the target transmission data to obtain a target transmission data package, and performing lossless compression on the target transmission data package according to the preset lossless compression level to obtain a target transmission data compression package; If not, the point cloud data in the target transmission data is adaptively lossily compressed to obtain a lossy point cloud data compression package, and the lossy point cloud data compression package is packaged with all other data in the target transmission data to obtain a target transmission data package, and the target transmission data package is losslessly compressed according to a preset lossless compression level to obtain a target transmission data compression package.

3. The remote data transmission method according to claim 2, characterized in that: When adaptive lossy compression is performed on the point cloud data in the target transmission data to obtain a lossy point cloud data compression package, it specifically includes: Calculate the maximum value of the data packet that the current network allows to transmit based on the network speed; The lossy compression ratio of the point cloud data is calculated based on the size of the target transmission data, the maximum size of the data packet allowed to be transmitted by the current network, and the preset lossless compression level; Determine the lossy compression level of the point cloud data according to the lossy compression ratio of the point cloud data; The point cloud data is lossily compressed according to the lossy compression level of the point cloud data to obtain a lossy compressed package of the point cloud data.

4. The remote data transmission method according to claim 1, wherein: After sending the target transmission data compressed package to one or more clients of the navigation intervention visualization system in a network communication manner, the method further includes: receiving a command data packet sent by one or more clients of the navigation intervention visualization system in a network communication manner; Parse the command data packet to obtain command data; And send the command data to the corresponding module in the server.

5. A remote data transmission method, applied to a client of a navigation intervention visualization system, characterized in that: include: Receiving a target transmission data compression package sent by a server of a navigation intervention visualization system using the remote data transmission method according to any one of claims 1 to 4; The target transmission data compression package is decompressed and parsed to obtain the target transmission data; wherein the target transmission data includes point cloud data, two-dimensional image data, MRI data and text data.

6. The remote data transmission method according to claim 5, characterized in that: Decompress and parse the target transmission data compressed package to obtain the target transmission data, specifically including: Decompressing the target transmission data compression package to obtain the target transmission data packet; Determine whether each data in the target transmission data packet is compressed; If not, each data in the target transmission data packet is parsed separately, and all the parsed data are used as the target transmission data; If so, decompress the compressed data in the target transmission data packet to obtain corresponding decompressed data; The corresponding decompressed data and the uncompressed data in the target transmission data packet are parsed respectively, and all the parsed data are used as the target transmission data.

7. The remote data transmission method according to claim 5, characterized in that: After decompressing and parsing the target transmission data compressed package to obtain the target transmission data, the following steps are also included: Get command data; Pack the commands into command data packets; The command data packet is sent to the server of the navigation intervention visualization system via network communication.

8. A navigation intervention visualization system server, characterized in that: include: A first data transmission module, configured to implement the remote data transmission method according to any one of claims 1 to 4; The first data display module is used to display target transmission data.

9. A client of a navigation intervention visualization system, characterized in that: include: A second data transmission module, configured to implement the remote data transmission method according to any one of claims 5 to 7; The second data display module is used to display target transmission data.

10. A navigation intervention visualization system, characterized in that: The system comprises a server of the navigation intervention visualization system according to any one of claims 8 and one or more clients of the navigation intervention visualization system according to any one of claims 9.

Images