Network delay prompting method and device for remote surgery, electronic equipment and storage medium

Abstract

The invention discloses a network delay prompting method and device for a remote operation, electronic equipment and a storage medium. The method comprises the steps that a real-time network signal of an end-to-end connection network is obtained, and the end-to-end connection network is a connection network between a control end and an execution end of a remote operation; determining a network delay level of the end-to-end connection network based on the real-time network signal; and under the condition that the network delay level meets a delay prompt condition, respectively carrying out network delay prompt through a first prompt device installed at the control end and a second prompt device installed at the execution end. According to the invention, real-time monitoring of the network condition in the remote operation process can be realized, and network delay prompting can be timely carried out on an operation operator under the condition of network delay, so that the operation operator can carry out corresponding operation control adjustment, and smooth operation is ensured; network delay prompts are respectively carried out on the execution end and the control end of the remote surgery, and end-to-end prompt synchronization in the surgery process can be realized.

Description

Technical Field

[0001] The present invention relates to the field of computer application technology, and in particular to a network delay prompt method, device, electronic device and storage medium for remote surgery. Background Art

[0002] During remote surgery, network delays can cause higher surgical risks. If there is a large network delay, the remote surgery can only be suspended and switched to local surgery.

[0003] In the case of network delay, the screen feedback will be stuck accordingly. At present, when the surgical operator observes that the screen feedback is stuck, it is clear that there is a network delay and corresponding measures are taken. However, there is a lag in the screen feedback under network delay, that is, the above method makes it difficult for the surgical operator to promptly identify the occurrence of network delay. Summary of the invention

[0004] The present invention provides a network delay prompt method, device, electronic device and storage medium for remote surgery, so as to solve the technical problem that the surgical operator cannot promptly identify the occurrence of network delay.

[0005] According to one aspect of the present invention, a method for prompting network delay in remote surgery is provided, the method comprising:

[0006] Acquiring a real-time network signal of an end-to-end connection network, wherein the end-to-end connection network is a connection network between a control end and an execution end of a remote surgery;

[0007] determining a network delay level of the end-to-end connection network based on the real-time network signal;

[0008] When the network delay level meets the delay prompt condition, a network delay prompt is respectively performed by a first prompt device installed on the control end and a second prompt device installed on the execution end.

[0009] According to another aspect of the present invention, a network delay prompting device for remote surgery is provided, the device comprising:

[0010] A signal receiving module, used for acquiring a real-time network signal of an end-to-end connection network, wherein the end-to-end connection network is a connection network between a control end and an execution end of a remote surgery;

[0011] a level determination module, configured to determine a network delay level of the end-to-end connection network based on the real-time network signal;

[0012] The delay prompt module is used to provide network delay prompts through a first prompt device installed on the control end and a second prompt device installed on the execution end respectively when the network delay level meets the delay prompt conditions.

[0013] According to another aspect of the present invention, an electronic device is provided, the electronic device comprising:

[0014] at least one processor; and

[0015] a memory communicatively connected to the at least one processor; wherein,

[0016] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the network delay prompt method for remote surgery described in any embodiment of the present invention.

[0017] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the network delay prompt method for remote surgery described in any embodiment of the present invention when executed.

[0018] The technical solution of the embodiment of the present invention is to obtain a real-time network signal of an end-to-end connection network, wherein the end-to-end connection network is a connection network between the control end and the execution end of the remote surgery; determine the network delay level of the end-to-end connection network based on the real-time network signal; and when the network delay level meets the delay prompt condition, respectively provide a network delay prompt through a first prompt device installed on the control end and a second prompt device installed on the execution end. The present invention realizes real-time monitoring of the network status during remote surgery, and in the event of network delay, promptly provides network delay prompts to the surgeon, so that the surgeon can make corresponding surgical control adjustments to ensure the smooth progress of the surgery; the present invention respectively provides network delay prompts to the execution end and the control end of the remote surgery, thereby realizing end-to-end prompt synchronization during the surgery.

[0019] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0021] Figure 1 is a flow chart of a network delay prompt method for remote surgery provided according to Embodiment 1 of the present invention;

[0022] Figure 2 is an architecture diagram of a network delay prompt system for remote surgery provided according to an embodiment of the present invention;

[0023] Figure 3 is a flow chart of a network delay prompt method for remote surgery provided according to Embodiment 2 of the present invention;

[0024] Figure 4 is a schematic diagram of the structure of a network delay prompt device for remote surgery provided according to Embodiment 3 of the present invention;

[0025] Figure 5 It is a schematic diagram of the structure of an electronic device for implementing the network delay prompt method for remote surgery according to an embodiment of the present invention. DETAILED DESCRIPTION

[0026] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0027] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0028] Embodiment 1

[0029] Figure 1 A flowchart of a method for prompting a network delay in remote surgery is provided for the first embodiment of the present invention. This embodiment can be applied to the case where a network delay occurs during a remote surgery to prompt a surgical operator. The method can be performed by a network delay prompting device for remote surgery. The network delay prompting device for remote surgery can be implemented in the form of hardware and / or software. The network delay prompting device for remote surgery can be configured in a computer. Figure 1 As shown, the method includes:

[0030] S110: Acquire a real-time network signal of an end-to-end connection network.

[0031] The end-to-end connection network is a connection network between the control end and the execution end of the remote surgery.

[0032] Optionally, obtaining a real-time network signal of an end-to-end connection network includes:

[0033] The real-time network signal of the end-to-end connection network is received in real time by a network signal receiver installed on the surgical console of the control end.

[0034] The embodiments of the present invention can be applied to remote surgery using a surgical robot. Figure 2 1 is an architecture diagram of a network delay prompt system for remote surgery provided according to an embodiment of the present invention. Figure 2 As shown, the remote surgery of the surgical robot may involve a control end (remote end in the figure) and an execution end (local end in the figure). The control end may be understood as the control end of the surgical operator. The local execution end may be understood as the execution end of the surgery.

[0035] Among them, the network signal receiver can have the function of receiving in real time the network signal of the end-to-end connection network between the control end and the execution end of the remote surgery.

[0036] The end-to-end connection network can be used to transmit surgery-related information between the control end and the execution end in real time. Figure 2 , the end-to-end connection network can be network 1 or network 2.

[0037] The real-time network signal may be understood as a network signal corresponding to the end-to-end connection network received in real time by a network signal receiver.

[0038] In the embodiment of the present invention, optionally, a network signal receiver may be installed on the surgical console of the execution end. The network signal receiver of the execution end may also be used to receive in real time the network signal of the end-to-end connection network between the control end and the execution end of the remote surgery.

[0039] S120. Determine a network delay level of the end-to-end connection network based on the real-time network signal.

[0040] The network delay level may represent the delay of the end-to-end connection network. Optionally, the network delay level may include a no delay level, a low delay level, a high delay level, etc.

[0041] Optionally, determining the network delay level of the end-to-end connection network based on the real-time network signal includes:

[0042] Determining specific network information corresponding to the real-time network signal;

[0043] Determining a network delay level of the end-to-end connection network according to the specific network information;

[0044] After determining the specific network information corresponding to the real-time network signal, the method further includes:

[0045] The specific network information is displayed respectively by a first display device installed at the control end and a second display device installed at the execution end.

[0046] The specific network information may be specific information related to network delay. The specific network information may characterize the specific delay of the end-to-end connection network. Optionally, the specific network information may be specific information of network speed or specific information of network delay. Exemplarily, the specific information of network delay may be 0ms, 60ms, 80ms or 120ms, etc.

[0047] Based on the above-mentioned embodiment scheme, the effect of real-time display of specific information of the end-to-end connection network at both ends (control end and execution end) is achieved, so that the surgical operator can understand the specific situation of the network delay in real time.

[0048] Specifically, determining the network delay level of the end-to-end connection network according to the specific network information includes:

[0049] A target delay interval to which the specific network information belongs is determined, and a network delay level of the end-to-end connection network is determined according to the target delay interval.

[0050] Exemplarily, the target delay interval may include [0, 60ms), [60ms, 120ms) or [120ms, 200ms) and the like. In an embodiment of the present invention, the network delay level and the target delay interval may be mapped one-to-one. For example, the no delay level is mapped to [0, 60ms) , the low delay level is mapped to [60ms, 120ms) , and the high delay level is mapped to [120ms, 200ms) . Specifically, when the specific network information is 80ms, the target delay interval is determined to be [60ms, 120ms) , and the network delay level of the end-to-end connection network is determined to be a low delay level.

[0051] The first display device and the second display device may be devices with information display functions installed on the surgical console of the control end and the surgical console of the execution end, respectively. In the embodiment of the present invention, the display device may be preset according to the scene requirements, and is not specifically limited here. Optionally, the display device may be three-dimensional glasses and / or a two-dimensional display screen.

[0052] S130: When the network delay level meets the delay prompt condition, a network delay prompt is respectively performed through a first prompt device installed on the control end and a second prompt device installed on the execution end.

[0053] Among them, the delay prompt condition is used to determine whether to perform a network delay prompt for the current network delay level. In an embodiment of the present invention, the delay prompt condition can be preset according to the scenario requirements and is not specifically limited here. Optionally, the delay prompt condition may be that the network delay level exceeds a preset prompt delay level. Among them, the prompt delay level may include a no delay level, a low delay level or a high delay level. Exemplarily, in the case where the prompt delay level is a no delay level, if the network delay level is a low delay level or a high delay level, it is considered that the network delay level meets the delay prompt condition.

[0054] In an embodiment of the present invention, the no-delay class exceeds the low-delay class, and the low-delay class exceeds the high-delay class.

[0055] The first prompt device may be a device with a prompt function installed on the surgical console of the control end. The second prompt device may be a device with a prompt function installed on the surgical console of the execution end. In the embodiment of the present invention, the prompt device can be preset according to the scene requirements and is not specifically limited here. Optionally, the prompt device may be a three-dimensional glasses for displaying the surgical screen, a virtual light and shadow prompt light on the four sides of the frame in a two-dimensional display screen, or a physical prompt light on the surgical console.

[0056] Optionally, when the network delay level meets the delay prompt condition, performing a network delay prompt respectively by a first prompt device installed on the control end and a second prompt device installed on the execution end includes:

[0057] When the network delay level satisfies the delay prompt condition, a delay prompt signal is generated, and the delay prompt signal is sent to the first prompt device of the control end and the second prompt device of the execution end respectively;

[0058] The network delay prompt is performed by the first prompt device and the second prompt device respectively.

[0059] In the embodiment of the present invention, the prompting devices of the control end and the execution end can be the same or different. The embodiment of the present invention achieves the effect of providing network delay prompts to both ends of the remote surgery.

[0060] Optionally, before sending the delay prompt signal to the first prompt device of the control end and the second prompt device of the execution end respectively, the method further includes:

[0061] In response to the prompt mode selection operation, determining a first prompt mode of the control end and a second prompt mode of the execution end, wherein the prompt mode includes a physical light prompt mode, a two-dimensional screen prompt mode, or a three-dimensional glasses prompt mode;

[0062] The method of sending the delay prompt signal to the first prompt device of the control end and the second prompt device of the execution end respectively includes:

[0063] Determine a first prompting device based on the first prompting mode, and determine a second prompting device based on the second prompting mode;

[0064] The delayed prompt signal is sent to the first prompt device at the control end and the second prompt device at the execution end respectively.

[0065] In an embodiment of the present invention, the first prompt mode and the second prompt mode may be different or the same. Exemplarily, the first prompt device is a 3D glasses, and the second prompt device is a virtual light and shadow prompt light on the four sides of the 2D display screen.

[0066] Based on the above-mentioned embodiment scheme, the prompt mode of network delay can be pre-selected based on the personalized needs of the surgical operator, thereby meeting the personalized needs of the surgical operator for the network delay prompt mode and improving the user experience.

[0067] Optionally, after determining the network delay level of the end-to-end connection network based on the real-time network signal, the method further includes:

[0068] When the network delay level satisfies the network switching condition, displaying a network switching control on the two-dimensional display screen of the surgical console at the control end;

[0069] In response to a target trigger operation on the network switching control, a backup network switching is performed on the remote transmission network.

[0070] Among them, the network switching condition is used to determine whether to perform a network switching prompt for the current network delay level. In an embodiment of the present invention, the network switching condition can be preset according to the scenario requirements and is not specifically limited here. Optionally, the delay prompt condition may be that the network delay level exceeds a preset prompt switching level. Among them, the prompt switching level may include a no delay level, a low delay level or a high delay level, etc. Exemplarily, when the prompt delay level is a low delay level, if the network delay level is a high delay level, it is considered that the network delay level meets the network switching condition.

[0071] The network switching control may be understood as a virtual control for switching a backup network.

[0072] In the embodiment of the present invention, the network switching control may include a switching confirmation option and / or a switching cancellation button. The target trigger operation may be a trigger operation for the switching confirmation option.

[0073] like Figure 2 As shown, illustratively, network 1 may be the end-to-end connection network, and network 2 may be a backup network.

[0074] Specifically, in response to a target trigger operation on the network switching control, network 1 is switched to network 2, and surgical information is transmitted between the control end and the execution end via network 2.

[0075] Or, specifically, in response to the cancel trigger operation on the network switching control, the surgical information transmission between the control end and the execution end continues through the network 1. The cancel trigger operation may be a trigger operation on the switch cancel option.

[0076] Based on the above technical solution, when there is a serious network delay in the end-to-end connection network, the backup network can be switched based on user needs to ensure the smoothness of the connection network and the smooth progress of the operation.

[0077] The technical solution of the embodiment of the present invention is to obtain a real-time network signal of an end-to-end connection network, wherein the end-to-end connection network is a connection network between the control end and the execution end of the remote surgery; determine the network delay level of the end-to-end connection network based on the real-time network signal; and when the network delay level meets the delay prompt condition, respectively provide a network delay prompt through a first prompt device installed on the control end and a second prompt device installed on the execution end. The present invention realizes real-time monitoring of the network status during remote surgery, and in the event of network delay, promptly provides network delay prompts to the surgeon, so that the surgeon can make corresponding surgical control adjustments to ensure the smooth progress of the surgery; the present invention respectively provides network delay prompts to the execution end and the control end of the remote surgery, thereby realizing end-to-end prompt synchronization during the surgery.

[0078] Embodiment 2

[0079] Figure 3 This is a flowchart of a method for prompting network delay in remote surgery provided in the second embodiment of the present invention. This embodiment is a refinement of the network delay prompting by the first prompting device installed on the control terminal in the above embodiment. Figure 3 As shown, the method includes:

[0080] S210: Acquire a real-time network signal of the end-to-end connection network.

[0081] S220. Determine a network delay level of the end-to-end connection network based on the real-time network signal.

[0082] Optionally, the first prompting device includes a first three-dimensional glasses for displaying surgical images.

[0083] The first three-dimensional glasses can be understood as the three-dimensional glasses used for displaying surgical images at the control end.

[0084] S230. When the network delay level meets the delay prompt condition, execute S2301 and S2302 simultaneously.

[0085] S2301. Determine a target identification form according to the network delay level, and display a target prompt identification in the target identification form in an overlay manner through the first three-dimensional glasses at the control end.

[0086] Wherein, the target prompt mark is superimposed and displayed on the surgical screen.

[0087] The target identification form may be understood as the form of a target prompt identification.

[0088] In the embodiment of the present invention, the target prompt mark may be preset and fixed. For example, the target prompt mark may be a prompt word or a prompt image.

[0089] For different network delay levels, the target identification form corresponding to the target prompt identification may be different. Optionally, the target identification form may be the font of the prompt word or the size of the prompt map.

[0090] Optionally, the target prompt identifier of the target identifier form mapped to the network delay level corresponding to the network delay level is determined by the level form identifier mapping relationship, wherein the level form identifier mapping relationship includes a mapping relationship between multiple network delay levels, multiple candidate forms and multiple candidate identifiers.

[0091] In the embodiment of the present invention, the level form identifier mapping relationship can be preset according to user needs and scenario requirements, and is not specifically limited here.

[0092] Optionally, the level morphology identification mapping relationship includes mapping the low delay level with a prompt word of the first type, and mapping the high delay level with a prompt map of the first size. Exemplarily, the first type may be "delay prompt", "mild delay prompt" or "severe delay prompt".

[0093] Optionally, the first prompt device includes virtual light and shadow prompt lights on four sides of the first two-dimensional display screen, and the network delay prompt is performed by the first prompt device installed on the control end, including:

[0094] The flashing frequency of the prompt light is determined according to the network delay level, and the lights of the prompt light flashing frequency are flashed by virtual light and shadow prompt lights on the four sides of the first two-dimensional display screen.

[0095] Among them, the first two-dimensional display screen can be understood as a two-dimensional display screen of the control end for displaying the surgical screen.

[0096] The flashing frequency of the prompt light can be understood as the flashing frequency of the virtual light and shadow prompt light.

[0097] The virtual light and shadow prompt light can be understood as a virtual prompt light with light and shadow flickering function inside the two-dimensional display screen. The virtual light and shadow prompt light can also be understood as an edge screen of the four sides of the two-dimensional display screen.

[0098] In the embodiment of the present invention, the virtual light and shadow prompt light may be preset and fixed.

[0099] For different network delay levels, the flashing frequency of the prompt light corresponding to the virtual light and shadow prompt light may be different. Optionally, the virtual light and shadow prompt light may be 1 time / second or 2 times / second, etc.

[0100] Optionally, the flashing frequency of the indicator light mapped to the network delay level corresponding to the network delay level is determined by the level-frequency mapping relationship, wherein the level-frequency mapping relationship includes a mapping relationship between a plurality of the network delay levels and a plurality of candidate frequencies.

[0101] In the embodiment of the present invention, the level-frequency mapping relationship may be preset according to user requirements and scenario requirements, and is not specifically limited here.

[0102] Optionally, the first prompt device includes a first physical prompt light, and the network delay prompt is performed by the first prompt device installed on the control terminal, including:

[0103] A target color is determined according to the network delay level, and the target color is displayed by the first physical prompt light.

[0104] The first physical indicator light can be understood as a physical indicator light of the control terminal. Exemplarily, the physical indicator light can be a light emitting diode or the like.

[0105] For different network delay levels, the target color corresponding to the virtual light and shadow prompt light may be different. Optionally, the target color may be red, yellow, green, or the like.

[0106] Optionally, the target color mapped to the network delay level corresponding to the network delay level is determined by the level-color mapping relationship, wherein the level-color mapping relationship includes mapping relationships between multiple network delay levels and multiple candidate colors.

[0107] In the embodiment of the present invention, the level color mapping relationship can be preset according to user needs and scene requirements, and is not specifically limited here. Exemplarily, the level color mapping relationship includes mapping low delay level with yellow, mapping high delay level with red, etc.

[0108] S2302: Prompt network delays through a second prompting device installed at the execution end.

[0109] Optionally, the second prompting device includes a second three-dimensional pair of glasses for displaying the surgical screen and / or virtual light and shadow prompt lights on four sides of the frame in a second two-dimensional display screen.

[0110] The second three-dimensional glasses can be understood as the three-dimensional glasses used for displaying the surgical images at the execution end. The second two-dimensional display screen can be understood as the two-dimensional display screen used for displaying the surgical images at the execution end.

[0111] The following is an overall exemplary description of the network delay prompt method for remote surgery:

[0112] like Figure 2 As shown, the execution subject can be the controller corresponding to the remote communication control module in the operating end (remote end). For the operating end, a network signal receiver is installed on the surgical console; the network signal receiver can determine the network delay level in real time, and when network delay or network fluctuation occurs, select the appropriate prompt method to provide network delay prompts, so that the surgical operator can obtain specific network information and respond in time.

[0113] In the embodiment of the present invention, a network delay of 0-60ms can be regarded as a non-delay network, a network delay of 60-120ms can be regarded as a lightly delayed network, that is, a low delay level, and a network delay of more than 120ms can be regarded as a heavy delay network, that is, a high delay level.

[0114] In the embodiment of the present invention, the optional prompting methods based on the needs of the surgical operator are as follows:

[0115] 1. The physical indicator light is always on. For example, when the network is normal, the green light is displayed; when there is a slight delay, the yellow light is displayed; when there is a severe delay, the red light is displayed.

[0116] 2. The virtual light and shadow indicator lights on the four sides of the two-dimensional display screen are always on. For example, when the network is normal, a green light is displayed; when there is a slight delay, a yellow light is displayed; when there is a severe delay, a red light is displayed.

[0117] 3. The virtual light and shadow indicator lights on the four sides of the two-dimensional display screen are always on and flashing. For example, when the network is normal, there is no flashing; when there is a slight delay, the lights flash at a low frequency; when there is a severe delay, the lights flash at a high frequency.

[0118] 4. The display prompt logo of the 3D glasses is superimposed. For example, when the network is normal, there is no display; when there is a slight delay, it will display "network delay 80ms"; when there is a severe delay, it will display "network delay 130ms".

[0119] Based on the technical solution of the present invention, timely reminders of network delays can be achieved to ensure the normal progress of remote-controlled surgery. The effect of enabling the surgical operator to respond in time after the network delay prompt occurs, such as switching to a backup network or slowing down the operation speed, etc. The effect of real-time understanding of the specific information of the network delay is achieved. The effect of network delay prompts based on the personalized needs of the surgical operator is achieved.

[0120] Embodiment 3

[0121] Figure 4 This is a schematic diagram of the structure of a network delay prompt device for remote surgery provided by the third embodiment of the present invention. Figure 4 As shown, the device includes: a signal receiving module 310 , a level determining module 32 and a delay prompting module 330 .

[0122] Among them, the signal receiving module 310 is used to obtain the real-time network signal of the end-to-end connection network, wherein the end-to-end connection network is the connection network between the control end and the execution end of the remote surgery; the level determination module 320 is used to determine the network delay level of the end-to-end connection network based on the real-time network signal; the delay prompt module 330 is used to provide network delay prompts through a first prompt device installed on the control end and a second prompt device installed on the execution end when the network delay level meets the delay prompt conditions.

[0123] The technical solution of the embodiment of the present invention is to obtain a real-time network signal of an end-to-end connection network, wherein the end-to-end connection network is a connection network between the control end and the execution end of the remote surgery; determine the network delay level of the end-to-end connection network based on the real-time network signal; and when the network delay level meets the delay prompt condition, respectively provide a network delay prompt through a first prompt device installed on the control end and a second prompt device installed on the execution end. The present invention realizes real-time monitoring of the network status during remote surgery, and in the event of network delay, promptly provides network delay prompts to the surgeon, so that the surgeon can make corresponding surgical control adjustments to ensure the smooth progress of the surgery; the present invention respectively provides network delay prompts to the execution end and the control end of the remote surgery, thereby realizing end-to-end prompt synchronization during the surgery.

[0124] Optionally, the signal receiving module 310 is specifically configured to:

[0125] The real-time network signal of the end-to-end connection network is received in real time by a network signal receiver installed on the surgical console of the control end.

[0126] Optionally, the first prompting device includes a first three-dimensional glasses for displaying the surgical screen, and a delay prompting module 330, which is specifically used to:

[0127] The target identification form is determined according to the network delay level, and a target prompt mark in the target identification form is superimposed and displayed through the first three-dimensional glasses on the control end, wherein the target prompt mark is superimposed and displayed on the surgical screen.

[0128] Optionally, the first prompting device includes virtual light and shadow prompting lights on four sides of the first two-dimensional display screen, and the delay prompting module 330 is specifically used to:

[0129] The flashing frequency of the prompt light is determined according to the network delay level, and the lights of the prompt light flashing frequency are flashed by virtual light and shadow prompt lights on the four sides of the first two-dimensional display screen.

[0130] Optionally, the second prompting device includes a second three-dimensional pair of glasses for displaying the surgical screen and / or virtual light and shadow prompt lights on four sides of the frame in a second two-dimensional display screen.

[0131] Optionally, the network delay prompting device for remote surgery further includes: a switching control display module and a backup network switching module;

[0132] Wherein, the switching control display module is used to display the network switching control on the two-dimensional display screen of the surgical console at the control end after the network delay level of the end-to-end connection network is determined based on the real-time network signal, if the network delay level meets the network switching condition;

[0133] The backup network switching module is used to perform backup network switching on the remote transmission network in response to a target trigger operation on the network switching control.

[0134] Optionally, the level determination module 320 includes: a specific information determination unit and a level determination unit;

[0135] Wherein, the specific information determining unit is used to determine the specific network information corresponding to the real-time network signal;

[0136] The level determination unit determines the network delay level of the end-to-end connection network according to the specific network information;

[0137] The level determination module 320 further includes:

[0138] The specific information display unit is used to display the specific network information respectively through a first display device installed on the control end and a second display device installed on the execution end after determining the specific network information corresponding to the real-time network signal.

[0139] The network delay prompt device for remote surgery provided in the embodiment of the present invention can execute the network delay prompt method for remote surgery provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0140] Embodiment 4

[0141] Figure 5A schematic diagram of the structure of an electronic device 10 that can be used to implement an embodiment of the present invention is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0142] like Figure 5 As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0143] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0144] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as a network delay prompt method for remote surgery.

[0145] In some embodiments, the network delay prompt method for remote surgery can be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the network delay prompt method for remote surgery described above can be performed. Alternatively, in other embodiments, the processor 11 can be configured to execute the network delay prompt method for remote surgery in any other appropriate manner (for example, by means of firmware).

[0146] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0147] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0148] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0149] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0150] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0151] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0152] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0153] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A network delay prompting method for remote surgery, characterized in that: include: Acquiring a real-time network signal of an end-to-end connection network, wherein the end-to-end connection network is a connection network between a control end and an execution end of a remote surgery; determining a network delay level of the end-to-end connection network based on the real-time network signal; When the network delay level meets the delay prompt condition, a network delay prompt is respectively performed by a first prompt device installed on the control end and a second prompt device installed on the execution end.

2. The method according to claim 1, characterized in that The step of obtaining a real-time network signal of an end-to-end connection network includes: The real-time network signal of the end-to-end connection network is received in real time by a network signal receiver installed on the surgical console of the control end.

3. The method according to claim 1, characterized in that The first prompt device includes a first three-dimensional pair of glasses for displaying a surgical screen, and the network delay prompt is performed by the first prompt device installed on the control end, including: The target identification form is determined according to the network delay level, and a target prompt mark in the target identification form is superimposed and displayed through the first three-dimensional glasses on the control end, wherein the target prompt mark is superimposed and displayed on the surgical screen.

4. The method according to claim 1, characterized in that: The first prompt device includes virtual light and shadow prompt lights on the four sides of the first two-dimensional display screen, and the network delay prompt is performed by the first prompt device installed on the control end, including: The flashing frequency of the prompt light is determined according to the network delay level, and the lights of the prompt light flashing frequency are flashed by virtual light and shadow prompt lights on the four sides of the first two-dimensional display screen.

5. The method according to claim 1, characterized in that The second prompting device includes a second three-dimensional pair of glasses for displaying the surgical image and / or virtual light and shadow prompting lights on the surrounding frames of a second two-dimensional display screen.

6. The method according to claim 1, characterized in that After determining the network delay level of the end-to-end connection network based on the real-time network signal, the method further includes: When the network delay level satisfies the network switching condition, displaying a network switching control on the two-dimensional display screen of the surgical console at the control end; In response to a target trigger operation on the network switching control, a backup network switching is performed on the remote transmission network.

7. The method according to claim 1, characterized in that The determining the network delay level of the end-to-end connection network based on the real-time network signal comprises: Determining specific network information corresponding to the real-time network signal; Determining a network delay level of the end-to-end connection network according to the specific network information; After determining the specific network information corresponding to the real-time network signal, the method further includes: The specific network information is displayed respectively by a first display device installed at the control end and a second display device installed at the execution end.

8. A network delay prompting device for remote surgery, characterized in that: include: A signal receiving module, used to obtain a real-time network signal of an end-to-end connection network, wherein the end-to-end connection network is a connection network between a control end and an execution end of a remote surgery; a level determination module, configured to determine a network delay level of the end-to-end connection network based on the real-time network signal; The delay prompt module is used to provide network delay prompts through a first prompt device installed on the control end and a second prompt device installed on the execution end respectively when the network delay level meets the delay prompt conditions.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to perform the network delay prompt method for remote surgery according to any one of claims 1-7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the network delay prompt method for remote surgery according to any one of claims 1 to 7 when executed.

Images