Operating room control system, operating room control method and storage medium

Abstract

The invention discloses an operating room control system, an operating room control method and a storage medium, and an interaction device in the operating room control system is used for outputting a second video signal and receiving marking information of a user for the second video signal, the second video signal is generated by encoding and decoding a first video signal provided by a first video source device; the control device is used for responding to the first selection instruction and controlling all or part of the at least one display device to output a third video signal; wherein the first selection instruction is used for selecting one video signal from the fourth video signal and the first video signal provided by each first video source device; the third video signal is generated by encoding and decoding the video signal selected by the first selection instruction; the fourth video signal is obtained by synthesizing the second video signal or the first video signal and marking information obtained from an interaction device capable of marking the second video signal.

Description

Technical Field

[0001] This application relates to the field of wireless technologies, and in particular, to an operating room control system, an operating room control method, and a storage medium. Background Art

[0002] To meet the needs of surgical teaching, medical staff or teaching staff will mark on the surgical video while playing the surgical video to achieve a better teaching effect. In related technologies, viewers can only view the marks on the surgical video through the device that makes the marks, and the acquisition channels of the mark information are limited, which affects the teaching effect. Summary of the Invention

[0003] To solve the related technical problems, embodiments of this application provide an operating room control system, an operating room control method, and a storage medium.

[0004] The technical solutions of the embodiments of this application are implemented as follows:

[0005] Embodiments of this application provide an operating room control system, including a control device, at least one first video source device, at least one interaction device, and at least one display device;

[0006] The first video source device is configured to provide a first video signal related to a surgery;

[0007] The interaction device is configured to output a second video signal and to receive mark information of a user on the second video signal; the second video signal is generated based on encoding and decoding the first video signal provided by the first video source device;

[0008] The control device is configured to, in response to a first selection instruction, control all or part of the at least one display device to output a third video signal; wherein,

[0009] The first selection instruction is used to select a video signal from a fourth video signal and the first video signals provided by the respective first video source devices of the at least one first video source device; the third video signal is generated based on encoding and decoding the video signal selected by the first selection instruction;

[0010] The fourth video signal is synthesized based on the second video signal and the mark information obtained from the interaction device capable of marking on the second video signal; or, the fourth video signal is synthesized based on the first video signal and the mark information obtained from the interaction device capable of marking on the second video signal.

[0011] An embodiment of the present application further provides an operating room control system, including a control device, at least one first video source device, a second video source device, at least one interaction device, and at least one display device;

[0012] The first video source device is configured to provide a first video picture related to the surgery;

[0013] The second video source device is configured to provide a second video picture with marking information added to the first video picture;

[0014] The control device is configured to control the output of the first video picture provided by the first video source device to the interaction device, so that the interaction device outputs the first video picture and receives the marking information of the user on the first video picture;

[0015] The interaction device is configured to output the first video picture and to receive the marking information of the user on the first video picture;

[0016] The control device is further configured to control the output of the video picture provided by one of the second video source device and the at least one first video source device to one of the at least one display device.

[0017] An embodiment of the present application further provides an operating room control method, which is applied to the control device in the operating room control system; the operating room control system further includes at least one first video source device, at least one interaction device, and at least one display device;

[0018] The method includes:

[0019] In response to a first selection instruction, controlling all or part of the display devices in the at least one display device to output a third video signal; wherein,

[0020] The first selection instruction is used to select a video signal from a fourth video signal and the first video signals related to the surgery provided by each of the at least one first video source device; the third video signal is generated based on the video signal selected by the first selection instruction after encoding and decoding; the fourth video signal is synthesized based on the second video signal and the marking information obtained from the interaction device capable of marking the second video signal, and the second video signal is generated based on the first video signal provided by the first video source device after encoding and decoding; or, the fourth video signal is synthesized based on the first video signal and the marking information obtained from the interaction device capable of marking the first video signal.

[0021] An embodiment of the present application also provides an operating room control method, which is applied to a control device in an operating room control system; the operating room control system further includes at least one first video source device, a second video source device, at least one interaction device, and at least one display device;

[0022] The method includes:

[0023] Controlling to output a first video picture provided by the first video source device to the interaction device for the interaction device to output the first video picture and receive marking information of the user on the first video picture; and,

[0024] Controlling to select a video picture provided by a video source device from the second video source device and the at least one first video source device and output it to one of the at least one display device; wherein,

[0025] The video picture provided by the first video source device represents a first video picture related to the operation; the video picture provided by the second video source device represents a second video picture with marking information added to the first video picture.

[0026] An embodiment of the present application also provides a storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of any of the above operating room control methods are implemented.

[0027] In the operating room control system, operating room control method, and storage medium provided by the embodiments of the present application, a video related to the operation is output to an interaction device that can mark the operation video. After the interaction device receives the marking of the user on the operation video, the control device of the operating room control system can control to display the operation video on the display device, or display the operation video with marking information added on the display device. In this way, the operation video with marking information can be transmitted to other display devices other than the interaction device for output. That is to say, the device that can output the marking information related to the operation video is no longer limited to the device itself for marking. The viewer can freely select a suitable device to view the operation video and related marking information according to needs, improving the teaching effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 It is a schematic structural diagram of an operating room control system according to an embodiment of the present application;

[0029] Figure 2 It is an example diagram of an online meeting interface when there are multiple interaction devices in the operating room control system according to an embodiment of the present application;

[0030] Figure 3 It is a schematic diagram of the implementation of an operating room control method according to an embodiment of the present application;

[0031] Figure 4 It is a schematic structural diagram of another operating room control system according to an embodiment of the present application;

[0032] Figure 5 It is a schematic diagram of the implementation process of another operating room control method according to an embodiment of the present application;

[0033] Figure 6 It is an example diagram of the system structure of the operating room control system in the application embodiment of the present application;

[0034] Figure 7 It is an example diagram of the video routing interface in the application embodiment of the present application;

[0035] Figure 8 It is an example diagram of the online meeting interface in the application embodiment of the present application. Specific embodiments

[0036] To meet the needs of surgical teaching, medical staff or teaching staff will mark the surgical video while playing it to achieve better teaching effects. In the related art, viewers can only view the marks on the surgical video through the device that makes the marks, and the acquisition channels of the mark information are limited, which affects the teaching effect.

[0037] Based on this, in each embodiment of the present application, the video related to the surgery is output to an interactive device that can mark the surgical video. After the interactive device receives the marks on the surgical video from the user, the control device of the operating room control system can control the surgical video to be displayed on the display device, or the surgical video with the mark information added to be displayed on the display device. In this way, the surgical video with the mark information added can be transmitted to other display devices other than the interactive device for output. That is to say, the device that can output the mark information related to the surgical video is no longer limited to the device itself that makes the marks. Viewers can freely select a suitable device to view the surgical video and the related mark information according to their needs, improving the teaching effect.

[0038] The following further describes the present application in detail with reference to the accompanying drawings and embodiments.

[0039] Figure 1 It shows a schematic diagram of the system architecture of an operating room control system provided by an embodiment of the present application, as Figure 1 shown, the operating room control system 1 includes:

[0040] A control device 11, at least one first video source device 12, at least one interactive device 13, and at least one display device 14.

[0041] Among them, the first video source device 12 is used to provide a first video signal related to the surgery.

[0042] An interaction device 13 for outputting a second video signal and for receiving marking information of the user with respect to the second video signal; the second video signal is generated based on encoding and decoding of the first video signal provided by the first video source device 12.

[0043] A control device 11 for controlling all or part of the display devices 14 in at least one display device to output a third video signal in response to a first selection instruction.

[0044] Here, the first selection instruction is used to select a video signal from the fourth video signal and the first video signals provided by each of the first video source devices among at least one first video source device; the third video signal is generated based on encoding and decoding of the video signal selected by the first selection instruction;

[0045] The fourth video signal is synthesized based on the second video signal and the marking information obtained from the interaction device capable of marking the second video signal; alternatively, the fourth video signal is synthesized based on the first video signal and the marking information obtained from the interaction device capable of marking the first video signal.

[0046] In one embodiment, the number of at least one first video source device is multiple.

[0047] In practical applications, the first video source device 12 includes, but is not limited to, one or more of an operative field camera, a panoramic camera, a monitor, a laparoscope, and a picture-in-picture device. Among them, the operative field camera is used to capture the operative field area, usually deployed on the head or the front side of the body of the surgeon, and can clearly display the surgical vision of the surgeon; the panoramic camera is used to capture the panoramic area of the operating room, usually deployed at a specific position in the operating room, such as on the ceiling or on the wall, and usually uses a wide-angle lens, and the provided video image can display the panorama of the operating room; the monitor is used to provide monitoring images related to the surgical process, including various real-time physiological indicators of the patient; the laparoscope is equipped with a camera for providing the operating vision inside the operative cavity; the picture-in-picture device is used to splice multiple video signals into one video signal. In the video image of the spliced video signal, each of the multiple video signals occupies a part of the video image. Among them, the video source devices providing the multiple video signals include, but are not limited to, one or more of an operative field camera, a panoramic camera, a monitor, and a laparoscope. In the picture-in-picture device, the multiple video signals are fused in a set picture layout style. According to the different positions and sizes occupied by the multiple video signals in the video image, the picture layout styles include, but are not limited to, equal division of the picture layout, picture-in-picture layout, combination layout of large and small pictures, and so on. And, in practical applications, the user can turn off the output of one or more of the video signals in the current picture layout style, that is, only display some of the video signals; the user can also arbitrarily interact with the picture positions of any two of the video signals in the current picture layout style; the user can also specify one video signal in the current picture layout style and exit the picture-in-picture mode, so as to achieve the enlarged display of the specified video signal.

[0048] In practical applications, the first video signal provided by the first video source device 12 is encoded by an encoder, transmitted to the interaction device 13 through a streaming media service, and decoded by a decoder and output in the interaction device 13.

[0049] The interaction device 13 needs to be configured with a display screen for outputting the second video signal. In addition, an input device should also be configured for the user to input marking information about the second video signal. The input device of the interaction device 13 includes, but is not limited to, a touch screen, a touch pad, a mouse, a keyboard, a microphone, etc.

[0050] In actual application, the interaction device 13 can be an electronic device such as a microcomputer, a personal computer (PC), a laptop, a mobile phone, a tablet, etc. Usually, according to the teaching needs, the interaction device 13 can be deployed in areas such as operating rooms, teaching rooms, offices, etc. Based on the display screen of the interaction device 13, the user can view medical images related to the surgical process. Based on the input device of the interaction device 13, the user can mark the medical images played on the display screen, for example, by touching.

[0051] In the embodiment of the present application, the display device 14 can be a display screen deployed in areas such as operating rooms or teaching rooms, and is used to output video signals. In actual application, the display device 14 can be a large display screen deployed in the above areas, such as an in-wall display screen, etc. Here, it should be noted that in the embodiment of the present application, although both the display device 14 and the interaction device 13 can output video signals, in comparison, the display device 14 does not have a touch function, and thus cannot mark the played video signals, for example, it is an ordinary monitor. Further, usually, the display device 14 has the ability to support video signals with a higher bit rate than the interaction device 13, for example, transmitting signals through a High-Definition Multimedia Interface (HDMI). In addition, the display device may not have a processing function, so it cannot receive and / or participate in multi-party conferences.

[0052] In a possible embodiment of the present application, the number of interaction devices outputting video signals is not limited. For example, based on the video routing function, the first video signal provided by the same first video source device is routed to one interaction device or different interaction devices based on the user's operation.

[0053] In a possible embodiment of the present application, the number of display devices outputting video signals is not limited. For example, based on the video routing function, the video signal provided by the same video source device is routed to one display device or different display devices based on the user's operation.

[0054] In Figure 1 In the shown operating room control system, the control device 11 can control the surgical video to be displayed on the display device 14, or the surgical video with marked information to be displayed on the display device 14.

[0055] Specifically, the control device 11 receives a first selection instruction, which is used to select the first video signal provided by one of the first video source devices 12 or the fourth video signal, and then controls the selected video signal to be output after encoding and decoding in all or part of the display devices 14.

[0056] Here, when the first selection instruction is used to select the first video signal, the control device 11 controls the first video signal to be encoded into a third video signal by the encoder, then transmitted via the switch and decoded by the decoder, and the third video signal is output by the display device 14.

[0057] When the first selection instruction is used to select the fourth video signal, as an implementation, the control device 11 synthesizes the second video signal output in the interaction device 13 and the relevant marker information received by the interaction device 13 to obtain the fourth video signal. Then, the fourth video signal is encoded into a third video signal by the encoder, transmitted via the switch and decoded by the decoder, and the third video signal is output by the display device 14. As another implementation, the control device 11 synthesizes the first video signal output from the first video source device 12 and the relevant marker information received by the interaction device 13 to obtain the fourth video signal. Then, the fourth video signal is encoded into a third video signal by the encoder, transmitted via the switch and decoded by the decoder, and the third video signal is output by the display device 14.

[0058] In addition, one or more display devices 14 for outputting the third video signal can also be determined by the control device 11 in response to the second selection instruction, which is used to select one or more display devices 14 in the operating room control system to output the video signal selected by the first selection instruction.

[0059] For the first case of the fourth video signal, it is synthesized based on the second video signal and the marker information obtained from the interaction device that can mark the second video signal. Here, the interaction device that can mark the second video signal can be only the interaction device that outputs the second video signal, and this interaction device can be used as the output end of the fourth video signal. For example, marking can be performed in the interaction device that outputs the second video signal. Or here, the interaction device that can mark the second video signal can be the interaction device that outputs the second video signal and other interaction devices. For example, in the function of a video conference, the interaction devices participating in the conference can all mark the picture corresponding to the first video signal of the current output endoscope. Since the interaction devices participating in the conference can see the marker information of multiple interaction devices, one of the interaction devices can be selected as the output end of the fourth video signal.

[0060] For the second case of the fourth video signal, it is synthesized based on the first video signal and the marker information obtained from the interaction device that can mark the first video signal. The interaction device that can mark the first video signal can be:

[0061] (1) An interactive device capable of marking the first video signal. Here, the device providing the first video signal and the device outputting the marking information can both be used as the input ends of the fourth video signal;

[0062] (2) Or it can be M interactive devices capable of marking the first video signal, where M is a positive integer greater than 1. Here, the device providing the first video signal and the device outputting the marking information can both be used as the input ends of the fourth video signal. The device outputting the marking information can be these M interactive devices, or it can be a service device for managing the marking information. For example, in the function of a video conference, the interactive devices joining the conference can all mark the first video image output by the endoscope. The endoscope and the interactive devices joining the conference can be used as the input ends of the fourth video signal. In addition, if a separate marking synchronization service device is set up to manage the marking information of the interactive devices joining the conference, then the endoscope and the marking synchronization service device can be used as the input ends of the fourth video signal.

[0063] For the second case of the above fourth video signal, the output end of the fourth video signal can be:

[0064] (1) A new separate device. For example, it obtains the video signal from the device providing the first video signal and obtains the marking information from the interactive device that marks the first video signal. This new separate device synthesizes the two and then outputs;

[0065] (2) Or it can be co-located with one of the interactive devices and can implement the synthesis function;

[0066] (3) Or it can be co-located with the service device outputting the marking information and can implement the synthesis function;

[0067] (4) Or it can be co-located with the device providing the first video signal and can implement the synthesis function.

[0068] Understandably, in the embodiments of the present application, the control device 11 is used to implement the video routing function, that is, to route the first video signal provided by one of the first video source devices 12 selected by the user or the fourth video signal with marking information to one or more display devices 14 for output. As described above, the functions of the interaction device 13 and the display device 14 are different. If the existing technology is adopted, the user can only view the marking information of the video signal through the device for marking the video signal, that is, the interaction device 13, and cannot view the marking information of the video signal on the device only with a display function, that is, the display device 14. However, in the embodiments of the present application, based on the video routing function of the control device 11, the video signal added with marking information can be output to the display device 14 for playing. In this way, when the user views the surgical video, the acquisition of the marking information is no longer limited to the device that can perform marking. The user can freely select a suitable device to view the surgical video and related marking information according to the area where he is located or the actual operation needs.

[0069] For example, in the demonstration classroom, the display screen of the interaction device is relatively small. If the video screen with marking information is displayed through the display screen of the interaction device, it will be inconvenient for teaching. Usually, a relatively large screen (equivalent to the display device) is also configured in the demonstration classroom. Therefore, through the solution of the embodiments of the present application, it can be realized that the large screen in the demonstration classroom is selected to output the surgical video added with marking information, so as to facilitate medical students to watch, thereby improving the teaching effect.

[0070] Another example is that in the operating room, the interaction device is located at a relatively far position from the operating bed or the operating table, and it may also be inconvenient to view the video screen with marking information due to equipment obstruction, etc. A boom monitor (equivalent to the display device) is configured at a position relatively close to the operating bed or the operating table. Therefore, through the solution of the embodiments of the present application, it can be realized that the boom monitor is selected to output the surgical video added with marking information, so as to facilitate viewing. In one embodiment, the number of interaction devices 13 is multiple.

[0071] Multiple interaction devices 13 can be respectively deployed in areas such as the operating room, the demonstration classroom or the office according to the teaching needs. Different interaction devices 13 communicate with each other through a local area network; alternatively, the interaction device 13 can also be a remote computer deployed outside the above local area network, and communicate with the interaction device 13 in the local area network based on the Internet or a mobile data network.

[0072] When one of the interaction devices 13 in the operating room control system outputs the second video signal, the way for the interaction device 13 to receive the marking information of the second video signal by the user includes: the interaction device 13 itself obtains the marking information of the second video signal input by the user through the input device through input detection.

[0073] When there are multiple interaction devices 13 in the operating room control system, in one embodiment, receiving the marking information of the user for the second video signal includes:

[0074] The first interaction device obtains the first marking information input by the user to the first interaction device through input detection; and / or,

[0075] The first interaction device receives the second marking information from the second interaction device; the second marking information represents the marking information input by the user to the second interaction device obtained by the second interaction device through input detection.

[0076] At this time, each interaction device has the function of receiving marking information. Therefore, the ways for each interaction device 13 to receive the marking information of the user for the video signal include: the interaction device 13 itself obtains the marking information of the user input to the video signal through input detection by the input device; and / or, one interaction device 13 receives the marking information of the video signal sent by another interaction device 13, and the marking information sent by the other interaction device 13 is also the marking information input by the user through the input device obtained by the other interaction device 13 through input detection.

[0077] That is to say, in practical applications, when there are multiple interaction devices 13 in the operating room control system, for each interaction device 13, the user can input marking information in this interaction device 13, or the user can also not input marking information in this interaction device 13, but the marking information input by the users of other interaction devices 13 in other interaction devices 13 will be transmitted to this interaction device 13, or this interaction device 13 can receive both the marking information input by its own user and the marking information input by other users sent by other interaction devices 13. In other words, based on the first video signal provided by the same first video source device 12, the display screens of each interaction device 13 output the same video signal, and each interaction device 13 can receive the marking information input by the user about the video signal, and the marking information received by any one interaction device 13 can be output on the display screens of other interaction devices 13 at the same time. Therefore, finally, all the marking information about the same video signal can be output in each interaction device 13.

[0078] In addition, in practical applications, at least one interaction device 13 can also be used as a participant in an online meeting to implement surgical teaching based on the online meeting. It can be understood that when there are multiple interaction devices 13 in the operating room control system, all of these multiple interaction devices 13 can join the online meeting, or only some of these multiple interaction devices join the online meeting. Figure 2 Shows the online meeting interface when there are multiple interaction devices in the operating room control system. It can be seen thatFigure 2 The example includes 4 interactive devices, each of which represents a participating user in the meeting. The users participating in the online meeting are OR1, OR9, OR6, and OR2 respectively.

[0079] Further, in order to improve the sharing efficiency of the marking information, in one embodiment, the second marking information is forwarded by the second interactive device to the first interactive device through the marking synchronization service.

[0080] Among them, the marking synchronization service is deployed in the first interactive device, or the marking synchronization service is deployed in the second interactive device, or the marking synchronization service is deployed in a device other than the first interactive device and the second interactive device.

[0081] Here, the marking synchronization service is used to synchronize the marking information of the second video signal among multiple interactive devices 13. In this way, as long as one of the interactive devices 13 receives the marking information input by the user, all the running interactive devices 13 in the operating room control system can receive the marking information, so as to output the marking information locally in the interactive device 13, realizing the sharing of the marking information. And, by deploying the marking synchronization service, all interactive devices 13 can be registered in the marking synchronization service. In this way, once one of the interactive devices 13 transmits the marking information to the marking synchronization service, the marking synchronization service can, according to the registration information, synchronously transmit the marking information to all other interactive devices 13 to improve the synchronization efficiency of the marking information.

[0082] The following details the implementation of the marking function in the operating room control system:

[0083] First, each of the multiple interactive devices 13 plays the second video signal and performs input detection while playing the second video signal.

[0084] After any one of the interactive devices 13 detects the marking information input by the user, the marking information is output in the interactive device 13 and the marking information is sent to the marking synchronization service. Here, the detected marking information input by the user can be various marking texts or marking graphics such as points and lines, as well as the corresponding marking colors, line thicknesses, marking positions, etc. In addition, it can also be an erasing operation on the existing marking.

[0085] After receiving the marking information, the marking synchronization service immediately sends the marking information to each of the other interactive devices 13 among the multiple interactive devices 13. In this way, the second video signal and the marking information about the second video signal can be output in all interactive devices 13.

[0086] In one embodiment, the interactive device 13 is further configured to: output the marking information of the user on the second video signal received.

[0087] Among them, outputting a second video signal and outputting the received user's marking information for the second video signal includes:

[0088] In the display interface of the interaction device 13, displaying a video picture after superimposing the second video signal and the received user's marking information for the second video signal; or,

[0089] In the display interface of the interaction device 13, displaying a second video picture corresponding to the second video signal, and at the same time displaying the received user's marking information for the second video signal in a set window; the set window represents a transparent window superimposed on the first video picture.

[0090] The above provides two implementation manners for simultaneously outputting the second video signal and the marking information about the second video signal. The first is to simultaneously render the second video signal and the corresponding marking information to the display interface of the interaction device 13; the second is to achieve independent rendering of the second video signal and the corresponding marking information by superimposing a transparent window on the display interface of the second video signal, that is, the second video signal is played in one window, and the marking information is output in another window, and the size and aspect ratio of the window for outputting the marking information are the same as those of the window for outputting the video signal. Since the playback of the second video signal and the output of the marking information are time-synchronized, and the output window of the marking information is superimposed on the playback window of the second video signal, from the user's perspective, the second video signal and the marking information are simultaneously rendered.

[0091] In an embodiment, the control device 11 is further configured to: output a fifth video signal; wherein, the fifth video signal is generated after encoding and decoding the video signal selected by the first selection instruction, and the bit rate of the fifth video signal is less than the bit rate of the third video signal.

[0092] Here, the fifth video signal can be understood as a preview picture corresponding to the video signal selected by the first selection instruction. In this way, the preview picture of the video signal selected by the first selection instruction is displayed in real time on the control device 11, which can help the user quickly determine the video signal that needs to be routed to the display device 14 for output, improving the video routing speed. In addition, since the preview picture is output in the control device 11 with a low bitstream, it can also effectively reduce the playback pressure of the operating room control system and reduce the occupancy of processing resources.

[0093] In an embodiment, the bit rate of the second video signal is less than the bit rate of the third video signal.

[0094] In actual application, the display device 14 can be a device with high-bitrate playback ability such as an in-wall large screen in an operating room, while the interaction device 13 is mostly a device for teaching purposes. Therefore, in the embodiments of the present application, on the one hand, the third video signal output to the display device 14 is displayed in high bitrate, which can make full use of the high-bitrate playback ability of the display device 14 to display the playback effect of the video; on the other hand, the second video signal output from the interaction device 13 is displayed in low bitrate, which can ensure the smooth playback of the teaching video, and thus also ensure the synchronization of the second video signal with the relevant marking information, ensuring the teaching effect.

[0095] Here, the encoder can encode the video signal simultaneously in high bitrate and low bitrate. Among them, for the video signal that needs to be output to the display device 14 for playback, high-bitrate encoding is performed to make full use of the high-bitrate playback ability and large-screen characteristics of the display device 14 to ensure the playback effect of the video; for the video signal that needs to be output to the control device 11 for preview, or output to the interaction device 13 for live broadcast and recording, low-bitrate encoding is performed to ensure the real-time performance of the video signal for live broadcast, recording or preview.

[0096] In actual application, when encoding the video signal in high bitrate, encoding algorithms such as SDVoE and JEPG2000 can be used. When encoding the video signal in low bitrate, encoding algorithms such as H.264, H.265, and NDI can be used.

[0097] Correspondingly, the embodiments of the present application also provide an operating room control method, which is applied to Figure 1 the control device 11 in the operating room control system shown in Figure 3 as shown, the method includes:

[0098] Step 301: In response to a first selection instruction, control all or part of the display devices in at least one display device to output a third video signal.

[0099] Among them, the first selection instruction is used to select a video signal from the fourth video signal and the first video signals related to the operation provided by each first video source device in at least one first video source device; the third video signal is generated based on the video signal selected by the first selection instruction after encoding and decoding; the fourth video signal is synthesized based on the second video signal and the marking information obtained from the interaction device that can mark the second video signal, or the fourth video signal is synthesized based on the first video signal and the marking information obtained from the interaction device that can mark the second video signal; the second video signal is generated based on the first video signal provided by the first video source device after encoding and decoding.

[0100] In one embodiment, the method further includes: outputting a fifth video signal; wherein, the fifth video signal is generated after encoding and decoding the video signal selected by the first selection instruction, and the bit rate of the fifth video signal is less than the bit rate of the fifth video signal.

[0101] The specific implementation of the operating room control method applied to the control device 11 can be explained with reference to the relevant embodiments of the above-mentioned operating room control system, and will not be described herein again.

[0102] Figure 4 FIG. shows a schematic diagram of the system architecture of an operating room control system provided by an embodiment of the present application, as Figure 4 shown, the operating room control system 4 includes: a control device 41, at least one first video source device 42, a second video source device 43, at least one interaction device 44, and at least one display device 45.

[0103] Among them, the first video source device 42 is used to provide a first video picture related to the operation;

[0104] The second video source device 43 is used to provide a second video picture with marking information added to the first video picture;

[0105] The control device 41 is used to control the output of the first video picture provided by the first video source device to all interaction devices for the interaction devices to output the first video picture and receive the marking information of the user on the first video picture;

[0106] The interaction device 44 is used to output the first video picture and receive the marking information of the user on the first video picture;

[0107] The control device 41 is further used to control the output of the video picture provided by one video source device selected from the second video source device and at least one first video source device to one display device 45 among at least one display device.

[0108] In one embodiment, the number of at least one first video source device is multiple.

[0109] In practical applications, the first video source device 42 includes, but is not limited to, one or more of an operative field camera, a panoramic camera, a monitor, a laparoscope, and a picture-in-picture device. Among them, the operative field camera is used to capture the operative field area, usually deployed in front of the head or body of the surgeon, and can clearly display the surgical vision of the surgeon; the panoramic camera is used to capture the panoramic area of the operating room, usually deployed at a specific location in the operating room, such as on the ceiling or on the wall, and usually uses a wide-angle lens, and the provided video image can display the panorama of the operating room; the monitor is used to provide monitoring images related to the surgical process, including various real-time physiological indicators of the patient; the laparoscope is equipped with a camera for providing the operating vision inside the body cavity; the picture-in-picture device is used to splice multiple video signals into one video signal. In the video image of the spliced video signal, each of the multiple video signals occupies a part of the video image. Among them, the video source devices providing the multiple video signals include, but are not limited to, one or more of an operative field camera, a panoramic camera, a monitor, and a laparoscope. In the picture-in-picture device, the multiple video signals are fused in a set picture layout style. According to the different positions and sizes of the multiple video signals in the video image, the picture layout styles include, but are not limited to, an evenly divided picture layout, a picture-in-picture layout, a combination layout of large and small pictures, and so on. And, in practical applications, the user can turn off the output of one or more of the video signals in the current picture layout style, that is, only display some of the video signals; the user can also arbitrarily interact with the picture positions of any two of the video signals in the current picture layout style; the user can also specify one video signal in the current picture layout style to exit the picture-in-picture mode, so as to achieve the enlarged display of the specified video signal.

[0110] The interaction device 44 needs to be configured with a display screen for outputting a video image. In addition, an input device should also be configured for the user to input marking information about the video image. The input device of the interaction device 44 includes, but is not limited to, a touch screen, a touchpad, a mouse, a keyboard, a microphone, etc.

[0111] In practical applications, the interaction device 44 can be an electronic device such as a microcomputer, a PC, a laptop, a mobile phone, a tablet, etc. Usually, according to the teaching needs, the interaction device 44 can be deployed in areas such as the operating room, the teaching room, the office, etc. Based on the display screen of the interaction device 44, the user can view the medical images related to the surgical process. Based on the input device of the interaction device 44, the user can mark the medical images played on the display screen, for example, by touching.

[0112] In the embodiments of the present application, the display device 45 may be a display screen deployed in areas such as operating rooms or demonstration classrooms for outputting video signals. In practical applications, the display device 45 may be a large display screen deployed in the above areas, such as an in-wall large display screen. Here, it should be noted that in the embodiments of the present application, although both the display device 45 and the interaction device 44 can output video signals, in comparison, the display device 14 does not have a touch function and thus cannot mark the played video signals, for example, it is an ordinary display. Further, usually, the display device 14 has the ability to support video signals with higher bitrates than the interaction device 13, for example, transmitting signals via HDMI. Additionally, the display device may not have a processing function and thus cannot receive and / or participate in multi-party conferences.

[0113] In possible embodiments of the present application, the number of interaction devices outputting video signals is not limited. For example, based on the video routing function and user operations, the first video signal provided by the same first video source device is routed to one interaction device or different interaction devices.

[0114] In possible embodiments of the present application, the number of display devices outputting video signals is not limited. For example, based on the video routing function and user operations, the video signal provided by the same video source device is routed to one display device or different display devices.

[0115] In the embodiments of the present application, the control device 41 is used to implement the video routing function, including encoding the first video frame provided by one of the first video source devices by an encoder, transmitting it through a switch, and decoding it by a decoder, and then outputting the first video frame by the interaction device 44. The control device 41 is also used to implement the video routing function, including routing the first video frame provided by one of the at least one first video source devices or the second video frame provided by the second video source device to all or part of the display devices 45 for output.

[0116] Here, when the control device 41 routes the first video frame provided by one of the at least one first video source devices to all or part of the display devices 45 for output, the control device 41 controls the first video frame to be encoded by an encoder, transmitted through a switch, and decoded by a decoder, and then output the first video frame by the display device 45.

[0117] When the control device 41 routes the second video image provided by the second video source device to all or part of the display devices 45 for output, at this time, the second video source device 43 is used to add marker information to the first video image, synthesize the second video image, and provide the second video image to the control device 41. The control device 41 controls the second video image to be encoded by an encoder, transmitted by a switch, and decoded by a decoder, and then the second video image is output by the display device 45.

[0118] In addition, one or more display devices 14 for outputting video images can also be determined by the control device 11 in response to a second selection instruction for selecting one or more display devices 14 in the operating room control system to output video images.

[0119] In the embodiment of the present application, the second video source device 43 is used to provide a second video image with marker information added to the first video image. That is to say, the second video source device 43 synthesizes the first video image with all the marker information received by at least one interaction device 44 to obtain the second video image. Therefore, the second video source device can be regarded as the provider of the second video image and provides a video signal source for the operating room control system 4.

[0120] In one embodiment, the second video source device set is in the interaction device, that is to say, the second video source device and the interaction device can be the same physical device. In the case where multiple interaction devices 44 are deployed in the operating room control system 4, the second video source device 42 can be integrated into one of the interaction devices 44 for synthesizing the first video image with all the marker information received by at least one interaction device 44.

[0121] Here, the first video image used to synthesize the second video image is the video image output by the interaction device 44.

[0122] In one embodiment, the second video source device is respectively communicatively connected to the first video source device and the interaction device to generate a second video image based on the first video image provided by the first video source device and the marker information provided by the interaction device.

[0123] Here, the first video image used to synthesize the second video image is the video image output by the first video source device 42.

[0124] Based on the above embodiments, it can be understood that when the second video source device 43 generates the second video image, in addition to synthesizing with the marker information received by the interaction device 44, the first video image used can be obtained from the interaction device 44 or from the first video source device 42.

[0125] As described above, the interactive device 44 and the display device 45 have different functions. If the existing technology is adopted, the user can only view the marked information of the video signal through the device for marking the video signal, that is, the interactive device 44, and cannot view the marked information of the video signal on the device with only display function, that is, the display device 45. In the embodiment of the present application, based on the video routing function of the control device 41, the video signal added with the marked information synthesized by the second video source device 43 can be output to the display device 45 for playing. In this way, when the user views the surgical video, the acquisition of the marked information is no longer limited to the device that can perform marking. The user can freely select a suitable device to view the surgical video and related marked information according to the area where he is located or the actual operation needs.

[0126] For example, in a demonstration classroom, the display screen of the interactive device is relatively small. If the video picture with marked information is displayed through the display screen of the interactive device, it will be inconvenient for teaching. Usually, a relatively large screen (equivalent to the display device) is also configured in the demonstration classroom. Therefore, through the solution of the embodiment of the present application, it is possible to select the large screen in the demonstration classroom to output the surgical video added with the marked information, so as to facilitate medical students to watch, thereby improving the teaching effect.

[0127] Another example is that in the operating room, the interactive device is at a relatively far position from the operating bed or the operating table, and it may also be inconvenient to view the video picture with marked information due to equipment obstruction. There is a boom-mounted monitor (equivalent to the display device) at a position closer to the operating bed or the operating table. Therefore, through the solution of the embodiment of the present application, it is possible to select the boom-mounted monitor to output the surgical video added with the marked information, so as to facilitate viewing.

[0128] In one embodiment, the number of the interactive devices 44 is multiple.

[0129] Multiple interactive devices 44 can be respectively deployed in areas such as the operating room, the demonstration classroom or the office according to the teaching needs. Different interactive devices 44 communicate with each other through a local area network; alternatively, the interactive device 44 can also be a remote computer deployed outside the above local area network, and communicate with the interactive device 44 in the local area network based on the Internet or a mobile data network.

[0130] When there is one interactive device 44 in the operating room control system, the ways for the interactive device 44 to receive the marked information of the video picture by the user include: the interactive device 44 itself obtains the marked information of the video picture input by the user through the input device through input detection.

[0131] When there are multiple interactive devices 44 in the operating room control system, in one embodiment, the interactive device receives the marked information of the first video picture by the user, including:

[0132] The first interaction device obtains first marker information input by the user to the first interaction device through input detection; and / or,

[0133] The first interaction device receives second marker information from the second interaction device; the second marker information represents marker information input by the user to the second interaction device obtained by the second interaction device through input detection.

[0134] At this time, each interaction device has the function of receiving marker information. Therefore, the ways for each interaction device 44 to receive the marker information of the video signal by the user include: the interaction device 44 itself obtains the marker information of the video signal input by the user through the input device through input detection; and / or, one interaction device 44 receives the marker information of the video signal sent by another interaction device 44, and the marker information sent by the other interaction device 44 is also the marker information input by the user through the input device obtained by the other interaction device 44 through input detection.

[0135] That is to say, in practical applications, when there are multiple interaction devices 44 in the operating room control system, for each interaction device 44, the user can input marker information in this interaction device 44, or the user can not input marker information in this interaction device 44, but the marker information input by the user in other interaction devices 44 will be transmitted to this interaction device 44, or this interaction device 44 can receive both the marker information input by its own user and the marker information input by other users sent by other interaction devices 44. In other words, based on the first video picture provided by the same first video source device 42, the display screens of each interaction device 44 output the same video picture, and each interaction device 44 can receive the marker information about the video signal input by the user, and the marker information received by any one interaction device 44 can be output on the display screens of other interaction devices 44 at the same time. Therefore, finally, all the marker information about the same video picture can be output in each interaction device 44.

[0136] In addition, in practical applications, at least one interaction device 44 can also be used as a participant in an online meeting to realize surgical teaching based on the online meeting. In this scenario, the participants in the online meeting include, but are not limited to, the interaction device 44, and can also be other participants without the function of adding marker information. At this time, in the online meeting, only the interaction device 44 can add marker information to the video signal.

[0137] Further, in order to improve the sharing efficiency of the marker information, in an embodiment, the second marker information is forwarded by the second interaction device to the first interaction device through the interaction synchronization service.

[0138] Among them, the marker synchronization service is deployed in the first interaction device, or the marker synchronization service is deployed in the second interaction device, or the marker synchronization service is deployed in a device other than the first interaction device and the second interaction device.

[0139] Here, the marker synchronization service is used to synchronize the marker information of the second video signal among multiple interaction devices 144. In this way, as long as one of the interaction devices 44 receives the marker information input by the user, all the running interaction devices 44 in the operating room control system can receive this marker information, so as to output the marker information locally in the interaction device 44, realizing the sharing of marker information. Moreover, by deploying the marker synchronization service, all interaction devices 44 can register in the marker synchronization service. In this way, once one of the interaction devices 44 transmits the marker information to the marker synchronization service, the marker synchronization service can synchronously transmit this marker information to all other interaction devices 44 according to the registration information to improve the synchronization efficiency of the marker information.

[0140] In an embodiment, the control device is further configured to: output a preview screen; wherein, the preview screen is a preview screen of a first video screen provided by one of at least one first video source device; or, the preview screen is a preview screen of a second video screen.

[0141] Here, the real-time display of the preview screen of one of the video screens on the control device 41 can help the user quickly determine the video signal that needs to be routed to the display device 45 for output, improving the speed of video routing. In addition, since the preview screen uses low-bitrate output, it can also effectively reduce the playback pressure of the operating room control system and reduce the occupation of processing resources.

[0142] Correspondingly, an embodiment of the present application further provides an operating room control method, which is applied to Figure 4 the control device 41 in the operating room control system shown in Figure 5 as shown, the method includes:

[0143] Step 501: Control to output the first video screen provided by the first video source device to all interaction devices; and, control to select a video screen provided by one video source device from the second video source device and at least one first video source device and output it to one display device among at least one display device.

[0144] Among them, the video screen provided by the first video source device represents a first video screen related to the surgery; the video screen provided by the second video source device represents a second video screen with marker information added to the first video screen.

[0145] Wherein, in one embodiment, the method further includes: outputting a preview screen; wherein, the preview screen is a preview screen of a first video screen provided by at least one of a first video source device and a second video source device; or, the preview screen is a preview screen of a second video screen.

[0146] The specific implementation of the operating room control method applied to the control device 41 can be explained with reference to the relevant embodiments of the above-mentioned operating room control system, and will not be described herein.

[0147] Figure 6 Fig. shows a schematic diagram of the system architecture of the operating room control system provided by the application embodiment of the present application. Refer to Figure 6 , the first video source device is an endoscope, which can provide a first video screen related to the operation in the surgical cavity during the operation. The first video screen is respectively encoded into a high-bitrate video signal and a low-bitrate video signal by an encoder. After the transmission of these two video signals through a switch, the high-bitrate video signal is transmitted to the operating room display and the demonstration room display, and is decoded and then displayed. The low-bitrate video signal is transmitted to the interaction devices: computer 1, operating room computer 2, and demonstration room computer 3 through a server and a streaming media service, and is decoded and then played. Here, computer 1, operating room computer 2, and demonstration room computer 3 constitute the participants in the online meeting. As an application example, computer 1 marks the played video screen and uploads the marking information to the marking synchronization service, and the marking synchronization service will synchronously send the marking information to operating room computer 2 and demonstration room computer 3 for real-time display. In addition, for the marked video image synthesized by the first video screen and the marking information, it can also be encoded into a high-bitrate video signal by an encoder, and transmitted to the operating room display and the demonstration room display through a switch, and is decoded and then displayed.

[0148] It should be noted that based on the foregoing, in Figure 6 , the display devices are the operating room display and the demonstration room display, and the interaction devices are computer 1, operating room computer 2, and demonstration room computer 3. Therefore, the operating room display and the demonstration room display only have the display function, cannot participate in the online meeting, and cannot mark the video signal. In addition, during the online meeting, since the operating room display and the demonstration room display are not the participants in the online meeting, they cannot see the marking of the video signal in real time. However, based on the video routing function, after the online meeting, the marked video signal (marked video) can be re-encoded, transmitted, decoded, and then played on the operating room display and the demonstration room display.

[0149] Figure 7The figure shows an example diagram of a video routing interface in the control device provided by the application embodiment of the present application. On the left side of the interface is the video source device. The video images provided by the first video source device can be selected in the left menu bar, including: picture-in-picture, monitor, 4K surgical field, 4K endoscope, or the video image with marked information provided by the second video source device can be selected. On the right side of the interface is the display device. Single selection or multiple selection can be performed in the right menu bar to determine on which display devices the video images of the video source device selected on the left need to be output. As Figure 7 shown, based on the solution of the embodiment of the present application, the following video routing functions can be achieved:

[0150] 1. Route the video image of the first video source device to the display device for output. For example, by selecting "monitor" on the left side of the interface and "display 1" on the right side of the interface, the video image of the monitor is routed to display 1 for output;

[0151] 2. Route the video image of the first video source device to the interactive device for output. For example, by selecting "monitor" on the left side of the interface and "marked video source" on the right side of the interface, the video image of the monitor is routed to the marked video source for output;

[0152] 3. Route the video image of the second video source device to the display device for output. For example, by selecting "marked video source" on the left side of the interface and "display 1" on the right side of the interface, the video image with marks is routed to display 1 for output.

[0153] At the same time, in Figure 7 the middle area of the interface, a preview image of the video image selected on the left side of the interface is displayed, so that the user can quickly know the content of the video image provided by the video source.

[0154] Figure 8 The figure shows an example diagram of the marking interface of the interactive device provided by the application embodiment of the present application. Refer to Figure 8 , there are a total of 4 interactive devices participating in the online meeting. Figure 8 The names of the interactive devices participating in the online meeting are shown on the left side of the interface. The source of the currently output video image is shown on the right side of the interface, and the corresponding video image display area is in the middle area of the interface. Among them, the user of the interactive device can input marked information in this video image display area. It should be noted that Figure 8 the video images shown on the right side of the interface all come from the first video source device. Under this interface, the user can select one of the video images provided by the first video source device to play in the middle area of the interface, and the user can add marks to the video image while playing the video image in the middle area of the interface.

[0155] Embodiments of the present application also provide a storage medium for storing various types of data to support Figure 3 or Figure 5 the operation of the control device in the embodiments. Examples of such data include: any computer program for operating on a processor.

[0156] In the above embodiments of the present application, the processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method may be completed by the integrated logic circuit in the hardware of the processor or by instructions in software form. The above processor may be a general-purpose processor, a digital signal processor (DSP, Digital Signal Processor), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The above processor may implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor may be a microprocessor or any conventional processor, etc. Combining the steps of the method disclosed in the embodiments of the present application, it may be directly embodied as being executed and completed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. The software module may be located in the storage medium and complete the foregoing method steps in combination with its hardware.

[0157] It can be understood that the storage medium in the embodiments of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM, Read Only Memory), a programmable read-only memory (PROM, Programmable Read-Only Memory), an erasable programmable read-only memory (EPROM, Erasable Programmable Read-Only Memory), an electrically erasable programmable read-only memory (EEPROM, Electrically Erasable Programmable Read-Only Memory), a ferromagnetic random access memory (FRAM, ferromagnetic random access memory), a flash memory (FlashMemory), a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM, Compact Disc Read-Only Memory); the magnetic surface memory can be a disk memory or a tape memory. The volatile memory can be a random access memory (RAM, Random Access Memory), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as a static random access memory (SRAM, Static Random Access Memory), a synchronous static random access memory (SSRAM, Synchronous Static Random Access Memory), a dynamic random access memory (DRAM, Dynamic Random Access Memory), a synchronous dynamic random access memory (SDRAM, Synchronous Dynamic Random Access Memory), a double data rate synchronous dynamic random access memory (DDRSDRAM, Double Data Rate Synchronous Dynamic Random Access Memory), an enhanced synchronous dynamic random access memory (ESDRAM, Enhanced Synchronous Dynamic Random AccessMemory), a sync link dynamic random access memory (SLDRAM, SyncLink Dynamic Random AccessMemory), and a direct rambus random access memory (DRRAM, Direct Rambus Random Access Memory).The memories described in the embodiments of the present application are intended to include, but are not limited to, these and any other suitable types of memories.

[0158] It should be noted that "first", "second", etc. are used to distinguish similar objects, and do not necessarily have to be used to describe a specific order or sequence.

[0159] In addition, the technical solutions described in the embodiments of the present application can be arbitrarily combined without conflict.

[0160] The above is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application.

Claims

1. An operating room control system, characterized in that, It includes a control device, at least one first video source device, at least one interaction device, and at least one display device; The first video source device is used to provide a first video signal related to surgery; The interaction device is used to output a second video signal and to receive marking information of the user for the second video signal; The second video signal is generated based on encoding and decoding of the first video signal provided by the first video source device; The control device is used to, in response to a first selection instruction, control all or part of the display devices in the at least one display device to output a third video signal; wherein, The first selection instruction is used to select a video signal from a fourth video signal and the first video signals provided by each of the first video source devices in the at least one first video source device; the third video signal is generated based on encoding and decoding of the video signal selected by the first selection instruction; The fourth video signal is synthesized based on the second video signal and the marking information obtained from the interaction device capable of marking the second video signal; or, the fourth video signal is synthesized based on the first video signal and the marking information obtained from the interaction device capable of marking the first video signal.

2. The operating room control system according to claim 1, wherein The receiving the marking information of the user for the second video signal includes: The first interaction device obtains first marking information input by the user to the first interaction device through input detection; and / or, The first interaction device receives second marking information from the second interaction device; the second marking information represents the marking information input by the user to the second interaction device obtained by the second interaction device through input detection.

3. The operating room control system according to claim 2, wherein, The second marking information is forwarded by the second interaction device to the first interaction device through a marking synchronization service.

4. The operating room control system according to claim 3, wherein The marking synchronization service is deployed in the first interaction device, or the marking synchronization service is deployed in the second interaction device, or the marking synchronization service is deployed in a device other than the first interaction device and the second interaction device.

5. The operating room control system according to claim 1, wherein, The interaction device is further used for: Outputting the received marking information of the user for the second video signal.

6. The operating room control system according to claim 5, wherein The outputting the second video signal and the outputting the received marking information of the user for the second video signal include: In the display interface of the interaction device, displaying a video picture after superimposing the second video signal and the received marking information of the user for the second video signal; or, In the display interface of the interaction device, displaying a second video picture corresponding to the second video signal, and at the same time, displaying the received marking information of the user for the second video signal in a set window; the set window represents a transparent window superimposed on the second video picture.

7. The operating room control system according to claim 1, characterized in that The control device is further used for: Outputting a fifth video signal; wherein, The fifth video signal is generated based on encoding and decoding of the video signal selected by the first selection instruction, and the bit rate of the fifth video signal is less than the bit rate of the third video signal.

8. The operating room control system according to claim 1, wherein, The bit rate of the second video signal is less than the bit rate of the third video signal.

9. The operating room control system according to claim 1, wherein The number of the at least one first video source device is multiple.

10. The operating room control system according to claim 1, wherein The at least one first video source device includes one or more of: an operative field camera, a panoramic camera, a monitor, a laparoscope, and a picture-in-picture device; wherein, the picture-in-picture device is configured to splice multiple video signals into one video signal.

11. An operating room control system, characterized in that, It includes a control device, at least one first video source device, a second video source device, at least one interaction device, and at least one display device; The first video source device is configured to provide a first video picture related to a surgery. The second video source device is configured to provide a second video picture with marking information added to the first video picture. The control device is configured to control the output of the first video picture provided by the first video source device to the interaction device for the interaction device to output the first video picture and receive marking information of the user on the first video picture. The interaction device is configured to output the first video picture and receive marking information of the user on the first video picture. The control device is further configured to control the output of the video picture provided by one video source device selected from the second video source device and the at least one first video source device to one display device among the at least one display device.

12. The operating room control system according to claim 11, wherein, The second video source device is integrated in the interaction device.

13. The operating room control system according to claim 11, wherein, The second video source device is communicatively connected to the first video source device and the interaction device respectively to generate the second video picture based on the first video picture provided by the first video source device and the marking information provided by the interaction device.

14. The operating room control system according to claim 11 or 12, characterized in that, The interaction device receiving marking information of the user on the first video picture includes: The first interaction device obtains first marking information input by the user to the first interaction device through input detection; and / or, The first interaction device receives second marking information from a second interaction device; the second marking information represents marking information input by the user to the second interaction device obtained by the second interaction device through input detection.

15. The operating room control system according to claim 14, wherein The second marking information is forwarded by the second interaction device to the first interaction device through an interaction synchronization service.

16. The operating room control system according to claim 14, characterized in that, The marking synchronization service is deployed in the first interaction device, or the marking synchronization service is deployed in the second interaction device, or the marking synchronization service is deployed in a device other than the first interaction device and the second interaction device.

17. The operating room control system according to claim 11, wherein The control device is further configured to: Output a preview picture; wherein, The preview picture is a preview picture of the first video picture provided by one video source device among the at least one first video source device and the second video source device; or the preview picture is a preview picture of the second video picture.

18. The operating room control system according to claim 11, characterized in that, The number of the at least one first video source device is multiple.

19. The operating room control system according to claim 11, characterized in that The at least one first video source device includes one or more of: an operative field camera, a panoramic camera, a monitor, a laparoscope, and a picture-in-picture device; wherein, the picture-in-picture device is configured to splice multiple video signals into one video signal.

20. A method for controlling an operating room, characterized in that, A control device applied to an operating room control system; The operating room control system further includes at least one first video source device, at least one marking device, and at least one display device; The method includes: In response to a first selection instruction, controlling all or part of the at least one display device to output a third video signal; wherein, The first selection instruction is used to select a video signal from a fourth video signal and first video signals related to surgery provided by each of the at least one first video source devices; the third video signal is generated based on encoding and decoding the video signal selected by the first selection instruction; The fourth video signal is synthesized based on a second video signal and marking information obtained from an interaction device capable of marking the second video signal, and the second video signal is generated based on encoding and decoding the first video signal provided by the first video source device; or, the fourth video signal is synthesized based on the first video signal and marking information obtained from an interaction device capable of marking the first video signal.

21. The method according to claim 20, wherein The method further includes: Outputting a fifth video signal; wherein, The fifth video signal is generated based on encoding and decoding the video signal selected by the first selection instruction, and the bit rate of the fifth video signal is less than the bit rate of the fifth video signal.

22. A method for controlling an operating room, characterized in that, Applied to a control device in an operating room control system; the operating room control system further includes at least one first video source device, a second video source device, at least one interaction device, and at least one display device; The method includes: Controlling to output a first video frame provided by the first video source device to the interaction device for the interaction device to output the first video frame and receive marking information of the user on the first video frame; and, Controlling to select a video frame provided by a video source device from the second video source device and the at least one first video source device and output it to one of the at least one display devices; wherein, The video frame provided by the first video source device represents a first video frame related to surgery; the video frame provided by the second video source device represents a second video frame with marking information added to the first video frame.

23. The method according to claim 22, wherein The method further includes: Outputting a preview frame; wherein, The preview frame is a preview frame of a first video frame provided by one of the at least one first video source devices; or, the preview frame is a preview frame of the second video frame.

24. A storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the steps of the method according to claim 20 or 21, or implements the steps of the method according to claim 22 or 23.

Images