Terminal device, real-time video stream configuration method, control system and storage medium
By monitoring the status of the operating room equipment, the video streaming screen layout is automatically configured, which solves the problem of low screen switching efficiency in surgical teaching, and achieves efficient and accurate teaching effect.
Patent Information
- Application Number
- CN202310566145.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-18
- Publication Date
- 2024-11-22
AI Technical Summary
During the surgical teaching process, frequent screen switching between operating room panoramic images, field images, monitor images or laparoscopic images is inefficient, which can easily lead to missing key information and consume a lot of human resources.
By monitoring the operating status of each medical device in the operating room, issuing instructions to automatically configure the screen layout of the real-time video stream, and switching the teaching screen according to the real-time progress of the operation to reduce manual operations.
It improves the efficiency and accuracy of teaching screen switching, saves time and human resources, and significantly improves the teaching effect.
Smart Images

Figure CN119011880A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of medical equipment technology, and in particular to a terminal device, a configuration method for a real-time video stream, a control system, and a storage medium. Background Art
[0002] In order to meet the needs of surgical teaching, when broadcasting live the surgical scene, it is necessary to frequently combine or switch between the panoramic screen of the operating room, the surgical field screen, the monitor screen or the laparoscope screen through manual operation, which is inefficient. In addition, if the operation is not timely or an operation error occurs, it is easy to miss key information actions. Summary of the invention
[0003] To solve related technical problems, the embodiments of the present application provide a terminal device, a configuration method for real-time video stream, a control system and a storage medium.
[0004] The technical solution of the embodiment of the present application is implemented as follows:
[0005] The embodiment of the present application provides a first terminal device, which is communicatively connected to each medical device in the operating room;
[0006] The first terminal device is used to monitor the operating status of each of the medical devices and issue a first instruction when the monitoring result meets the set conditions; wherein,
[0007] The first instruction is used to instruct that the screen layout of the real-time video stream of the operating room be configured as a first screen layout that matches the set condition; the video screen in the screen layout of the real-time video stream of the operating room is provided by at least one video signal source in the operating room.
[0008] The embodiment of the present application also provides a method for configuring a real-time video stream, which is applied to a first terminal device; the first terminal device is respectively connected to each medical device in an operating room for communication; the method comprises:
[0009] Monitor the operating status of each medical device, and issue a first instruction when the monitoring result meets the set conditions; wherein,
[0010] The first instruction is used to instruct that the screen layout of the real-time video stream of the operating room be configured as a first screen layout that matches the set condition; the video screen in the screen layout of the real-time video stream of the operating room is provided by at least one video signal source in the operating room.
[0011] The embodiment of the present application further provides a control system for an operating room, the control system comprising at least a first terminal device and a display device; the first terminal device is respectively connected to each medical device in the operating room for communication;
[0012] The first terminal device is used to monitor the operating status of each of the medical devices, and issue a first instruction when the monitoring result meets the set condition; wherein the first instruction is used to instruct to configure the screen layout of the real-time video stream of the operating room to be a first screen layout matching the set condition; the video screen in the screen layout of the real-time video stream of the operating room is provided by at least one video signal source in the operating room;
[0013] The display device is used to display the real-time video stream of the operating room.
[0014] An embodiment of the present application further provides a storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of any of the above methods are implemented.
[0015] The terminal device, real-time video stream configuration method, control system and storage medium provided in the embodiment of the present application can configure the screen layout of the real-time video stream of the operating room to a screen layout that matches the set condition by monitoring the operating status of each medical device in the operating room and issuing a first instruction when the monitoring result meets the set condition. Based on the above scheme, the teaching screen can be automatically switched according to the real-time progress of the operation in the surgical teaching scene, avoiding frequent manual operations, saving time resources and human resources, and also improving the efficiency and accuracy of the teaching screen switching, greatly improving the teaching effect. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] Figure 1 This is a schematic diagram of using a large and small screen to display two images at the same time in the related art;
[0017] Figure 2 A schematic diagram of the system architecture of a control system of an operating room is provided for an embodiment of the present application;
[0018] Figure 3 A schematic diagram of the system architecture of another operating room control system is provided for an embodiment of the present application;
[0019] Figure 4 A schematic diagram of the system architecture of another operating room control system is provided for an embodiment of the present application;
[0020] Figure 5 A schematic diagram of the system architecture of another operating room control system is provided for an embodiment of the present application;
[0021] Figure 6 The routine operation process of a minimally invasive surgery in the relevant technology;
[0022] Figure 7A flowchart of a method for configuring a real-time video stream provided in an embodiment of the present application;
[0023] Figure 8 This is a schematic diagram of the structure of a first terminal device according to an embodiment of the present application. DETAILED DESCRIPTION
[0024] Doctors need to undergo long-term training and teaching to be able to perform various surgeries proficiently. In daily training and teaching in hospitals, surgical demonstration is the most intuitive teaching method that is widely used. In surgical demonstration, it is common to use the picture-in-picture split screen method to cut out multiple screens from the same screen for students to watch at the same time to meet the needs of teaching and learning. Due to the limitation of the screen display area, when the screen is divided into multiple screens, the screen will be too small to see the operation clearly, especially for minimally invasive surgeries with delicate operations. Some screens need to be enlarged to understand the operation essentials. In related technologies, large and small screens are often used to display two screens at the same time, such as Figure 1 As shown. However, because the monitor screen, panoramic screen, surgical field screen, and laparoscope screen need to be viewed throughout the entire operation, there must be a doctor in the operating room to cooperate with the surgeon to switch the screen, which is labor-intensive and inefficient. Moreover, if the screen switching is not timely or an error occurs, the key actions in the operation are easily missed, and the teaching effect is difficult to guarantee. At the same time, the operating room medical staff themselves also bear heavy surgical tasks, and it is difficult to have time to switch the teaching screen for teaching needs alone. If the screen switching operation is performed by non-operating room medical staff, they may not be clear about the surgeon's next operation intention and the actual situation of the operating room, and thus cannot complete the screen switching operation.
[0025] Based on this, the embodiment of the present application provides a terminal device, a configuration method for real-time video stream, a control system and a storage medium, which can configure the screen layout of the real-time video stream of the operating room to a screen layout that matches the set condition by monitoring the operating status of each medical device in the operating room and issuing a first instruction when the monitoring result meets the set condition. Based on the above scheme, the teaching screen can be automatically switched according to the real-time progress of the operation in the surgical teaching scene, avoiding frequent manual operations, saving time resources and human resources, and also improving the efficiency and accuracy of the teaching screen switching, greatly improving the teaching effect.
[0026] The present application is further described in detail below in conjunction with the accompanying drawings and embodiments.
[0027] Figure 2 A schematic diagram of the system architecture of a control system for an operating room provided in an embodiment of the present application is shown. Figure 2As shown, the control system 2 at least includes a first terminal device 21 and a display device 22. The first terminal device 21 is communicatively connected to each medical device 23 in the operating room.
[0028] In this system, all medical devices deployed in the operating room are centrally controlled through the first terminal device 21. At this time, the first terminal device 21 can obtain the real-time operating status of these medical devices. The device form of the first terminal device 21 can be a fixed terminal, or a mobile terminal, or a combination of a fixed terminal and a mobile terminal. Optionally, the first terminal device can be deployed in the same operating room as the medical devices.
[0029] Medical equipment 23 includes but is not limited to operating tables, operating lights, pneumoperitoneum machines, energy platforms, ultrasonic scalpels, electrosurgical scalpels, monitors, laparoscopes, etc. In actual application, according to the communication mode, communication protocol or communication interface supported by the medical equipment 23, the first terminal device 21 can achieve communication connection with each medical device 23 through wired communication or wireless communication. Exemplarily, the first terminal device 21 can be connected to a local area network at the same time as all medical equipment 23 in the operating room to achieve a safer and more reliable communication connection. Based on the communication connection between the first terminal device 21 and the medical equipment 23, the first terminal device 21 and the medical equipment 23 can transmit instructions or data to each other, including but not limited to the first terminal device 21 sending instructions to the medical equipment 23, the medical equipment 23 returning a response to the first terminal device 21, or the medical equipment 23 reporting data to the first terminal device 21.
[0030] The display device 22 may be a display device in an operating room or a display device in a demonstration room.
[0031] In addition, the control system 2 also includes a camera 24 that provides a video signal source, including but not limited to a camera for photographing the surgical field area and a camera for photographing the panoramic area of the operating room, etc. In addition, laparoscopes and monitors as medical equipment can also provide video signal sources.
[0032] As an implementation method, the control system 2 also includes a video encoder 25 and a video decoder 26, for example, an H.265 encoder and an H.265 decoder. The device providing the video signal source is connected to the video encoder 25 via a high-definition multimedia interface (HDMI) line or a digital component serial interface (SDI) line, and the video encoder 25 encodes the original video signal and transmits the encoded video signal to the first terminal device 21, and the first terminal device 21 is connected to the video decoder 26 for communication, and the video signal processed by the first terminal device 21 is decoded by the video decoder 26 and finally output in the display device 22.
[0033] Optionally, in one embodiment, the video encoder 25 and the video decoder 26 may be replaced by a video matrix 27. Figure 3 As shown, at this time, the device providing the video signal source is connected to the video matrix 27 via an HDMI cable or an SDI cable, and the video matrix 27 transmits the video signal to the first terminal device 21. The video signal processed by the first terminal device 21 is finally output in the display device 22.
[0034] Optionally, in one embodiment, the control system 2 further includes a second terminal device 28, which can be an independent video processing device capable of completing image stitching and switching, such as an image processor. At this time, the first terminal device 21 and the second terminal device 28 are in communication connection, and the second terminal device is used to generate a real-time video stream of a corresponding image layout in response to instructions issued by the first terminal device 21. Exemplarily, the first terminal device can be deployed in the same operating room as various medical devices, and the second terminal device can be deployed outside the operating room, for example, the second terminal device is a device in a demonstration room. Figure 4 As shown, when the control system 2 further includes a video encoder 25 and a video decoder 26, the device providing the video signal source is connected to the video encoder 25 via an HDMI cable or an SDI cable, the video encoder 25 encodes the original video signal, and transmits the encoded video signal to the second terminal device 28, the second terminal device 28 is connected to the video decoder 26 for communication, and the video signal processed by the second terminal device 28 is decoded by the video decoder 26 and finally output to the display device 22. Figure 5 As shown, when the control system 2 also includes a video matrix 27, the device providing the video signal source is connected to the video matrix 27 via an HDMI cable or an SDI cable, and the video matrix 27 transmits the video signal to the second terminal device 28. The video signal processed by the second terminal device 28 is finally output in the display device 22.
[0035] based on Figures 2 to 5 The system architecture of the control system of any operating room shown in the figure, the embodiment of the present application provides a first terminal device. In the embodiment of the present application, the first terminal device 21 is used to monitor the operating status of each medical device 23, and when the monitoring result meets the set condition, issue a first instruction; wherein the first instruction is used to instruct to configure the screen layout of the real-time video stream of the operating room to a first screen layout matching the set condition; the video screen in the screen layout of the real-time video stream of the operating room is provided by at least one video signal source in the operating room.
[0036] The real-time video stream of the operating room is displayed on the display device 22. In actual application, the display device 22 can be deployed in the teaching room.
[0037] Here, the first screen layout may reflect the video signal source providing the video screen and the screen size and screen position of each video screen in the real-time video stream.
[0038] Here, issuing the first instruction may also be understood as generating or producing the first instruction. The first terminal device 21 may issue the first instruction itself and then execute the operation corresponding to the first instruction itself.
[0039] Take minimally invasive surgery as an example. Minimally invasive surgery has the characteristics of small trauma and high efficiency. It can improve the turnover rate of medical resources and improve the operating efficiency of hospitals. Therefore, it has been vigorously promoted. In recent years, it has been chosen by more and more doctors and patients, and the number of surgeries has increased year by year. Figure 6 The conventional operation process of a minimally invasive surgery is shown. Among them, body positioning, skin incision, establishment of pneumoperitoneum, insertion of sheath card, insertion of laparoscope, removal of lesions, specimen collection, and skin suturing are key steps in the operation. During the complete operation, since the surgeon needs to switch back and forth between the outside and inside of the abdominal cavity to perform various operations, the teaching screen for students needs to switch back and forth between various camera screens. Therefore, the solution provided in the embodiment of the present application is particularly suitable for the teaching scenario of minimally invasive surgery.
[0040] Based on the solution provided in the embodiment of the present application, the teaching screen can be automatically switched according to the real-time progress of the operation in the surgical teaching scenario, avoiding frequent manual operations, saving time and human resources, while also improving the efficiency and accuracy of teaching screen switching, greatly improving the teaching effect.
[0041] For minimally invasive surgery, when performing surgical teaching, the monitor screen, panoramic screen, surgical field screen, and laparoscope screen need to be viewed throughout the entire surgical process. Based on this, in one embodiment, the at least one video signal source includes at least one of the following: a first video signal source provided by a camera device for photographing the surgical field area, a second video signal source provided by the monitor regarding the monitor display interface, a third signal source provided by a camera device for photographing the panoramic area of the operating room, and a fourth signal source provided by a laparoscope camera.
[0042] In one embodiment, the setting conditions include:
[0043] The configured medical device performs the configured operation; and / or,
[0044] The set medical device sends a set signal.
[0045] In actual application, the real-time progress of the operation can be determined based on the operation performed by the medical device or the signal sent. In the embodiment of the present application, when the first terminal device 21 detects that the set medical device has performed the set operation, and / or detects that the set medical device has sent a set signal, it can automatically identify the real-time progress of the operation that matches the set operation and / or the set signal, and further adjust the screen layout of the real-time video stream of the operating room according to the real-time progress of the operation, so as to provide a surgical screen with key information in combination with the real-time progress of the operation.
[0046] In one embodiment, the set conditions include that the surgical light has activated the global lighting mode, and correspondingly, the video screen in the first screen layout is provided by at least the first video signal source and the second video signal source. In actual applications, when the surgical light activates the global lighting mode, it indicates that the current operation will enter the skin incision and sheath card insertion stage. At this time, the operation actions of the entire surgical field area need to be displayed to the students. At the same time, students also need to pay attention to changes in the patient's vital signs. Therefore, when the first terminal device 21 detects that the surgical light has activated the global lighting mode, it will automatically use the surgical field screen and the monitor screen as teaching screens for teaching. In actual applications, the surgical field screen and the monitor screen can be presented in large and small screen modes.
[0047] In one embodiment, the setting condition includes that the laparoscope has activated the white balance function of the camera, and correspondingly, the video screen in the first screen layout is provided by at least two of the first video signal source, the second video signal source, the third video signal source, and the fourth video signal source. In actual applications, when the laparoscope activates the white balance function of the camera, it indicates that the assistant of the surgeon will insert the laparoscope into the patient's abdomen to start laparoscopic surgery. At this time, the preparation work in the entire operating room, the surgeon's hand operation, and the patient's vital signs information all need to be paid attention to, and the surgical field screen, laparoscope screen, panoramic screen, and monitor screen need to be displayed synchronously. Therefore, when the first terminal device 21 detects that the laparoscope has activated the white balance function of the camera, it will automatically use the surgical field screen, laparoscope screen, panoramic screen, and monitor screen as teaching screens for teaching. In actual applications, the surgical field screen, laparoscope screen, panoramic screen, and monitor screen can be presented in a four-split screen mode.
[0048] In one embodiment, the set conditions include that the energy platform has started an ultrasonic scalpel and / or an electric scalpel, and correspondingly, the video screen in the first screen layout is provided by at least the first video signal source and the fourth video signal source. In actual applications, when the energy platform starts the ultrasonic scalpel and / or the electric scalpel, it indicates that the surgeon has begun to free the tissue. At this time, students need to focus on observing the freeing process and the hand movements of the surgeon. Therefore, when the first terminal device 21 detects that the energy platform has started the ultrasonic scalpel and / or the electric scalpel, it will automatically use the surgical field screen and the laparoscope screen as teaching screens for teaching. In actual applications, the surgical field screen and the laparoscope screen can be presented in a large and small screen mode, for example, the laparoscope screen is a large screen and the surgical field screen is a small screen.
[0049] In one embodiment, the set condition includes that the monitor sends an alarm signal, and correspondingly, the video screen in the first screen layout is provided by at least the second signal source. In actual applications, when the monitor sounds an alarm during surgery, it indicates that the patient's vital signs fluctuate. Therefore, when the first terminal device 21 detects that the monitor sends an alarm signal, it will automatically use the monitor screen as a teaching screen for teaching. In actual applications, the monitor screen can be superimposed next to other screens in the form of a small window.
[0050] In one embodiment, the first terminal device 21 is further used for:
[0051] In response to the second instruction, a matching relationship between the setting condition and the first screen layout is configured.
[0052] In an embodiment of the present application, a user can configure: when a device performs a certain operation and / or sends a certain signal, which video screens are used as teaching screens, and at which screen position each video screen used as a teaching screen is configured, and the screen size corresponding to each video screen.
[0053] In one embodiment, configuring the screen layout of the real-time video stream of the operating room to be a first screen layout matching the set condition includes:
[0054] The second screen layout is changed to the first screen layout; wherein the second screen layout represents the screen layout of the real-time video stream of the operating room before the monitoring result meets the set condition; or,
[0055] adding or reducing video signal sources in the second screen layout; or,
[0056] Maintain the screen layout of the real-time video stream of the operating room before the monitoring result meets the set conditions.
[0057] Here, when configuring the first screen layout, according to the display difference between the first screen layout and the second screen layout currently displayed and outputted, there may be the above three implementation methods of the first screen layout, specifically:
[0058] The first one is that no matter whether the first picture layout and the existing second picture layout have video pictures provided by the same video signal source, the existing second picture layout is directly changed to the first picture layout.
[0059] This method is suitable for situations where the video signal sources of the first screen layout and the existing second screen layout are quite different. For example, the video signal sources in the first screen layout are A and B, and the video signal sources in the second screen layout are C and D. For another example, the first screen layout is a large and small screen mode, and the second screen layout is a four-split screen mode. In the above cases, the screen layout is usually changed directly as a whole to improve the efficiency of switching the screen layout.
[0060] The second method is to determine the video signal sources that are added or reduced in the first screen layout compared to the existing second screen layout, and to increase or reduce the video signal sources on the basis of the second screen layout.
[0061] This method is suitable for situations where the video signal source difference between the first screen layout and the existing second screen layout is small. For example, when the monitor sends out an alarm signal, it is necessary to superimpose the monitor screen in the current screen layout. In this case, just add the video signal source corresponding to the monitor in the current screen layout and superimpose the monitor screen in the form of a small window. Therefore, according to the display difference before and after the screen layout is switched, the second configuration method can be used when the display difference is small, which can also relatively improve the switching efficiency of the screen layout.
[0062] The third type is that if the video signal sources of the first screen layout and the existing second screen layout are completely consistent, the existing second screen layout is kept unchanged.
[0063] In one embodiment, the first terminal device 21 is further configured to generate a real-time video stream of the first screen layout in response to the first instruction.
[0064] In the embodiment of the present application, the first terminal device 21 has the ability to complete image stitching and switching, and can integrate the video images provided by various video signal sources to generate a real-time video stream of the first image layout.
[0065] In one embodiment, the first terminal device 21 is further configured to send the first instruction to the second terminal device 38 to instruct the second terminal device 28 to generate a real-time video stream of the first screen layout.
[0066] In the embodiment of the present application, the second terminal device 28 has the ability to complete screen splicing and switching, and can respond to the first instruction issued by the first terminal device 21, integrate the video screens provided by various video signal sources, and generate a real-time video stream of the first screen layout.
[0067] In one embodiment, the parameters for configuring the screen layout include: a first parameter and / or a second parameter; wherein,
[0068] The first parameter represents at least one video signal source providing a video picture; the second parameter represents a picture position and / or a picture size of a video picture provided by each video signal source in a real-time video stream.
[0069] In an embodiment of the present application, when the monitoring result meets the set condition, the screen layout of the real-time video stream of the operating room is configured as a first screen layout that matches the set condition, wherein the first screen layout is configured according to the first parameter and / or the second parameter, and all video signal sources providing the video screen are determined according to the first parameter, and the screen position and / or screen size of the video screen provided by each video signal source in the real-time video stream are determined according to the second parameter. Here, both the first parameter and the second parameter can be pre-set according to demand, and it can also be understood that how the display form of a screen layout is determined by the first parameter and / or the second parameter.
[0070] In actual applications, only the first parameter can be set. In this case, the position and size of the video image provided by each video signal source in the real-time video stream are random or default. Only the second parameter can be set. The second parameter can be in array form, and each element represents a video signal source. If the element value is empty, the video image provided by the corresponding video signal source can be defaulted not to be displayed.
[0071] Based on the above description of the first terminal device side embodiment, correspondingly, the embodiment of the present application also provides a real-time video stream configuration method, which is applied to the first terminal device, and the first terminal device is respectively connected to each medical device in the operating room. Figure 7 , the method comprising:
[0072] Step 701: Monitor the operating status of each medical device and issue a first instruction when the monitoring result meets the set conditions.
[0073] Among them, the first instruction is used to instruct to configure the screen layout of the real-time video stream of the operating room to be a first screen layout that matches the set condition; the video screen in the screen layout of the real-time video stream of the operating room is provided by at least one video signal source in the operating room.
[0074] In one embodiment, the setting conditions include:
[0075] The configured medical device performs the configured operation; and / or,
[0076] The set medical device sends a set signal.
[0077] In one embodiment, the at least one video signal source includes at least one of the following: a first video signal source provided by a camera device for capturing the surgical field area, a second video signal source provided by a monitor regarding a monitor display interface, a third signal source provided by a camera device for capturing the panoramic area of the operating room, and a fourth signal source provided by a laparoscope camera.
[0078] In one embodiment, the set condition includes that the surgical lamp starts a global illumination mode, and correspondingly, the video images in the first image layout are provided by at least the first video signal source and the second video signal source; and / or,
[0079] The setting condition includes that the laparoscope starts the white balance function of the camera, and correspondingly, the video screen in the first screen layout is provided by at least two of the first video signal source, the second video signal source, the third video signal source and the fourth video signal source; and / or,
[0080] The set condition includes that the energy platform starts the ultrasonic knife and / or the electric knife, and correspondingly, the video picture in the first picture layout is provided by at least the first video signal source and the fourth video signal source; and / or,
[0081] The set condition includes that the monitor sends out an alarm signal, and correspondingly, the video screen in the first screen layout is provided by at least the second signal source.
[0082] In one embodiment, configuring the screen layout of the real-time video stream of the operating room to be a first screen layout matching the set condition includes:
[0083] The second screen layout is changed to the first screen layout; wherein the second screen layout represents the screen layout of the real-time video stream of the operating room before the monitoring result meets the set condition; or,
[0084] adding or reducing video signal sources in the second screen layout; or,
[0085] Maintain the screen layout of the real-time video stream of the operating room before the monitoring result meets the set conditions.
[0086] In one embodiment, the method further comprises:
[0087] In response to the second instruction, a matching relationship between the setting condition and the first screen layout is configured.
[0088] In one embodiment, the method further comprises:
[0089] In response to the first instruction, a real-time video stream of the first screen layout is generated.
[0090] In one embodiment, the method further comprises:
[0091] The first instruction is sent to a second terminal device so that the second terminal device generates a real-time video stream of the first screen layout.
[0092] In one embodiment, the parameters for configuring the screen layout include: a first parameter and / or a second parameter; wherein,
[0093] The first parameter represents at least one video signal source providing a video picture; the second parameter represents a picture position and / or a picture size of a video picture provided by each video signal source in a real-time video stream.
[0094] It should be noted that when the first terminal device is configuring the real-time video stream, in actual applications, the relevant operations of the configuration of the real-time video stream can be assigned to different program modules as needed to complete all or part of the processing described above. In addition, the configuration method of the real-time video stream provided in the above embodiment belongs to the same concept as the embodiment on the first terminal device side. The specific implementation process is detailed in the embodiment on the first terminal device side, which will not be repeated here.
[0095] In order to implement the configuration method of the real-time video stream in the embodiment of the present application, the embodiment of the present application further provides a first terminal device, which is respectively connected to each medical device in the operating room for communication, such as Figure 8 As shown, the first terminal device 800 includes:
[0096] Communication interface 801, capable of exchanging information with other devices;
[0097] The processor 802 is connected to the communication interface 801 to implement information exchange with other devices, and is used to execute the method provided by one or more technical solutions of the first terminal device side when running the computer program. The computer program is stored in the memory 803.
[0098] Specifically, the communication interface 801 is used to issue a first instruction when the monitoring result meets the set condition;
[0099] Among them, the first instruction is used to instruct to configure the screen layout of the real-time video stream of the operating room to be a first screen layout that matches the set condition; the video screen in the screen layout of the real-time video stream of the operating room is provided by at least one video signal source in the operating room.
[0100] The processor 802 is used to monitor the operating status of each of the medical devices.
[0101] In one embodiment, the setting conditions include:
[0102] The configured medical device performs the configured operation; and / or,
[0103] The set medical device sends a set signal.
[0104] In one embodiment, the at least one video signal source includes at least one of the following: a first video signal source provided by a camera device for capturing the surgical field area, a second video signal source provided by a monitor regarding a monitor display interface, a third signal source provided by a camera device for capturing the panoramic area of the operating room, and a fourth signal source provided by a laparoscope camera.
[0105] In one embodiment, the set condition includes that the surgical lamp starts a global illumination mode, and correspondingly, the video images in the first image layout are provided by at least the first video signal source and the second video signal source; and / or,
[0106] The setting condition includes that the laparoscope starts the white balance function of the camera, and correspondingly, the video screen in the first screen layout is provided by at least two of the first video signal source, the second video signal source, the third video signal source and the fourth video signal source; and / or,
[0107] The set condition includes that the energy platform starts the ultrasonic knife and / or the electric knife, and correspondingly, the video picture in the first picture layout is provided by at least the first video signal source and the fourth video signal source; and / or,
[0108] The set condition includes that the monitor sends out an alarm signal, and correspondingly, the video screen in the first screen layout is provided by at least the second signal source.
[0109] In one embodiment, the processor 802 configures the screen layout of the real-time video stream of the operating room to be a first screen layout matching the set condition, including:
[0110] The second screen layout is changed to the first screen layout; wherein the second screen layout represents the screen layout of the real-time video stream of the operating room before the monitoring result meets the set condition; or,
[0111] adding or reducing video signal sources in the second screen layout; or,
[0112] Maintain the screen layout of the real-time video stream of the operating room before the monitoring result meets the set conditions.
[0113] In one embodiment, the processor 802 is further configured to:
[0114] In response to the second instruction, a matching relationship between the setting condition and the first screen layout is configured.
[0115] In one embodiment, the processor 802 is further configured to:
[0116] In response to the first instruction, a real-time video stream of the first screen layout is generated.
[0117] In one embodiment, the communication interface 801 is further used for:
[0118] The first instruction is sent to a second terminal device so that the second terminal device generates a real-time video stream of the first screen layout.
[0119] In one embodiment, the parameters for configuring the screen layout include: a first parameter and / or a second parameter; wherein,
[0120] The first parameter represents at least one video signal source providing a video picture; the second parameter represents a picture position and / or a picture size of a video picture provided by each video signal source in a real-time video stream.
[0121] Of course, in actual application, the various components in the first terminal device 800 are coupled together through the bus system 804. It can be understood that the bus system 804 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 804 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clarity, Figure 8 Various buses are labeled as bus system 804 .
[0122] The memory 803 in the embodiment of the present application is used to store various types of data to support the operation of the first terminal device 800. Examples of such data include: any computer program used to operate on the first terminal device 800.
[0123] The method disclosed in the above embodiment of the present application can be applied to the processor 802, or implemented by the processor 802. The processor 802 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by an integrated logic circuit of the hardware in the processor 802 or an instruction in the form of software. The above-mentioned processor 802 may be a general-purpose processor, a digital signal processor (DSP, Digital Signal Processor), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The processor 802 can implement or execute the various methods, steps and logic block diagrams disclosed in the embodiments of the present application. A general-purpose processor may be a microprocessor or any conventional processor, etc. In combination with the steps of the method disclosed in the embodiment of the present application, it can be directly embodied as a hardware decoding processor to execute, or it can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium, which is located in the memory 803, and the processor 802 reads the information in the memory 803 and completes the steps of the above method in combination with its hardware.
[0124] In an exemplary embodiment, the first terminal device 800 can be implemented by one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers (MCUs), microprocessors, or other electronic components to execute the aforementioned method.
[0125] It can be understood that the memory of the embodiment of the present application can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a ferromagnetic random access memory, a flash memory, a magnetic surface memory, an optical disc, or a compact disc read-only memory (CD-ROM); the magnetic surface memory can be a disk memory or a tape memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), synchronous static random access memory (SSRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM, SyncLink Dynamic Random Access Memory), and direct RAM bus random access memory (DRRAM, Direct Rambus Random Access Memory).The memories described in the embodiments of the present application are intended to include, but are not limited to, these and any other suitable types of memories.
[0126] In an exemplary embodiment, the embodiment of the present application further provides a storage medium, namely a computer storage medium, specifically a computer-readable storage medium, for example, a storage device storing a computer program, and the computer program can be executed by the processor 802 of the first terminal device 800 to complete the steps of the aforementioned control device side method. The computer-readable storage medium can be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface storage, optical disk, or CD-ROM.
[0127] It should be noted that: "first", "second", etc. are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.
[0128] The term "and / or" herein is only a description of the association relationship of the associated objects, indicating that there may be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" herein represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C can represent including any one or more elements selected from the set consisting of A, B, and C.
[0129] In addition, the technical solutions described in the embodiments of the present application can be combined arbitrarily without conflict.
[0130] The above description is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application.
Claims
1. A first terminal device, characterized in that: The first terminal device is respectively connected to each medical device in the operating room for communication; The first terminal device is used to monitor the operating status of each of the medical devices and issue a first instruction when the monitoring result meets the set conditions; wherein, The first instruction is used to instruct that the screen layout of the real-time video stream of the operating room be configured as a first screen layout that matches the set condition; the video screen in the screen layout of the real-time video stream of the operating room is provided by at least one video signal source in the operating room.
2. The first terminal device according to claim 1, characterized in that: The setting conditions include: The configured medical device performs the configured operation; and / or, The set medical device sends a set signal.
3. The first terminal device according to claim 2, characterized in that: The at least one video signal source includes at least one of the following: a first video signal source provided by a camera device for photographing the surgical field area, a second video signal source provided by a monitor regarding a monitor display interface, a third signal source provided by a camera device for photographing a panoramic area of the operating room, and a fourth signal source provided by a laparoscope camera.
4. The first terminal device according to claim 3, characterized in that: The setting condition includes that the surgical lamp starts the global illumination mode, and correspondingly, the video screen in the first screen layout is provided by at least the first video signal source and the second video signal source; and / or, The setting condition includes that the cavity mirror starts the white balance function of the camera, and correspondingly, the video picture in the first picture layout is provided by at least two of the first video signal source, the second video signal source, the third video signal source and the fourth video signal source; and / or, The set condition includes that the energy platform starts the ultrasonic knife and / or the electric knife, and correspondingly, the video picture in the first picture layout is provided by at least the first video signal source and the fourth video signal source; and / or, The set condition includes that the monitor sends out an alarm signal, and correspondingly, the video screen in the first screen layout is provided by at least the second signal source.
5. The first terminal device according to claim 1, characterized in that: Configuring the screen layout of the real-time video stream of the operating room to be a first screen layout matching the set condition includes: The second screen layout is changed to the first screen layout; wherein the second screen layout represents the screen layout of the real-time video stream of the operating room before the monitoring result meets the set condition; or, adding or reducing video signal sources in the second screen layout; or, Maintain the screen layout of the real-time video stream of the operating room before the monitoring result meets the set conditions.
6. The first terminal device according to any one of claims 1 to 5, characterized in that: The first terminal device is also used for: In response to the second instruction, a matching relationship between the setting condition and the first screen layout is configured.
7. The first terminal device according to any one of claims 1 to 5, characterized in that: The first terminal device is further configured to generate a real-time video stream of the first screen layout in response to the first instruction.
8. The first terminal device according to any one of claims 1 to 5, characterized in that: The first terminal device is further used to send the first instruction to the second terminal device to instruct the second terminal device to generate a real-time video stream of the first screen layout; The first terminal device can be deployed in the same operating room as the medical devices; the second terminal device can be deployed outside the operating room.
9. The first terminal device according to any one of claims 1 to 5, characterized in that: The parameters used to configure the screen layout include: a first parameter and / or a second parameter; wherein, The first parameter represents at least one video signal source providing a video picture; the second parameter represents a picture position and / or a picture size of a video picture provided by each video signal source in a real-time video stream.
10. A method for configuring a real-time video stream, characterized in that: Applied to a first terminal device; The first terminal device is respectively connected to each medical device in the operating room for communication; the method comprises: Monitor the operating status of each of the medical devices, and issue a first instruction when the monitoring result meets the set conditions; wherein, The first instruction is used to instruct that the screen layout of the real-time video stream of the operating room be configured as a first screen layout that matches the set condition; the video screen in the screen layout of the real-time video stream of the operating room is provided by at least one video signal source in the operating room.
11. The method according to claim 10, characterized in that The setting conditions include: The configured medical device performs the configured operation; and / or, The set medical device sends a set signal.
12. The method according to claim 11, characterized in that The at least one video signal source includes at least one of the following: a first video signal source provided by a camera device for photographing the surgical field area, a second video signal source provided by a monitor regarding a monitor display interface, a third signal source provided by a camera device for photographing a panoramic area of the operating room, and a fourth signal source provided by a laparoscope camera.
13. The method according to claim 12, characterized in that The setting condition includes that the surgical lamp starts the global illumination mode, and correspondingly, the video screen in the first screen layout is provided by at least the first video signal source and the second video signal source; and / or, The setting condition includes that the cavity mirror starts the white balance function of the camera, and correspondingly, the video picture in the first picture layout is provided by at least two of the first video signal source, the second video signal source, the third video signal source and the fourth video signal source; and / or, The set condition includes that the energy platform starts the ultrasonic knife and / or the electric knife, and correspondingly, the video picture in the first picture layout is provided by at least the first video signal source and the fourth video signal source; and / or, The set condition includes that the monitor sends out an alarm signal, and correspondingly, the video screen in the first screen layout is provided by at least the second signal source.
14. The method according to claim 10, characterized in that Configuring the screen layout of the real-time video stream of the operating room to be a first screen layout matching the set condition includes: The second screen layout is changed to the first screen layout; wherein the second screen layout represents the screen layout of the real-time video stream of the operating room before the monitoring result meets the set condition; or, adding or reducing video signal sources in the second screen layout; or, Maintain the screen layout of the real-time video stream of the operating room before the monitoring result meets the set conditions.
15. A control system for an operating room, characterized in that: The control system at least includes a first terminal device and a display device; the first terminal device is respectively connected to each medical device in the operating room for communication; The first terminal device is the device described in any one of claims 1-9.
16. A storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 10 to 14 are implemented.
