Interaction control method and control system of operating room display terminal

Abstract

The invention relates to an interaction control method and control system for an operating room display terminal. The control method comprises the following steps: carrying out coordinate division on display areas under different interfaces of the display terminal; different logic control instructions are given to the interaction operation of each area based on different interfaces, the interaction action of the display area is detected in real time, and control instruction judgment is carried out based on the action type and coordinates of the interaction action and the area to which the coordinates belong; therefore, the switching between the control interface and the full-screen display interface and the interactive operation under the two interfaces are realized, the complexity of operating room image control is simplified, the instability possibly caused by multi-device integration of the control terminal is reduced, and the reliability and usability of the system are improved.

Description

Technical Field

[0001] The present invention belongs to the technical field of medical equipment, and in particular relates to an interactive control method and a control system for an operating room display terminal. Background Art

[0002] With the continuous advancement of medical technology, digital operating rooms have become a key component of the digital construction of modern hospitals. The goal of a digital operating room is to achieve network connectivity between the operating room and other departments of the hospital through highly compatible equipment and integrated control platforms, so that doctors can obtain patient information and surgical references. Although existing digital operating rooms have achieved this goal to a certain extent, there are still some significant limitations. At present, existing operating room control systems usually require a control end workstation and at least one medical image display terminal. The medical equipment in the operating room is controlled by an integrated workstation to distribute the signal source image to the designated medical image display terminal. This control method requires independent control and display devices, which are usually large in size and require additional space for installation. A large number of cable connections are required in the operating room, which not only takes up a lot of space in the operating room, but may also interfere with the doctor's workflow.

[0003] Therefore, it is necessary to develop an operating room display terminal that integrates operating room control functions and signal source image display functions to simplify the structure of the operating room control system and reduce the space occupied by the operating room. In addition, when the operating room control function and the signal source image display function are integrated in the same display terminal, the interactive control logic becomes very complicated and difficult to operate, which not only requires extra time to train medical staff, but also may affect the operation due to system delays or failures. Summary of the invention

[0004] The purpose of the present invention is to solve one of the above technical problems and to provide an interactive control method and control system for an operating room display terminal.

[0005] To achieve the above object, the technical solution adopted by the present invention is:

[0006] An interactive control method for an operating room display terminal, the display terminal at least comprising a control terminal function interface and a full-screen display interface, the interactive control method comprising the following steps:

[0007] When the display terminal is in the control terminal function interface, the display area of ​​the operating room display terminal is divided into a signal source selection area, a layout switching area, a medical image display area and a blank area;

[0008] The signal source selection area is used to display preview images of all signal sources currently connected to the display terminal; the layout switching area is used to display multiple pre-divided playback layouts, wherein each playback layout includes at least one window for playing videos; the medical image display area plays at least one signal source image currently connected to the display terminal based on the playback layout currently selected in the layout switching area;

[0009] In the control terminal function interface, the interactive actions in the display area are detected in real time, and the control command is judged based on the action type, coordinates and area to which the coordinates belong to the interactive action;

[0010] When the interactive action is a single click and the click coordinates are located in the layout switching area, the current instruction is determined to be a layout switching instruction, and the medical image display area is divided into play windows based on the play layout corresponding to the click coordinates in the layout switching area, so that the medical image display area plays the signal source image based on the play layout;

[0011] When the interactive action is to click twice and the coordinates of the two clicks are located in the signal source selection area and the medical image display area respectively, or when the interactive action is to press and drag and the starting coordinates and the ending coordinates of the action are located in the signal source selection area and the medical image display area respectively, the current instruction is judged to be a screen introduction instruction, and the signal source screen corresponding to the starting coordinates of the action is moved into the playback window corresponding to the ending coordinates for display;

[0012] When the interactive action is a single click, and the coordinates of the single click are located in the blank area, the current instruction is determined to be a full-screen display instruction, the image in the current medical image display area is displayed in full screen, and the display terminal enters a full-screen display interface.

[0013] In some embodiments of the present invention, the following steps are also included:

[0014] When the display terminal is in the control end function interface, the interactive action in the display area is detected in real time, and the control instruction is judged based on the action type, coordinates and area to which the coordinates belong to the interactive action;

[0015] When the interactive action is long press and drag, and the starting coordinates and the ending coordinates of the action are respectively located in two different play windows, the current instruction is determined to be a position exchange instruction, and the signal source images in the two play windows are exchanged;

[0016] When the interactive action is a double-click and the double-click coordinates are located in any playback window, the current instruction is judged to be a regional full-screen display instruction, and the picture in the playback window corresponding to the double-click coordinates is displayed in full screen. At this time, the interactive action of the display area is continuously detected. When the next double-click action is detected, the original layout display screen is returned.

[0017] In some embodiments of the present invention, the plurality of pre-divided playback layouts include at least a picture-in-picture layout, a single window layout, a two-part window layout, a four-part window layout, and a six-part window layout.

[0018] In some embodiments of the present invention, the picture-in-picture layout includes a main playback window and a sub-playback window;

[0019] When the currently selected playback layout in the layout switching area is a picture-in-picture layout and the full-screen display interface is entered, the method for determining the control instruction in the full-screen display interface further includes:

[0020] When the interactive action is long press and drag, and the starting coordinates of the action are located at the center of the sub-play window, the current instruction is determined to be a sub-window move instruction, and the screen of the sub-play window is moved from the starting coordinate position to the end coordinate position of the action for display;

[0021] When the interactive action is long press and drag, and the starting coordinates of the action are located at the upper left corner of the sub-play window, and the ending coordinates are located at the upper left of the starting coordinates, the current command is determined to be a small window zoom command; at this time, the coordinates of the lower right corner of the sub-play window are kept unchanged, and the coordinates of the upper left corner of the sub-play window are moved from the starting coordinates of the action to the ending coordinates of the action, and the screen ratio of the sub-play window is kept unchanged during the movement;

[0022] When the interactive action is long press and drag, and the starting coordinates of the action are located at the upper left corner of the sub-play window, and the end coordinates are located at the lower right of the starting coordinates, the current instruction is judged to be a sub-window reduction instruction; at this time, the coordinates of the lower right corner of the sub-play window are kept unchanged, and the coordinates of the upper left corner of the sub-play window are moved from the starting coordinates of the action to the end coordinates of the action, and the screen ratio of the sub-play window is kept unchanged during the movement.

[0023] In some embodiments of the present invention, when the display terminal is in a full-screen display interface, a floating control button is set above the video playback channel, and the method for judging control instructions in the full-screen display interface also includes: when the interactive action is a single click and the click coordinates are located in the floating control button area, the current instruction is judged to be an exit full-screen display instruction. At this time, the full-screen display of the medical image display area is exited, and the display terminal enters the control end function interface.

[0024] In some embodiments of the present invention, the display terminal is connected to an image processing engine, and an interactive coordinate recognition layer is arranged on the top layer of its picture channel, and the bottom layer is a picture input layer of the image processing engine;

[0025] After the display terminal determines the control instruction, it sends the current control instruction to the image processing engine, and the image processing engine changes the coordinate starting point and coordinate range of the image output of the corresponding signal source screen in the display area based on the control instruction.

[0026] In some embodiments of the present invention, the display terminal is connected to at least one external display, and the interactive control method further comprises the following steps:

[0027] When the display terminal is in the control terminal function interface, a display selection area is further divided in the display area of ​​the operating room display terminal; the display terminal distributes the signal source screen to at least one external display for display by identifying the interactive action in the display selection area;

[0028] Before the display terminal distributes the signal source screen, it identifies the resolution of the external display connected to it, and divides the screen of the external display based on the resolution to control the coordinate starting point and coordinate range of the image output of the signal source screen in the display area of ​​the external display.

[0029] Some embodiments of the present invention further provide an operating room control system, comprising an operating room display terminal and at least one medical imaging device;

[0030] Each medical imaging device is connected to an encoding device, and the display terminal and the encoding device are connected to the same local area network; the encoding device is used to encode the video images taken by the medical imaging device into an IP stream and push it to the local area network;

[0031] The display terminal is connected to an image processing engine with a decoding function, and an interactive coordinate recognition layer is arranged at the top layer of its picture channel, and the bottom layer is a picture input layer of the image processing engine; the interactive coordinate recognition layer is used to detect interactive actions in the terminal display area in real time, and the picture input layer of the image processing engine is used to control the image output coordinate starting point and coordinate range of each signal source picture in the display area; the display terminal adopts the interactive control method of the operating room display terminal according to any one of claims 1 to 5 for interactive control;

[0032] The display terminal controls the communication between the coding device and the image processing engine connected to the local area network, so as to display the video images captured by the medical imaging equipment in real time in the display area of ​​the display terminal.

[0033] In some embodiments of the present invention, the display terminal and the encoding device are connected to the same local area network through at least one interconnected switch.

[0034] In some embodiments of the present invention, the device further comprises: at least one external display, each of which is connected to an image processing engine with a decoding function and is connected to a local area network;

[0035] The display terminal controls the communication with the coding device and the image processing engine connected to the network through the local area network, so as to distribute the video images captured by the medical imaging equipment to each external display for display.

[0036] The beneficial effects of the present invention are:

[0037] 1. The present invention integrates the functions of the existing wall-mounted integrated display and the integrated workstation in the operating room into one, and provides an operating room display terminal with both control and display functions, so that the user can directly perform the operating room display image layout and equipment control on the display terminal without the need for additional control equipment. By reducing the number of necessary external devices, the space occupation and cable requirements of the operating room are reduced, and it can also be adapted to operating rooms of more types and sizes;

[0038] 2. The interactive control method of the display terminal provided by the present invention divides the display areas under different interfaces of the display terminal by coordinates, and assigns different logical control instructions to the interactive operations of each area based on different interfaces, so as to realize the switching of the control interface and the full-screen display interface and the interactive operations under the two interfaces, simplifying the complexity of operating room image control, reducing the instability that may be caused by the integration of multiple devices in the control terminal, and improving the reliability and ease of use of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the specific embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0040] Figure 1 This is a diagram of the digital operating room control system architecture in the prior art;

[0041] Figure 2 It is a flow chart of an interactive control method of an operating room display terminal;

[0042] Figure 3 A schematic diagram of the display area division of the operating room display terminal;

[0043] Figure 4 A schematic diagram of the optional playback layout for the layout switching area;

[0044] Figure 5 A schematic diagram of a four-split screen playback layout for a medical image display area;

[0045] Figure 6 A schematic diagram of the full-screen display state of the four-split-screen playback layout;

[0046] Figure 7 It is a schematic diagram of the coordinate recognition structure of the display terminal;

[0047] Figure 8 The present invention is an architecture diagram of an operating room control system;

[0048] Fig. 9This is the architecture diagram of the video fusion matrix of the operating room control system;

[0049] Fig.10 This is the display terminal screen layout diagram of the video matrix technical solution. DETAILED DESCRIPTION

[0050] In order to make the purpose, technical solutions and advantages of the present application clearer, the present application is described and illustrated below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. Based on the embodiments provided in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0051] It should be noted that the terms used herein are only for describing specific embodiments and are not intended to limit the exemplary embodiments according to the present application. As used herein, unless the context clearly indicates otherwise, the singular form is also intended to include the plural form. In addition, it should be understood that the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0052] In the absence of conflict, the embodiments of the present invention and the features of the embodiments may be combined with each other.

[0053] In order to better explain the solution of the present invention, the composition structure and existing defects of the existing digital operating room are firstly described.

[0054] In the existing technology, the digital operating room is an important part of the hospital's digital construction. The goal of the digital operating room construction is to establish a network connection between the operating room, doctor's office, nurse station, classroom, ward and other departments of the hospital, and provide highly compatible equipment and operating room information integration and control platform to facilitate the storage and access of surgical patient information and teaching video related materials, so that doctors can understand various information about patients. At the same time, the control platform needs to have a powerful image coordination function, and display images on multiple external monitors in the operating room to provide a comprehensive and fast reference for surgical plan formulation and surgical process. The existing digital operating room control system architecture is shown in the attached figure. Figure 1 As shown, including at least:

[0055] A set of integrated display is installed on the wall of the operating room to display patient information and various related medical information.

[0056] An integrated workstation is installed on the wall of the operating room. The system host is installed with a control system to collect, forward and store video input signals from various equipment in the operating room, including panoramic camera signals, surgical field camera signals, laparoscope video signals, monitor image signals, etc. It has functions such as audio and video acquisition, video switching, surgical teaching, video preview, recording, surgical patient information management, equipment control, and video file management.

[0057] Two sets of endoscopic external monitors are installed on the cantilever of the pendant tower to display the intraoperative information in all directions. The integrated workstation enables the endoscopic external monitor to display the connected medical signals in a variety of playback layouts.

[0058] One set of audio components is used to collect and transmit the sound during the doctor's surgical explanation and the recording of surgical video resources.

[0059] 1 set of camera system components, used to view the global image in the operating room or the surgeon's endoscopic operation techniques.

[0060] As attached Figure 1 As shown, in the prior art, the digital operating room acquires images through a video matrix or distributed encoder or other equipment with an image processing engine to collect the signal images of medical equipment, and a control terminal such as an integrated workstation controls the video matrix or distributed decoder with an image processing engine to distribute the signal source image to the designated external display in the operating room. Therefore, if the operating room needs to realize basic digital image control functions, it needs at least one control end workstation with a control host and an external display, as well as a medical image display terminal for viewing image data or comprehensive surgical information. At present, such a digital operating room image control method has the following problems:

[0061] 1. The control end and the display end are two devices, where the control end is integrated with multiple devices (including a control host with an operating system, a keyboard and mouse, and an external display with touch function or non-touch function). The combination of multiple devices has a certain degree of instability, and it is difficult to troubleshoot problems later.

[0062] 2. The operating room needs to reserve installation space for control equipment and display equipment. However, due to the integration of multiple devices, the overall size of such equipment is too large, which often occupies a large space in the operating room. In addition, too many cables are reserved in the operating room when in use. When the space in the operating room is insufficient, it is very easy to affect the doctor's work.

[0063] 3. From the perspective of implementation cost, since the control end is integrated with multiple devices, additional lines need to be reserved to communicate with the image processing engine, and the installation and maintenance costs of multiple devices are high, the implementation cost of the solution is relatively high.

[0064] 4. Due to the complexity of the existing operating room control system, medical staff need to receive additional training to become proficient in operation, which increases training costs and time.

[0065] 5. System upgrades and maintenance are difficult. Systems integrating multiple devices may face more technical challenges and costs during upgrades and maintenance.

[0066] The technical solution of the present invention is described in detail below in conjunction with specific embodiments and the accompanying drawings.

[0067] As attached Figure 1 -Attached Figure 7 As shown, in an illustrative embodiment of an interactive control method of an operating room display terminal of the present invention, the interactive control method includes the following steps.

[0068] The functions of the wall-mounted integrated display and the integrated workstation in the operating room are integrated into the same touch-sensitive operating room display terminal. After integration, the terminal has both the display function of the wall-mounted integrated display, which can be used to display the image of the signal source, patient information, and various related medical information, and the control function of the integrated workstation on various medical equipment in the operating room, which can realize the acquisition, forwarding, and storage of video input signals of various equipment in the operating room, such as panoramic camera signals, surgical field camera signals, laparoscope video signals, monitor image signals, etc., and has functions such as audio and video acquisition, video switching, surgical teaching, video preview, recording, surgical patient information management, equipment control, and video file management. Accordingly, the operating room display terminal with integrated display and control functions has at least a control end function interface and a full-screen display interface.

[0069] When the display terminal is in the control end function interface, the display area of ​​the operating room display terminal is divided into a signal source selection area, a layout switching area, a medical image display area and a blank area.

[0070] Among them, as attached Figure 3 As shown, the signal source selection area is located on the left side of the display area of ​​the display terminal, and is used to display the preview screen of all signal source signals currently connected to the display terminal, where the signal source signals include panoramic camera signals, surgical field camera signals, laparoscope video signals, monitor image signals, etc.

[0071] The layout switching area is located above the display area of ​​the display terminal, and arranges and displays multiple pre-divided play layouts, wherein each play layout includes at least one play window for playing a video. Figure 4 As shown, the multiple pre-divided playback layouts include at least a picture-in-picture layout, a single window layout, a two-part window layout, a four-part window layout, and a six-part window layout.

[0072] The medical image display area is located in the middle of the display area of ​​the display terminal, and is used to play at least one signal source image currently connected to the display terminal based on the currently selected play layout in the layout switching area.

[0073] The blank area is arranged around the signal source selection area, the layout switching area and the medical image display area, and is used to display preset information and to trigger a full-screen display mode.

[0074] In the control end function interface, the user's touch interaction actions in the display area are detected in real time, the action type, coordinates and the area to which the coordinates belong to the interaction action are identified, and control instructions are judged based on the action type, coordinates and the area to which the coordinates belong to the interaction action. The instructions are conveyed to the image processing engine, so that it completes the corresponding image coordinate changes through logical control, and finally outputs them to the display area of ​​the display terminal.

[0075] The touch commands under the control terminal function interface include layout switching commands, screen introduction commands and full-screen display commands.

[0076] When the touch interaction action is a single click and the click coordinates are located in the layout switching area, the current instruction is judged to be a layout switching instruction. At this time, the medical image display area is divided into playback windows based on the playback layout selected in the layout switching area based on the click coordinates, and the coordinate identification area corresponding to the medical image display area and the selected playback layout is identified, so that the medical image display area plays the signal source image screen based on the playback layout.

[0077] When the interactive action is to click twice and the coordinates of the two clicks are located in the signal source selection area and the medical image display area respectively, or when the interactive action is to press and drag and the starting coordinates and the ending coordinates of the action are located in the signal source selection area and the medical image display area respectively, the current instruction is judged to be a screen introduction instruction, and the signal source screen corresponding to the starting coordinates of the action is moved into the playback window corresponding to the ending coordinates for display. Figure 5 Taking the four-split screen playback layout as an example, click signal source A in the signal source selection area, and then click area A in the medical image display area to send the coordinate position of area A to the image processing engine and tell it to place the signal source A screen into area A for display; alternatively, long press signal source A and drag it to area A and release it to achieve the same screen introduction effect.

[0078] When the interactive action is a single click, and the coordinates of the click are within the blank area, the current command is judged to be a full-screen display command, the image within the current medical image display area is displayed in full screen, and the display terminal enters the full-screen display interface. Figure 5As shown, after completing the introduction of the signal images of the four playback windows A, B, C, and D, clicking any point in the outer blank area will notify the image processing engine to display the image in the current medical image display area in full screen, and the display terminal will enter the full-screen display interface.

[0079] In order to adjust the signal source image pictures of each playback window in the full-screen display interface, some embodiments of the present invention further include the following steps.

[0080] When the display terminal is in a full-screen display interface, the interactive actions in the display area are detected in real time, and the control instruction is judged based on the action type, coordinates and the area to which the coordinates belong to the interactive action.

[0081] The touch commands in the full-screen display interface include position exchange commands and area full-screen display commands.

[0082] When the interactive action is long press and drag, and the starting coordinates and the ending coordinates of the action are located in two different play windows, the current instruction is judged to be a position exchange instruction, and the signal source images in the two play windows are exchanged. Figure 6 Taking the full-screen display state of the four-split screen as an example, when you long press area A and drag it to area B, the image processing engine will be notified to swap the two areas.

[0083] When the interactive action is a double-click, and the double-click coordinates are located in any playback window, the current instruction is judged to be a regional full-screen display instruction, and the picture in the playback window corresponding to the double-click coordinates is displayed in full screen. At this time, the interactive action of the display area is continuously detected. When the next double-click action is detected, the original layout display is returned.

[0084] In order to improve the flexibility of adjusting the play window in the picture-in-picture play layout, in some embodiments of the present invention, as shown in the attached Figure 4 As shown, the picture-in-picture layout includes a main playback window A and a sub-playback window B.

[0085] When the currently selected playback layout in the layout switching area is a picture-in-picture layout and the full-screen display interface is entered, the method for determining the control instruction in the full-screen display interface further includes the following steps:

[0086] When the interactive action is long press and drag, and the starting coordinates of the action are located at the center of the sub-play window, the current instruction is determined to be a sub-window move instruction, and the screen of the sub-play window is moved from the starting coordinate position to the end coordinate position of the action for display. It can be understood that when the user performs a touch operation, long presses the center position of the sub-play window B and drags it to any coordinate position, which will notify the image processing engine to move the screen of the sub-play window B to the coordinate position.

[0087] When the interactive action is long press and drag, and the starting coordinates of the action are located at the upper left corner of the sub-play window, and the end coordinates are located at the upper left of the starting coordinates, the current instruction is judged to be a small window zoom instruction; at this time, the coordinates of the lower right corner of the sub-play window are kept unchanged, and the coordinates of the upper left corner of the sub-play window are moved from the starting coordinates of the action to the end coordinates of the action, and the screen ratio of the sub-play window is kept unchanged during the movement. It can be understood that when the user performs a touch operation, long presses the upper left corner of the sub-play window B and drags it to a certain coordinate, which will notify the image processing engine to keep the screen ratio and move its upper left corner coordinates to the end coordinates of the drag, and the lower right corner coordinates remain unchanged, so as to achieve screen zooming.

[0088] When the interactive action is long press and drag, and the starting coordinates of the action are located at the upper left corner of the sub-play window, and the end coordinates are located at the lower right of the starting coordinates, the current instruction is judged to be a sub-window reduction instruction; at this time, the coordinates of the lower right corner of the sub-play window are kept unchanged, and the coordinates of the upper left corner of the sub-play window are moved from the starting coordinates of the action to the end coordinates of the action, and the screen ratio of the sub-play window is kept unchanged during the movement. It can be understood that when the user performs a touch operation, long presses the upper left corner of the sub-play window B and drags it to the lower right to a certain coordinate, the image processing engine will be notified to maintain the screen ratio and move the upper left corner coordinates to the end coordinates of the drag, and the lower right corner coordinates remain unchanged, so as to achieve screen reduction.

[0089] In order to realize returning to the control terminal function interface from the full-screen display interface, in some embodiments of the present invention, when the display terminal is in the full-screen display interface, as shown in the attached Figure 6 As shown, a console floating control button is set above the video playback channel, and the method for judging the control command in the full-screen display interface also includes: when the interactive action is a single click and the click coordinates are located in the floating control button area, the current command is judged to be an exit full-screen display command, and the full-screen display of the medical image display area is exited at this time, and the display terminal enters the control terminal function interface.

[0090] In order to realize the recognition of the user interaction coordinates of the display terminal, it is convenient to analyze the interactive action to determine the logical instructions and convey them to the image processing engine, so that it completes the corresponding image coordinate changes through logical control, and finally outputs the corresponding signal source screen to the display terminal, in some embodiments of the present invention, such as the attached Figure 7 As shown, the display terminal is connected to an image processing engine, an interactive coordinate recognition layer is arranged at the top layer of its picture channel, and the bottom layer is the picture input layer of the image processing engine.

[0091] After the display terminal determines the control instruction, it sends the current control instruction to the image processing engine, and the image processing engine changes the coordinate starting point and coordinate range of the image output of the corresponding signal source screen in the display area based on the control instruction.

[0092] In order to simultaneously display images of multiple signal sources in the operating room, in some embodiments of the present invention, the operating room display terminal is connected to at least one external display, and the interactive control method further includes the following steps:

[0093] When the display terminal is in the control terminal function interface, the display area of ​​the operating room display terminal is further divided into a display selection area, as shown in the attached figure. Figure 3 As shown, the display selection area is located to the right of the display area.

[0094] The display terminal distributes the signal source image to at least one external display for display by identifying the interactive actions in the display selection area.

[0095] Specifically, the touch instructions under the control end function interface also include external display switching instructions. When it is detected that the interactive action in the display area is a single click, and the click coordinates are located in the display selection area, the current instruction is judged to be an external display switching instruction. At this time, the screen of the external display corresponding to the single click coordinates is displayed in the medical image display area. The playback layout of the external display can be selected by clicking the layout switching area, and the signal source screen for playback can be introduced to the external display by clicking the signal source selection area.

[0096] Before allocating the signal source screen to the external display, the display terminal identifies the resolution of the connected external display and splits the screen of the external display based on the resolution to control the coordinate starting point and coordinate range of the image output of the signal source screen in the display area of ​​the external display.

[0097] In order to facilitate the expansion of the functions of the display terminal, in some embodiments of the present invention, when the display terminal is in the control end function interface, a control end function menu area is further divided in the display area of ​​the operating room display terminal, which includes function buttons such as video switching, equipment control, and live surgery recording, so that the function button corresponding to the area can be clicked through the control end function interface to switch to the corresponding function interface.

[0098] Some embodiments of the present invention further provide an operating room control system, as shown in the attached Figure 8 -Attached Fig.10 As shown, it includes an operating room display terminal and at least one medical imaging device

[0099] Each medical imaging device is connected to an encoding device, and the display terminal and each encoding device are connected to the same local area network; wherein the medical imaging devices include surgical field cameras, panoramic cameras, laparoscope hosts, vital signs monitors, etc., and the encoding device is used to encode the SDI, DVI, HDMI and other audio and video signals captured by the medical imaging devices into IP streams and push them to the local area network. In this embodiment, the video signal is pushed through the IP stream, and there is no restriction on the interface type of each medical imaging device, which effectively expands the scope of application of the display terminal.

[0100] The operating room display terminal integrates the functions of the wall-mounted comprehensive display terminal and the integrated workstation in the operating room, has at least a control terminal function interface and a full-screen display interface, and adopts the above-mentioned interactive control method of the operating room display terminal for interactive control.

[0101] The operating room display terminal is connected to an image processing engine with a decoding function, and an interactive coordinate recognition layer is set at the top layer of its picture channel, and the bottom layer is the picture input layer of the image processing engine; the interactive coordinate recognition layer is used to detect the interactive actions in the terminal display area in real time, and the picture input layer of the image processing engine is used to control the image output coordinate starting point and coordinate range of each signal source picture in the display area;

[0102] The display terminal controls the communication between the coding device and the image processing engine connected to the local area network, so as to display the video images captured by the medical imaging equipment in real time in the display area of ​​the display terminal.

[0103] In some embodiments of the present invention, the display terminal and at least one medical imaging device are connected to the same local area network by being connected to the same switch.

[0104] In some embodiments of the present invention, the device further comprises: at least one external display, each of which is connected to an image processing engine with a decoding function and is connected to a local area network;

[0105] The display terminal controls the communication with the coding device and the image processing engine connected to the network through the local area network, so as to distribute the video images captured by the medical imaging equipment to each external display for display.

[0106] In some embodiments of the present invention, the display terminal and at least one medical imaging device can also be connected to the same local area network through the same video fusion matrix.

[0107] Specifically, as attached Fig. 9 As shown, the video fusion matrix is ​​the image processing engine, and the display terminal built-in system, such as Android, Windows, Hongmeng, etc., is a display terminal with interactive coordinate recognition function.

[0108] The video fusion matrix does not limit the interface type and communication method. In this embodiment, taking DVI and serial communication as examples, the video fusion matrix collects the signal of the imaging device and sends it to the display terminal and other displays. The display terminal sets a coordinate interaction recognition layer on the top layer of its picture channel, and the bottom layer is the picture input layer of the image processing engine. When the user performs interactive control in the display area, the system determines the control instruction based on the recognized coordinate information and interactive actions, and sends it to the image processing engine through the communication interface, so that it controls the display terminal and the display images of each external display to make corresponding position changes. At the same time, as shown in the attached Fig.10 As shown, the display terminal sends the identified interactive coordinate points and interactive action judgment logic instructions to the image processing engine of the video fusion matrix, allowing it to change the coordinate starting point of the signal displayed on the screen, thereby realizing different layout forms.

[0109] Finally, it should be noted that: the various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0110] The above embodiments are only used to illustrate the technical solution of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the preferred embodiments, ordinary technicians in the field should understand that the specific implementation methods of the present invention can still be modified or some technical features can be replaced by equivalents without departing from the spirit of the technical solution of the present invention, which should be included in the scope of the technical solution for protection of the present invention.

Claims

1. An interactive control method for an operating room display terminal, characterized in that: The display terminal at least includes a control terminal function interface and a full-screen display interface, and the interactive control method includes the following steps: When the display terminal is in the control terminal function interface, the display area of ​​the operating room display terminal is divided into a signal source selection area, a layout switching area, a medical image display area and a blank area; The signal source selection area is used to display preview images of all signal sources currently connected to the display terminal; the layout switching area is used to display multiple pre-divided playback layouts, wherein each playback layout includes at least one window for playing videos; the medical image display area plays at least one signal source image currently connected to the display terminal based on the playback layout currently selected in the layout switching area; Detecting interactive actions in the display area in real time under the control terminal function interface, and judging control instructions based on the action type, coordinates and the area to which the coordinates belong of the interactive actions; When the interactive action is a single click and the click coordinates are located in the layout switching area, the current instruction is determined to be a layout switching instruction, and the medical image display area is divided into play windows based on the play layout corresponding to the click coordinates in the layout switching area, so that the medical image display area plays the signal source image based on the play layout; When the interactive action is to click twice and the coordinates of the two clicks are located in the signal source selection area and the medical image display area respectively, or when the interactive action is to press and drag and the starting coordinates and the ending coordinates of the action are located in the signal source selection area and the medical image display area respectively, the current instruction is judged to be a screen introduction instruction, and the signal source screen corresponding to the starting coordinates of the action is moved into the playback window corresponding to the ending coordinates for display; When the interactive action is a single click, and the coordinates of the single click are located in the blank area, the current instruction is determined to be a full-screen display instruction, the image in the current medical image display area is displayed in full screen, and the display terminal enters a full-screen display interface.

2. The interactive control method of the operating room display terminal according to claim 1, characterized in that: The following steps are also included: When the display terminal is in a full-screen display interface, the interactive action in the display area is detected in real time, and the control instruction is judged based on the action type, coordinates and area to which the coordinates belong of the interactive action; When the interactive action is long press and drag, and the starting coordinates and the ending coordinates of the action are respectively located in two different play windows, the current instruction is determined to be a position exchange instruction, and the signal source images in the two play windows are exchanged; When the interactive action is a double-click and the double-click coordinates are located in any playback window, the current instruction is judged to be a regional full-screen display instruction, and the picture in the playback window corresponding to the double-click coordinates is displayed in full screen. At this time, the interactive action of the display area is continuously detected. When the next double-click action is detected, the original layout display screen is returned.

3. The interactive control method of the operating room display terminal according to claim 1 or 2, characterized in that: The multiple pre-divided playback layouts include at least a picture-in-picture layout, a single window layout, a two-part window layout, a four-part window layout, and a six-part window layout.

4. The interactive control method of the operating room display terminal according to claim 3, characterized in that: The picture-in-picture layout includes a main play window and a sub play window; When the currently selected playback layout in the layout switching area is a picture-in-picture layout and a full-screen display interface is entered, the method for determining a control instruction in the full-screen display interface further includes: When the interactive action is long press and drag, and the starting coordinates of the action are located at the center of the sub-play window, the current instruction is determined to be a sub-window move instruction, and the screen of the sub-play window is moved from the starting coordinate position to the end coordinate position of the action for display; When the interactive action is long press and drag, and the starting coordinates of the action are located at the upper left corner of the sub-play window, and the ending coordinates are located at the upper left of the starting coordinates, the current command is determined to be a small window zoom command; at this time, the coordinates of the lower right corner of the sub-play window are kept unchanged, and the coordinates of the upper left corner of the sub-play window are moved from the starting coordinates of the action to the ending coordinates of the action, and the screen ratio of the sub-play window is kept unchanged during the movement; When the interactive action is long press and drag, and the starting coordinates of the action are located at the upper left corner of the sub-play window, and the end coordinates are located at the lower right of the starting coordinates, the current instruction is judged to be a sub-window reduction instruction; at this time, the coordinates of the lower right corner of the sub-play window are kept unchanged, and the coordinates of the upper left corner of the sub-play window are moved from the starting coordinates of the action to the end coordinates of the action, and the screen ratio of the sub-play window is kept unchanged during the movement.

5. The interactive control method of the operating room display terminal according to any one of claims 1, 2 or 4, characterized in that: When the display terminal is in a full-screen display interface, a floating control button is set above the video playback channel. The method for judging control instructions in the full-screen display interface also includes: when the interactive action is a single click and the click coordinates are located in the floating control button area, the current instruction is judged to be an exit full-screen display instruction. At this time, the full-screen display of the medical image display area is exited, and the display terminal enters the control terminal function interface.

6. The interactive control method of the operating room display terminal according to claim 1, characterized in that: The display terminal is connected to an image processing engine, and an interactive coordinate recognition layer is arranged at the top layer of its picture channel, and the bottom layer is the picture input layer of the image processing engine; After determining the control instruction, the display terminal sends the current control instruction to the image processing engine, and the image processing engine changes the coordinate starting point and coordinate range of the image output of the corresponding signal source screen in the display area based on the control instruction.

7. The interactive control method of the operating room display terminal according to claim 1, characterized in that: The display terminal is connected to at least one external display, and the interactive control method further comprises the following steps: When the display terminal is in the control terminal function interface, a display selection area is further divided in the display area of ​​the operating room display terminal; the display terminal distributes the signal source screen to at least one external display for display by identifying the interactive action in the display selection area; Before the display terminal distributes the signal source screen, it identifies the resolution of the external display connected to it, and divides the screen of the external display based on the resolution to control the coordinate starting point and coordinate range of the image output of the signal source screen in the display area of ​​the external display.

8. An operating room control system, characterized in that: It includes an operating room display terminal and at least one medical imaging device; Each medical imaging device is connected to an encoding device, and the display terminal and the encoding device are connected to the same local area network; the encoding device is used to encode the video images taken by the medical imaging device into an IP stream and push it to the local area network; The display terminal is connected to an image processing engine with a decoding function, and an interactive coordinate recognition layer is arranged at the top layer of its picture channel, and the bottom layer is the picture input layer of the image processing engine; the interactive coordinate recognition layer is used to detect interactive actions in the terminal display area in real time, and the picture input layer of the image processing engine is used to control the image output coordinate starting point and coordinate range of each signal source picture in the display area; the display terminal adopts the interactive control method of the operating room display terminal according to any one of claims 1 to 7 for interactive control; The display terminal controls the communication between the encoding device and the image processing engine connected to the local area network, so as to display the video images captured by the medical imaging equipment in real time in the display area of ​​the display terminal.

9. The operating room control system according to claim 8, characterized in that: The display terminal and the encoding device are connected to the same local area network by being connected to at least one interconnected switch.

10. The operating room control system according to claim 8 or 9, characterized in that: Further including: At least one external display, each of which is connected to an image processing engine with decoding function and is connected to the local area network; The display terminal controls the communication with the coding device and the image processing engine connected to the network through the local area network, so as to distribute the video images captured by the medical imaging equipment to each external display for display.

Images