Operating room control equipment and display method thereof

Abstract

The invention discloses operating room control equipment and a display method thereof, the equipment responds to an equipment control function selected by a user, an equipment control interface is displayed in a display screen, the equipment control interface comprises an equipment identification area and an equipment control area, and equipment identification corresponding to at least one operating room equipment in multiple operating room equipment is displayed in the equipment identification area. The equipment control area is used for displaying a control interface of target operating room equipment selected from the at least one operating room equipment; in response to a first user operation received in the device control interface, a setting area of a video routing function is displayed, the setting area covers part of the device control interface, at least one first video input end and at least one first video output end are displayed in the setting area, the first video input end is a video source with a display picture, and the first video output end is a video source with a display picture. The first video output end is a display device capable of outputting a display picture of the first video input end. And the setting area with the video routing function covers the equipment control interface for display, so that the convenience of video routing setting is improved.

Description

Technical Field

[0001] The present invention relates to the medical field, and more particularly to an operating room control device and a display method thereof. Background Art

[0002] The spatial environment of a digital operating room is relatively large, and the digital operating system and the placement of operating room equipment essential for surgery, such as operating tables and operating lights, are relatively scattered. When a user views and sets the equipment during a surgery, they need to operate on each machine, which not only affects work efficiency but also the efficiency and quality of the surgeon, and there is a certain risk interference to the surgery.

[0003] The existing solution is to extract the important functions of the operating room equipment to the digital operating room control device, and the operating room equipment is uniformly controlled through the operating room control device. After the user sets the parameters of the operating room equipment on the operating room control device, they still need to switch to the video routing page for video routing settings such as screen projection, live broadcast, and teaching, which increases the operation time of the user, reduces the operation efficiency of the user, and also increases the memory cost when the user uses it, and there may be a situation where the video routing settings are incorrect. Summary of the Invention

[0004] A series of simplified concepts are introduced in the Summary of the Invention section, which will be further detailed in the Detailed Description section. The Summary of the Invention section of the present invention does not mean to attempt to define the key features and essential technical features of the claimed technical solution, nor does it mean to attempt to determine the protection scope of the claimed technical solution.

[0005] An embodiment of the present invention provides an operating room control device on the one hand, including:

[0006] A display screen;

[0007] A communication module for communicatively connecting with multiple operating room devices;

[0008] The operating room control device is configured with an equipment control function and a video routing function. The equipment control function is used to control the multiple operating room devices; the video routing function is used to determine a video input end and a video output end;

[0009] A processor for performing the following processing:

[0010] In response to the equipment control function selected by the user, display an equipment control interface on the display screen;

[0011] Among them, the device control interface includes a device identification area and a device control area. In the device identification area, the device identification corresponding to at least one operating room device among the multiple operating room devices is displayed. The device control area is used to display the control interface of the target operating room device selected from the at least one operating room device;

[0012] In response to a first user operation received on the device control interface, a first setting area of the video routing function is displayed. The first setting area covers a part of the device control interface, and at least one first video input terminal and at least one first video output terminal are displayed in the first setting area; among them, the first video input terminal is a video source with a displayed picture; the first video output terminal is a display device that can output the displayed picture of the first video input terminal.

[0013] In one embodiment, the processor is further configured to:

[0014] When the device control interface is currently displayed, in response to the user's selection of the video routing function, a video routing interface is displayed on the display screen. At least one second video input terminal and at least one second video output terminal, and the displayed picture of the target input terminal selected from the at least one second video input terminal are displayed in the video routing interface.

[0015] In one embodiment, the processor is further configured to:

[0016] When the device control interface is currently displayed, in response to the user's selection of the video conferencing function, a video conferencing interface is displayed on the display screen. The video conferencing interface includes at least one third video input terminal, and the displayed picture of the target input terminal selected from the at least one third video input terminal.

[0017] In one embodiment, in response to a second user operation received on the video conferencing interface, a second setting area of the video routing function is displayed. The second setting area covers a part of the device conference interface, and the at least one third video input terminal is displayed in the second setting area.

[0018] In one embodiment, the processor is further configured to:

[0019] In response to the target input terminal selected by the user from the at least one first video input terminal, and the target output terminal selected by the user from the at least one first video output terminal,

[0020] Route the displayed picture from the target input terminal to the target output terminal for output.

[0021] In one embodiment, the processor is further configured to:

[0022] In the first setting area, the corresponding relationship between the target input end and the target output end is displayed.

[0023] In one embodiment, the first setting area covers part or all of the device control area and does not block the device identification area.

[0024] In one embodiment, the device control area is displayed on the right side of the device identification area, and the first setting area covers the right part of the device control area.

[0025] In one embodiment, the display mode of the first setting area includes a drawer type or a pop-up window type.

[0026] In one embodiment, a first preset identifier corresponding to the first setting area is displayed in the device control interface, and the first user operation includes a user operation on the first preset identifier;

[0027] Alternatively, the first user operation includes a first touch gesture operation.

[0028] In one embodiment, a second preset identifier is displayed in the first setting area, and the first setting area is hidden in response to a user operation on the second preset identifier;

[0029] Alternatively, the first setting area is hidden in response to a second touch gesture operation.

[0030] In one embodiment, the control interface displayed in the device control area is the same as the control interface displayed by the target operating room device itself.

[0031] In one embodiment, the processor is further configured to:

[0032] Generate a control instruction for the target operating room device based on the control interface;

[0033] Send the control instruction to the target operating room device to control the target operating room device and make the control interface displayed by the target operating room device itself change synchronously with the control interface displayed in the device control area.

[0034] In one embodiment, the control interface displayed in the device control area being the same as the control interface displayed by the target operating room device itself includes at least one of the following:

[0035] The functions of the operation controls are the same, the identifiers of the operation controls are the same, the positions of the operation controls are the same, the user interaction methods are the same, and the visual effects are the same.

[0036] In one embodiment, virtual operation keys that simulate the physical operation keys of the target operating room equipment are further displayed on the device control interface, and the layout of the virtual operation keys is the same as that of the physical operation keys.

[0037] In one embodiment, the operating room equipment includes at least one of the following: an operating lamp, an operating table, a pneumoperitoneum machine, a uterine dilatation pump, a laparoscope, an energy platform, a surgical camera, a panoramic camera, and an audio device.

[0038] A second aspect of the embodiments of the present invention provides an operating room control device, including:

[0039] A display screen;

[0040] A communication module for communicatively connecting with multiple operating room devices;

[0041] The operating room control device is configured with a video conferencing function and a video routing function. The video conferencing function is used to conduct a video conference with at least one user terminal; the video routing function is used to determine a video input end and a video output end;

[0042] A processor for performing the following processing:

[0043] In response to the selected video conferencing function by the user, a video conferencing interface is displayed on the display screen;

[0044] In response to a user operation received in the video conferencing interface, a setting area of the video routing function is displayed. The setting area covers a part of the video conferencing interface, and at least one video input end is displayed in the setting area. The video input end is a video source with a displayed picture;

[0045] The video conferencing interface includes a display picture area for displaying the display pictures of at least one of the video input ends.

[0046] In one embodiment, the processor is further used for:

[0047] In response to a target input end selected by the user from the at least one video input end, the display picture from the target input end is routed to a preset video output end for output.

[0048] In one embodiment, the display mode of the setting area includes a drawer type or a pop-up window type.

[0049] A third aspect of the embodiments of the present invention provides a display method of an operating room control device. The operating room control device is configured with a device control function and a video routing function. The device control function is used to control multiple operating room devices, and the video routing function is used to determine a video input end and a video output end; the method includes:

[0050] In response to a device control function selected by a user, a device control interface is displayed. The device control interface includes a device identification area and a device control area. In the device identification area, the device identification corresponding to at least one operating room device among the multiple operating room devices is displayed. The device control area is used to display the control interface of a target operating room device selected from the at least one operating room device.

[0051] In response to a first user operation received in the device control interface, a first setting area for the video routing function is displayed. The first setting area covers a part of the device control interface. At least one first video input terminal and at least one first video output terminal are displayed in the first setting area. Among them, the first video input terminal is a video source with a display screen, and the first video output terminal is a display device that can output the display screen of the first video input terminal.

[0052] In one embodiment, the method further includes:

[0053] When the device control interface is currently being displayed, in response to the video routing function selected by the user, a video routing interface is displayed. At least one second video input terminal, at least one second video output terminal, and the display screen of a target input terminal selected from the at least one second video input terminal are displayed in the video routing interface.

[0054] In one embodiment, the method further includes:

[0055] When the device control interface is currently being displayed, in response to the video conferencing function selected by the user, a video conferencing interface is displayed. The video conferencing interface includes at least one third video input terminal, and the display screen of a target input terminal selected from the at least one third video input terminal.

[0056] In one embodiment, the method further includes:

[0057] In response to a second user operation received in the video conferencing interface, a second setting area for the video routing function is displayed. The second setting area covers a part of the device conferencing interface. The at least one third video input terminal is displayed in the second setting area.

[0058] In one embodiment, the method further includes:

[0059] In response to the target input terminal selected by the user from the at least one first video input terminal and the target output terminal selected by the user from the at least one first video output terminal, the display screen from the target input terminal is routed to the target output terminal for output.

[0060] In one embodiment, the first setting area covers part or all of the device control area and does not obscure the device identification area.

[0061] In one embodiment, the display mode of the first setting area includes a drawer type or a pop-up type.

[0062] In one embodiment, the control interface displayed in the device control area is the same as the control interface displayed by the target operating room device itself.

[0063] In one embodiment, the method further includes:

[0064] Generating a control instruction for the target operating room device based on the control interface;

[0065] Sending the control instruction to the target operating room device to control the target operating room device and causing the control interface displayed by the target operating room device itself to change synchronously with the control interface displayed in the device control area.

[0066] A fourth aspect of the embodiments of the present invention provides a display method for an operating room control device. The operating room control device is configured with a video conferencing function and a video routing function. The video conferencing function is used to conduct a video conference with at least one user terminal, and the video routing function is used to determine a video input end and a video output end; the method includes:

[0067] Displaying a video conference interface in response to the selected video conferencing function by the user;

[0068] In response to a user operation received in the device control interface, displaying a setting area of the video routing function. The setting area covers part of the video conference interface, and at least one video input end is displayed in the setting area. The video input end is a video source with a display picture;

[0069] The video conference interface includes a display picture area for displaying the display pictures of at least one of the video input ends.

[0070] In one embodiment, the method further includes:

[0071] In response to a target input end selected by the user from the at least one video input end, routing the display picture from the target input end to a preset video output end for output.

[0072] In one embodiment, the display mode of the setting area includes a drawer type or a pop-up type.

[0073] In the embodiment of the present invention, the setting area for the video routing function is overlaid and displayed on the device control interface. During the process of controlling the operating room equipment, the user can perform video routing settings through the setting area. After the settings are completed, the user can continue to control the operating room equipment without switching interfaces, which is convenient and fast. BRIEF DESCRIPTION OF THE DRAWINGS

[0074] The above and other objects, features, and advantages of the present invention will become more apparent by describing the embodiments of the present invention in more detail in conjunction with the accompanying drawings. The accompanying drawings are used to provide a further understanding of the embodiments of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation to the present invention. In the drawings, the same reference numerals generally represent the same components or steps.

[0075] Figure 1 Showing a block diagram of an operating room control device according to an embodiment of the present invention;

[0076] Figure 2 Schematic diagram of a device control interface according to an embodiment of the present invention;

[0077] Figure 3 Schematic diagram of displaying a first setting area in the device control interface according to an embodiment of the present invention;

[0078] Figure 4 Schematic diagram of displaying a first setting area in the device control interface according to another embodiment of the present invention;

[0079] Figure 5 Schematic diagram of a video routing interface according to an embodiment of the present invention;

[0080] Figure 6 Schematic diagram of displaying a second setting area in the device control interface according to an embodiment of the present invention;

[0081] Figure 7 Schematic diagram of a video conferencing interface according to an embodiment of the present invention;

[0082] Figure 8 Schematic diagram of a control interface of an operating table according to an embodiment of the present invention;

[0083] Figure 9 Schematic diagram of a control interface of a pneumoperitoneum machine according to an embodiment of the present invention;

[0084] Figure 10 Schematic diagram of a control interface of an energy platform according to an embodiment of the present invention;

[0085] Figure 11 Schematic diagram of a control interface of a laparoscope according to an embodiment of the present invention;

[0086] Figure 12 is a schematic flowchart of a display method of an operating room control device according to an embodiment of the present invention;

[0087] Figure 13 is a schematic flowchart of a display method of an operating room control device according to another embodiment of the present invention. Detailed implementation manners

[0088] In order to make the objectives, technical solutions and advantages of the present invention more apparent, exemplary embodiments according to the present invention will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all embodiments of the present invention. It should be understood that the present invention is not limited by the exemplary embodiments described herein. Based on the embodiments of the present invention described herein, all other embodiments obtained by those skilled in the art without creative efforts shall fall within the protection scope of the present invention.

[0089] In the following description, numerous specific details are given to provide a more thorough understanding of the present invention. However, it is obvious to those skilled in the art that the present invention may be implemented without one or more of these details. In other instances, some well-known technical features are not described in order to avoid confusion with the present invention.

[0090] It should be understood that the present invention can be implemented in different forms and should not be construed as limited to the embodiments presented herein. On the contrary, providing these embodiments will make the disclosure thorough and complete, and will fully convey the scope of the present invention to those skilled in the art.

[0091] The purpose of the terms used herein is only to describe specific embodiments and is not a limitation of the present invention. When used herein, the singular forms "a", "an" and "the" are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the terms "comprising" and / or "including", when used in this specification, determine the presence of the stated features, integers, steps, operations, elements and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components and / or groups. When used herein, the term "and / or" includes any and all combinations of the related listed items.

[0092] To thoroughly understand the present invention, detailed structures will be presented in the following description to explain the technical solutions proposed by the present invention. The optional embodiments of the present invention are described in detail below. However, in addition to these detailed descriptions, the present invention may also have other implementation manners.

[0093] The embodiments of the present invention provide an operating room control device, such asFigure 1 As shown in the figure, the operating room control device 100 of the embodiment of the present invention includes a display screen 110, a communication module 120, and a processor 130. Among them, the communication module 120 is used for communication connection with multiple operating room devices; the operating room control device is configured with a device control function and a video routing function, the device control function is used to control multiple operating room devices, and the video routing function is used to determine video input and video output; the processor 130 is used to perform the following processing:

[0094] In response to the device control function selected by the user, display a device control interface on the display screen 110; wherein, the device control interface includes a device identification area and a device control area, and the device identification corresponding to at least one operating room device among the multiple operating room devices is displayed in the device identification area, and the device control area is used to display the control interface of the target operating room device selected from at least one operating room device;

[0095] In response to the first user operation received on the device control interface, display a first setting area of the video routing function, the first setting area covers part of the device control interface, and at least one first video input end and at least one first video output end are displayed in the first setting area, wherein the first video input end is a video source with a displayed picture, and the first video output end is a display device that can output the displayed picture of the first video input end.

[0096] Specifically, the processor 130 is communicatively connected to multiple operating room devices of different types through the communication module 120, and the communication connection methods include wireless connection methods such as WiFi and BLE or wired connection methods. The operating room devices include operating lights, operating tables, insufflators, uterine dilators, endoscopes, energy platforms, surgical cameras, panoramic cameras, audio devices, etc. The operating room control device 100 can be used for centralized control of the above-mentioned operating room devices to improve the work efficiency of surgeons; at the same time, the operating room control device 100 can also achieve audio and video intercommunication, such as realizing video routing in the operating room, picture-in-picture video, holding video conferences, video recording, and conducting teaching and live broadcasts outside the operating room.

[0097] The operating room control device 100 may include multiple display screens, and the display screen 110 may be one of the multiple display screens, mainly used for controlling operating room devices and performing video routing settings, etc. For the convenience of user operation, the display screen 110 may be implemented as a touch display screen.

[0098] The operating room control device 100 is at least configured with a device control function and a video routing function. The device control function is used to control multiple operating room devices. When the user selects the device control function, the display screen 110 outputs a device control interface, as Figure 2 shown; when the user selects the video routing function, the display screen 110 outputs a video routing interface, asFigure 5 As shown. Exemplarily, the operating room device 100 may also be configured with one or more of the operating room functions such as a video archiving function, a video conferencing function, a document management function, etc. The user can switch different operating room functions through the function options displayed below the display screen, and the display screen 100 switches the corresponding display interface in response to the operating room function selected by the user.

[0099] Continue to refer to Figure 2 , the device control interface corresponding to the device control function at least includes a device identification area and a device control area. In the device identification area, the device identifications corresponding to at least one of the multiple operating room devices are displayed. The device identification may include at least one of a text identification and a graphic identification. The device control area is used to display the control interface of the target operating room device selected from at least one operating room device, so as to control the target operating room device. For example, Figure 2 As shown, the target operating room device is a surgical lamp, and the control interface of the surgical lamp is displayed in the device control area. The user can adjust the illuminance, light spot, color temperature of the surgical lamp through this control interface, set functions such as synchronization, ambient light, shadow management, soft light mode, and turn the surgical lamp on and off. In Figure 2 In the example of , the device identification area and the device control area are arranged horizontally in the device control interface, and the device identification area is located on the left side of the device control area; in addition, the device identification area and the device control area may also adopt other layout methods.

[0100] When the user controls the target operating room device through the device control interface, it may also be necessary to perform video routing settings such as screen mirroring, live broadcast, and teaching. If switching from the device control interface to the video routing interface for video routing settings, it will increase the operation time and there may also be incorrect operations in the delivery. If the video routing interface and the device control interface are displayed side by side, it will cause insufficient utilization of the space of the device control interface. Therefore, the embodiment of the present invention displays the setting area of the video routing function in response to the first user operation received in the device control interface, and this setting area covers part of the device control interface. If necessary during the process of controlling the operating room device, the setting area covering part of the device control interface can be opened for video routing settings, and the control parameters of the operating room device can also be viewed while performing the video routing settings; after the settings are completed, closing the setting area can continue to control the operating room device without interface switching, which is convenient and fast.

[0101] Such as Figure 3As shown, at least one first video input terminal and at least one first video output terminal are displayed in the setting area of the video routing function. Among them, the first video input terminal is a video source with a displayed picture, including but not limited to panoramic camera, endoscope, monitor, surgical field camera, EMR (Electronic Medical Record), LIS (Laboratory Information Management System), PACS (Picture Archiving and Communication System), etc. The first video output terminal is a display device or method that can output the displayed picture of the first video input terminal, including but not limited to multiple monitors connected to the processor 130, live broadcast method, display device in the demonstration classroom, display device in the conference room, etc. The processor 130 can route the displayed picture from the target input terminal to the target output terminal for output in response to the target input terminal selected by the user among at least one first video input terminal and the target output terminal selected by the user among at least one first video output terminal.

[0102] Exemplarily, a one-to-one, one-to-many, or many-to-many relationship can be established between the video input terminal and the video output terminal, that is, the displayed picture of the same target input terminal can be routed to one or more target output terminals for output, and the displayed pictures of multiple target input terminals can also be respectively routed to multiple target output terminals for output. For example, the first video input terminal selected by the user can be determined as the first target input terminal, and one or more first video output terminals selected immediately thereafter can be determined as the first target output terminals corresponding to the first target input terminal; the first video input terminal selected again by the user can be determined as the second target input terminal, and one or more first video output terminals selected immediately thereafter can be determined as the second target output terminals corresponding to the second target input terminal.

[0103] After determining the target input terminal and the target output terminal, the corresponding relationship between the target input terminal and the target output terminal can be displayed in the first setting area. For example, refer to Figure 4 , when the first target input terminal is an endoscope and the first target output terminal is monitor 1, the endoscope can be displayed below monitor 1, and an association identifier can be displayed on the right side of the two; when the second target input terminal is a surgical field camera and the second target output terminal is monitor 2, the surgical field camera can be displayed below monitor 2, and an association identifier can be displayed on the right side of the two. There can be multiple ways to display the corresponding relationship. For example, the corresponding video output terminal can be displayed below the video input terminal, etc. The embodiments of the present invention do not limit this.

[0104] Exemplarily, the first setting area covers part or all of the device control area and does not block the device identification area, so that the user can view the list of operating room devices while performing routing settings. The first setting area can expose part of the device control area, so that the user can view some control parameters while performing routing settings. Figure 3 and Figure 4 In the example, the device identification area and the device control area are arranged on the left and right in the device control interface, and the device control area is displayed on the right side of the device identification area. The first setting area can cover the right part of the device control area and expose some control parameters of the energy platform.

[0105] Exemplarily, the display mode of the first setting area may include a drawer mode, that is, the first setting area is displayed in a drawer mode in response to the first user operation. In one example, a first preset mark corresponding to the first setting area is displayed in the device control interface, see Figure 2 , the first preset mark can be a left-pointing arrow displayed on the far right of the device control interface. When a user operation for the first preset mark is received, for example, when the user clicks the arrow, the first setting area appears from right to left in the device control interface. In another example, the first user operation can also be a first touch gesture operation, for example, when a touch gesture operation of sliding to the left is received in the device control interface, the first setting area is displayed. Thus, the user can quickly call out the first setting area when needed.

[0106] When the video routing setting is completed and the first setting area needs to be hidden, the first setting area can be hidden in response to a user operation on the second preset mark displayed in the first setting area. Figure 3 , the second preset mark can be a right-pointing arrow displayed on the left side of the first setting area. When a user operation for the second preset mark is received, such as when the user clicks the arrow, the first setting area is hidden from left to right. Alternatively, the first setting area can also be hidden in response to a second touch gesture operation, such as when a touch gesture operation of sliding to the right is received in the device control interface, the first setting area is hidden. In this way, the first setting area can be quickly folded when the user needs it.

[0107] Optionally, in addition to the drawer-style display mode, the display mode of the first setting area may also include a pop-up window display mode. The main difference between the two is that the drawer-style first display area usually slides out or hides from the edge of the display screen, while the pop-up window-style first display area usually pops up from the middle of the display screen.

[0108] In addition to setting video routing through the above-mentioned video routing function setting area, users can also set video routing through the video routing interface. At least one second video input terminal and at least one second video output terminal are displayed in the video routing interface. The processor 130 can route the display screen of the target input terminal selected from at least one second video input terminal to the target output terminal selected from at least one second video output terminal for display. In addition, the video routing interface is also used to display the display screen of the target input terminal, and the display screen can be the live screen or preview screen of the target input terminal. Exemplarily, the second video input terminal can be the same as the first video input terminal, and the second video output terminal can be the same as the first video output terminal; moreover, the target input terminal and target output terminal determined based on the video routing interface can be the same as the target input terminal and target output terminal determined based on the setting area.

[0109] Referring to Figure 5 , the video routing interface F includes a video input terminal selection area on the left, a video output terminal selection area on the right, and a display screen area F1 in the middle. The above three areas can also adopt other layout methods. The video input terminal selection area is used to select video sources such as the operative field camera, endoscope, and monitor that can generate display screens, and output the live screen or preview screen of the selected video input terminal through the display screen area F1. The video output terminal selection area is used to select display devices or methods such as monitors, live broadcasts, and conference rooms that can output display screens. The video routing interface also displays the matching relationship between the two after the user selects the video input terminal and the video output terminal. For example, in Figure 5 , it is selected that the display screen of the endoscope is output by the 4K monitor 2, and the live screen or preview screen of the endoscope is displayed through the display screen area F1.

[0110] In some embodiments, the video routing interface can also display an operation control F2, which can be used to adjust the direction of the lens. For example, when displaying the screen of the operative field camera or the panoramic camera, the direction of the operative field camera or the panoramic camera can be adjusted through the operation control F2, so as to adjust the direction of the displayed screen. In this embodiment, several operation controls F2 can be set. For example, four operation controls F2 can be set, which are respectively used to adjust the up, down, left, and right directions. In this embodiment, the operation control F2 can also be a sliding disk for direction operation, and the sliding disk can slide in any direction to achieve arbitrary direction adjustment of the screen.

[0111] In some embodiments, when the video input end providing the display screen can adjust the lens direction, the operation control F2 is displayed in the display screen area F1, or the operation control F2 can be operated. Otherwise, the operation control F2 is not displayed, or the operation control F2 cannot be operated. For example, when the video input end providing the display screen is an operative field camera or a panoramic camera, the operation control F2 is displayed in the display interface F1, or the operation control F2 is displayed in a bright color, such as white, indicating that it can be operated. When the video input end providing the display screen is other devices such as an endoscope, the operation control F2 is not displayed in the display interface F1, or the operation control F2 is displayed in a dark color, such as gray, indicating that it cannot be operated, that is, after the user operates, the operation control F2 does not respond.

[0112] As described above, the operating room control device 100 can also be configured with a video conferencing function; in the case of the current display device control interface, the processor 130, in response to the user's selection of the video conferencing function, displays a video conferencing interface on the display screen 110. As Figure 6 shown, at least one third video input end is displayed in the video conferencing interface, and the display screen of the target input end selected from at least one third video input end. The third video input end can be the same as the first video input end and the second video input end described above. For example, the third video input end can also include panoramic cameras, endoscopes, monitors, operative field cameras, EMR, LIS, and PACS. In Figure 6 the example, the target input end is an endoscope, so the display screen of the endoscope is displayed in the video conferencing interface. In addition to displaying the display screen of the target input end in the video conferencing interface, the processor 130 also routes the display screen of the target input end to a preset output end of the video conferencing function for display.

[0113] Exemplarily, the video conferencing name, the user devices currently participating in the video conference, the operation controls for adding or deleting user devices, the operation controls for exiting or closing the conference, etc. can also be displayed in the video conferencing interface. Since the video conferencing function usually uses a fixed video output device to output the display screen and does not require the user to select the video output end, the video output end can not be displayed in the video conferencing interface.

[0114] The way the video conferencing interface displays the video input end is similar to that of the device control interface. Specifically, in response to the second user operation received in the video conferencing interface, a second setting area for the video routing function is displayed. The second setting area covers part of the device conference interface, and at least one third video input end is displayed in the second setting area. The second setting area can be displayed in a drawer or pop-up window manner and can cover part of the display screen of the target input end.

[0115] In some embodiments, if the target output end set in the video routing interface or the first setting area is the preset output end of the video conferencing function, the target input end set in the video routing interface or the first setting area can be used as the target input end of the video conferencing function. For example, assume that the preset output end of the video conferencing function is Monitor 1. If the target input end set in the video routing interface or the first setting area is the endoscope and the target output end is Monitor 1, the endoscope can be determined as the target input end of the video conferencing function, and the user can also modify the target input end through the second setting area. If the target input end set in the video routing interface or the first setting area is the endoscope, but the target output end is not Monitor 1 (for example, it is Monitor 2), the user needs to reset the target input end in the second setting area. The reset target input end can be the endoscope or other video sources. At this time, the display screen of the endoscope will still be routed to Monitor 2 for display.

[0116] By covering the setting area of the video routing function on the video conferencing interface for display, the user can switch the video input end through the setting area during the video conferencing process, and can also view part of the video conferencing interface during the setting process. After the setting is completed, the video conferencing can continue without affecting the normal progress of the video conferencing.

[0117] Some embodiments of the present invention also optimize the device control interface, so that the control interface displayed in the device control area is the same as the control interface displayed by the target operating room device itself. The control functions of operating room devices such as surgical lights, operating tables, and insufflators are not deleted and are completely displayed in the device control area. Moreover, the control interface displayed in the device control area has the same functions of operation controls, the same identifiers of operation controls, the same positions of operation controls, the same user interaction methods, and the same visual effects as the control interface displayed by the target operating room device itself. When the user uses the operating room control device 100 to control the operating room devices, they have a psychological expectation for the operation process of each operating room device and do not need to think and transform anymore. Alarms or smaller functions can all be operated on the operating room control device 100 without the need to operate on the specific operating room device, thereby reducing the user's memory cost, reducing the error rate, and improving the user's work efficiency.

[0118] Users can select the target operating room equipment through the device identification area and control the target operating room equipment based on the control interface displayed in the device control area. Specifically, a control instruction for the target operating room equipment is generated based on the control interface, and the control instruction is sent to the target operating room equipment to control the target operating room equipment. At this time, the control interface displayed on the target operating room equipment itself changes synchronously with the control interface displayed in the device control area. Optionally, when the user controls the target operating room equipment through the control interface on the target operating room equipment itself, the control interface displayed in the device control area also changes synchronously, so as to facilitate the user to control the target operating room equipment through any control interface.

[0119] See Figure 8 , where the target operating room equipment shown is an operating table, which is used to support the patient and adjust the body position during the operation. The control interface of the operating table is displayed in the device control area. Through this control interface, the height, angle of the operating table can be adjusted, and the operating table can be translated, etc. Since the operating table also has physical operation keys, in order to fully present the control function of the operating table, virtual operation keys simulating the physical operation keys of the operating table can also be displayed in the device control area, and the layout method of the virtual operation keys is the same as that of the physical operation keys. For other operating room equipment with physical operation keys, their physical operation keys can also be simulated by virtual operation keys to retain the complete control function.

[0120] See Figure 9 , where the target operating room equipment shown is a pneumoperitoneum machine, which is used to establish and maintain pneumoperitoneum during laparoscopic surgery. The control interface of the pneumoperitoneum machine is displayed in the device control area. Through this control interface, the pressure and flow rate of the pneumoperitoneum machine can be adjusted, the mode of the pneumoperitoneum machine can be set, the pneumoperitoneum machine can be started and paused, etc., and this control interface is the same as the control interface displayed on the pneumoperitoneum machine itself. In addition to the operation controls, the actual pressure, set pressure, actual flow rate, set flow rate, total flow rate, etc. are also displayed in the control interface of the pneumoperitoneum machine.

[0121] See Figure 10 , where the target operating room equipment shown is an energy platform, which is used to dissect and cut the diseased part and perform coagulation and vascular closure on the damaged interface. The control interface of the energy platform is displayed in the device control area. Through this control interface, the power of the ultrasonic scalpel, monopolar mode and bipolar mode of the energy platform can be set, and this control interface is the same as the control interface displayed on the energy platform itself.

[0122] See Figure 11 , where the target operating room equipment shown is a laparoscope, which is used to examine and diagnose the physiological and pathological conditions in the human uterine and abdominal cavities. The control interface of the laparoscope is displayed in the device control area. Through this control interface, the light source can be turned on, the light source brightness can be set, the recordable time can be viewed, etc., and this control interface is the same as the control interface displayed on the laparoscope itself.

[0123] Exemplarily, the control interfaces of several operating room devices are shown above. Each control interface is the same as the control interface of the operating room device itself. During the process of controlling the corresponding operating room device through any control interface, the first setting area of the video routing function can be displayed in response to the first user operation to perform video routing settings. After the settings are completed, the control of the operating room device continues without interrupting the normal surgical workflow of the user. Especially when conference communication or teaching is required during the operation, video routing settings and control of the operating room device need to be performed multiple times. The operating room control device 100 based on the embodiments of the present invention can improve work efficiency and reduce the probability of errors.

[0124] On the other hand, an embodiment of the present invention provides an operating room control device, including a display screen 110, a communication module 120, and a processor 130. Among them, the communication module 120 is used to communicate and connect with multiple operating room devices; the operating room control device is configured with a video conferencing function and a video routing function. The video conferencing function is used to conduct a video conference with at least one user terminal, and the video routing function is used to determine video input and video output; the processor 130 is used to perform the following processing:

[0125] In response to the user-selecting video conferencing function, display a video conferencing interface on the display screen 110;

[0126] In response to the user operation received in the video conferencing interface, display the setting area of the video routing function. The setting area covers a part of the video conferencing interface, and at least one video input end is displayed in the setting area. The video input end is a video source with a display screen.

[0127] The video conferencing interface includes a display screen area for displaying the display screens of at least one video input end.

[0128] In one embodiment, the processor 130 is further used to, in response to the target input end selected by the user among at least one video input end, route the display screen from the target input end to a preset video output end for output, and the display screen displayed in the screen area is the display screen of the target input end. Since the video conferencing function usually outputs the display screen through a preset video output end, the video output end does not need to be displayed in the setting area, reducing the area of the setting area, thereby reducing the occlusion ratio of the display screen.

[0129] Exemplarily, the display mode of the setting area includes a drawer type or a pop-up window type. Its specific display mode is similar to the display mode of the first setting area covering the device control interface, and the relevant description above can be specifically referred to.

[0130] In an embodiment of the present invention, the setting area for the video routing function is overlaid and displayed on the video conferencing interface. During a video conference, a user can select a video input end through the setting area, and during the setting process, a part of the video conferencing interface can also be viewed. After the setting is completed, the video conference can continue without affecting the normal progress of the video conference.

[0131] Next, a display method of an operating room control device according to an embodiment of the present invention will be described with reference to Figure 12 a flowchart shown in FIG. Figure 12 FIG. 1200 is a schematic flowchart of a display method 1200 of an operating room control device according to an embodiment of the present invention. The display method 1200 of the operating room control device in this embodiment can be implemented in the operating room control device 100 described above. Specifically, each step of the display method 1200 of the operating room control device can be executed by the processor 130 of the operating room control device 100. The operating room control device is configured with a device control function and a video routing function. The device control function is used to control multiple operating room devices, and the video routing function is used to determine a video input end and a video output end.

[0132] As Figure 12 shown, the display method 1200 of the operating room control device according to an embodiment of the present invention includes the following steps:

[0133] In step S1210, in response to a user's selection of the device control function, a device control interface is displayed. The device control interface includes a device identification area and a device control area. In the device identification area, the device identification corresponding to at least one operating room device among the multiple operating room devices is displayed. The device control area is used to display a control interface of a target operating room device selected from the at least one operating room device.

[0134] In step S1220, in response to a first user operation received on the device control interface, a first setting area of the video routing function is displayed. The first setting area covers a part of the device control interface. At least one first video input end and at least one first video output end are displayed in the first setting area. The first video input end is a video source with a displayed picture, and the first video output end is a display device capable of outputting the displayed picture of the first video input end.

[0135] When performing video routing settings through the first setting area, in response to a target input end selected by the user from at least one first video input end and a target output end selected by the user from at least one first video output end, the displayed picture from the target input end is routed to the target output end for output.

[0136] In the case of the current display device control interface, a video routing interface can also be displayed in response to the user's selection of the video routing function. At least one second video input terminal, at least one second video output terminal, and a display screen of a target input terminal selected from at least one second video input terminal are displayed in the video routing interface.

[0137] In the case of the current display device control interface, a video conferencing interface can also be displayed in response to the user's selection of the video conferencing function. At least one third video input terminal and a display screen of a target input terminal selected from at least one third video input terminal are displayed in the video conferencing interface. In the case of displaying the video conferencing interface, a second setting area for the video routing function can also be displayed in response to a second user operation received in the video conferencing interface. The second setting area covers part of the device conferencing interface, and at least one third video input terminal is displayed in the second setting area.

[0138] Exemplarily, the first setting area covers part or all of the device control area and does not obscure the device identification area. The display mode of the first setting area can include a drawer type or a pop-up type.

[0139] In one embodiment, the control interface displayed in the device control area is the same as the control interface displayed by the target operating room device itself, thereby reducing the user's memory cost and error rate.

[0140] When controlling the operating room device through the device control interface, a control instruction for the target operating room device can be generated based on the control interface displayed in the device control area, and the control instruction is sent to the target operating room device to control the target operating room device, and the control interface displayed by the target operating room device itself changes synchronously with the control interface displayed in the device control area.

[0141] The display method 1200 of the operating room control device according to the embodiment of the present invention displays the setting area of the video routing function covering the device control interface, improving the convenience of video routing setting. The specific details of the display method 1200 of the operating room control device can refer to the relevant description of the operating room control device 100 above and will not be elaborated here.

[0142] Next, refer to Figure 13 Describe a display method of an operating room control device according to another embodiment of the present invention. Figure 13It is a schematic flowchart of a display method 1300 of an operating room control device according to an embodiment of the present invention. The display method 1300 of the operating room control device in this embodiment can be implemented in the operating room control device 100 described above. Specifically, each step of the display method 1200 of the operating room control device can be executed by the processor 130 of the operating room control device 100. The operating room control device is configured with a video conferencing function and a video routing function. The video conferencing function is used to conduct a video conference with at least one user terminal, and the video routing function is used to determine a video input end and a video output end.

[0143] As Figure 13 shown, the display method 1300 of the operating room control device according to an embodiment of the present invention includes the following steps:

[0144] In step S1310, a video conferencing interface is displayed in response to the user's selection of the video conferencing function;

[0145] In step S1320, in response to a user operation received in the device control interface, a setting area of the video routing function is displayed. The setting area covers part of the video conferencing interface. At least one video input end is displayed in the setting area, and the video input end is a video source with a display picture. The video conferencing interface includes a display picture area for displaying the display pictures of at least one of the video input ends.

[0146] Further, in response to a target input end selected by the user from at least one video input end, the display picture from the target input end is routed to a preset video output end for output.

[0147] Exemplarily, the display mode of the setting area of the video routing function includes a drawer type or a pop-up window type.

[0148] The display method 1300 of the operating room control device according to an embodiment of the present invention displays the setting area of the video routing function covering the video conferencing interface, which can switch the video input end during the video conference without affecting the normal progress of the video conference. The specific details of the display method 1300 of the operating room control device can refer to the relevant description of the operating room control device 100 above and will not be elaborated here.

[0149] Although example embodiments have been described herein with reference to the accompanying drawings, it should be understood that the above example embodiments are merely exemplary and are not intended to limit the scope of the present invention. Those of ordinary skill in the art can make various changes and modifications therein without departing from the scope and spirit of the present invention. All such changes and modifications are intended to be included within the scope of the present invention as claimed in the appended claims.

[0150] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in connection with the embodiments disclosed herein can be implemented in electronic hardware, or in a combination of computer software and electronic hardware. Whether these functions are executed in hardware or software depends on the specific application and design constraints of the technical solution. A person skilled in the art can use different methods for each specific application to implement the described functions, but such implementation should not be considered to exceed the scope of the present invention.

[0151] In several embodiments provided by the present invention, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed.

[0152] In the specification provided here, a large number of specific details are set forth. However, it can be understood that the embodiments of the present invention can be practiced without these specific details. In some instances, well-known methods, structures, and technologies have not been shown in detail so as not to obscure the understanding of this specification.

[0153] Similarly, it should be understood that, in order to streamline the present invention and assist in understanding one or more of the various inventive aspects, in the description of the exemplary embodiments of the present invention, the various features of the present invention are sometimes grouped together into a single embodiment, figure, or description thereof. However, the method of the present invention should not be construed as reflecting the intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as reflected by the corresponding claims, the inventive point lies in that the corresponding technical problems can be solved by features less than all the features of a single disclosed embodiment. Therefore, the claims following the detailed description are hereby expressly incorporated into the detailed description, where each claim itself serves as a separate embodiment of the present invention.

[0154] Those skilled in the art will understand that, except for features that are mutually exclusive, any combination can be adopted for all the features disclosed in this specification (including the accompanying claims, abstract, and drawings) and all the processes or units of any method or device so disclosed. Unless otherwise expressly stated, each feature disclosed in this specification (including the accompanying claims, abstract, and drawings) can be replaced by an alternative feature that provides the same, equivalent, or similar purpose.

[0155] In addition, those skilled in the art will understand that although some embodiments described herein include certain features included in other embodiments rather than other features, the combination of features of different embodiments means that it is within the scope of the present invention and forms different embodiments. For example, in the claims, any one of the claimed embodiments can be used in any combination.

[0156] Each component embodiment of the present invention can be implemented in hardware, or in software modules running on one or more processors, or in a combination thereof. Those skilled in the art should understand that a microprocessor or a digital signal processor (DSP) can be used in practice to implement some or all of the functions of some of the modules according to the embodiments of the present invention. The present invention can also be implemented as a device program (such as a computer program and a computer program product) for executing part or all of the methods described herein. Such a program for implementing the present invention can be stored on a computer-readable medium, or can be in the form of one or more signals. Such signals can be downloaded from an Internet website, or provided on a carrier signal, or in any other form.

[0157] It should be noted that the above embodiments illustrate the present invention rather than limit the present invention, and those skilled in the art can design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The present invention can be implemented by means of hardware including several different elements and by means of a suitably programmed computer. In a unit claim listing several devices, several of these devices can be embodied by the same hardware item. The use of the words first, second, and third, etc. does not denote any order. These words can be interpreted as names.

[0158] As described above, it is only the specific implementation manner of the present invention or the description of the specific implementation manner. The protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, and all of them should be covered by the protection scope of the present invention. The protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. An operating room control device, characterized in that, comprising: a display screen; a communication module for communicatively connecting with multiple operating room devices; the operating room control device is configured with a device control function and a video routing function, the device control function is used to control the multiple operating room devices; the video routing function is used to determine a video input end and a video output end; a processor for performing the following processing: in response to the device control function selected by the user, displaying a device control interface on the display screen; wherein, the device control interface includes a device identification area and a device control area, at least one device identification corresponding to the multiple operating room devices is displayed in the device identification area, and the device control area is used to display a control interface of a target operating room device selected from the at least one operating room device; in response to a first user operation received on the device control interface, displaying a first setting area of the video routing function, the first setting area covers part of the device control interface, and at least one first video input end and at least one first video output end are displayed in the first setting area; wherein, the first video input end is a video source with a display screen; the first video output end is a display device capable of outputting the display screen of the first video input end.

2. The device according to claim 1, characterized in that, the processor is further configured to: when currently displaying the device control interface, in response to the video routing function selected by the user, displaying a video routing interface on the display screen, at least one second video input end and at least one second video output end are displayed in the video routing interface, and a display screen of a target input end selected from the at least one second video input end is also displayed.

3. The device according to claim 1, characterized in that, the processor is further configured to: when currently displaying the device control interface, in response to the video conferencing function selected by the user, displaying a video conferencing interface on the display screen, the video conferencing interface includes at least one third video input end, and a display screen of a target input end selected from the at least one third video input end is also displayed.

4. The device according to claim 3, characterized in that, in response to a second user operation received on the video conferencing interface, displaying a second setting area of the video routing function, the second setting area covers part of the device conferencing interface, and the at least one third video input end is displayed in the second setting area.

5. The device according to claim 1, characterized in that, the processor is further configured to: in response to a target input end selected by the user from the at least one first video input end, and a target output end selected by the user from the at least one first video output end, routing the display screen from the target input end to the target output end for output.

6. The device according to claim 5, characterized in that, the processor is further configured to: displaying the corresponding relationship between the target input end and the target output end in the first setting area.

7. The device according to claim 1, wherein, the first setting area covers part or all of the device control area and does not obscure the device identification area.

8. The device according to claim 7, wherein, the device control area is displayed on the right side of the device identification area, and the first setting area covers the right part of the device control area.

9. The device according to claim 1, wherein, the display mode of the first setting area includes a drawer type or a pop-up type.

10. The device according to claim 1, wherein, a first preset identifier corresponding to the first setting area is displayed in the device control interface, and the first user operation includes a user operation on the first preset identifier; alternatively, the first user operation includes a first touch gesture operation.

11. The device according to claim 1 or 10, wherein, a second preset identifier is displayed in the first setting area, and the first setting area is hidden in response to a user operation on the second preset identifier; alternatively, the first setting area is hidden in response to a second touch gesture operation.

12. The device according to claim 1, wherein, the control interface displayed in the device control area is the same as the control interface displayed by the target operating room device itself.

13. The device according to claim 12, wherein, the processor is further configured to: generate a control instruction for the target operating room device based on the control interface; send the control instruction to the target operating room device to control the target operating room device and synchronize the change of the control interface displayed by the target operating room device itself with the control interface displayed in the device control area.

14. The device according to claim 12, wherein, the control interface displayed in the device control area is the same as the control interface displayed by the target operating room device itself, including at least one of the following: the functions of the operation controls are the same, the identifiers of the operation controls are the same, the positions of the operation controls are the same, the user interaction methods are the same, and the visual effects are the same.

15. The device according to claim 14, wherein, a virtual operation key simulating the physical operation key of the target operating room device is further displayed in the device control interface, and the layout mode of the virtual operation key is the same as the layout mode of the physical operation key.

16. The device according to any one of claims 1-15, wherein, the operating room device includes at least one of the following: an operating lamp, an operating table, a pneumoperitoneum machine, a uterine dilator pump, a laparoscope, an energy platform, an intraoperative camera, a panoramic camera, and an audio device.

17. An operating room control device, wherein, comprising: a display screen; a communication module for communicating with a plurality of operating room devices; the operating room control device is configured with a video conferencing function and a video routing function, the video conferencing function is used to conduct a video conference with at least one user terminal; the video routing function is used to determine a video input end and a video output end; a processor for performing the following processing: In response to the video conferencing function selected by the user, a video conferencing interface is displayed on the display screen; In response to a user operation received in the video conferencing interface, a setting area of the video routing function is displayed. The setting area covers a part of the video conferencing interface, and at least one video input terminal is displayed in the setting area. The video input terminal is a video source with a display picture; The video conferencing interface includes a display picture area for displaying the display pictures of at least one of the video input terminals.

18. The device according to claim 17, wherein, the processor is further configured to: In response to a target input terminal selected by the user from the at least one video input terminal, route the display picture from the target input terminal to a preset video output terminal for output.

19. The device according to claim 17, wherein, the display mode of the setting area includes a drawer type or a pop-up window type.

20. A display method for an operating room control device, wherein, the operating room control device is configured with a device control function and a video routing function. The device control function is used to control multiple operating room devices, and the video routing function is used to determine video input terminals and video output terminals; the method includes: In response to the device control function selected by the user, a device control interface is displayed. The device control interface includes a device identification area and a device control area. In the device identification area, the device identification corresponding to at least one operating room device among the multiple operating room devices is displayed. The device control area is used to display the control interface of a target operating room device selected from the at least one operating room device; In response to a first user operation received in the device control interface, a first setting area of the video routing function is displayed. The first setting area covers a part of the device control interface, and at least one first video input terminal and at least one first video output terminal are displayed in the first setting area. Among them, the first video input terminal is a video source with a display picture, and the first video output terminal is a display device capable of outputting the display picture of the first video input terminal.

21. The method according to claim 20, wherein, the method further includes: When the device control interface is currently displayed, in response to the video routing function selected by the user, a video routing interface is displayed. At least one second video input terminal, at least one second video output terminal, and the display picture of a target input terminal selected from the at least one second video input terminal are displayed in the video routing interface.

22. The method according to claim 20, wherein, the method further includes: When the device control interface is currently displayed, in response to the video conferencing function selected by the user, a video conferencing interface is displayed. At least one third video input terminal, and the display picture of a target input terminal selected from the at least one third video input terminal are displayed in the video conferencing interface.

23. The method according to claim 22, wherein, further includes: In response to a second user operation received in the video conferencing interface, a second setting area of the video routing function is displayed, the second setting area covering a part of the device conferencing interface, and the at least one third video input terminal is displayed in the second setting area.

24. The method according to claim 20, wherein, the method further includes: In response to a target input terminal selected by the user from the at least one first video input terminal and a target output terminal selected by the user from the at least one first video output terminal, routing the display screen from the target input terminal to the target output terminal for output.

25. The method according to claim 20, wherein, the first setting area covers a part or all of the device control area and does not block the device identification area.

26. The method according to claim 20, wherein, the display mode of the first setting area includes a drawer type or a pop-up window type.

27. The method according to claim 20, wherein, the control interface displayed in the device control area is the same as the control interface displayed by the target operating room device itself.

28. The method according to claim 27, wherein, the method further includes: Generating a control instruction for the target operating room device based on the control interface; Sending the control instruction to the target operating room device to control the target operating room device and causing the control interface displayed by the target operating room device itself to change synchronously with the control interface displayed in the device control area.

29. A display method for an operating room control device, wherein, the operating room control device is configured with a video conferencing function and a video routing function, the video conferencing function is used to conduct a video conference with at least one user terminal, and the video routing function is used to determine video input terminals and video output terminals; the method includes: Displaying a video conferencing interface in response to the user selecting the video conferencing function; In response to a user operation received in the device control interface, displaying a setting area of the video routing function, the setting area covering a part of the video conferencing interface, and at least one video input terminal being displayed in the setting area, the video input terminal being a video source with a display screen; The video conferencing interface includes a display screen area for displaying the display screens of at least one of the video input terminals.

30. The method according to claim 29, wherein, the method further includes: In response to a target input terminal selected by the user from the at least one video input terminal, routing the display screen from the target input terminal to a preset video output terminal for output.

31. The method according to claim 29, wherein, the display mode of the setting area includes a drawer type or a pop-up window type.

Images