Display interaction method and system applied to endoscope system

Abstract

The invention provides a display interaction method and system applied to an endoscope system, and the method comprises the steps: a processor firstly determines the working state of the endoscope system, and the working state at least comprises a first working state and a second working state; and when the endoscope system is in a first working state, determining a first state function control corresponding to the first working state, and displaying the first state function control in the first display screen according to first control layout information corresponding to the first working state. Thus, in different working states, the processor controls the first display screen to perform control regulation and control, so that the state function control corresponding to each working state is displayed in different layouts, the frequency of finding the currently required function control through functions of page turning, searching and the like by a user can be reduced, and the user experience is improved. The operation convenience and the display intelligence are improved, and the user experience is enhanced.

Description

Technical Field

[0001] The present invention relates to the technical field of medical devices, and particularly to a display interaction method and system applied to an endoscope system. Background Art

[0002] An endoscope system is a medical device used for in-vivo examination, diagnosis, and treatment. The endoscope system includes multiple devices for operation, display, and processing. The electronic device where the processor is located includes areas for operation and display. Currently, the layout and order of the function controls presented in this area are the same in different surgical or examination scenarios or different stages. Users may need to flip pages and search for functions to find the currently required function controls, thus causing inconvenience in operation. Summary of the Invention

[0003] Embodiments of the present application provide a display interaction method and system applied to an endoscope system, which can reduce the frequency for users to find the currently required function controls by flipping pages and searching for functions, and is beneficial to improving the operation convenience.

[0004] In a first aspect, embodiments of the present application provide a display interaction method applied to an endoscope system, which is applied to a processor of the endoscope system. The endoscope system further includes a first display screen, and the first display screen is the screen of the device where the processor is located. The method includes:

[0005] Determine the working state of the endoscope system, where the working state includes at least a first working state and a second working state;

[0006] When the endoscope system is in the first working state, determine the first state function controls corresponding to the first working state, and display the first state function controls on the first display screen according to the first control layout information corresponding to the first working state;

[0007] When the endoscope system is in the second working state, determine the second state function controls corresponding to the second working state, and display the second state function controls on the first display screen according to the second control layout information corresponding to the second working state;

[0008] Wherein, both the first state function controls and the second state function controls include at least a first type of function controls and a second type of function controls. The functional requirement degree of the first type of function controls is greater than that of the second type of function controls, and at least a part of the first type of function controls in the first state function controls is different from the first type of function controls in the second state function controls.

[0009] In a second aspect, an embodiment of the present application provides an endoscope system, including a processor, a first display screen, an endoscope insertion end, a memory, and one or more programs. The one or more programs are stored in the memory and configured to be executed by the processor. The one or more programs include instructions for performing the steps in the method of the first aspect; the first display screen is used to respond to the processor; the endoscope insertion end is used to collect real-time images.

[0010] It can be seen that in the embodiment of the present application, the processor first determines the working state of the endoscope system, and the working state at least includes a first working state and a second working state; then when the endoscope system is in the first working state, it determines a first state function control corresponding to the first working state, and according to the first control layout information corresponding to the first working state, displays the first state function control on the first display screen; when the endoscope system is in the second working state, it determines a second state function control corresponding to the second working state, and according to the second control layout information corresponding to the second working state, displays the second state function control on the first display screen; wherein, both the first state function control and the second state function control at least include a first type of function control and a second type of function control, the function requirement degree of the first type of function control is greater than that of the second type of function control, and at least a part of the first type of function control in the first state function control is different from the first type of function control in the second state function control. In this way, in different working states, the processor controls the controls for the first display screen, so that the state function controls corresponding to each working state are displayed in different layouts, which can reduce the frequency for the user to find the currently required function control by flipping pages or searching for functions, is beneficial to improving the operation convenience and display intelligence, and enhances the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will describe the drawings required to be used in the embodiments of the present invention.

[0012] Figure 1a It is a system architecture diagram of the first endoscope system provided by the embodiment of the present application;

[0013] Figure 1b It is a system architecture diagram of the second endoscope system provided by the embodiment of the present application;

[0014] Figure 1c It is a system architecture diagram of the third endoscope system provided by the embodiment of the present application;

[0015] Figure 1d It is a system architecture diagram of the fourth endoscope system provided by the embodiment of the present application;

[0016] Figure 1e It is a system architecture diagram of the fifth endoscope system provided by an embodiment of the present application;

[0017] Figure 1f It is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

[0018] Figure 1g It is a schematic structural diagram of another electronic device provided by an embodiment of the present application;

[0019] Figure 2 It is a schematic flowchart of a display interaction method applied to an endoscope system provided by an embodiment of the present application;

[0020] Figure 3a It is a schematic diagram of the interface division of the first first display screen provided by an embodiment of the present application;

[0021] Figure 3b It is a schematic diagram of the interface division of the second first display screen provided by an embodiment of the present application;

[0022] Figures 4a - 4c It is a schematic diagram of the control layout of the first display screen provided by an embodiment of the present application;

[0023] Figure 5 It is a schematic diagram of the control sequence layout of the first display screen proposed by an embodiment of the present application;

[0024] Figure 6a It is a schematic diagram of the interface of the first second display screen provided by an embodiment of the present application;

[0025] Figure 6b It is a schematic diagram of the interface of the second second display screen provided by an embodiment of the present application;

[0026] Figure 7a It is a schematic diagram of the first interface switching provided by an embodiment of the present application;

[0027] Figure 7b It is a schematic diagram of the second interface switching provided by an embodiment of the present application;

[0028] Figure 8 It is a schematic structural diagram of a display interaction device applied to an endoscope system provided by an embodiment of the present application. Detailed implementation manners

[0029] To enable those skilled in the art to better understand the solution of this application, the following will clearly and completely describe the technical solution in the embodiments of this application with reference to the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are only a part of the embodiments of this application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of this application.

[0030] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned accompanying drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or electronic device that includes a series of steps or units is not limited to the listed steps or units, but in an alternative example also includes steps or units not listed, or in an alternative example also includes other steps or units inherent to these processes, methods, products, or electronic devices.

[0031] Referring to "embodiment" herein means that a specific feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of this application. The phrase appears in various places in the specification and does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.

[0032] Currently, when the area for controlling and displaying on the electronic device where the processor of the endoscope system is located is in different surgical or examination scenarios or different stages, the layout and order of the function controls shown are the same. Therefore, there is still a problem that the user needs to turn pages and find the currently required function control by searching for functions, which causes inconvenience in operation.

[0033] In view of the above problems, the embodiments of this application provide a display interaction method and system applied to an endoscope system. The following will introduce the embodiments of this application in detail with reference to the accompanying drawings.

[0034] Please refer to Figure 1a , Figure 1a which is the system architecture diagram of the first endoscope system provided by the embodiments of this application. As Figure 1a shown, the endoscope system 100 includes: a processor 110 and a first display screen 120.

[0035] Among them, the processor 110 is a device or integrated chip capable of executing a series of instructions to process data or control other devices. In a specific embodiment, the processor 110 includes functions for processing instructions, executing operations, controlling time, processing data, data conversion, data transmission, etc.; the device controlled by the processor 110 has a first display screen 120, and this device can be a host. In some cases, the first display screen 120 can also be an independent device or integrated on other devices and is controlled by the processor 110; this display screen is used to respond to the control instructions of the processor 110, specifically including at least for image display and interactive interface display. The specific interactive interface is used to display at least one control, and to obtain the interactive instructions of the user. The control is used to control at least one device in the endoscope system 100, including the first display screen 120. In some cases, the first display screen 120 can also be used for report editing, etc. Specifically, a report template can be displayed for the user to edit and export.

[0036] Please refer to Figure 1b , Figure 1b which is the system architecture diagram of the second endoscope system provided by the embodiments of the present application. As Figure 1b shown, this endoscope system includes: a processor 110, a first display screen 120, and an endoscope insertion end 130.

[0037] Among them, the endoscope insertion end 130 is a device for image acquisition and in-vivo operation, and specifically may include a camera device, an operation device, a lighting device, etc., which are not limited herein; during use, one end of the endoscope insertion end 130 can be connected to the physical device controlled by the processor 110 of the endoscope system, so that the processor 110 can perform operations such as controlling and data transmission on the endoscope insertion end 130.

[0038] Please refer to Figure 1c , Figure 1c which is the system architecture diagram of the third endoscope system provided by the embodiments of the present application. As Figure 1c shown, this endoscope system includes: a processor 110, a first display screen 120, an endoscope insertion end 130, and a second display screen 140.

[0039] Among them, the second display screen 140 is a display for at least displaying the real-time picture detected by the endoscope insertion end 130. The second display screen 140 can also display function controls, task information of the current detection task, etc. In some cases, it can also display historical detection images and reports, etc.

[0040] Please refer to Figure 1d , Figure 1d which is the system architecture diagram of the fourth endoscope system provided by the embodiments of the present application. As Figure 1dAs shown in the figure, the endoscope system includes: a processor 110, a first display screen 120, an endoscope insertion end 130, a second display screen 140, and an endoscope handle device 131.

[0041] Among them, the endoscope handle device 131 can be a handle-type operation device directly connected to the endoscope insertion end 130. In practice, it is possible that the endoscope handle device 131 and the endoscope insertion end 130 are integrated into one device, with one end of the device being the endoscope insertion end 130 and the other end being the endoscope handle device 131. Specifically, a plurality of physical controls are provided on the endoscope handle device 131 for controlling the devices of the endoscope system. Specifically, it can be used to control the display content of the endoscope insertion end 130 and the second display screen 140, the display content of the first display screen 120, or other devices, which is not limited herein. The specific functions corresponding to each physical control of the endoscope handle device 131 are regulated by the processor 110.

[0042] Please refer to Figure 1e , Figure 1e which is the system architecture diagram of the fifth endoscope system provided by the embodiments of the present application. As Figure 1e shown in the figure, the endoscope system includes: a processor 110, a first display screen 120, an endoscope insertion end 130, a second display screen 140, an endoscope handle device 131, and other external devices 150.

[0043] Among them, the other external devices 150 can be other devices for operation or display, specifically including a foot-operated device, a peristaltic pump device, an ultrasonic device, a keyboard and mouse device, etc. The other external devices 150 can be connected to the device where the processor 110 is located and controlled by the processor 110, or controlled by the endoscope handle device 131.

[0044] It should be noted that the processor 110 and the first display screen 120 can be integrated into one electronic device, which can be a host computer. The first display screen 120 can also be an independent device or integrated into other electronic devices, but is controlled by the processor 110.

[0045] Please refer to Figure 1f , Figure 1f which is the structural schematic diagram of an electronic device provided by the embodiments of the present application. As Figure 1f shown in the figure, the electronic device includes a processor 110, a memory 160, a communication interface 170, and one or more programs 161. Among them, the one or more programs 161 are stored in the above-mentioned memory 160 and are configured to be executed by the above-mentioned processor 110. The one or more programs 161 include instructions for executing any step in the following method embodiments. When performing data transmissions such as receiving and obtaining, the communication interface 170 can be selectively called to complete the corresponding operations.

[0046] Please refer to Figure 1g , Figure 1g which is a schematic structural diagram of another electronic device provided by an embodiment of the present application. As shown in Figure 1g , the electronic device includes a processor 110, a first display screen 120, a memory 160, a communication interface 170, and one or more programs 161. Among them, the one or more programs 161 are stored in the above-mentioned memory 160 and are configured to be executed by the above-mentioned processor 110. The one or more programs 161 include instructions for performing any step in the following method embodiments. When performing data transmissions such as receiving and obtaining, the communication interface 170 can be selectively called to complete the corresponding operations. When performing operations such as displaying, it is completed by the first display screen 120.

[0047] Please refer to Figure 2 , Figure 2 which is a schematic flowchart of a display interaction method applied to an endoscope system provided by an embodiment of the present application. The display interaction method applied to the endoscope system is applied to the processor of the endoscope system. The endoscope system further includes a first display screen, and the first display screen is the screen of the device where the processor is located. As shown in Figure 2 , it specifically includes the following steps.

[0048] S210, determine the working state of the endoscope system.

[0049] Among them, the working state at least includes a first working state and a second working state. It is specifically used to distinguish the current state of the endoscope system. In each working state, the operations required by the user are different. For example, in some states, information confirmation is required, in some states, device adjustment is required, and in some cases, data viewing is required.

[0050] Among them, the working state of the endoscope system can be determined according to the device connection state, the device startup state, the power-on state of each part, etc.

[0051] In a possible embodiment, the system further includes an endoscope insertion end. Determining the working state of the endoscope system includes: determining the access state of the endoscope insertion end; and determining the working state of the endoscope system according to the access state.

[0052] Among them, the access state of the endoscopic insertion end is the connection condition between the endoscopic insertion end and the device where the processor is located. The device where the processor is located has an interface connected to the endoscopic insertion end, and the access state is determined by judging whether the endoscopic insertion end is connected to the device where the processor is located; then, the working state of the endoscopic system is determined according to the access state. There are multiple working states of the endoscopic system, and when the access state changes, the working state will also change accordingly.

[0053] Specifically, the access state includes a non-access state, an access state, or a state of being pulled out after access. If the access state of the endoscopic insertion end is the non-access state, the working state is the preparation state; if the access state of the endoscopic insertion end is the access state, the working state is the inspection state; if the access state of the endoscopic insertion end is the state of being pulled out after access, the working state is the end state.

[0054] It can be seen that in this embodiment, determining the working state of the endoscopic system based on the connection condition between the endoscopic insertion end and the device where the processor is located can improve the intelligence and efficiency of the endoscopic system in determining the working state.

[0055] In a possible embodiment, the system further includes an endoscopic insertion end, and the endoscopic insertion end further includes a camera device for photographing and / or recording; determining the working state of the endoscopic system includes: determining the access state of the endoscopic insertion end, and / or, determining the startup state of the camera device and / or the lighting device; according to the access state and / or the startup state, determining the working state of the endoscopic system.

[0056] Among them, the access state of the endoscopic insertion end is the connection condition between the endoscopic insertion end and the device where the processor is located. The device where the processor is located has an interface connected to the endoscopic insertion end, and the access state is determined by judging whether the endoscopic insertion end is connected to the device where the processor is located; when it is detected that the endoscopic insertion end is connected to the device where the processor is located, the startup state of the camera device is detected. The startup state includes an on state and an off state, and then the working state of the endoscopic system is determined according to the access state and the startup state; there are multiple working states of the endoscopic system, and when the access state changes, the working state will also change accordingly.

[0057] Specifically, the access state includes a non-access state, an access state, or a state of being pulled out after access. If the access state of the insertion end of the endoscope is the non-access state, the working state is the preparation state; if the access state of the insertion end of the endoscope is the access state and the startup state is the non-activated state, the working state is the inspection state; if the access state of the insertion end of the endoscope is the access state and the startup state is the activated state, the working state is the inspection and recording state; if the access state of the insertion end of the endoscope is the state of being pulled out after access, the working state is the end state.

[0058] It can be seen that in this embodiment, based on the connection situation between the insertion end of the endoscope and the device where the processor is located and the startup state of other devices included in the insertion end of the endoscope, the working state of the endoscope system is determined, which can improve the intelligence and efficiency of the endoscope system in determining the working state.

[0059] In a possible embodiment, the system further includes other external devices; determining the working state of the endoscope system includes: determining the access state of the insertion end of the endoscope, and / or determining the startup state of the imaging device and / or the lighting device, and / or determining the access situation of other external devices; according to the access state and / or the startup state and / or the access situation, determining the working state of the endoscope system.

[0060] Among them, the other external devices may specifically include a foot-operated device, a peristaltic pump device, an ultrasonic device, or a keyboard and mouse device, etc. The foot-operated device corresponds to a first access situation, the peristaltic pump device corresponds to a second access situation, the ultrasonic device corresponds to a third access situation, and the keyboard and mouse device corresponds to a fourth access situation.

[0061] Specifically, if the access state of the insertion end of the endoscope is the non-access state, the working state is the preparation state; if the access state of the insertion end of the endoscope is the accessed state and the startup state is the non-activated state, the working state is the inspection state; the access state includes a non-access state and an accessed state; if the access state of the insertion end of the endoscope is the accessed state and the startup state is the activated state, the working state is the inspection and recording state; if the access state of the insertion end of the endoscope is the state of being pulled out after access, the working state is the end state. If it is detected that at least one of the first access state, the second access state, the third access state, and the fourth access state is the access state, the working state is the preparation and configuration state. Specifically, the first access state may be that the ultrasonic device has been accessed, the second access state may be that the foot-operated device has been accessed, the third access state may be that the peristaltic pump has been accessed, and the fourth access state may be that the keyboard and mouse have been accessed and any key has been clicked.

[0062] For example, please refer to the content of Table 1. Table 1 is a mapping table of the judgment conditions for each working state.

[0063] Table 1

[0064]

[0065] It can be seen that in this embodiment, based on the connection situation between the insertion end of the endoscope and the device where the processor is located, the startup status of other devices included in the insertion end of the endoscope, and the access situation of other external devices, the working state of the endoscope system is determined, which can improve the intelligence and efficiency of the endoscope system for working state determination.

[0066] In a possible embodiment, the working state includes a preparation state, an inspection state, and an end state; when the working state is the preparation state, the first type of function control includes at least one inspection task information control for task information prompt; when the working state is the inspection state, the first type of function control includes at least one device control control for controlling the endoscope handle device and / or the second display screen of the endoscope system; when the working state is the end state, the first type of function control includes at least one report generation control for information export and report generation.

[0067] Among them, the inspection task information control is used to display the task information under the current inspection task and for information configuration; the device control control is used to control the external devices and system modes included in the endoscope system. The external devices include the endoscope handle device, and the system modes include the display modes of the second display screen and the first display screen; the report generation control is used for information export and report generation. Specifically, information export can include image export and inspection information viewing.

[0068] Specifically, the inspection task information control includes a patient information control and a doctor information control, the device control control includes a light source brightness adjustment control and a mode adjustment control, and the report generation control includes an image export control and a report generation control.

[0069] Among them, the working state also includes an inspection record state and a preparation configuration state. When the working state is the inspection record state, the first type of function control includes at least one information viewing control, and in some possible cases, at least one device control control; when the working state is the preparation configuration state, the first type of function control includes at least one device control control, and the device control control is used to control the screen display, external devices, and information retrieval of the endoscope system. In the above inspection record state, the information viewing control included in the first type of function control may include a photo review control; the first type of function control may also include multiple external device adjustment controls, specifically including an air pump adjustment control, a light source brightness adjustment control, and a node addition control. In the above preparation configuration state, the device control control included in the first type of function control may include multiple screen adjustment controls, such as picture-in-picture, picture-out-of-picture, and screen swapping controls, and may also include multiple foot pedal adjustment controls, multiple peristaltic pump adjustment controls, multiple information prompt controls, etc.

[0070] For example, when the working state is the preparation state, the first type of function control includes a configuration control, a doctor information control, and a patient information control; when the working state is the inspection state, the first type of function control includes a special light control, an air pump adjustment control, a light source brightness adjustment control, a light transmission mode control, an immersion mode control, and a photometry control; when the working state is the inspection record state, the first type of function control includes a node addition control, a photo review control, an air pump adjustment control, and a light source brightness adjustment control; when the working state is the inspection end state, the first type of function control includes an image export control, an inspection details control, and a report generation control; when the working state is the preparation configuration state, the first type of function control includes a picture-in-picture control, a picture-out-of-picture control, a screen swapping control, a foot pedal trigger control, a custom foot pedal function control, a water supply switch control, a flow rate setting control, a mode selection control, a doctor information control, a patient information control, and a report generation control.

[0071] For example, when the working state is the preparation state, the second type of function control includes a white balance control and a control for changing the storage location of the current file; when the working state is the inspection state, the second type of function control includes a configuration, a doctor information control, a patient information control, and a control for changing the storage location of the current file; when the working state is the preparation configuration state, the second type of function control includes a shortcut key setting control; when the working state is the inspection record state or the inspection end state, the second type of function control is empty.

[0072] In a possible embodiment, the endoscope system further includes an endoscope handle device provided with a plurality of physical controls. After the step of determining the working state of the endoscope system, the method further includes: determining first function information corresponding to the first working state according to the first working state, where the first function information includes a plurality of first control functions corresponding to each of the physical controls; setting the control functions of the plurality of physical controls based on the function information; if it is recognized that the working state changes from the first working state to the second working state, determining second function information corresponding to the second working state; and updating the control functions of the plurality of physical controls based on the second function information.

[0073] Among them, the endoscope handle device is provided with a plurality of physical controls. The number of physical controls is fixed, but the specific functions mapped by each physical control are different, or different operations on the same control can map different specific functions. Similar to the function controls on the first screen, the function information corresponding to the physical controls can also be switched according to different working states. That is to say, the physical controls will be configured with functions according to the plurality of first control functions corresponding to each physical control in the first function information. For example, the function of "light source switch" is bound to a specific physical control, so that when the user operates the button according to the mapped specific operation, the corresponding function operation can be executed. For example, if the current working state is the preparation state, the function of double-clicking the first physical control is mapped to turn on the light source, and the function of single-clicking the first physical control is mapped to turn off the light source. Through this setting, the physical controls have corresponding functions in the first working state to meet the operation requirements in this working state. The system will reconfigure the second control functions mapped by each physical control after switching the working state to the corresponding physical controls. In this way, the functions of the physical controls will be adjusted according to the change of the working state to adapt to new work tasks and operation requirements. For example, after switching from the preparation state to the inspection state, double-clicking the first physical control is mapped to turn on the immersion mode, and single-clicking is mapped to turn off the immersion mode.

[0074] For example, please refer to Table 2, which is used to exemplify the situation of the first type of function controls and the second type of function controls in each working state.

[0075] Table 2

[0076]

[0077]

[0078] It can be seen that in this embodiment, multiple function controls are adaptively adjusted based on the working state, so that there are corresponding first-type function controls to be preferentially displayed and second-type function controls to be secondly displayed in each working state, which can improve the intelligence and efficiency of the endoscope system for working state determination.

[0079] S220. When the endoscope system is in the first working state, determine the first-state function controls corresponding to the first working state, and display the first-state function controls on the first display screen according to the first control layout information corresponding to the first working state; when the endoscope system is in the second working state, determine the second-state function controls corresponding to the second working state, and display the second-state function controls on the first display screen according to the second control layout information corresponding to the second working state.

[0080] Among them, both the first-state function controls and the second-state function controls at least include first-type function controls and second-type function controls. The functional requirement degree of the first-type function controls is greater than that of the second-type function controls. At least a part of the first-type function controls in the first-state function controls is different from the first-type function controls in the second-state function controls.

[0081] Among them, the first working state can be a preparation state, an inspection state, an inspection record state, an end state, or a preparation configuration state; the second working state can be a preparation state, an inspection state, an inspection record state, an end state, or a preparation configuration state; the first working state and the second working state are different working states. Each working state corresponds to a state function control, each state function control includes multiple function controls, and the state function controls corresponding to each working state are different. The difference can specifically include different functions, the same functions but different arrangement orders, etc. Specifically, the first working state corresponds to the first-state function controls, and the second working state corresponds to the second-state function controls.

[0082] Among them, both the first state function control and the second state function control at least include a first type of function control and a second type of function control. The first type of function control and the second type of function control are used to distinguish different degrees of function requirements in different working states. The function requirement degree of the first type of function control is greater than that of the second type of function control. It can be understood that the first type of function control has a higher priority than the second type of function control. In practical applications, it can also be divided into a third type of function control and a fourth type of function control according to different degrees of requirements, which is not limited here. The first control layout information is the layout method information corresponding to the first state function control, used to control the specific layout of the first state function control, and can include but is not limited to the order of control arrangement, control appearance, control position, etc.; the second control layout information is the layout method information corresponding to the second state function control, used to control the specific layout of the second state function control, and can include but is not limited to the order of control arrangement, control appearance, control position, etc. Specifically, the first control layout information or the second space layout information can be the layout information used to distinguish the first type of function control and the second type of function control.

[0083] In a possible embodiment, the determining the first state function control corresponding to the first working state includes: obtaining a preset function mapping rule, obtaining user-specified information, or obtaining historical operation information. The user-specified information is the first type of function control division information specified by the user, and the historical operation information includes the number of times of use, the usage duration, or the setting situation of each function in the working state; based on the preset function mapping rule, the user-specified information, or the historical operation information, and the working state, determine the first state function control corresponding to the first working state.

[0084] Among them, the preset function mapping rule is a function mapping rule pre-built in the system. Specifically, it can refer to the mapping rule in Table 2. Specifically, it is to judge the working state by judging the access situation of each external device in the endoscope system and match the corresponding first state function control based on the working state, specifically including matching the corresponding first type of function control and the second type of function control. In the case where an endoscope handle is connected and the endoscope handle has physical controls, it also specifically includes matching the specific functions of the corresponding endoscope handle buttons. In the preset function mapping rule, the specific functions of the first type of function control, the second type of function control, and the endoscope handle buttons corresponding to each working state can be set artificially, and specifically can be conclusions obtained based on empirical statistics.

[0085] Among them, the historical operation information includes the usage of each function collected in various working states, specifically including the number of uses, usage duration, setting conditions, etc. Specifically, corresponding event listeners are set for each function control to record operation behaviors. For example, when the user clicks a certain function button, the click event listener is triggered to start recording the usage of this function, which can be stored in the form of a data table on the mobile phone. Data analysis of the task time is carried out during the system development stage or after each use. When the user opens a certain function, the current time is recorded as the start time. When the user closes the function or performs other operations that cause the function to pause, the end time is recorded, and the time difference between the two is calculated and the usage duration field of this function is updated. Whenever the user performs an operation on a certain function, the usage times counter of the corresponding function is incremented by 1. For example, when the user uses the "air pump adjustment" function, the value of the usage times field in the record corresponding to this function in the database is incremented by 1. When the user opens a certain function, the current time is recorded as the start time; when the user closes the function or performs other operations that cause the function to pause, the end time is recorded, and the time difference between the two is calculated and the usage duration field of this function is updated. Optionally, according to actual requirements and experience, different weights are assigned to factors such as the number of uses, usage duration, and setting conditions. For example, if the number of uses is considered relatively important, a weight of X can be assigned; a weight of Y is assigned to the usage duration; a weight of Z is assigned to the setting conditions, where X > Y > Z. According to the sorting results, several function controls with the highest scores are determined as the first-class function controls, and several function controls with the second-highest scores are determined as the second-class function controls. In some cases, there will be remaining controls with scores lower than those of the second-class function controls, which can be arranged at the end or not displayed as appropriate, and can be set according to actual requirements, which are not limited here.

[0086] Among them, before using or when using this endoscope device, the user can select the specified first-class function controls and second-class function controls. In specific implementation, an interactive interface dedicated to the user-defined function controls can be displayed, and various forms such as a drop-down menu, a checkbox group, and a text input box can be used. When the user completes the selection or input, the system receives the information specified by the user in real time. For the drop-down menu and the checkbox group, the system automatically obtains the options selected by the user; for the text input box, the system obtains the text content input by the user. Check whether the input content conforms to the rules preset by the system. For example, for the drop-down menu and the checkbox group, ensure that the options selected by the user are valid; for the text input box, check whether the input content contains illegal characters and whether it conforms to specific format requirements, etc. If the information is illegal, a prompt box is popped up to inform the user of the reason for the error and require the user to re-enter.

[0087] Among them, comprehensive consideration can be carried out based on the preset function mapping rule, the user-specified information or the historical operation information. For example, in the case of preset function mapping, the user can input specified information to adjust and change the first type of function control and the second type of function control; in the case of automatically dividing function controls based on historical operation information, the user can also input specified information to adjust and change the first type of function control and the second type of function control; or the preset function mapping rule and the historical operation information can be integrated into a unified data structure or analysis model for weighted evaluation.

[0088] In some cases, determining the second state function control corresponding to the second working state includes: obtaining a preset function mapping rule, obtaining user-specified information or obtaining historical operation information, where the user-specified information is the division information of the first type of function control specified by the user, and the historical operation information includes the usage times, usage duration or setting conditions of each function in the working state; based on the preset function mapping rule, the user-specified information or the historical operation information, and the working state, determining the first state function control corresponding to the second working state.

[0089] Among them, the method for determining the second state function control in the case of the second working state is the same as the method for determining the first state function control in the first working state, which will not be elaborated here. Please refer to the above description.

[0090] It can be seen that in this embodiment, by obtaining the preset function mapping rule, the system can directly locate the function control that should be focused on in a specific working state according to the pre-set logical relationship. Combining with the historical operation information, it can present the function controls that are frequently used or have a longer usage duration according to the usage of each function in the past actual operations, so that when the user enters the corresponding working state, they can quickly find and use the frequently used functions, reducing the operation steps and time, and improving work efficiency. The acquisition of user-specified information allows the user to customize the division of function controls according to their own operation habits, professional judgments or specific task requirements. This enables the system to better adapt to the personalized needs of different users and enhance the user experience. Furthermore, it can improve the intelligence and efficiency of the endoscope system for working state determination, reduce the cognitive burden of the user in the complicated whole surgical process, and thus improve the efficiency of surgery and examination.

[0091] In a possible embodiment, displaying the first state function controls in the first display screen according to the first control layout information corresponding to the first working state includes: based on the first control layout information, displaying the first type of function controls in a first area, and displaying the second type of function controls in a second area; and / or, based on the first control layout information, performing a first appearance adjustment process on the first type of function controls, and performing a second appearance adjustment process on the second type of function controls, so that the appearance of the first type of function controls is different from the appearance of the second type of function controls, and displaying the first state function controls, where the appearance adjustment includes at least one of color adjustment, area adjustment, and shape adjustment; and / or, based on the first control layout information, controlling the display order adjustment of the first type of function controls and / or the second type of function controls, so that the first type of function controls are arranged before the second type of function controls when being displayed, and displaying the first state function controls.

[0092] Among them, the first control layout information includes an indication of the interface layout of the first display screen in the first working state, and specifically may include at least one of the following: the first interface division information for indicating the interface area division and partitioning the function controls, the first appearance adjustment information for indicating the first type of function controls and the second type of function controls included in the first state function controls, and the first control arrangement information for indicating the arrangement order of the first type of function controls and the second type of function controls included in the first state function controls.

[0093] Among them, please refer to Figure 3a , Figure 3a is the schematic diagram of the interface division of the first display screen provided by the first embodiment of the present application. If the first control layout information includes the first interface division information, the first display screen is divided into multiple areas based on the first interface division information. The multiple areas may include a first area and a second area; each area is used to layout different types of function controls. Specifically, the first area is used to display the first type of function controls, and the second area is used to display the second type of function controls; when there is a difference in the demand degree between the first type of function controls and the second type of function controls, the first area division occupies the screen area that is easily observable by the user, and the second area division occupies other screen areas. As Figure 3a shown, the first area may be the area on the left side above the screen, and the second area may be the area on the right side above the screen. In some cases, please refer to Figure 3b , Figure 3b is the schematic diagram of the interface division of the second display screen provided by the embodiment of the present application. As Figure 3bAs shown in the figure, the multiple regions divided by the first display screen may further include a third region, which is used to display fixed function controls. The fixed function controls are function controls that do not change with the working state of the endoscope system. The third region may be arranged at the position of the lower edge region of the screen. The first region and the second region may be arranged above the third region. In practical applications, the screen division regions of the first region, the second region, and the third region may be other, for example, the third region is at the upper edge region position, and the first region and the second region are arranged below the third region; the specific layout is not limited herein.

[0094] Among them, if the first control layout information includes the first appearance adjustment information, based on the first control layout information, the first appearance control is performed on the first type of function controls, and the second appearance control is performed on the second type of function controls; please refer to Figures 4a - 4c , Figures 4a - 4c is a schematic diagram of the control layout of the first display screen provided by an embodiment of the present application. As Figures 4a - 4c shown, after the first appearance control and the second appearance control, the appearances of the first type of function controls and the second type of function controls are different. Specifically, the first appearance control includes at least one of color control, area control, and shape control, so that the first type of function controls are more prominent and eye-catching than the second type of function controls and are more convenient to identify. Among them, the above color control may be to adjust the control colors of the first type of function controls and the second type of function controls. For example, the first type of function controls are changed to a more eye-catching yellow, and the second type of function controls remain the default color, such as white. Among them, the above area control may be to increase the area of the first type of function controls or reduce the area of the second type of function controls, so that the area of the first type of function controls is larger than the area of the second type of function controls. Among them, the above shape control may be to distinguish and display the shapes of the first type of function controls and the second type of function controls. For example, the first type of function controls are set to be square, and the second type of function controls are set to be rectangular. It should be noted that at least one of the above area control, color control, and shape control may exist at the same time. For example, while performing shape control on the first type of function controls, area control and color control are also performed, or only area control may be performed.

[0095] Among them, if the first control layout information includes the first control arrangement information, based on the first control layout information, the first type of function controls and the second type of function controls are sorted in sequence, so that the first type of function controls are displayed on the interface prior to the second type of function controls; in practical applications, due to a large number of function control data, there may be a multi-page display situation when the first display screen displays function controls. After the display order control, the first type of function controls are displayed prior to the second type of function controls. Please refer to Figure 5 , Figure 5 is a schematic diagram of the control order layout of a first display screen provided by an embodiment of the present application. AsFigure 5 As shown, in the case of needing to turn pages, the first type of function controls are preferentially displayed on the first page, and the remaining first type of function controls are displayed on the second page. If all the first type of function controls on the second page are displayed, the second type of function controls are displayed in the remaining part of the second page.

[0096] It should be noted that at least one of the above display area division, appearance adjustment processing, and display order adjustment can be adjusted according to specific requirements during actual use, and no limitation is made here.

[0097] It can be seen that in this embodiment, by performing display area division, appearance adjustment, and display order adjustment on the first type of function controls and the second type of function controls, the first type of function controls can be made more easily recognizable by users than the second type of function controls, which can reduce the frequency of users finding the currently required function controls by turning pages and searching for functions, is beneficial to improving operation convenience and display intelligence, and enhances the user experience.

[0098] In a possible embodiment, the displaying the second-state function controls in the first display screen according to the second control layout information corresponding to the second working state includes: based on the second control layout information, displaying the first type of function controls in a first area, and displaying the second type of function controls in a second area; and / or based on the second control layout information, performing a first appearance adjustment process on the first type of function controls, and performing a second appearance adjustment process on the second type of function controls, so that the appearance of the first type of function controls is different from the appearance of the second type of function controls, and displaying the first-state function controls, where the appearance adjustment includes at least one of color adjustment, area adjustment, and shape adjustment; and / or based on the second control layout information, controlling the display order adjustment of the first type of function controls and / or the second type of function controls, so that the first type of function controls are arranged prior to the second type of function controls during display, and displaying the first-state function controls.

[0099] Among them, the second control layout information includes an indication of the interface layout of the first display screen in the second working state, and specifically may include at least one of the following: second interface division information for indicating the interface area division and partitioning the function controls, second appearance adjustment information for indicating the first type of function controls and the second type of function controls included in the second-state function controls, and second control arrangement information for indicating the arrangement order of the first type of function controls and the second type of function controls included in the second-state function controls.

[0100] Among them, if the first control layout information includes the second interface division information, the first display screen is divided into multiple regions based on the second interface division information. The multiple regions may include a first region and a second region; each region is used to layout different types of function controls. Specifically, the first region is used to display the first type of function controls, and the second region is used to display the second type of function controls; when there is a difference in the demand degree between the first type of function controls and the second type of function controls, the division of the first region occupies the screen region that is easily observable by the user, and the division of the second region occupies other screen regions. The first region may be the region on the left side above the screen, and the second region may be the region on the right side above the screen. In some cases, the multiple regions divided by the first display screen may further include a third region, and the third region is used to display fixed function controls. The fixed function controls are function controls that do not change with the working state of the endoscope system. The third region may be laid out at the position of the lower edge region of the screen. The first region and the second region may be laid out above the third region. In practical applications, the screen division regions of the first region, the second region, and the third region may be other, for example, the third region is at the upper edge region position, and the first region and the second region are laid out below the third region; the specific layout is not limited here.

[0101] Among them, if the second control layout information includes the second appearance adjustment information, based on the second control layout information, the first appearance regulation is performed on the first type of function controls, and the second appearance regulation is performed on the second type of function controls; after the first appearance regulation and the second appearance regulation, the appearances of the first type of function controls and the second type of function controls are different. Specifically, the first appearance regulation includes at least one of color regulation, area regulation, and shape regulation, so that the first type of function controls is more prominent and eye-catching and more convenient to identify compared with the second type of function controls. Among them, the above color regulation may be to adjust the control colors of the first type of function controls and the second type of function controls. For example, the first type of function controls is changed to a more eye-catching yellow, and the second type of function controls remains the default color, such as white. Among them, the above area regulation may be to increase the area of the first type of function controls or reduce the area of the second type of function controls, so that the area of the first type of function controls is larger than the area of the second type of function controls. Among them, the above shape regulation may be to distinguish the shapes of the first type of function controls and the second type of function controls. For example, the first type of function controls is set to a square, and the second type of function controls is set to a rectangle. It should be noted that at least one of the above area regulation, color regulation, and shape regulation may exist at the same time. For example, while performing shape regulation on the first type of function controls, area regulation and color regulation are also performed, or only area regulation may be performed.

[0102] Among them, if the second control layout information includes the second control arrangement information, based on the second control layout information, the first type of function controls and the second type of function controls are sorted successively, so that the first type of function controls are displayed on the interface prior to the second type of function controls; in practical applications, due to a large number of function control data, there may be a multi-page display situation when the first display screen displays function controls. After the display order is adjusted, the first type of function controls are displayed prior to the second type of function controls. In the case of needing to turn pages, the first type of function controls are preferentially displayed on the first page, and the remaining first type of function controls are displayed on the second page. If all the first type of function controls on the second page are displayed, the second type of function controls are displayed in the remaining part of the second page.

[0103] It should be noted that at least one of the above display area division, appearance adjustment processing, and display order adjustment can be adjusted according to specific requirements during actual use, and no limitation is made here.

[0104] It should be noted that the specific controls included in the first type of function controls and the second type of function controls regulated by the second control layout information and the first control layout information are different. Specifically, in different working states, the first type of function controls and the second type of function controls include at least one different multiple function controls. In the first working state, the first type of function controls and the second type of function controls included in the first state function controls are regulated according to the first control layout information; when the working state changes, for example, it is detected that the state changes from the first working state to the second working state, then the first type of function controls and the second type of function controls in the current second working state are regulated according to the second control layout information. The first type of function controls in the second working state and the first type of function controls in the first working state include at least one different function control, and the second type of function controls in the second working state and the second type of function controls in the first working state include at least one different function control.

[0105] It can be seen that in this embodiment, by performing display area division, appearance adjustment, and display order adjustment on the first type of function controls and the second type of function controls, the first type of function controls can be made more easily recognizable by users than the second type of function controls, which can reduce the frequency for users to find the currently required function controls by turning pages and searching for functions, is beneficial to improving operation convenience and display intelligence, and enhances the user experience.

[0106] In a possible embodiment, the endoscope system further includes a second display screen, which is at least used to display the detection screen in real time; when the endoscope system is in the first working state, the display of the first state function controls on the first display screen includes: when the endoscope system is in the first working state, determining the first state function controls corresponding to the first working state, and displaying the first state function controls on the first display screen according to the first control layout information corresponding to the first working state, and at the same time displaying the first type of function controls in the first state function controls on the second display screen.

[0107] Among them, please refer to Figure 6a , Figure 6a which is the schematic diagram of the interface of the first second display screen provided by the embodiment of the present application. As Figure 6a shown, the second display screen of the endoscope system can be used to display the detection screen, and in some cases, it can also display the control information of the first type of controls. The second display screen can clearly and accurately display the high-resolution images captured by the endoscope, enabling doctors or operators to directly observe the internal conditions and perform diagnoses and operations; the second display screen is generally installed on a bracket or fixed on a wall or an equipment trolley, and is relatively high in position for easy direct observation by doctors during surgery or examinations; the first display screen is generally installed on the panel of the endoscope host. The first display screen is mainly used to operate and set the functions of the endoscope system, such as adjusting parameters such as the brightness, contrast, and color saturation of the image, and can also set functions such as the working mode of the endoscope system, storing images or videos, etc. In addition to displaying some basic image information for assisting operations, the first display screen can serve as an operation interface to receive user input commands.

[0108] Among them, the first control layout information can also include the display layout information, which is used to constrain the specific layout of the first type of function controls displayed on the display interface of the second display screen. When the first state function controls and the first control layout information are determined according to the working state, the first type of function controls can be synchronously displayed on the second display screen according to the first control layout information. The controls on the second display screen can be used for click operations or to prompt the user about the specific functions included in the first type of function controls.

[0109] Among them, the first working state can be any one of the preparation state, the inspection state, the inspection record state, the end state, and the preparation configuration state.

[0110] It can be seen that in this embodiment, when the first type of function controls are displayed on the first display screen, the function controls are also displayed on the second display screen, making the first type of function controls more prominent and improving the user's search efficiency.

[0111] In a possible embodiment, the endoscope system further includes a second display screen, which is at least used for displaying the detection screen in real time; when the endoscope system is in the second working state, a second state function control is displayed on the first display screen, including: when the endoscope system is in the second working state, determining the second state function control corresponding to the second working state, and according to the second control layout information corresponding to the second working state, displaying the second state function control on the first display screen, and at the same time displaying the first type of function control in the second state function control on the second display screen.

[0112] Among them, when the working state changes, the first type of function control displayed on the second display screen also changes. The second control layout information may further include display layout information, which is used to restrict the specific layout of the first type of function control displayed on the display interface of the second display screen. After determining the second state function control and the second control layout information according to the working state, the first type of function control can be synchronously displayed on the second display screen according to the first control layout information. The controls on the second display screen can be used for click operations or to prompt the user about the specific functions included in the first type of function control.

[0113] Among them, the second working state can be any one of the preparation state, the inspection state, the inspection record state, the end state, and the preparation configuration state.

[0114] It can be seen that in this embodiment, when the first type of function control is displayed on the first display screen, the function control is also displayed on the second display screen and automatically switches as the working state changes, making the switching of the first type of function control flexible and more prominent in different working states, and improving the user's search efficiency.

[0115] In a possible embodiment, the method further includes: displaying status prompt information on the second display screen based on the working state.

[0116] Among them, after determining the current working state, the working state is displayed on the second display screen as status prompt information. Specifically, please refer to Figure 6b , Figure 6b is the schematic diagram of the interface of the second display screen provided in the second embodiment of the present application. As shown in Figure 6b , a text box for displaying status prompt information is displayed on the second display screen, and the status prompt information changes as the working state changes.

[0117] It can be seen that in this embodiment, synchronously displaying the working state on the second display screen can enable the user to intuitively understand the change of the working state, prompt the user about the change of the function control, and is beneficial to improving the user's efficiency in searching for the control.

[0118] ThroughFigure 2 For the method provided by the embodiment, the processor first determines the working state of the endoscope system, and the working state at least includes a first working state and a second working state; then when the endoscope system is in the first working state, it determines a first state function control corresponding to the first working state, and according to the first control layout information corresponding to the first working state, displays the first state function control on the first display screen; when the endoscope system is in the second working state, it determines a second state function control corresponding to the second working state, and according to the second control layout information corresponding to the second working state, displays the second state function control on the first display screen; wherein, both the first state function control and the second state function control at least include a first type of function control and a second type of function control, the functional requirement degree of the first type of function control is greater than that of the second type of function control, and at least a part of the first type of function control in the first state function control is different from the first type of function control in the second state function control. In this way, in different working states, the processor controls the first display screen to perform control adjustment, so that the state function controls corresponding to each working state are displayed in different layouts, which can reduce the frequency of the user turning pages and searching for the currently required function controls, is beneficial to improving the operation convenience and display intelligence, and enhances the user experience.

[0119] In a possible embodiment, before determining the working state of the endoscope system, the method further includes: displaying a first control on the first display screen; if an operation on the first control is detected, then enter the working state determination step of the endoscope system, and display a first type of interface, where the first type of interface is used to display function controls that change based on the working state.

[0120] In a possible embodiment, before determining the working state of the endoscope system, the method further includes: displaying a second control on the first display screen; if no operation on the second control is detected within a preset time threshold, then hide the second control; if an operation on the second control is detected within the preset time threshold, then enter the working state determination step of the endoscope system, and display a first type of interface.

[0121] It can be seen that by setting multiple controls for entering or exiting to implement switching to enter or exit the control layout based on working state recognition, that is, the first type of interface, the entry and exit are more flexible and convenient, which is beneficial to improving the operation convenience and sense of use, and enhancing the user experience.

[0122] In a possible embodiment, the method further includes: displaying a setting control on a first display screen, detecting a trigger operation on the setting control, and displaying a setting window for interacting with a user; obtaining, through the setting window, mode setting information set by the user, where the mode setting information is used to indicate whether to directly execute the step of determining the working state of the endoscope system after the processor of the endoscope system is powered on. The mode setting information includes an on mode and an off mode. The off mode indicates that the processor does not execute the step of determining the working state of the endoscope system after being powered on, but displays a second type of interface, and the second type of interface includes a default function control interface, and the default function control interface is used to display a plurality of function controls in a preset system default layout; the on mode indicates that the processor executes the step of determining the working state of the endoscope system after being powered on and displays a first type of interface.

[0123] It should be noted that it is optional to switch function controls based on the working state. It is possible to choose to display the second type of interface with the default function control interface, or choose to display the first type of interface with function controls based on the working state.

[0124] It can be seen that by obtaining the mode setting information preset by the user, it is realized that when starting up, it automatically enters or exits the control layout based on working state recognition, that is, the first type of interface, making the entry and exit more flexible and convenient, which is beneficial to improving the operation convenience and user experience.

[0125] In a possible embodiment, if the endoscope system includes at least one operation external device, and the operation external device includes an endoscope handle device, a foot pedal device, and a mouse / keyboard device, before the step of determining the working state of the endoscope system, the method further includes: obtaining start state information of the endoscope handle device and / or the foot pedal device and / or the mouse / keyboard device, where the start state information is used to indicate whether to directly obtain a state recognition instruction, and the start state includes started. Among them, the start state information is used to indicate whether the processor of the endoscope system directly executes the step of determining the working state of the endoscope system after being powered on. The start state information includes a started mode and a closed mode. The closed mode indicates that the processor does not execute the step of determining the working state of the endoscope system after being powered on, but displays a second type of interface, and the second type of interface includes a default function control interface, and the default function control interface is used to display a plurality of function controls in a preset system default layout; the started mode indicates that the processor executes the step of determining the working state of the endoscope system after being powered on and displays a first type of interface.

[0126] It can be seen that by monitoring the access status of multiple external devices to switch into or out of the control layout based on work status recognition, that is, the first type of interface, the entry and exit are made more flexible and convenient, which is beneficial to improving the operation convenience and user experience.

[0127] In a possible embodiment, the method further includes: if a preset gesture operation of the user on the first display screen is detected, perform an interface switch based on the current interface, so that the first type of interface is switched to the second type of interface, or the second type of interface is switched to the first type of interface, and the gesture operation includes a sliding operation.

[0128] For example, please refer to Figure 7a and Figure 7b , Figure 7a is the first interface switch schematic diagram provided by the embodiment of the present application. Figure 7b is the second interface switch schematic diagram provided by the embodiment of the present application. The first type of interface and the second type of interface are adjacent interfaces. Specifically, the first type of interface is set on the left side of the second type of interface (which can be understood as the negative first page, and the second type of interface is the home page, that is, the first page). As Figure 7a shown, if the first display screen is currently in the second type of interface on the home page and a rightward sliding operation of the user is detected, that is, the page is switched and swiped to the right, the first display screen is switched to display the negative first page, that is, the first type of interface, that is, the interface for scenario recognition. As Figure 7b shown, if the first display screen is currently in the first type of interface on the negative first page and a leftward sliding operation of the user is detected, that is, the page is switched and swiped to the left, the first display screen is switched to display the home page, that is, the second type of interface.

[0129] In specific implementation, the arrangement manner of the first type of interface and the second type of interface can be other ways, such as vertical arrangement, and the switching operation can also be other switching ways, such as upward sliding, downward sliding, etc. This is not limited herein.

[0130] It can be seen that by performing a sliding switch through a preset interface to enter or exit the control layout based on work status recognition, that is, the first type of interface, the entry and exit are made more flexible and convenient, which is beneficial to improving the operation convenience and user experience.

[0131] Please refer to Figure 8 , Figure 8 is a schematic structural diagram of a display interaction device applied to an endoscope system proposed by the embodiment of the present application. The device is applied to the processor of the endoscope system. The endoscope system further includes a first display screen, and the first display screen is the screen of the device where the processor is located; the display interaction device 800 applied to the endoscope system includes: a status determination module 810 and a layout display module 820.

[0132] A status determination module 810 is configured to determine the working status of the endoscope system, where the working status at least includes a first working status and a second working status;

[0133] A layout display module 820 is configured to, when the endoscope system is in the first working status, determine a first status function control corresponding to the first working status, and display the first status function control on the first display screen according to first control layout information corresponding to the first working status; when the endoscope system is in the second working status, determine a second status function control corresponding to the second working status, and display the second status function control on the first display screen according to second control layout information corresponding to the second working status; where both the first status function control and the second status function control at least include a first type of function control and a second type of function control, the functional requirement degree of the first type of function control is greater than that of the second type of function control, and at least a part of the first type of function control in the first status function control is different from the first type of function control in the second status function control.

[0134] In a possible embodiment, the system further includes an endoscope insertion end, and the status determination module 810 is specifically configured to, in determining the working status of the endoscope system:

[0135] Determine the access status of the endoscope insertion end;

[0136] Determine the working status of the endoscope system according to the access status.

[0137] In a possible embodiment, the layout display module 820 is specifically configured to, in displaying the first status function control on the first display screen according to the first control layout information corresponding to the first working status:

[0138] Based on the first control layout information, display the first type of function control in a first area, and display the second type of function control in a second area; and / or,

[0139] Based on the first control layout information, perform a first appearance adjustment process on the first type of function control, and perform a second appearance adjustment process on the second type of function control, so that the appearance of the first type of function control is different from the appearance of the second type of function control, and display the first status function control, where the appearance adjustment includes at least one of color adjustment, area adjustment, and shape adjustment; and / or,

[0140] Based on the first control layout information, control the display order of the first type of function controls and / or the second type of function controls, so that the first type of function controls are arranged before the second type of function controls during display, and display the first state function controls.

[0141] In a possible embodiment, the layout display module 820 is specifically configured to display the second state function controls in the first display screen according to the second control layout information corresponding to the second working state:

[0142] Based on the second control layout information, display the first type of function controls in a first area, and display the second type of function controls in a second area; and / or,

[0143] Based on the second control layout information, perform a first appearance adjustment process on the first type of function controls, and perform a second appearance adjustment process on the second type of function controls, so that the appearance of the first type of function controls is different from the appearance of the second type of function controls, and display the first state function controls, where the appearance adjustment includes at least one of color adjustment, area adjustment, and shape adjustment; and / or,

[0144] Based on the second control layout information, control the display order of the first type of function controls and / or the second type of function controls, so that the first type of function controls are arranged before the second type of function controls during display, and display the first state function controls.

[0145] In a possible embodiment, the endoscope system further includes a second display screen, and the second display screen is at least used to display the detection screen in real time; when the endoscope system is in the first working state, the layout display module 820 is specifically configured to display the first state function controls in the first display screen:

[0146] When the endoscope system is in the first working state, determine the first state function controls corresponding to the first working state, and display the first state function controls in the first display screen according to the first control layout information corresponding to the first working state, and at the same time display the first type of function controls in the first state function controls in the second display screen;

[0147] When the endoscope system is in the second working state, the layout display module 820 is specifically configured to display the second state function controls in the first display screen:

[0148] When the endoscopic system is in the second working state, determine the second state function control corresponding to the second working state, and display the second state function control on the first display screen according to the second control layout information corresponding to the second working state. At the same time, display the first type of function controls in the second state function controls on the second display screen;

[0149] The layout display module 820 is specifically further configured to: display status prompt information on the second display screen based on the working state.

[0150] In a possible embodiment, the layout display module 820 is specifically configured to determine the first state function control corresponding to the first working state as follows:

[0151] Obtain a preset function mapping rule, obtain user-specified information, or obtain historical operation information. The user-specified information is the division information of the first type of function controls specified by the user, and the historical operation information includes the usage times, usage durations, or setting conditions of each function in the working state;

[0152] Based on the preset function mapping rule, the user-specified information, or the historical operation information, and the working state, determine the first state function control corresponding to the first working state.

[0153] In a possible embodiment, the layout display module 820 is specifically configured to determine the second state function control corresponding to the second working state as follows:

[0154] Obtain a preset function mapping rule, obtain user-specified information, or obtain historical operation information. The user-specified information is the division information of the first type of function controls specified by the user, and the historical operation information includes the usage times, usage durations, or setting conditions of each function in the working state;

[0155] Based on the preset function mapping rule, the user-specified information, or the historical operation information, and the working state, determine the first state function control corresponding to the second working state.

[0156] In a possible embodiment, the endoscopic system further includes an endoscopic handle device, and the endoscopic handle device is provided with a plurality of physical controls. After the step of determining the working state of the endoscopic system, the layout display module 820 is specifically further configured to:

[0157] Determine the first function information corresponding to the first working state according to the first working state. The first function information includes a plurality of first control functions corresponding to each of the physical controls;

[0158] Setting the control functions of the plurality of entity controls based on the function information;

[0159] If it is identified that the working state is changed from the first working state to the second working state, second function information corresponding to the second working state is determined; and the control functions of the multiple physical controls are updated based on the second function information.

[0160] It is worth noting that the specific functional implementation of the display interaction device 800 applied to the endoscope system can be found in the above Figure 2 The description of the display interaction method applied to the endoscope system shown, for example, the state determination module 810 is used to implement the relevant content of executing S210. The various units or modules in the display interaction device 800 applied to the endoscope system can be respectively or completely combined into one or several other units or modules to constitute, or one (some) of the units or modules can also be divided into multiple functionally smaller units or modules to constitute, which can achieve the same operation without affecting the realization of the technical effects of the embodiments of the present invention. The above-mentioned units or modules are divided based on logical functions. In actual applications, the functions of one unit (or module) are implemented by multiple units (or modules), or the functions of multiple units (or modules) are implemented by one unit (or module).

[0161] An embodiment of the present application also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, wherein the computer program enables a computer to execute part or all of the steps of any method described in the above method embodiments, and the above computer includes an electronic device.

[0162] The embodiment of the present application also provides a computer program product, the computer program product includes a non-transitory computer-readable storage medium storing a computer program, the computer program is operable to cause a computer to execute some or all of the steps of any method described in the method embodiment. The computer program product may be a software installation package, and the computer includes an electronic device.

[0163] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0164] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0165] In several embodiments provided by the present application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the above-mentioned division of units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection between each other can be through some interfaces. The indirect coupling or communication connection of the device or unit can be in an electrical or other form.

[0166] The units described above as separate components may or may not be physically separated. The components displayed as units may or may not be physical units, that is, they can be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0167] In addition, in each embodiment of the present application, each functional unit can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

[0168] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions for causing a computer electronic device (which can be a personal computer, an electronic device, or a network electronic device, etc.) to execute all or part of the steps of the above methods in each embodiment of the present application. And the aforementioned memory includes: various media such as USB flash drives, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), mobile hard disks, magnetic disks, or optical discs that can store program codes.

[0169] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable memory. The memory may include: a flash drive, a read-only memory (abbreviation: ROM), a random access memory (abbreviation: RAM), a magnetic disk, an optical disc, etc.

[0170] The above has introduced the embodiments of the present application in detail. Specific examples are used in this article to elaborate on the principle and implementation manner of the present application. The description of the above embodiments is only used to help understand the method and its core idea of the present application; at the same time, for those of ordinary skill in the art, according to the idea of the present application, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to the present application.

Claims

1. A display interaction method applied to an endoscope system, characterized in that A processor applied to an endoscope system, the endoscope system further including a first display screen, and the first display screen being the screen of the device where the processor is located; the method includes: Determine the working state of the endoscope system, where the working state at least includes a first working state and a second working state; When the endoscope system is in the first working state, determine a first state function control corresponding to the first working state, and display the first state function control on the first display screen according to the first control layout information corresponding to the first working state; When the endoscope system is in the second working state, determine a second state function control corresponding to the second working state, and display the second state function control on the first display screen according to the second control layout information corresponding to the second working state; Wherein, both the first state function control and the second state function control at least include a first type of function control and a second type of function control, the functional requirement degree of the first type of function control is greater than that of the second type of function control, and at least a part of the first type of function control in the first state function control is different from the first type of function control in the second state function control.

2. The method according to claim 1, characterized in that, The system further includes an endoscope insertion end, and the determining the working state of the endoscope system includes: Determine the access state of the endoscope insertion end; According to the access state, determine the working state of the endoscope system.

3. The method according to claim 1 or 2, characterized in that The displaying the first state function control on the first display screen according to the first control layout information corresponding to the first working state includes: Based on the first control layout information, display the first type of function control in a first area, and display the second type of function control in a second area; and / or, Based on the first control layout information, perform a first appearance adjustment process on the first type of function control, and perform a second appearance adjustment process on the second type of function control, so that the appearance of the first type of function control is different from the appearance of the second type of function control, and display the first state function control, where the appearance adjustment includes at least one of color adjustment, area adjustment, and shape adjustment; and / or, Based on the first control layout information, control the display order adjustment of the first type of function control and / or the second type of function control, so that the first type of function control is arranged prior to the second type of function control during display, and display the first state function control.

4. The method according to claim 1 or 2, characterized in that, The displaying the second state function control on the first display screen according to the second control layout information corresponding to the second working state includes: Based on the second control layout information, display the first type of function control in a first area, and display the second type of function control in a second area; and / or Based on the second control layout information, perform a first appearance adjustment process on the first type of function controls, and perform a second appearance adjustment process on the second type of function controls, so that the appearance of the first type of function controls is different from that of the second type of function controls, and display the first state function controls, where the appearance adjustment includes at least one of color adjustment, area adjustment, and shape adjustment; and / or Based on the second control layout information, control the first type of function controls and / or the second type of function controls to perform a display order adjustment, so that the first type of function controls are arranged prior to the second type of function controls when displayed, and display the first state function controls.

5. The method according to claim 1, wherein The endoscope system further includes a second display screen, and the second display screen is at least a screen for real-time display of a detection image; when the endoscope system is in the first working state, the display of the first state function controls on the first display screen includes: When the endoscope system is in the first working state, determine the first state function controls corresponding to the first working state, and display the first state function controls on the first display screen according to the first control layout information corresponding to the first working state, and at the same time display the first type of function controls in the first state function controls on the second display screen; When the endoscope system is in the second working state, the display of the second state function controls on the first display screen includes: When the endoscope system is in the second working state, determine the second state function controls corresponding to the second working state, and display the second state function controls on the first display screen according to the second control layout information corresponding to the second working state, and at the same time display the first type of function controls in the second state function controls on the second display screen; Further includes: Based on the working state, display status prompt information on the second display screen.

6. The method according to claim 1, wherein The determination of the first state function controls corresponding to the first working state includes: Obtain a preset function mapping rule, obtain user-specified information, or obtain historical operation information, where the user-specified information is the first type of function control division information specified by the user, and the historical operation information includes the usage times, usage durations, or setting situations of each function in the working state; Based on the preset function mapping rule, the user-specified information, or the historical operation information, and the working state, determine the first state function controls corresponding to the first working state.

7. The method according to claim 1, wherein The determination of the second state function controls corresponding to the second working state includes: Obtain a preset function mapping rule, obtain user-specified information, or obtain historical operation information, where the user-specified information is the first type of function control division information specified by the user, and the historical operation information includes the usage times, usage durations, or setting situations of each function in the working state; Based on the preset function mapping rule, the user-specified information, or the historical operation information, and the working state, determine the first state function controls corresponding to the second working state.

8. The method according to claim 5, wherein The endoscope system further includes an endoscope handle device, which is provided with a plurality of physical controls. After the step of determining the working state of the endoscope system, the method further includes: Determining first function information corresponding to the first working state according to the first working state, where the first function information includes a plurality of first control functions corresponding to each of the physical controls; Setting the control functions of the plurality of physical controls based on the function information; If it is recognized that the working state changes from the first working state to the second working state, determining second function information corresponding to the second working state; and updating the control functions of the plurality of physical controls based on the second function information.

9. The method according to claim 8, wherein The working state includes a preparation state, an inspection state, and an end state; when the working state is the preparation state, the first type of function control includes at least one inspection task information control for performing task information prompts; When the working state is the inspection state, the first type of function control includes at least one device regulation control for regulating the endoscope handle device and / or the second display screen of the endoscope system; when the working state is the end state, the first type of function control includes at least one report generation control for performing information export and report generation.

10. The method according to claim 9, characterized in that, The inspection task information control includes a patient information control and a doctor information control, the device regulation control includes a light source brightness adjustment control and a mode adjustment control, and the report generation control includes an image export control and a report generation control.

11. An endoscope system, characterized in that, It includes a processor, a first display screen, an endoscope insertion end, a memory, and one or more programs. The one or more programs are stored in the memory and are configured to be executed by the processor. The one or more programs include instructions for performing the steps in the method according to any one of claims 1-10; the first display screen is used to respond to the processor; the endoscope insertion end is used to collect real-time images.

Images