Endoscope image display method and endoscope system

Abstract

The invention provides an endoscope image display method and an endoscope system, and the method comprises the steps that a processor of the endoscope system receives a first mode instruction, and the first mode instruction is used for indicating to start an immersion mode; and in response to the first mode instruction, only displaying the real-time picture or only displaying the real-time picture and associated picture information in at least part of pages of the first display screen, and simultaneously displaying at least one interface element in the second display screen. Therefore, related information contents in the first display screen for displaying real-time pictures can be synchronously transferred to the second display screen according to user instructions, so that the first display screen reaches the purity degree required by a user, the second display screen displays the related information contents, the surgical field picture purity degree can be improved, the cognitive load of surgery or examination is reduced, and the user experience is improved. And the user still can intuitively obtain related information contents, so that the user experience is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of medical devices, and in particular, to an endoscope image display method and an endoscope system. Background Art

[0002] An endoscope system generally includes devices such as a processor, a main display screen, and an endoscope insertion end. In the current display mode, not only real-time images but also a considerable amount of relevant information or other image elements need to be displayed on the main display screen. The relevant information and other images displayed on the main display screen may change at any time, resulting in an impure surgical field image, distracting the user's attention, and increasing the cognitive load during surgery or examination. Summary of the Invention

[0003] Embodiments of the present application provide an endoscope image display method and an endoscope system, which can switch the surgical field image to a pure image, help improve the purity of the surgical field image, reduce the cognitive load during surgery or examination, and improve the user experience.

[0004] In a first aspect, embodiments of the present application provide an endoscope image display method, which is applied to a processor of an endoscope system. The endoscope system further includes an endoscope insertion end, an endoscope host, and a display device. The endoscope insertion end is used to insert into the body of a detection object to collect real-time images of the detection site; the endoscope host is internally provided with the processor and components that cooperate with the endoscope insertion end when performing the current detection task; the display device includes a first display screen and a second display screen; the method includes:

[0005] Receiving a first mode instruction for instructing to turn on the immersive mode;

[0006] Responding to the first mode instruction, only displaying real-time images or only displaying real-time images and associated image information on at least part of the pages of the first display screen, and simultaneously displaying at least one interface element on the second display screen, where the interface element includes a first display item for presenting time information of the current detection task, a second display item for presenting detection object information of the current detection task, a third display item for presenting component status information inside the endoscope host, a fourth display item for presenting external device status information, a fifth display item for presenting image information associated with the real-time image, or a preview display item for displaying captured images.

[0007] In a possible embodiment, at least part of the function controls for controlling the endoscope insertion end, at least part of the function controls for controlling internal components of the endoscope host, or at least one of at least part of the function controls for controlling external devices is also simultaneously displayed on the second display screen.

[0008] In a possible embodiment, the second display screen includes a main page and a switching page. The main page is used to display at least one of the interface elements. The switching page is used to be retrieved by a switching operation instruction and display at least one of at least some function controls for manipulating the insertion end of the endoscope, at least some function controls for manipulating internal components of the endoscope main unit, or at least some function controls for manipulating an external device.

[0009] In a possible embodiment, a physical button for adjusting the real-time picture size is provided on the insertion end of the endoscope or the endoscope main unit, or a function control for adjusting the real-time picture size is synchronously displayed on the second display screen; the method further includes:

[0010] In response to the physical button for adjusting the real-time picture size or the function control for adjusting the real-time picture size, enlarge or reduce the display size of the real-time picture on the first display screen.

[0011] In a possible embodiment, the first display screen includes an original size page, a partial magnification page, and a full-screen display page for displaying the real-time picture; the enlarging or reducing the display size of the real-time picture on the first display screen in response to the physical button for adjusting the real-time picture size or the function control for adjusting the real-time picture size includes:

[0012] In response to the physical button for adjusting the real-time picture size or the function control for adjusting the real-time picture size, sequentially switch between the original size page, the partial magnification page, and the full-screen display page.

[0013] In a possible embodiment, while sequentially switching between the original size page, the partial magnification page, and the full-screen display page in response to the physical button for adjusting the real-time picture size or the function control for adjusting the real-time picture size, the interface elements and page layout of the second display screen remain unchanged.

[0014] In a possible embodiment, in response to the first mode instruction, in at least one page of the first display screen, in addition to displaying the real-time picture, a preview display item for displaying the captured image is further included.

[0015] In a possible embodiment, before receiving the first mode instruction, it includes:

[0016] Obtain the working state of the insertion end of the endoscope, where the working state includes an access state;

[0017] If the working state is the access state, obtain the first mode switching instruction.

[0018] In a possible embodiment, it further includes:

[0019] Obtain the working state of the insertion end of the endoscope, where the working state includes a pulled-out state;

[0020] If the working state is the pulled-out state, exit the immersive mode and display the original layout on the first display screen.

[0021] In a second aspect, an endoscope system provided by an embodiment of the present application includes an endoscope insertion end, an endoscope host, and a display device. The endoscope host includes a processor, a memory, and one or more programs. The one or more programs are stored in the memory and are configured to be executed by the processor. The one or more programs include instructions for performing the steps in the method described in any of the above aspects; the first display screen is used to respond to the processor.

[0022] By implementing the embodiments of the present application, the processor of the endoscope system receives a first mode instruction for instructing to turn on the immersive mode; in response to the first mode instruction, only the real-time image or only the real-time image and the associated image information are displayed on at least part of the pages of the first display screen, and at least one interface element is simultaneously displayed on the second display screen, where the interface element includes a first display item for presenting the time information of the current detection task, a second display item for presenting the detection object information of the current detection task, a third display item for presenting the component status information inside the endoscope host, a fourth display item for presenting the external device status information, a fifth display item for presenting the image information associated with the real-time image, or a preview display item for displaying the captured images. In this way, the relevant information content in the first display screen for displaying the real-time image can be synchronously transferred to the second display screen according to the user instruction, so that the first display screen reaches the required purity level for the user, and the second display screen displays the relevant information content, which is beneficial to improving the purity of the surgical field image, reducing the cognitive load of the surgery or examination, and the user can still intuitively obtain the relevant information content, improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the background art, the drawings required to be used in the embodiments of the present invention or the background art will be described below.

[0024] Figure 1a The system architecture diagram of an endoscope system provided by an embodiment of the application;

[0025] Figure 1b It is another system architecture diagram of an endoscope system provided by an embodiment of the present application;

[0026] Figure 1c It is a schematic structural diagram of an endoscope host provided by an embodiment of the present application;

[0027] Figure 1d It is a schematic structural diagram of another endoscope host provided by an embodiment of the present application;

[0028] Figure 2 It is a schematic flowchart of a method for displaying an endoscope image provided by an embodiment of the present application;

[0029] Figure 3a It is a schematic diagram of an operation scenario for displaying an endoscope image provided by an embodiment of the present application;

[0030] Figure 3b It is a schematic diagram of the interfaces of a first display screen and a second display screen provided by an embodiment of the present application;

[0031] Figure 4a It is a schematic diagram of the interface of the first immersive mode provided by an embodiment of the present application;

[0032] Figure 4b It is a schematic diagram of the interface of the second immersive mode provided by an embodiment of the present application;

[0033] Figure 4c It is a schematic diagram of the interface of the second display screen in the first immersive mode provided by an embodiment of the present application;

[0034] Figure 4d It is a schematic diagram of the interface of the second display screen in the second immersive mode provided by an embodiment of the present application;

[0035] Figure 5a It is a schematic diagram of the screen of the first display screen in the first immersive mode proposed by an embodiment of the present application;

[0036] Figure 5b It is a schematic diagram of the screen of the first display screen in the second immersive mode proposed by an embodiment of the present application;

[0037] Figure 6a It is a schematic diagram of the interfaces of the first display screen and the second display screen in the first immersive mode provided by an embodiment of the present application;

[0038] Figure 6b It is a schematic diagram of the interfaces of the first display screen and the second display screen in the second immersive mode provided by an embodiment of the present application;

[0039] Figure 7 It is a schematic structural diagram of an endoscope image display device provided by an embodiment of the present application;

[0040] Figure 8It is a schematic structural diagram of another endoscopic image display device provided by an embodiment of the present application. Detailed implementation manners

[0041] In order to enable those skilled in the art to better understand the solution of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0042] The terms "first", "second", etc. in the description and claims of the present application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or electronic device that includes a series of steps or units is not limited to the listed steps or units, but also includes unlisted steps or units in an alternative example, or other steps or units inherent to these processes, methods, products or electronic devices in an alternative example.

[0043] Referring to "embodiment" herein means that a specific feature, structure or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The phrase appears in various places in the specification and does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.

[0044] An endoscopic system generally includes devices such as a processor, a main display screen, an endoscopic insertion end, and a control screen. In the current display mode, not only real-time images but also a considerable amount of relevant information or other image elements need to be displayed on the main display screen. The relevant information and other images displayed on the main display screen may change at any time, resulting in an impure surgical field image, distracting the user's attention, and increasing the cognitive load during surgery or examination.

[0045] In view of the above problems, an endoscopic image display method and an endoscopic system are provided in an embodiment of the present application. The method includes: a processor of the endoscopic system receives a first mode instruction for indicating to turn on the immersive mode; in response to the first mode instruction, only a real-time image or only the real-time image and associated image information are displayed on at least part of the pages of the first display screen, and at least one interface element is simultaneously displayed on the second display screen, where the interface element includes a first display item for presenting the time information of the current detection task, a second display item for presenting the detection object information of the current detection task, a third display item for presenting the component status information inside the endoscopic host, a fourth display item for presenting the external device status information, a fifth display item for presenting the image information associated with the real-time image, or a preview display item for displaying the captured image. In this way, the relevant information content on the first display screen for displaying the real-time image can be synchronously transferred to the second display screen according to the user instruction, so that the first display screen reaches the desired purity level for the user, and the second display screen displays the relevant information content, which is beneficial to improving the purity of the surgical field image, reducing the cognitive load during the operation or examination, and the user can still intuitively obtain the relevant information content, improving the user experience.

[0046] The endoscopic image display method and the endoscopic system provided in the embodiments of the present application can be applied to an endoscopic system as shown in Figure 1a and Figure 1b Please refer to Figure 1a , Figure 1a FIG. Figure 1a is a system architecture diagram of an endoscopic system provided in an embodiment of the present application. As shown in

[0047] Among them, an image acquisition device, such as a micro camera, is built into the endoscope insertion end 120, which can acquire real-time image data inside the human body or the object to be inspected. These image data will be transmitted to the endoscope main unit 110 through a specific transmission cable or wireless transmission method. The endoscope main unit 110 is responsible for providing necessary power supply for the endoscope insertion end 120 to ensure that components such as the image acquisition device inside it can work properly. At the same time, the endoscope main unit 110 can also send control signals to the endoscope insertion end 120, such as controlling parameters such as the focal length, aperture, and white balance of the camera at the insertion end to obtain clear and accurate images. The endoscope main unit 110 processes the image data received from the endoscope insertion end 120, including operations such as image decoding, noise reduction, enhancement, and color correction, and transmits the processed image data to the first display screen 131 for display. The first display screen 131 can be the main display screen, usually having a relatively large size and high resolution, and can clearly display the real-time image inside the human body or the object being observed collected by the endoscope insertion end, providing intuitive visual information for operators such as doctors to facilitate observation and diagnosis. The endoscope main unit 110 may include at least one processor, which can be an image processor and a processor. The second display screen 132 serves as a control screen for operating the endoscope main unit or multiple processors, mainly used to display the operation interface and related parameter setting options. The second display screen 132 can also display the working status information of the endoscope main unit 110, multiple processors, external devices, etc., such as the currently running image processing tasks, system resource occupancy, device connection status, image status, etc. The first display screen 131 is mainly used to display real-time images, providing an intuitive visual observation window for operators; the second display screen 132 is mainly used for operation and control, providing an operation interface and parameter setting function. In some cases, the second display screen 132 can also perform image display and operations on the image, such as zooming in and out. In some cases, the second display screen 132 can also be integrated into other devices or be a separate device without being set on the endoscope main unit 110.

[0048] Please refer to Figure 1b , Figure 1b which is the system architecture diagram of another endoscope system provided by an embodiment of the present application. As Figure 1b shown, the endoscope main unit 110 includes a processor 111. The endoscope system 100 includes: an endoscope main unit 110, a processor 111, an endoscope insertion end 120, and a display device 130. Among them, the display device 130 includes a first display screen 131 and a second display screen 132.

[0049] Among them, the processor 111 generally refers to a chip or module with data processing and computing capabilities. The endoscope host may be built-in with a dedicated processor for controlling the overall operation of the host, coordinating the work among various components, such as managing data transmission and interaction with the image processor, display screen, operation panel, etc. At the same time, it also generates control signals according to system settings and operation instructions and sends them to the endoscope insertion end 120 to adjust its working state. The processor 111 is also used to control and make decisions on the display content of the first display screen 131 and the second display screen 132.

[0050] Please refer to Figure 1c , Figure 1c which is a schematic structural diagram of an endoscope host provided by an embodiment of the present application. As Figure 1c shown, the endoscope host 110 includes a processor 111, a memory 112, a communication interface 113, a second display screen 132, and one or more programs 1121. Among them, the one or more programs 1121 are stored in the above-mentioned memory 112 and are configured to be executed by the above-mentioned processor 111. The one or more programs 1121 include instructions for executing any step in the following method embodiments. In a specific implementation, the processor 111 is used to execute any step in the following method embodiments, and when performing data transmission processes such as receiving and sending, the communication interface 113 can be selectively called to complete the corresponding operations. When performing operations such as displaying, it can be completed by the second display screen 132. Since the first display screen 131 is an external display screen outside the endoscope host 110, it can also be used for display operations.

[0051] Please refer to Figure 1d , Figure 1d which is a schematic structural diagram of another endoscope host provided by an embodiment of the present application. As Figure 1d shown, the endoscope host 110 includes a processor 111, a memory 112, a communication interface 113, and one or more programs 1121. Among them, the one or more programs 1121 are stored in the above-mentioned memory 112 and are configured to be executed by the above-mentioned processor 111. The one or more programs 1121 include instructions for executing any step in the following method embodiments. In a specific implementation, the processor 111 is used to execute any step in the following method embodiments, and when performing data transmission such as sending and receiving, the communication interface 113 can be selectively called to complete the corresponding operations.

[0052] Please refer to Figure 2 , Figure 2It is a schematic flowchart of an endoscopic image display method provided by an embodiment of the present application. This method is applied to a processor of an endoscopic system, and the endoscopic system further includes an endoscopic insertion end, an endoscopic host, and a display device. The endoscopic insertion end is used to be inserted into the body of a detection object to collect a real-time image of a detection site; the endoscopic host internally is provided with the processor and components that cooperate with the endoscopic insertion end when performing the current detection task; the display device includes a first display screen and a second display screen; As Figure 2 shown, the method includes the following steps:

[0053] S210, receive a first mode instruction, where the first mode instruction is used to indicate to turn on the immersive mode.

[0054] Among them, the immersive mode is an optional display mode built into the system, which is controlled to be turned on or exited by responding to the first mode instruction. The first mode instruction can be an automatically generated conditional instruction or an obtained operation instruction. The above-mentioned automatically generated conditional instruction can be an instruction generated when starting up or an instruction preset to be generated under a certain condition. For example, when it is detected that a certain external device is connected, the first mode instruction is generated and received by the processor.

[0055] In a possible embodiment, please refer to Figure 3a , Figure 3a It is a schematic diagram of an operation scenario of endoscopic image display provided by an embodiment of the present application. Before the step of receiving the first mode instruction, the method further includes: displaying a first control on the first display screen and / or the second display screen; receiving a first trigger instruction based on the first control, where the first trigger instruction is used to generate the first mode instruction. Among them, the first control for interacting with the user to obtain the user instruction can be displayed on both the first display screen and the second display screen. When the user clicks the first control, the first mode instruction is generated to turn on the immersive mode.

[0056] Among them, on the first display screen of the device, or the second display screen, or possibly both display screens, the first control will appear. It is used to interact with the user. When the user clicks this first control, the device will receive an instruction, that is, the first trigger instruction. The role of the first trigger instruction is to generate the first mode instruction to achieve the function of turning on the immersive mode.

[0057] In a possible embodiment, the endoscope system further includes a handle device, which has a connection relationship with the insertion end of the endoscope. Since the insertion end of the endoscope has a connection relationship with the processor, the handle device and the processor have a connection relationship through the insertion end of the endoscope. The handle device is provided with a plurality of physical controls, and the handle device is used for the user to perform the current detection task and obtain user instructions. Before the step of receiving the first mode instruction, the method further includes: receiving a second trigger instruction based on the physical control, and the second trigger instruction is used to generate the first mode instruction.

[0058] Among them, there are a plurality of physical controls on the handle device, such as buttons, joysticks, etc. In some cases, some functions of these physical controls can be used to perform the current detection task, such as controlling the insertion, turning, grasping, etc. of the insertion end of the endoscope through the handle device; some functions can be used to implement certain functions and obtain user instructions, that is, the user can convey the intention of turning on the immersive mode to the device by pressing the physical controls on the handle. After the user presses certain physical controls on the handle, a second trigger instruction will be generated.

[0059] In a possible embodiment, before receiving the first mode instruction, it includes: obtaining the working state of the insertion end of the endoscope, and the working state includes an access state; if the working state is the access state, then obtain the first mode switching instruction.

[0060] Among them, the insertion end of the endoscope can be connected to the endoscope host. When the insertion end of the endoscope is connected to the endoscope host, the working state of the insertion end of the endoscope is the access state. When the insertion end of the endoscope is not connected to the endoscope host, the working state of the insertion end of the endoscope is the unplugged state. The immersive mode can be automatically turned on or off based on the working state of the insertion end of the endoscope. When the working state is the access state, a first mode switching instruction will be generated, and the processor can obtain this first mode switching instruction and turn on the immersive mode.

[0061] In a possible embodiment, obtain the working state of the insertion end of the endoscope, and the working state includes the unplugged state; if the working state is the unplugged state, then exit the immersive mode and display the original layout on the first display screen.

[0062] Among them, if it has been in the unplugged state, the original layout can be maintained. In this case, other instructions for starting the immersive mode can also be obtained, such as obtaining the first mode switching instruction through a control.

[0063] In a possible embodiment, before receiving the first mode instruction, the method further includes: receiving a first gesture operation instruction of the first display screen and / or the second display screen, the first gesture operation instruction being used to generate the first mode instruction, the first mode instruction being used to indicate to turn on the immersive mode, and if a first gesture operation instruction is detected, turning on the immersive mode, wherein the gesture operation instruction is generated by a user's gesture operation, and the gesture operation includes swiping right or swiping left.

[0064] In a possible embodiment, at least one of the first display screen and the second display screen displays a second control. When a third trigger instruction of the second control is detected, a mode setting interface is displayed on at least one of the first display screen and the second display screen. The mode setting interface is used to interact with the user, and a selection control for obtaining the user's willingness to turn on the immersive mode is displayed on the display mode interface. Specifically, it may include a first selection control and a second selection control. The first selection control is used to indicate to turn on the immersive mode, and the second selection control is used to indicate to exit the immersive mode. The selection control is a function setting selection that is not initialized with the device power on and off. Detect a selection operation of the user on the selection control, specifically a click operation. When the user selects the first selection control, record the selection state of the immersive mode. When the endoscope system is powered on again after being powered off, detect and obtain the previously recorded selection state of the immersive mode, and keep the device in the immersive mode for interface display. When the user turns on the endoscope system and is currently in the state where the immersive mode is turned on, if the user wants to exit the immersive mode, the user can operate on the second selection control by clicking the second control again to exit the immersive mode.

[0065] In a possible embodiment, the method further includes: displaying a third control on at least one of the first display screen and the second display screen; receiving a third trigger instruction based on the third control, the third trigger instruction being used to generate a second mode instruction, the second mode instruction being used to indicate to exit the immersive mode; and in response to the second mode instruction, displaying a preset first original layout on the first display screen and a preset second original layout on the second display screen.

[0066] Wherein, the third control can be displayed on the first display screen, on the second display screen, or on both the first display screen and the second display screen, and is used to receive a second mode instruction for the user to exit the immersive mode. When a click operation of the user on the third control is detected, in response to the second mode instruction, exit the immersive mode; exiting the immersive mode means displaying the layout before turning on the immersive mode on the first display screen and the second display screen, that is, restoring the original layout, and the original layout is a preset second original layout.

[0067] In a possible embodiment, the method further includes: receiving a fourth trigger instruction based on the entity control, where the fourth trigger instruction is used to generate the second mode instruction.

[0068] In a possible embodiment, the method further includes: receiving a second gesture operation instruction of the first display screen and / or the second display screen, where the second gesture operation instruction is used to generate the second mode instruction, and the second mode instruction is used to indicate exiting the immersive mode. If a second gesture operation instruction is detected, the immersive mode is exited. Wherein, the gesture operation instruction is generated by a user's gesture operation, and the gesture operation includes swiping right or swiping left. It should be noted that if the first gesture operation instruction for enabling the immersive mode is preset to swipe left, then the second gesture operation instruction for exiting the immersive mode is preset to swipe right; if the first gesture operation instruction for enabling the immersive mode is preset to swipe right, then the second gesture operation instruction for exiting the immersive mode is preset to swipe left. The gesture operation can be other operations, such as swiping up, swiping down, etc., which are not limited herein.

[0069] It should be noted that in the above method of enabling the immersive mode by obtaining the first control, detecting the working state of the endoscopic insertion end, the entity control of the handle device, the second control mode setting, and the gesture operation method, and in the above method of exiting the immersive mode by obtaining the third control, detecting the working state of the endoscopic insertion end, the entity control of the handle device, the second control mode setting, and the gesture operation method, the method of enabling the immersive mode includes at least one of the above, the method of exiting the immersive mode includes at least one of the above, and the above methods of enabling the immersive mode and exiting the immersive mode can be combined.

[0070] It should be noted that for enabling the immersive mode through the first control, the entity control of the handle device, the second control mode setting method, and the gesture operation, the immersive mode can be successfully enabled only when the endoscopic insertion end and / or the endoscopic handle device are normally connected to the endoscopic host. If the endoscopic insertion end and / or the endoscopic handle device are not connected to the endoscopic host, or the endoscopic insertion end and / or the endoscopic handle device cannot be used normally, then it may not be possible to successfully enable the immersive mode through the first control, the entity control of the handle device, and the second control mode setting. In this case, if the endoscopic insertion end and / or the endoscopic handle device are not connected to the endoscopic host, or the endoscopic insertion end and / or the endoscopic handle device cannot be used normally resulting in the failure to successfully enable the immersive mode, a display prompt information text box is popped up on at least one of the first display and the second display to prompt the user to connect the endoscopic insertion end and / or the endoscopic handle device, or that the endoscopic insertion end and / or the endoscopic handle device cannot be used normally.

[0071] It should be noted that, in order to ensure a reasonable response when multiple ways of entering and exiting immersive mode are triggered simultaneously, a priority rule is preset. For example, the operation priority of the physical control of the handle device is higher than that of the first control, and the priority of identifying the working state of the insertion end of the endoscope is lower than the priority of the second control mode setting. The specific priority order can be flexibly adjusted according to the actual usage scenario of the system and user needs. This is only an example here and is not limited herein.

[0072] For example, during an actual endoscopy examination, the user initially selects to automatically enter immersive mode at startup through the setting module. During the examination, it is necessary to temporarily exit the immersive mode, so the user presses the physical control (exit button) on the handle device to exit the immersive mode, or swipes right to exit the immersive mode. Then, in order to observe a suspicious area more clearly, he presses the physical control (start button) on the handle device to enter immersive mode again, or presses the first control on the second screen to enter immersive mode again. Throughout the process, the endoscope system responds accurately and quickly to each operation, providing the user with an efficient and convenient operation experience, and greatly improving the quality and efficiency of endoscopy examinations.

[0073] It can be seen that through the above embodiments of entering or exiting immersive mode, by setting convenient controls, or options for automatic entry or automatic exit, or by identifying the connection status of external devices to enter and exit immersive mode, it is convenient for users to use, improves the efficiency of immersive mode, and is beneficial to improving the user experience.

[0074] Among them, please refer to Figure 3b , Figure 3b is a schematic diagram of the interfaces of a first display screen and a second display screen provided by an embodiment of the present application. As Figure 3bAs shown, when the immersive mode is not enabled, in addition to the first control and the second control, the first display screen also displays a live video, a folding information control, and multiple interface elements. The folding information control is used to display the video information of the current detection task. The video information may include at least one of MLI-1, MLI-2, SWI, HEI, peak photometry, average photometry, automatic photometry, ENH, color enhancement, electronic zoom, freeze, and light transmission. The above "MLI-1" and "MLI-2" are different video modes or parameter settings; "SWI" and "HEI" are specific function switches or parameters; "peak photometry", "average photometry", and "automatic photometry" are related to light measurement and display; "ENH" refers to the enhancement function, and "color enhancement" and "electronic zoom" are functions for processing the color and size of the video; "freeze" is used to freeze the video, and "light transmission" may be a function for adjusting the video transparency. The interface elements may specifically include those for presenting the time information of the current detection task, those for presenting the detection object information of the current detection task, those for presenting the component status information inside the endoscope host, those for presenting the external device status information, and those for presenting the video information associated with the live video, etc. The above information may be displayed in a foldable information display interface or directly in the form of a text box, etc. When a click operation on the folding information control is detected, the folded information display interface is expanded to display information content including at least the above information. The first display screen also displays a first video frame for displaying the live detection video, and in some cases, a second video frame for displaying the thumbnail of the historical video of the captured video. The second display screen is used to display multiple function controls. The multiple function controls include at least one of the function controls for manipulating the insertion end of the endoscope, the function controls for manipulating the internal components of the endoscope host, or the function controls for manipulating the external device. Among the multiple function controls, there may also be fixed function controls and variable function controls. The fixed function controls and the variable function controls are set in different areas of the display interface of the second display screen. The fixed function controls may include a light adjustment control, an air pump adjustment control, etc. The position layout of the fixed function controls may not change with the enabling or exiting of the immersive mode. In some possible cases, Figure 3b The display interfaces of the first display screen and the second display screen shown may be the original layout. That is, when the immersive mode is not enabled, the first display screen and the second display screen may be in the Figure 3b interface shown as the original layout.

[0075] S220. In response to the first mode instruction, only the live video or only the live video and the associated video information are displayed on at least part of the pages of the first display screen, and at least one interface element is simultaneously displayed on the second display screen.

[0076] The interface elements include a first display item for presenting the time information of the current detection task, a second display item for presenting the detection object information of the current detection task, a third display item for presenting the component status information inside the endoscope host, a fourth display item for presenting the external device status information, a fifth display item for presenting the picture information associated with the real-time picture, or a preview display item for displaying the captured images. Among them, the above-mentioned time information of the current detection task, the detection object information of the current detection task, the component status information for presenting inside the endoscope host, the external device status information for presenting, the picture information associated with the real-time picture for presenting, and the preview display item for displaying the captured images are at least displayed on the first display screen when the immersive mode is not enabled.

[0077] Among them, the detection object information of the current detection task may include at least one of the patient's name, patient ID, patient gender, patient date of birth, and patient age. The component status information inside the endoscope host may include the air pump status, light status, etc. The external device status information may include at least one of the endoscope model, serial number, quick button, channel indication, and other external devices.

[0078] Among them, please refer to Figure 4a and Figure 4b , Figure 4a is the interface schematic diagram of the first immersive mode provided by the embodiment of the present application, Figure 4b is the interface schematic diagram of the second immersive mode provided by the embodiment of the present application. As Figure 4a and Figure 4b shown, the immersive mode further includes a first immersive mode and a second immersive mode. As Figure 4a and Figure 4b shown, in the first immersive mode, at least part of the page of the first display screen only displays the real-time picture. As Figure 4b shown, in the second immersive mode, at least part of the page of the first display screen displays the real-time picture and the associated picture information. The above-mentioned associated picture information. Specifically, in the first immersive mode, the second display screen also displays at least one historical picture. In the second immersive mode, the first display screen also displays at least one historical picture. The historical picture is a picture saved by the user for the real-time picture, and can specifically be a video or a picture. The second display screen displays the above-mentioned interface elements in both the first immersive mode and the second immersive mode.

[0079] Among them, the screen information may include at least one of MLI-1, MLI-2, SWI, HEI, peak photometry, average photometry, automatic photometry, ENH, color enhancement, electronic zoom, freeze, and light transmission. The above "MLI-1" and "MLI-2" are different screen modes or parameter settings; "SWI" and "HEI" are specific function switches or parameters; "peak photometry", "average photometry", and "automatic photometry" are related to light measurement and display; "ENH" refers to the enhancement function, and "color enhancement" and "electronic zoom" are functions for processing the color and size of the screen; "freeze" is used to freeze the screen, and "light transmission" may be a function for adjusting the screen transparency. These functions are generally used to adjust the display effects and parameters of the device output screen. In the first immersive mode, the screen information is displayed in the form of interface elements on the second display screen; in the second immersive mode, the screen information is hidden in the form of a hidden information list on the first display screen, and a screen information control is set on the first display screen. When a click operation on the screen information space by the user is detected, an information list is displayed, and this list is used to display at least one of the above screen information.

[0080] Among them, the switching selection between the first immersive mode and the second immersive mode can be preset. Specifically, at least one of the first display screen or the second display screen can call out a setting module, and the setting module is used for mode setting, etc. In the setting module, the immersive mode can be selected. When an immersive mode is selected and confirmed, the current immersive mode is changed to the selected immersive mode, and before the next regulation, the enabled immersive mode is selected as the immersive mode selected by the setting module. For example, in the setting module, the immersive mode is selected as the first immersive mode and confirmed. If the immersive mode is currently enabled, it is changed to the first immersive mode, and in subsequent times when the immersive mode is enabled, it is also displayed as the first immersive mode.

[0081] In a possible embodiment, after the immersive mode is enabled, at least one of at least some function controls for manipulating the insertion end of the endoscope, at least some function controls for manipulating the internal components of the endoscope host, or at least some function controls for manipulating an external device are also displayed on the second display screen.

[0082] Among them, this part of the function controls is displayed on the second display screen when the immersive mode is not enabled and is used for manipulating devices such as the insertion end of the endoscope, the endoscope host, and the external device. After the immersive mode is enabled, the above function controls can be hidden or displayed. The above "at least some" means that at least one of all the function controls displayed on the second display screen, that is, at least one function control for manipulating the insertion end of the endoscope, at least one function control for manipulating the internal components of the endoscope host, or at least one function control for manipulating the external device.

[0083] Among them, the display interface of the second display screen can be divided into multiple regions. Among them, the first region can be used to display the above-mentioned multiple function controls, and the second region can be used to display the above-mentioned at least one interface element. The above-mentioned multiple regions can be multiple regions divided on one interface, or can be paged, with different regions divided on different pages.

[0084] It can be seen that in this embodiment, when the immersive mode is turned on or off, the second display screen can display multiple function controls for operation, which can ensure that the normal operation of the endoscope system is not affected when the immersive mode is turned on, facilitating user use and improving the user experience.

[0085] In some possible embodiments, the display interface of the second display screen is divided into at least two regions, including a first region and a second region. The first region is used to display at least one interface element, where the interface element includes a first display item for presenting the time information of the current detection task, a second display item for presenting the detection object information of the current detection task, a third display item for presenting the component status information inside the endoscope host, a fourth display item for presenting the status information of the external device, a fifth display item for presenting the picture information associated with the real-time picture, or a preview display item for displaying the captured image; the second region is used to display at least one function control.

[0086] Among them, it also includes determining the display effects of the first region and the second region, which can specifically include at least one of the following: the first region occupies a larger display area of the display interface; and / or different borders and / or background colors are added to the first region and the second region, and / or, the colors, sizes, shapes, and transparencies of the multiple interface elements in the first region are changed. It should be noted that the first region can be an overall region or can include multiple scattered regions; the second region can be an overall region or can include multiple scattered regions.

[0087] For example, the first area may occupy three-fifths of the upper left area of the display interface of the second display screen, and the remaining two-fifths of the right area is the second area, which conforms to the user's browsing habits from top to bottom and from left to right. In some cases, the first area may use a more prominent color as the border color, such as yellow, while the second area may not change its color to highlight the first area. In some possible cases, the first area may use a prominent but not glaring color as the background color to display interface elements, such as yellow, green, etc., and the second area may use gray or white as the background color. In some possible cases, the area of each interface element in the first area can be adjusted to be larger than the area of the function control. In some cases, the transparency of the interface elements can be appropriately reduced to make them look clearer and more real. The interface elements can also be made to have a certain sense of hierarchy and stand out from the background by adding shadows or borders, etc. When not being operated, the function controls can be set to a lower transparency, and when the user touches them, the transparency is increased to highlight their operability.

[0088] It can be seen that in the embodiment of the present application, when the immersive mode is turned on, the second display screen can prominently display the interface elements, so that the interface elements can also be easily captured by the user on the second display screen, and it can ensure that the normal viewing of the interface elements is not affected when the immersive mode is turned on, and the operation is simple, the interface is clearly divided, which is convenient for the user to use and improves the user experience.

[0089] In a possible embodiment, the second display screen includes a main page and a switching page. The main page is used to display at least one of the interface elements. The switching page is used to be retrieved through a switching operation instruction and display at least one of at least part of the function controls for controlling the insertion end of the endoscope, at least part of the function controls for controlling the internal components of the endoscope host, or at least part of the function controls for controlling the external device.

[0090] Among them, please refer to Figure 4c and Figure 4d , Figure 4c is a schematic diagram of the interface of the second display screen in a first immersive mode provided by the embodiment of the present application, Figure 4d is a schematic diagram of the interface of the second display screen in a second immersive mode provided by the embodiment of the present application, as Figure 4c and Figure 4dAs shown, after the immersive mode is enabled, the second display screen displays multiple paged pages, specifically including a main page and a switching page. When displaying, the main page is displayed first, and the switching page is hidden before or after the current main page. The above function controls can be displayed on other pages in the second display screen. The home page is used to display the above multiple interface elements. When a switching operation instruction for the switching page is detected, the page switches from the main page to the switching page, that is, the page that displays the above multiple function controls. The above switching operation instruction can be generated by the switching page operation, and the above switching page operation can be a page sliding; for example, when currently on the main page, when a left-sliding gesture operation of the user is detected, the page switches to the next page, that is, the switching page, and the display interface of the second page displays the above multiple function controls; when currently on the switching page of the second page, when a right-sliding gesture operation of the user is detected, the page switches to the previous page, that is, the main page, and the main page displays the above multiple interface elements. In the first immersive mode, the main page displays the display content corresponding to the first immersive mode, including interface elements and historical images. In the second immersive mode, the main page displays the display content corresponding to the second immersive mode, including interface elements.

[0091] It can be seen that in the embodiment of the present application, when the immersive mode is enabled, the second display screen can display interface elements on the home page, and the switching page can display multiple function controls for operation, which can ensure that the normal viewing of interface elements is not affected and the normal operation of the endoscope system is not affected when the immersive mode is enabled. Moreover, the operation is simple, the interface is clearly divided, which is convenient for users to use and improves the user experience.

[0092] In a possible embodiment, a physical button for adjusting the real-time picture size is provided on the endoscope insertion end or the endoscope host, or a function control for adjusting the real-time picture size is synchronously displayed on the second display screen; the method further includes: in response to the physical button for adjusting the real-time picture size or the function control for adjusting the real-time picture size, enlarging or reducing the display size of the real-time picture on the first display screen.

[0093] Among them, in the immersive mode, the real-time picture displayed on the first display screen can have multiple picture sizes, and the adjustment of the picture size can be performed by a physical button provided on the endoscope insertion end or the endoscope host, or by a function control for adjusting the real-time picture size on the second display screen. Specifically, the adjustment of the real-time picture size can be performed in both the first immersive mode and the second immersive mode. When a adjustment operation for the physical button or function control for real-time picture adjustment is detected, the picture size is changed based on the adjustment operation.

[0094] Specifically, the first display screen includes an original-size page for displaying a live video, a partial magnification page, and a full-screen display page; in response to a physical button for adjusting the size of the live video or a function control for adjusting the size of the live video, enlarging or reducing the display size of the live video on the first display screen includes: in response to the physical button for adjusting the size of the live video or the function control for adjusting the size of the live video, sequentially switching among the original-size page, the partial magnification page, and the full-screen display page.

[0095] Exemplarily, for example, a physical control is set. Pressing it once switches the video size once. If the preset order is the first-size page - the second-size page - the third-size page, the first-size page is displayed first. If it is detected that the physical control is pressed once, it switches to the second-size page. If it is detected that the physical control is pressed again, it switches to the third-size page. If it is detected that the physical control is pressed again, it switches to the first-size page, and so on in a cycle.

[0096] It can be seen that in this embodiment, by presetting multiple immersive-mode display sizes and allowing the self-adjustment of the video in multiple sizes, it is beneficial to improve the purity of the surgical field video based on the user's intention, reduce the cognitive load during surgery or examination, and improve the user experience.

[0097] In a possible embodiment, in response to the first-mode instruction, in at least one page of the first display screen, in addition to displaying the live video, a preview display item for displaying a captured image is further included.

[0098] Exemplarily, please refer to Figure 5a and Figure 5b , Figure 5a is a schematic diagram of the first display screen in a first immersive mode provided by an embodiment of the present application, Figure 5b is a schematic diagram of the first display screen in a second immersive mode provided by an embodiment of the present application. As shown in Figure 5a and Figure 5b , the video size includes multiple sizes, and the display page may include a first-size page, a second-size page, and a third-size page; among them, the first-size page may be a display of the video in the original size, with a small part cropped at the top and bottom, and there is a certain area of black border around the video, not a full-screen display; the second-size page may be a partial magnification page where the display area of the video is a larger cropped part. Compared with the first figure, its video size is larger and the border part is smaller; the third-size page may be a full-screen display page for displaying the live video in full screen. In the second immersive mode, at the first size, at least one preview display item for displaying a captured image is further set in the border part, and a video information control is set at the first size, the second size, and the third size.

[0099] It should be noted that the above first immersion mode and second immersion mode are default recommended layouts, and the sizes of each control, image frame, display screen, the information selected to be hidden, etc. can all be adjusted and configured to generate a custom layout.

[0100] It can be seen that in this embodiment, in the immersion mode, it is possible to select to display the preview display item of the captured image, or not to display the preview display item of the captured image. The preview display item of the captured image does not affect the display of the real-time screen, which can make the layout of the immersion mode more flexible and display content according to requirements, which is beneficial to improving the purity of the surgical field screen, reducing the cognitive load of surgery or examination, and improving the user experience.

[0101] In a possible embodiment, when responding to the physical button for adjusting the real-time screen size or the function control for adjusting the real-time screen size, and sequentially switching between the original size page, the partial magnification page, and the full-screen display page, the interface elements and page layout of the second display screen remain unchanged.

[0102] Among them, in the first immersion mode or the second immersion mode, the content displayed on the second display screen does not change with the change of the content of the screen size of the first display screen.

[0103] For example, please refer to Figure 6a and Figure 6b , Figure 6a is a schematic diagram of the interfaces of the first display screen and the second display screen in the first immersion mode provided by the embodiment of the present application; Figure 6b is a schematic diagram of the interfaces of the first display screen and the second display screen in the second immersion mode provided by the embodiment of the present application. As Figure 6a shown, in the first immersion mode, the first display screen includes displays of images of multiple sizes. The first display screen only displays the real-time screen, and the second display screen displays multiple interface elements. The interface elements include at least one type of displayed interface element, where the interface elements include a first display item for presenting the time information of the current detection task, a second display item for presenting the detection object information of the current detection task, a third display item for presenting the component status information inside the endoscope host, a fourth display item for presenting the status information of the external device, a fifth display item for presenting the picture information associated with the real-time screen, or a preview display item for displaying the captured image. As Figure 6bAs shown, in the second immersion mode, the first display screen includes displays of images of multiple sizes. The first display screen includes a display of a real-time image and image information controls, and in some cases, a preview display item of a captured image can be displayed. The second display screen displays multiple interface elements, and the interface elements include at least one type of interface element, where the interface elements include a first display item for presenting the time information of the current detection task, a second display item for presenting the detection object information of the current detection task, a third display item for presenting the component status information inside the endoscope host, a fourth display item for presenting the status information of an external device, and a fifth display item for presenting the image information associated with the real-time image. When the image size of the real-time image on the first display screen is switched to the second size or the third size, the preview display item of the captured image on the first display screen is hidden, and the preview display item of the captured image is additionally displayed on the second display screen.

[0104] It can be seen that in this embodiment, the first display screen can adjust the image size based on selection in the immersion mode, and the second display screen does not adjust its layout according to the image size of the first display screen in the immersion mode, which can enhance the consistency of the user experience, improve the coherence and stability of operations, is not prone to operating errors on the second display screen, reduce the distraction of the user's attention, and improve the user experience.

[0105] In this way, by implementing the embodiments of the present application, the processor of the endoscope system receives a first mode instruction for instructing to turn on the immersion mode; in response to the first mode instruction, only the real-time image or only the real-time image and associated image information are displayed on at least part of the pages of the first display screen, and at least one type of interface element is simultaneously displayed on the second display screen, where the interface elements include a first display item for presenting the time information of the current detection task, a second display item for presenting the detection object information of the current detection task, a third display item for presenting the component status information inside the endoscope host, a fourth display item for presenting the status information of an external device, a fifth display item for presenting the image information associated with the real-time image, or a preview display item for displaying a captured image. In this way, the relevant information content in the first display screen for displaying the real-time image can be synchronously transferred to the second display screen according to the user instruction, making the first display screen reach the required purity level for the user, and the second display screen displays the relevant information content, which is beneficial to improving the purity of the surgical field image, reducing the cognitive load during surgery or examination, and the user can still intuitively obtain the relevant information content, improving the user experience.

[0106] Please refer to Figure 7 , Figure 7It is a schematic structural diagram of an endoscopic image display device proposed in an embodiment of the present application. This device is applied to the processor of an endoscopic system, which further includes an endoscopic insertion end, an endoscopic host, and a display device. The endoscopic insertion end is used to insert into the body of a detection object to collect real-time images of the detection site. The endoscopic host internally is provided with the processor and components that cooperate with the endoscopic insertion end when performing the current detection task. The display device includes a first display screen and a second display screen. The endoscopic image display device 700 includes: a receiving module 710 and a response module 720. Among them, the receiving module 710 is used to receive a first mode instruction, and the first mode instruction is used to indicate to turn on the immersive mode. The response module 720 is used to respond to the first mode instruction, and only display the real-time image or only display the real-time image and associated image information on at least part of the pages of the first display screen, and display at least one interface element on the second display screen at the same time.

[0107] Among them, the interface elements include a first display item for presenting the time information of the current detection task, a second display item for presenting the detection object information of the current detection task, a third display item for presenting the component status information inside the endoscopic host, a fourth display item for presenting the external device status information, a fifth display item for presenting the image information associated with the real-time image, or a preview display item for displaying the captured images.

[0108] In a possible embodiment, at least one of at least part of the function controls for manipulating the endoscopic insertion end, at least part of the function controls for manipulating the internal components of the endoscopic host, or at least part of the function controls for manipulating the external device is also displayed on the second display screen at the same time.

[0109] In a possible embodiment, the second display screen includes a main page and a switching page. The main page is used to display at least one of the interface elements. The switching page is used to be retrieved through a switching operation instruction and display at least one of at least part of the function controls for manipulating the endoscopic insertion end, at least part of the function controls for manipulating the internal components of the endoscopic host, or at least part of the function controls for manipulating the external device.

[0110] In a possible embodiment, a physical button for adjusting the size of the real-time image is provided on the endoscopic insertion end or the endoscopic host, or a function control for adjusting the size of the real-time image is synchronously displayed on the second display screen. The response module 720 is specifically further used to: respond to the physical button for adjusting the size of the real-time image or the function control for adjusting the size of the real-time image, and enlarge or reduce the display size of the real-time image on the first display screen.

[0111] In a possible embodiment, the first display screen includes an original-size page, a partially enlarged page, and a full-screen display page for displaying a live video; when the response module 720 responds to a physical button for adjusting the size of the live video or a function control for adjusting the size of the live video and enlarges or reduces the display size of the live video on the first display screen, it is specifically further configured to: respond to the physical button for adjusting the size of the live video or the function control for adjusting the size of the live video, and sequentially switch among the original-size page, the partially enlarged page, and the full-screen display page.

[0112] In a possible embodiment, when the response module 720 responds to the physical button for adjusting the size of the live video or the function control for adjusting the size of the live video and sequentially switches among the original-size page, the partially enlarged page, and the full-screen display page, the interface elements and page layout of the second display screen remain unchanged.

[0113] In a possible embodiment, when the response module responds to the first mode instruction, in at least one page of the first display screen, in addition to displaying the live video, it further includes a preview display item for displaying a captured image.

[0114] In a possible embodiment, the receiving module 710 is specifically further configured to: obtain the working state of the insertion end of the endoscope, where the working state includes an access state; if the working state is the access state, then obtain the first mode switching instruction.

[0115] In a possible embodiment, the receiving module 710 is specifically further configured to: obtain the working state of the insertion end of the endoscope, where the working state includes a removal state; if the working state is the removal state, then exit the immersive mode and display the original layout on the first display screen.

[0116] It should be noted that, for the specific functional implementation manner of the endoscope image display device 700, refer to the description of the endoscope image display method shown above Figure 2 For example, the receiving module 710 is used to implement the relevant content of executing S210, and the response module 720 is used to implement the relevant content of executing S220. Each unit or module in the endoscope image display device 700 can be separately or wholly combined into one or several other units or modules to form, or a certain one (or some) of the units or modules can be further split into multiple smaller units or modules with functional division to form, which can achieve the same operation without affecting the realization of the technical effects of the embodiments of the present invention. The above units or modules are divided based on logical functions. In practical applications, the function of one unit (or module) is implemented by multiple units (or modules), or the functions of multiple units (or modules) are implemented by one unit (or module).

[0117] It can be seen that in the endoscopic image display device described in the embodiments of the present application, by receiving a first mode instruction for indicating to turn on the immersive mode, in response to the first mode instruction, only the real-time image or only the real-time image and the associated image information are displayed on at least part of the pages of the first display screen, and at least one interface element is simultaneously displayed on the second display screen, where the interface element includes a first display item for presenting the time information of the current detection task, a second display item for presenting the detection object information of the current detection task, a third display item for presenting the component status information inside the endoscopic host, a fourth display item for presenting the external device status information, a fifth display item for presenting the image information associated with the real-time image, or a preview display item for displaying the captured image. In this way, the relevant information content in the first display screen for displaying the real-time image can be synchronously transferred to the second display screen according to the user instruction, so that the first display screen reaches the required purity level for the user, and the second display screen displays the relevant information content, which is beneficial to improving the purity of the surgical field image, reducing the cognitive load of the operation or examination, and the user can still intuitively obtain the relevant information content, improving the user experience.

[0118] In the case of adopting an integrated unit, please refer to Figure 8 , Figure 8 FIG. is a schematic structural diagram of another endoscopic image display device proposed in the embodiments of the present application; as Figure 8 shown, the endoscopic image display device 700 includes: a communication module 701 and a processing module 702. The processing module 702 is used to control and manage the operations of the endoscopic image display device 700. For example, it executes the steps of the response module 720 and the receiving module 710, and / or is used to execute other processes of the technologies described herein. The communication module 701 is used for the interaction between the endoscopic image display device 700 and other devices. As Figure 8 shown, the endoscopic image display device 700 may further include a storage module 703, and the storage module 703 is used to store the program code and data of the endoscopic image display device 700.

[0119] Among them, the processing module 702 can be a processor or a controller. For example, it can be a Central Processing Unit (CPU), a general-purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logical blocks and modules described in connection with the disclosure of the present application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and so on. The communication module 701 can be a transceiver, an RF circuit, or a communication interface, etc. The storage module 703 can be a memory.

[0120] Among them, all relevant contents of each scenario involved in the above method embodiments can be cited in the function descriptions of the corresponding functional modules, and will not be elaborated here. The above endoscopic image display device 700 can execute the above Figure 2 shown endoscopic image display method.

[0121] The embodiments of the present application also provide a computer storage medium. Among them, the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute some or all of the steps of any one of the methods described in the above method embodiments. The above computer includes an electronic device.

[0122] The embodiments of the present application also provide a computer program product. The above computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the above computer program is operable to enable a computer to execute some or all of the steps of any one of the methods described in the above method embodiments. The computer program product can be a software installation package, and the above computer includes an electronic device.

[0123] It should be noted that for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should know that the present application is not limited by the described action sequence, because according to the present application, some steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to the present application.

[0124] In the above embodiments, the descriptions of the various embodiments have their respective focuses. For parts not detailed in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.

[0125] In several embodiments provided in the present application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the above division of units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed couplings or direct couplings or communication connections to each other can be through some interfaces. The indirect couplings or communication connections of devices or units can be in electrical or other forms.

[0126] The units described above as separate components may or may not be physically separated. The components displayed as units may or may not be physical units, that is, they can be located in one place, or they can be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0127] In addition, in each embodiment of the present application, the functional units can be integrated into a processing unit, or each unit can exist physically alone, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

[0128] If the above integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions for causing a computer electronic device (which can be a personal computer, an electronic device, or a network electronic device, etc.) to execute all or part of the steps of the above methods in each embodiment of the present application. And the aforementioned memory includes: various media such as USB flash drives, read-only memories (ROMs), random access memories (RAMs), mobile hard disks, magnetic disks, or optical discs that can store program codes.

[0129] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable memory, which may include: a flash drive, a read-only memory (abbreviation: ROM), a random access memory (abbreviation: RAM), a magnetic disk, an optical disk, etc.

[0130] The above embodiments of the present application have been introduced in detail. Specific examples are used in this article to elaborate on the principles and implementation manners of the present application. The description of the above embodiments is only used to help understand the method and its core idea of the present application; at the same time, for those of ordinary skill in the art, according to the idea of the present application, there will be changes in the specific implementation manners and application scopes. In summary, the content of this specification should not be construed as a limitation to the present application.

Claims

1. An endoscopic image display method, characterized in that, A processor applied to an endoscope system, the endoscope system further comprising an endoscope insertion end, an endoscope main unit, and a display device. The endoscope insertion end is configured to be inserted into the body of a detection object to collect real-time images of the detection site. The endoscope main unit is internally provided with the processor and components that cooperate with the endoscope insertion end when performing the current detection task. The display device includes a first display screen and a second display screen. The method includes: Receiving a first mode instruction for instructing to turn on the immersive mode. Responding to the first mode instruction, only displaying the real-time image or only displaying the real-time image and associated image information on at least part of the pages of the first display screen, and simultaneously displaying at least one interface element on the second display screen, where the interface element includes a first display item for presenting the time information of the current detection task, a second display item for presenting the detection object information of the current detection task, a third display item for presenting the component status information inside the endoscope main unit, a fourth display item for presenting the external device status information, a fifth display item for presenting the image information associated with the real-time image, or a preview display item for displaying the captured images.

2. The endoscopic image display method according to claim 1, characterized in that At least one of at least part of the function controls for manipulating the endoscope insertion end, at least part of the function controls for manipulating the internal components of the endoscope main unit, or at least part of the function controls for manipulating the external device is also simultaneously displayed on the second display screen.

3. The endoscopic image display method according to claim 1, wherein The second display screen includes a main page and a switching page. The main page is used to display at least one of the interface elements, and the switching page is used to be retrieved through a switching operation instruction and display at least one of at least part of the function controls for manipulating the endoscope insertion end, at least part of the function controls for manipulating the internal components of the endoscope main unit, or at least part of the function controls for manipulating the external device.

4. The endoscopic image display method according to claim 1, characterized in that, A physical button for adjusting the size of the real-time image is provided on the endoscope insertion end or the endoscope main unit, or a function control for adjusting the size of the real-time image is synchronously displayed on the second display screen. The method further includes: Responding to the physical button for adjusting the size of the real-time image or the function control for adjusting the size of the real-time image, enlarging or reducing the display size of the real-time image on the first display screen.

5. The endoscopic image display method according to claim 4, characterized in that, The first display screen includes an original size page, a partial magnification page, and a full-screen display page for displaying the real-time image. The responding to the physical button for adjusting the size of the real-time image or the function control for adjusting the size of the real-time image, enlarging or reducing the display size of the real-time image on the first display screen, includes: Responding to the physical button for adjusting the size of the real-time image or the function control for adjusting the size of the real-time image, sequentially switching between the original size page, the partial magnification page, and the full-screen display page.

6. The endoscopic image display method according to claim 5, characterized in that When the physical button for adjusting the real-time screen size or the function control for adjusting the real-time screen size is responded to, and the switching is sequentially performed among the original size page, the partial magnification page, and the full-screen display page, the interface elements and page layout of the second display screen remain unchanged.

7. The endoscopic image display method according to claim 1, wherein In response to the first mode instruction, in at least one page of the first display screen, in addition to displaying the real-time screen, a preview display item for displaying the captured image is included.

8. The endoscopic image display method according to claim 1, characterized in that, Before receiving the first mode instruction, it includes: Obtaining the working state of the insertion end of the endoscope, where the working state includes the access state; If the working state is the access state, obtaining the first mode switching instruction.

9. The endoscopic image display method according to claim 1, wherein It further includes: Obtaining the working state of the insertion end of the endoscope, where the working state includes the removal state; If the working state is the removal state, exiting the immersive mode and displaying the original layout on the first display screen.

10. An endoscope system, characterized in that, It includes an endoscope insertion end, an endoscope host, and a display device. The display device includes a first display screen and a second display screen; the endoscope host includes a processor, a memory, and one or more programs. The one or more programs are stored in the memory and are configured to be executed by the processor. The one or more programs include instructions for performing the steps in the method according to any one of claims 1-9; the first display screen is used to respond to the processor.

Images