Display control method for endoscope system, and endoscope system

Abstract

The invention discloses a display control method of an endoscope system and the endoscope system.The method comprises the steps that a first user interface is displayed in a first screen, and in a screen linkage mode, at least a local area of the first user interface is a display area used for displaying linkage files; a second user interface is displayed in the second screen, and in the screen linkage mode, at least a local area of the second user interface is a touch interaction area used for bearing touch operation of a user; responding to a first contact instruction received in the touch interaction area; and adjusting the display area and / or the linkage file according to the associated function corresponding to the first contact instruction. The interaction efficiency and the task processing efficiency can be improved.

Description

Technical Field

[0001] This application relates to the technical field of endoscopes, and particularly to a display control method and an endoscope system for an endoscope system. Background Art

[0002] An endoscope is a commonly used medical device for introducing into a patient's body for examination. The processor of the endoscope can store relevant data such as image data, video data, and examination information.

[0003] When it is necessary to view or edit the data stored in the processor, due to the small display screen on the host, it cannot well meet the display of the data, especially for images or videos, and cannot meet the user's immediate viewing needs. Usually, the data needs to be exported to a computer for operation, or a workstation needs to be configured for operation on the workstation, or an external device needs to be configured to cooperate with the operation, such as a keyboard and mouse kit. Therefore, there are problems of poor interaction experience and low operation efficiency. Summary of the Invention

[0004] Embodiments of this application provide a display control method and an endoscope system for an endoscope system to improve operation efficiency and optimize the interaction experience.

[0005] In a first aspect, embodiments of this application provide a display control method for an endoscope system, which is applied to a processor of the endoscope system; the endoscope system further includes an endoscope insertion end, a first screen, and a second screen, and the second screen is configured as a touch screen; when the endoscope insertion end is in a working state, at least a partial area of the first screen is used to display real-time images collected by the endoscope insertion end; the method includes:

[0006] Display a first user interface on the first screen, and in the screen linkage mode, at least a partial area of the first user interface is a display area for displaying linked files;

[0007] Display a second user interface on the second screen, and in the screen linkage mode, at least a partial area of the second user interface is a touch interaction area for carrying out user touch operations;

[0008] Respond to a first contact instruction received in the touch interaction area;

[0009] Adjust the display area and / or the linked files according to the associated function corresponding to the first contact instruction.

[0010] Second aspect, an embodiment of the present application provides an endoscope system, the endoscope system includes: a processor, a first screen, a second screen, and an endoscope insertion end; the second screen is configured as a touch screen; when the endoscope insertion end is in a working state, at least a partial area of the first screen is used to display real-time images collected by the endoscope insertion end; the processor is configured to implement the method as described in the first aspect.

[0011] Third aspect, an embodiment of the present application provides a display control device for an endoscope system, which is applied to the processor of the endoscope system; the endoscope system further includes an endoscope insertion end, a first screen, and a second screen, and the second screen is configured as a touch screen; when the endoscope insertion end is in a working state, at least a partial area of the first screen is used to display real-time images collected by the endoscope insertion end; the device includes:

[0012] A first display unit, configured to display a first user interface on the first screen. In the screen linkage mode, at least a partial area of the first user interface is a display area for displaying linkage files;

[0013] A second display unit, configured to display a second user interface on the second screen. In the screen linkage mode, at least a partial area of the second user interface is a touch interaction area for carrying out user touch operations;

[0014] A response unit, configured to respond to a first contact instruction received in the touch interaction area;

[0015] An adjustment unit, configured to adjust the display area and / or the linkage file according to the associated function corresponding to the first contact instruction.

[0016] Fourth aspect, an embodiment of the present application provides an electronic device, including a memory, a processor, and executable program code stored on the memory and executable on the processor. When the processor executes the executable program code, it executes the steps of the method as described in the first aspect.

[0017] Fifth aspect, an embodiment of the present application provides a computer-readable storage medium, on which executable program code is stored. The executable program code includes execution instructions, and the execution instructions are used to execute the steps of the method as described in the first aspect.

[0018] Sixth aspect, an embodiment of the present application provides a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program. The computer program is operable to cause a computer to execute some or all of the steps described in the first aspect of the embodiments of the present application. The computer program product can be a software installation package.

[0019] It can be seen that in the embodiment of the present application, first, a first user interface is displayed on the first screen. In the screen linkage mode, at least a partial area of the first user interface is a display area for displaying linkage files. Then, a second user interface is displayed on the second screen. In the screen linkage mode, at least a partial area of the second user interface is a touch interaction area for carrying out user touch operations. Then, a first contact instruction received in the touch interaction area is responded to. Finally, according to the associated function corresponding to the first contact instruction, the display area and / or the linkage file are adjusted. Based on the screen linkage mode of the dual screens, the embodiment of the present application makes corresponding adjustments to the display area for displaying linkage files and / or the linkage file on the first screen through the contact instruction in the touch interaction area on the second screen, realizes cross-screen interactive display control, provides a more convenient operation method for users, is particularly suitable for scenarios with low-precision operations, improves the operation effect, and optimizes the interaction experience. Description of the Drawings

[0020] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required to be used in the embodiments will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0021] Figure 1 is a system architecture diagram of an endoscope system provided by an embodiment of the present application;

[0022] Figure 2 is a schematic flowchart of a display control method of an endoscope system provided by an embodiment of the present application;

[0023] Figure 3 is a first user interface schematic diagram provided by an embodiment of the present application;

[0024] Figure 4 is a second user interface schematic diagram provided by an embodiment of the present application;

[0025] Figure 5 is a third user interface schematic diagram provided by an embodiment of the present application;

[0026] Figure 6 is a fourth user interface schematic diagram provided by an embodiment of the present application;

[0027] Figure 7 is a fifth user interface schematic diagram provided by an embodiment of the present application;

[0028] Figure 8 is a sixth user interface schematic diagram provided by an embodiment of the present application;

[0029] Figure 9 is the seventh user interface schematic diagram provided by an embodiment of the present application;

[0030] Figure 10 is the eighth user interface schematic diagram provided by an embodiment of the present application;

[0031] Figure 11 is the ninth user interface schematic diagram provided by an embodiment of the present application;

[0032] Figure 12 is the tenth user interface schematic diagram provided by an embodiment of the present application;

[0033] Figure 13 is the block diagram of the functional units of a display control device of an endoscope system provided by an embodiment of the present application;

[0034] Figure 14 is the block diagram of the functional units of another display control device of an endoscope system provided by an embodiment of the present application;

[0035] Figure 15 is the structural schematic diagram of an electronic device proposed by an embodiment of the present application. Detailed implementation manners

[0036] In order to enable those skilled in the art to better understand the solution of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without making creative efforts belong to the scope protected by the present application.

[0037] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally further includes steps or units not listed, or optionally further includes other steps or units inherent to these processes, methods, products or devices.

[0038] Reference to "embodiment" in this specification means that the specific features, structures, or characteristics described in connection with the embodiment may be included in at least one embodiment of the present application. The phrase appears at various positions in the specification and does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that the embodiments described herein may be combined with other embodiments.

[0039] When a doctor needs to perform operations such as magnifying and viewing or editing a stored data file, the first method is to implement the above operations on the computer of the workstation. However, if the endoscope is not connected to the workstation, only tools such as a USB flash drive can be used to copy the file to the computer for operation, which is very inconvenient. The second method: An external device (such as a keyboard and mouse kit) needs to be added to cooperate with the endoscope display screen for operation, but it will increase the disinfection pressure on medical staff, etc.

[0040] In view of the above problems, the embodiments of the present application provide a display control method and an endoscope system for an endoscope system. The embodiments of the present application will be introduced in detail below with reference to the accompanying drawings.

[0041] Please refer to Figure 1 , Figure 1 which is a system architecture diagram of an endoscope system provided by the embodiments of the present application. As Figure 1 shown, the endoscope system 100 includes a processor 101, an endoscope insertion end 102, a first screen 103, and a second screen 104, wherein the processor 101, the endoscope insertion end 102, the first screen 103, and the second screen 104 are communicatively connected to each other.

[0042] Among them, the front end of the endoscope insertion end 102 is equipped with a high-resolution camera and a high-quality optical system, which can clearly collect various real-time images in its working state; the first screen 103 is a large display screen. When the endoscope insertion end 102 is working, at least a partial area in the first screen 103 displays the real-time images transmitted by the endoscope insertion end 102.

[0043] Among them, the second screen 104 is a small display screen, the second screen 104 is configured as a touch screen, and the size of the first screen 103 is much larger than the size of the second screen 104; there is a screen linkage relationship between the second screen 104 and the first screen 103. In the screen linkage mode, the content of the second screen 104 can be mapped to the first screen 103 for display.

[0044] Among them, the processor 101 is the control core of the endoscope system 100, and is at least used to respond to various touch operations of the user on the second screen 104, and in the screen linkage mode, control the display content and display layout of the first screen 103 according to the touch operation, and control the display content of the second screen 104.

[0045] Based on this, the present application provides a display control method for an endoscope system and an endoscope system, and the present application is described in detail below in conjunction with the accompanying drawings.

[0046] See also Figure 2 , Figure 2 is a flow chart of a display control method for an endoscope system provided in an embodiment of the present application, such as Figure 2 As shown, the method is applied to a processor of an endoscope system; the endoscope system further includes an endoscope insertion end, a first screen and a second screen, the second screen being configured as a touch screen; when the endoscope insertion end is in a working state, at least a partial area of the first screen is used to display a real-time image collected by the endoscope insertion end, and the method includes the following steps:

[0047] S210, displaying a first user interface on the first screen.

[0048] Wherein, in the screen linkage mode, at least a partial area of the first user interface is a display area for displaying linkage files.

[0049] S220, display a second user interface on the second screen.

[0050] Wherein, in the screen linkage mode, at least a partial area of the second user interface is a touch interaction area for carrying user touch operations.

[0051] The first screen is a larger screen, which may be 27 inches by way of example. The second screen is a touch screen, which is a smaller screen, which may be 7 inches by way of example.

[0052] The processor is connected to the first screen and the second screen through wired or wireless communication. The processor can transmit display content to the first screen and the second screen, and the first screen and the second screen receive the display content for display. In the screen linkage mode, the display content of the first screen and the second screen is different. The processor can obtain the resolution of the first screen and the second screen, and the display content transmitted to the first screen and the second screen will automatically adapt the resolution for display. In some embodiments, the processors connected to the first screen and the second screen can be different processors, and the two processors communicate data to realize the display on the first screen and the second screen, as well as the interaction between the first screen and the second screen.

[0053] Among them, the display area in the first user interface can be a partial area display or a full-screen display. In some embodiments, the display state of the display area is specifically adjusted according to the user's touch instruction and / or the operating state of the insertion end of the endoscope.

[0054] Among them, the touch interaction area can be used to display various media files selected by the user for viewing. In some embodiments, the proportion of the touch interaction area in the second screen is the largest, which is used to provide a larger operation area and can provide low-precision touch. For example, when medical staff do not want to contaminate their gloves during the operation, it supports scenarios where elbows or other parts can be used for operation, which is beneficial to improving the flexibility of operation.

[0055] Specifically, the linked file includes one or more of images, videos, or texts.

[0056] Among them, the linked file refers to a file that realizes associated interactive display between different screens, which can be an image, a video, a text, or any combination of the above. Exemplarily, in the data review function, the linked file can be at least an image, a combined file including an image, a video, or a combined file including a video. Exemplarily, in the edit report function, the linked file can be at least a text or a combined file including a text. Exemplarily, in the automatic report function, the linked file can be an image, a combined file including an image, a video, a combined file including a video, a text, or a combined file including a text.

[0057] Specifically, displaying the first user interface on the first screen includes: responding to a first start instruction of the screen linkage mode, where the first start instruction includes the start information of the screen linkage mode and the linked file information required for interaction after starting the screen linkage mode; according to the linked file information, displaying a user interface corresponding to the linked file information on the first screen; and displaying the second user interface on the second screen includes: according to the linked file information, displaying a user interface corresponding to the linked file information on the second screen.

[0058] In some embodiments, the first start instruction can be started through a physical button.

[0059] Exemplarily, the endoscope handle is connected to the insertion end of the endoscope through a specific connection structure. When the insertion end of the endoscope is in the working state, the screen linkage mode is started through a specific quick button on the endoscope handle. If it is necessary to exit the screen linkage mode, the specific quick button on the endoscope handle can be clicked again.

[0060] In some embodiments, the first start instruction can be a touch instruction on the second screen.

[0061] Further, different functions correspond to different startup instructions, and the startup instructions are also different depending on the operating state of the insertion end of the endoscope.

[0062] Exemplarily, in the editing report function, click the "Generate Report" control on the file page of the second screen to enter the screen linkage mode, and click the "Exit" control on the editing report page of the second screen to exit the screen linkage mode.

[0063] Exemplarily, in the data review function, first determine the operating state of the insertion end of the endoscope. If the insertion end of the endoscope is in the working state, during the operation or examination, click the quick switch on the second screen to enter the screen linkage mode, and click the quick switch on the second screen again to exit the screen linkage mode; if the insertion end of the endoscope is in the non-working state, after the operation or examination, click the quick switch in the file function module of the second screen to enter the screen linkage mode, or click on a single image, video, or text in the second screen to enter the screen linkage mode; similarly, click the quick switch in the file function module of the second screen again to exit the screen linkage mode, or click the "Return" control to exit the page of the single image, video, or text being viewed or edited currently to exit the screen linkage mode.

[0064] Among them, after triggering the screen linkage startup instruction, the user or the device will select the linkage file required for interaction after entering the screen linkage mode, such as viewing a certain image or editing a certain text. It can be understood that the startup information received by the processor includes both the startup information of the screen linkage mode and the information about the type of linkage file targeted by the screen linkage mode.

[0065] Among them, the linkage file information may include information such as file type, file name, and / or file size.

[0066] Among them, after entering the screen linkage mode, the linkage file is displayed in the display area in the first user interface. In a possible embodiment, the display area can be full-screen display or partial area display. Specifically, the size of the display area is related to the operating state of the insertion end of the endoscope.

[0067] Among them, if the insertion end of the endoscope is in the working state, the display area is a partial area in the first user interface. The first user interface further includes a real-time image area for displaying the real-time endoscope image collected by the insertion end of the endoscope, or the first user interface further includes an area for displaying other information. In a possible embodiment, the proportion of the real-time image area in the first user interface is the largest.

[0068] Exemplarily, Figure 3This is the schematic diagram of the first user interface provided by the embodiments of the present application, showing the operating state of the insertion end of the endoscope as the working state under the data review function, and the schematic diagram of the user interface when a viewing operation needs to be performed on the endoscope image 1. As Figure 3 shown, (a) is the first user interface, and the first user interface includes an inspection information area, a button information area, a display area, and a real-time image area.

[0069] Among them, the inspection information area can be used to display the patient's inspection information, such as vital sign information and blood routine results; the button information area is used to display the functions of each physical button on the endoscope handle; the display area is used to display the linked file, that is, the endoscope image 1 is displayed in the display area; the real-time image area is used to display the real-time endoscope image collected by the insertion end of the endoscope.

[0070] In a possible embodiment, the number of currently stored images or videos can be displayed in the display area.

[0071] Among them, if the insertion end of the endoscope is in a non-working state, the display area occupies all the visible space of the first user interface.

[0072] Exemplarily, Figure 4 This is the schematic diagram of the second user interface provided by the embodiments of the present application, showing the operating state of the insertion end of the endoscope as the non-working state under the data review function, and the schematic diagram of the user interface when a viewing operation needs to be performed on the endoscope image 1. As Figure 4 shown, the first user interface only includes a display area, and the display area occupies all the visible space of the first user interface and is used to display the endoscope image 1.

[0073] Among them, different file types correspond to different second user interfaces.

[0074] In a possible embodiment, if the linked file is an image or a combined file including images, after entering the screen linkage mode, the second user interface includes a touch interaction area, and by responding to the contact instruction in the touch interaction area of the second user interface, the size and / or the display content of the display area are controlled. In a possible embodiment, the second user interface further includes a preview area, and multiple to-be-linked files are displayed through the preview area to provide preview thumbnails for the user. In a possible embodiment, the user is supported to quickly select the linked file to be viewed or edited in the preview area.

[0075] In a possible embodiment, the second user interface may further include an information display area for providing users with a clear understanding of the interface scenario and the operation object. For example, it may be function status information, that is, the function mode currently executed by the interface, to help users clarify the purpose of the interface. For example, it may also be file identification information, such as the image file name and file type being viewed, allowing users to quickly identify the specific content being processed currently.

[0076] In a possible embodiment, the second user interface may also be provided with a drop-down list to select associated files through the drop-down list. Specifically, when clicking on the drop-down list, a list containing all optional associated files will pop up and be arranged and displayed according to a preset rule. Users can browse and search for associated files in this list, and after selection, the associated file will be displayed in the display area of the first user interface.

[0077] Exemplarily, as Figure 3 shown, (b) is the second user interface. The second user interface includes an information display area b1 at the top, showing that the current is in the data review function. The second user interface also includes a large touch interaction area b3 for receiving various touch instructions from users, supporting users to perform gesture operations, such as two-finger zooming, single-finger sliding to switch images, etc. The second user interface also includes a preview area b2 for displaying thumbnail previews of multiple images. Currently, the endoscopic image 1 is selected, and the border of the endoscopic image 1 is highlighted in the preview area b2, such as being highlighted with a red rectangular frame. Clicking on other thumbnails can quickly switch to view the corresponding image or file. Among them, there is an arrow pointing to the icon within the rectangular frame in the upper right corner of the second user interface, which is a check icon. Clicking on it can select the currently displayed image for subsequent batch operations, such as batch deletion. The "<" in the upper left corner of the second user interface is a return button. Clicking on it can return to the previous page.

[0078] In a possible embodiment, associated files can be displayed in the touch interaction area according to user needs.

[0079] In a possible embodiment, if the associated file is a video or a combined file including a video, after entering the screen linkage mode, the second user interface includes a touch interaction area and a progress bar touch area. In a possible embodiment, the second user interface further includes a preview area for displaying multiple associated files to be linked and providing preview thumbnails for users. In a possible embodiment, it supports users to quickly select the associated files that need to be viewed or edited in the preview area.

[0080] Among them, the progress bar touch area can be provided below the touch interaction area. Dragging the progress bar can quickly jump to a specified playing period, and at the same time, the progress timestamp is displayed. Selecting a playing node by tapping, and swiping the progress bar left and right can achieve fast forward and rewind.

[0081] In a possible embodiment, the second user interface may further include an information display area for providing the user with a clear understanding of the interface scenario and the operation object.

[0082] In a possible embodiment, the second user interface may also be provided with a drop-down list for selecting associated files through the drop-down list.

[0083] Exemplarily, Figure 5 FIG. 8 is a schematic diagram of the third user interface provided by an embodiment of the present application, showing a schematic diagram of the user interface when the operating state of the insertion end of the endoscope is in a non-operating state and a viewing operation needs to be performed on the endoscope video 1 in the data review function, as Figure 5 shown. (a) is the first user interface, which only includes a display area that occupies all the visible space of the first user interface and displays the endoscope video 1. (b) is the second user interface, which includes an information display area b1 at the top, showing the file name of the currently viewed endoscope video 1, which is 202304061200; the second user interface (b) also includes a large touch interaction area b3 for receiving various touch instructions from the user and supporting the user to perform gesture operations, such as two-finger zooming, single-finger sliding to switch images, etc.

[0084] Among them, a progress bar touch area b4 is provided below the touch interaction area b3, and dragging it can fast forward and rewind the video. The progress bar touch area b4 includes a triangular video play control, a video progress timestamp, a progress slider, a video duration, and a progress bar. The video progress timestamp is displayed on the left side of the progress bar touch area b4, and "12:13" represents that the current playback progress of the video is 12 minutes and 13 seconds; the video duration is displayed on the right side of the progress bar touch area b4, and "34:56" indicates that the total length of the video is 34 minutes and 56 seconds; the white circular slider in the middle of the progress bar is the progress slider, which can be dragged to freely locate the playback position, realizing fast forward, rewind, or accurately jumping to a specific time point to view the content of the corresponding period.

[0085] Among them, the second user interface further includes a preview area b2 for displaying thumbnail previews of multiple images or videos. The currently selected endoscope video 1 is highlighted with a border in the preview area b2, such as being highlighted with a red rectangular frame. Clicking on other thumbnails can quickly switch to view the corresponding image or video. Among them, there is an arrow pointing to an icon inside the rectangular frame in the upper right corner of the second user interface, which is a check mark icon. Clicking it can select the currently displayed image for subsequent batch operations; the "<" in the upper left corner of the second user interface is a return button, and clicking it can return to the previous page.

[0086] Among them, if the linked file is a text or a combined file including text, after entering the screen linkage mode, the second user interface includes a touch interaction area, and the touch interaction area includes a preview touch area and an editing area. The preview touch area is the preview touch area, which has multiple rectangular frames for intuitively displaying the position, size, and arrangement of the text, helping the user to preview the final effect in real time. This helps to reduce the manual search and positioning time and enables the doctor to complete the text editing more efficiently.

[0087] In a possible embodiment, the interaction in the editing area can be triggered by clicking on the rectangular frame in the preview touch area. Specifically, the user clicks on any rectangular frame, and then enters the text corresponding to the rectangular frame in the editing area. At the same time, the detailed information of the selected rectangular frame is displayed in real time in the editing area, which is dynamically synchronized with the preview touch area.

[0088] In a possible embodiment, the interaction in the editing area can be triggered by dragging the rectangular frame in the preview touch area. Specifically, the user drags any rectangular frame into the editing area, and then enters the text corresponding to the rectangular frame in the editing area. At the same time, the detailed information of the selected rectangular frame is displayed in real time in the editing area, which is dynamically synchronized with the preview touch area.

[0089] In a possible embodiment, after clicking or dragging the rectangular frame in the preview touch area, the area will be highlighted, such as with a blue border or filling, indicating that it has entered the editable state.

[0090] In a possible embodiment, the second user interface may further include an information display area for providing the user with a clear understanding of the interface scenario and operation objects.

[0091] Among them, if the linked file is a text or a combined file including text, after entering the screen linkage mode, the layout of the display area of the first user interface and the preview touch area can be the same, but the preview touch area presents the text layout, and the interaction object is a textless rectangular frame; while the display area will carry text information for displaying multiple text objects that are currently being edited and / or to be edited.

[0092] Exemplarily, Figure 6 is the schematic diagram of the fourth user interface provided by the embodiment of the present application, showing the schematic diagram of the user interface when an editing operation needs to be performed on "Findings" under the editing report function, as Figure 6 shown. (b) is the second user interface, and the second user interface includes an information display area b1, a preview touch area b5, and an editing area b7. Among them, the uppermost information display area b1 shows that the current page is the inspection report page.

[0093] Among them, the preview touch area b5 on the left side includes multiple rectangular frames and a first control. The position of each rectangular frame corresponds to the position of each text in the inspection report displayed in the display area. After the user clicks on a certain rectangular frame in the preview touch area b5, this area will be highlighted by blue filling, indicating that the text corresponding to this rectangular frame enters the editable state. For example, "Findings" is in the editable state; the first control is used to trigger the next operation related to preview. For example, clicking on this control can enter the next step of report generation, or switch to the next page preview of the report, or may be used to switch between different preview modes or related operations, guiding the user to continue to complete the report-related operations.

[0094] Among them, the second user interface further includes a control area b6, which is used to place various function buttons related to report operations, such as reset, upload, save, print, export, and exit, etc.; there is a text box set below the control area b6, which is used to display the detailed information of the selected rectangular frame in real time. Exemplarily, it is "Findings", prompting the user to fill in the specific situation observed during the inspection in the editing area.

[0095] Among them, the editing area b7 may further include an auxiliary input area, which is used for the user to quickly select appropriate words to edit the report-related content. Exemplarily, when editing "Findings", the auxiliary input area may include a thesaurus control, which is used for the user to select appropriate words from the thesaurus to fill in the "Findings", so as to improve the user's editing efficiency, ensure the accuracy and standardization of medical terms and other word usages, and avoid spelling mistakes or inappropriate word usages in manual input.

[0096] Among them, there is a large space editing area b7 below the auxiliary input area, which is the place where the user actually inputs text content, and is used to record the inspection-related information in detail.

[0097] In some embodiments, the display size of the editing area is larger than the display size of the preview touch area.

[0098] In a possible embodiment, if the linked file is a text or a combined file including text, after entering the screen linkage mode, the second user interface can set a drop-down list, and the text to be edited can be selected through the drop-down list.

[0099] In a possible embodiment, as Figure 6 shown, (a) is the first user interface. The first user interface includes a prompt area a2 and a display area a3. The uppermost area is the prompt area a2, which is used to prompt the user about the purpose, operation status or key information of the current interface. For example, it can inform that this is a report editing interface, remind the type of report being processed, such as an endoscopic examination report; it can also prompt the operation progress, such as the report is not saved, data is being edited, etc.; it may also give operation guidelines, such as please fill in the following patient information in sequence, etc.

[0100] Below the prompt area is the display area a3, which displays the inspection report template, including hospital name, report title, name, gender, age, phone number, ID, inspection number, inspection date, content number, inspection image, inspection findings, clinical diagnosis, biopsy site, suggestions, inspecting doctor and nurse, etc. Here, the ID is the patient's identity identification number, through which various inspection information, medical record records and other materials of the patient can be quickly and accurately queried.

[0101] Furthermore, the first user interface further includes a linkage response area for focusing on the text being edited in the editing area of the second user interface. Among them, the linkage response area can also be displayed in various ways. For example, color highlighting can be used to prominently display the text being edited in the editing area in the first user interface in a prominent color, differentiating it from other parts, so that users can locate it at a glance. Or by adding a bold border to prompt users that this is the part that needs attention and operation currently. Exemplarily, as Figure 6 shown, the text being edited in the editing area can be focused and displayed through a green box.

[0102] Exemplarily, if it is necessary to fill in the "inspection image" in the inspection report, the control area of the second user interface may include an image upload control for the user to select and upload the endoscope image file stored locally, so as to add the image to the inspection report. Furthermore, an area can be divided in the preview touch area, or at a suitable position above the editing area, etc., so that the user can view the image content immediately after uploading to confirm whether it is the required image, and simple zooming, rotation and other operations can also be performed to adjust the display effect. And an image annotation tool is set in the auxiliary input area for the user to use tools such as lines and text boxes to annotate when key information such as the lesion location needs to be annotated on the inspection image to assist in explaining the image content.

[0103] It can be seen that through screen linkage, various files, pictures, etc. are displayed on the large screen in the embodiment of the present application, enabling doctors to select corresponding files for editing, realizing flexible and convenient operations, and improving efficiency. And users do not need complex operation steps and instruction inputs, and can control the display area only through simple touch operations, reducing the learning cost and operation difficulty of users, and enabling more users to easily use this function. It is especially applicable to the scenario where the endoscope is not connected to the workstation.

[0104] Specifically, displaying the first user interface on the first screen includes: responding to a second start instruction for automatic reporting; according to the second start instruction, displaying the first user interface on the first screen, where the first user interface includes a report display area for displaying an inspection report, and the inspection report includes at least one second file to be linked; displaying the second user interface on the second screen includes: according to the second start instruction, displaying the second user interface on the second screen, and at least a partial area of the second user interface includes a third preview area for quickly selecting a linked file to be displayed in the display area from the second files to be linked.

[0105] Among them, the automatic reporting function is used to automatically generate an inspection report after all inspection operations are completed, including basic text information and media files of the inspection. The second start instruction is an instruction received after all inspection operations are completed, and it can enter automatically, enter by pressing a key. Exemplarily, it can be that the user clicks on the control for automatic reporting to issue the instruction. Under the automatic reporting function, after the inspection is completed, when the endoscopic insertion end is pulled out, the screen linkage mode can be automatically entered. If there is no operation in the touch interaction area for 30 seconds after entering, it will automatically exit; or click the exit button on the second screen to exit the screen linkage mode.

[0106] Among them, under the automatic reporting function, the processor will select key images and key videos from the videos and images captured by the endoscopic insertion end, and then generate an automatic report. For example, during a gastroscopy examination, the processor can select abnormal images such as gastric mucosa congestion, edema, or ulcers, so that these key information can be directly focused on in the automatic report, reducing the browsing time of irrelevant images.

[0107] Among them, under the automatic reporting function, there are multiple types of inspection reports. For different inspection types, corresponding report templates are designed, including required items, recommended filling content, format specifications, etc. Before entering the automatic report, the user selects the inspection report type in advance, and then generates the corresponding inspection report.

[0108] Among them, after entering the automatic reporting function, the first user interface includes a report display area for displaying the content of the automatic report. The second user interface includes a touch interaction area, and by responding to the contact instruction in the touch interaction area of the second user interface, the display content in the display area of the first user interface is controlled. In a possible embodiment, the second user interface further includes a preview area for displaying multiple files to be linked in the automatic report to provide the user with preview thumbnails. In a possible embodiment, the user is supported to quickly select the linked files to be viewed or edited in the preview area.

[0109] Exemplarily, Figure 7This is the fifth schematic diagram of the user interface provided by the embodiments of the present application, showing the schematic diagram of the user interface when a viewing operation needs to be performed on the endoscope image 2 under the automatic reporting function. As Figure 7 shown, (a) is the first user interface. The first user interface includes a report display area a1, and the report display area a1 occupies all the visible space of the first user interface and is used to display the automatically generated inspection report, showing the basic text information of the inspection, that is, patient-related information and inspection data. For example, the patient's name is Zhang San, and the ID is 49304939; the start time is 14:24 on April 12, 2023, the duration is 34 minutes and 12 seconds, 3 videos were taken, and the number of photos taken is 34. Among them, the start time refers to the inspection start time, and the duration is the inspection duration. On the right side, it is used to display the media files in the automatic report, including images and videos.

[0110] As Figure 7 shown, (b) is the second user interface. The 30S in the upper right corner of the second user interface is the countdown display area, prompting that if there is no operation in the touch interaction area b3 within 30 seconds, the screen linkage mode will be automatically exited. The "×" button in the upper right corner of the second user interface is the close button, and clicking it can exit the automatic reporting function. The second user interface also includes a touch interaction area b3 and a preview area b2.

[0111] In a possible embodiment, the preview area can be within the touch interaction area or below the touch interaction area.

[0112] In a possible embodiment, the preview area b2 includes multiple display frames, and each display frame displays an image or a video. The red display frame indicates that the current endoscope image 2 is in the selected state, and the user can determine the content displayed in the display area by touching and selecting different display frames.

[0113] In a possible embodiment, when the user clicks on the endoscope image 2, the first user interface fully displays the endoscope image 2 at this time, and the display area completely covers the report display area. Among them, there is an icon similar to a nine-square grid in the upper left corner of the second user interface. Clicking this icon controls the first user interface to return to the automatic reporting state, that is, the automatic report is displayed in the report display area, and at this time the report display area completely covers the display area.

[0114] S230, respond to the first contact instruction received in the touch interaction area.

[0115] Specifically, the linked file is the image or a combined file including the image; the first contact instruction includes a first switching instruction, a zoom-in instruction, a zoom-out instruction or a second switching instruction.

[0116] Among them, the first switching instruction is used to switch pictures according to a sliding gesture. Specifically, it is triggered according to the subsequent sliding direction of a single touch point in the touch interaction area. If the user touches and swipes to the right, the next picture is viewed correspondingly in the touch interaction area. If the user touches and swipes to the left, the previous picture is viewed correspondingly in the touch interaction area.

[0117] Among them, the zoom-in instruction is used to zoom in on the picture and / or the display area according to a touch action. Specifically, the zoom-in instruction can be triggered according to the interval time of consecutive touch points in the touch interaction area. For example, double-tapping to zoom in. It can also be triggered according to the change in the distance between touch points in the touch interaction area. Detect the change in the distance between two or more touch points. When the distance gradually increases, it is determined as the zoom-in instruction, thereby zooming in on the picture. For example, spreading two fingers apart to zoom in. It can also be triggered according to a long-press operation in the touch interaction area. The user long-presses a certain position in the touch interaction area, and then a zoom-in option menu appears. Select the zoom-in option, or directly trigger the zoom-in effect after the long-press, and the zoom-in degree can be further adjusted through subsequent touch operations.

[0118] In a possible embodiment, the object corresponding to the zoom-in instruction can be determined according to the size of the display area. Specifically, if the display size of the display area is smaller than the first preset display size, the zoom-in instruction is used to zoom in on the display area and display the picture in the zoomed-in display area, that is, synchronously zoom in on the picture. If the display size of the display area is greater than or equal to the first preset display size, the zoom-in instruction is used to zoom in on the picture in the display area. Among them, the first preset display size can be determined according to user needs. An exemplary first preset display size can be the full screen.

[0119] In a possible embodiment, when the operating state of the endoscopic insertion end is the non-working state, the display area occupies all the visible space of the first user interface. When the touch instruction is the zoom-in instruction, the image is zoomed in and the local content of the image is displayed.

[0120] In a possible embodiment, when the operating state of the endoscopic insertion end is the working state, the display area is a local area of the first user interface. When the touch instruction is the zoom-in instruction, the display size of the display area is zoomed in and the image is displayed in the zoomed-in display area, that is, the display size of the image is zoomed in.

[0121] Among them, the zoom-out instruction is used to zoom out the picture and / or the display area according to the touch action. Specifically, it can be triggered according to the interval time of consecutive contacts in the touch interaction area, such as double-tapping to zoom out; it can also be triggered according to the change in the distance between contacts in the touch interaction area, detecting the change in the distance between two or more touch points, and when the distance gradually shrinks, it is determined as the zoom-out instruction, so as to zoom out the picture, such as pinching inward with two fingers to zoom out; it can also be triggered according to the long-press operation in the touch interaction area. The user long-presses a certain position in the touch interaction area, and then a zoom-out option menu appears. Select the zoom-out option, or directly trigger the zoom-out effect after the long-press, and the zoom-out degree can be further adjusted through subsequent touch operations.

[0122] In a possible embodiment, the object corresponding to the zoom-out instruction can be determined according to the size of the display area. Specifically, if the display size of the display area is greater than the second preset display size, the zoom-out instruction is used to zoom out the display area and display the picture in the zoomed-out display area, that is, the picture is zoomed out synchronously; if the display size of the display area is less than or equal to the second preset display size, the zoom-out instruction is used to zoom out the picture in the display area.

[0123] In a possible embodiment, when the operating state of the insertion end of the endoscope is the non-working state, the display area occupies all the visible space of the first user interface. When the contact instruction is the zoom-out instruction, the linked file is zoomed out in the display area of the first user interface.

[0124] In a possible embodiment, if the operating state of the insertion end of the endoscope is the working state, the display area is a partial area of the first user interface. When the contact instruction is the zoom-out instruction, the display size of the display area is reduced in the first user interface.

[0125] Among them, the second switching instruction is used to switch the magnified content of the image displayed in the display area according to the sliding gesture. The second switching instruction is generally an instruction received after the magnification instruction is executed, and is used to drag the magnified image.

[0126] Specifically, the linked file is the video or a combined file including the video; the first contact instruction includes the first switching instruction, the play instruction, the stop play instruction or the sliding instruction.

[0127] Among them, the first switching instruction is used to switch the video according to the sliding gesture. Specifically, it is triggered according to the subsequent sliding direction of a single contact in the touch interaction area. If the user touches and swipes to the right, the next video is viewed correspondingly in the touch interaction area. If the user touches and swipes to the left, the previous video is viewed correspondingly in the touch interaction area.

[0128] Among them, the play instruction can be triggered by a single touch point in the touch interaction area. When the user clicks on any position in the touch interaction area, the video is played in the touch interaction area. The play instruction can also be triggered by the video play control in the progress bar touch area.

[0129] Among them, the stop play instruction is an instruction after responding to the play instruction and can be triggered by a single touch point in the touch interaction area. When the user clicks on any position in the touch interaction area again, the video is stopped in the display area. The play instruction can also be triggered by the video play control in the progress bar touch area, that is, by clicking on the video play control again.

[0130] Among them, the sliding instruction is used to switch the video progress according to the sliding gesture. Specifically, it is triggered according to the subsequent sliding direction of a single touch point in the touch interaction area. If the user touches and slides to the left, the video progress jumps forward, that is, the play time moves to a future time point, and the subsequent content is played quickly. If the user touches and slides to the right, the video progress jumps backward, that is, the play time returns to a past time point, and the previous content is played again. Further, the jump progress is determined according to the sliding distance.

[0131] Specifically, the sliding instruction in the progress bar touch area can also be responded to, that is, by dragging the progress bar to control the play progress of the video.

[0132] Specifically, the linked file is the text or a combined file including the text; the first contact instruction is an edit instruction.

[0133] Among them, according to the correspondence between the display content in the preview touch area and the display content in the first user interface, the text to be edited is selected in the preview touch area, and then the corresponding content of the text is input in the editing area. Specifically, the user clicks on a certain rectangular box in the preview touch area, and then inputs the text information corresponding to the rectangular box in the editing area of the second user interface.

[0134] Exemplarily, as Figure 6 shown, the user clicks on a certain rectangular box in the preview touch area b5, and the corresponding content of the rectangular box is "Findings of examination", that is, currently "Findings of examination" needs to be edited. Then, the text information is input in the editing area b7 of the second user interface to fill in "Findings of examination" in the inspection report. Among them, according to the click operation of the user in the preview touch area b5, the clicked rectangular box will be focused in the preview touch area b5. For example, the rectangular box is filled with blue to show that "Findings of examination" is currently being edited.

[0135] Exemplarily, Figure 8 is the schematic diagram of the sixth user interface provided by the embodiment of the present application, showing the schematic diagram of the user interface when the contact instruction is the first switching instruction under the data review function, as Figure 8As shown, in the touch interaction area b3 of the second user interface (b), the blue circle is the user's touch position, i.e., the contact point position, and the arrow direction is a rightward slide, which means that the next picture or video is correspondingly displayed in the display area of the first user interface (a). Among them, b1 is the information display area for displaying that the current is in the data review function, and b2 is the preview area for displaying thumbnail previews of multiple images or videos.

[0136] Exemplarily, Figure 9 is the seventh schematic diagram of the user interface provided by the embodiment of the present application, showing the schematic diagram of the user interface when the contact instruction is the first switching instruction under the data review function, as Figure 9 As shown, in the touch interaction area b3 of the second user interface (b), the blue circle is the user's touch position, i.e., the contact point position, and the arrow direction is a leftward slide, which means that the previous picture or video is correspondingly displayed in the display area of the first user interface (a). Among them, b1 is the information display area for displaying that the current is in the data review function, and b2 is the preview area for displaying thumbnail previews of multiple images or videos.

[0137] Exemplarily, Figure 10 is the eighth schematic diagram of the user interface provided by the embodiment of the present application, showing the schematic diagram of the user interface when the operating state of the endoscopic insertion end is the working state and the contact instruction is the magnification instruction under the data review function, as Figure 10 As shown, in the touch interaction area b3 of the second user interface (b), the two blue circles correspond to the user's two click touch positions, and then in response to the magnification instruction, the display size of the display area in the first user interface (a) is enlarged, and an image is displayed in the enlarged display area. Among them, b1 is the information display area for displaying that the current is in the data review function, and b2 is the preview area for displaying thumbnail previews of multiple images or videos.

[0138] In a possible embodiment, when the endoscopic insertion end is in the working state, the display area and / or the linked file can also be controlled by multiple physical buttons on the endoscopic handle. Exemplarily, physical button 1 is used to view the previous linked file, physical button 2 is used to view the next linked file, physical button 3 is used to enlarge the display area and / or the linked file, physical button 4 is used to reduce the display area and / or the linked file, and physical button 5 is used to exit the current function.

[0139] S240. Adjust the display area and / or the linked file according to the associated function corresponding to the first contact instruction.

[0140] Among them, when the linked file is an image or a combined file including an image, the associated function corresponding to the first switching instruction is used to adjust the linked file. Exemplarily, as Figure 9 shown, the previous picture of the current picture is displayed in the display area of the first user interface; asFigure 8 As shown, the next image of the current image is displayed in the display area of the first user interface.

[0141] Wherein, when the operating state of the endoscopic insertion end is the working state and the contact instruction is the zoom-in instruction, the associated function corresponding to the zoom-in instruction is used to zoom in the display area, that is, to correspondingly zoom in the display size of the linked file on the first user interface.

[0142] Wherein, the zoom-in instruction includes a zoom-in ratio, and according to the zoom-in ratio, the zoomed-in size of the display area is determined. If the zoom-in ratio is greater than the preset ratio, the display area will cover other areas of the first user interface.

[0143] Exemplarily, as Figure 10 shown, the display size of the display area is zoomed in according to the zoom-in ratio. The yellow square area is the zoomed-in display area, and the zoom-in ratio is greater than the preset ratio, so that the display area covers other areas of the first user interface, such as the real-time image area.

[0144] Wherein, the zoom-in instruction includes a zoom-in ratio, and according to the zoom-in ratio, the zoomed-in size of the display area is determined. If the zoom-in ratio is greater than the preset ratio, the display sizes of other areas in the first user interface are correspondingly adjusted so that each area can be normally displayed on the first user interface.

[0145] Exemplarily, Figure 11 is the schematic diagram of the ninth user interface provided by the embodiment of the present application, showing the schematic diagram of the user interface when the operating state of the endoscopic insertion end is the working state and the contact instruction is the zoom-in instruction under the data review function, as Figure 11 shown, in the touch interaction area b3 of the second user interface (b), the two blue circles correspond to the two click and touch positions of the user, and then the zoom-in instruction is responded to. The display size of the display area is zoomed in according to the zoom-in ratio. The yellow square area is the zoomed-in display area, and the zoom-in ratio is greater than the preset ratio, so the display size of the real-time image area is correspondingly reduced. The blue square area is the reduced real-time image area, so that the zoomed-in display area and the reduced real-time image area can be independently displayed in the first user interface (a). Wherein, b1 is the information display area for displaying that the current is in the data review function, and b2 is the preview area for displaying thumbnail previews of multiple images or videos.

[0146] Wherein, the associated function corresponding to the zoom-out instruction is used to adjust the display area and / or the linked file.

[0147] In a possible embodiment, when the operating state of the endoscopic insertion end is the working state and the contact instruction is the zoom-out instruction, the associated function corresponding to the zoom-out instruction can be used to reduce the display size of the display area, and correspondingly reduce the display size of the linked file on the first user interface. Wherein, according to the zoom-out ratio in the zoom-out instruction, the reduced size of the display area is determined.

[0148] Further, according to the reduction ratio, the display sizes of other areas in the first user interface can be appropriately adjusted, such as enlarging the display size of the real-time image area.

[0149] In a possible embodiment, when the operating state of the endoscopic insertion end is a non-working state and the contact instruction is a reduction instruction, the associated function corresponding to the reduction instruction can be used to reduce the image, that is, to reduce the image in the display area of the first user interface.

[0150] Among them, the associated function corresponding to the second switching instruction is used to adjust the linked file and switch the partial content of the linked file displayed in the display area. The second switching instruction corresponds to a magnify-and-slide operation, and is used to drag and view the partial content of the magnified image in the display area.

[0151] It can be seen that in the embodiment of the present application, through the linkage between the first screen and the second screen, when the doctor performs a touch operation on the second screen, the first screen is synchronously updated and displayed, providing an intuitive and convenient interaction experience and improving the work comfort.

[0152] Among them, when the linked file is a video or a combined file including a video, the first switching instruction and the associated function corresponding to the first switching instruction are the same as those when the linked file is an image or a combined file including an image, and will not be elaborated here.

[0153] Among them, when the linked file is a video or a combined file including a video, the associated function corresponding to the play instruction is used to adjust the linked file and start playing the video in the display area; the associated function corresponding to the stop-play instruction is used to adjust the linked file and stop playing the video in the display area; the associated function corresponding to the slide instruction is used to adjust the linked file and adjust the playback progress of the video in the display area.

[0154] Among them, according to the play instruction or the stop-play instruction, in the display area of the first user interface, start playing the video or stop playing the video. Specifically, the play instruction can be to click on any position in the touch interaction area or click on the video play control in the progress bar touch area; the stop-play instruction can be to click on any position in the touch interaction area again or click on the video play control in the progress bar touch area again.

[0155] Exemplarily, Figure 12 is the tenth schematic diagram of the user interface provided by the embodiment of the present application, showing the schematic diagram of the user interface when the operating state of the endoscopic insertion end is a working state and a viewing operation needs to be performed on the endoscopic video 1 in the data review function, as Figure 12As shown, according to the play instruction or stop play instruction received in the touch interaction area b3 or the progress bar touch area b4 in the second user interface (b), start playing or stop playing the endoscope video 1 in the display area of the first user interface (a). Among them, b1 is the information display area for displaying that the current is in the data review function, and b2 is the preview area for displaying thumbnail previews of multiple images or videos.

[0156] Exemplarily, as Figure 5 shown, the operating state of the endoscope insertion end is a non-working state. According to the play instruction or stop play instruction received in the touch interaction area b3 or the progress bar touch area b4 in the second user interface (b), start playing or stop playing the endoscope video 1 in the display area of the first user interface (a).

[0157] Among them, the slide instruction is used to adjust the play progress of the video in the display area and control the play progress of the video in the display area of the first user interface. According to the user's slide direction, control the video progress to jump forward or backward.

[0158] Specifically, the associated function corresponding to the edit instruction is used to adjust the linked file, and update the display of the linked file displayed in the display area according to the text information input corresponding to the edit instruction.

[0159] Exemplarily, as Figure 6 shown, according to the text information related to "findings of examination" input by the user in the editing area, update the text information related to the findings of examination to the examination report in the first user interface.

[0160] It can be seen that in the embodiment of the present application, based on the screen linkage mode of the dual screens, through the contact instruction in the touch interaction area of the second screen, the display area for displaying the linked file and / or the linked file in the first screen are correspondingly adjusted, realizing cross-screen interactive display control, providing a more convenient operation method for users, and thus improving the interaction efficiency and the task processing efficiency.

[0161] Consistent with the above embodiment, please refer to Figure 13 , Figure 13 is the functional unit composition block diagram of a display control device of an endoscope system provided by the embodiment of the present application. As Figure 13As shown, the display control device 130 of the endoscope system includes: a first display unit 131 for displaying a first user interface on the first screen, and in the screen linkage mode, at least a partial area of the first user interface is a display area for displaying linkage files; a second display unit 132 for displaying a second user interface on the second screen, and in the screen linkage mode, at least a partial area of the second user interface is a touch interaction area for carrying out user touch operations; a response unit 133 for responding to a first contact instruction received in the touch interaction area; and an adjustment unit 134 for adjusting the display area and / or the linkage file according to the associated function corresponding to the first contact instruction.

[0162] In a possible embodiment, the linkage file includes one or more of an image, a video or a text.

[0163] In a possible embodiment, the linkage file is the image or a combined file including the image; the first contact instruction includes a first switching instruction, a zoom-in instruction, a zoom-out instruction or a second switching instruction; wherein, the associated function corresponding to the first switching instruction is used to adjust the linkage file and display an adjacent linkage file of the linkage file in the display area; the associated function corresponding to the zoom-in instruction is used to adjust the display area and / or the linkage file; the associated function corresponding to the zoom-out instruction is used to adjust the display area and / or the linkage file; and the associated function corresponding to the second switching instruction is used to adjust the linkage file and switch partial content of the linkage file displayed in the display area.

[0164] In a possible embodiment, the linkage file is the video or a combined file including the video; the first contact instruction includes a first switching instruction, a play instruction, a stop play instruction or a slide instruction; wherein, the associated function corresponding to the first switching instruction is used to adjust the linkage file and display an adjacent linkage file of the linkage file in the display area; the associated function corresponding to the play instruction is used to adjust the linkage file and start playing the video in the display area; the associated function corresponding to the stop play instruction is used to adjust the linkage file and stop playing the video in the display area; and the associated function corresponding to the slide instruction is used to adjust the linkage file and adjust the play progress of the video in the display area.

[0165] In a possible embodiment, the linkage file is the text or a combined file including the text; the first contact instruction is an edit instruction, and the associated function corresponding to the edit instruction is used to adjust the linkage file and update and display the linkage file displayed in the display area according to the text information input corresponding to the edit instruction.

[0166] In a possible embodiment, with regard to displaying a first user interface on the first screen, the first display unit 131 is further specifically configured to: respond to a first start instruction of the screen linkage mode, where the first start instruction includes start information of the screen linkage mode and linkage file information required for interaction after starting the screen linkage mode; according to the linkage file information, display a user interface corresponding to the linkage file information on the first screen; and the displaying a second user interface on the second screen includes: according to the linkage file information, display a user interface corresponding to the linkage file information on the second screen.

[0167] In a possible embodiment, with regard to displaying a first user interface on the first screen, the first display unit 131 is further specifically configured to: determine an operating state of the insertion end of the endoscope; according to the operating state, display a user interface corresponding to the operating state on the first screen; and the displaying a second user interface on the second screen includes: according to the operating state, display a user interface corresponding to the operating state on the second screen.

[0168] In a possible embodiment, the operating state includes a working state or a non - working state; if the operating state is the working state and the first contact instruction is a magnification instruction, then in the first user interface, the positional relationship between at least a partial area where the real - time image is located and the display area changes from a non - overlapping state to an overlapping state.

[0169] In a possible embodiment, the linkage file is an image, a video, a combined file including the image, or a combined file including the video; the second user interface further includes a preview area and / or a progress bar touch area; the preview area includes a plurality of first to - be - linked files for quickly selecting the linkage file displayed in the display area; the progress bar touch area is used to control the playing progress of the linkage file in the display area.

[0170] In a possible embodiment, the linkage file is a text or a combined file including the text; the second user interface further includes a preview touch area and an editing area, the preview touch area is used to display a linkage file including a plurality of texts to be edited, the editing area is used to input text characters, and there is an interaction relationship between the preview touch area and the editing area, and the interaction relationship is: according to a second contact instruction received in the preview touch area for a single text to be edited in the linkage file, start a text editing mode for the single text to be edited in the editing area.

[0171] In a possible embodiment, the first user interface further includes a linkage response area, which is used to quickly locate and mark the single text to be edited in the linkage file according to the second contact instruction.

[0172] In a possible embodiment, in terms of displaying the first user interface on the first screen, the first display unit 131 is specifically further configured to: respond to an automatically reported second start instruction; according to the second start instruction, display the first user interface on the first screen, where the first user interface includes a report display area for displaying the inspection report, and the inspection report includes at least one second file to be linked; and the step of displaying the second user interface on the second screen includes: according to the second start instruction, display the second user interface on the second screen, where at least a partial area of the second user interface includes a first area for quickly selecting, in the second file to be linked, the linked file displayed in the display area.

[0173] It can be understood that since the method embodiment and the device embodiment are different presentation forms of the same technical concept, the content of the method embodiment part in this application should be synchronously adapted to the device embodiment part, and will not be elaborated here.

[0174] In the case of adopting an integrated unit, please refer to Figure 14 , Figure 14 is a functional unit composition block diagram of another display control device of an endoscope system provided by an embodiment of the present application. As Figure 14 shown, the display control device 130 of the endoscope system includes: a processing module 1302 and a communication module 1301. The processing module 1302 is used to control and manage the actions of the display control device 130 of the endoscope system. For example, it executes the steps of the first display unit 131, the second display unit 132, the response unit 133, and the adjustment unit 134, and / or is used to execute other processes of the technologies described herein. The communication module 1301 is used for the interaction between the display control device 130 of the endoscope system and other devices. As Figure 14 shown, the display control device 130 of the endoscope system may further include a storage module 1303, and the storage module 1303 is used to store the program code and data of the display control device 130 of the endoscope system.

[0175] Among them, the processing module 1302 can be a processor or a controller. For example, it can be a Central Processing Unit (CPU), a general-purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logical blocks, modules, and circuits described in connection with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and so on. The communication module 1301 can be a transceiver, an RF circuit, a communication interface, etc. The storage module 1303 can be a memory.

[0176] Among them, all relevant contents of each scenario involved in the above method embodiments can be cited in the function descriptions of the corresponding functional modules, and will not be elaborated here. The display control device 130 of the above endoscope system can execute the above Figure 2 display control method of the endoscope system shown.

[0177] Please refer to Figure 15 , Figure 15 which is a schematic structural diagram of an electronic device proposed in an embodiment of this application. As Figure 15 shown, the electronic device 1500 includes a processor 1510, a memory 1520, a communication interface 1530, and one or more programs 1521. The above one or more programs 1521 are stored in the above memory and are configured to be executed by the above processor. When the program is executed, it includes some or all of the steps of any of the display control methods of the endoscope system described in the above method embodiments. The processor, the memory, and the communication interface are interconnected and complete the communication work between them.

[0178] Among them, the memory can be a volatile memory such as a Dynamic Random Access Memory (DRAM), or a non-volatile memory such as a mechanical hard disk. The above memory is used to store a set of executable program codes. The above processor is used to call the executable program codes stored in the memory and can execute some or all of the steps of any of the display control methods of the endoscope system described in the above process configuration method embodiments.

[0179] It can be seen that for the electronic device 1500 described in the embodiments of the present application, first, a first user interface is displayed on the first screen. In the screen linkage mode, at least a partial area of the first user interface is a display area for displaying linked files. Then, a second user interface is displayed on the second screen. In the screen linkage mode, at least a partial area of the second user interface is a touch interaction area for carrying out user touch operations. Then, a first contact instruction received in the touch interaction area is responded to. Finally, according to the associated function corresponding to the first contact instruction, the display area and / or the linked files are adjusted.

[0180] Based on the dual-screen screen linkage mode of the present application, through the contact instruction in the touch interaction area of the second screen, the display area for displaying linked files and / or the linked files on the first screen are correspondingly adjusted, realizing cross-screen interactive display control, providing a more convenient operation method for users, and thus improving the interaction efficiency and the task processing efficiency.

[0181] The embodiments of the present application further provide a computer storage medium. The computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute some or all of the steps of any of the methods recorded in the above method embodiments. The above computer includes an electronic device.

[0182] The embodiments of the present application further provide a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable a computer to execute some or all of the steps of any of the methods recorded in the above method embodiments. The computer program product can be a software installation package, and the above computer includes an electronic device.

[0183] It should be noted that for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should know that the present application is not limited by the described action sequence, because according to the present application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all optional embodiments, and the actions and modules involved are not necessarily essential to the present application.

[0184] In the above embodiments, the descriptions of the various embodiments have their own focuses. For the parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0185] In several embodiments provided by the present application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed coupling or direct coupling or communication connection between each other can be through some interfaces. The indirect coupling or communication connection of the device or unit can be in electrical or other forms.

[0186] The units described as separate components may or may not be physically separated. The components displayed as units may or may not be physical units, that is, they can be located in one place or distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0187] In addition, in each embodiment of the present application, the functional units can be integrated in a processing unit, or each unit can exist physically alone, or two or more units can be integrated in one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software program modules.

[0188] If the above-mentioned integrated unit is implemented in the form of a software program module and sold or used as an independent product, it can be stored in a computer-readable memory. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions to enable a computer device (which can be a personal computer, a server or a network device, etc.) to execute all or part of the steps of the methods described in each embodiment of the present application. And the aforementioned memory includes: USB flash drives, read-only memories (ROM), random access memories (RAM), mobile hard disks, magnetic disks or optical disks and other media that can store program codes.

[0189] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program. The program can be stored in a computer-readable memory. The memory can include: flash drives, read-only memories, random access memories, magnetic disks or optical disks, etc.

[0190] The above has introduced the embodiments of the present application in detail. Specific examples are used herein to illustrate the principle and embodiments of the present application. The description of the above embodiments is only for helping to understand the method and its core idea of the present application; at the same time, for those of ordinary skill in the art, according to the idea of the present application, there will be changes in the specific embodiments and application scope. In summary, the content of this specification should not be construed as a limitation on the present application.

Claims

1. A display control method for an endoscope system, characterized in that A processor applied to an endoscope system; the endoscope system further includes an endoscope insertion end, a first screen, and a second screen, and the second screen is configured as a touch screen; when the endoscope insertion end is in a working state, at least a partial area of the first screen is used to display real-time images collected by the endoscope insertion end; the method includes: Display a first user interface on the first screen. In the screen linkage mode, at least a partial area of the first user interface is a display area for displaying linkage files; Display a second user interface on the second screen. In the screen linkage mode, at least a partial area of the second user interface is a touch interaction area for carrying out user touch operations; Respond to a first contact instruction received in the touch interaction area; Adjust the display area and / or the linkage file according to the associated function corresponding to the first contact instruction.

2. The method according to claim 1, wherein The linkage file includes one or more of images, videos, or texts.

3. The method according to claim 2, characterized in that The linkage file is the image or a combined file including the image; the first contact instruction includes a first switching instruction, a zoom-in instruction, a zoom-out instruction, or a second switching instruction; wherein, The associated function corresponding to the first switching instruction is used to adjust the linkage file and display an adjacent linkage file of the linkage file in the display area; The associated function corresponding to the zoom-in instruction is used to adjust the display area and / or the linkage file; The associated function corresponding to the zoom-out instruction is used to adjust the display area and / or the linkage file; The associated function corresponding to the second switching instruction is used to adjust the linkage file and switch the partial content of the linkage file displayed in the display area.

4. The method according to claim 2, wherein The linkage file is the video or a combined file including the video; the first contact instruction includes a first switching instruction, a play instruction, a stop play instruction, or a slide instruction; wherein, The associated function corresponding to the first switching instruction is used to adjust the linkage file and display an adjacent linkage file of the linkage file in the display area; The associated function corresponding to the play instruction is used to adjust the linkage file and start playing the video in the display area; The associated function corresponding to the stop play instruction is used to adjust the linkage file and stop playing the video in the display area; The associated function corresponding to the slide instruction is used to adjust the linkage file and adjust the playing progress of the video in the display area.

5. The method according to claim 2, characterized in that, The linkage file is the text or a combined file including the text; the first contact instruction is an edit instruction, and the associated function corresponding to the edit instruction is used to adjust the linkage file and update the display of the linkage file displayed in the display area according to the text information input corresponding to the edit instruction.

6. The method according to claim 1, wherein The displaying the first user interface on the first screen includes: Respond to a first start instruction of the screen linkage mode, and the first start instruction includes start information of the screen linkage mode and linkage file information required for interaction after starting the screen linkage mode; According to the linked file information, display a user interface corresponding to the linked file information on the first screen; The display of the second user interface on the second screen includes: According to the linked file information, display a user interface corresponding to the linked file information on the second screen.

7. The method according to claim 1 or 6, characterized in that, The display of the first user interface on the first screen includes: Determine the operating state of the insertion end of the endoscope; According to the operating state, display a user interface corresponding to the operating state on the first screen; The display of the second user interface on the second screen includes: According to the operating state, display a user interface corresponding to the operating state on the second screen.

8. The method according to claim 7, wherein The operating state includes a working state or a non-working state; if the operating state is the working state and the first contact instruction is a magnification instruction, then in the first user interface, the positional relationship between at least a partial area where the real-time image is located and the display area changes from a non-overlapping state to an overlapping state.

9. The method according to claim 1, wherein The linked file is an image, a video, a combined file including the image, or a combined file including the video; the second user interface further includes a first preview area and / or a progress bar touch area; the first preview area includes a plurality of first files to be linked, for quickly selecting the linked file displayed in the display area; the progress bar touch area is used to control the playback progress of the linked file in the display area.

10. The method according to claim 1 or 9, characterized in that The linked file is a text or a combined file including the text; the second user interface further includes a preview touch area and an editing area. The preview touch area is used to display the linked file including a plurality of texts to be edited, and the editing area is used to input text characters. There is an interaction relationship between the preview touch area and the editing area, and the interaction relationship is: according to the second contact instruction received in the preview touch area for a single text to be edited in the linked file, start the text editing mode of the single text to be edited in the editing area.

11. The method according to claim 10, wherein The first user interface further includes a linked response area, and the linked response area is used to quickly locate and mark the single text to be edited in the linked file according to the second contact instruction.

12. The method according to claim 1, wherein The display of the first user interface on the first screen includes: Respond to the second start instruction of the automatic report; According to the second start instruction, display the first user interface on the first screen. The first user interface includes a report display area, and the report display area is used to display an inspection report, and the inspection report includes at least one second file to be linked; The display of the second user interface on the second screen includes: According to the second start instruction, display the second user interface on the second screen. At least a partial area of the second user interface includes a second preview area, and the second preview area is used to quickly select the linked file to be displayed in the display area from among the at least one second file to be linked.

13. An endoscope system, characterized in that, The endoscopic system includes: a processor, a first screen, a second screen, and an endoscopic insertion end; the second screen is configured as a touch screen; when the endoscopic insertion end is in a working state, at least a partial area of the first screen is used to display real-time images acquired by the endoscopic insertion end; the processor is configured to implement the method according to any one of claims 1-12.

Images