Medical visualization system with user interface

Abstract

Various aspects of a video processing device operable to receive image data from an endoscope having an image sensor configured to generate image data indicative of a view from the endoscope are disclosed. The video processing device comprises a housing, a processing unit adapted to receive the image data from the endoscope when the image data is generated and to cause a display to display a graphical user interface. The graphical user interface includes a plurality of non-overlapping portions, the plurality of non-overlapping portions including a first portion and a second portion, where the first portion is disposed proximate the second portion along a second direction. The present disclosure provides various advantageous improvements in the disclosed video processing device, facilitating easier and more efficient operation of the video processing device.

Description

Technical Field

[0001] The present disclosure relates to a medical visualization system and its elements. In particular, a medical visualization system includes a video processing device with a graphical user interface. The medical visualization system may also include a medical visualization device, such as an endoscope. Background Art

[0002] An endoscope can be used to visually inspect certain areas of the human body, such as the interior of a body cavity. For example, an endoscope can be used to inspect the airway, digestive tract, or intestines.

[0003] The endoscope can be provided with a camera and attached to a video processing device (e.g., a video processing device having a display screen), and the video output from the endoscope's camera can be received and displayed at the video processing device or the coupled display screen, thereby allowing the operator to control the endoscope to inspect an area of ​​interest.

[0004] The endoscope can include an operating handle at the proximal end and an insertion wire extending from the handle toward the distal end. The handle is configured to be held by an operator and, in particular, includes an externally protruding operating member connected to an internal control device, thereby allowing the operator to control the movement of a curved segment near the distal end of the insertion wire when the distal end of the insertion wire is advanced to a desired position (e.g., within a human body cavity). In some cases, the endoscope can include a control interface (e.g., as an alternative or supplement to the operating handle) that can be controlled by a robot, such as for robot-assisted surgery. With the aid of a coupled video processing device (e.g., a video processing device with a display screen), the endoscope can be used to view the position to which the distal end has been advanced. As an exemplary alternative to an endoscope including an insertion wire, the endoscope can be a laryngoscope, which is a more rigid type of endoscope, typically having an L-shape, for viewing the larynx.

[0005] The endoscope may be a disposable endoscope. It is generally advantageous for the endoscope to be disposable in order to avoid harsh cleaning processes and the risk of cross contamination between patients.

[0006] The video processing device may be provided with certain functionality, such as the ability to save still images and / or video sequences of views from an attached visualization device. In addition, the video processing device may include some image processing capabilities and / or may be configured to output video or image output (e.g., to an external display). Summary of the Invention

[0007] It is an object of the present disclosure to provide a solution that at least improves upon the solutions of the prior art.In particular, it is an object of the present disclosure to provide a medical visualization system and elements thereof.

[0008] The present disclosure is set forth in the following claims.

[0009] In particular, a video processing device and a medical visualization system are disclosed, the medical visualization system including such a video processing device and an endoscope. The endoscope has an image sensor (e.g., a camera module) configured to generate image data indicative of a view from the endoscope. The endoscope may be a disposable endoscope. The video processing device is operable to receive image data from the endoscope.

[0010] The video processing device includes a housing and a processor. The processor is suitable for receiving the image data from the endoscope when the image data is generated. The processor is further suitable for causing a display (a display of the video processing device itself and / or an external display) to display a graphical user interface. The graphical user interface extends a first length along a first direction (e.g., a vertical direction) and extends a second length along a second direction perpendicular to the first direction (e.g., a horizontal direction). The graphical user interface includes a plurality of non-overlapping parts, the plurality of non-overlapping parts including a first part and a second part, wherein the first part is arranged adjacent to the second part along the second direction. The plurality of non-overlapping parts may include a third part and / or a fourth part.

[0011] In a first aspect of the present disclosure, the video processing device displays a live representation of the image data within a first portion of the graphical user interface. The live representation is displayed at full size covering a first length along the first direction.

[0012] The video processing device is adapted to detect a first user input signal indicative of a request to activate a freeze function, and in response to detecting the first user input signal, the video processing device activates the freeze function. Activating the freeze function includes: ceasing to display the live representation of the image data within the first portion of the graphical user interface; displaying within the first portion of the graphical user interface a first representation of a still image corresponding to the image data received when the first user input signal was detected, wherein the first representation of the still image is displayed at full size; and displaying within the second portion of the graphical user interface a live representation of the image data, wherein the live representation is displayed at a reduced size that is smaller than the full size.

[0013] Advantages of the first aspect of the present disclosure include that it gives the operator the opportunity to more conveniently perform a closer inspection of the view during surgery, and before deciding to store the image for later retrieval, the operator can review the image to confirm that what the operator is trying to capture is indeed seen in the picture, and / or ensure that the picture quality meets expectations / requirements.

[0014] In a second aspect of the present disclosure, the video processing device further includes a peripheral input device interface (e.g., including a USB interface, a Bluetooth transceiver, and / or another interface type known in the art), the peripheral input device interface being adapted to couple the video processing device to one or more peripheral input devices (e.g., a foot pedal, a keyboard, a mouse, a trackpad, a game controller, etc.). The processing unit may be adapted to detect one or more peripheral input signals from the one or more peripheral input devices.

[0015] In the second aspect, the video processing device displays a shortcut setting user interface within the first portion of the graphical user interface. While displaying the shortcut setting user interface, the video processing device is adapted to detect a first peripheral input signal from a first peripheral input device coupled to the video processing device (via the peripheral input device interface). The first peripheral input signal indicates activation of an input component of the first peripheral input device.

[0016] In response to detecting the first peripheral input signal, the video processing device displays a shortcut indicator that indicates an input component of the first peripheral input device associated with the first peripheral input signal; and displays a function selection interface that includes two or more representations of two or more functions that can be assigned to the input component of the first peripheral input device.

[0017] When displaying the function selection interface, the video processing device is adapted to detect a first user input signal indicating selection of a first function among the two or more functions. In response to detecting the first user input, the video processing device stores first shortcut information, the first shortcut information including assigning the first peripheral input signal to the first function.

[0018] After storing the first shortcut information, the video processing device is adapted to detect a first peripheral input signal from the first peripheral input device. In response to detecting the first peripheral input signal, the video processing device activates the first function according to the video processing device operating in a first mode in which the first function is available.

[0019] An advantage of the second aspect of the present disclosure is that it allows a user to configure a peripheral input device (e.g., a USB device) to perform a desired function (such as storing images and / or recording video), thereby helping the user perform the procedure more efficiently without requiring much assistance. Another advantage is that by allowing a peripheral input device to activate certain functions, remote activation of certain functions can be achieved without requiring the endoscope to include programmable buttons. Thus, the second aspect of the present disclosure enhances the flexibility of using the video processing device in combination with a range of different endoscopes.

[0020] In a third aspect of the present disclosure, the video processing device displays a patient information panel within the second portion of the graphical user interface. The video processing device may display a live representation of the image data within the first portion of the graphical user interface. The patient information panel includes a title portion and a detail portion, the detail portion further including detailed patient information and a hide button. The video processing device is further adapted to detect a first user input corresponding to a selection of the hide button.

[0021] In response to detecting the first user input and based on the hidden data function being in an activated state when the first user input is detected, the video processing device deactivates the hidden data function, including displaying the first patient information in the title portion. In response to detecting the first user input and based on the hidden data function not being in an activated state when the first user input is detected, the video processing device activates the hidden data function, including ceasing to display the first patient information in the title portion.

[0022] The video processing device is further adapted to detect a second user input indicating a request to toggle the detailed portion of the patient information panel. In response to detecting the second user input and in accordance with the detailed portion being displayed when the second user input is detected, the video processing device stops displaying the detailed portion of the patient information panel. In response to detecting the second user input and in accordance with the detailed portion not being displayed when the second user input is detected, the video processing device displays the detailed portion of the patient information panel.

[0023] The advantage of the third aspect of the present disclosure is that it provides the operator with a convenient possibility to conceal patient information where appropriate (e.g. where bystanders are involved in the procedure). Furthermore, this third aspect provides a balanced approach where patient information can be concealed while still providing the operator with the possibility to easily access that information where required.

[0024] In a fourth aspect of the present disclosure, the video processing device retrieves worklist data from a remote server. The worklist data includes patient information data of a plurality of scheduled surgeries.

[0025] The video processing device opens a surgical session and displays a live representation of the image data within the first portion of the graphical user interface. Alternatively, the video processing device displays a plurality of representations corresponding to a plurality of stored data files stored during the surgical session within the first portion of the graphical user interface.

[0026] The video processing device displays a patient information panel within the second portion of the graphical user interface. The patient information panel includes a worklist portion including a plurality of selectable patient information items corresponding to the patient information data of the worklist data.

[0027] The video processing device is adapted to detect a first user input corresponding to selecting a first patient information item from the plurality of selectable patient information items. Based on detecting the first user input, the video processing device assigns first patient information data corresponding to the first patient information item to the surgical session.

[0028] Advantages of the fourth aspect of the present disclosure include: easily assigning patient data to an ongoing (new) surgical session or a previously performed surgical session, and increasing the likelihood that the patient data assigned to a session (and indeed to stored images / videos) is complete, correct, and / or consistent with the patient's other records.

[0029] In a fifth aspect of the present disclosure, the video processing device opens a surgical session and displays a live representation of the image data within the first portion of the graphical user interface. Alternatively, the video processing device displays a plurality of representations corresponding to a plurality of stored data files stored during the surgical session within the first portion of the graphical user interface.

[0030] The video processing device displays a patient input panel within the second portion of the graphical user interface, the patient input panel including one or more patient information input fields and a confirmation button. The video processing device is adapted to receive an input sequence corresponding to a sequence of characters entered into the one or more patient input fields, and a subsequent confirmation user input corresponding to selection of the confirmation button.

[0031] In response to receiving the confirmation user input, the video processing device assigns first patient information data corresponding to the sequence of characters in the one or more patient input fields to the surgical session.

[0032] An advantage of the fifth aspect of the present disclosure is that it provides for easy assignment of patient data to an ongoing (new) surgical session or a previously performed surgical session in situations where the necessary patient data cannot be automatically retrieved (as with respect to the fourth aspect of the present disclosure). This may be advantageous, for example, in situations where the surgery is an unplanned surgery where the scheduled schedule changes and / or the operator does not have the required access rights to electronically retrieve the patient data. The fifth aspect of the present disclosure is further advantageous in combination with the fourth aspect of the present solution, where the fifth aspect may provide a fallback solution in certain situations. Thus, greater flexibility is provided when using the video processing device of the present disclosure.

[0033] In a sixth aspect of the present disclosure, the video processing device includes a network interface.

[0034] The video processing device displays a network driver setup within a first portion of the graphical user interface. The network driver setup includes a plurality of network driver input fields and a confirmation button. While displaying the network driver setup, the video processing device is adapted to receive a sequence of one or more user inputs corresponding to a sequence of characters entered in the one or more network driver input fields, and a confirmation user input corresponding to selection of the confirmation button.

[0035] In response to receiving the confirmation user input, the video processing device stores network driver information for a first network driver corresponding to the sequence of characters in the one or more network driver input fields.

[0036] The advantage of the sixth aspect of the present disclosure is that it provides a simple and convenient way to enable (e.g., using a standard file sharing protocol) the stored image / video to be exported to a network drive. In addition, the sixth aspect of the present disclosure helps the video processing device to be configured to work in various IT environments.

[0037] In a seventh aspect of the present disclosure (which may be advantageously combined with the sixth aspect), the video processing device may include a network interface and / or an external communication interface (such as a USB interface).

[0038] The video processing device displays a plurality of representations corresponding to a plurality of stored data files stored during the surgical session within the first portion of the graphical user interface, and the video processing device displays an export button (e.g., within a third portion of the graphical user interface). The video processing device is adapted to detect an export user input corresponding to selection of the export button.

[0039] In response to detecting the export user input, the video processing device displays an export menu including an export confirmation button. The video processing device is adapted to receive an export confirmation user input corresponding to a selection of the export confirmation button. The export menu further includes a plurality of selectable export modalities, the plurality of selectable export modalities including: exporting to a first PACS server, and optionally exporting to a first network drive and / or exporting to a first external storage device (e.g., a USB drive). The video processing device is adapted to receive a modality selection user input corresponding to a selection of a selected export modality from the plurality of selectable export modalities.

[0040] In response to detecting the export confirmation user input and corresponding to exporting to the first network drive according to the selected export modality, the video processing device transfers the stored image data corresponding to one or more of the plurality of stored data files to the first network drive.

[0041] In response to detecting the export confirmation user input and corresponding to exporting to the first external storage device according to the selected export modality, the video processing device transfers the stored image data corresponding to one or more of the multiple stored image data files to the first external storage device (e.g., the first USB drive).

[0042] The advantage of the seventh aspect of the present disclosure is that it provides multiple possible ways to easily and conveniently export stored images / videos. The seventh aspect of the present disclosure also promotes the use of standard or de facto standard devices and / or protocols, thereby simplifying the use and increasing the flexibility of using the video processing device.

[0043] As will become apparent in the following description, it should be noted that the above-mentioned aspects of the present disclosure can be combined in any convenient manner and, therefore, can form multiple parts of the same graphical user interface. In addition, the examples of the various aspects as described in this disclosure can be combined as appropriate, and it should be noted that all of the mentioned aspects and examples can be employed on a single video processing device.

[0044] Overview

[0045] A video processing device and a medical visualization system are disclosed. The medical visualization system includes the video processing device and an endoscope. The endoscope has an image sensor (e.g., a camera module) configured to generate image data indicating a view from the endoscope. The endoscope may be a disposable endoscope. The video processing device is operable to receive image data from the endoscope.

[0046] The endoscope (e.g., a handle of the endoscope) may include one or more buttons. The endoscope may be adapted to transmit (e.g., to the video processing device) one or more corresponding endoscopic signals indicating that a user has activated a corresponding button on the endoscope. For example, the one or more buttons may include a first button, and the endoscope may be adapted to transmit (e.g., to the video processing device) a first endoscopic signal indicating that a user has activated the first button. The one or more buttons may include a second button, and the endoscope may be adapted to transmit (e.g., to the video processing device) a second endoscopic signal indicating that a user has activated the second button. The video processing device may be adapted to detect the one or more endoscopic signals.

[0047] The video processing device includes a housing and a processor.The video processing device may include electronic memory, which may include volatile and / or non-volatile memory.

[0048] The processor is adapted to receive the image data from the endoscope as the image data is generated. The processor is further adapted to cause a display to display a graphical user interface. The video processing device may include the display. For example, the display may be housed in a housing of the video processing device. Alternatively or additionally, the display may be an external display coupled to the video processing device, such as to allow the video processing device to cause the external display to display the graphical user interface and / or auxiliary graphical user interface.

[0049] The display may be a touch sensitive display. Thus, when reference is made to user input hereinafter, this may typically be a touch user input detected by the touch sensitive display. However, alternatively, the video processing unit may be controlled by other means, such as a mouse or another human interface device (HID).

[0050] The graphical user interface extends along a first direction (e.g., the vertical direction of the display) by a first length and extends along a second direction perpendicular to the first direction (e.g., the horizontal direction of the display) by a second length. The second length may be greater than the first length. For example, the ratio between the second length and the first length may be 4:3, 16:9, or 16:10.

[0051] The graphical user interface includes a plurality of non-overlapping parts, the plurality of non-overlapping parts including a first part and a second part, wherein the first part is arranged adjacent to the second part along the second direction. Each of these parts can substantially extend throughout the first length in the first direction. The plurality of non-overlapping parts can include a third part and / or a fourth part. The first part can be arranged between the third part and the second part along the second direction. The second part can be arranged between the fourth part and the first part along the second direction. The fourth part can be arranged between one side of the display and the second part along the second direction. The third part can be arranged between the other (opposite) side of the display and the first part along the second direction. The first part and the second part can be arranged between the third part and the fourth part along the second direction.

[0052] The video processing device may display a live representation of the image data within the first portion of the graphical user interface. The live representation may be displayed at full size covering the first length along the first direction.

[0053] The video processing device may be adapted to detect a first user input signal indicating a request to activate a freeze function. In response to detecting the first user input signal, the video processing device may activate the freeze function. Activating the freeze function may include: ceasing to display the live representation of the image data within the first portion of the graphical user interface; displaying within the first portion of the graphical user interface a first representation of a still image corresponding to the image data received when the first user input signal was detected, wherein the first representation of the still image is displayed at full size; and displaying within the second portion of the graphical user interface a live representation of the image data, wherein the live representation is displayed at a reduced size that is less than full size.

[0054] Displaying the first representation of the still image within the first portion of the graphical user interface may include displaying a freeze indicator element that covers a portion of the first representation of the still image. Thus, the video processing device may utilize the freeze indicator element to provide a visual indication that the currently displayed representation is not a live view but a still image.

[0055] When the freeze function is activated, the video processing device may be adapted to detect a second user input signal indicating a request to deactivate the freeze function. In response to detecting the second user input signal, the video processing device may deactivate the freeze function. Deactivating the freeze function may include: ceasing to display the first representation of the still image within the first portion of the graphical user interface; displaying a live representation of the image data within the first portion of the graphical user interface, wherein the live representation is displayed at full size; and ceasing to display the live representation of the image data within the second portion of the graphical user interface.

[0056] The video processing device may be adapted to detect user input to the live representation of the image data being displayed in the second portion of the graphical user interface. The second user input signal may be issued by detecting user input to the live representation of the image data. For example, the user may provide user input to the live representation in the second portion and thereby deactivate the freeze function.

[0057] The video processing device may be adapted to detect disconnection of the endoscope. The second user input signal may be issued in response to detecting that the endoscope is disconnected from the video processing device. For example, if the endoscope is disconnected from the video processing device, the video processing device may automatically disable the freeze function.

[0058] The video processing device can be adapted to detect the connection of an endoscope. In some examples, the video processing device can be adapted to facilitate the simultaneous connection of more than one endoscope. Thus, the video processing device can be adapted to detect the connection of an endoscope, which can be a first endoscope and / or a second endoscope. The second user input signal can be issued in response to detecting the connection of the first endoscope and / or the second endoscope to the video processing device. For example, if an additional / second endoscope is connected to the video processing device, the video processing device can automatically deactivate the freeze function.

[0059] The video processing device can, for example, display a freeze button in the third part of the graphical user interface. The video processing device can be suitable for detecting a user input corresponding to the selection of the freeze button. The first user input signal can be issued by detecting a user input corresponding to the selection of the freeze button. Therefore, the user can request to activate the freeze function by providing a user input to the freeze button. Alternatively or additionally, the second user input signal can be issued by detecting a user input corresponding to the selection of the freeze button. Therefore, the user can request to deactivate the freeze function by providing a user input to the freeze button. In some examples, the freeze button can work as a toggle button, which works for activating the freeze function when the freeze function is not in an activated state and deactivating the freeze function when the freeze function is in an activated state.

[0060] The video processing device can be adapted to detect a first endoscopic signal from the endoscope, the first endoscopic signal instructing a user to activate a first button on the endoscope. The first user input signal can be issued upon detecting the first endoscopic signal. Thus, the user can request activation of the freeze function by activating the first button on the endoscope. Alternatively or additionally, the second user input signal can be issued upon detecting the first endoscopic signal. Thus, the user can request deactivation of the freeze function by activating the first button on the endoscope. In some examples, the first button on the endoscope can function as a toggle button that is operable to activate the freeze function when the freeze function is not activated, and to deactivate the freeze function when the freeze function is activated.

[0061] When the freeze function is active, the video processing device is adapted to detect a third user input signal indicating a request to store a still image (i.e., a still image whose first representation is being displayed within the first portion of the graphical user interface). In response to detecting the third user input signal, the video processing device may store, in an electronic memory of the video processing device, an image data file corresponding to the image data received when the first user input signal was detected. The image data file (stored in response to detecting the third user input signal while the freeze function is active) may include information indicating that the image data file was captured while the freeze function was active. For example, the freeze indicator element may be included in the image data file, e.g., overlaying a portion of the still image.

[0062] The video processing device can, for example, display one or more actionable items in the third portion of the graphical user interface. The one or more actionable items may include an image capture button. The video processing device can be adapted to detect a capture user input (e.g., a touch input) corresponding to selecting the image capture button. The third user input signal can be sent by a user input corresponding to selecting the image capture button.

[0063] The video processing device may be adapted to detect a second endoscope signal from the endoscope, the second endoscope signal indicating that a user has activated a second button on the endoscope (e.g., a button different from the first button of the endoscope mentioned previously). The third user input signal may be issued by detecting the second endoscope signal.

[0064] In response to detecting the third user input signal, the video processing device may further deactivate the freeze function.Thus, the video processing device may automatically deactivate the freeze function after storing the image corresponding to the representation currently being displayed in the first portion.

[0065] In response to detecting the third user input signal, the video processing device may display the first representation of the still image within the second portion of the graphical user interface (e.g., at a location different from the location where the live representation was displayed when the freeze function was activated). After a predetermined delay after detecting the third user input signal, the video processing device may cease displaying the first representation of the still image within the second portion of the graphical user interface.

[0066] The video processing device may include one or more image modification functions. The one or more image modification functions may include one or more of the following: ARC (Advanced Red Contrast), color adjustment, contrast adjustment, sharpness adjustment, image brightness adjustment, zoom function, rotation of the live representation, and endoscope light on / off. For each of the one or more images, each of the one or more image modification functions, when activated, may modify one or more parameters of the live representation of the image data. The one or more image modification functions may be activatable when the freeze function is not activated. The one or more image modification functions may be inactivatable (e.g., disabled and / or unavailable) when the freeze function is activated.

[0067] When the freeze function is active, the video processing device may, in response to detecting a fourth user input signal indicating a request to activate an image modification function among the one or more image modification functions, display a notification, for example within the second portion of the graphical user interface, indicating that the image modification function is disabled while the freeze function is active.

[0068] The video processing device may include an endoscope light switch function. The endoscope light switch function, when activated, may cause the light emitter of the endoscope to be deactivated. The endoscope light switch function may be activatable when the freeze function is not activated. The endoscope light switch function may be inactivatable (e.g., disabled and / or unavailable) when the freeze function is activated.

[0069] The video processing device may, in response to detecting the first user input signal, activate the freeze function based on the endoscope's light emitter being in an activated state. The video processing device may, in response to detecting the first user input signal, forgo activating the freeze function based on the endoscope's light emitter being in an inactive state. Thus, the user may be allowed to activate the freeze function when the endoscope's light emitter is in an activated state, and / or the user may not be allowed to activate the freeze function when the endoscope's light emitter is in an inactive state.

[0070] The video processing device may include a peripheral input device interface that is suitable for coupling the video processing device to one or more peripheral input devices. The peripheral input device interface may include a USB interface, a Bluetooth transceiver and / or another interface type known in the art. The one or more peripheral input devices may include (or may be) a foot pedal, a keyboard, a mouse, a trackpad, a game controller, or other devices capable of providing input signals to the video processing device. The one or more peripheral input devices may generate and transmit one or more peripheral input signals. The processing unit may be suitable for detecting one or more peripheral input signals from the one or more peripheral input devices (e.g., when coupled to the video processing device via the peripheral input device interface).

[0071] The video processing device may display a shortcut setting user interface in the first portion of the graphical user interface. The shortcut setting user interface may include instructions for connecting a first peripheral input device and / or for activating an input component of the first peripheral input device.

[0072] The video processing device may store one or more user profiles, each user profile including a user name and a password for activating an authorization mode of the video processing device. In some examples, the shortcut setting user interface is displayed based on the authorization mode being activated.

[0073] When displaying the shortcut setting user interface, the video processing device is adapted to detect a first peripheral input signal from the first peripheral input device, the first peripheral input device being coupled to the video processing device (e.g., via the peripheral input device interface). The first peripheral input signal may indicate activation of an input component of the first peripheral input device.

[0074] In response to detecting the first peripheral input signal, the video processing device may display a shortcut indicator, for example, within the shortcut setting user interface. The shortcut indicator may indicate an input component of the first peripheral input device associated with the first peripheral input signal.

[0075] In response to detecting the first peripheral input signal and based on the video processing device including shortcut information (e.g., in the electronic memory) that assigns the first peripheral input signal to a previous function, the video processing device can display a warning message. The warning message can include information about the previous function. This allows the operator to be aware of what feature is already associated with the input component of the first peripheral input device and that the association may be overwritten if the setting is continued.

[0076] In response to detecting the first peripheral input signal, the video processing device may display a cancel button selectable for exiting the shortcut setting user interface.

[0077] In further response to detecting the first peripheral input signal, the video processing device may display a function selection interface, for example within the shortcut setting user interface. The function selection interface may include two or more representations of two or more functions assignable to the input component of the first peripheral input device.

[0078] The two or more functions assignable to the input component of the first peripheral input device may include a capture image function that causes the video processing device to store an image data file corresponding to image data received when the capture image function is activated. Alternatively or additionally, the two or more functions assignable to the input component of the first peripheral input device may include a video capture function that causes the video processing device to store an image data video sequence corresponding to image data received when the video capture function is activated.

[0079] When displaying the function selection interface, the video processing device may be adapted to detect a first user input indicating a selection of a first function among the two or more functions. For example, the first function may be the capture image function, or the first function may be the video capture function. In response to detecting the first user input, the video processing device may store first shortcut information, the first shortcut information including assigning the first peripheral input signal to the first function.

[0080] In response to detecting the first user input (before, after, or simultaneously with storing the first shortcut information), the video processing device may display a naming dialog. The naming dialog may include an input text field. The naming dialog may be adapted to receive a first user input name, the first user input name being used to identify the designation of the first peripheral input signal to the first function. The stored first shortcut information may include the first user input name. Based on the first user input name not being received or the first user input name being empty or invalid, the stored first shortcut information may include a default name and / or a system-generated name.

[0081] The video processing device may be adapted to detect a user input corresponding to selecting the cancel button. In response to detecting the user input corresponding to selecting the cancel button, the video processing device may exit the shortcut setting user interface and abandon storing the first shortcut information.

[0082] After storing the first shortcut information, the video processing apparatus may be adapted to detect a first peripheral input signal from the first peripheral input device.

[0083] In response to detecting the first peripheral input signal, the video processing device can activate the first function, for example, based on the video processing device operating in a first mode in which the first function is available. When operating in the first mode, the video processing device can display a live representation of the image data within the first portion of the graphical user interface.

[0084] In response to detecting the first peripheral input signal, the video processing device may display an error notification in the graphical user interface and may forgo activating the first function, e.g., based on the video processing device operating in the second mode in which the first function is unavailable. The error notification may be displayed in the second portion of the graphical user interface. Certain circumstances may cause the video processing device to operate in the second mode. For example, the video processing device may operate in the second mode when no live representation of the image data is displayed and / or when no endoscope is connected to the video processing device.

[0085] For example, the video processing device may display a live representation of the image data within a first portion of the graphical user interface while the video processing device may display a patient information panel within a second portion of the graphical user interface. The patient information panel may include a title portion and a details portion. The details portion may include detailed patient information and a hidden button. The detailed patient information may include the patient's name, personal identification number, date of birth, and / or gender. The video processing device may be adapted to detect a hidden user input corresponding to selection of the hidden button.

[0086] In response to detecting the hidden user input and based on the hidden data function being active when the hidden user input was detected, the video processing device may deactivate the hidden data function. Deactivating the hidden data function may include displaying first patient information in the header portion. The first patient information may include the patient's name and / or the patient's personal identification number. The detailed patient information may include the first patient information. In response to detecting the hidden user input and based on the hidden data function not being active when the hidden user input was detected, the video processing device may activate the hidden data function. Activating the hidden data function may include stopping displaying the first patient information in the header portion.

[0087] Deactivating the hide data function may include changing the visual appearance of the hide button to a first appearance (e.g., a first color). Activating the hide data function may include changing the visual appearance of the hide button to a second appearance (e.g., a second color) different from the first appearance.

[0088] The video processing device may be further adapted to detect a detail user input indicating a request to switch a detail portion of the patient information panel.The request to switch the detail portion may be a user input corresponding to selecting an expand icon.

[0089] In response to detecting the detail user input and in accordance with the detail portion being displayed when the detail user input is detected, the video processing device may cease displaying the detail portion of the patient information panel. In response to detecting the detail user input and in accordance with the detail portion not being displayed when the detail user input is detected, the video processing device may display the detail portion of the patient information panel.

[0090] The video processing device may include a display interface, such as DVI, HDMI or other, suitable for connecting the video processing device to an external display. The video processing device may be suitable for causing the external display to display an auxiliary graphical user interface. The auxiliary graphical user interface may extend a first auxiliary length along a first auxiliary direction (e.g., the vertical direction of the external display) and extend a second auxiliary length along a second auxiliary direction perpendicular to the first auxiliary direction (e.g., the horizontal direction of the external display). The second auxiliary length may be greater than the first auxiliary length. For example, the ratio between the second auxiliary length and the first auxiliary length may be 4:3, 16:9 or 16:10.

[0091] The auxiliary graphical user interface may include a plurality of non-overlapping auxiliary parts, the plurality of non-overlapping auxiliary parts including a first auxiliary part and a second auxiliary part, wherein the first auxiliary part is arranged adjacent to the second auxiliary part along the second auxiliary direction. Each of these auxiliary parts may substantially extend over a first auxiliary length in the first auxiliary direction. The plurality of non-overlapping auxiliary parts may include a third auxiliary part and / or a fourth auxiliary part. The first auxiliary part may be arranged between the third auxiliary part and the second auxiliary part along the second auxiliary direction. The second auxiliary part may be arranged between the fourth auxiliary part and the first auxiliary part along the second auxiliary direction. The fourth auxiliary part may be arranged between one side of the external display and the second auxiliary part along the second auxiliary direction. The third auxiliary part may be arranged between the other (opposite) side of the external display and the first auxiliary part along the second auxiliary direction. The first auxiliary part and the second auxiliary part may be arranged between the third auxiliary part and the fourth auxiliary part along the second auxiliary direction.

[0092] The video processing device may display a live representation of the image data within a first auxiliary portion of the auxiliary graphical user interface.

[0093] In response to the data hiding function not being activated, the video processing device may display an auxiliary patient information panel in the second auxiliary portion of the auxiliary graphical user interface. The auxiliary patient information panel may include the detailed patient information. In response to the data hiding function being activated, the video processing device may forgo displaying the auxiliary patient information panel in the second auxiliary portion of the auxiliary graphical user interface.

[0094] In response to detecting the detail user input, and in accordance with the hide data function not being active and the detail portion not being displayed when the detail user input is detected, the video processing device may display the auxiliary patient information panel, the auxiliary patient information panel including the detailed patient information.

[0095] In response to detecting the detail user input, and based on the fact that the hide data function was not active and the detail portion was being displayed when the detail user input was detected, the video processing device can stop displaying the auxiliary patient information panel, or at least stop displaying the detailed patient information of the auxiliary patient information panel.

[0096] In response to detecting the detail user input, and based on the hide data function being active when the detail user input is detected, the video processing device may forgo displaying the auxiliary patient information panel within the second auxiliary portion of the auxiliary graphical user interface.

[0097] The video processing device may retrieve worklist data from a remote server. The video processing device and the remote server may be part of a local area network. The video processing device may retrieve the worklist data via the local area network. The worklist data may include patient information data for a plurality of scheduled surgeries.

[0098] The video processing device may open a (new) surgical session and display a live representation of the image data within the first portion of the graphical user interface. Alternatively, the video processing device may display within the first portion of the graphical user interface a plurality of representations corresponding to a plurality of stored data files stored during a (previous) surgical session.

[0099] The video processing device may display a patient information panel within the second portion of the graphical user interface. Prior to displaying the patient information panel, the video processing device may, for example, display a worklist button within the second portion of the graphical user interface. The video processing device may be adapted to detect a worklist button user input corresponding to selection of the worklist button. In response to detecting the worklist button user input, the video processing device may display the patient information panel.

[0100] The patient information panel may include a title portion. The patient information panel may include a worklist portion. The video processing device may store one or more user profiles, each user profile including a user name and password for activating an authorization mode of the video processing device. In some examples, the worklist portion is displayed based on the authorization mode being activated. The worklist portion may include a plurality of selectable patient information entries corresponding to the patient information data of the worklist data. Each of the plurality of selectable patient information entries may include one or more of a patient name, a patient identification number, and a scheduled time for surgery (e.g., including a date and a time of day).

[0101] The video processing device may be adapted to detect a first user input corresponding to selection of a first patient information item of the plurality of selectable patient information items.

[0102] Based on detecting the first user input, and optionally, detecting one or more additional user inputs (e.g., for confirming the selection), the video processing device may assign the first patient information data corresponding to the first patient information entry to a surgical session (i.e., to a newly opened surgical session in the case where the video processing device displays a live representation of the image data; or to a previous surgical session in the use case where the video processing device displays multiple representations corresponding to multiple stored data files).

[0103] In response to detecting the first user input, the video processing device may display a representation of the first patient information data and a confirmation button, for example, in a second portion of the graphical user interface. The video processing device may be adapted to detect a confirmation user input corresponding to selection of the confirmation button. In response to detecting the confirmation user input, the video processing device may assign the first patient information data to the surgical session.

[0104] The video processing device may be adapted to detect a second user input indicating a request to toggle display of the worklist portion of the patient information panel. The second user input may correspond to, for example, selecting an expand icon within the header portion of the patient information panel.

[0105] In response to detecting the second user input and in accordance with the worklist portion being displayed when the second user input is detected, the video processing device may cease displaying the worklist portion of the patient information panel. In response to detecting the second user input and in accordance with the worklist portion not being displayed when the second user input is detected, the video processing device may display the worklist portion of the patient information panel.

[0106] In response to detecting the second user input and based on the work list portion not being displayed when the second user input is detected, the video processing device may retrieve the work list data from the remote server.

[0107] The plurality of selectable patient information items in the worklist portion may be sorted in chronological order, for example, based on a scheduled surgery time.

[0108] The patient information data of the work list may include patient information data having a scheduled surgery time, the scheduled surgery time being between a first time (e.g., 12 hours) before the current system time of the video processing device and a second time (e.g., 24 hours) after the current system time. The first time may be shorter than the second time.

[0109] The selectable patient information items may include a primary selectable patient information item and a secondary selectable patient information item. The primary selectable patient information item may have a primary surgery scheduled time, and the secondary selectable patient information item may have a secondary surgery scheduled time. The secondary surgery scheduled time may be later than the primary surgery scheduled time (i.e., after the primary surgery scheduled time).

[0110] The primary selectable patient information item may be adjacent to the secondary selectable patient information item. In other words, the selectable patient information items may not have an intermediate selectable patient information item with an intermediate surgery scheduled time between the primary surgery scheduled time and the secondary surgery scheduled time.

[0111] Based on the current system time of the video processing device being between the scheduled time of the main operation and the scheduled time of the auxiliary operation, the video processing device may abandon displaying the main selectable patient information entry in the work list part when displaying the patient information panel, and may display the auxiliary selectable patient information entry in the work list part at a position adjacent to the top of the work list part.

[0112] Based on the current system time of the video processing device before the scheduled time of the main operation, the video processing device can display the primary selectable patient information item adjacent to the top of the work list portion when displaying the patient information panel, and can display the secondary selectable patient information item adjacent to the primary selectable patient information item and below the primary selectable patient information item in the work list portion.

[0113] According to the current system time of the video processing device, after the scheduled time of the auxiliary surgery, the video processing device may abandon displaying the main selectable patient information item in the work list part when displaying the patient information panel, and may abandon displaying the auxiliary selectable patient information item in the work list part.

[0114] The worklist portion may be scrollable in a first scrolling direction (e.g., parallel to or the same as the first direction) to display earlier selectable patient information items in the plurality of selectable patient information items. The worklist portion may be scrollable in a second scrolling direction (e.g., opposite to the first scrolling direction) to display later selectable patient information items in the plurality of selectable patient information items.

[0115] The video processing device may be adapted to detect connection of the endoscope. In response to detecting connection of the endoscope, the video processing device may retrieve the worklist data. In response to detecting connection of the endoscope, the video processing device may open the surgical session. In response to detecting connection of the endoscope, the video processing device may obtain device identifier information from a device identifier of the endoscope (e.g., an EPROM, a QR code, an RFID tag, NFC, etc.). The surgical session may be associated with the device identifier information.

[0116] The video processing device may display one or more actionable items within the graphical user interface (e.g., within the third portion of the graphical user interface). The one or more actionable items may include an image capture button. The video processing device may be adapted to detect a capture user input corresponding to selection of the image capture button. In response to detecting the capture user input, the video processing device may store an image data file corresponding to the image data received when the capture user input was detected. The video processing device may further associate the image data file with the surgical session.

[0117] The patient information panel may include a search bar. The video processing device may be adapted to receive an input sequence corresponding to a character sequence entered in the search bar. In response to receiving the input sequence, the video processing device may filter the displayed selectable patient information items from the plurality of selectable patient information items, for example, based on a comparison between the character sequence in the search bar and the patient information data corresponding to the plurality of selectable patient information items.

[0118] After assigning the first patient information data to the surgical session, the video processing device may display the first patient information of the first patient information data in a title portion of the patient information panel.

[0119] After assigning the first patient information data to the surgical session, the video processing device may stop displaying the worklist portion of the patient information panel.

[0120] For example, after assigning the first patient information data to the surgical session, the patient information panel may include a Change Patient button. The video processing device may be adapted to detect a change request user input corresponding to selection of the Change Patient button. In response to detecting the change request user input, the video processing device may display a confirmation dialog, for example, in the first portion of the graphical user interface or in the second portion of the graphical user interface. The confirmation dialog may include a Confirm button and a Cancel button. The video processing device may be adapted to detect a Confirm user input corresponding to selection of the Confirm button and a Cancel user input corresponding to selection of the Cancel button.

[0121] Upon detecting the confirmation user input, the video processing device may remove the designation of the first patient information data to the surgical session.The video processing device may further stop displaying the confirmation dialog and redisplay the worklist portion in the patient information panel.

[0122] Upon detecting the cancellation user input, the video processing device may maintain the assignment of the first patient information data to the surgical session.The video processing device may further stop displaying the confirmation dialog and forgo redisplaying the worklist portion in the patient information panel.

[0123] The video processing device may display a patient input panel within the second portion of the graphical user interface, the patient input panel including one or more patient information input fields and a confirmation button.

[0124] Prior to displaying the patient input panel, the video processing device may, for example, display a manual input button within the second portion of the graphical user interface. The patient information panel may include the manual input button. The video processing device may be adapted to detect a manual input button user input corresponding to selection of the manual input button. Upon detecting the manual input button user input, the video processing device may display the patient input panel within the second portion of the graphical user interface, the patient input panel including the one or more patient information input fields and a confirmation button.

[0125] The video processing device may be adapted to receive an input sequence corresponding to a sequence of characters entered in the one or more patient input fields. (e.g., after receiving the input sequence) the video processing device may be adapted to detect a confirmation user input corresponding to a selection of the confirmation button. In response to receiving the confirmation user input, the video processing device may assign manual patient information data corresponding to the sequence of characters in the one or more patient input fields to the surgical session.

[0126] After assigning the manual patient information data to the surgical session, the video processing device may stop displaying the patient input panel and may display a detailed portion including detailed patient information within the second portion of the graphical user interface. The video processing device may display the patient information panel (e.g., including the detailed portion) within the second portion of the graphical user interface. The patient information panel may include a title portion. The video processing device may display the first patient information of the manual patient information data in the title portion.

[0127] The patient information panel (e.g., displayed after assigning the manual patient information data to the surgical session) may include an edit button. The video processing device may be adapted to detect an edit button user input corresponding to a selection of the edit button. In response to detecting the edit button user input, the video processing device may (re)display the patient input panel within the second portion of the graphical user interface, the patient input panel including the one or more patient information input fields.

[0128] The patient information panel (e.g., displayed after assigning the manual patient information data to the surgical session) may include a delete button. The video processing device may be adapted to detect a delete button user input corresponding to selection of the delete button. In response to detecting the delete button user input, the video processing device may display a confirmation dialog, which may include, for example, a confirm button and / or a cancel button. The video processing device may be adapted to detect a confirm user input corresponding to selection of the confirm button. The video processing device may be adapted to detect a cancel user input corresponding to selection of the cancel button.

[0129] Upon detecting the confirmation user input, the video processing device may remove the assignment of the manual patient information data to the surgical session. The video processing device may further cease displaying the confirmation dialog and may display the manual input button within the second portion of the graphical user interface. For example, the video processing device may display a patient information panel including the manual input button.

[0130] Upon detecting the cancellation user input, the video processing device may maintain the assignment of the manual patient information data to the surgical session. The video processing device may further cease displaying the confirmation dialog and may redisplay the patient information panel within the second portion of the graphical user interface (e.g., as displayed after the manual patient information data was assigned to the surgical session).

[0131] The video processing device may include a network interface.

[0132] The video processing device may display network driver settings in the first portion of the graphical user interface. The network driver settings may include a plurality of network driver input fields and a confirmation button. The plurality of network driver input fields may include one or more of the following: a server name, a server IP address, a server port number, a directory name, and user credentials.

[0133] While displaying the network driver settings, the video processing device may be adapted to receive a sequence of one or more user inputs corresponding to entering a sequence of characters in the one or more network driver input fields.The video processing device may be adapted to detect a confirmation user input corresponding to selecting the confirmation button.

[0134] In response to receiving the confirmation user input, the video processing device may store network driver information for a first network driver corresponding to the sequence of characters in the one or more network driver input fields.

[0135] The video processing device may include the network interface and / or the external communication interface (such as a USB interface).

[0136] The video processing device may display within the first portion of the graphical user interface a plurality of representations corresponding to a plurality of stored data files stored during the surgical session.

[0137] Each of the plurality of representations corresponding to the plurality of stored image data files may include a selection indicator. The video processing device may be adapted to detect a first selection user input corresponding to a first selection indicator selecting a first representation of the plurality of representations. In response to detecting the first selection user input and based on the first selection indicator not indicating current activation, the video processing device may display the first selection indicator indicating activation. In response to detecting the first selection user input and based on the first selection indicator indicating current activation, the video processing device may display the first selection indicator not indicating activation.

[0138] The video processing device may further display an export button, for example within the third portion of the graphical user interface, when displaying the plurality of representations corresponding to the plurality of stored data files. The video processing device may be adapted to detect an export user input corresponding to selecting the export button.

[0139] In response to detecting the export user input, the video processing device may display an export menu including an export confirmation button. The video processing device may be adapted to receive an export confirmation user input corresponding to a selection of the export confirmation button. The export menu may further include a plurality of selectable export modalities, the plurality of selectable export modalities including: exporting to a first PACS server, and optionally exporting to a first network drive (such as the first network drive described above) and / or exporting to a first external storage device (e.g., a USB drive). The video processing device may be adapted to receive a modality selection user input corresponding to a selection of a selected export modality from the plurality of selectable export modalities. In some examples, the first network drive may be an SMB network drive.

[0140] In response to detecting the export confirmation user input and corresponding to export to the first PACS server based on the selected export modality, the video processing device may transmit the stored image data corresponding to one or more of the plurality of stored data files to the first PACS server.

[0141] In response to detecting the export confirmation user input and corresponding to exporting to the first network drive according to the selected export modality, the video processing device may transfer the stored image data corresponding to one or more of the plurality of stored data files to the first network drive.

[0142] The video processing device can transfer the stored image data corresponding to one or more of the plurality of stored image data files to a location on the first network drive, the location being based on network drive information for the first network drive stored at the video processing device. For example, the stored network drive information can be network drive information stored based on the contents of a plurality of network drive input fields in the network drive settings. Alternatively or additionally, the location can be based on details of the surgical session. For example, the folder at the location can be named based on the date of the surgery and / or a patient identifier (e.g., the patient's name and / or patient identification number).

[0143] In response to detecting the export confirmation user input and corresponding to exporting to the first external storage device based on the selected export modality, the video processing device can transfer the stored image data corresponding to one or more of the multiple stored image data files to the first external storage device (e.g., the first USB drive).

[0144] The video processing device may transfer the stored image data corresponding to one or more of the plurality of stored image data files to a location on the first external storage device based on details of the surgical session. For example, a folder in the location may be named based on the date of the surgery and / or a patient identifier (e.g., patient name and / or patient identification number).

[0145] The stored image data transferred to the first PACS server, the first network drive, or the first USB drive may correspond to one or more stored image data files of the plurality of stored image data files each having a selection indicator indicating current activation.

[0146] The stored image data transferred to the first network drive and / or the first USB drive may include one or more of a plurality of stored image files in a common image file format (e.g., PNG, JPEG, or TIFF). When the stored image data is transferred to the first PACS server, the stored image data may include one or more of a plurality of stored image files in a DICOM format.

[0147] The present disclosure further relates to a method for operating a video processing device to receive image data from an endoscope, the claimed method being performed concurrently with an unclaimed surgical procedure, the endoscope having an image sensor configured to generate image data indicative of a view from the endoscope, the method comprising the steps of:

[0148] - receiving the image data from the endoscope when the image data is generated and causing a display to display a graphical user interface, the graphical user interface extending a first length along a first direction and a second length along a second direction perpendicular to the first direction, the graphical user interface comprising a plurality of non-overlapping portions, the plurality of non-overlapping portions comprising a first portion and a second portion, wherein the first portion is disposed proximate to the second portion along the second direction;

[0149] - displaying a live representation of the image data within the first portion of the graphical user interface at full size covering the first length along the first direction;

[0150] - detecting a first user input signal indicating a request for activating a freeze function;

[0151] - ceasing to display the live representation of the image data within the first portion of the graphical user interface;

[0152] - displaying a first representation of a still image at full size within the first portion of the graphical user interface, the first representation of the still image corresponding to image data received when the first user input signal is detected; and

[0153] - displaying a live representation of the image data within a second portion of the graphical user interface, wherein the live representation is displayed at a reduced size that is smaller than the full size.

[0154] Surgical procedure should be understood as the insertion of an endoscope or a portion of an endoscope into a patient's body or cavity, as well as any direct interaction of the endoscope with the patient.

[0155] In one aspect, the method may further comprise the steps of:

[0156] - detecting a third user input signal indicating a request to store the still image; and

[0157] - storing an image data file corresponding to the image data received when the first user input signal is detected. BRIEF DESCRIPTION OF THE DRAWINGS

[0158] Hereinafter, embodiments of the present disclosure will be described in more detail with respect to the accompanying drawings. These drawings illustrate one way of implementing the present disclosure and should not be interpreted as limiting other possible embodiments that fall within the scope of the appended claim set.

[0159] Figure 1 schematically illustrates an exemplary medical visualization system,

[0160] Figure 2 schematically illustrates an exemplary video processing device,

[0161] Figure 3 schematically illustrates an exemplary video processing device,

[0162] Figure 4 is a block diagram of an exemplary video processing device,

[0163] Figure 5 schematically illustrates an exemplary video processing device and an exemplary external display connected to the video processing device,

[0164] Figures 6A to 6H schematically illustrates portions of an exemplary graphical user interface related to a freeze function of a video processing device,

[0165] Figures 7A to 7H schematically illustrates portions of an exemplary graphical user interface associated with an exemplary procedure for setting a shortcut function,

[0166] Figures 8A to 8D schematically illustrates portions of an exemplary graphical user interface related to using a shortcut function,

[0167] 9A to 9D schematically illustrates portions of an exemplary graphical user interface related to a hidden function,

[0168] 10A to 10J schematically illustrates portions of an exemplary graphical user interface associated with a program for entering patient data,

[0169] Figures 11A to 11B schematically illustrates portions of an exemplary graphical user interface associated with a program for entering patient data,

[0170] 12A to 12D schematically illustrates portions of an exemplary graphical user interface associated with a program for exporting stored data files, and

[0171] 13A to 13E Portions of an exemplary graphical user interface associated with a program for configuring the export of stored data files are schematically illustrated. DETAILED DESCRIPTION

[0172] Various exemplary embodiments and details are described below with reference to the accompanying drawings (when relevant). It should be noted that the drawings may or may not be drawn to scale, and elements with similar structure or function are represented by similar reference numerals in all drawings. It should also be noted that the drawings are intended only to facilitate the description of the embodiments. The drawings are not intended to serve as an exhaustive description of the present invention or as a limitation to the scope of the present invention. In addition, the illustrated embodiments do not need to have all aspects or advantages shown. The aspects or advantages described in conjunction with a particular embodiment are not necessarily limited to that embodiment and may be implemented in any other embodiment, even if not illustrated or not explicitly described as such.

[0173] Figure 1 An exemplary medical visualization system 2 is schematically illustrated that includes an endoscope 4 and a video processing device 20. The endoscope 4 has an image sensor 12 (e.g., a CCD or CMOS) that is configured to generate image data indicative of a view from the endoscope 4. In the illustrated example, the endoscope 4 includes a handle 6 and an insertion line 8 extending from the handle 6 to a distal line portion 10. In an alternative embodiment, the endoscope can be a laryngoscope. The image sensor 12 can be configured to generate image data indicative of a view from the distal line portion 10 of the insertion line 8. The endoscope 4 can further include a light emitter 13 suitable for providing illumination of the view. The light emitter 13 can be an LED, an optical fiber connectable to a light source, or a similar element known to provide illumination.

[0174] The endoscope 4 can be connected to a video processing device 20. In the illustrated example, a device cable 14 extending from the handle 6 terminates in a device connector 16 that is connected to a connection port 40 of the video processing device 20. The video processing device 20 is operable to receive image data generated by the image sensor 12 of the endoscope 4 as the image data is generated. For example, the video processing device 20 can receive the image data generated by the image sensor 12 via the device cable 14, the connector 16, and the connection port 40. Alternatively, the endoscope 4 can be connected to the video processing device 20 wirelessly.

[0175] The video processing device 20 is configured to cause images received from the endoscope 4 to be displayed. The video processing device 20 may include a display 26 (such as a touch-sensitive display) as shown, and / or may be connected to an external display 80 in which images received from the endoscope 4 are displayed. Thus, the video processing device 20 may be configured to cause the display 26 and / or the external display 80 to display images received from the endoscope 4. The external display 80 may form part of the medical visualization system 2. In some examples, the external display 80 and the video processing device 20 may be connected via a wired connection (e.g., HDMI or DVI). Alternatively, the external display 80 and the video processing device 20 may be connected via a wireless connection (e.g., wireless HDMI or another known protocol for wirelessly connecting displays).

[0176] The handle 6 includes a control mechanism 7 adapted to receive input in a first input direction and / or in a second input direction. A touch input on the control mechanism 7 in the first input direction causes the curved segment 9 of the insertion line 8 to bend in the first bending direction, for example via a wire extending from the handle through the insertion line 8 to the curved segment 9. A touch input on the control mechanism 7 in the second input direction causes the curved segment 9 of the insertion line 8 to bend in the second bending direction. The first input direction and the second input direction may be opposite. The first bending direction and the second bending direction may be opposite. Bending the curved segment 9 of the insertion line 8 may cause the distal end 10 and the image sensor 12 to move in a direction relative to the image sensor 12. Thus, in the case of viewing an image generated by the image sensor 12, the direction in the image (e.g., up or down) may correspond to a corresponding input on the control mechanism 7.

[0177] The endoscope 4 (e.g., the handle 6) may include one or more buttons 11a, 11b that can activate various functions. For example, a button 11a or 11b on the handle can activate a function in the video processing device 20, such as storing a still image or a video sequence. One or more buttons 11a, 11b can be programmable, for example, in the sense that the video processing device can be configured to activate a user-selected function upon receiving a signal indicating that the user has pressed a particular button 11a, 11b.

[0178] The system 2 may include a remote server 90, and the video processing device 20 may be connected to the remote server 90, for example, via a network (e.g., a LAN) (via a wired connection or a wireless connection). Alternatively, the video processing device 20 may be directly connected to the remote server 90 (via a wired or wireless connection).

[0179] Figure 2 An exemplary video processing device 20 is schematically illustrated, such as Figure 1 The video processing device 20 shown. The video processing device 20 includes a first housing 25. The first housing 25 extends from a first housing side 21 to a second housing side 22 in a first direction x1 and extends from a third housing side 23 to a fourth housing side 24 in a second direction x2 perpendicular to the first direction x1. The video processing device 20 includes a display, such as a touch-sensitive display 26, housed in the first housing 25. The touch-sensitive display 26 has a first length L1 in the first direction x1 and a second length L2 in the second direction x2. As illustrated, the second length L2 can be longer than the first length L1. In some examples, the video processing device 20 can include a second housing (not shown) that does not include a display. For example, the second housing can be coupled to the first housing 25, or the second housing can be coupled to an external display. In such an example, the processing unit, electronic memory and / or other components of the video processing device 20 can be arranged in the second housing.

[0180] As illustrated, the video processing device 20 may include one or more connection ports 40, such as three connection ports 40. The connection port 40 may allow for connection of an endoscope. As illustrated, the connection port(s) 40 may be arranged at the third housing side 23. Alternatively or additionally, the connection port(s) 40 may be arranged at the fourth housing side 24. In some examples, the video processing device 20 may provide a wireless connection to the endoscope, in which case the connection port 40 may be omitted. However, in some examples, the video processing device 20 may include both the connection port 40 and the ability to connect wirelessly to an endoscope. In some examples, where the video processing device 20 includes a second housing, as mentioned above, the second housing may include the connection port 40.

[0181] As illustrated, the video processing device may include an on / off button 41 , which may be provided on the fourth housing side 24 .

[0182] Figure 3 An exemplary video processing device 20 is schematically illustrated, such as Figures 1 to 2 The video processing apparatus 20 is shown. As illustrated, the device connector 16 may be connected to the connection port 40.

[0183] The video processing device 20 may be provided with a graphical user interface 27. The graphical user interface 27 may be displayed using a touch-sensitive display 26, and a user may interact with the graphical user interface 27, for example, by providing touch input on the touch-sensitive display 26. In some examples, the video processing device may not be provided with a touch-sensitive display, and the user may interact with the graphical user interface by other means (e.g., via a keyboard, trackpad, or mouse). In some examples, the video processing device 20 may be displayed on an external display (e.g., Figure 1 The graphical user interface 27 is displayed on a display 80 of the video processing device. An external display may be provided as a supplement or alternative to the display of the video processing device 20.

[0184] The graphical user interface 27 extends along a first direction x1 and along a second direction x2. The graphical user interface 27 may include a plurality of non-overlapping portions 31, 32, 33, and 34. Each of the portions 31, 32, 33, and 34 may substantially extend over a first length L1 in the first direction x1. In other words, each of the portions 31, 32, 33, and 34 may occupy the entire height of the graphical user interface 27. The non-overlapping portions include a first portion 31 and a second portion 32. The first portion 31 is immediately adjacent to the second portion 32 along the second direction x2. In the illustrated example, the non-overlapping portions also include a third portion 33 and a fourth portion 34. The first portion 31 is arranged between the third portion 33 and the second portion 32 along the second direction x2. The second portion 32 is arranged between the fourth portion 34 and the first portion 31 along the second direction x2. The fourth portion 34 is arranged between a side of the first housing (e.g., the third housing side 23) and the second portion 32 along the second direction x2. The third portion 33 is arranged along the second direction x2 between the other side of the first housing 25 (eg, the fourth housing side 24) and the first portion 31. The first and second portions 31, 32 are arranged between the third portion 33 and the fourth portion 34 along the second direction x2.

[0185] The video processing device 20 may display a live representation 70 of the image data within the first portion 31 of the graphical user interface 27. Preferably, as illustrated, the live representation 70 is displayed in full size covering a first length L1 along the first direction x1.

[0186] As about Figure 1As depicted, the first and second bending directions of the curved segment 9 of the insertion line 8 can correspond to the first image direction 37 and the second image direction 38, respectively, of the live view 70. As illustrated, the first and second image directions 37 and 38 can be parallel to the first direction x1. As illustrated, the first and second image directions 37 and 38 can be opposite. Thus, user manipulation of the control mechanism 7 of the endoscope 4 can cause the curved segment 9 of the insertion line 8 to move and bend in a direction corresponding to the first or second image direction 37 and 38 of the live view 70.

[0187] The video processing device 20 can utilize the touch-sensitive display 26 to display one or more actionable items 36, for example, within the third portion 33 of the graphical user interface 27. The actionable items 36 can include an image capture button 36a, for example, for storing an image data file corresponding to image data received when the image capture button 36a is activated. Alternatively or additionally, the actionable items 36 can include a video capture button 36b, for example, for storing an image data video sequence (i.e., a video data file) corresponding to image data received when the video capture button 36b is activated.

[0188] The video processing device 20 can utilize the touch-sensitive display 26 to display one or more actionable menu items 42 within the fourth portion 34 of the graphical user interface 27. Actionable menu items 42 can include, for example, a login menu item for initiating a login process, a settings menu item for accessing a settings menu, an archive menu item for browsing archives, and a default menu item for returning to a default view. A battery indicator 50 can also be displayed in the fourth portion 34.

[0189] Figure 4FIG is a block diagram of an exemplary video processing device 20 (e.g., the video processing device 20 of the previous figures). The video processing device 20 includes a processing unit 60 and an electronic memory 62. The electronic memory 62 may include both volatile memory and non-volatile memory. The video processing device 20 may also include an orientation sensor 64 for determining the orientation of a housing (e.g., the first housing 25) relative to gravity. The orientation sensor 64 may include one or more accelerometers and / or gyroscopes. The video processing device 20 may include an input / output module 66, such as for receiving image data from the image sensor 12 via a connector of the endoscope 4. The input / output module 66 may also include one or more network interfaces 66a, such as an Ethernet connector, a Wi-Fi transceiver, and / or a Bluetooth transceiver. The input / output module 66 may also include a video connector 66b (e.g., HDMI or DVI), a USB port 66c, etc. The input / output module 66 may also include a corresponding controller. The video processing device 20 may also include a touch-sensitive display 26 as described earlier. The video processing device 20 can utilize the touch-sensitive display 26 to display information, graphical user interface objects, images, buttons, etc. The video processing device 20 can also include a microphone 68. The video processing device 20 can include a power unit 61 for powering the video processing device 20. The power unit 61 can include a rechargeable battery 61a. The power unit 61 can include a power connector 61b for connecting the power unit 61 to an external power source (e.g., a conventional AC power outlet). The power connection 61b can power the video processing device and / or charge the battery 61a. The components of the video processing device 20 can be interconnected via a bus or signal lines. As illustrated, some or all of the components of the video processing device can be housed in the first housing 25. However, alternatively, some components (e.g., the processing unit 60, the electronic storage 62, the input / output module 66, the optical scanner 69, and / or the power unit 61) can be housed in a second housing (not shown) of the video processing device 20.

[0190] The power unit 61 may include components for indirectly measuring the capacity of the rechargeable battery 61a, for example. For example, the power unit 61 may include a voltmeter to measure the voltage of the rechargeable battery 61a. Based on the measured voltage, the remaining capacity of the rechargeable battery 61a may be estimated, for example, by the processing unit 60. The power unit 61 may also include components for measuring the power consumption of the video processing device 20. For example, the power unit 61 may include a power meter to measure the rate at which the video processing device 20 consumes power from the rechargeable battery 61a. The voltmeter may be a low current consumption integrated circuit or a resistor coupled in parallel with the battery. A current sensor may be provided, and the power may be calculated as the product of the voltage and the current. Additionally, an integrated circuit may be provided that includes the voltmeter and the current sensor and outputs the power value in digital form.

[0191] The video processing device 20 may utilize the touch-sensitive display 26 and / or an externally coupled display (e.g., Figure 1 The video processing device 20 may display the content by transmitting, via the processing unit 60, instructions indicating the content to be displayed to the touch-sensitive display 26 and / or the externally coupled display. The processing unit 60 may be adapted to receive image data from the endoscope, for example, as the image data is generated. The processing unit 60 may be adapted to cause a display, such as the touch-sensitive display 26 and / or the externally coupled display, to display a live representation of the image data. As described above (see Figures 2 to 3 ), the processing unit 60 may be adapted to cause a display (such as the touch-sensitive display 26 and / or an externally coupled display) to display a graphical user interface 27.

[0192] The video processing device 20 can utilize the touch-sensitive display 26 to receive user input. In particular, the video processing device 20 can utilize the touch-sensitive display 26 to detect user input. For example, a user providing a touch input on the touch-sensitive display 26 causes a change in one or more electrical parameters of the touch-sensitive display 26, the one or more electrical parameters indicating at least the location of the touch input. Information about the touch input is transmitted from the touch-sensitive display 26 to the processing unit 60, and the processing unit 60 can determine whether the touch input corresponds to an action to be performed, such as whether the location of the touch input corresponds to the location of a soft button displayed at the touch-sensitive display 26. Alternatively or additionally, the video processing device 20 can receive user input by other means (e.g., by a keyboard, trackpad, or mouse), which can be coupled to the video processing device 20. As will be described later, the video processing device 20 can also or alternatively receive user input via buttons on a coupled endoscope.

[0193] A user may interact with the video processing device 20 via the graphical user interface 27 by providing user input (e.g., by providing touch input on the touch-sensitive display 26), and the video processing device 20 may detect such user input using the touch-sensitive display 26. The touch input (e.g., a single click, a long press, a double click, a swipe, or the like) and the location of the touch input on the touch-sensitive display 26 may be registered by the touch-sensitive display 26, which transmits information about the touch input (e.g., including the type of touch (double click, long press, single click, swipe, etc.) and / or the location of the touch) to the processing unit 60 of the video processing device 20. The processing unit 60 may interpret the received information and determine whether the touch input corresponds to the activation of an action, for example, whether the touch input corresponds to the activation of a button displayed at the location of the touch input using the touch-sensitive display 26. In response to determining that the touch input corresponds to the activation of an action, the processing unit 60 performs the corresponding action.

[0194] For example, reference Figure 3 and Figure 4 To capture an image corresponding to the currently shown live representation 70 (e.g., corresponding to image data received from the image sensor), the user can tap image capture button 36a. The tap and the location of the tap are registered by touch-sensitive display 26, which transmits information about the tap to processing unit 60 of video processing device 20. Processing unit 60 interprets the received information and determines that the user tapped a location corresponding to image capture button 36a. In response, processing unit 60 stores an image data file corresponding to the received image data in electronic storage 62.

[0195] Further references Figure 3 and Figure 4 To capture a video sequence corresponding to the live representation 70 shown during a period of time (e.g., corresponding to image data received from the image sensor during a period of time), the user can tap the video capture button 36b. The tap and the location of the tap are registered by the touch-sensitive display 26, which transmits information about the tap to the processing unit 60 of the video processing device 20. The processing unit 60 interprets the received information and determines that the user tapped the location corresponding to the video capture button 36b. In response, the processing unit 60 begins collecting image data received from the image sensor 12 and temporarily stores the data in the electronic storage 62. To stop recording, the user can tap the video capture button 36b again. Based on the signal received from the touch-sensitive display 26, the processing unit 60 determines that the user tapped the video capture button 36b and stops collecting image data received from the image sensor 12. The processing unit 60 reads the temporarily stored data from the electronic storage 62 and creates a complete video sequence (e.g., a video data file) based thereon, which the processing unit 60 stores in the electronic storage 62.

[0196] Figure 5 An exemplary video processing device 20 is schematically illustrated, such as Figures 1 to 4 The video processing device 20 is shown. Figure 5 Also schematically illustrated is an exemplary external display 80 connected to the video processing device 20, such as also shown in FIG. Figure 1 The external display 80 is shown in FIG.

[0197] The video processing device 20 includes a display interface 82 adapted to connect the video processing device 20 to an external display 80. In the illustrated example, the connection between the video processing device 20 and the external display 80 is provided via a wired connection. However, alternatively, the connection may be provided via wireless technology. Thus, the display interface 82 may include (multiple) DVI interfaces, (multiple) HDMI interfaces, (multiple) wireless HDMI interfaces, and / or other suitable display interfaces.

[0198] The video processing device 20 may be adapted to cause the external display 80 to display an auxiliary graphical user interface 27'. The auxiliary graphical user interface 27' may extend a first auxiliary length L1' along a first auxiliary direction x1' and a second auxiliary length L2' along a second auxiliary direction x2' perpendicular to the first auxiliary direction x1'. The auxiliary graphical user interface 27' includes a plurality of non-overlapping auxiliary parts 31', 32', 33', the plurality of non-overlapping auxiliary parts including a first auxiliary part 31' and a second auxiliary part 32', wherein the first auxiliary part 31' is arranged adjacent to the second auxiliary part 32' along the second auxiliary direction x2'. The plurality of non-overlapping auxiliary parts 31', 32', 33' may further include a third auxiliary part 33'. As illustrated, the first auxiliary part 31' may be arranged between the second auxiliary part 32' and the third auxiliary part 33'.

[0199] The video processing device 20 may be adapted to display a live representation 70 of the image data within the first auxiliary portion 31' of the auxiliary graphical user interface 27'. Preferably, as illustrated, the live representation 70 is displayed in full size covering a first auxiliary length L1' along a first auxiliary direction x1'.

[0200] Preferably, the content displayed in the first portion 31 of the graphical user interface 27 of the video processing device 20 (e.g., the live presentation 70) is displayed in the first auxiliary portion 31′ of the auxiliary graphical user interface 27′. In fact, the first auxiliary portion 31′ of the auxiliary graphical user interface 27′ can be a mirror image of the first portion 31 of the graphical user interface 27.

[0201] Figures 6A to 6HSchematically illustrates portions of an exemplary graphical user interface 27, such as the graphical user interface 27 described with respect to the previous figures. More specifically, Figures 6A to 6H The graphical user interface 27 is concerned with the freeze function of the video processing device 20 .

[0202] Figure 6A The graphical user interface 27 is illustrated and includes a live representation 70 displaying image data within the first portion 31 .

[0203] The video processing device 20 is adapted to detect a first user input signal indicating a request for activating the freeze function. For example, the video processing device may be adapted to detect a first user input signal from the endoscope 4 (see Figure 1 ) and the first user input signal may be issued by detecting the first endoscope signal. For example, the first endoscope signal may indicate that the user has activated a first button on the endoscope 4 (e.g., Figure 1 In practice, the user can issue the first user input signal by activating a first button on the endoscope, and accordingly request activation of the freeze function. Alternatively or additionally, the video processing device 20 may display a freeze button 36c within the third portion 33 of the graphical user interface 27 (e.g., as part of one or more actionable items 36). The video processing device 20 may be adapted to detect user input 110 corresponding to selection of the freeze button 36c, and the first user input signal may be issued by detecting user input 110 corresponding to selection of the freeze button 36c. In practice, the user can issue the first user input signal by selecting the freeze button 36c (e.g., via touch input 110), and accordingly request activation of the freeze function.

[0204] like Figure 6B As schematically illustrated in FIG, in response to detecting the first user input signal, the video processing device activates a freeze function. Activating the freeze function includes ceasing to display the live representation 70 within the first portion 31 and displaying a first representation 101 of a still image within the first portion 31, the first representation of the still image corresponding to the image data received when the first user input signal was detected (e.g., a first user input signal issued by a user selecting 110 the freeze button 36c or activating a first button on the endoscope). Therefore, it should be understood that Figure 6B The first representation 101 is a static image, while Figure 6A The live representation 70 in FIG. 1 is a dynamic image. The first representation 101 is displayed in full size, ie, covering the entire first length L1 (ie, height, see FIG. 27 ) of the graphical user interface 27. Figure 2 ).

[0205] In addition, if Figure 6BAs shown, activating the freeze function also includes displaying the live representation 70 within the second portion 32. The live representation 70 is displayed at a reduced size that is less than the full size. In other words, when the freeze function is activated, the live representation 70 is displayed at a size that is smaller than the size of the first representation 101 (still image).

[0206] Thus, in effect, the live representation 70 is scaled down and moved to the second portion 32 of the graphical user interface 27, while the first representation 101 of the still image is displayed at full size in the first portion 31 of the graphical user interface 27. In this way, the operator can verify that the result they wanted to confirm was indeed visible in the image when they activated the freeze function. This can be used to review a certain result without having to constantly maintain a full view of that result. Furthermore, the present disclosure provides that, while allowing the operator to review the representation 101 of the still image, the live representation 70 is still provided to the operator so that the operator can see the current position of the endoscope and possibly react to it. A further advantage of the present disclosure is that neither the live representation 70 nor the first representation 101 is completely or partially obscured, so that the operator can fully review any visible information in the image.

[0207] like Figure 6B As shown, when the freeze function is activated and the first representation 101 of the still image is displayed in the first portion 31, a freeze indicator element 102 may also be displayed, for example, within the first portion 31. The freeze indicator element 102 may provide a visual indication to the operator that a still image is being displayed rather than the live representation 70. The freeze indicator element 102 may cover a portion of the first representation 101. The freeze indicator element 102 may be partially transparent to reduce impairment of any information in the still image.

[0208] When the freeze function is activated, such as Figure 6B As shown, the video processing device 20 may be adapted to detect a second user input signal indicating a request to deactivate the freeze function. For example, the video processing device may be adapted to detect a second user input signal from the endoscope 4 (see Figure 1 ) and the second user input signal may be issued by detecting the second endoscope signal. For example, the second endoscope signal may indicate that the user has activated the second button and / or the first button on the endoscope 4 (e.g., Figure 1 Thus, the second endoscopic signal can be triggered by the same button (e.g., button 11a or 11b) that triggered the first endoscopic signal as previously described. Figure 1In practice, the user can issue a second user input signal by activating the first button on the endoscope again and, accordingly, requesting the deactivation of the freeze function. Alternatively or additionally, the video processing device 20 can be adapted to detect another user input 111 corresponding to the selection of the freeze button 36c, and the second user input signal can be issued by detecting another user input 111 corresponding to the selection of the freeze button 36c. In practice, the user can issue a second user input signal by (e.g., again) selecting the freeze button 36c (e.g., by touch input 111) and, accordingly, requesting the deactivation of the freeze function.

[0209] like Figure 6C As schematically illustrated in FIG, in response to detecting the second user input signal, the video processing device deactivates the freeze function. Deactivating the freeze function includes ceasing to display the first representation 101 of the still image within the first portion 31 of the graphical user interface 27. In addition, the live representation 70 of the image data is again displayed at full size within the first portion 31 of the graphical user interface 27. When the freeze function is deactivated, the live representation 70 is displayed at full size, i.e., covering the entire first length L2 (i.e., height, see FIG) of the graphical user interface 27. Figure 2 ).

[0210] As an alternative or in addition to the above-described manner of deactivating the freeze function, the video processing device 20 may be adapted to deactivate the freeze function based on other user input or state changes. Figure 6B As shown, when the freeze function is activated, the video processing device may be adapted to detect a user input 112 to the live representation 70 of the image data being displayed in the second portion 32, and a second user input signal for deactivating the freeze function may be issued by detecting the user input 112 to the live representation 70 of the image data. Alternatively or additionally, the video processing device 20 may be adapted to detect a disconnection of the endoscope 4 (e.g., removal of the device connector 16 from the connection port 40, see FIG. 1 ). Figure 1 ), and the second user input signal to deactivate the freeze function may be issued in response to detecting that the endoscope is disconnected from the video processing device 20. Alternatively or additionally, the video processing device 20 may be adapted to detect connection of the endoscope (e.g., insertion of the device connector 16 into the connection port 40, see Figure 1 ), and the second user input signal that deactivates the freeze function may be issued in response to detecting the connection of the endoscope to the video processing device. In some examples, the video processing device 20 may be connected to multiple endoscopes simultaneously, such as a first endoscope and a second endoscope. Figure 1As can be seen in FIG, this can be achieved, for example, by a video processing device comprising a plurality of connection ports 40. In this case, the second user input signal for deactivating the freeze function can be issued in response to detecting the connection of a second endoscope to the video processing device. The second endoscope can be different from the first endoscope that has been connected to the video processing device 20.

[0211] When the freeze function is activated, such as Figure 6B As shown, the video processing device 20 may be adapted to detect a third user input signal indicating a request to store a still image corresponding to the first representation 101. For example, the video processing device may be adapted to detect a still image from the endoscope 4 (see Figure 1 ) and the third user input signal may be issued by detecting the third endoscope signal. For example, the third endoscope signal may indicate that the user has activated a third button on the endoscope 4 (e.g., Figure 1 In practice, the user can issue a third user input signal by activating a third button on the endoscope and, accordingly, request storage of a still image corresponding to the first representation 101. Alternatively or additionally, the video processing device 20 displays one or more actionable items 36, for example, within the third portion 33 of the graphical user interface 27, wherein the one or more actionable items 36 include an image capture button 36a. The video processing device 20 can be adapted to detect a user input 113 corresponding to selection of the image capture button 36a, and the third user input signal can be issued by detecting the user input 113 corresponding to selection of the image capture button 36a. In practice, the user can issue a third user input signal by selecting the image capture button 36a (e.g., via touch input 113) and, accordingly, request storage of a still image corresponding to the first representation 101.

[0212] In response to detecting the third user input signal, the video processing device 20 stores an image data file corresponding to the image data received when the first user input signal was detected (i.e., when the freeze function was activated) in the electronic memory of the video processing device 20. Thus, the image data file stored by the video processing device 20 corresponds to the first representation 101 currently being displayed in the first portion 31 of the graphical user interface 27.

[0213] When storing an image data file, while the freeze function is active, the stored image data file may include information indicating that the image data file was captured while the freeze function was active. This can provide information, when reviewing the stored images at a later stage, that a particular image was captured while the freeze function was active. Such information can prove valuable, for example, during quality inspections, surgical reviews, and the like. The information included in the stored image data file indicating that the image data file was captured while the freeze function was active may include a freeze indicator element 102, which may be included in the stored image (e.g., overlaid on the image).

[0214] Storing a still image corresponding to the first representation 101 can further cause the freeze function to be deactivated. Therefore, when the user stores the still image, it can be interpreted as a confirmation of acceptance of the still image and an instruction to continue the procedure, and accordingly, a request to deactivate the freeze function. Therefore, similar to the above explanation, the video processing device 20 can further deactivate the freeze function in response to detecting a third user input signal.

[0215] Figure 6D Schematically illustrates the Figure 6B When the freeze function is activated, when the user requests to store a still image corresponding to the first representation 101 (e.g., by Figure 6B Example results after touch input 113 in .

[0216] The video processing device 20 may display the first representation 101 of the still image within the second portion 32 of the graphical user interface 27 in response to detecting the third user input signal indicating a request to store the still image. Thus, the graphical user interface 27 signals to the user that the still image is being stored and that the still image corresponds to the first representation 101. After a predetermined delay after detecting the third user input signal (i.e., after a predetermined delay after displaying the first representation 101 within the second portion 32), the video processing device 20 may stop displaying the first representation 101 of the still image within the second portion 32 of the graphical user interface 27. Before stopping displaying the first representation 101 within the second portion 32, the video processing device 20 may display an animation 103 that converts the first representation 101 into a folder icon 104, for example, as shown in FIG. Figure 6E shown.

[0217] The video processing device 20 may include one or more image modification functions. The one or more image modification functions may cause a noticeable change to the live representation 70 of the image data. For example, the one or more image modification functions may include: ARC (Advanced Red Contrast), color adjustment, contrast adjustment, sharpness adjustment, image brightness adjustment, a zoom function, rotation of the live representation, and endoscope light on / off. The one or more image modification functions (or some of them) may be activatable by image function buttons 36 d, which may form part of one or more actionable items 36 displayed, for example, within the third portion 33 of the graphical user interface 27. When one of the one or more image modification functions is activated, for example by a user selecting one of the image function buttons 36 d, one or more parameters of the live representation 70 of the image data may be modified. For example, contrast, color, sharpness, brightness, size, orientation, etc. may be modified.

[0218] When the freeze function is not in an active state, one or more image modification functions may be activatable, i.e., one or more image modification functions may function normally. When the freeze function is in an active state, some or all image modification functions may be inactivatable, e.g., disabled. For example, Figure 6B As can be seen in FIG, when the freeze function is active, image function button 36 d may be grayed out or otherwise indicate that image modification functions are not activatable. In some examples, some image modification functions may be activatable even when the freeze function is active. For example, the backlight of display 26 may be adjusted even when the freeze function is active.

[0219] like Figure 6B As shown, when the freeze function is in an activated state, the video processing device 20 may detect a fourth user input signal (such as a touch user input 114, such as Figure 6B As shown in FIG, the fourth user input signal indicates a request for activating an image modification function among one or more image modification functions. Alternatively or in addition to the touch user input 114 shown in the figure, the fourth user input signal may be issued by the user pressing a button on the endoscope. In response to detecting the fourth user input signal, for example, when the fourth user input signal indicates a request for activating an image modification function that cannot be activated when the freeze function is activated, as shown in FIG. Figure 6F As shown, the video processing device 20 may display a notification 105, for example, within the second portion 32 of the graphical user interface 27, indicating that the image modification function is disabled and / or unavailable while the freeze function is active.

[0220] The video processing device 20 may include an endoscope light switch function (eg, as one of the image modification functions) which, when activated, causes a light emitter of the endoscope (eg, with respect to Figure 1 For example, Figure 6A As shown, the image function button 36d may include a button for toggling the endoscope light switch function (i.e., for activating and / or deactivating the endoscope's light emitter). Alternatively or additionally, the endoscope may include a button for toggling the endoscope light switch function. It may be convenient to be able to turn off the endoscope's light emitter to avoid dazzling other people in the room with the endoscope light before it is introduced into the patient. As explained above, the endoscope light switch function may be activatable when the freeze function is not activated, and the endoscope light switch function may be inactivatable when the freeze function is activated. Attempting to activate the endoscope light switch function while the freeze function is activated may generate a notification (e.g., Figure 6F 105), which indicates that the endoscope light switch function cannot be activated when the freeze function is activated.

[0221] like Figure 6G As shown, for example, by Figure 6A activating the endoscope light switch function to deactivate the endoscope's light emitter using the user input 115 shown in FIG. 7A would result in a live representation 70 showing nothing (or only showing something very dimly due to light from other light sources).

[0222] The freeze function may be inactivatable when the light emitter of the endoscope is deactivated. In other words, the video processing device 20 may be adapted such that the freeze function cannot be activated unless the light emitter of the endoscope is turned on. Thus, the freeze button 36c may be grayed out. When a user attempts to activate the freeze function when the light emitter of the endoscope is not in an activated state (e.g., by a user input 110 corresponding to selecting the freeze button 36c, or by pressing a first button on the endoscope (e.g., Figure 1 In the case of pressing the button 11a), the video processing device 20 may abandon activating the freeze function. Figure 6H As shown, the video processing device 20 may display a notification 106, for example within the second portion 32 of the graphical user interface 27, indicating that the freeze function is not activatable when the light emitter of the endoscope is deactivated.

[0223] 7A to 8D Schematically illustrates portions of an exemplary graphical user interface 27, such as the graphical user interface 27 described with respect to the previous figures. More specifically, 7A to 8D The present invention relates to a graphical user interface 27 related to the shortcut function of the video processing device 20. More specifically, Figures 7A to 7H relates to a graphical user interface 27 associated with a program for setting a shortcut function, and Figures 8A to 8D The graphical user interface 27 is involved in connection with subsequent use of the shortcut function.

[0224] Figure 7A The video processing device 20 is shown to include a peripheral input device interface 200, for example, including a USB interface, a Bluetooth transceiver and / or another interface type known in the art. The peripheral input device interface 200 can be formed as described with respect to Figure 4 A portion of the input-output module 66 is described in the block diagram. Figure 7A In the example of FIG, the peripheral input device interface 200 includes a wired interface, such as a USB interface, etc. However, alternatively or additionally, the peripheral input device interface may include a wireless interface, such as Bluetooth, etc.

[0225] The peripheral input device interface 200 is suitable for coupling the video processing device 20 to one or more peripheral input devices 201, such as a foot pedal, a keyboard, a mouse, a trackpad, a game controller, etc. In the illustrated example, a foot pedal is illustrated as the peripheral input device 201. In the illustrated example, the peripheral input device 201 is illustrated as being connected via a wired connection. However, alternatively, the peripheral input device 201 can be connected via a wireless connection. The peripheral input device 201 includes an input component 202. In the illustrated example, the input component 202 is a pedal of the foot pedal 201 (or more specifically, a switch activated by stepping on the pedal). In some examples, a peripheral input device can have multiple input components. For example, a traditional PC keyboard can have 104 or 105 keys, and therefore such a keyboard can have up to 104 or 105 input components.

[0226] The peripheral input device interface 200 may be adapted to receive peripheral input signals from the peripheral input device 201. In examples where more than one peripheral input device is coupled to the peripheral input device interface 200, the peripheral input device interface 200 may be adapted to receive multiple peripheral input signals, e.g., one or more signals from each coupled peripheral input device.

[0227] The peripheral input device interface 200 may be further adapted to transmit one or more auxiliary peripheral input signals to the processing unit of the video processing apparatus 20 , the one or more auxiliary peripheral input signals being indicative of the received peripheral input signal(s).

[0228] The video processing device 20 displays the shortcut setting user interface 210 within the first portion 31 of the graphical user interface 27. In this example and as illustrated, the first portion 31 may also include Figure 3The third portion 33 of the graphical user interface 27 is shown. As illustrated, the shortcut settings user interface 210 may include instructions 211 for connecting a peripheral input device and / or for activating a desired input component of the peripheral input device. In some examples, the video processing device 20 stores one or more user profiles, each of which includes a username and password for activating an authorized mode of the video processing device 20, and the shortcut settings user interface is displayed based on whether the authorized mode is activated. In other words, the shortcut settings user interface 210 may be limited to being available only to authorized users of the video processing device 20.

[0229] When the shortcut setting user interface 210 is displayed, the video processing apparatus 20 is adapted to detect a first peripheral input signal from the coupled peripheral input device 201. In response to detecting the first peripheral input signal, as shown in FIG. Figure 7B As shown, the video processing device displays a shortcut indicator 212 indicating the input component 202 of the peripheral input device 201 associated with the detected first peripheral input signal. In addition, a continue button 213 may be displayed and enabled. In addition, a cancel button 214 may be displayed, which can be selected to exit the program for setting a shortcut and the shortcut setting user interface 210 without storing new shortcut information.

[0230] Furthermore, in response to detecting the first peripheral input signal (eg, after the user selects the continue button 213, such as by touch user input 220), as shown in FIG. Figure 7C As shown, the video processing device displays a function selection interface 215. In the illustrated example, the function selection interface 215 forms part of the shortcut setting user interface 210. The function selection interface 215 includes at least two representations 216a, 216b of two or more functions that can be assigned to the input component 202 of the peripheral input device 201. In this example, the two representations 216a, 216b are representations of a capture image function and a video capture function, respectively. In some examples, one of the functions can be preselected. In the illustrated example, the video capture function has been preselected, as indicated by the radio button for the video capture representation 216b being filled.

[0231] When the function selection interface 215 is displayed, the video processing device is adapted to detect a first user input 221 (eg, a touch input) indicating selection of a first function (eg, the capture image function 216a) of the two or more functions. Figure 7D As shown, selection of the first function (eg, the capture image function) may be indicated by the radio button for the capture image function representation 216a being filled in.

[0232] Furthermore, in some examples, such as Figure 7EAs shown, in response to detecting the first peripheral input signal (e.g., after the user (again) selects the continue button 213 by touching the user input 222), the video processing device displays a naming dialog 217. The naming dialog 217 is adapted to receive a user-input name 218 that identifies the assignment of the first peripheral input signal to the selected function. In some examples, if the user does not enter the desired user-input name 218, a default name is assigned to the shortcut.

[0233] In response to detecting the first user input 221, and optionally further in response to the user selecting (again) the continue button 213, for example by touch user input 223, when the naming dialog 217 is displayed, the video processing device 20 stores first shortcut information, the first shortcut information including: assigning the first peripheral input signal corresponding to the input component 202 to the first peripheral input signal corresponding to the input component 202. Figure 7C The first function (eg, image capture function) corresponding to the function selected in the function selection interface 215 is shown in FIG. Figure 7E The user input name 218 provided in the naming dialog 217 may be included in the stored first shortcut information. As illustrated, the continue button 213 displayed with the naming dialog 217 may have a different appearance to indicate that selecting the continue button 213 at this stage will complete the shortcut setting procedure.

[0234] In response to the user selecting the continue button 213, for example by touching the user input 223, thereby ending the procedure for setting the shortcut, the user enters the state of the shortcut. Figure 7F As shown, the video processing device may display a shortcut overview 219. The shortcut overview 219 may include an option for deleting one or more shortcuts from the list. The shortcut overview 219 may include an option for adding one or more additional shortcuts.

[0235] When the shortcut setting UI is displayed (such as Figure 7A As shown), and in response to detecting the first peripheral input signal, if the video processing device already includes the following shortcut information - the shortcut information includes assigning the first peripheral input signal to a previous function (in other words, if the input component 202 of the peripheral device 201 has already been assigned to a certain function), then Figure 7G As shown, the video processing device may provide a warning message 233 along with a shortcut indicator 212 indicating the input component 202 of the peripheral input device 201 associated with the detected first peripheral input signal. If the user wishes to abort the potential reassignment of the input component 202, the user may press a cancel button 214 to exit the shortcut setting user interface without storing new shortcut information. Alternatively, if the user wishes to continue, the user may press a continue button 213.

[0236] In the event that the user continues by selecting the continue button 213 (e.g., by touching the user input 224), as shown Figure 7H As shown, the video processing device can display a function selection interface 215 (such as Figure 7C ), wherein a warning message 233 is additionally displayed. Warning message 233 (in Figure 7G and Figure 7H The warning message 233 may include information on the current designation of the input component 202. For example, the warning message 233 may indicate that the input component 202 is designated for a video capture function.

[0237] Figure 8A Schematically illustrates the Figures 7A to 7H The illustrated example shows the graphical user interface 27 after storing the first shortcut information. For example, a shortcut may have been stored that assigns the first peripheral input signal corresponding to the input component 202 to the capture image function of the video processing device 20. The illustrated graphical user interface 27 includes a live representation 70 of the image data displayed within the first portion 31.

[0238] While the live representation 70 is displayed and after the first shortcut information has been stored, the video processing device is adapted to detect a first peripheral input signal from the first peripheral input device 201. In response to detecting the first peripheral input signal (e.g., pedal 202 corresponding to foot pedal 201 being depressed), the video processing device activates the designated function, i.e., the image capture function. Figure 8B The capture of an image in response to a user activating the foot pedal is schematically illustrated. As illustrated, the video processing device 20 can display a representation 230 of the still image within the second portion 32 of the graphical user interface 27 in response to detecting a first peripheral input signal (in this example, the first peripheral input signal indicates a request to store a still image). This signals the user that a still image is being stored and that the still image corresponds to the live representation 70 at the time the foot pedal 201 was depressed. After a predetermined delay, the video processing device 20 can display an animation that transforms the representation 230 into a folder icon 231.

[0239] and Figure 8A Same, Figure 8C Schematically illustrates the Figures 7A to 7H The example described stores the graphical user interface 27 after the first shortcut information. Figure 8A on the contrary, Figure 8CThe example in which the video processing device 20 does not display the live representation 70 is shown. This may be because no endoscope is connected to the video processing device, or it may be for other reasons. Therefore, in this case, the functions assigned to the peripheral input device 201 (such as the image capture function) may be unavailable. Therefore, Figure 8A The example of may correspond to a case where the video processing apparatus 20 operates in a first mode in which a function assigned to the peripheral input device 201 is available, while Figure 8C The example of may correspond to a case where the video processing device 20 operates in the second mode in which the function assigned to the peripheral input device 201 is unavailable. Figure 8C ) and the video processing device 20 detects a first peripheral input signal from the peripheral input device 201, then Figure 8D As shown, the video processing device may display an error notification 232. The video processing device may further abstain from activating the designated function, for example, the video processing device 20 may abstain from capturing a (blank) still image.

[0240] 9A to 9D Portions of an exemplary graphical user interface 27 of the video processing device 20 , such as the graphical user interfaces 27 described with respect to previous figures, are schematically illustrated. 9A to 9D Also schematically shown is an external display 80 (e.g. also in FIG. Figure 5 80). Although the following description is provided with respect to an example in which the external display 80 is connected to the video processing device 20, it will become apparent hereinafter that some of the features explained below provide certain advantages even when used without the external display 80 connected.

[0241] More specifically, 9A to 9D The graphical user interfaces 27, 27' relate to functionality that enables the operator to hide certain information, such as patient information. This can be advantageous in many situations, but in particular it is worth noting that when the video processing device 20 and / or the external display 80 are used for presentation, demonstration and / or teaching purposes (where the viewer is closely following the procedure), it is advantageous to be able to hide such information, for example for privacy reasons.

[0242] As illustrated, in addition to displaying the live representation 70, the video processing device 20 displays a patient information panel 300 within the second portion 32 of the graphical user interface 27. The patient information panel 300 includes a title portion 310, a detail portion 320, and a hide button 330. The title portion 310 may include first patient information 311, such as the patient's name and / or the patient's personal identification number. The detail portion 320 may include detailed patient information 321, and optionally, the detail portion 320 may include a hide button 330. Figure 9A , the hide button 330 has a first appearance indicating that the hide data function is currently disabled. Figure 9A As shown, the detailed patient information 321 may include the first patient information 311 (ie, the patient's name and / or personal identification number), and / or the detailed patient information 321 may include additional patient information of the patient, such as the patient's date of birth and / or gender.

[0243] In the illustrated example in which an external display 80 is connected to the video processing device, the video processing device 20 also displays the live representation 70 of the image data within the first auxiliary portion 31' of the auxiliary graphical user interface 27' on the external display 80. In addition, an auxiliary patient information panel 300' is displayed within the second auxiliary portion 32' of the auxiliary graphical user interface 27'. The auxiliary patient information panel 300' may include detailed patient information 321. The auxiliary patient information panel 300' may include an auxiliary title portion 310' that includes first patient information 311. As illustrated, the auxiliary patient information panel 300' may be different from the patient information panel 300 of the graphical user interface 27. However, the same information as that in the patient information panel 300 of the graphical user interface 27, or some of the same information, may be displayed in the auxiliary patient information panel 300'.

[0244] The video processing device 20 is adapted to detect a hidden user input 340 (eg, a touch user input) corresponding to selecting the hidden button 330. In response to detecting the hidden user input 340, as shown in FIG. Figure 9B As shown, the video processing device activates the hidden data function. Activating the hidden data function may include changing the visual appearance of the hidden button 330 to a second appearance, such as Figure 9B shown.

[0245] Activating the hide data function, such as by touch user input 340, includes ceasing to display the first patient information in header portion 310. Additionally, activating the hide data function may include ceasing to display the auxiliary patient information panel 300' on external display 80. In some examples, activating the hide data function may include ceasing to display only a portion of the auxiliary patient information panel 300' while maintaining display of other elements of the auxiliary patient information panel 300'.

[0246] When the hide data function is activated (such as Figure 9B ), the video processing device 20 is adapted to (again) detect a hidden user input 341 corresponding to selecting the hide button 330. In response to detecting the hidden user input 341 when the hide data function is activated, the video processing device deactivates the hide data function.

[0247] Deactivating the hidden data function includes displaying the first patient information in the title portion 310. Additionally, deactivating the hidden data function may include displaying the auxiliary patient information panel 300' on the external display 80, and / or displaying all previously hidden portions of the auxiliary patient information panel 300'. In essence, deactivating the hidden data function regenerates the Figure 9A Deactivating the hide data function may include changing the visual appearance of the hide button 330 to a first appearance, such as Figure 9A shown.

[0248] Thus, in response to detecting the hidden user input 340, if the hidden data function is not active when the hidden user input 340 is detected ( Figure 9A ), the video processing device activates the hidden data function (generating Figure 9B In response to detecting the hidden user input 341, in the case where the hidden data function is in the activated state when the hidden user input 341 is detected ( Figure 9B ), the video processing device disables the hidden data function (generating Figure 9A status shown).

[0249] The video processing device may be further adapted to detect detail user inputs 342 to 345 indicating a request to switch the detail portion 320 of the patient information panel 300. The detail user inputs 342 to 345 may correspond to selecting the collapse icon 312 of the title portion 310.

[0250] In response to detecting the detail user input 342 - 345 , the video processing device stops displaying the detail portion 320 of the patient information panel 300 , or displays the detail portion 320 of the patient information panel 300 .

[0251] Thus, depending on whether the detail portion 320 is being displayed (e.g., Figure 9A As shown), the video processing device stops displaying the detailed portion 320 of the patient information panel 300. For example, Figure 9C According to the state shown. When the detail user input 344 is detected, the detail portion 320 is not displayed (eg Figure 9C As shown), the video processing device displays the detailed part of the patient information panel. For example, Figure 9A The status shown.

[0252] Similar behavior may occur in the auxiliary graphical user interface 27' at the external display 80. Thus, depending on whether the detail portion 320 is being displayed (e.g., Figure 9A As shown), the video processing device stops displaying the detailed patient information 321 of the auxiliary patient information panel 300'. Figure 9C In some examples, the entire auxiliary patient information panel 300' may be stopped from being displayed. Figure 9C As shown), the video processing device displays an auxiliary patient information panel 300' including detailed patient information 321, as shown Figure 9A shown.

[0253] Figure 9A and Figure 9C The diagram shows a case where detail user inputs 342, 344 are detected when the hide data function is not active. Detail user inputs 343, 345 may also or alternatively be detected when the hide data function is active. Figure 9B and Figure 9D Middle picture.

[0254] Thus, according to the fact that the hide data function is active and the detail portion 320 is being displayed (e.g., when the detail user input 343 is detected), Figure 9B As shown), the video processing device stops displaying the detailed portion 320 of the patient information panel 300. For example, Figure 9D Compared to the state where the hide data function is not activated Figure 9C on the contrary, Figure 9D The patient information panel 300 shows only a title portion 310, which also does not show the patient's name, but only a generic "Patient Information" placeholder.

[0255] According to the fact that the hide data function is active and the detail portion 320 is not displayed (e.g., when the detail user input 345 is detected), Figure 9D As shown), the video processing device displays the detailed portion 320 of the patient information panel. For example, Figure 9B The status shown.

[0256] Additionally, the hidden data function is active (e.g., Figure 9B and Figure 9D ), the auxiliary patient information panel 300' originally displayed in the second auxiliary portion 32' of the auxiliary graphical user interface 27' is not displayed.

[0257] 10A to 10J Schematically illustrates portions of an exemplary graphical user interface 27, such as the graphical user interface 27 described with respect to the previous figures. More specifically, 10A to 10J A graphical user interface 27 is involved in connection with the program for entering patient data.

[0258] The video processing device 20 may be adapted to open a surgical session. For example, the video processing device 20 may be adapted to detect the connection of an endoscope and, in response to detecting the connection of the endoscope, open a surgical session. In response to detecting the connection of the endoscope, the video processing device 20 may obtain device identifier information from the device identifier of the endoscope. For example, the endoscope may be equipped with an EPROM that can be read by the video processing device 20 (alternatively, a QR code, RFID tag, NFC, etc. may be used). For example, the processing unit of the video processing device may perform a process of querying the device identifier via the device connector and connection port. The EPROM may store information about the endoscope (e.g., the serial number of the endoscope), which may uniquely identify the endoscope. Furthermore, the device identifier information may indicate the type of endoscope (e.g., whether it is a bronchoscope, duodenoscope, laryngoscope, etc.), the brand of the endoscope, the production version, the batch number, etc.

[0259] After obtaining the device identifier information, the video processing device 20 can open (or create or reopen, depending on whether the endoscope was previously connected) a surgical session corresponding to the device identifier information. For example, a first surgical session corresponding to first device identifier information obtained from a first endoscope can be opened, and a second surgical session corresponding to second device identifier information obtained from a second endoscope can be opened. Surgical sessions can be unique, and thus reconnecting a previously connected endoscope can cause the video processing device 20 to reopen a previously created session. Surgical sessions can be implemented by creating folders in the file system of the video processing device 20 (e.g., within the electronic memory of the video processing device 20). Image data files and video sequences (e.g., video data files) obtained using a particular endoscope can be stored in the folder corresponding to that particular endoscope.

[0260] Figure 10A The graphical user interface 27 is illustrated and includes a live representation 70 of image data displayed within a first portion 31. Furthermore, within a second portion 32 of the graphical user interface 27 a patient information panel 400 is displayed.

[0261] When and / or before displaying the live representation 70, the video processing device 20 is adapted to receive a video from a remote server (e.g., Figure 1The remote server 90 described above retrieves work list data. The work list data may include patient information data for a plurality of scheduled surgeries (e.g., scheduled surgeries within the next 24 hours, or the next week, or another appropriate time interval). Figure 1 Exemplarily explained, the video processing device and the remote server may be part of a local area network, and thus, the video processing device may retrieve the work list data via the local area network.

[0262] In some examples, the video processing device may retrieve worklist data corresponding to surgeries that are between a first time (e.g., 12 hours) before a current system time of the video processing device and a second time (e.g., 24 hours) after the current system time. Thus, the retrieved worklist data may be limited to a time span around the current system time. Thus, the patient information data of the worklist data may consist of (e.g., be limited to) patient information data having a scheduled time for a surgery that is between a first time before the current system time of the video processing device and a second time after the current system time. Such an implementation would limit the amount of data that needs to be retrieved while still allowing the user the flexibility to select surgeries that were scheduled in the past but were not performed at the scheduled time, for example due to delays, and to allow selection of surgeries that were scheduled in the future in case it is possible to perform the surgery earlier.

[0263] In some examples, the video processing device 20 may be adapted to detect the connection of an endoscope. The connection of the endoscope may trigger the receipt of worklist data. Thus, the video processing device 20 may retrieve the worklist data in response to detecting the connection of the endoscope.

[0264] like Figure 10A The illustrated patient information panel 400 includes a worklist section 410 that includes a plurality of selectable patient information items 411. The selectable patient information items 411 correspond to patient information data from the worklist data retrieved from the remote server. Each of the plurality of selectable patient information items 411 may include a patient name, a patient ID, and / or a scheduled surgery time. The plurality of selectable patient information items 411 in the worklist section 410 may be sorted chronologically based on the scheduled surgery time.

[0265] In some examples, the video processing device 20 stores one or more user profiles, each of which includes a user name and password for activating an authorization mode of the video processing device 20, and the work list section 410 is displayed based on whether the authorization mode is activated. In other words, the work list section 410 can be limited to being available only to authorized users of the video processing device 20.

[0266] like Figure 10AAs shown, the patient information panel 400 may include update information 401 indicating the last time the worklist data was retrieved / updated from the remote server. The update information 401 may be user-selectable and / or may provide a selectable icon that, when selected by the user, causes the video processing device to retrieve the worklist data (e.g., updated worklist data) from the remote server.

[0267] like Figure 10A As shown, the patient information panel 400 may include a search bar 402 for a search function. The search function may allow a user to enter one or more characters in the search bar 402. Accordingly, the video processing device may be adapted to receive an input sequence corresponding to the sequence of characters entered in the search bar 402. The video processing device (e.g., in response to detecting the character input in the search bar 402) may update the worklist portion 410 so that the displayed selectable patient information items 411 correspond to the one or more characters entered into the search bar 402. In response to receiving the input sequence, the video processing device 20 may filter the displayed selectable patient information items 411 from the plurality of selectable patient information items 411 based on a comparison between the character sequence in the search bar 402 and the patient information data corresponding to the plurality of selectable patient information items 411.

[0268] The video processing device 20 is adapted to detect a first user input 420 (e.g., a touch user input) corresponding to a selection of a first patient information item 411a from the plurality of selectable patient information items 411. Upon detecting the first user input 420, the video processing device 20 assigns the first patient information data corresponding to the first patient information item 411a to the surgical session. Thus, in the illustrated example, the first user input 420 corresponds to a selection of patient information related to the patient "Abbot, Ted," and thus, information specific to Abbot, Ted (e.g., name, identification number, scheduled time of surgery, etc.) is assigned to the currently open and active surgical session.

[0269] In some examples, such as Figure 10BAs shown, the video processing device 20 can display a confirmation dialog 430, for example, in the second portion 32 of the graphical user interface 27, in response to detecting the first user input 420. The confirmation dialog 430 can include a representation of first patient information data, such as patient information associated with the selected patient information item 411a. The confirmation dialog 430 can include a confirmation button 431 and, optionally, a cancel button 432. The confirmation button 431 can be selectable to continue assigning the first patient information data corresponding to the first patient information item 411a to the surgical session. The cancel button 432 can be selectable to abort assigning the first patient information data to the surgical session. Thus, the video processing device 20 can be adapted to detect a confirmation user input 421 (e.g., a touch user input) corresponding to the selection of the confirmation button 431. In response to detecting the confirmation user input 421, the video processing device 20 can assign the first patient information data corresponding to the first patient information item 411a to the surgical session.

[0270] Return to Figure 10A The video processing device is adapted to detect a second user input 422 (e.g., a touch user input), for example, to the collapse icon 403 of the patient information panel 400. The second user input 422 indicates a request to switch the display of the worklist portion 410 of the patient information panel 400. Figure 10C As shown, in response to detecting the second user input 422, the video processing device stops displaying the work list portion 410 of the patient information panel 400. If the work list portion 410 is not displayed (e.g., Figure 10C As shown), the second user input 423 is directed to the folding icon 403 (which is relative to Figure 10A The appearance of the patient information panel 400 may have changed), the video processing device 20 may (re)display the worklist portion 410 of the patient information panel 400 in response to detecting the second user input 423. Figure 10A Thus, in other words, based on the state that the work list portion 410 is currently displaying (e.g., Figure 10A ), the video processing device may stop displaying the work list portion 410 of the patient information panel 400 (as shown in FIG. Figure 10C ). And according to the fact that the work list portion 410 is not displayed when the second user input 423 is detected (as shown in FIG. Figure 10C ), the video processing device can display the work list portion of the patient information panel (as Figure 10A shown).

[0271] In some examples, the video processing device 20 may respond to detecting the second user input 423 (eg, when the work list portion 410 is not displayed) while the work list portion 410 is not displayed. Figure 10CTherefore, switching the display of the work list portion 410 (particularly when switching to display the work list portion 410) can cause the work list data to be updated and / or re-retrieved from the remote server.

[0272] The patient information panel 400 may include a header portion 405. After assigning the first patient information data to the surgical session (see Figure 10D ), the video processing device 20 can display the first patient information (for example, the patient's name and / or the patient's personal identification number) of the first patient information data in the title part 405.

[0273] After assigning the first patient information data to the surgical session, as Figure 10D As shown, the video processing device may stop displaying the work list portion 410 of the patient information panel 400. Instead, the video processing device 20 may display the detailed patient portion 440, which may be similar to the detailed patient portion 440 as described with respect to FIG. 9A to 9D The detailed part 320 is explained. For example, 9A to 9D As depicted, the detailed patient section 440 may include a hide button 330 for toggling a hide data function.

[0274] The patient information panel 400 (e.g., the detailed patient portion 440) may include a change patient button 442. The video processing device 20 may be adapted to detect a change request user input 425 corresponding to selection of the change patient button 442. In response to detecting the change request user input 425, the video processing device 20 may be adapted to detect a change request user input 425 corresponding to selection of the change patient button 442. Figure 10E As shown, the video processing device displays a confirmation dialog 450 including a confirmation button 451 and a cancel button 452. As illustrated, the confirmation dialog 450 may be displayed in the second portion 32 of the graphical user interface 27. Alternatively, the confirmation dialog 450 may be displayed in the first portion 31 of the graphical user interface 27. The video processing device 20 is adapted to detect a confirmation user input 426 corresponding to selection of the confirmation button 451. The video processing device 20 is also adapted to detect a cancel user input (not shown) corresponding to selection of the cancel button 452. As illustrated, upon detecting the confirmation user input 426, the video processing device 20 removes the designation of the first patient information data to the surgical session, stops displaying the confirmation dialog 450, and redisplays the worklist portion 410 in the patient information panel 400. In effect, the process returns to the state shown in FIG. Figure 10A Upon detecting the cancellation of the user input, the video processing device 20 maintains the designation of the first patient information data to the surgical session and stops displaying the confirmation dialog. Figure 10D The status shown.

[0275] As previously explained, the video processing device 20 can display one or more actionable items 36, including, for example, an image capture button 36a and / or a video capture button 36b. The video processing device 20 can be adapted to detect a capture user input 424 (e.g., a touch user input) corresponding to selection of the image capture button 36a. In response to detecting the capture user input 424, the video processing device 20 can store an image data file corresponding to the image data received when the capture user input 424 was detected. Furthermore, the video processing device can associate the stored image data file with the surgical session. Thus, as described with respect to 10A to 10C As explained, having previously assigned the first patient information data to the surgical session, the first patient information data is actually coupled with the stored image data file.A similar effect can be achieved with respect to video capture if the user selects the video capture button 36b.

[0276] In some examples, based on the system time of the video processing device 20 , the patient information entry displayed at the top in the patient information entries 411 is the next scheduled surgery.

[0277] For example, Figure 10F and Figure 10G As shown, selectable patient information items 411 include a primary selectable patient information item 412 and a secondary selectable patient information item 413. The primary selectable patient information item 412 has a primary surgery scheduled time 412a, and the secondary selectable patient information item 413 has a secondary surgery scheduled time 413a. The secondary surgery scheduled time 413a is later than the primary surgery scheduled time 412a. Furthermore, the selectable patient information items 411 do not include any intermediate selectable patient information items with intermediate surgery scheduled times between the primary surgery scheduled time 412a and the secondary surgery scheduled time 413a. In other words, the secondary selectable patient information item 413 is scheduled immediately after the primary selectable patient information item 412.

[0278] exist Figure 10F In , the current system time of the video processing device 20 is before 11:30, for example, 11:15. Figure 10G In the example, the current system time of the video processing device 20 is after 11:30 but before 12:00, for example, 11:45.

[0279] When the patient information panel 400 is displayed, the current system time of the video processing device 20 is before the scheduled time 412a of the main surgery (eg Figure 10F As shown), the video processing device 20 displays primary selectable patient information 412 in the work list portion 410 adjacent to the top 410 a of the work list portion 410 .

[0280] When the patient information panel 400 is displayed, the current system time of the video processing device 20 is between the scheduled time of the main surgery 412a and the scheduled time of the auxiliary surgery 413a (eg Figure 10G ), the video processing device 20 does not display the primary selectable patient information 412 in the work list portion 410. Therefore, the secondary selectable patient information item 413a is displayed in the work list portion 410 adjacent to the top 410a of the work list portion 410.

[0281] The worklist portion 410 may be scrollable. For example, the worklist portion 410 may be scrollable in a first scrolling direction (e.g., downward in the exemplary figure) to show earlier selectable patient information items in the plurality of selectable patient information items 411, and may be scrollable in a second scrolling direction (e.g., opposite to the first scrolling direction, such as upward in the exemplary figure) to show later selectable patient information items in the plurality of selectable patient information items 411. The worklist portion 410 may be scrollable in response to a touch and drag input (upward or downward) on the touch-sensitive display 26.

[0282] like Figure 10A As shown, the patient information panel 400 may include a manual input button 460. In some examples, where the worklist section 410 is restricted to be available only to authorized users, the manual input button 460 may still be available to unauthorized users.

[0283] The video processing device 20 may be adapted to detect a manual input button user input 470 corresponding to selecting the manual input button 460. Figure 10H As shown, in response to detecting manual input button user input 470, the video processing device can display a patient input panel 461, for example, within the second portion 32 of the graphical user interface 27. The patient input panel 461 can include one or more (e.g., multiple) patient information input fields 462 and a confirmation button 463.

[0284] The video processing device 20 is adapted to receive an input sequence corresponding to a sequence of characters entered into the patient input field 462. For example, a soft keyboard may be displayed upon detecting user input to the patient input field 462. Alternatively, an external keyboard may be used to provide the sequence of characters. After receiving the input sequence, the video processing device 20 is adapted to detect a confirmation user input 471 corresponding to selection of the confirmation button 463.

[0285] In response to receiving the confirmation user input 471, the video processing device assigns to the surgical session the manual patient information data corresponding to the sequence of characters in one or more patient input fields 462. Some patient input fields 462 may be left blank.

[0286] After assigning manual patient information data based on the information entered in the patient input field 462 to the surgical session, as shown in FIG. Figure 10I As shown, the video processing device 20 may stop displaying the patient input panel 461 and redisplay the patient information panel 400, wherein the title portion 404 includes second patient information of the manual patient information data according to the information entered in the patient input field 462. Figure 10D As explained, the patient information panel 400 may further include a detailed patient section 440 showing detailed patient information of the manual patient information data according to the information entered in the patient input field 462 .

[0287] like Figure 10I As shown, the patient information panel 400 may include an edit button 464. The video processing device 20 may be adapted to detect an edit button user input 472 corresponding to selection of the edit button 464. In response to detecting the edit button user input 472, the video processing device may (re)display the patient input panel 461, i.e., return to the patient input panel 461 as shown. Figure 10H The status shown.

[0288] like Figure 10I As shown, the patient information panel 400 may include a delete button 465. The video processing device 20 may be adapted to detect a delete button user input 473 corresponding to selecting the delete button 465. In response to detecting the delete button user input 473, as shown in FIG. Figure 10J As shown, the video processing device displays a confirmation dialog 466 including a confirmation button 467 and a cancel button 468. The video processing device is adapted to detect a confirmation user input 474 corresponding to selection of the confirmation button 467. The video processing device is also adapted to detect a cancel user input (not shown) corresponding to selection of the cancel button 468.

[0289] Upon detecting the confirmation user input 474, the video processing device 20 removes the assignment of the manual patient information data to the surgical session, stops displaying the confirmation dialog 466, and redisplays the patient information panel 400 including the manual input button 460. Figure 10A status.

[0290] Upon detecting the cancel user input corresponding to selection of the cancel button 468, the video processing device 20 maintains the assignment of the manual patient information data to the surgical session, stops displaying the confirmation dialog, and redisplays the patient information panel 400 including the delete button. Figure 10I status.

[0291] Figures 11A to 11BSchematically illustrates portions of an exemplary graphical user interface 27, such as the graphical user interface 27 described with respect to the previous figures. More specifically, Figures 11A to 11B The graphical user interface 27 is concerned with an alternative procedure for entering patient data. Figures 11A to 11B The procedure explained for entering patient data can be compared with the procedure explained for entering patient data. 10A to 10J The explained procedures are provided together (ie, within the same graphical user interface 27). More specifically,

[0292] exist Figure 11A , the video processing device 20 displays a plurality of representations 500 within the first portion 31 of the graphical user interface 27. The plurality of representations 500 corresponds to a plurality of stored data files (e.g., image data files and / or video data files) stored during a first surgical session (e.g., a previous surgical session or an ongoing surgical session). The plurality of representations 500 may be displayed in response to a user entering an archive mode of the video processing device 20. This may be accomplished, for example, by the user selecting an archive menu item 42a from one or more actionable menu items 42 displayed in the fourth portion 34 of the graphical user interface 27.

[0293] As explained above, the video processing device 20 may be adapted to receive data from a remote server (e.g., Figure 1 The work list data can be retrieved from the remote server 90 described above. As also explained previously, the work list data can include patient information data for a plurality of scheduled surgeries, such as scheduled surgeries within an appropriate time interval (e.g., between 12 hours before the current system time of the video processing device 20 and 24 hours after the current system time of the video processing device). The work list data can be retrieved in the form of a list of patient information data. 10A to 10J Execute in a similar manner as explained.

[0294] Also like Figure 11A As shown, the video processing device displays a patient information panel 400 within the second portion 32 of the graphical user interface 27. Figure 10A The illustrated patient information panel 400 is similar and includes a worklist portion 410 that includes a plurality of selectable patient information entries 411 corresponding to patient information data of the worklist data retrieved from the remote server.

[0295] The video processing device 20 is adapted to detect a first user input 510 corresponding to a selection of a first patient information entry 411a from the plurality of selectable patient information entries 411. Based on detecting the first user input 510, the video processing device assigns the first patient information data corresponding to the first patient information entry 411a to the first surgical session (i.e., the surgical session during which the plurality of stored data files corresponding to the plurality of representations 500 were stored).

[0296] Similar to Figure 10A ,like Figure 11A As shown, the patient information panel 400 may include a manual input button 501. The video processing device 20 may be adapted to detect a manual input button user input 511 corresponding to selecting the manual input button 501. Figure 11B As shown, in response to detecting manual input button user input 511, the video processing device may display a patient input panel 502, for example, within the second portion 32 of the graphical user interface 27. The patient input panel 502 may include one or more (e.g., multiple) patient information input fields 503 and a confirmation button 504. The patient input panel 502 may function similarly to the patient input panel 502 described in connection with the present invention. Figure 10H Patient input panel 461 is depicted.

[0297] In particular, the video processing device 20 may be adapted to receive an input sequence corresponding to a sequence of characters entered in the patient input field 503. After receiving the input sequence, the video processing device 20 is adapted to detect a confirmation user input corresponding to selecting the confirmation button 504, and in response to receiving the confirmation user input, the video processing device assigns the manual patient information data corresponding to the sequence of characters in the one or more patient input fields 503 to the first surgical session. Figure 10H As depicted, some patient input fields 503 may be left blank.

[0298] like Figure 11B As shown, the video processing device can display a worklist button 504 in the second portion 32 of the graphical user interface 27 (e.g., as part of the patient information panel 400). The video processing device 20 can be adapted to detect a worklist button user input 512 corresponding to selecting the worklist button 504. In response to detecting the worklist button user input 512, the video processing device 20 displays the patient information panel 400 including the worklist portion 410 within the second portion 32 of the graphical user interface 27. In effect, the transition to Figure 11A The status shown.

[0299] Therefore, as explained, Figure 11B The manual input mode shown is the same as Figure 11AIn some examples, a manual input mode ( Figure 11B ) as an initial mode for assigning patient data to information (such as a data file) stored during a first surgical session (e.g., a previous surgical session or an ongoing surgical session). Therefore, in order for a user to select patient information from a retrieved worklist, the user must first select Figure 11B Click the Work List button 504 in the Work List Input Mode to enter the Work List Input Mode.

[0300] 12A to 12D Schematically illustrates portions of an exemplary graphical user interface 27, such as the graphical user interface 27 described with respect to the previous figures. More specifically, 12A to 12D A graphical user interface 27 is involved in connection with a program for exporting stored data files, such as image data files and / or video data files.

[0301] In the illustrated example, also as regards Figure 4 As described, the video processing device 20 may include a network interface, such as a network interface for enabling the video processing device to communicate with a network server (such as an SMB server or a PACS server). Alternatively or additionally, the video processing device 20 may include an external communication interface (such as a USB interface), for example, to enable data to be transferred to an external data carrier (such as a USB storage device).

[0302] exist Figure 12A , the video processing device 20 displays a plurality of representations 600 within the first portion 31 of the graphical user interface 27. The plurality of representations 600 corresponds to a plurality of stored data files (e.g., image data files and / or video data files) stored during a first surgical session (e.g., a previous surgical session or an ongoing surgical session). The plurality of representations 600 may be displayed in response to the user entering an archive mode of the video processing device 20. This may be accomplished, for example, by the user selecting an archive menu item 42a from one or more actionable menu items 42 displayed in the fourth portion 34 of the graphical user interface 27. Figure 12A The plurality of representations 600 shown may correspond to Figure 11A The multiple representations shown are 500. Thus, Figure 11A and Figure 12A The parts of the graphical user interface 27 shown can each be used for the same archiving mode of the video processing device 20 .

[0303] The video processing device 20 may provide the possibility of exporting stored data files. For example, the user may select one or more of the stored data files for export. Each of the plurality of representations 600 may include a corresponding selection indicator 601 for the user to select or deselect to indicate which of the stored data files is to be exported. Figure 12A In the example of FIG, the selection indicator of one representation is indicated as being in an activated state (showing a cross frame), while the remaining selection indicators 601 are indicated as being in an inactivated state (showing empty frames). A user can select or deselect each of these selection indicators 601, thereby switching between an activated state (cross frame) and an inactivated state (empty frame). For example, the video processing device 20 is adapted to detect a selection user input 610 corresponding to a selection indicator 601 selecting a representation from the plurality of representations 600. Figure 12B As shown, in response to detecting a selection user input 610 and because the exemplary selected selection indicator does not indicate current activation, the video processing device changes the display of the exemplary selected selection indicator to indicate activation (i.e., adds a cross to the frame). If the exemplary selected selection indicator indicates current activation, the video processing device will change the display of the exemplary selected selection indicator to not indicate activation (i.e., remove the cross from the frame).

[0304] Also like Figure 12A As shown, the export button 602 may be displayed, for example, in the third portion 33 of the graphical user interface 27. The video processing device 20 may be adapted to detect a user input 611 (eg, a touch input) corresponding to selecting the export button 602. In response to detecting the user input 611, as shown Figure 12C As shown, the video processing device may display an export menu 603, for example, in the third portion 33 of the graphical user interface 27. When the indicator of the export menu 603 is the content of the third portion 33, the export button 602 may change its appearance to, for example, a second appearance (for example, a second color, for example, green) that is different from the first appearance (for example, a first color, for example, white).

[0305] In the export menu 603, the user can select how to export the selected data file (based on the selection state indicated by the selection indicator 601). In other words, the user wants to use which of multiple selectable export modalities to export the selected data file. For example, the user can export to an external storage device (such as a USB drive), the user can export to a PACS (Picture Archiving and Communication System) server, or the user can export to a network drive (such as an SMB storage entity). As shown, the export menu 603 includes multiple selectable export modalities 605, such as for exporting to a USB, PACS, and / or a network drive.

[0306] In some examples, the video processing device 20 stores one or more user profiles, each of which includes a username and password for activating an authorization mode of the video processing device 20, and the possibility of exporting to the PACS can be displayed based on whether the authorization mode is activated. In other words, the PACS server(s) can be restricted to being available only to authorized users of the video processing device 20.

[0307] exist Figure 12C In the example shown, (as indicated by the fill indicator) a USB drive named "Drive 1" has been selected as the current export location. Thus, the export modality is currently selected as USB device storage. The video processing device 20 may be adapted to detect user input (e.g., user input 612) corresponding to selection of another export location so that the user exports the selected data files to one of the other locations (e.g., one of a PACS server or a network drive). For example, the video processing device 20 may detect user input 612 corresponding to selection of the PACS server "Server 1" and, in response to detecting user input 612, as in Figure 12D As indicated in , the video processing device 20 changes the selected export location to "Server 1", which is also indicated by Figure 12D This is indicated by the filled indicator next to "Server 1" in the , and the now open indicator next to the USB drive "Drive 1." Thus, the export modality is selected as PACS.

[0308] like Figure 12C and Figure 12D As shown, the export confirmation button 604 is displayed as part of the export menu 603. The video processing device 20 is adapted to detect an export confirmation user input 613 (eg, Figure 12D In response to detecting the export confirmation user input 613, the video processing device transfers the stored image data corresponding to the selected stored data files (those stored data files having selection indicators 601 indicating current activation) to the selected export location (in the selected export location) via the selected export modality. Figure 12D In the example shown, the transmission is to the PACS server "Server 1").

[0309] Therefore, the selected export modality corresponds to the export to the PACS server (e.g. Figure 12D The video processing device 20 transmits the storage image data corresponding to the selected storage data file to the PACS server "Server 1". Figure 12CIn the state where the user input is detected 613), the video processing device 20 transfers the storage image data corresponding to the selected storage data file to the USB drive "Drive 1". According to the selected export mode corresponding to exporting to a network drive (such as the network drive "SMB1" has been selected), the video processing device 20 transfers the storage image data corresponding to the selected storage data file to the network drive "SMB 1".

[0310] In particular, when exporting to USB storage and / or network drive storage, the video processing device 20 may transfer the stored image data corresponding to the selected stored data file to a location on the USB drive or network drive, wherein the location is based on the details of the surgical session. For example, a folder may be created at the location, and the folder may be named based on the date (and optionally, time) of the surgery and / or a patient identifier (such as the patient's name and / or patient identification number). For example, as described with respect to Figures 10A to 11B As described, such information can be assigned to the surgery. However, in some examples, it may be advantageous not to include patient-specific details when exporting to a USB drive and / or network drive (e.g., a setting to include or exclude patient-specific details when exporting may be configured in a configuration menu of the video processing device). Thus, the folders may be named purely based on the date (and optionally the time) of the surgery.

[0311] When exporting to USB storage and / or network drive storage, the stored image data transferred to the USB drive or network drive may include selected stored data files in a common picture file format (e.g., PNG, JPEG, or TIFF). When exporting to PACS, the stored image data transferred to the PACS server may include selected stored data files in DICOM format (Digital Imaging and Communications in Medicine). Thus, the selection of the export modality affects the format in which the selected data files are exported. When exporting to PACS, surgical information may be exported. For example, the time and date of the surgery, (e.g., information about the surgery, Figures 10A to 11B Patient details and / or operator details (as described, assigned to the procedure) may be exported along with the image data.

[0312] 13A to 13E Schematically illustrates portions of an exemplary graphical user interface 27, such as the graphical user interface 27 described with respect to the previous figures. More specifically, 13A to 13E A graphical user interface 27 is provided in connection with a program for configuring the export of stored data files, such as image data files and / or video data files. 12A to 12D Described, about 13A to 13E The described procedure affects the export procedure.

[0313] Figure 13A The video processing device 20 is shown detecting a user input 710 corresponding to a selection of a setup menu item 42b of the one or more operable menu items 42 displayed in the fourth portion 34 of the graphical user interface 27. Figure 13B As shown, in response to detecting user input 710, a settings menu 700 is displayed, for example, in the second portion 32 of the graphical user interface 27. The settings menu 700 may include a plurality of setting buttons for configuring various settings, such as changing the language of the graphical user interface 27, changing the date and time of the system time of the video processing device 20, etc. The settings menu 700 may include a network drive settings button 701 to allow the user to configure the network drive settings for enabling exporting data files to a network drive, for example, as described with respect to 12A to 12D Explained.

[0314] The video processing device 20 may be adapted to detect another user input 711 corresponding to selecting a network drive settings button 701 in a settings menu 700 of a settings menu item 42b of one or more operational menu items 42 displayed in the fourth portion 34 of the graphical user interface 27. Figure 13C As shown, in response to detecting another user input 711, the video processing device displays a network drive overview 702. The network drive overview 702 can be displayed in the first portion 31 of the graphical user interface 27. In some examples, as shown, the network drive overview 702 can also extend into the second portion 32. Figure 13C As shown, the network driver settings button 701 may change appearance (eg, from a first background color to a second (different) background color) to indicate that the currently displayed page corresponds to the network driver settings button 701 .

[0315] The network driver overview 702 may include a list 703 of currently configured network drivers. In the illustrated example, the list 703 includes two network drivers. However, if no network drivers are configured, the list 703 may be empty. The network driver overview 702 may include a new button 704.

[0316] The video processing device 20 may be adapted to detect a user input 712 corresponding to a selection of the add button 704. In response to detecting the user input 712 corresponding to the selection of the add button 704, as shown in FIG. Figure 13D As shown, the video processing device 20 displays a network drive setting 705. The network drive setting 705 may be displayed in the first portion 31 of the graphical user interface 27. In some examples, the network drive setting 705 may also extend into the second portion 32 as illustrated.

[0317] The network drive settings 705 include a plurality of network drive input fields 706. The network drive settings 705 include a confirmation button 707. The network drive settings 705 include a cancel button 708, which, if selected, returns to the network drive overview 702. The network drive settings 705 include a test button 709.

[0318] When displaying network driver settings 705, video processing device 20 is suitable for receiving the sequence of one or more user inputs corresponding to the input character sequence in network driver input field 706. For example, when detecting the user input for network driver input field 706, soft keyboard can be displayed. Alternatively, an external keyboard can be used to provide the character sequence. The network driver input field can include server name (for example, for providing a label indicating the network driver), server IP address, server port number, directory name and user credentials (for example, when the network driver needs authorization to accept data storage). The user can select test button 709 to test the network driver according to the information provided in network driver input field 706, and therefore, if one or more contents of network driver input field 706 do not pass the verification test or the server according to the information provided does not respond, then a warning is provided.

[0319] The video processing device 20 is adapted to detect (e.g., after receiving the input sequence) a confirmation user input 713 corresponding to selecting the confirmation button 707. In response to receiving the confirmation user input 713, the video processing device 20 stores the network driver information for the first network driver corresponding to the character sequence in the one or more network driver input fields. Thus, the information that the user has entered into the network driver input field 706 is stored in the electronic memory of the video processing device 20.

[0320] When you then enter the export process (such as 12A to 12D ), the export menu 603 comprises the possibility to select a network driver according to the network driver information provided in the network driver input field; and according to the selected export mode ( Figure 12D ) corresponds to exporting to Figure 13D The video processing device 20 transmits the storage image data corresponding to the selected storage data file to the network driver according to the information input into the network driver input field 706.

[0321] Return to Figure 13C , the list 703 of the currently set network drivers includes the names of the currently set network drivers, and if Figure 13DIf the list is displayed after adding a network drive as explained, the list 703 will also contain a reference to the newly added network drive.

[0322] The user may be provided with the possibility to modify the configuration of the currently set network drive. Thus, the video processing device 20 may be adapted to detect an edit user input 714 corresponding to selecting a first network drive in the list 703 of currently set network drives. In some examples, the list 703 may include an edit button next to the network drive names in the list 703. Thus, the edit user input 714 may additionally or alternatively correspond to selecting the edit button of the first network drive. In response to receiving the edit user input 714, as Figure 13E As shown, the video processing device 20 can display a network driver editing page 720. The network driver editing page 720 includes a plurality of network driver editing bars 721, which are similar to Figure 13D 7. Multiple network driver input fields 706 are provided in the network driver edit field 721, but the fields contain current information. The user can change some or all of the information in the network driver edit field 721 to change the configuration. For example, a soft keyboard can be displayed when user input to the network driver edit field 721 is detected. Alternatively, an external keyboard can be used to provide input to the network driver edit field 721. The user can select a test button 723 to test the network driver based on the information provided in the network driver edit field 721, and thus provide a warning if one or more contents of the network driver edit field 721 fail a validation test or if the server is unresponsive based on the provided information.

[0323] Changes to the network driver configuration made by changing the contents of one or more network driver edit fields 721 may be automatically saved. Alternatively, an edit confirmation button (similar to Figure 13D A confirmation button 707 may be provided to save the changes. Similarly, a cancel button may be provided to undo any changes entered.

[0324] The network drive edit page 720 may include a delete button 722. The video processing device 20 may be adapted to detect a delete user input 714 corresponding to a selection of the delete button 722. In response to receiving the delete user input 714, the video processing device 20 may delete the stored information associated with the network drive currently being edited. Subsequently, the video processing device 20 may display the network drive overview 702. Thus, essentially returning to Figure 13C , where the now deleted network drive will be omitted from the list 703.

[0325] The present disclosure has been described with reference to the preferred embodiments. However, the scope of the present invention is not limited to the illustrated embodiments, and changes and modifications may be made without departing from the scope of the present invention.

[0326] Throughout the description, the use of the terms "first," "second," "third," "fourth," "primary," "auxiliary," "tertiary," etc. does not imply any particular order or importance, but is included to identify individual elements. Furthermore, reference to a first element does not imply the presence of a second element and vice versa.

[0327] Exemplary embodiments

[0328] Exemplary embodiments of the present disclosure are set forth in the following items:

[0329] 1. A video processing device operable to receive image data from an endoscope, the endoscope having an image sensor configured to generate image data indicative of a view from the endoscope, the video processing device comprising:

[0330] -case,

[0331] a processing unit adapted to receive the image data from the endoscope when the image data is generated and to cause a display to display a graphical user interface, the graphical user interface extending a first length along a first direction and a second length along a second direction perpendicular to the first direction, the graphical user interface comprising a plurality of non-overlapping portions, the plurality of non-overlapping portions comprising a first portion and a second portion, wherein the first portion is disposed proximate to the second portion along the second direction,

[0332] and wherein the video processing device displays a live representation of the image data within the first portion of the graphical user interface, wherein the live representation is displayed at full size covering the first length along the first direction,

[0333] The video processing device is adapted to detect a first user input signal indicating a request for activating a freeze function, and in response to detecting the first user input signal, the video processing device activates the freeze function, comprising:

[0334] - ceasing to display the live representation of the image data within the first portion of the graphical user interface,

[0335] - displaying within the first portion of the graphical user interface a first representation of a still image corresponding to the image data received upon detecting the first user input signal, wherein the first representation of the still image is displayed at the full size, and

[0336] - displaying a live representation of the image data within a second portion of the graphical user interface, wherein the live representation is displayed at a reduced size that is smaller than the full size.

[0337] 2. The video processing device according to any of the preceding clauses, wherein, when the freeze function is in an activated state, the video processing device is adapted to detect a second user input signal indicating a request for deactivating the freeze function, and in response to detecting the second user input signal, the video processing device deactivates the freeze function, comprising:

[0338] - ceasing to display the first representation of the still image within the first portion of the graphical user interface,

[0339] - displaying a live representation of the image data within the first portion of the graphical user interface, wherein the live representation is displayed at the full size, and

[0340] - ceasing to display the live representation of the image data within the second portion of the graphical user interface.

[0341] 3. A video processing device according to item 2, wherein the video processing device is suitable for detecting user input to the live representation of the image data being displayed within the second part of the graphical user interface, and wherein the second user input signal is issued by detecting the user input to the live representation of the image data.

[0342] 4. A video processing device according to any one of items 2 to 3, wherein the video processing device is adapted to detect disconnection of the endoscope, and wherein the second user input signal is issued in response to detecting that the endoscope is disconnected from the video processing device.

[0343] 5. A video processing device according to any one of items 2 to 4, wherein the video processing device is adapted to detect connection of the endoscope, and wherein the second user input signal is issued in response to detecting connection of a second endoscope to the video processing device.

[0344] 6. The video processing device according to any of the preceding clauses, wherein displaying the first representation of the still image within the first portion of the graphical user interface comprises displaying a freeze indicator element covering a portion of the first representation of the still image.

[0345] 7. A video processing device according to any of the preceding items, wherein the video processing device displays a freeze button, for example, within the third part of the graphical user interface, wherein the video processing device is suitable for detecting user input corresponding to selection of the freeze button, and wherein the first user input signal is issued by detecting user input corresponding to selection of the freeze button.

[0346] 8. A video processing device according to any of the preceding items, wherein the video processing device is adapted to detect a first endoscopic signal from the endoscope, the first endoscopic signal indicating that a user has activated a first button on the endoscope, and wherein the first user input signal is issued by detecting the first endoscopic signal.

[0347] 9. A video processing device according to any of the preceding clauses, wherein, when the freeze function is activated, the video processing device is adapted to detect a third user input signal indicating a request to store the still image, and in response to detecting the third user input signal, the video processing device stores in the electronic memory of the video processing device an image data file corresponding to the image data received when the first user input signal was detected.

[0348] 10. The video processing device according to item 9, wherein the image data file includes information indicating that the image data file was captured while the freeze function was activated.

[0349] 11. A video processing device according to any one of items 9 to 10, wherein the video processing device displays one or more operable items, for example, within a third part of the graphical user interface, wherein the one or more operable items include an image capture button, wherein the video processing device is suitable for detecting a capture user input corresponding to selection of the image capture button, and wherein the third user input signal is issued by a user input corresponding to selection of the image capture button.

[0350] 12. A video processing device according to any one of items 9 to 11, wherein the video processing device is suitable for detecting a second endoscopic signal from the endoscope, the second endoscopic signal indicating that the user activates a second button on the endoscope, wherein the third user input signal is issued by detecting the second endoscopic signal.

[0351] 13. The video processing device according to any one of clauses 9 to 12, wherein the video processing device further deactivates the freeze function in response to detecting the third user input signal, comprising:

[0352] - ceasing to display the first representation of the still image within the first portion of the graphical user interface,

[0353] - displaying a live representation of the image data within the first portion of the graphical user interface, wherein the live representation is displayed at the full size, and

[0354] - ceasing to display the live representation of the image data within the second portion of the graphical user interface.

[0355] 14. A video processing device according to any of clauses 9 to 13, wherein the video processing device is further to display the first representation of the still image within the second portion of the graphical user interface in response to detecting the third user input signal.

[0356] 15. A video processing device according to item 14, wherein the video processing device stops displaying the first representation of the still image within the second part of the graphical user interface after a predetermined delay after detecting the third user input signal.

[0357] 16. A video processing device according to any of the preceding items, wherein the video processing device includes one or more image modification functions, each of the one or more image modification functions modifying one or more parameters of the live representation of the image data when activated, and wherein the one or more image modification functions are activatable when the freeze function is not activated, and wherein the one or more image modification functions are not activatable when the freeze function is activated.

[0358] 17. A video processing device according to item 16, wherein, when the freeze function is activated, the video processing device displays a notification in response to detecting a fourth user input signal indicating a request for activating an image modification function among the one or more image modification functions, the notification indicating that the image modification function is disabled while the freeze function is activated.

[0359] 18. A video processing device according to any of the preceding items, wherein the video processing device includes an endoscope light switch function, which, when activated, causes deactivation of the light emitter of the endoscope, and wherein the endoscope light switch function is activatable when the freeze function is not activated, and wherein the endoscope light switch function is not activatable when the freeze function is activated.

[0360] 19. A video processing device according to item 18, wherein the video processing device activates the freeze function in response to detecting the first user input signal based on the light emitter of the endoscope being in an activated state, and wherein the video processing device abandons activating the freeze function in response to detecting the first user input signal based on the light emitter of the endoscope being in an unactivated state.

[0361] 20. A video processing device operable to receive image data from an endoscope, the endoscope having an image sensor configured to generate image data indicative of a view from the endoscope, the video processing device comprising:

[0362] -case,

[0363] a peripheral input device interface adapted to couple the video processing apparatus to one or more peripheral input devices, and

[0364] a processing unit adapted to receive the image data from the endoscope when the image data is generated and to cause a display to display a graphical user interface, the graphical user interface extending a first length along a first direction and a second length along a second direction perpendicular to the first direction, the graphical user interface comprising a plurality of non-overlapping portions, the plurality of non-overlapping portions comprising a first portion and a second portion, wherein the first portion is arranged proximate to the second portion along the second direction, the processing unit further adapted to detect one or more peripheral input signals from the one or more peripheral input devices,

[0365] The video processing device displays a shortcut setting user interface in the first part of the graphical user interface.

[0366] When displaying the shortcut setting user interface, the video processing device is adapted to detect a first peripheral input signal from a first peripheral input device coupled to the video processing device, wherein the first peripheral input signal indicates activation of an input component of the first peripheral input device, and in response to detecting the first peripheral input signal, the video processing device:

[0367] - displaying a shortcut indicator indicating an input component of the first peripheral input device associated with the first peripheral input signal, and

[0368] - displaying a function selection interface comprising two or more representations of two or more functions assignable to input components of the first peripheral input device,

[0369] The video processing device is adapted to detect a first user input indicating selection of a first function among the two or more functions while displaying the function selection interface, and in response to detecting the first user input, the video processing device stores first shortcut information, the first shortcut information including assigning the first peripheral input signal to the first function,

[0370] And wherein, after storing the first shortcut information, the video processing device is adapted to detect a first peripheral input signal from the first peripheral input device, and in response to detecting the first peripheral input signal, the video processing device activates the first function according to the video processing device operating in a first mode in which the first function is available.

[0371] 21. A video processing device according to clause 20, wherein, when operating in the first mode, the video processing device displays a live representation of the image data within the first portion of the graphical user interface.

[0372] 22. A video processing device according to any one of items 20 to 21, wherein, after storing the first shortcut information and in response to detecting the first peripheral input signal, according to the video processing device operating in a second mode in which the first function is unavailable, the video processing device displays an error notification in the graphical user interface and abandons activating the first function.

[0373] 23. The video processing apparatus according to any one of items 20 to 22, wherein the peripheral input device interface comprises a USB interface and / or a Bluetooth interface.

[0374] 24. A video processing apparatus according to any one of items 20 to 23, wherein the one or more peripheral input devices include one or more of a keyboard, a mouse, a trackpad, a game controller and a foot pedal, and / or wherein the first peripheral input device is a foot pedal.

[0375] 25. The video processing apparatus according to any one of items 20 to 24, wherein the shortcut setting user interface comprises instructions for connecting a first peripheral input device and / or for activating an input component of the first peripheral input device.

[0376] 26. A video processing device according to any one of items 20 to 25, wherein, in response to detecting the first peripheral input signal when displaying the shortcut setting user interface, the video processing device includes the following shortcut information - the shortcut information includes assigning the first peripheral input signal to a previous function, and the video processing device displays a warning message.

[0377] 27. A video processing device according to any one of items 20 to 26, wherein, in response to detecting the first peripheral input signal when displaying the shortcut setting user interface, the video processing device displays a cancel button that can be selected for exiting the shortcut setting user interface without storing the first shortcut information.

[0378] 28. A video processing device according to any one of items 20 to 27, wherein, in response to detecting the first user input, the video processing device displays a naming dialog, which is suitable for receiving a first user input name, the first user input name is used to identify the designation of the first peripheral input signal to the first function, and wherein the stored first shortcut information includes the first user input name.

[0379] 29. A video processing device according to any one of items 20 to 28, wherein the two or more functions that can be assigned to the input component of the first peripheral input device include a capture image function, which enables the video processing device to store an image data file corresponding to the image data received when the capture image function is activated.

[0380] 30. A video processing device according to any one of items 20 to 29, wherein the two or more functions assignable to the input component of the first peripheral input device include a video capture function, which enables the video processing device to store a video sequence of image data corresponding to the image data received when the video capture function is activated.

[0381] 31. A video processing device according to any one of items 20 to 30, wherein the video processing device stores one or more user profiles, each user profile comprising a user name and password for activating an authorization mode of the video processing device, and wherein the shortcut setting user interface is displayed based on whether the authorization mode is activated.

[0382] 32. A video processing device operable to receive image data from an endoscope, the endoscope having an image sensor configured to generate image data indicative of a view from the endoscope, the video processing device comprising:

[0383] -case,

[0384] a processing unit adapted to receive the image data from the endoscope when the image data is generated and to cause a primary display to display a graphical user interface, the graphical user interface extending a first length along a first direction and a second length along a second direction perpendicular to the first direction, the graphical user interface comprising a plurality of non-overlapping portions, the plurality of non-overlapping portions comprising a first portion and a second portion, wherein the first portion is disposed proximate to the second portion along the second direction,

[0385] And wherein, the video processing device:

[0386] - displaying a live representation of the image data within the first portion of the graphical user interface, and

[0387] - displaying a patient information panel within the second portion of the graphical user interface, the patient information panel comprising a title portion and a detail portion, the detail portion further comprising detailed patient information and a hide button,

[0388] The video processing device is adapted to detect a hidden user input corresponding to selection of the hidden button, and in response to detecting the hidden user input, the video processing device:

[0389] - in accordance with the hidden data function being activated when the hidden user input is detected, deactivating the hidden data function, including displaying the first patient information in the header portion, and

[0390] - activating the hidden data function, including stopping displaying the first patient information in the title portion, based on the hidden data function not being in an activated state when the hidden user input is detected,

[0391] and wherein the video processing device is further adapted to detect a detail user input indicative of a request to switch a detail portion of the patient information panel, and in response to detecting the detail user input, the video processing device:

[0392] - ceasing to display the detail portion of the patient information panel in accordance with the detail portion being displayed when the detail user input is detected, and

[0393] - displaying a details portion of the patient information panel in response to the details portion not being displayed when the details user input is detected.

[0394] 33. A video processing device according to item 32, wherein the video processing device comprises a display interface adapted to connect the video processing device to an external display, and wherein the video processing device is adapted to cause the external display to display an auxiliary graphical user interface, the auxiliary graphical user interface extending by a first auxiliary length along a first auxiliary direction and by a second auxiliary length along a second auxiliary direction perpendicular to the first auxiliary direction, the auxiliary graphical user interface comprising a plurality of non-overlapping auxiliary portions, the plurality of non-overlapping auxiliary portions comprising a first auxiliary portion and a second auxiliary portion, wherein the first auxiliary portion is arranged adjacent to the second auxiliary portion along the second auxiliary direction,

[0395] The video processing device:

[0396] - displaying a live representation of the image data within a first auxiliary portion of the auxiliary graphical user interface,

[0397] - displaying an auxiliary patient information panel within the second auxiliary portion of the auxiliary graphical user interface in accordance with the hide data function not being activated, the auxiliary patient information panel including the detailed patient information, and

[0398] - in accordance with the hide data function being activated, forgoing display of the auxiliary patient information panel in the second auxiliary portion of the auxiliary graphical user interface.

[0399] 34. The video processing device according to clause 33, wherein the video processing device is further responsive to detecting the detail user input:

[0400] - in response to the hide data function not being active and the detailed portion not being displayed when the detailed user input is detected, displaying the auxiliary patient information panel, the auxiliary patient information panel including the detailed patient information,

[0401] - ceasing to display the auxiliary patient information panel in response to the hide data function not being active and the detail portion being displayed when the detail user input is detected, and

[0402] - in response to the hide data function being activated when the detailed user input is detected, forgoing displaying the auxiliary patient information panel within the second auxiliary portion of the auxiliary graphical user interface.

[0403] 35. The video processing device of any of clauses 32 to 34, wherein, in response to detecting the hidden user input:

[0404] - in accordance with the hidden data functionality being active when the hidden user input is detected, changing the visual appearance of the hidden button to a first appearance, and

[0405] - in response to the hidden data function not being active when the hidden user input is detected, changing the visual appearance of the hidden button to a second appearance different from the first appearance.

[0406] 36. The video processing apparatus according to any one of items 32 to 35, wherein the first patient information comprises the patient's name and / or the patient's personal identification number.

[0407] 37. The video processing device according to any one of items 32 to 36, wherein the detailed patient information comprises first patient information and additional patient information of the patient, the additional patient information comprising, for example, the date of birth and / or gender of the patient.

[0408] 38. A video processing device operable to receive image data from an endoscope, the endoscope having an image sensor configured to generate image data indicative of a view from the endoscope, the video processing device comprising:

[0409] -case,

[0410] a processing unit adapted to receive the image data from the endoscope when the image data is generated and to cause a primary display to display a graphical user interface, the graphical user interface extending a first length along a first direction and a second length along a second direction perpendicular to the first direction, the graphical user interface comprising a plurality of non-overlapping portions, the plurality of non-overlapping portions comprising a first portion and a second portion, wherein the first portion is disposed proximate to the second portion along the second direction,

[0411] And wherein, the video processing device:

[0412] - retrieving worklist data from a remote server, wherein the worklist data includes patient information data for a plurality of scheduled surgeries,

[0413] -Open surgery session,

[0414] - displaying a live representation of the image data within the first portion of the graphical user interface, and

[0415] - displaying a patient information panel within the second portion of the graphical user interface, the patient information panel comprising a worklist portion including a plurality of selectable patient information items corresponding to the patient information data of the worklist data,

[0416] The video processing device is adapted to detect a first user input corresponding to a selection of a first patient information entry from the plurality of selectable patient information entries, and based on detecting the first user input, the video processing device assigns first patient information data corresponding to the first patient information entry to the surgical session.

[0417] 39. The video processing device according to clause 38, wherein the video processing device and the remote server are part of a local area network, and wherein the video processing device retrieves the work list data via the local area network.

[0418] 40. The video processing device according to any of clauses 38 to 39, wherein the video processing device is adapted to detect a second user input indicating a request to toggle display of the worklist portion of the patient information panel, and in response to detecting the second user input, the video processing device:

[0419] - ceasing to display the worklist portion of the patient information panel in accordance with the worklist portion being displayed when the second user input is detected, and

[0420] - displaying the worklist portion of the patient information panel in response to the worklist portion not being displayed when the second user input is detected.

[0421] 41. The video processing device of clause 40, wherein, in response to detecting the second user input and in accordance with the work list portion not being displayed when the second user input is detected, the video processing device retrieves the work list data from the remote server.

[0422] 42. A video processing device according to any one of items 38 to 41, wherein the video processing device displays a representation of the first patient information data and a confirmation button in response to detecting the first user input, the video processing device is suitable for detecting a confirmation user input corresponding to selection of the confirmation button, and in response to detecting the confirmation user input, the video processing device assigns the first patient information data to the surgical session.

[0423] 43. A video processing device according to any one of items 38 to 42, wherein each of the plurality of selectable patient information items comprises one or more of a patient name, a patient identification number, and a scheduled time for surgery.

[0424] 44. The video processing apparatus according to any one of items 38 to 43, wherein the plurality of selectable patient information items of the work list portion are sorted in chronological order based on a scheduled time of surgery.

[0425] 45. A video processing device according to any one of items 38 to 44, wherein the patient information data of the work list consists of patient information data having a scheduled surgery time, which is between a first time before a current system time of the video processing device and a second time after the current system time.

[0426] 46. ​​The video processing device according to any one of items 38 to 45, wherein the selectable patient information items include a primary selectable patient information item and a secondary selectable patient information item, wherein the primary selectable patient information item has a primary surgery scheduled time and the secondary selectable patient information item has a secondary surgery scheduled time that is later than the primary surgery scheduled time,

[0427] wherein the selectable patient information items do not include an intermediate selectable patient information item having an intermediate surgery scheduled time, the intermediate surgery scheduled time being between the primary surgery scheduled time and the auxiliary surgery scheduled time, and

[0428] In which, when displaying the patient information panel, based on the current system time of the video processing device being between the scheduled time of the main operation and the scheduled time of the auxiliary operation, the video processing device does not display the main selectable patient information entry in the work list part, and displays the auxiliary selectable patient information entry in the work list part at a position adjacent to the top of the work list part.

[0429] 47. A video processing device according to any one of items 38 to 46, wherein the work list portion is scrollable in a first scrolling direction to show earlier selectable patient information entries among the multiple selectable patient information entries, and is scrollable in a second scrolling direction to show later selectable patient information entries among the multiple selectable patient information entries.

[0430] 48. A video processing device according to any one of items 38 to 47, wherein the video processing device is adapted to detect connection of the endoscope, and wherein the video processing device retrieves the worklist data and opens the surgical session in response to detecting connection of the endoscope.

[0431] 49. A video processing device according to item 48, wherein the video processing device obtains device identifier information from the device identifier of the endoscope in response to detecting the connection of the endoscope, and wherein the surgical session is associated with the device identifier information.

[0432] 50. A video processing device according to any one of items 38 to 48, wherein the video processing device displays one or more operable items within the graphical user interface, wherein the one or more operable items include an image capture button, and wherein the video processing device is suitable for detecting a capture user input corresponding to selection of the image capture button, and in response to detecting the capture user input, the video processing device stores an image data file corresponding to the image data received when the capture user input is detected, and associates the image data file with the surgical session.

[0433] 51. A video processing device according to any one of items 38 to 50, wherein the patient information panel includes a search bar, and wherein the video processing device is suitable for receiving an input sequence corresponding to a character sequence entered in the search bar, and in response to receiving the input sequence, the video processing device filters the displayed selectable patient information entries from the multiple selectable patient information entries based on a comparison between the character sequence in the search bar and the patient information data corresponding to the multiple selectable patient information entries.

[0434] 52. A video processing device according to any one of items 38 to 51, wherein the patient information panel includes a title portion, and wherein, after the first patient information data is assigned to the surgical session, the video processing device displays the first patient information of the first patient information data in the title portion.

[0435] 53. The video processing device according to any one of items 38 to 52, wherein after assigning the first patient information data to the surgical session, the video processing device stops displaying the work list portion of the patient information panel.

[0436] 54. The video processing device according to any of items 38 to 53, wherein the patient information panel includes a change patient button, and wherein the video processing device is adapted to detect a change request user input corresponding to selection of the change patient button, and in response to detecting the change request user input, the video processing device displays a confirmation dialog including a confirmation button and a cancel button, and is adapted to detect a confirmation user input corresponding to selection of the confirmation button and a cancel user input corresponding to selection of the cancel button, the video processing device:

[0437] - upon detecting the confirmation user input, removing the assignment of the first patient information data to the surgical session, ceasing to display the confirmation dialog, and redisplaying the worklist portion in the patient information panel,

[0438] - based on detecting the cancel user input, maintaining the assignment of the first patient information data to the surgical session, ceasing to display the confirmation dialog, and forgoing redisplaying the worklist portion in the patient information panel.

[0439] 55. A video processing device according to any of items 38 to 54, wherein the patient information panel comprises a manual input button, and wherein the video processing device is adapted to detect a manual input button user input corresponding to selection of the manual input button, and

[0440] Based on detecting the manual input button user input, the video processing device displays a patient input panel within the second portion of the graphical user interface, the patient input panel including one or more patient information input fields and a confirmation button, wherein the video processing device is adapted to receive an input sequence corresponding to entering a sequence of characters in the one or more patient input fields and a subsequent confirmation user input corresponding to selecting the confirmation button, and

[0441] In response to receiving the confirmation user input, the video processing device assigns manual patient information data corresponding to the sequence of characters in the one or more patient input fields to the surgical session.

[0442] 56. A video processing device according to any one of items 38 to 55, wherein the video processing device stores one or more user profiles, each user profile comprising a user name and password for activating an authorization mode of the video processing device, and wherein the work list portion is displayed based on whether the authorization mode is activated.

[0443] 57. A video processing device operable to receive image data from an endoscope, the endoscope having an image sensor configured to generate image data indicative of a view from the endoscope, the video processing device comprising:

[0444] -case,

[0445] a processing unit adapted to receive the image data from the endoscope when the image data is generated and to cause a primary display to display a graphical user interface, the graphical user interface extending a first length along a first direction and a second length along a second direction perpendicular to the first direction, the graphical user interface comprising a plurality of non-overlapping portions, the plurality of non-overlapping portions comprising a first portion and a second portion, wherein the first portion is disposed proximate to the second portion along the second direction,

[0446] And wherein, the video processing device:

[0447] - retrieving worklist data from a remote server, wherein the worklist data includes patient information data for a plurality of scheduled surgeries,

[0448] - displaying within the first portion of the graphical user interface a plurality of representations corresponding to a plurality of stored data files stored during the surgical session,

[0449] - displaying a patient information panel within the second portion of the graphical user interface, the patient information panel comprising a worklist portion including a plurality of selectable patient information items corresponding to the patient information data of the worklist data,

[0450] The video processing device is adapted to detect a first user input corresponding to a selection of a first patient information entry from the plurality of selectable patient information entries, and based on detecting the first user input, the video processing device assigns first patient information data corresponding to the first patient information entry to the surgical session.

[0451] 58. A video processing device according to item 57, wherein, before displaying the patient information panel including the work list portion, the video processing device displays a work list button in the second part of the graphical user interface, the video processing device is suitable for detecting a work list button user input corresponding to a selection of the work list button, and in response to detecting the work list button user input, the video processing device displays the patient information panel including the work list portion within the second part of the graphical user interface.

[0452] 59. A video processing device operable to receive image data from an endoscope, the endoscope having an image sensor configured to generate image data indicative of a view from the endoscope, the video processing device comprising:

[0453] -case,

[0454] a processing unit adapted to receive the image data from the endoscope when the image data is generated and to cause a primary display to display a graphical user interface, the graphical user interface extending a first length along a first direction and a second length along a second direction perpendicular to the first direction, the graphical user interface comprising a plurality of non-overlapping portions, the plurality of non-overlapping portions comprising a first portion and a second portion, wherein the first portion is disposed proximate to the second portion along the second direction,

[0455] And wherein, the video processing device:

[0456] -Open surgery session,

[0457] - displaying a live representation of the image data within the first portion of the graphical user interface,

[0458] - displaying a patient input panel within the second portion of the graphical user interface, the patient input panel comprising one or more patient information input fields and a confirmation button,

[0459] The video processing device is adapted to receive an input sequence corresponding to entering a sequence of characters in the one or more patient input fields and a subsequent confirmation user input corresponding to selecting the confirmation button, and

[0460] In response to receiving the confirmation user input, the video processing device assigns manual patient information data corresponding to the sequence of characters in the one or more patient input fields to the surgical session.

[0461] 60. A video processing device according to item 59, wherein, before displaying the patient input panel, the video processing device displays a manual input button within the second part of the graphical user interface, the video processing device is suitable for detecting a manual input button user input corresponding to a selection of the manual input button, and in response to detecting the manual input button user input, the video processing device displays the patient input panel within the second part of the graphical user interface.

[0462] 61. A video processing device according to any one of items 59 to 60, wherein, after assigning the manual patient information data to the surgical session, the video processing device stops displaying the patient input panel and displays the patient information panel within the second part of the graphical user interface.

[0463] 62. The video processing device according to item 61, wherein the patient information panel includes a title portion, and wherein the video processing device displays the first patient information of the manual patient information data in the title portion.

[0464] 63. A video processing device according to any one of items 61 to 62, wherein the patient information panel includes an edit button, and wherein the video processing device is suitable for detecting an edit button user input corresponding to a selection of the edit button, and in response to detecting the edit button user input, the video processing device displays a patient input panel including the one or more patient information input fields within the second part of the graphical user interface.

[0465] 64. The video processing device according to any of items 61 to 63, wherein the patient information panel includes a delete button, and wherein the video processing device is adapted to detect a delete button user input corresponding to selection of the delete button, and in response to detecting the delete button user input, the video processing device displays a confirmation dialog including a confirm button and a cancel button, and is adapted to detect a confirm user input corresponding to selection of the confirm button and a cancel user input corresponding to selection of the cancel button, the video processing device:

[0466] - upon detecting the confirmation user input, removing the assignment of the manual patient information data to the surgical session, ceasing to display the confirmation dialog, and displaying the manual input button within the second portion of the graphical user interface, and

[0467] - based on detecting the cancellation user input, maintaining the assignment of the manual patient information data to the surgical session, ceasing to display the confirmation dialog, and redisplaying the patient information panel within the second portion of the graphical user interface.

[0468] 65. A video processing device operable to receive image data from an endoscope, the endoscope having an image sensor configured to generate image data indicative of a view from the endoscope, the video processing device comprising:

[0469] -case,

[0470] a processing unit adapted to receive the image data from the endoscope when the image data is generated and to cause a primary display to display a graphical user interface, the graphical user interface extending a first length along a first direction and a second length along a second direction perpendicular to the first direction, the graphical user interface comprising a plurality of non-overlapping portions, the plurality of non-overlapping portions comprising a first portion and a second portion, wherein the first portion is disposed proximate to the second portion along the second direction,

[0471] And wherein, the video processing device:

[0472] - displaying within the first portion of the graphical user interface a plurality of representations corresponding to a plurality of stored data files stored during the surgical session,

[0473] - displaying a patient input panel within the second portion of the graphical user interface, the patient input panel comprising one or more patient information input fields and a confirmation button,

[0474] The video processing device is adapted to receive an input sequence corresponding to entering a sequence of characters in the one or more patient input fields and a subsequent confirmation user input corresponding to selecting the confirmation button, and

[0475] In response to receiving the confirmation user input, the video processing device assigns manual patient information data corresponding to the sequence of characters in the one or more patient input fields to the surgical session.

[0476] 66. A video processing device according to item 65, wherein, before displaying the patient input panel, the video processing device displays a manual input button in the second part of the graphical user interface, the video processing device is suitable for detecting a manual input button user input corresponding to a selection of the manual input button, and in response to detecting the manual input button user input, the video processing device displays the patient input panel within the second part of the graphical user interface.

[0477] 67. A video processing device operable to receive image data from an endoscope, the endoscope having an image sensor configured to generate image data indicative of a view from the endoscope, the video processing device comprising:

[0478] -case,

[0479] - Network interface,

[0480] a processing unit adapted to receive the image data from the endoscope when the image data is generated and to cause a primary display to display a graphical user interface, the graphical user interface extending a first length along a first direction and a second length along a second direction perpendicular to the first direction, the graphical user interface comprising a plurality of non-overlapping portions, the plurality of non-overlapping portions comprising a first portion and a second portion, wherein the first portion is disposed proximate to the second portion along the second direction,

[0481] The video processing device displays a network driver setting in the first part of the graphical user interface, wherein the network driver setting includes a plurality of network driver input fields and a confirmation button.

[0482] While displaying the network driver settings, the video processing device is adapted to receive a sequence of one or more user inputs corresponding to entering a sequence of characters in the one or more network driver input fields, and a confirmation user input corresponding to selecting the confirmation button,

[0483] In response to receiving the confirmation user input, the video processing device stores network driver information for a first network driver corresponding to the sequence of characters in the one or more network driver input fields.

[0484] 68. A video processing device according to item 67, wherein the plurality of network driver input fields include one or more of the following: server name, server IP address, server port number, directory name and user credentials.

[0485] 69. The video processing device according to any of clauses 67 to 68, wherein after storing the network driver information of the first network driver, the video processing device:

[0486] - displaying within the first portion of the graphical user interface a plurality of representations corresponding to a plurality of stored data files stored during the surgical session, and

[0487] -Show Export button,

[0488] wherein the video processing device is adapted to detect an export user input corresponding to a selection of the export button, and in response to detecting the export user input, the video processing device displays an export menu including an export confirmation button, wherein the video processing device is adapted to receive an export confirmation user input corresponding to the selection of the export confirmation button, the export menu further including a plurality of selectable export modalities, the plurality of selectable export modalities including exporting to a first PACS server and exporting to the first network drive, and wherein the video processing device is adapted to receive a modality selection user input corresponding to a selection of a selected export modality from the plurality of selectable export modalities,

[0489] Wherein, in response to detecting the export confirmation user input and corresponding to exporting to the first network drive according to the selected export modality, the video processing device transfers the stored image data corresponding to one or more of the multiple stored data files to the first network drive.

[0490] 70. A video processing device operable to receive image data from an endoscope, the endoscope having an image sensor configured to generate image data indicative of a view from the endoscope, the video processing device comprising:

[0491] -case,

[0492] - Network interface,

[0493] a processing unit adapted to receive the image data from the endoscope when the image data is generated and to cause a primary display to display a graphical user interface, the graphical user interface extending a first length along a first direction and a second length along a second direction perpendicular to the first direction, the graphical user interface comprising a plurality of non-overlapping portions, the plurality of non-overlapping portions comprising a first portion and a second portion, wherein the first portion is disposed proximate to the second portion along the second direction,

[0494] And wherein, the video processing device:

[0495] - displaying within the first portion of the graphical user interface a plurality of representations corresponding to a plurality of stored data files stored during the surgical session, and

[0496] -Show Export button,

[0497] wherein the video processing device is adapted to detect an export user input corresponding to a selection of the export button, and in response to detecting the export user input, the video processing device displays an export menu including an export confirmation button, wherein the video processing device is adapted to receive an export confirmation user input corresponding to the selection of the export confirmation button, the export menu further including a plurality of selectable export modalities, the plurality of selectable export modalities including exporting to a first PACS server and exporting to a first network drive, and wherein the video processing device is adapted to receive a modality selection user input corresponding to a selection of a selected export modality from the plurality of selectable export modalities,

[0498] Wherein, in response to detecting the export confirmation user input and corresponding to exporting to the first network drive according to the selected export modality, the video processing device transfers the stored image data corresponding to one or more of the multiple stored data files to the first network drive.

[0499] 71. The video processing device according to any of items 69 to 70, wherein each of the plurality of representations corresponding to the plurality of stored data files comprises a selection indicator, and wherein the video processing device is adapted to detect a first selection user input corresponding to a first selection indicator selecting a first representation of the plurality of representations, and wherein, in response to detecting the first selection user input, the video processing device:

[0500] - displaying a first selection indicator indicating activation in response to the first selection indicator not indicating current activation,

[0501] - Based on the first selection indicator indicating current activation, displaying a first selection indicator that does not indicate activation.

[0502] 72. The video processing device according to item 71, wherein the stored image data transmitted to the first network drive corresponds to one or more stored data files of the plurality of stored data files each having a selection indicator indicating current activation.

[0503] 73. A video processing device according to any one of items 69 to 72, wherein the video processing device transfers the stored image data corresponding to one or more of the multiple stored data files to a location on the first network drive, which location is based on the network drive information of the first network drive stored at the video processing device.

[0504] 74. A video processing device according to item 73, wherein the location is based on details of the surgical session, for example, the folders of the location are named based on the date of the surgery and / or patient identifier.

[0505] 75. The video processing device according to any of items 67 to 74, wherein the first network driver is an SMB network driver.

[0506] 76. A video processing device according to any one of items 67 to 75, wherein the stored image data transmitted to the first network drive comprises one or more of a plurality of stored image files in a common picture file format, such as PNG, JPEG or TIFF.

[0507] 77. A video processing device operable to receive image data from an endoscope, the endoscope having an image sensor configured to generate image data indicative of a view from the endoscope, the video processing device comprising:

[0508] -case,

[0509] -USB interface,

[0510] a processing unit adapted to receive the image data from the endoscope when the image data is generated and to cause a primary display to display a graphical user interface, the graphical user interface extending a first length along a first direction and a second length along a second direction perpendicular to the first direction, the graphical user interface comprising a plurality of non-overlapping portions, the plurality of non-overlapping portions comprising a first portion and a second portion, wherein the first portion is disposed proximate to the second portion along the second direction,

[0511] And wherein, the video processing device:

[0512] - displaying within the first portion of the graphical user interface a plurality of representations corresponding to a plurality of stored data files stored during the surgical session, and

[0513] -Show Export button,

[0514] wherein the video processing device is adapted to detect an export user input corresponding to a selection of the export button, and in response to detecting the export user input, the video processing device displays an export menu including an export confirmation button, wherein the video processing device is adapted to receive an export confirmation user input corresponding to the selection of the export confirmation button, the export menu further including a plurality of selectable export modalities, the plurality of selectable export modalities including exporting to a first PACS server and exporting to a first USB drive, and wherein the video processing device is adapted to receive a modality selection user input corresponding to a selection of a selected export modality from the plurality of selectable export modalities,

[0515] Wherein, in response to detecting the export confirmation user input and corresponding to exporting to the first USB drive according to the selected export modality, the video processing device transfers the stored image data corresponding to one or more stored data files of the plurality of stored data files to the first USB drive.

[0516] 78. The video processing device of clause 77, wherein each of the plurality of representations corresponding to the plurality of stored data files comprises a selection indicator, and wherein the video processing device is adapted to detect a first selection user input corresponding to a first selection indicator selecting a first representation of the plurality of representations, and wherein, in response to detecting the first selection user input, the video processing device:

[0517] - displaying a first selection indicator indicating activation in response to the first selection indicator not indicating current activation,

[0518] - Based on the first selection indicator indicating current activation, displaying a first selection indicator that does not indicate activation.

[0519] 79. The video processing device according to item 78, wherein the stored image data transferred to the first USB drive corresponds to one or more stored data files among the plurality of stored data files each having a selection indicator indicating current activation.

[0520] 80. A video processing device according to any one of items 77 to 79, wherein the video processing device transfers the stored image data corresponding to one or more of the plurality of stored data files to a location on the first USB drive, the location being based on details of the surgical session, for example, the folders at the location being named based on the date of the surgery and / or patient identifier.

[0521] 81. A video processing device according to any one of items 77 to 80, wherein the stored image data transferred to the first USB drive comprises one or more of a plurality of stored image files in a common picture file format, such as PNG, JPEG or TIFF.

[0522] 82. A medical visualization system comprising an endoscope and a video processing device according to any of the preceding clauses.

Claims

1. A video processing device operable to receive image data from an endoscope, the endoscope having an image sensor configured to generate image data indicative of a view from the endoscope, the video processing device comprising: -case, a processing unit adapted to receive the image data from the endoscope when the image data is generated and to cause a display to display a graphical user interface, the graphical user interface extending a first length along a first direction and a second length along a second direction perpendicular to the first direction, the graphical user interface comprising a plurality of non-overlapping portions, the plurality of non-overlapping portions comprising a first portion and a second portion, wherein the first portion is disposed proximate to the second portion along the second direction, and wherein the video processing device displays a live representation of the image data within the first portion of the graphical user interface, wherein the live representation is displayed at full size covering the first length along the first direction, The video processing device is adapted to detect a first user input signal indicating a request for activating a freeze function, and in response to detecting the first user input signal, the video processing device activates the freeze function, comprising: - ceasing to display the live representation of the image data within the first portion of the graphical user interface, - displaying within the first portion of the graphical user interface a first representation of a still image corresponding to the image data received upon detecting the first user input signal, wherein the first representation of the still image is displayed at the full size, and - displaying a live representation of the image data within a second portion of the graphical user interface, wherein the live representation is displayed at a reduced size that is smaller than the full size, Wherein, when the freeze function is in an active state, the video processing device is adapted to detect a third user input signal indicating a request to store the still image, and in response to detecting the third user input signal, the video processing device stores in an electronic memory of the video processing device an image data file corresponding to the image data received when the first user input signal was detected.

2. A video processing device according to any one of the preceding claims, wherein When the freeze function is in an activated state, the video processing device is adapted to detect a second user input signal indicating a request for deactivating the freeze function, and in response to detecting the second user input signal, the video processing device deactivates the freeze function, comprising: - ceasing to display the first representation of the still image within the first portion of the graphical user interface, - displaying a live representation of the image data within the first portion of the graphical user interface, wherein the live representation is displayed at the full size, and - ceasing to display the live representation of the image data within the second portion of the graphical user interface.

3. The video processing device according to claim 2, wherein: The video processing device is adapted to detect user input to the live representation of the image data being displayed within the second portion of the graphical user interface, and wherein the second user input signal is issued by detecting the user input to the live representation of the image data.

4. The video processing device according to any one of claims 2 to 3, wherein: The video processing device is adapted to detect disconnection of the endoscope, and wherein the second user input signal is issued in response to detecting disconnection of the endoscope from the video processing device.

5. The video processing device according to any one of claims 2 to 4, wherein: The video processing device is adapted to detect connection of the endoscope, and wherein the second user input signal is issued in response to detecting connection of a second endoscope to the video processing device.

6. Video processing device according to any one of the preceding claims, wherein Displaying the first representation of the still image within the first portion of the graphical user interface includes displaying a freeze indicator element that covers a portion of the first representation of the still image.

7. A video processing device according to any one of the preceding claims, wherein The video processing device displays a freeze button, for example, within the third portion of the graphical user interface, wherein the video processing device is adapted to detect a user input corresponding to a selection of the freeze button, and wherein the first user input signal is issued by detecting the user input corresponding to the selection of the freeze button.

8. A video processing device according to any one of the preceding claims, wherein: The video processing device is adapted to detect a first endoscope signal from the endoscope, the first endoscope signal indicating that a user has activated a first button on the endoscope, and wherein the first user input signal is issued by detecting the first endoscope signal.

9. A video processing device according to any one of the preceding claims, wherein The image data file includes information indicating that the image data file was captured while the freeze function was activated.

10. The video processing device according to any one of the preceding claims, wherein The video processing device, for example, displays one or more operable items within a third portion of the graphical user interface, wherein the one or more operable items include an image capture button, wherein the video processing device is adapted to detect a capture user input corresponding to selection of the image capture button, and wherein the third user input signal is issued by a user input corresponding to selection of the image capture button.

11. A video processing device according to any one of the preceding claims, wherein The video processing device is adapted to detect a second endoscopic signal from the endoscope, the second endoscopic signal indicating that a user has activated a second button on the endoscope, wherein the third user input signal is issued by detecting the second endoscopic signal.

12. A video processing device according to any one of the preceding claims, wherein The video processing device further deactivates the freeze function in response to detecting the third user input signal, comprising: - ceasing to display the first representation of the still image within the first portion of the graphical user interface, - displaying a live representation of the image data within the first portion of the graphical user interface, wherein the live representation is displayed at the full size, and - ceasing to display the live representation of the image data within the second portion of the graphical user interface.

13. A video processing device according to any one of the preceding claims, wherein: The video processing device further displays the first representation of the still image within the second portion of the graphical user interface in response to detecting the third user input signal. The video processing device according to claim 13 , wherein: After a predetermined delay after detecting the third user input signal, the video processing device ceases displaying the first representation of the still image within the second portion of the graphical user interface.

15. Video processing device according to any one of the preceding claims, wherein The video processing device includes one or more image modification functions, each of the one or more image modification functions modifying one or more parameters of the live representation of the image data when activated, and wherein the one or more image modification functions are activatable when the freeze function is not activated, and wherein the one or more image modification functions are not activatable when the freeze function is activated. The video processing device according to claim 15 , wherein: When the freeze function is active, the video processing device displays a notification in response to detecting a fourth user input signal indicating a request to activate an image modification function among the one or more image modification functions, the notification indicating that the image modification function is disabled while the freeze function is active.

17. A video processing device according to any one of the preceding claims, wherein The video processing device comprises an endoscope light switch function which, when activated, causes deactivation of a light emitter of the endoscope, and wherein the endoscope light switch function is activatable when the freeze function is not activated, and wherein the endoscope light switch function is not activatable when the freeze function is activated. The video processing device according to claim 17 , wherein: The video processing device activates the freeze function in response to detecting the first user input signal based on the light emitter of the endoscope being in an activated state, and wherein the video processing device forgoes activating the freeze function in response to detecting the first user input signal based on the light emitter of the endoscope being in an inactive state.

19. A medical visualization system comprising an endoscope and a video processing device according to any one of the preceding claims.

20. A method for operating a video processing device to receive image data from an endoscope, the method being performed concurrently with an unclaimed surgical procedure, the endoscope having an image sensor configured to generate image data indicative of a view from the endoscope, the method comprising the steps of: - receiving the image data from the endoscope when the image data is generated and causing a display to display a graphical user interface, the graphical user interface extending a first length along a first direction and a second length along a second direction perpendicular to the first direction, the graphical user interface comprising a plurality of non-overlapping portions, the plurality of non-overlapping portions comprising a first portion and a second portion, wherein the first portion is disposed proximate to the second portion along the second direction; - displaying a live representation of the image data within the first portion of the graphical user interface at full size covering the first length along the first direction; - detecting a first user input signal indicative of a request for activating the freeze function; - ceasing to display the live representation of the image data within the first portion of the graphical user interface; - displaying a first representation of a still image at full size within the first portion of the graphical user interface, the first representation of the still image corresponding to image data received when the first user input signal is detected; and - displaying a live representation of the image data within a second portion of the graphical user interface, wherein the live representation is displayed at a reduced size that is smaller than the full size.

21. The method according to claim 20, wherein The method further comprises the following steps: - detecting a third user input signal indicative of a request to store the still image; and - storing an image data file corresponding to the image data received when the first user input signal is detected.

Images