User interface navigation, control, and display

Abstract

This application relates to user interface navigation, control and display, generally to generating various composites of input video information for streaming to one or more displays. For example, a first display can be configured to show a first video stream and a second video stream. The first video stream can be a live view of video from an endoscope, and the second video stream can be from a (remote) camera control unit. These streams are presented in a PIP (picture-in-picture) mode or a PAP (picture-aside-picture) mode. Either or other information in the video streams can be selected for display, and any combination of them can be optionally configured for streaming to any selected display. Additional aspects relate to video rendering systems in which the primary image is a 3D image stream, and the secondary image (such as in PiP) is the same image stream, but in 2D. Even more aspects relate to video rendering systems in which the primary image is a 2D image stream, and the secondary image is the same image stream, but in 3D.

Description

[0001] Cross-reference to related applications Pursuant to 35 USC §119(e), this application claims the benefit and priority of U.S. Provisional Application Serial No. 63 / 765,228 entitled “UserInterface for Navigation, Control, and Display”, filed February 28, 2025, the entire disclosure of which is incorporated herein by reference in its entirety for all purposes taught and for all purposes.

[0002] This application is also related to the following applications: U.S. Provisional Application Serial No. 63 / 764,625, entitled “Signal Adapter Device,” filed on February 28, 2025, U.S. Provisional Application Serial No. 63 / 764,606, entitled "Shielding Enclosure for Electronic Device", was filed on February 28, 2025. U.S. Provisional Application Serial No. 63 / 765,612, filed on February 28, 2025, entitled "Status Indicating Switch for Electrical Equipment, Especially Medical Equipment" U.S. Provisional Application Serial No. 63 / 764,610, entitled "Electronic Device with Improved CircuitBoard Holding System", filed on February 28, 2025, U.S. Provisional Application Serial No. 63 / 764,615, entitled "Data Transfer System and Method for Image Processing," filed on February 28, 2025, U.S. Provisional Application Serial No. 63 / 764,614, entitled “Circuit Board Retaining Device,” filed on February 28, 2025, All of these applications are incorporated herein by reference in their entirety. Technical Field

[0003] The exemplary aspect relates to video processing. More specifically, the exemplary aspect relates to medical imaging. Even more specifically, the exemplary aspect relates to user interfaces that facilitate image display and customization. Summary of the Invention

[0004] One aspect involves video processing.

[0005] On the other hand, it involves medical image and video processing.

[0006] More specifically, one aspect involves methods for displaying medical images (such as endoscopic or other medical camera images) in combination with other information.

[0007] One exemplary aspect relates to a method for displaying medical imaging information, as well as other information, such as that from endoscopes, exoscopes, or other medical camera imaging technologies, in a customizable composition. Multiple customizable compositions may exist, each capable of outputting / streaming to a different display. Each customizable composition may optionally include multiple user-selectable quick menu functions that allow for further configuration of the streaming information.

[0008] One exemplary aspect relates to a method of displaying medical imaging information (such as video streams from endoscopes, exoscopes, or other medical camera imaging technologies) and other information (such as additional video streams, training information, still image information, CCU streams, CT scan information, X-ray information, MRI scan information, recorded video information, 3D video information, 2D video information, and any information generally useful for playback of medical procedures and / or as part of an ongoing procedure) in customizable composites. Multiple customizable composites may exist, each capable of outputting / streaming to a different display. Each customizable composite may optionally include multiple user-selectable quick menu functions (and optionally submenu functions) for further configuration of information allowing streaming. Optionally, each output customizable composite may uniquely include both 2D and 3D streaming video information.

[0009] Another aspect involves simultaneously displaying multiple video or other inputs and / or acquiring external inputs and combining the external input(s) with the currently active streaming camera input.

[0010] Other aspects involve mixing certain inputs with certain synthetics to produce different outputs for different monitor / display devices.

[0011] A further aspect involves acquiring two different composites, each of which can be transferred to either of two (or more) video outputs.

[0012] Additional aspects involve acquiring an external video source (such as from different CCUs (Camera Control Units), a reference still, a reference video, previous videos, training videos, archived videos, the Internet, etc.) and adding internal video sources (such as from endoscopes, exoscopes, etc.), and rendering the combination of images / videos as picture-in-picture / side-by-side, etc.

[0013] Other features allow multiple attached display devices to display different combinations of their own various inputs.

[0014] An additional aspect involves using a second video input with user / system-specified preferences to generate an output that shows both the first and second video streams. This second video stream can originate from a camera control unit, and these streams are presented in either PiP (Picture-in-Picture) or PaP (Panel-in-Panel) mode.

[0015] This extends even further to video rendering systems, where the dominant image is a 3D image stream, and subordinate images are the same (or different) image streams, but in 2D. For example, subordinate images can be rendered as PiP or PaP. The sizes of the dominant and subordinate images are user-adjustable, and their positions on the display are user-configurable.

[0016] This extends even further to video rendering systems where the dominant image is a 2D image stream, and subordinate images are the same (or different) image streams, but in 3D. For example, subordinate images might be rendered as PiP or PaP. The sizes of the dominant and subordinate images are user-adjustable, and their positions on the display are user-configurable.

[0017] Additional aspects involve a user interface that is configured to control any of the above, as well as control video routing, video preferences, configuration preferences, and / or video management.

[0018] Other aspects involve providing video effects customization via the user interface.

[0019] The phrases “at least one,” “one or more,” and “and / or” are open-ended expressions that are both conjunction and disjunctive in operation. For example, each of the expressions “at least one of A, B, and C,” “at least one of A, B, or C,” “one or more of A, B, and C,” “one or more of A, B, or C,” and “A, B, and / or C” means A alone, B alone, C alone, A and B together, A and C together, B and C together, or A, B, and C together.

[0020] The term "a" or "an" entity refers to one or more of the entities. Therefore, the terms "a" (or "an"), "one or more," and "at least one" are used interchangeably herein. It should also be noted that the terms "comprising," "including," and "having" are used interchangeably.

[0021] As used herein, the term "automatic" and its variations refer to any process or operation performed without material human input. However, a process or operation can be automatic even if material or non-material human input is used in its execution, provided that input is received prior to its execution. A human input is considered material if it influences how the process or operation will be performed. Human input that consents to the execution of a process or operation is not considered "material."

[0022] As used herein, the term "computer-readable medium" refers to any tangible storage and / or transmission medium that participates in providing instructions to a processor for execution. Such media can take many forms, including but not limited to non-volatile media, volatile media, and transmission media. Non-volatile media include, for example, NVRAM or disks or optical discs. Volatile media include dynamic memory, such as main memory. Common forms of computer-readable media include, for example, floppy disks, flexible disks, hard disks, magnetic tape or any other magnetic media, magneto-optical media, CD-ROMs, any other optical media, punched cards, paper tape, any other physical media with a perforated pattern, RAM, PROMs and EPROMs, flash memory-EPROMs, solid-state media (such as memory cards), any other memory chips or cassette tapes, carrier waves as described below, or any other media from which a computer can read. Digital file attachments such as emails or other self-contained archives or sets of archives are considered equivalent to distribution media of tangible storage. When computer-readable media is configured as a database, it should be understood that the database can be any type of database, such as relational databases, hierarchical databases, object-oriented databases, etc. Therefore, this disclosure is considered to include tangible storage media or distribution media, as well as equivalents and successor media recognized by the prior art, wherein software implementations of this disclosure are stored.

[0023] As used herein, the terms “determine,” “account,” and “calculate,” and their variations, are used interchangeably and include any type of method, process, mathematical operation, or technique.

[0024] It should be understood that, as used herein, the term "means" should be interpreted as broadly as possible in accordance with 35 USC §112(f). Therefore, claims containing the term "means" should cover all structures, materials, or actions set forth herein and all their equivalents. Furthermore, structures, materials, or actions and their equivalents should include all those described in any part of this document. Therefore, the means-type language can be used to claim protection for any or more of the embodiments described herein.

[0025] The foregoing is a simplified overview of this disclosure to provide an understanding of some aspects thereof. This content is neither a broad nor an exhaustive summary of this disclosure and its various aspects, embodiments, and / or configurations. It is not intended to identify key or essential elements of this disclosure, nor to outline its scope, but rather to present selected concepts in a simplified form as an introduction to the more detailed description that follows. As will be understood, other aspects, embodiments, and / or configurations of this disclosure may utilize one or more of the features set forth above or described in detail below, either alone or in combination.

[0026] These and other features and advantages of this technology are described in or may be apparent from the following detailed description of exemplary embodiments. Attached Figure Description

[0027] Exemplary embodiments will be described in detail with reference to the following figures, wherein: Figure 1 A block diagram of an exemplary video processing system according to one aspect is shown.

[0028] Figure 2 An example preference GUI based on one aspect is shown.

[0029] Figure 3 Another example preference GUI based on one aspect is shown.

[0030] Figure 4 An example preference GUI based on one aspect is shown.

[0031] Figure 5 An example of a display composition configuration based on one aspect is illustrated.

[0032] Figure 6 An exemplary display layout of a display composite is illustrated according to one aspect.

[0033] Figure 7 An example user interface / display layout based on one aspect is shown.

[0034] Figure 8 An exemplary documentation interface based on one aspect is shown.

[0035] Figure 9 Another exemplary document interface based on one aspect is shown.

[0036] Figure 10 An example preference menu based on one aspect is shown.

[0037] Figure 11 An example is given of a method for operating an imaging system according to one aspect.

[0038] Figure 12 An exemplary method for mixing and streaming content is illustrated according to one aspect.

[0039] Figure 13 An exemplary method for mixing and streaming content based on one aspect of storage-based preferences is illustrated. Detailed Implementation

[0040] Exemplary embodiments of the technology will be described in conjunction with video processing, video mixing, medical imaging, and corresponding user interfaces(s).

[0041] For illustrative purposes, numerous details have been set forth to provide a thorough understanding of the present technical solution. However, it should be understood that the currently disclosed technology can be practiced in various ways beyond the specific details set forth herein. Furthermore, while the exemplary embodiments illustrated herein show various components of the system co-located, it should be understood that the various components of the system may be located at remote locations within a distributed or local network or circuit.

[0042] Figure 1 A high-level block diagram of exemplary system components is illustrated. Exemplary system 100 includes a GPU / mixer 110, a CPU 120, a memory / storage device 130, an I / O controller 140, one or more hard disk drives / solid-state drives 150, a display output 160, one or more cameras / endoscopes 170, one or more external sources 180, and one or more displays 190.

[0043] Each of the displays 190 is configured to display a user interface having various elements discussed herein, including but not limited to video information, image information, medical information, configuration information, and 2D / 3D imaging.

[0044] In operation, the system receives source information from one or more sources (such as internal source 170 (e.g., camera / (one or more) endoscopes / (one or more) exoscopes) and external source 180), such as external video feeds, image information, training videos, previously stored videos / images, Internet content, information from another CCU, or any information from any source.

[0045] As will be discussed herein, various source information can be configured for display on one or more displays 190. Each display 190 may have the same information displayed, or a customizable mixture (composite) may be selected, such that one or more displays have a unique combination of displayed information. Of particular interest is the ability to mix 2D and 3D content on the same display and to select how 2D and 3D information (or other information) is displayed on the screen.

[0046] Through the collaboration of CPU 120 and GPU / mixer 110, software stored on memory / storage device 130 is responsible for processing and displaying information from various sources based on user-selected preferences. This information is then output via display output 160 to one or more displays 190, each of which can be a video monitor(s), headset, wall display, remote display, VR or augmented reality display, projector, etc., where the displayed information can also be stored on one or more hard disk drives / solid-state drives 150, and / or remotely stored in a network / server or the cloud. The display output can be any known or later-developed display output, such as VGA, DVI-D, DVI-I, mini DVI, micro DVI, HDMI, mini HDMI, micro HDMI, DisplayPort (DP), Thunderbolt®, USB, wireless video, SDI (Serial Digital Interface), etc.

[0047] In interface 200, the user selects one or more sources for displaying information on display 190. The user (or each user at each display) can select one or more internal sources 210 and one or more external sources 220. In the display composition section 230 of interface 200, the user can select, for example, whether the sources should be displayed individually 270, displayed in PiP or PaP format (272 / 274), displayed side-by-side in a variable adjustable format 276, or displayed one on top of another, etc. In the variable adjustable format 276, a slider may be provided that allows the user to select the slider and increase / decrease the size of one source and correspondingly decrease / increase the size of another source. The user can also use the PiP size selection button 280 to select the size of the PiP image. Although the various buttons and switches shown herein are illustrated on a graphical user interface, it should be understood that any of the user interface elements discussed herein may also be implemented as physical buttons or controllers associated with remotely located devices that communicate with the system (such as buttons attached to a camera head). Optionally, a source exchange button 260 can be provided, which indicates the location of the source within the exchange interface.

[0048] Figure 2An exemplary user interface 200 is shown. As an example, the user interface includes a representation of video from an internal source (such as an endoscope) and menus for selectable feature settings.

[0049] Specifically, in addition to information such as patient information, preference information / settings, time / date information, connection information, and help information, a menu with selectable features is also provided. In this exemplary embodiment, selectable / controllable features include still capture 201, video capture 202, light source switching 203, pressure / suction / blow-in information 204, enhanced video 205, white balance 206, fluorescence 207, and more function buttons 208. Each of these features may represent an installed independent feature package (IFP) that is installed on system 100 and is now controllable within the UI due to its installation.

[0050] Although certain features are shown, it should be understood that any one or more of the features shown herein (such as...) Figures 3 to 4 Those features (those mentioned above) can also be shown in interface 200. After selecting one of these features, an optional submenu is available, which allows for more refined customization / selection of the feature.

[0051] The still capture button 201 allows the user to capture a screen capture of the interface 200 or a portion thereof. The video capture button 202 allows the user to capture video of the interface 200 or a portion thereof. The light source button 203 allows the user to switch between light sources or adjust their settings. The blow-in button 204 provides editable pressure / volume information such as for a pump or vacuum. The image enhancement button 205 allows the user to enhance the image on the interface 200 or select between several possible enhancement packages. The white balance button 206 allows the user to change the white balance. The fluorescence button 207 controls the configuration of the fluorescence display in the image and may include the selection of fluorescence imaging mode, display preferences (such as color coverage, sensitivity, etc.), the ability to target specific fluorophores, etc. The more functions button 208 can take the user to a submenu that allows selection / deselection of various additional quick menu functions that can be displayed on the interface 200. (See also...) Figures 3 to 5 ) Figure 2 The document also shows other selectable functions / buttons of system 100, including video management button 300, live view button 500, view selection button 400, document button 600, and file cabinet button 700. Video management button 300, live view button 500, document button 600, and file cabinet button 700 can be optionally hidden until view selection button 400 is selected.

[0052] The video management button 300 allows users to select video or other information sources and configure how those video / information sources are displayed on one or more interfaces 200. For example... Figure 7 As shown, the left side of the interface provides exemplary selectable internal video information sources (internal sources from an endoscope (or other connected camera systems, such as an exoscope), and external sources from SDI or HDMI sources, etc.), and the right side of the interface shows exemplary display composites for a specific monitor. Figure 7 The upper right image is shown as PiP, where a still image exists within the PiP section. This image (“Composer 1”) can be streamed to a first display. As an example, the lower section (“Composer 2”) simply provides a live image that can be presented to another display. Any number of these composers can be created, and the output of these composers can be directed and streamed to any one or more selected displays.

[0053] The live view button 500 can provide Figure 2 The view shown is illustrated. Selecting the view button 400 can be used, for example, to show or hide various features in the interface 200.

[0054] The document button 600 provides access to, for example, information that has been recorded (such as...). Figure 8 Access to the interface (showing the recorded information) is possible. Access to the "Document" feature may be part of an optional package / module that can be installed on the system.

[0055] The recorded information can be stored on and accessed via an HDD / SSD 150, or it can be stored remotely (such as in the cloud). Figure 8 In this interface 800, there are endoscopic views 810 and room views 820. Since any source can be selected as discussed, the information displayed in these interfaces can be customized to any combination of input source information. Figure 8 The timeline includes each of the endoscope camera 830 and the room camera 840. Using a slider, the user can scroll to any point in the recorded video. Supplementary information associated with the recorded video may be included along with the recorded video, such as captured still images 840 or other recorded video clips 870, documents, notes, verbal memos, metadata, or any information that a medical practitioner might typically associate with the recording.

[0056] Figure 3 Exemplary selected and available quick menu functions are shown. For example, a user can drag and drop any available quick menu function into the selected quick menu function area, and similarly deselect a quick menu function by dragging it from the "Selected" section of the interface (e.g., using a mouse or other input device) to the "Available" section. Similarly, in Figure 4The example illustrates how a user selects an empty quick menu function box to add an available quick function. For instance, a user can click on an available space in the quick menu function area to select an available space, and then click on one of the available quick menu functions to place that available quick function in the selected available space.

[0057] Here, the "Quick Menu" function is located on the left side of the interface. Figure 2 The menu shows those functions, where "More Functions" is accessed by selecting the "More Functions" button 208, and "Available Quick Functions" can be added to either category. Figure 5 An exemplary menu configuration is shown, in which some of the available quick menu features have been added to the quick menu, where these quick menu features are configured to work with... Figure 2 The method shown is similar to that shown in the diagram. Figure 5 It also shows a software management button, which allows users to view and manage installed and available software packages (e.g., in the cloud).

[0058] Some functions available for use from the quick menu include, but are not limited to, video capture, still capture, light source selection, orientation, enhancement (video), fluorescence, blowing, camera swapping, brightness, 3D imaging, preset selection, layout switching, smoke extraction, white balance, printing, training mode, zoom, etc. Other quick menu functions are available, for example, those suitable for the type of attached instrument / equipment.

[0059] One or more of the quick menu functions can have associated submenus that allow further exploration into the selected function. For example, selecting a light source might bring up a submenu that allows the user to choose from multiple lighting sources or modes. Similarly, if the user selects zoom, the submenu can optionally provide a fixed zoom level and / or allow the user to select a custom zoom level.

[0060] In selection Figure 2 After selecting the view button 400, four exemplary options can be provided to the user: video management button 300, live view button 500, document button 600, and file cabinet button 700. The live view button can display an interface (such as...) Figure 2 The interface (such as...) can be provided after selecting the video management button 300. Figure 6 The interface shown allows users to configure various video feeds, including how and where they will be displayed. A documentation button leads the user to... Figures 8 to 9The exemplary interface shown is for accessing recorded information, such as surgical procedure records. Surgical procedures can be recorded continuously, and the surgical procedure records can optionally be accessed afterward. Additionally, even while a surgical procedure is in progress, the user can jump to any point in the recorded timeline (or to any frame in the timeline). This can be particularly helpful in assisting medical personnel, for example, by recalling and reviewing events that may have occurred earlier in the procedure.

[0061] The filing cabinet button 700 can take the user to an interface that presents stored information associated with the patient or historical procedures. Similar to access to the “document” feature, the filing cabinet button and functionality can be part of an optional feature package / module that can be installed on the system 100, where the information is stored locally and / or remotely.

[0062] In selection Figure 2 After the video management button 400 is activated, it can be displayed to the user. Figures 6 to 7 The interface shown is for video management. Users can select from one or more internal and external sources and display them on the composite side of the display. As discussed, these composites can be configured as PiP, PaP, 2D, 3D, or some combination thereof. The display composite can also be saved as a preference and recalled later, allowing for a layout that presents information in the same manner. A particularly unique aspect is the optional ability to display 2D and 3D information together or side-by-side with PiPs or PaPs.

[0063] Figure 10 An example of a saved preference menu, "Select Preset," is shown. Here, you can select a preset by clicking the button that allows you to choose a preset (in...). Figure 2 The button shown is labeled "General Surgical Procedure 2" (with a General Surgical Procedure 2 preset selected). It allows selection of a saved set of preferences for a specific surgical suite and / or a specific surgeon. This exemplary set of preferences is configured to store one or more of the following: quick menu main menu functions, quick menu "More Functions" menu, the order of various quick menu functions, various presets for the selected function (e.g., enhancement, orientation, zoom, etc.), how to configure buttons on medical devices (such as endoscopes or camera heads) (e.g., long press for zoom, short press for recording, etc.), and video routing information. Inputs for Composite 1(one) and Composite 2(one) are pre-configured. Specifically, Exemplary Composite 1 is a PiP with video information from the endoscope and SDI. Composite 2 displays information from the endoscope.

[0064] As will be understood, any feature / setting / configuration can be stored and recalled later using the Save / Select Preset menu. These presets are also editable, deleteable, and applicable by selecting the appropriate button in the user interface. Any number of presets can be saved, and these presets can be stored on network-accessible devices or in the cloud, and can be accessed from multiple different systems via a network or wireless interface. In this way, preferences can "follow" surgeons or other medical personnel throughout the hospital(s) or medical facility(s) and can be quickly recalled to reduce device setup time.

[0065] Figure 11 The diagram also illustrates optional parameter coverage areas that may be included. This coverage may display certain properties of the endoscope, such as enhancement mode, image orientation, 3D imaging mode, fluorescence mode, light source information, airflow rate, airflow pressure, light source intensity, etc. Any or all of this information may be stored in the surgical procedure documentation.

[0066] Figure 12 An exemplary method for configuring and displaying information is outlined. Control begins at step S100 and continues to step S104. In step S104, one or more internal video sources are selected. These internal video sources may, for example, come from an endoscope, endoscope, etc. Next, in step S108, one or more external sources are selected. These external sources may be, for example, external video streams, training videos, one or more images, previous recordings of procedures, internet content, previous scans such as CT or MRI scans, ultrasound imaging, or generally any stored or streamed content. Control then continues to S112.

[0067] In step S112, the display properties and layout of the first synthesized product are configured. This may include arranging the source as PiP, PaP; selecting PiP size settings; selecting positioning and size settings; selecting where to output / stream the synthesized product; selecting one or more display properties, etc.

[0068] As shown in S116 and S120, this same configuration can be performed for any number of synthesizers until all synthesizers are configured. Once all synthesizers are configured, in step S124, the mixer / GPU mixes and prepares one or more synthesizers for output. Then, in step S128, the synthesizers are streamed to one or more displays. Control then continues to step S132, where the control sequence ends.

[0069] Figure 13An exemplary method for displaying content is outlined. Control begins at step S200 and continues to step S204. In step S204, one or more saved composition preferences are retrieved. These preferences may be stored on a network-accessible device, in the cloud, on the device, or typically in any accessible location. Composition preferences specify how various content sources, such as internal video sources, external video sources, and other external information sources, are displayed. As discussed, these compositions may include PiP, PaP, full-frame, variable or fixed side-by-side views, etc. In step S208, the mixer reads these saved preferences and applies them to one or more information sources, preparing them for streaming to one or more displays. Control then continues to step S212.

[0070] In step S212, the system may optionally retrieve one or more saved quick menu settings. Like saved composition settings, these preferences can be stored on a network-accessible device, in the cloud, on the device itself, or typically in any accessible location. Next, in step S216, the saved quick menu settings are applied to the output stream. The composed stream is then output to one or more displays. Control then continues to step S224, where the control sequence ends.

[0071] The systems, methods, and protocols disclosed herein can be implemented on a dedicated computer, a programmable microprocessor or microcontroller and one or more peripheral integrated circuit elements, an ASIC or other integrated circuit, a digital signal processor, a flash memory device, hardwired electronic or logic circuits (such as discrete component circuits), a programmable logic device (such as a PLD, PLA, FPGA, PAL), an image processing device, an endoscope, a medical imaging device, etc. Generally, any device (or one or more equivalent means) capable of implementing a state machine can be used to implement the various methods, protocols, and techniques disclosed herein, which in turn can implement the methods exemplified herein.

[0072] Furthermore, the disclosed methods can be readily implemented in software stored on a non-transitory computer-readable storage medium using, for example, an object-oriented software development environment that provides portable source code usable on various computer or workstation platforms. Alternatively, the disclosed systems can be implemented partially or entirely in hardware using standard logic circuits or VLSI designs. Whether a system based on this disclosure is implemented in software or hardware depends on the system's speed and / or efficiency requirements, specific functions, and the particular software or hardware system or microprocessor or microcomputer system utilized. The systems, methods, and protocols illustrated herein can be readily implemented in hardware and / or software by those skilled in the art based on the functional descriptions provided herein and by general knowledge of the fields of computers, medicine, optics, and / or endoscopy, using any known or subsequently developed systems or structures, devices, and / or software.

[0073] Furthermore, the disclosed methods can be readily implemented in software that can be stored on a computer-readable storage medium and executed on a cooperating general-purpose computer, special-purpose computer, microprocessor, etc., with a controller and memory. The systems and methods of this technology can be implemented as programs embedded in personal computers (such as applets, JAVA®, or CGI scripts), as resources residing on servers or computer workstations, as routines embedded in dedicated systems or system components, etc. Systems can also be implemented by physically incorporating the system and / or methods into software and / or hardware systems (such as hardware and software systems for imaging / medical / electronic devices).

[0074] Although this description has been described with reference to exemplary embodiments, it should be understood that individual aspects of the present technology may be claimed individually, and one or more features of various embodiments may be combined.

[0075] While the exemplary embodiments illustrated herein discuss various co-located components, it should be understood that various components of the system may be located in remote portions of a distributed network (such as a telecommunications network and / or the Internet) or within a dedicated communications network. Therefore, it should be understood that components of the system may be combined into one or more devices or co-located on specific nodes of a distributed network (such as a communications network). As will be understood from the following description, and for computational efficiency reasons, components of the system may be arranged anywhere within the distributed network without affecting the operation of the system.

[0076] Although this disclosure describes components and functions implemented in various aspects, embodiments, and / or configurations with reference to specific standards and protocols, these aspects, embodiments, and / or configurations are not limited to such standards and protocols. Other similar standards and protocols not mentioned herein exist and are considered to be included in this disclosure. Furthermore, the standards and protocols mentioned herein, as well as other similar standards and protocols not mentioned herein, are periodically replaced by faster or more efficient equivalents with substantially the same functionality. Such alternative standards and protocols with the same functionality are considered to be equivalents included in this disclosure.

[0077] In various aspects, embodiments, and / or configurations, this disclosure includes components, methods, processes, systems, and / or apparatuses substantially as depicted and described herein, including aspects, embodiments, configurations, examples, sub-combinations, and / or subsets thereof. Upon understanding this disclosure, those skilled in the art will understand how the disclosed aspects, embodiments, and / or configurations can be made and used. In various aspects, embodiments, and / or configurations, this disclosure includes providing apparatus and processes, for example, to improve performance, ease of implementation, and / or reduce implementation costs, in the absence of items not depicted and / or described herein, or in its aspects, embodiments, and / or configurations (including in the absence of such items that may have already been used in prior equipment or processes).

[0078] The foregoing discussion has been presented for purposes of illustration and description. The foregoing is not intended to limit this disclosure to the one or more forms disclosed herein. For example, in the foregoing detailed description, various features of this disclosure are grouped together in one or more aspects, embodiments, and / or configurations for the purpose of simplifying the disclosure. Features of aspects, embodiments, and / or configurations of this disclosure may be combined in alternative aspects, embodiments, and / or configurations other than those discussed above. This approach of the disclosure should not be construed as reflecting an intention to claim more features than expressly stated in each claim. Rather, as reflected in the appended claims, the inventive aspect lies in all features less than those of a single foregoing aspect, embodiment, and / or configuration. Therefore, the following claims are hereby incorporated into this detailed description, wherein each claim is independently a separate preferred embodiment of this disclosure.

[0079] Furthermore, although the description has included descriptions of one or more aspects, embodiments, and / or configurations, as well as certain variations and modifications, other variations, combinations, and modifications may be made within the scope of this disclosure upon understanding of it, for example, as may be possible within the skill and knowledge of those skilled in the art. It is intended to obtain the right to include alternative aspects, embodiments, and / or configurations to the permissible extent, including alternatives, interchangeable, and / or equivalent structures, functions, scopes, or steps to those claimed, whether such alternatives, interchangeable, and / or equivalent structures, functions, scopes, or steps are disclosed herein, and not to disclose any proprietary patentable subject matter.

[0080] Exemplary aspects include: A video system, the video system comprising: One or more video inputs; mixer; Multiple display outputs; User interface; and At least one display, wherein the mixer is configured to output several different selected video inputs from one or more video inputs selected in the user interface as corresponding video streams via some of the multiple video outputs to the at least one display.

[0081] Any one or more of the foregoing aspects, wherein some of the video inputs are 2D and the other video inputs are 3D.

[0082] Any one or more of the foregoing aspects, wherein one of the one or more video inputs is an internal source and the other of the one or more video inputs is an external source.

[0083] Any or more of the foregoing aspects, wherein the user interface includes one or more buttons that allow one or more of the following: video enhancement, picture-in-picture settings, side-by-side picture settings, and source swapping buttons.

[0084] In any one or more of the above aspects, the output of the mixer is recorded in real time.

[0085] Any one or more of the foregoing aspects, wherein the user interface provides buttons for selecting a review of a previous portion of the currently performed and recorded medical procedure.

[0086] Any or more of the foregoing aspects, wherein the user interface provides menus and submenus, the menus providing selectable options for a plurality of functions, and the submenus providing additional selectable options for a selected function among the plurality of functions.

[0087] Any one or more of the foregoing aspects, wherein the user interface is configured to allow a user to select some of the one or more video inputs for a specific composite.

[0088] One or more of the above aspects, wherein some of the selected video inputs include 2D and 3D video streams.

[0089] Any or more of the foregoing aspects also include a selectable preset button, which is configured to invoke one or more mixers and preferences.

[0090] A method, the method comprising: Receive multiple input video streams; Select one or more of the video streams for output to the first display; One or more of the video streams are selected for output to a second display, wherein at least one video stream for the second display is different from a selected video stream for the first display; and The selected video streams are streamed and output to the first display and the second display respectively, wherein one of the one or more video streams comes from an internal source and another of the one or more video streams comes from an external source, and at least one of the one or more video streams is modified based on a number of selected menu functions.

[0091] Any or more of the above aspects also include continuously recording the output video stream.

[0092] Any or more of the above aspects, wherein the internal source is derived from an endoscope.

[0093] In any one or more of the foregoing aspects, the first video stream of the one or more video streams is 2D, and the other video stream of the one or more video streams is 3D, and the first 2D video stream and the 3D video stream are presented simultaneously.

[0094] Any or more of the foregoing aspects also include providing an interface with buttons for selecting / deselecting one or more of the menu functions.

[0095] Any or more of the above aspects, wherein the selected video stream is one of PiP, PaP, side-by-side, or variable configuration.

[0096] Any one or more of the above aspects, wherein the output selected video stream configuration can be saved as a callable preset.

[0097] Any or more of the above aspects, wherein one of the plurality of input streams originates from another medical procedure.

[0098] Any or more of the foregoing aspects also include providing multiple different compositions, wherein each composition is streamed to a different display.

[0099] Any one or more of the above aspects, wherein the input video stream is medical protocol or related to medical protocol.

[0100] As in any or more of the aspects / embodiments disclosed herein.

[0101] Any or more of the aspects / embodiments substantially disclosed herein may optionally be combined with any one or more other aspects / embodiments substantially disclosed herein.

[0102] One or more means suitable for performing any or more of the above aspects / embodiments as substantially disclosed herein.

[0103] One or more of the features disclosed herein.

[0104] Such as any one or more of the features substantially disclosed herein.

[0105] Any one or more of the features substantially disclosed herein combined with any one or more other features substantially disclosed herein.

[0106] Any aspect / feature / embodiment may be combined with any one or more other aspects / features / embodiments.

[0107] Use of any or more of the aspects or features disclosed herein.

[0108] Therefore, it is apparent that systems and methods for streaming content have been provided according to this disclosure. While this disclosure has been described in conjunction with several embodiments, it will be apparent to those skilled in the art that many alternatives, modifications, and variations will be or will be obvious. Therefore, this disclosure is intended to cover all such alternatives, modifications, equivalents, and variations within the spirit and scope of the disclosed technology.

Claims

1. A video system, the video system comprising: One or more video inputs; mixer; Multiple display outputs; user interface; as well as At least one display, wherein the mixer is configured to output several different selected video inputs from one or more video inputs selected in the user interface as corresponding video streams via some of the plurality of video outputs to the at least one display.

2. The system of claim 1, wherein some of the video inputs are 2D and the other video inputs are 3D.

3. The system of claim 1, wherein one of the one or more video inputs is an internal source and the other of the one or more video inputs is an external source.

4. The system of claim 1, wherein the user interface includes one or more buttons that allow one or more of the following: video enhancement, picture-in-picture settings, side-by-side settings, and source swapping buttons.

5. The system of claim 1, wherein the output of the mixer is recorded in real time.

6. The system of claim 5, wherein the user interface provides buttons for selecting a review of a previous portion of the currently being performed and recorded medical procedure.

7. The system of claim 1, wherein the user interface provides a menu and a submenu, the menu providing selectable options for a plurality of functions, and the submenu providing additional selectable options for a selected function among the plurality of functions.

8. The system of claim 1, wherein the user interface is configured to allow a user to select some of the one or more video inputs for a specific composite.

9. The system of claim 8, wherein some of the selected video inputs include 2D and 3D video streams.

10. The system of claim 1, further comprising a selectable preset button configured to invoke one or more mixers and preference settings.

11. A method, the method comprising: Receive multiple input video streams; Select one or more of the video streams for output to the first display; One or more of the video streams are selected for output to a second display, wherein at least one video stream for the second display is different from a selected video stream for the first display; as well as The selected video streams are streamed and output to the first display and the second display respectively, wherein one of the one or more video streams comes from an internal source and another of the one or more video streams comes from an external source, and at least one of the one or more video streams is modified based on a number of selected menu functions.

12. The method of claim 11, further comprising continuously recording the output video stream.

13. The method of claim 11, wherein the internal source is derived from an endoscope.

14. The method of claim 11, wherein the first video stream of the one or more video streams is 2D, and the other video stream of the one or more video streams is 3D, and the first 2D video stream and the 3D video stream are presented simultaneously.

15. The method of claim 11, further comprising providing an interface having buttons for selecting / deselecting one or more of the menu functions.

16. The method of claim 11, wherein the selected video stream is one of PiP, PaP, side-by-side, or a variable configuration.

17. The method of claim 11, wherein the output selected video stream configuration can be saved as a recall preset.

18. The method of claim 11, wherein one of the plurality of input streams originates from another medical procedure.

19. The method of claim 11, further comprising providing a plurality of different compositions, wherein each composition is streamed to a different display.

20. The method of claim 11, wherein the input video stream is of or related to a medical protocol.

Images