Surgical Visualization and Recording System

Abstract

The present invention provides a method for capturing, communicating and displaying a surgical site image having a resolution of up to 4K ultra high definition (UHD) and associated with patient information in real time during a surgical procedure, and a surgical visualization and recording system (SVRS). The SVRS includes a UHD camera system having an optical component and an image sensor, and a display unit having an embedded microcomputer and a tactile user interface (TUI). The image sensor captures a surgical site image having a resolution of up to 4K UHD and communicates it to the embedded microcomputer. The embedded microcomputer receives the patient information through the TUI and associates the captured and communicated surgical site image with the patient information in real time. The display unit displays the captured and communicated surgical site image having a resolution of up to 4K UHD and associated with the patient information on the TUI in real time.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to non-provisional patent application No. 15 / 884,359, entitled “Surgical Visualization And Recording System,” filed in the United States Patent and Trademark Office on January 30, 2018. The entirety of the above-referenced patent application is incorporated herein by reference. Background Art

[0003] Minimally invasive surgeries, such as laparoscopy, arthroscopy, and thoracoscopy, are increasingly being performed to reduce trauma to patient tissue, reduce scarring, minimize postoperative pain, reduce blood loss, lower the risk of infection, and enable faster patient recovery. In minimally invasive surgery, the surgeon makes a small incision, for example, a few millimeters, through the patient's skin, rather than creating a larger opening in the patient's body as in conventional open surgery. Conventional surgical visualization systems used in minimally invasive surgery include a camera, an external control unit, and a monitor for visualizing the surgical site. The surgeon passes a thin, elongated tube with a camera attached to the proximal end of an examination device (e.g., a laparoscope) through one incision and passes other instruments used to facilitate minimally invasive surgery through another incision. The camera captures images of the surgical site, such as still images or videos. The external control unit receives and processes the image signal from the camera and projects the images of the surgical site (e.g., still images or moving images, such as video) onto a monitor in the operating room, providing the surgeon with a clear and magnified view of the surgical site. The surgeon may use the hardware controls of the external control unit for setting image parameters associated with the captured image, such as brightness, saturation, contrast, etc., and for controlling other aspects of the captured image.

[0004] Conventional surgical visualization systems, including a camera, an external control unit, and a monitor, are bulky systems of separate (often spaced apart) devices used to capture and display images of the surgical site during minimally invasive surgery. To modify image parameters, a user, such as a surgeon, must place hardware controls, such as buttons, on the external control unit and continuously operate them while visualizing the captured images in real time on the monitor. Modifying image parameters of captured images in real time during minimally invasive surgery can be distracting for the surgeon performing the procedure, as the surgeon must simultaneously manage separate devices. Conventional surgical visualization systems do not support real-time review of captured images. An external media viewer or external computing device (e.g., a laptop or tablet) is typically connected to a conventional surgical visualization system to enable the surgeon to review captured images of the surgical site. Furthermore, conventional surgical visualization systems typically capture low-resolution images, which are difficult to optimally view and interpret. Furthermore, conventional surgical visualization systems require a separate recording system for capturing and recording images, which can lead to erroneous processing and identification of patient information.

[0005] Surgeons performing minimally invasive surgery must have access to patient information before, during, and after the minimally invasive surgery, and at all times. This patient information includes, for example, the patient's name, age, gender, patient identifier, medical history, information about the minimally invasive surgery to be performed, and the like. Access to patient information enables surgeons to carefully plan the minimally invasive surgery and respond to the ongoing surgical procedure, thereby improving the success of the minimally invasive surgery. In contrast, in conventional surgical visualization systems, for example, a hospital may maintain a handwritten or electronic document of patient information, which needs to be transmitted to the surgeon for access before, during, and after the minimally invasive surgery, and at all times. For the surgeon, processing the handwritten document containing the patient information and visualizing the surgical site images captured by the conventional surgical visualization system in real time during the minimally invasive surgery, or viewing the electronic document containing the patient information and visualizing the surgical site images captured in real time during the minimally invasive surgery on an external media player (e.g., a laptop or tablet computer) can be cumbersome and hindering, resulting in a suboptimal situation for performing minimally invasive surgery.

[0006] Surgical site images captured by conventional surgical visualization systems are typically stored within the conventional surgical visualization system and can be viewed using an external media viewer. Conventional surgical visualization systems require physical accessibility to enable the surgeon to view the captured surgical site images. Technical failures in conventional surgical visualization systems may corrupt data stored in the conventional surgical visualization system or may allow the captured images to be accessed by unauthorized individuals. Manually transferring captured surgical site images to another device carries the risk of mishandling and manipulation of the captured images.

[0007] Therefore, there is a pressing need for a method and a surgical visualization and recording system that includes embedded image capture, recording, control, and display components for capturing, communicating, recording, and displaying surgical site images associated with patient information in real time during a surgical procedure (e.g., minimally invasive surgery), the surgical site images having a 4K ultra-high-definition (UHD) resolution of up to 3840 pixels x 2160 lines. Furthermore, there is a need for a method and a surgical visualization and recording system that includes an integrated visualization interface for accepting user input without an external control unit to modify image parameters of the captured surgical site images and for enabling a user, such as a surgeon, to review the captured images having a resolution of up to 4K UHD and patient information during and after the procedure without an external media viewer or external computing device (e.g., a laptop or tablet). Furthermore, there is a need for a method and a surgical visualization and recording system for accepting user input to enter additional patient information into the integrated visualization interface and for associating the patient information with the captured images in real time, thereby reducing the paperwork required to associate the captured images with the patient. Furthermore, there is a need for a method and a surgical visualization and recording system for enabling a user (e.g., a surgeon) to record 4K UHD resolution images directly to a storage device (e.g., a flash drive, a hard drive, or a network drive on a secure hospital network) to prevent unauthorized personnel from processing the captured images and patient information and to maintain the confidentiality of the patient information in accordance with the Health Insurance Portability and Accountability Act (HIPAA). Furthermore, there is a need for a method and a surgical visualization and recording system for automatically and securely transmitting captured surgical site images for secure storage in real-time directly over a network (e.g., an internal hospital network) in an external system and / or a cloud computing environment. Summary of the Invention

[0008] This disclosure is provided to introduce a selection of concepts in a simplified form that are further disclosed in the detailed description of the disclosure. This summary is not intended to determine the scope of the claimed subject matter.

[0009] The disclosed method and surgical visualization and recording system (SVRS) including embedded image capture, recording, control, and display components address the aforementioned need for capturing, communicating, recording, and displaying surgical site images in real time during surgical procedures (e.g., minimally invasive surgery) with ultra-high-definition (UHD) resolution up to 3840 pixels x 2160 lines, hereinafter referred to as "4K UHD resolution," in UHD format, associated with patient information. The disclosed method and SVRS provide an integrated visualization interface, i.e., a tactile user interface, for accepting user input for modifying image parameters of captured surgical site images without an external control unit, and enabling a user (e.g., a surgeon) to review the captured images at up to 4K UHD resolution and patient information during and after surgery without an external media viewer or external computing device (e.g., a laptop or tablet). The tactile user interface of the disclosed SVRS also accepts user input for entering additional patient information. The SVRS associates patient information with captured images in real time, thereby reducing the paperwork required to associate captured images with patients.

[0010] Furthermore, the method and surgical visualization and recording system (SVRS) disclosed herein enable a user (e.g., a surgeon) to record 4K ultra high definition (UHD) resolution images directly to a storage device (e.g., a flash drive, a hard drive, or a network drive on a secure hospital network), thereby preventing unauthorized personnel from processing the captured images and patient information and maintaining the confidentiality of the patient information in accordance with the Health Insurance Portability and Accountability Act (HIPAA). Furthermore, the method and SVRS disclosed herein meet the above-mentioned needs for automatically and securely transmitting captured surgical site images for secure storage directly in an external system and / or cloud computing environment over a network (e.g., an internal hospital network) in real time. The SVRS eliminates the need to handle external media for transferring and downloading captured images over a hospital network or hospital server. A hospital network drive can be mapped to the SVRS for storing captured images in the initial setup of the SVRS.

[0011] In the method disclosed herein, a surgical visualization and recording system (SVRS) including an ultra-high-definition (UHD) camera system and a display unit is provided for capturing, communicating, and displaying surgical site images in real time during a surgical procedure, the surgical site images having a resolution of up to 4K UHD, associated with patient information. The UHD camera system includes an optical component and an image sensor. The optical component and the image sensor are located at the proximal end of a surgical viewing device, such as a laparoscope. The image sensor is in optical communication with the optical component and is configured to receive reflected light from the surgical site through the optical component and capture surgical site images having a resolution of up to 4K UHD. The display unit includes an embedded microcomputer and a tactile user interface. The embedded microcomputer is in operative communication with the UHD camera system. The embedded microcomputer includes at least one processor configured to execute computer program instructions for receiving, transforming, and processing captured surgical site images. The tactile user interface is in operative communication with the embedded microcomputer for receiving one or more user inputs for controlling the operation of the UHD camera system and for displaying processed surgical site images having a resolution of up to 4K UHD.

[0012] When a user (e.g., a surgeon performing an operation) inputs patient information via the display unit's tactile user interface, the display unit's embedded microcomputer receives the patient information. Upon receiving one or more user inputs via the display unit's tactile user interface and / or via one or more input devices (operably connected to the embedded microcomputer), an image sensor of an ultra-high-definition (UEID) camera system captures an image of the surgical site with a resolution of up to 4K UHD and communicates the captured image to the display unit's embedded microcomputer in real time. The embedded microcomputer associates the captured and communicated surgical site image with the received patient information in real time. The display unit displays the captured and communicated surgical site image, associated with the received patient information, in real time on the tactile user interface. The surgical site image, with a resolution of up to 4K UHD, is displayed.

[0013] In one or more embodiments, the system includes circuits and / or programs for implementing the methods disclosed herein. The circuits and / or programs can be any combination of hardware, software, and / or firmware configured to implement the methods disclosed herein according to the design choices of the system designer. Furthermore, in embodiments, various structural elements can be used according to the design choices of the system designer. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] The foregoing summary of the invention and the following detailed description of the invention will be better understood when read in conjunction with the accompanying drawings. For purposes of illustrating the invention, example configurations of the invention are shown in the accompanying drawings. However, the invention is not limited to the specific methods and components disclosed herein. The description of a method step or component denoted by a reference numeral in a drawing also applies to the description of a method step or component denoted by the same reference numeral in any subsequent drawing.

[0015] Figure 1 Methods for capturing, communicating, and displaying surgical site images in real time, with up to ultra-high definition resolution, associated with patient information, during surgery are presented.

[0016] Figure 2 The example shows an exploded perspective view of a surgical visualization and recording system for capturing, communicating, and displaying surgical site images in real time, up to ultra-high definition resolution, associated with patient information during surgery.

[0017] Figure 3 The example shows a block diagram of a surgical visualization and recording system for capturing, communicating, and displaying surgical site images in real time during surgery, with up to ultra-high-definition resolution, associated with patient information.

[0018] Figure 4 The example shows a block diagram of a surgical visualization and recording system for capturing, communicating, and displaying surgical site images in real time, up to ultra-high definition resolution, associated with patient information during a laparoscopic procedure.

[0019] Figure 5 The example shows a flow chart including steps performed by an embedded microcomputer of a display unit of a surgical visualization and recording system according to user input received on a start screen presented on a tactile user interface of the display unit.

[0020] Figures 6A-6B The example shows a flow chart including steps performed by an embedded microcomputer of a display unit according to user input received on an operation screen presented on a tactile user interface of the display unit.

[0021] Figures 7A-7B The example shows a flow chart including steps performed by an embedded microcomputer of a display unit according to user input received on a camera setting screen presented on a tactile user interface of the display unit.

[0022] Figures 8A-8BThe example represents a screenshot of a tactile user interface of a display unit, showing a camera settings screen for modifying camera parameters of an ultra-high definition camera system of a surgical visualization and recording system.

[0023] Figures 9A-9B The example shows a flow chart including steps performed by an embedded microcomputer of a display unit in response to user input received on a patient information screen presented on a tactile user interface of the display unit.

[0024] Figure 10 The example shows a screenshot of a tactile user interface of a display unit, showing a patient information screen for entering patient information related to imaging of a surgical site.

[0025] Figures 11A-11B The example shows a flow chart including steps performed by an embedded microcomputer of a display unit according to user input received on a video recording and image capture screen presented on a tactile user interface of the display unit.

[0026] Figure 12 The example shows a flow chart including steps performed by an embedded microcomputer of a display unit in response to user input received on a media viewer screen presented on a tactile user interface of the display unit. DETAILED DESCRIPTION

[0027] Figure 1A method for capturing, communicating, and displaying images of a surgical site in real time during surgery (e.g., minimally invasive surgery, such as laparoscopy) is presented. The images have an ultra-high-definition (UHD) resolution of, for example, 3840 pixels x 2160 lines, associated with patient information. Hereinafter, the UHD resolution of 3840 pixels x 2160 lines is referred to as "4K UHD resolution." As used herein, the term "image" refers to a still image or a moving image, such as a video of the surgical site. Furthermore, as used herein, "surgical site" refers to a portion of an organ or cavity in a patient's body that is to be visualized (for surgical purposes). In the disclosed method, a surgical visualization and recording system (SVRS) 101 is provided that includes a UHD camera system and a display unit. The UHD camera system includes optical components and an image sensor, which is located at the proximal end of a surgical observation device (e.g., a laparoscope). As used herein, "optical component" refers to a component that changes the path of light, such as by focusing or dispersing light through refraction, or by diverging light. An optical component, for example, is an optical lens for focusing or diverging light. The optical component transmits reflected light from the surgical site to an image sensor. The image sensor is an electronic detector that detects and transmits optical information that constitutes an image. In the method disclosed herein, image parameters are set on the image sensor to form an image with a resolution of up to 4K UHD. The image sensor receives reflected light from the surgical site and converts the reflected light into signals, such as current pulses, that transmit optical information about the surgical site. The image sensor is, for example, a complementary metal oxide semiconductor (CMOS) image sensor. The image sensor is optically connected to the optical component, configured to receive reflected light from the surgical site through the optical component and capture an image of the surgical site with a resolution of up to 4K UHD. The CMOS image sensor can stream captured images with a resolution of up to 4K UHD (e.g., 30 frames per second (fps)) over a universal serial bus (USB) interface (e.g., a USB 3.0 interface) in the Compressed Motion Joint Photographic Experts Group (MJPEG) format and transmit them to a display unit. The image sensor transmits the captured images as a series of frames to the display unit.

[0028] The display unit includes an embedded microcomputer and a tactile user interface. The embedded microcomputer is in operative communication with an image sensor of an ultra-high definition (UHD) camera system. The embedded microcomputer includes at least one processor configured to execute computer program instructions for receiving, transforming, and processing captured surgical site images. In an embodiment, the embedded microcomputer is configured to manage, for example, a custom software application based on a computer program. This custom software application, hereinafter referred to as the "surgical visualization and recording application," runs on an operating system. The surgical visualization and recording application interfaces and communicates with the UHD camera system's image sensor via an interface (e.g., a Universal Serial Bus). The embedded microcomputer integrated into the display unit eliminates the need for an external control unit (e.g., an external camera control unit) and the need for external media within the control unit.

[0029] The tactile user interface of the display unit is, for example, a 4K ultra high definition (UHD) resolution capacitive touch screen display interface that is in operative communication with the embedded microcomputer for receiving one or more user inputs for controlling the operation of the UHD camera system and for displaying the captured surgical site image having up to 4K UHD resolution. The tactile user interface is, for example, an online web interface, a web-based downloadable application interface, a mobile device-based downloadable application interface, etc. that detects and receives tactile input. In the method disclosed herein, when a user, such as a surgeon, provides patient information to a surgical visualization and recording system (SVRS) by entering the patient information on the tactile user interface of the display unit, the embedded microcomputer receives the patient information (102) via the tactile user interface of the display unit. The patient information includes, for example, a patient identifier, patient name, surgeon name, surgery type, surgery description, surgery date, etc. The ability to enter the patient information into the same integrated custom tactile user interface eliminates the additional paperwork required to associate the captured image with the patient.

[0030] Upon receiving one or more user inputs via the display unit's tactile user interface and / or one or more input devices operatively connected to the display unit via the embedded microcomputer, the image sensor of the ultra-high-definition (UHD) camera system captures an image 103 of the surgical site having a resolution of up to 4K UHD and communicates it in real time to the embedded microcomputer of the display unit. Examples of input devices include a keyboard (e.g., an alphanumeric keyboard), a joystick, a pointing device (e.g., a computer mouse), a touchpad, a light pen, a digital pen, a microphone for providing voice input, a digital camera, physical buttons, a touch-sensitive display device, a trackball, a pointing stick, any device capable of detecting tactile input, a foot switch, a portable wireless controller, and the like. Image parameters are downloaded to the image sensor for capturing an image of the surgical site having a resolution of up to 4K UHD and communicating the image to the embedded microcomputer. A user (e.g., a surgeon) provides user input, which may include, for example, an image capture command, an image recording command, and the like. In one embodiment, the image sensor utilizes a wired communication mode, such as a universal serial bus (USB), to communicate the captured image of the surgical site to the embedded microcomputer of the display unit. In another embodiment, an image sensor with built-in custom software utilizes a wireless communication mode such as Bluetooth® from toothSig, Inc. Wi-Fi Alliance Corporation etc., so as to communicate the captured surgical site image to the embedded microcomputer of the display unit. A general-purpose computer using a general-purpose program cannot capture a surgical site image having a resolution of up to 4K UHD from the image sensor of the UHD camera system and communicate it to the embedded microcomputer of the display unit in real time when receiving one or more user inputs through the tactile user interface and / or one or more input devices of the display unit according to the above-mentioned method steps.

[0031] The embedded microcomputer uses a surgical visualization and recording application (SVRA) to capture and communicate an image of the surgical site in an ultra high definition (UHD) format from an image sensor of the UHD camera system. The embedded microcomputer considers the captured and communicated image received from the image sensor of the UHD camera system to be a final image. Image capture is initiated when an image capture command is received from a user via a tactile user interface of a display unit. The embedded microcomputer associates the captured and communicated surgical site image with received patient information in real time (104). As used herein, associating the captured and communicated surgical site image with received patient information means connecting or combining the received patient information with the captured and communicated surgical site image. The embedded microcomputer appends the received patient information to the captured and communicated surgical site image so that the captured and communicated image can be visualized with the real-time received patient information to have a resolution of up to 4K UHD. In an embodiment, the embedded microcomputer uses image processing technology to overlay the received patient information on the captured and communicated image. In another embodiment, the image sensor of the UHD camera system transmits a series of frames of image data to the embedded microcomputer of the display unit. During recording, the embedded microcomputer overlaps each frame with the received patient information and stores the frames with the overlapped patient information in a storage location in the file system. A general-purpose computer using a general-purpose program cannot associate the captured and communicated surgical site images with the received patient information in real time according to the above-described method steps. In one embodiment, the embedded microcomputer uses SVRA to organize the captured and communicated surgical site images and the received patient information in the file system. For example, the embedded microcomputer stores the captured and communicated surgical site images and the received patient information for multiple patients in separate files within a patient folder. For example, the directory structure for each patient in the file system may be: video file name NP_patientID_MMMDDYYYY_NNN (date format MMMDDYYYY), where NNN is a sequential number, such as 001, 002, 003, etc.; image file name NP_patientID_MMMDDYYYY__NNN, where NNN is a sequential number, such as 001, 002, 003, etc.; or NP_patientID_MMMDDYYYY_info.txt, which is used to access the patient information file. A general purpose computer using a general purpose program is not capable of organizing the captured and communicated surgical site images and received patient information in a file system according to the above method steps.

[0032] A display unit of a surgical visualization and recording system (SVRS) displays (105) a surgical site image captured and communicated in association with received patient information on a tactile user interface in real time, the surgical site image having a resolution of up to 4K ultra-high definition (UHD). In an embodiment, the display unit displays the patient information on the real-time image. The display unit displays information and a display interface, user interface elements (e.g., slidable arrows, buttons, icons, etc.) via a tactile user interface, such as for receiving user input (e.g., image grabbing commands, video recording commands, etc.), and for displaying the surgical site image captured and communicated in association with the received patient information. In an embodiment, the display unit includes, for example, a video display, a liquid crystal display, a plasma display, an organic light emitting diode (OLED)-based display, etc. When a surgical visualization and recording application is used, an embedded microcomputer presents a tactile user interface on the display unit for receiving user input for capturing and recording surgical site images. The tactile user interface and (in an embodiment) one or more input devices are used to input patient information into the embedded microcomputer and / or for controlling the capture, recording, and display of surgical site images. In an embodiment, the embedded microcomputer records the captured and communicated surgical site images with up to 4K UHD resolution and with received patient information in a storage device that is connected in real time with the display unit, for example via a universal serial bus interface.

[0033] In one embodiment, a user, such as a surgeon, can activate an ultra-high-definition (UHD) camera system's image sensor to capture and communicate surgical site images to an embedded microcomputer by controlling an input device (e.g., a foot switch), and activate the embedded microcomputer to receive, record, and display surgical site images, thereby enabling the surgeon to focus on the procedure rather than on initiating the capture, recording, and display of surgical site images via an external control unit. In another embodiment, an input device (e.g., a handheld or portable wireless controller) can be used by a surgeon technician to activate the image sensor to capture and communicate surgical site images to the embedded microcomputer, and activate the embedded microcomputer to receive, record, and display surgical site images, thereby enabling the surgeon to focus on the procedure rather than on initiating the capture, recording, and display of surgical site images via an external control unit. User input entered via a tactile user interface on a display unit is converted, processed, and executed by an algorithm executed by at least one processor in the embedded microcomputer to control the capture, recording, and display of surgical site images having resolutions up to 4K UHD, and to transmit the captured and communicated surgical site images, associated with received patient information, to an external system and / or a client application on a user device. A general purpose computer using a general purpose program is unable to display the captured and communicated surgical site image associated with the received patient information in real time on a tactile user interface according to the above method steps with up to 4K UHD resolution.

[0034] In one embodiment, the embedded microcomputer of the display unit securely stores the captured and communicated surgical site images with received patient information directly in real time on an external system (e.g., a hospital system) using the embedded microcomputer's built-in surgical visualization and recording application without a transmission interface. A user, such as a surgeon, can connect a storage device (e.g., a flash drive, hard drive, or network drive) on a secure hospital network to the display unit, for example, using a universal serial bus (USB) interface, to record 4K ultra-high-definition (UHD) images directly to the storage device in real time. This prevents unauthorized personnel from mishandling and manipulating patient information associated with the captured and communicated images and maintains the confidentiality of patient information in accordance with the Health Insurance Portability and Accountability Act (HIPAA). Thus, the surgical visualization and recording system (SVRS) protects the captured and communicated surgical site images with received patient information in accordance with HIPAA guidelines. A network drive on the secure hospital network is mapped to the SVRS for storing the captured and communicated surgical site images with received patient information on the network drive. A general-purpose computer using a general-purpose program cannot directly and securely store the captured and communicated surgical site image with the received patient information on an external system in real time according to the above-described method steps without a transmission interface.

[0035] In another embodiment, the embedded microcomputer of the display unit stores the captured and communicated surgical site images with the received patient information in real time over a network (e.g., the Internet) in a cloud computing environment. As used herein, a "cloud computing environment" refers to a processing environment that includes configurable physical and logical computing resources (e.g., networks, servers, storage media, virtual machines, applications, services, etc.) and data distributed over the network. A cloud computing environment provides on-demand network access to a shared pool of configurable physical and logical computing resources. A general-purpose computer using a general-purpose program cannot store the captured and communicated surgical site images with the received patient information in real time over a network in a cloud computing environment according to the above-described method steps.

[0036] The embedded microcomputer controls the capture, recording, and display of surgical site images having a resolution of up to 4K ultra-high definition (UHD) when receiving one or more user inputs through a tactile user interface of a display unit and / or one or more input devices. The user input for controlling the display of the surgical site images on the tactile user interface of the display unit includes, for example, a play command, a pause command, and a stop command. In an embodiment, the embedded microcomputer controls one or more of a plurality of camera parameters of the UHD camera system when receiving one or more user inputs through a tactile user interface of the display unit and / or one or more input devices. The camera parameters include, for example, white balance, brightness, sharpness, contrast, grayscale, saturation, resolution, gain, exposure, frame rate, etc. In the method disclosed in the present invention, the camera parameters with patient information are set using the embedded microcomputer and the tactile user interface using a surgical visualization and recording application (SVRA), thereby eliminating the need for an external control unit for setting the camera parameters.

[0037] In an embodiment, the embedded microcomputer of the display unit transmits the captured and communicated surgical site images having a resolution of up to 4K ultra-high definition (UHD) and associated patient information in real time via an internal hospital network to a client application on a user device (e.g., a personal computer, laptop, tablet computing device, smartphone, etc.), allowing the captured and communicated surgical site images with the received patient information to be viewed in real time on the user device. Transmitting the captured and communicated surgical site images having a resolution of up to 4K UHD and associated patient information to the client application on the user device in real time facilitates remote access to the captured and communicated surgical site images having a resolution of up to 4K UHD. The embedded microcomputer transmits the captured and communicated images (e.g., real-time video associated with the received patient information for viewing on a dedicated wireless channel) to a client application (e.g., a mobile application) loaded on the user device. A general-purpose computer using a general-purpose program cannot transmit the captured and communicated surgical site images having a resolution of up to 4K UHD and with received patient information to a client application on a user device over a network in accordance with the above-described method steps, for allowing the captured and communicated surgical site images with received patient information to be viewed in real time on the user device.

[0038] During surgery, a user, such as a surgeon, can view captured and communicated surgical site images with resolutions up to 4K ultra-high definition (UHD) on a display unit of a surgical visualization and recording system (SVRS). When a storage device is connected to the display unit via an embedded microcomputer, the embedded microcomputer of the display unit can record the captured and communicated surgical site images with patient information on the storage device (e.g., a removable drive). In one embodiment, the embedded microcomputer of the display unit immediately plays back the captured and communicated surgical site images without additional conversion or reprocessing of the captured and communicated images. The resolution of the captured and communicated surgical site images can be set to 4K UHD resolution. In one embodiment, the display unit displays the captured and communicated surgical site images with resolutions up to 4K UHD in real time on a tactile user interface. In another embodiment, the display unit displays pre-recorded surgical site images from a storage device (e.g., a removable drive) operatively connected to the display unit. The embedded microcomputer receives user input, such as image capture commands, image recording commands, play commands, pause commands, stop commands, etc., to control the display of the pre-recorded surgical site images. The embedded microcomputer also changes the camera parameters of the pre-recorded image on the display unit according to user input, such as brightness, contrast, sharpness, grayscale, saturation, resolution, gain, exposure, white balance, frame rate, etc.

[0039] A surgical visualization and recording system (SVRS) provides a display unit with a tactile user interface for receiving patient information and user input. The tactile user interface includes a defined space for entering patient information and providing user input, such as in the form of touch gestures using a stylus or finger on the tactile user interface. An embedded microcomputer receives these touch gestures as user input, receives and communicates surgical site images captured in real time by an ultra-high-definition (UHD) camera system's image sensor, and, in embodiments, records the captured and communicated surgical site images. In embodiments, the embedded microcomputer receives patient information and user input via a client application supported by the SVRS on a user device over a network. The embedded microcomputer distinguishes between image capture commands and image recording commands input by the user via the tactile user interface. The embedded microcomputer converts the user input on the tactile user interface into actions that activate the optical components and image sensor of the UHD camera system to capture surgical site images and communicate them to the embedded microcomputer in real time. In embodiments, the captured and communicated images are recorded on a storage device. In embodiments, the embedded microcomputer receives user input via an input device, such as a portable wireless controller and / or a foot switch operably connected to the display unit. Button presses on the portable wireless controller and / or the foot switch constitute user input provided to the embedded microcomputer. The embedded microcomputer receives these button presses as user input and distinguishes between image capture commands and image recording commands. The embedded microcomputer converts the user input from the portable wireless controller and / or the foot switch into actions that activate the optical components and image sensor of the UHD camera system to capture images of the surgical site and communicate them to the embedded microcomputer in real time. In embodiments, the captured and communicated images are recorded on a storage device.

[0040] The image sensor of the ultra-high-definition (UHD) camera system converts the captured surgical site image into data suitable for communication to a display unit of a surgical visualization and recording system (SVRS) via a USB interface over a USB cable using a universal serial bus (USB) protocol. The embedded microcomputer converts the data into a format compatible with the display unit for displaying the captured and communicated surgical site image on a tactile user interface without compromising resolution. The embedded microcomputer associates the captured and communicated surgical site image with patient information, and thus, in an embodiment, converts the captured and communicated image into a formed image combined with the patient information to allow the captured and communicated surgical site image to be visualized together with the patient information without compromising the visibility and quality of the captured and communicated surgical site image. The above-described method steps 101, 102, 103, 104, and 105 performed by the SVRS are concrete, provide advantageous results, and are not abstract. The operational connection of a UHD camera system to a surgical viewing device and a display unit (the display unit having an embedded microcomputer and a tactile user interface), and the communication between the UHD camera system and display unit and external systems and client applications on user devices (for displaying captured and communicated surgical site images having resolutions up to 4K UHD and associated with received patient information) are improvements to surgical visualization technology.

[0041] Furthermore, the embedded microcomputer receives user input in the form of touch gestures (via a tactile user interface) and / or button presses on an input device (e.g., a portable wireless controller and / or a foot switch) for controlling camera parameters, including, for example, brightness, contrast, sharpness, gain, exposure, frame rate, etc. The embedded microcomputer receives these user inputs and distinguishes between user inputs for different camera parameter inputs. The embedded microcomputer converts these user inputs into actions for controlling or modifying the camera parameters, thereby triggering the capture of surgical site images by the image sensor of the ultra-high-definition (UHD) camera system in real time and, in embodiments, recording the captured images. Furthermore, the embedded microcomputer receives user input in the form of touch gestures (via a tactile user interface) and / or button presses on an input device (e.g., a portable wireless controller and / or a foot switch), such as image capture commands, image recording commands, play commands, pause commands, and stop commands, for controlling the capture, recording, and display of surgical site images. The embedded microcomputer receives these user inputs and distinguishes between user inputs for controlling the capture, recording, and display of images. The embedded microcomputer converts these user inputs into actions for controlling the capture, recording, and display of surgical site images.

[0042] Consider an example of a surgeon performing a laparoscopy using the surgical visualization and recording system (SVRS) disclosed herein. The surgeon connects an ultra-high-definition (UHD) camera system to a display unit with a built-in embedded microcomputer via a communication interface, such as a universal serial bus (USB) interface. The surgeon activates the SVRS to access the display unit's tactile user interface. The surgeon enters patient information, such as a patient identifier, patient name, surgeon name, surgery type, and a brief description of the surgical question, into the tactile user interface. The surgeon or technician then uses the tactile user interface to set and verify camera parameters for the UHD camera system, such as brightness, contrast, sharpness, gamma, saturation, gain, exposure, white balance, etc. After entering the camera parameters and patient information, during the procedure, the surgeon or technician uses the tactile user interface to trigger image capture, such as still images or videos of the surgical site. The surgeon or technician can also use an input device, such as a foot switch operatively connected to the display unit, to trigger image capture. The SVRS enables the surgeon to capture, record, and pause images set by the surgeon, with resolutions up to 4K UHD. SVRS allows these captured images to be stored along with patient information files about the surgery on a pre-determined network drive on the hospital network, eliminating mishandling and manipulation of surgical data and protecting it in accordance with Health Insurance Portability and Accountability (HIPAA) guidelines.

[0043] In one embodiment, a surgical visualization and recording system (SVRS) receives instructions from a user to capture multiple images. An image sensor of an ultra-high-definition (UHD) camera system captures the multiple images and communicates them to an embedded microcomputer of a display unit. The embedded microcomputer stores the captured and communicated images in a storage location in a file system with a date and time stamp. In another embodiment, the SVRS receives instructions from a user to capture a single image of the surgical site. The image sensor captures the single image and communicates it to an embedded microcomputer of the display unit. The embedded microcomputer stores the captured and communicated single image in a storage location in a file system with a date and time stamp. In one embodiment, this storage access can also be configured by the surgeon on an external universal serial bus (USB) drive. The SVRS enables the surgeon to view both the captured and communicated images within the same integrated tactile user interface. In one embodiment, the SVRS transmits real-time video of the surgical site over a dedicated wireless channel from the embedded microcomputer of the display unit to a mobile application that can be loaded on a hospital tablet for viewing. Thus, the SVRS eliminates the need for multiple accessories and provides an integrated, end-to-end technical solution for addressing the challenges faced during endoscopic surgery.

[0044] In the method disclosed herein, the design and information flow between the optical components and image sensors of an ultra-high-definition (UHD) camera system of a surgical visualization and recording system (SVRS), between a tactile user interface and an embedded microcomputer of a display unit of the SVRS, and between the embedded microcomputer, input devices, external systems, and client applications on user devices are carefully designed and directed. Each user input provided to the embedded microcomputer through the tactile user interface of the display unit and / or through one or more input devices is configured by the embedded microcomputer to guide the user toward a limited set of predictable outcomes. The embedded microcomputer uses one or more dedicated computer programs to guide the user toward the set of end outcomes. The interactions designed by the SVRS enable the SVRS to receive patient information and user input from the user and, from this information, use other independent and autonomous computer programs to capture, communicate, record, and display surgical site images in real time during surgery, the surgical site images having up to 4K ultra-high-definition (UHD) resolution, associated with patient information. In order to receive patient information through the tactile user interface of the display unit, in order to capture surgical site images with a resolution of up to 4K UHD and communicate them in real time to an embedded microcomputer in the display unit when receiving user input through the tactile user interface of the display unit and / or through one or more input devices, in order to associate the captured and communicated surgical site images with the received patient information in real time, and in order to display the captured and communicated surgical site images with a resolution of up to 4K UHD and associated with the received patient information on the tactile user interface in real time, four or more separate computer programs and subroutines are required, the execution of which cannot be performed using a general-purpose computer with general-purpose programs.

[0045] The method disclosed herein provides improvements in surgical visualization technology as follows. When implementing the method disclosed herein, an ultra-high-definition (UHD) camera system of a surgical visualization and recording system (SVRS) captures an image of the surgical site with a resolution of up to 4K UHD and communicates it in real time to an embedded microcomputer of the SVRS's display unit, upon receiving one or more user inputs via a tactile user interface of a display unit and / or one or more input devices. The embedded microcomputer receives patient information via the tactile user interface of the display unit. The embedded microcomputer associates the captured and communicated surgical site image with the received patient information in real time. The SVRS's display unit displays the captured and communicated surgical site image with a resolution of up to 4K UHD and associated with the received patient information on the tactile user interface in real time. The SVRS allows a user (e.g., a surgeon performing minimally invasive surgery) to access patient information, such as name, age, gender, patient identifier, medical history, and detailed instructions for the minimally invasive surgery to be performed, before, during, and after the minimally invasive surgery, and at any time. Access to patient information and real-time visualization of the captured and communicated surgical site image enables the surgeon to plan and perform surgery with enhanced visualization and information in real time.

[0046] Furthermore, a surgical visualization and recording system (SVRS) provides a single display unit for displaying captured and communicated surgical site images in real-time with resolutions up to 4K ultra-high-definition (UHD), without the need for an external media viewer. The SVRS includes an embedded microcomputer within the display unit, unlike conventional surgical visualization systems, which include separate and discrete components such as a camera assembly, an external control unit, and an external monitor. The absence of an external control unit in the SVRS reduces power consumption and transmission losses of communicated surgical site images. Camera parameters for captured and communicated surgical site images can be controlled via user input received through a tactile user interface, eliminating the risk of the surgeon being distracted by using an external control unit to control camera parameters and visualize the surgical site on the display unit. The SVRS securely stores captured and communicated surgical site images directly on an external system to comply with Health Insurance Portability and Accountability (HIPAA) guidelines. This direct storage of captured and communicated surgical site images eliminates the risk of mishandling and manipulation of the captured and communicated surgical site images and related patient information by unauthorized individuals. Furthermore, the SVRS stores the captured and communicated surgical site images in a cloud computing environment. Furthermore, the SVRS provides remote accessibility to the captured and communicated surgical site images with patient information by transmitting the captured and communicated surgical site images with patient information to a client application on a user device, thereby allowing another user to view the captured and communicated surgical site images in real time and to review the recorded surgical site images.

[0047] The method and surgical visualization and recording system (SVRS) disclosed in the present invention focus on improvements to surgical visualization technology itself, rather than improvements to the economy or other tasks of general-purpose computers used in ordinary capabilities. Therefore, the method and SVRS disclosed in the present invention are not directed to abstract ideas. Instead, the method and SVRS disclosed in the present invention are directed to special improvements in the operating methods of components of the SVRS, such as receiving patient information through a tactile user interface, capturing surgical site images with a resolution of up to 4K ultra high definition (UHD) and communicating them to an embedded microcomputer of a display unit in real time when receiving user input, associating the captured and communicated surgical site images with the received patient information in real time, and displaying the captured and communicated surgical site images with a resolution of up to 4K UHD and associated with the received patient information on the tactile user interface in real time.

[0048] Figure 2The example shows an exploded perspective view of a surgical visualization and recording system (SVRS) 200 for capturing, communicating, and displaying images of a surgical site with resolutions up to 4K ultra-high definition (UHD) and associated with patient information in real time during surgery. The SVRS 200 includes an ultra-high definition (UHD) camera system 201 having an optical component 203 and a camera interface board 210 housed within a housing. Figure 3 An image sensor 220 shown as an example in FIG; and a display unit 216, which is included in Figure 3 The tactile user interface 217 and the embedded microcomputer 222 are shown as examples in FIG. Figure 1 The UHD camera system 201 also includes a C-mount interface 202, a locking ring 204, a glass 205, an O-ring 206, a camera 207, one or more studs 208, a gasket 209, a universal serial bus (USB) cable 212, a USB interface connector 211, and a cable gland 214. The UHD camera system 201 is enclosed in a housing 213. The C-mount interface 202 is a lens mounting assembly that is connected to the optical component 203 and is capable of adjusting the focus of the optical component 203. The C-mount interface 202 is operatively connected to the optical component 203 for adjusting the focus of the optical component 203, for example, from about 18 millimeters (mm) to about 35 mm. The locking ring 204 is a threaded gasket for fixing the position of the optical component 203 on the camera 207. The locking ring 204 prevents the optical component 203 from accidentally moving and loosening from the camera 207, and seals the gap between the optical component 203 and the camera 207 to provide a waterproof seal.

[0049] The glass 205 of the ultra-high-definition (UHD) camera system 201 is refractive and designed to provide focus and / or zoom. The glass 205 is operatively coupled to the C-mount interface 202 to adjust the focal length of the optical component 203, for example, from approximately 18 mm to approximately 35 mm. The optical component 203 is sealed by an O-ring 206 and a gasket 209. The O-ring 206 is positioned between the glass 205 and the camera head 207 and is compressed within a groove 207a of the camera head 207 to absorb shock and vibration. The camera head 207 houses the C-mount interface 202, the optical component 203, the locking ring 204, the glass 205, and the O-ring 206. A stud 208 securely attaches the camera head 207 to the camera interface plate 210. The gasket 209 provides a seal between the camera head 207 and the housing 213 and absorbs shock and vibration. The camera interface board 210 is securely housed in a housing 213, and the camera head 207 is attached to the housing 213 using studs 208. The image sensor 220 housed in the camera interface board 210 of the UHD camera system 201 captures images of the surgical site with resolutions up to 4K UHD and communicates in real time to an embedded microcomputer 222 of the display unit 216, as shown in FIG. Figure 1 disclosed in the detailed description.

[0050] A universal serial bus (USB) cable 212 is connected to the camera interface board 210 via a USB interface connector 211. The USB cable 212 is used to communicate captured surgical site images to an embedded microcomputer 222 of a display unit 216. The captured and communicated surgical site images are associated with patient information received via a tactile user interface 217 and displayed on the tactile user interface 217 with resolutions up to 4K UHD. A cable gland 214 attaches and secures the end of the cable to the UHD camera system 201. The USB cable 212 is connected to the display unit 216 via a USB interface connector 215. The display unit 216 receives the captured and communicated surgical site images via the USB cable 212 and processes the captured and communicated images using the embedded microcomputer 222 to display the captured and communicated surgical site images in real time with resolutions up to 4K UHD and associated patient information. A USB interface connector 219 is used to connect the display unit 216 to an input device (e.g., a foot switch) for controlling the capture, recording, and display of captured and communicated surgical site images with associated patient information. The input device can also control the display of pre-recorded surgical site images from a storage device (e.g., a removable drive 218 operatively connected to the display unit 216).

[0051] Figure 3The example shows a block diagram of a surgical visualization and recording system (SVRS) 200 for capturing, communicating, and displaying images of a surgical site with resolutions up to 4K ultra-high definition (UHD) and associated with patient information in real time during surgery. The SVRS 200 includes: a UHD camera system 201 having an optical component 203 and an image sensor 220; and a display unit 216 having a tactile user interface 217 and an embedded microcomputer 222, as shown in FIG. Figure 1-2 The UHD camera system 201 is waterproof. The UHD camera system 201 is made of waterproof materials, such as polypropylene, polyetherimide, polychlorotrifluoroethylene, etc. The optical component 203 is positioned at the proximal end of the surgical observation device. The optical component 203 is optically connected to the image sensor 220. Figure 2 The camera interface board 210, shown in the example, houses an image sensor 220. The image sensor 220 captures images of the surgical site. The camera interface board 210 includes a communication interface, such as a Universal Serial Bus (USB) interface 221, for enabling communication with a display unit 216, for example, using a USB cable 212. In an embodiment, the camera interface board 210 is configured as a 4K complementary metal oxide semiconductor (CMOS) camera board having a USB interface 221. The USB interface 221 enables real-time streaming of captured images with up to 4K UHD resolution from the image sensor 220 of the UHD camera system 201 to the display unit 216 and / or an external system 303 and / or a cloud computing environment in a 4K UHD digital display format. The image sensor 220 captures images of the surgical site with up to 4K UHD resolution in the Compressed Motion Joint Photographic Experts Group (MJPEG) format via the USB interface 221 (e.g., a USB 3.0 interface) and the USB cable 212 (e.g., a USB 3.0 cable), and communicates in real time to the embedded microcomputer 222 of the display unit 216.

[0052] The display unit 216 is in operable communication with the ultra-high-definition (UHD) camera system 201. The tactile user interface 217 of the display unit 216 receives one or more user inputs for controlling the operation of the UHD camera system 201, for receiving patient information from a user (e.g., a surgeon performing minimally invasive surgery at a surgical site), and for displaying captured and communicated images of the surgical site at resolutions up to 4K UHD. In an embodiment, the embedded microcomputer 222 of the display unit 216 activates the UHD camera system 201 upon receiving user input via the tactile user interface 217 of the display unit 216. The embedded microcomputer 222 invokes a surgical visualization and recording application on the tactile user interface 217 of the display unit 216 to receive patient information and / or one or more user inputs for controlling the UHD camera system 201. The embedded microcomputer 222 is in operable communication with the image sensor 220 of the UHD camera system 201 and the tactile user interface 217 of the display unit 216. Upon receiving one or more inputs from the tactile user interface 217 and / or from other input devices 302, the embedded microcomputer 222 activates the image sensor 220 of the UHD camera system 201 to receive reflected light from the surgical site through the optical component 203, capture images of the surgical site with resolutions up to 4K UHD, and communicate these images to the embedded microcomputer 222 in real time. The embedded microcomputer 222 activates the tactile user interface 217 to display the captured and communicated surgical site images and patient information in real time with resolutions up to 4K UHD. The embedded microcomputer 222 is a computer system programmable using a high-level computer programming language. It includes programming and dedicated hardware. The embedded microcomputer 222 includes a camera interface 224, which interfaces with the image sensor 220 of the UHD camera system 201 via a hardware abstraction layer 223. The hardware abstraction layer 223 is a programming layer that allows the operating system 226 of the embedded microcomputer 222 to interact with the optical components 203 and the image sensor 220 of the UHD camera system 201. The camera interface 224 enables communication between the image sensor 220 and the embedded microcomputer 222. The camera interface 224 connects to the image sensor 220 through the hardware abstraction layer 223 and provides output (e.g., an image captured by the image sensor 220) to the microprocessor 225 of the embedded microcomputer 222 for further processing.

[0053] Embedded microcomputer 222 includes: a non-transitory computer-readable storage medium, such as a memory unit 227 for storing program instructions, application programs, and data; and at least one processor, such as microprocessor 225, communicatively coupled to the non-transitory computer-readable storage medium. As used herein, "non-transitory computer-readable storage medium" refers to all computer-readable media other than transitory propagating signals, such as non-volatile media, volatile media, and transmission media. Non-volatile media includes, for example, solid-state drives, optical or magnetic disks, and other permanent memory volatile media (including dynamic random access memory (DRAM), which typically constitutes main memory). Volatile media includes, for example, register memory, processor cache, random access memory (RAM), etc. Transmission media includes, for example, coaxial cables, copper wires, fiber optic cables, modems, etc., including the wires that constitute a system bus coupled to microprocessor 225. Memory unit 227 is configured to store computer program instructions determined by modules (e.g., 228, 229, 230, 231, 232, 233, etc.) of embedded microcomputer 222. The modules of the embedded microcomputer 222 are installed and stored in the memory unit 227 of the embedded microcomputer 222. The memory unit 227 is, for example, a random access memory (RAM) or another type of dynamic storage device, which stores information and instructions for execution by the microprocessor 225. The memory unit 227 also stores temporary variables and other intermediate information used when the computer program instructions are executed by the microprocessor 225. The embedded microcomputer 222 also includes a read-only memory (ROM) or another type of static storage device, which stores static information and instructions for the microprocessor 225.

[0054] The microprocessor 225 is configured to execute computer program instructions determined by the modules (e.g., 228, 229, 230, 231, 232, 233, etc.) of the embedded microcomputer 222 for receiving, converting, and processing surgical site images captured by the image sensor 220. The microprocessor 225 refers to any one or more processors, central processing unit (CPU) devices, finite state machines, computers, microcontrollers, digital signal processors, logic circuits, logic devices, user circuits, application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), chips, etc., or any combination thereof, capable of executing a computer program or a series of commands, instructions, or state transitions. In an embodiment, the microprocessor 225 is implemented as a processor group including, for example, a programmed microprocessor and a math or graphics coprocessor. The microprocessor 225 is selected, for example, from the following: Processors, e.g. Core i5 processor, Core i7 processor, microprocessor, Processors, etc.; Advanced MicroDevices Processors, e.g. processor; processor; processor; Processor; International Business Machines Processors, e.g. Microprocessor; MIPS Technologies, Inc. Reduced Instruction Set Computer (RISC) processors; ARM Holdings' RISC-based computer processors; processor; The embedded microcomputer 222 is not limited to using the microprocessor 225. In an embodiment, the embedded microcomputer 222 uses a controller or a microcontroller. The microprocessor 225 executes the modules of the embedded microcomputer 222, such as 228, 229, 230, 231, 232, 233, etc.

[0055] like Figure 3 As shown in the example, the embedded microcomputer 222 also includes a data bus 245 / input / output (I / O) controller 241 and a network interface 240. The data bus 245 allows communication between the modules (e.g., 224, 225, 226, 227, 234, 235, 240, 241, etc.) of the embedded microcomputer 222. The I / O controller 241 controls the input actions and output actions performed by the embedded microcomputer 222. The network interface 240 enables the display unit 216 to be connected to a network 301, such as a short-range network or a long-range network. In an embodiment, the network interface 240 is provided as an interface card on the embedded microcomputer 222, also referred to as a line card. The network interface 240 is, for example, an interface that implements Wi-Fi* of the Wi-Fi Alliance Corporation and / or a local area network interface. In an embodiment, the network interface 240 is, for example, one or more infrared interfaces, Apple Inc.'s Interface, Ethernet interface, frame relay interface, cable interface, digital subscriber line interface, token ring interface, peripheral controller interconnection interface, wide area network interface, interface using serial protocol, interface using parallel protocol, Ethernet communication interface, asynchronous transfer mode interface, high-speed serial interface, fiber distributed data interface, interface based on transmission control protocol / internet protocol, interface based on wireless communication technology (such as satellite technology, radio frequency technology, near field communication), etc.

[0056] The network 301 is, for example, the Internet, an intranet, a wired network, a wireless network, a network implementing Bluetooth Sig, Inc. communication network, achieving Wi-Fi Alliance Corporation's Network, Ultra-Wideband Communication Network (UWB), Wireless Universal Serial Bus (USB) Communication Network, Implementation Alliance Corporation The communication network may be a wireless communication network, a general packet radio service (GPRS) network, a mobile telecommunication network (e.g., a global system for mobile (GSM) communication network, a code division multiple access (CDMA) network, a third generation (3G) mobile communication network, a fourth generation (4G) mobile communication network, a fifth generation (5G) mobile communication network, a long term evolution (LTE) mobile communication network, a public telephone network, etc.), a local area network, a wide area network, an Internet connection network, an infrared communication network, etc., or a network formed by any combination of these networks. In an embodiment, the captured and communicated surgical site image can be accessed by a user by accessing the Internet, for example, through a wide spectrum of technologies and devices, such as a cellular phone, a tablet computing device, etc.

[0057] Embedded microcomputer 222 also includes multiple modules, such as a data communication module 228, a patient information association module 229, and a display module 230 stored in memory unit 227. Data communication module 228 receives patient information via tactile user interface 217 of display unit 216 and one or more user inputs via tactile user interface 217 and / or one or more input devices 302 (e.g., a foot switch, a portable wireless controller, etc.) for controlling the operation of ultra-high-definition (UHD) camera system 201. Data communication module 228 receives, in real time, captured and communicated surgical site images having resolutions up to 4K UHD from image sensor 220 of UHD camera system 201. In one embodiment, embedded microcomputer 222 also includes a storage module 231 for storing the received patient information in an internal database 239 and, in one embodiment, in a storage device 234 of embedded microcomputer 222, such as a hard disk drive, solid-state drive, or solid-state hybrid drive. In another embodiment, storage module 231 stores the captured and communicated surgical site images in storage device 234.

[0058] The patient information association module 229 associates the captured and communicated surgical site images with the received patient information in real time, for example by linking, integrating, or overlaying the received patient information with the captured and communicated surgical site images. In an embodiment, the patient information association module 229 organizes the captured and communicated surgical site images with the received patient information in a file system. The display module 230 displays the captured and communicated surgical site images in real time on the tactile user interface 217 of the display unit 216, with resolution up to 4K ultra-high definition (UHD), and associated with the received patient information.

[0059] In an embodiment, the storage module 231 of the embedded microcomputer 222 directly stores the captured and communicated surgical site images with the received patient information in real time in an external database 304 on an external system 303, such as a hospital database. The internal database 239 and the external database 304 refer to any storage area or medium that can be used to store data and files. The internal database 239 and the external database 304 can be, for example, any Structured Query Language (SQL) data storage, or a NoSQL data storage, such as SQL Server, MySQL ABL Limited Company Database, MongoDB, Inc. database, Neo Technology Corporation's Neo4j graph database, Apache Software Foundation's Cassandra database, Apache Software Foundation's In one embodiment, the internal database 239 and the external database 304 can also be located on a file system. In another embodiment, the internal database 239 can be remotely accessed by the embedded microcomputer 222 via the network 301. In another embodiment, the internal database 239 and / or the external database 304 are configured as cloud-based databases implemented in a cloud computing environment, wherein computing resources are delivered as a service over the network 301.

[0060] The captured and communicated surgical site images with received patient information for multiple patients are stored in separate files within each patient folder in the external database 304. The captured and communicated surgical site images with associated patient information are stored directly in the external database 304 of the external system 303 to prevent mishandling and manipulation of the captured and communicated surgical site images with associated patient information, thereby protecting the captured and communicated surgical site images with associated patient information in accordance with Health Insurance Portability and Accountability (HIPAA) guidelines. In an embodiment, the captured and communicated surgical site images with associated patient information are stored in a removable drive 218, such as a universal serial bus (USB) flash drive. Therefore, the storage module 231 of the embedded microcomputer 222 stores the captured and communicated images in the internal database 239, the storage device 234 of the embedded microcomputer 222, the removable drive 218, and / or the external database 304. In an embodiment, the embedded microcomputer 222 further includes an image recorder 233 stored in the memory unit 227 for recording, in real time, the captured and communicated surgical site images having a resolution of up to 4K ultra-high definition (UHD) and received patient information in a storage device 234 and / or a removable drive 218. In an embodiment, the data communication module 228 of the embedded microcomputer 222 receives one or more user inputs via the tactile user interface 217 and / or one or more input devices 302 for controlling the real-time recording of the captured and communicated surgical site images with associated patient information in the storage device 234 and / or the removable drive 218. In another embodiment, the storage module 231 of the embedded microcomputer 222 stores, in real time, the captured and communicated surgical site images with received patient information in a cloud computing environment over the network 301.

[0061] In an embodiment, the data communication module 228 of the embedded microcomputer 222 transmits the captured and communicated surgical site image having a resolution up to 4K ultra high definition (UIID) and having received patient information to a client application 306 deployed on a user device 305, such as a mobile application, in real time via a network 301, for allowing the captured and communicated surgical site image having received patient information to be viewed on the user device 305 in real time. The user device 305 communicates with the surgical visualization and recording system 200 via the network 301. The user device 305 is an electronic device, such as one or more personal computers, tablet computing devices, mobile computers, mobile phones, smart phones, portable computing devices, personal digital assistants, laptop computers, wearable computing devices (e.g., Google Inc.'s Google Assistant), or the like. Apple Inc.'s Apple Android by Google Inc. The embedded microcomputer 222 may also include a control module 232 stored in the memory unit 227. Upon receiving one or more user inputs via the tactile user interface 217 of the display unit 216 and / or one or more input devices 302, the control module 232 controls the capture, recording, and display of surgical site images having resolutions up to 4K ultra-high definition (UHD). In embodiments, upon receiving one or more user inputs via the tactile user interface 217 of the display unit 216 and / or one or more input devices 302, the control module 232 controls one or more camera parameters, such as white balance, brightness, sharpness, contrast, gamma, saturation, resolution, gain, exposure, and frame rate, of the UHD camera system 201. In an embodiment, the data communication module 228 , the patient information association module 229 , the display module 230 , the storage module 231 , the control module 232 , and the image recorder 233 constitute a surgical visualization and recording application of the embedded microcomputer 222 .

[0062] Computer applications and programs are used to operate the embedded microcomputer 222. The programs are loaded on the storage device 234 and in the memory unit 227. In an embodiment, the computer applications and programs are loaded directly into the memory unit 227 via the network 301. The computer applications and programs are executed by double-clicking a related icon displayed on the tactile user interface 217 of the display unit 216 using the input device 302 or one of the touch gestures on the tactile user interface 217.

[0063] The microprocessor 225 of the embedded microcomputer 222 executes an operating system 226 selected from, for example: operating system, Canonical Limited Operating system, simplified set up, Operating system, any version operating system, MacOS from Apple Inc., OS / 2, Vx from Wind River Systems, Inc. QNX, developed by QNX Software Systems Ltd. Palm Solaris operating system developed by Sun Microsystems, Inc., Google Inc. Operating system, Microsoft Corporation's Windows Operating system, BlackBerry Limited operating systems, Apple Inc.'s iOS operating system, Symbian from Symbian Foundation Limited TM Operating system, etc. The embedded microcomputer 222 uses an operating system 226 to perform various tasks. The operating system 226 manages and coordinates the activities and resource sharing of the embedded microcomputer 222. The operating system 226 also manages the security of the ultra-high-definition (UHD) camera system 201 and the display unit 216, the connection of peripheral devices to the UHD camera system 201 and the display unit 216, and network connections. The operating system 226 on the embedded microcomputer 222 uses the microprocessor 225 to execute various programs. The microprocessor 225 and the operating system 226 together define the computer platform for which application programs written in a high-level programming language are used.

[0064] The additional software components 235 of the embedded microcomputer 222 include the hardware abstraction layer 223, a system settings module 238, an internal database 239, a database manager 237, and a service layer 236, as described above. The system settings module 238 associates patient settings parameters. The internal database 239 stores surgical site images captured and communicated with received patient information in real time. Storing these surgical site images captured and communicated with received patient information in the internal database 239 enables the user to review these surgical site images captured and communicated with received patient information in real time on the display unit 216 during surgery. In one embodiment, surgical site images captured and communicated with received patient information for multiple patients are stored in the internal database 239 in different files within corresponding patient folders. The database manager 237 manages the patient information stored in the internal database 239. The database manager 237 manages the functions of the internal database 239, including, for example, the creation and maintenance of the internal database 239. The database manager 237 creates an internal database 239, backs up the internal database 239, restores the internal database 239, clones the internal database 239, renames the internal database 239, and so on. In an embodiment, the database manager 237 remotely discovers and manages an external database 304 in an external system 303 via a network 301. The database manager 237 connects to the external database 304 and displays information from a directory that is part of the external database 304. The database manager 237 activates features and functions provided for managing remote databases outside the user interface. The business layer 236 implements the business logic that determines how data is created, stored, and modified in the surgical visualization and recording system 200. The business layer 236 includes business rules and workflows. Business rules describe specific processing procedures, while workflows include process steps, required input and output information, and the tools required for each step of the specific processing procedure. The business layer 236 determines the sequence of operations associated with the data in the internal database 239 to execute the business rules.

[0065] The microprocessor 225 retrieves instructions determined by the data communication module 228, the patient information association module 229, the display module 230, the storage module 231, the control module 232, the image recorder 233, and the additional software components 235 to perform the corresponding functions described above. The microprocessor 225 retrieves instructions from the memory unit 227 to execute the modules of the embedded microcomputer 222, such as 228, 229, 230, 231, 232, 233, etc. The program counter determines the location of the instruction in the memory unit 227. The program counter stores a number that identifies the current location in the program of each module (e.g., 228, 229, 230, 231, 232, 233, etc.) of the embedded microcomputer 222. The instructions retrieved from the memory unit 227 by the microprocessor 225 are decoded after processing. The instructions are stored in an instruction register in the microprocessor 225. After processing and decoding, the microprocessor 225 executes the instructions, thereby performing one or more processes determined by those instructions.

[0066] During execution, the instruction stored in the instruction register is examined to determine the operation to be performed. The microprocessor 225 then performs the specified operation. This operation includes arithmetic and logical operations. The operating system 226 executes multiple routines to perform the various tasks required to execute the modules (e.g., 228, 229, 230, 231, 232, 233, etc.) of the embedded microcomputer 222. The tasks performed by the operating system 226 include, for example, allocating memory to the modules (e.g., 228, 229, 230, 231, 232, 233, etc.) of the embedded microcomputer 222 and data used by the embedded microcomputer 222, moving data between the memory unit 227 and the disk unit, and handling input / output operations. The operating system 226 performs the tasks required by the operation, and after performing the task, the operating system 226 passes execution control back to the microprocessor 225. The microprocessor 225 continues execution to obtain one or more outputs. The execution output of the modules (eg, 228 , 229 , 230 , 231 , 232 , 233 , etc.) of the embedded microcomputer 222 is displayed to the user on the display unit 216 , and in an embodiment, on the user device 305 .

[0067] In the surgical visualization and recording system (SVRS) 200 disclosed in the present invention, an ultra-high definition (UHD) camera system 201 and a surgical observation device ( Figure 3The display unit 216 interfaces with the user device 305 and the external system 303 to capture, record, display, and communicate images of the surgical site with a resolution of up to 4K UHD and associated with patient information in real time during surgery. The display unit 216, which includes a tactile user interface 217 and an embedded microcomputer 222, is in operative communication with the UHD camera system 201 of the SVRS 200. The display unit 216 is a capacitive touch screen that receives one or more user inputs for controlling the operation of the UHD camera system 201 and for displaying, capturing, and communicating images of the surgical site with a resolution of up to 4K UHD and associated with received patient information. The display unit 216 also includes universal serial bus (USB) interfaces 242, 243, and 244. The USB interface 242 is used to connect the display unit 216 to the UHD camera system 201 via a USB cable 212. The USB interface 243 is used to connect the display unit 216 to a removable drive 218, such as a USB flash drive, a storage hard drive, or the like, for recording captured and communicated surgical site images with associated patient information and for accessing pre-recorded surgical site images with associated patient information. The embedded microcomputer 222 stores the captured and communicated surgical site images associated with the patient information in real time in the removable drive 218. The display unit 216 also displays the pre-recorded surgical site images associated with the patient information and stored in the removable drive 218 on the tactile user interface 217. The USB interface 244 is used to connect one or more input devices 302 (e.g., a foot switch) to the display unit 216 to allow a user to control camera parameters of the UHD camera system 201 and to control the capture, recording, display, and communication of surgical site images.

[0068] The non-transitory computer-readable storage medium disclosed in the present invention stores computer program code, which includes instructions executable by at least one processor (e.g., microprocessor 225) for capturing, recording, and displaying surgical site images with a resolution of up to 4K ultra-high definition (UHD) and associated with patient information in real time during surgery. The computer program code includes: first computer program code for receiving patient information through the tactile user interface 217 of the display unit 216, and receiving one or more user inputs through the tactile user interface 217 and / or one or more input devices 302 (operably connected to the display unit 216), the user inputs being used to control the operation of the UHD camera system 201; second computer program code for receiving, in real time, a surgical site image having a resolution of up to 4K UHD captured and communicated by the image sensor 220 of the UHD camera system 201 when receiving one or more user inputs through the tactile user interface 217 of the display unit 216 and / or through the one or more input devices 302; third computer program code for associating the captured and communicated surgical site image with the received patient information in real time; and fourth computer program code for displaying, in real time, the captured and communicated surgical site image having a resolution of up to 4K UHD and associated with the received patient information on the tactile user interface 217.

[0069] In an embodiment, the computer program code further includes fifth computer program code for recording the captured and communicated surgical site images with up to 4K ultra-high definition (UHD) resolution and received patient information in real-time on a storage device (e.g., removable drive 218). In another embodiment, the computer program code further includes sixth computer program code for securely storing the captured and communicated surgical site images with received patient information directly on external system 303 in real-time. In another embodiment, the computer program code further includes seventh computer program code for storing the captured and communicated surgical site images with received patient information in real-time on network 301 in a cloud computing environment. In another embodiment, the computer program code further includes eighth computer program code for controlling the capture, recording, and display of the captured and communicated surgical site images with up to 4K UHD resolution, and for controlling the capture and display of pre-recorded surgical site images with up to 4K UHD resolution upon receiving one or more user inputs via tactile user interface 217 of display unit 216 and / or one or more input devices 302.

[0070] In another embodiment, the computer program code further includes ninth computer program code for transmitting the captured and communicated surgical site image having a resolution of up to 4K ultra-high definition (UHD) and the received patient information to a client application 306 on a user device 305 in real time via the network 301, for allowing the captured and communicated surgical site image with the received patient information to be viewed in real time on the user device 305. In another embodiment, the computer program code further includes tenth computer program code for organizing the captured and communicated surgical site image and the received patient information in a file system. In another embodiment, the computer program code further includes eleventh computer program code for controlling one or more camera parameters of the UHD camera system 201 upon receiving one or more user inputs via the tactile user interface 217 of the display unit 216 and / or the one or more input devices 302.

[0071] The computer program code also includes one or more additional computer program codes for performing additional steps that may be necessary and desirable for capturing, communicating, and displaying surgical site images having resolutions up to 4K Ultra High Definition (UHD) and associated with patient information in real time during a surgical procedure. In an embodiment, a single computer program code comprising computer-executable instructions performs one or more steps of the disclosed method for capturing, communicating, and displaying surgical site images having resolutions up to 4K UHD and associated with patient information in real time during a surgical procedure. The computer program code comprising the computer-executable instructions is embodied on a non-transitory computer-readable storage medium. The microprocessor 225 of the embedded microcomputer 222 retrieves these computer-executable instructions and executes them. When executed by the microprocessor 225, the computer-executable instructions cause the microprocessor 225 to perform the method steps for capturing, communicating, and displaying surgical site images having resolutions up to 4K UHD and associated with the patient in real time during a surgical procedure.

[0072] Figure 4The example shows a surgical visualization and recording system (SVRS) 200 for capturing, communicating, and displaying images of a surgical site 401 with up to 4K ultra-high-definition (UHD) resolution and associated patient information in real time during a laparoscopic procedure. The SVRS 200 facilitates laparoscopy for surgeons. The surgeon connects the ultra-high-definition (UHD) camera system 201 of the SVRS 200 to the proximal end 402a of a surgical viewing device (e.g., a laparoscope 402). The laparoscope 402 is an elongated, thin, fiber-optic rigid instrument with a high-intensity light and a UHD resolution camera located at the proximal end 402a of the laparoscope 402. The surgeon also uses a USB interface connector 215 to connect a universal serial bus (USB) cable 212 operatively connected to the UHD camera system 201 to a display unit 216 of the SVRS 200. The surgeon makes one or more small incisions, e.g., approximately 0.5 cm to approximately 1.5 cm, in the patient's skin. The surgeon inserts trocars 403 and 404 (having diameters of, for example, approximately 5 millimeters (mm) and approximately 10 mm, respectively) through an incision into the patient's abdominal wall to access surgical site 401, such as the peritoneal cavity. Trocars 403 and 404 are medical devices that each include an obturator, a hollow tube or cannula, and a seal to block the incision. Trocars 403 and 404 serve as access points for inserting instruments such as graspers 405, scissors, staples, laparoscope 402, and the like. The surgeon connects an insufflator 406 to trocar 403 via an insufflator tube 407 via an insufflator adapter 408. Insufflator 406 provides gas, such as carbon dioxide, through the insufflator tube 407 to inflate surgical site 401 for laparoscopy. The surgeon inserts laparoscope 402 through trocar 403. The surgeon connects an optical cable 410 extending from a light source 409 to the laparoscope 402 via an optical adapter 411. The light source 409 provides light to the laparoscope 402 via the optical cable 410. The light source 409 is, for example, a light emitting diode (LED). The cable 410 is, for example, an optical fiber cable, a liquid crystal gel cable, or the like.

[0073] The light from the light source 409 in the optical cable 410 passes through the optical cable 410 by reflecting from the inner wall of the optical cable 410 and illuminates the surgical site 401. The surgical site 401 reflects the light focused on the surgical site 401. An optical lens (not shown) positioned at the distal end 402b of the laparoscope 402 receives the light reflected from the surgical site 401. The optical lens on the laparoscope 402 focuses the reflected light from the surgical site 401 onto the optical cable in the laparoscope 402. The reflected light from the surgical site 401 passes through the optical cable in the laparoscope 402 and reaches the laparoscope 402. Figure 2-3 The optical component 203 of the ultra-high definition (UHD) camera system 201 is shown as an example in FIG. The reflected light from the surgical site 401 on the optical component 203 is directed to Figure 2-3 The image sensor 220 of the UHD camera system 201 is shown as an example in FIG. The image sensor 220 receives the reflected light and captures an image of the surgical site 401. The image sensor 220 transmits information constituting the captured image to the embedded microcomputer 222 of the display unit 216, as shown in FIG. Figure 1-3 The image sensor 220 communicates captured images with up to 4K UHD resolution to an embedded microcomputer 222 of a display unit 216 via a universal serial bus (USB) cable 212 and a USB interface connector 215. The surgeon inserts a grasper 405 through a trocar 404. The grasper 405 is a device for grasping and holding tissue in the surgical site 401.

[0074] The surgeon activates the surgical visualization and recording system (SVRS) 200. The embedded microcomputer 222 of the display unit 216 causes the start screen to appear on the tactile user interface 217 of the display unit 216 and determines whether the ultra-high-definition (UHD) camera system 201 and the removable drive 218 are connected to the display unit 216. The embedded microcomputer 222 causes the run screen to appear on the tactile user interface 217 of the display unit 216 and, depending on whether the UHD camera system 201 and / or the removable drive 218 are connected to the display unit 216, activates one or more buttons on the run screen. The surgeon clicks a button corresponding to camera settings on the tactile user interface 217 to set camera parameters. The embedded microcomputer 222 causes the camera settings screen to appear on the tactile user interface 217, allowing the surgeon to set the camera parameters. The surgeon exits the camera settings screen and returns to the run screen. The surgeon clicks a button corresponding to patient information on the run screen. The embedded microcomputer 222 causes the patient information screen to appear on the tactile user interface 217. The surgeon enters patient information on the tactile user interface 217, views the patient's medical history, exits the patient information screen, and returns to the run screen.

[0075] The surgeon then clicks a button on the tactile user interface 217 corresponding to capturing and recording a single image, or a button for capturing and recording multiple images to be displayed at a determined rate. The embedded microcomputer 222 causes the video recording and image capture screen to be presented on the tactile user interface 217 of the display unit 216. The image sensor 220 of the ultra-high-definition (UHD) camera system 201 captures an image of the surgical site 401 with a resolution of up to 4K UHD and communicates the captured image of the surgical site 401 to the embedded microcomputer 222 of the display unit 216 in real time. The embedded microcomputer 222 associates the captured and communicated image of the surgical site 401 with patient information in real time. In an embodiment, the embedded microcomputer 222 records the captured and communicated image of the surgical site 401 with a resolution of up to 4K UHD and with patient information in real time on the removable drive 218. The display unit 216 displays the captured and communicated image of the surgical site 401 with a resolution of up to 4K UHD and associated with patient information on the tactile user interface 217 in real time. The surgeon is able to visualize the captured and communicated surgical site 401 images in real time and perform laparoscopic examination easily and fully focused.

[0076] A light source 409 connected to the laparoscope 402 assists the surgeon in performing laparoscopic examinations by illuminating the surgical site 401. After completing the laparoscopic examination, the surgeon can exit the video recording and image capture screen and return to the run screen on the tactile user interface 217 of the display unit 216. When the surgeon wishes to review the images of the surgical site 401 recorded, captured, and communicated to the removable drive 218, the surgeon clicks a button on the tactile user interface 217 of the display unit 216 for viewing pre-recorded images. The embedded microcomputer 222 causes the media viewer screen to appear on the tactile user interface 217, allowing the surgeon to view the captured and communicated images. The surgeon can then exit the media viewer screen and return to the run screen on the tactile user interface 217. The surgeon can then shut down the surgical visualization and recording system 200 by clicking the power off button on the tactile user interface 217. The embedded microcomputer 222 closes the run screen and initiates the shutdown routine. The surgeon can then disconnect the removable drive 218 with the directly recorded, captured, and communicated surgical site 401 images and transfer the recorded, captured, and communicated surgical site 401 images to a secure hospital system to avoid mishandling and manipulation of the patient information and recorded surgical site 401 images by unauthorized personnel and to maintain the confidentiality of the patient information in accordance with the Health Insurance Portability and Accountability Act (HIPAA).

[0077] In an embodiment, the foot switch 302a is connected to the display unit 216 via a universal serial bus (USB) interface connector 219. The surgeon can use the foot switch 302a to control the capture, recording, and display of the captured and communicated images of the surgical site 401 and / or the display of pre-recorded images of the surgical site 401 on the display unit 216. In another embodiment, the surgeon's technician can use a portable wireless controller 302b that wirelessly communicates with the display unit 216 to control the capture, recording, and display of the captured and communicated images of the surgical site 401 and / or the display of pre-recorded images of the surgical site 401 on the display unit 216.

[0078] Figure 5 The example shows a flow chart including Figure 3 The embedded microcomputer 222 of the display unit 216 of the surgical visualization and recording system (SVRS) 200 shown in FIG. Figure 2 The steps are performed based on the user input received on the start screen presented on the tactile user interface 217 of the display unit 216 shown in the example. The start screen includes a power button and a run screen button. The embedded microcomputer 222 determines Figure 2-3 501. The example shown in FIG. 502 shows whether the ultra-high-definition (UHD) camera system 201 and the removable drive 218 are connected to the display unit 216 via the embedded microcomputer 222. When the UHD camera system 201 and the removable drive 218 are connected to the display unit 216 via the embedded microcomputer 222, the embedded microcomputer 222 allows a user, such as a surgeon, to perform various activities on the run screen 502, such as capturing, recording, storing, and displaying surgical site images in real time during surgery, viewing surgical site images pre-recorded in the removable drive 218, and the like. The embedded microcomputer 222 waits for approximately 10 seconds 503 and proceeds to the run screen 504. The embedded microcomputer 222 also determines whether the UHD camera system 201 is connected to the display unit 216 and whether the removable drive 218 is not connected to the display unit 216 via the embedded microcomputer 222 505. When the UHD camera system 201 is connected to the display unit 216 via the embedded microcomputer 222 and the removable drive 218 is not connected to the display unit 216, the embedded microcomputer 222 allows the user to view the real-time screen 506 presented on the tactile user interface 217, thereby displaying the captured and communicated surgical site images in real time without recording and storing the captured and communicated surgical site images and patient information.

[0079] The embedded microcomputer 222 also determines 508 whether the removable drive 218 is connected to the display unit 216 via the embedded microcomputer 222 and whether the ultra-high-definition (UHD) camera system 201 is not connected to the display unit 216. When the removable drive 218 is connected to the display unit 216 via the embedded microcomputer 222 and the UHD camera system 201 is not connected to the display unit 216, the embedded microcomputer 222 allows the user to view pre-recorded images 509, such as pre-recorded still images and videos stored in the removable drive 218 on the display unit 216, without providing access to the real-time screen on the tactile user interface 217 of the display unit 216 (for viewing the captured and communicated surgical site images in real time). The embedded microcomputer 222 determines 507 whether the user clicks the run screen button on the tactile user interface 217. When the user clicks the run screen button, the embedded microcomputer 222 advances to the run screen 504. The embedded microcomputer 222 also determines whether the user clicks the power button 510 of the start screen. When the user clicks the power button, the embedded microcomputer 222 shuts down 511 the surgical visualization and recording system 200 by initiating a shutdown routine.

[0080] Figures 6A-6B The example shows a flow chart including Figure 3 The embedded microcomputer 222 of the display unit 216 shown in the example is based on Figure 2 The embedded microcomputer 222 creates and displays default patient information 601, such as a patient identifier, a patient name, etc., on the operating screen and prompts a user, such as a surgeon, to enter user information, such as the surgeon's name, the type of surgery, and the description of the surgery. The embedded microcomputer 222 determines that Figure 26. The example shown in FIG. 602 shows whether the removable drive 218 is connected to the display unit 216 via the embedded microcomputer 222. When the removable drive 218 is connected to the display unit 216 via the embedded microcomputer 222, the embedded microcomputer 222 activates the image view button and the video view button 603 on the operation screen. The embedded microcomputer 222 determines whether the image view button 618 is clicked. When the image view button is clicked, the embedded microcomputer 222 presents the image view window 619 on the tactile user interface 217 of the display unit 216. The embedded microcomputer 222 determines whether the video view button 620 is clicked. When the video view button is clicked, the embedded microcomputer 222 presents the video view window 621 on the tactile user interface 217. When the removable drive 218 is not connected to the display unit 216 via the embedded microcomputer 222, the embedded microcomputer 222 deactivates the image view button and the video view button 604 on the operation screen.

[0081] The embedded microcomputer 222 determines Figure 2-3 6. The embedded microcomputer 222 checks whether the UHD camera system 201, shown as an example in FIG, is connected to the display unit 216 605. When the UHD camera system 201 is connected to the display unit 216, the embedded microcomputer 222 activates buttons for video recording, image capture, patient information, and camera settings 606. The embedded microcomputer 222 initializes 607 the UHD camera system 201 using default camera parameters. Figure 3The image sensor 220 of the UHD camera system 201 shown in the example captures a real-time image 608 of the surgical site with resolutions up to 4K UHD and communicates the real-time image to the embedded microcomputer 222 of the display unit 216. The display unit 216 displays the real-time image on the tactile user interface 217. The embedded microcomputer 222 determines whether a video record button 610 is clicked on the operation screen. When the video record button is clicked on the operation screen, the embedded microcomputer 222 enters a record mode 611 for recording real-time images. The embedded microcomputer 222 determines whether an image capture button 612 is clicked on the operation screen. When the image capture button is clicked on the operation screen, the embedded microcomputer 222 enters a capture mode 613 for capturing an image of the surgical site. The embedded microcomputer 222 determines whether a patient information button 614 is clicked on the operation screen. When the patient information button is clicked on the operation screen, the embedded microcomputer 222 presents a patient information screen 615 on the tactile user interface 217 of the display unit 216. The embedded microcomputer 222 determines whether a camera setting button 616 is clicked on the run screen. When the camera setting button is clicked on the run screen, the embedded microcomputer 222 presents the camera setting screen 617 on the tactile user interface 217. When the UHD camera system 201 is not connected to the display unit 216, the embedded microcomputer 222 disables the buttons 609 for video recording, image capture, patient information, and camera settings. The embedded microcomputer 222 determines whether a power button 622 is clicked on the run screen. When the power button is clicked on the run screen, the embedded microcomputer 222 shuts down the surgical visualization and recording system 200 by initiating 623 a shutdown routine.

[0082] Figures 7A-7B The example shows a flow chart including Figure 5 The embedded microcomputer 222 of the display unit 216 shown in the example is based on Figure 2The example shows steps performed based on user input received on a camera settings screen presented on the tactile user interface 217 of the display unit 216. The camera settings screen includes, for example, an Exit button, a Hide button, a Save button, a Back button, and an Exit to Desktop button. The embedded microcomputer 222 provides one or more camera settings profiles with predetermined values, wherein the user cannot change typical camera parameters. Camera parameters include, for example, brightness, sharpness, contrast, gamma, saturation, auto white balance, resolution, gain, exposure, frame rate, etc. The embedded microcomputer 222 sets a default standard camera settings profile. The embedded microcomputer 222 prompts the user to select a camera settings profile 701. The embedded microcomputer 222 prompts the user to select a custom profile mode and enter a name for the custom profile 702. The embedded microcomputer 222 then prompts the user to adjust the values ​​of basic camera parameters, such as brightness, contrast, sharpness, auto balance, gain, exposure, frame rate, etc. 703. The embedded microcomputer 222 sets a camera flip 704, which provides the option of flipping the image.

[0083] The embedded microcomputer 222 determines whether the Exit button 705 is clicked on the camera setting screen. When the Exit button is clicked on the camera setting screen, the embedded microcomputer 222 determines whether the camera parameters have been modified 706. If the camera parameters have not been modified, the embedded microcomputer 222 exits the camera setting screen 707. If the camera parameters have been modified, the embedded microcomputer 222 prompts the user to save the modified camera parameters 708. The embedded microcomputer 222 provides a Save & Exit button and an Exit Without Saving button on the camera setting screen. The embedded microcomputer 222 determines 709 whether the Save & Exit button is clicked on the camera setting screen. When the Save & Exit button is clicked on the camera setting screen, the embedded microcomputer 222 saves the modified camera parameters in the selected camera setting profile and exits the camera setting screen 710. The embedded microcomputer 222 determines whether the Exit Without Saving button 711 is clicked on the camera setting screen. When the Exit Without Saving button is clicked on the camera setting screen, the embedded microcomputer 222 exits the camera setting screen 712 without saving the modified camera parameters.

[0084] The embedded microcomputer 222 also determines whether the hidden button 713 is clicked on the camera setting screen. When the hidden button is clicked on the camera setting screen, the embedded microcomputer 222 prompts the user to enter a password or passphrase 714. The embedded microcomputer 222 receives the entered password and compares the received password with the password on the camera setting screen. Figure 3The embedded microcomputer 222 compares the received password with the password stored in the internal database 239 and / or storage device 234, as shown in the example in FIG. 715. When the embedded microcomputer 222 determines that there is a match between the received password and the password stored in the internal database 239 and / or storage device 234, the embedded microcomputer 222 prompts the user to adjust additional camera parameters and receives the adjusted additional camera parameters 716. The additional parameters include, for example, saturation, gamma, calibration, white balance, automatic or manual exposure settings, image saving and video settings for resolution and format type, etc. When the embedded microcomputer 222 determines that the passwords do not match, the embedded microcomputer 222 executes steps 701, 705, and 713 disclosed above.

[0085] The embedded microcomputer 222 prompts the user to adjust the image saving settings for resolution and format type 717. The embedded microcomputer 222 prompts the user to adjust the video saving settings for resolution and format type 718. The embedded microcomputer 222 receives the adjusted image saving settings and video saving settings and stores them in the internal database 239 and / or the storage device 234. The embedded microcomputer 222 determines whether the Save button is clicked on the camera settings screen 719. When the Save button is clicked on the camera settings screen, the embedded microcomputer 222 saves the camera parameters in the selected camera settings file 720. The embedded microcomputer 222 then exits the additional parameter mode. The embedded microcomputer 222 determines whether the Back button is clicked on the camera settings screen 721. When the Back button is clicked on the camera settings screen, the embedded microcomputer 222 prompts the user to return to the basic camera parameters 722. The embedded microcomputer 222 determines whether the Exit Desktop button is clicked on the camera settings screen 723. When the Exit Desktop button is clicked on the camera settings screen, the embedded microcomputer 222 prompts the user to enter a password 724. The embedded microcomputer 222 receives the input password and compares 725 the received password with the passwords stored in the internal database 239 and / or the storage device 234. When the embedded microcomputer 222 determines that there is a match between the received password and the stored password, the embedded microcomputer 222 exits the camera setting screen 726. When the embedded microcomputer 222 determines that the passwords do not match, the embedded microcomputer 222 performs steps 701, 705, and 713 disclosed above.

[0086] Figures 8A-8B The example shows Figure 2 A screenshot of the tactile user interface 217 of the display unit 216 is shown as an example, showing a camera settings screen for modifying the camera settings in the Figure 2FIG2 shows an example of camera parameters of an ultra-high-definition (UHD) camera system 201 of a surgical visualization and recording system (SVRS) 200. The tactile user interface 217 displays buttons such as a power off button 801, a camera setting button 802, a video record button 803, and an image capture button 804. When a user clicks the camera setting button 802, the tactile user interface 217 displays the camera parameters of the ultra-high-definition (UHD) camera system 201 of the surgical visualization and recording system (SVRS) 200. Figure 8A The camera setting screen shown in the example is used to modify the basic camera parameters of the UHD camera system 201. The embedded microcomputer 222 prompts the user to select a camera setting profile and enter the name of the camera setting profile to be selected, as shown in Figures 7A-7B The camera setting screen displays a pull-down menu for providing the user with a selection of camera setting profiles. The user selects a camera setting profile from the pull-down menu. When the user selects a custom profile, the embedded microcomputer 222 prompts the user to enter the name of the custom profile. The user enters the name of the custom profile in a text box provided on the camera setting screen for receiving the name of the custom profile. The camera setting screen displays a value adjustment scale and a value adjustment box for adjusting basic camera parameters. The user adjusts the value of the basic camera parameter, such as brightness, contrast, automatic white balance, and sharpness, using the value adjustment scale or the value adjustment box corresponding to each basic camera parameter. As Figure 8A 806 and Exit button 807. The user can use the Save button 806 to save the selected camera setting file with the name of the camera setting file and the values ​​of the basic camera parameters, as shown in FIG. Figures 7A-7B The user can use the exit button 807 to exit the camera setting screen, as shown in Figures 7A-7B The detailed description is disclosed in .

[0087] When the user clicks the camera settings button 802, the tactile user interface 217 is displayed Figure 8B The camera setting screen shown in the example is used to adjust the additional camera parameters of the ultra high definition (UHD) camera system 201. The camera setting screen displays a value adjustment scale and a value adjustment box for adjusting the additional camera parameters. The embedded microcomputer 222 prompts the user to adjust the additional camera parameters, such as Figures 7A-7BThe user adjusts the value of the additional camera parameter, such as saturation, pan, tilt, zoom, grayscale, etc., using the value adjustment scale or value adjustment box corresponding to each additional camera parameter. The camera setting screen displays a drop-down menu for providing the user with a selection list to select additional camera parameter values ​​for image capture (such as color space or compression, output size, image format, etc.) and additional camera parameter values ​​for video capture (such as frame rate, color space or compression, etc.). For image capture, the user can select, for example, YUYV (YUYV4:2:2) for color space or compression, select 1920X1080 as output size, and select Joint Photographic Experts Group (jpeg) file extension (such as ".jpg") as image format from the drop-down menu. For video capture, the user can also select, for example, 30 frames per second (fps) as frame rate and YUYV (YUYV4:2:2) as color space or compression from the drop-down menu. The tactile user interface 217 displays a real-time image 805 near the camera setting screen, as shown in FIG. Figures 8A-8B 805 , and allows the user to modify basic and additional camera parameters while viewing a live image 805. When the live image 805 is displayed on the tactile user interface 217 with a resolution up to 4K UHD, the user can click the image capture button 804 to capture an image of the surgical site being streamed, or click the video record button 803 to record a video of the surgical site being streamed. The user can click the power off button 801 to power off the surgical visualization and recording system 200.

[0088] Figures 9A-9B The example shows a flow chart including Figure 3 The embedded microcomputer 222 of the display unit 216 shown in the example is based on Figure 2The steps are performed based on user input received on the patient information screen presented on the tactile user interface 217 of the display unit 216, as shown in the example. The patient information screen includes, for example, an Exit button, a Save and Exit button, a Discard Changes and Exit button, a Complete Surgery button, and a Display Patient Information checkbox. The embedded microcomputer 222 determines whether patient information has been previously entered 901. If patient information has been previously entered, the embedded microcomputer 222 displays the previously stored patient information 902 on the patient information screen. The embedded microcomputer 222 prompts the user to enter the patient's name 903. The embedded microcomputer 222 receives the entered patient name and determines the availability of a patient identifier 915. If the patient identifier is not available, the embedded microcomputer 222 prompts the user to enter a patient identifier 916 and proceeds to step 918. If the patient identifier is available, the embedded microcomputer 222 does not allow the user to enter a patient identifier 917. The embedded microcomputer 222 prompts the user to enter the name of the surgeon performing the surgery 918. The embedded microcomputer 222 prompts the user to enter the type of surgery 919. The embedded microcomputer 222 prompts the user to enter surgical details 920. The embedded microcomputer 222 determines whether the Display Patient Information checkbox 921 is checked on the patient information screen. When the Display Patient Information checkbox is checked on the patient information screen, the embedded microcomputer 222 displays the patient information 923 on the run screen. When the Display Patient Information checkbox is not checked on the patient information screen, the embedded microcomputer 222 does not display the patient information 922 on the run screen. If no patient information has been previously entered, the embedded microcomputer 222 displays default patient information 904 and prompts the user to enter the patient's name 903 and continue with steps 915 to 923 described above.

[0089] The embedded microcomputer 222 determines whether the Exit button 905 is clicked on the patient information screen. When the Exit button is clicked on the patient information screen, the embedded microcomputer 222 determines whether the patient information has been modified 906. When the patient information has not been modified, the embedded microcomputer 222 exits to the Run screen 907. When the patient information has been modified, the embedded microcomputer 222 prompts the user to save the modified patient information 908. The embedded microcomputer 222 determines whether the Save and Exit button 909 is clicked on the patient information screen. When the Save and Exit button is clicked on the patient information screen, the embedded microcomputer 222 saves the modified patient information and exits to the Run screen 910. The embedded microcomputer 222 determines whether the Exit Without Saving button 911 is clicked on the patient information screen. When the Exit Without Saving button is clicked on the patient information screen, the embedded microcomputer 222 discards the modified patient information and exits to the Run screen 912. The embedded microcomputer 222 determines whether the Complete Surgery button 913 is clicked on the patient information screen. When the Complete Procedure button is clicked on the patient information screen, the embedded microcomputer 222 clears the patient information and loads the default patient information 914 .

[0090] Figure 10 The example shows Figure 2 , a screen shot of the tactile user interface 217 of the display unit 216 is shown by way of example in FIG, showing a patient information screen for entering patient information to be associated with an image of a surgical site. The tactile user interface 217 displays buttons such as a power off button 801, a camera setup button 802, a video record button 803, and an image capture button 804. The patient information screen displays a text box for receiving patient information including, for example, a patient identifier (ID), the patient's name, the surgeon's name, and detailed instructions for the procedure, and also displays a drop-down menu for providing options for selecting a type of procedure. Figure 3 The embedded microcomputer 222 of the display unit 216 shown in the example prompts the user to enter patient information, such as Figures 9A-9B The user enters the patient ID, patient name, surgeon name, and surgical details in the corresponding text boxes and selects the type of surgery from the selection list provided in the corresponding drop-down menu. The patient information screen displays a Save button 1001, a Complete Surgery button 1002, and an Exit button 1003, as shown in FIG. Figure 10 The example in the example shows that it is used to execute Figures 9A-9B The tactile user interface 217 displays a real-time image 1004 near the patient information screen, such as Figure 10. When the real-time image 1004 is displayed on the tactile user interface 217 with a resolution up to 4K UHD, the user can click the image capture button 804 to capture the image of the surgical site being streamed, or click the video record button 803 to record the video of the surgical site being streamed. In an embodiment, the user is able to enter patient information while viewing the real-time image 1004. The embedded microcomputer 222 overlays the patient information on the real-time image 1004 for visualization by the user. The user can view the patient information along with the real-time image 1004 on the tactile user interface 217 while the procedure is being performed. The user can click the power off button 801 to turn off the power supply. Figure 2-3 The power supply of the surgical visualization and recording system 200 is shown as an example.

[0091] Figures 11A-11B The example shows a flow chart including Figure 3 The embedded microcomputer 222 of the display unit 216 shown in the example is based on Figure 2 The example shows steps performed in response to user input received on a video recording and image capture screen presented on a tactile user interface 217 of a display unit 216. The video recording and image capture screen includes, for example, an image save button, a camera save button, an image capture button, a video recording button, a pause button, a resume button, and a stop button. The user must pre-select a patient identifier for the embedded microcomputer 222 to present the video recording and image capture screen on the display unit 216. The embedded microcomputer 222 determines whether the image save button 1101 is clicked on the video recording and image capture screen. When the image save button is clicked on the video recording and image capture screen, the embedded microcomputer 222 activates the image capture button 1102 on the video recording and image capture screen. The embedded microcomputer 222 determines whether the image capture button is clicked and determines 1103 on the video recording and image capture screen. Figure 3 The image sensor 220 of the ultra high definition (UHD) camera system 201 shown in the example in FIG captures an image. When an image is captured, the embedded microcomputer 222 stores the captured image in Figure 3 The current patient folder 1104 in the storage device 234 and / or removable drive 218 is shown as an example in FIG.

[0092] The embedded microcomputer 222 determines whether a camera save button 1105 is clicked on the video recording and image capture screen. When the camera save button is clicked on the video recording and image capture screen, the embedded microcomputer 222 activates a video record button 1106. The embedded microcomputer 222 determines whether a video record button 1107 is clicked on the video recording and image capture screen. When the video record button is clicked on the video recording and image capture screen, the embedded microcomputer 222 activates buttons 1108 for video recording, pause, resume, and stop on the video recording and image capture screen. The embedded microcomputer 222 displays the video recording time 1109 on the video recording and image capture screen. The embedded microcomputer 222 determines whether a pause button 1110 is clicked on the video recording and image capture screen. When the pause button is clicked on the video recording and image capture screen, the embedded microcomputer 222 pauses video recording 1111. The embedded microcomputer 222 determines whether a resume button 1112 is clicked on the video recording and image capture screen. When the resume button is clicked on the video recording and image capturing screen, the embedded microcomputer 222 resumes the video recording 1113. The embedded microcomputer 222 determines whether the stop button is clicked on the video recording and image capturing screen 1114. When the stop button is clicked on the video recording and image capturing screen, the embedded microcomputer 222 stops recording the video 1115. The embedded microcomputer 222 saves the recorded video in the selected patient folder 1116 in the storage device 234 and / or the removable drive 218.

[0093] Figure 12 The example shows a flow chart including Figure 3 The embedded microcomputer 222 of the display unit 216 shown in the example is based on Figure 2 The example shows steps performed based on user input received from the media viewer screen presented on the tactile user interface 217 of the display unit 216. The embedded microcomputer 222 prompts the user to click on Figures 6A-6B The embedded microcomputer 222 displays an image viewing button or a video viewing button 1201 disclosed in the detailed description of FIG. When the image viewing button or the video viewing button is clicked, the embedded microcomputer 222 determines whether a default patient is selected 1202. When the default patient is selected, the embedded microcomputer 222 displays a list of available patients 1203 on the media viewer screen. The embedded microcomputer 222 prompts the user to select a patient 1204 for viewing corresponding images or videos. The embedded microcomputer 222 receives the selection of a patient for viewing images or videos. The embedded microcomputer 222 displays patient information 1205 based on the patient selection received on the media viewer screen. The embedded microcomputer 222 does not allow the user to view images or videos that do not correspond to the selected patient.

[0094] It will be readily apparent that in various embodiments, the various methods, algorithms, and computer programs disclosed herein are implemented on a non-transitory computer-readable storage medium suitable for programming a computing device. The non-transitory computer-readable storage medium participates in providing data, such as instructions, to be read by a computer, processor, or similar device. In various embodiments, "non-transitory computer-readable storage medium" also refers to a single or multiple media, such as a centralized database, a distributed database, and / or associated caches and servers storing one or more sets of instructions that are read by a computer, processor, or similar device. "Non-transitory computer-readable storage medium" also refers to any medium capable of storing or encoding a set of instructions for execution by a computer, processor, or similar device, and causing the computer, processor, or similar device to perform any one or more of the methods disclosed herein. Common forms of non-transitory computer-readable storage media include, for example, floppy disks, diskettes, hard disks, magnetic tapes, laser discs, Blu-ray Disc Association's Any magnetic medium, compact disc-read only memory (CD-ROM), digital versatile disc (DVD), any optical medium, flash memory cards, punch cards, paper tape, any other physical medium with a pattern of holes, random access memory (RAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, any other memory chip or cartridge, or any other medium from which a computer can read.

[0095] In an embodiment, the computer program that implements the methods and algorithms disclosed in the present invention is stored and transmitted in several ways using a variety of media (e.g., computer readable media). In an embodiment, hard-wired circuits or custom hardware are used in place of or in combination with software instructions to implement the methods of various embodiments. Therefore, the embodiments are not limited to any specific combination of hardware and software. Computer program code comprising computer executable instructions can be implemented in any programming language. Examples of programming languages ​​that can be used include C, C++, C#, Fortran, Ruby, Visual Hypertext Preprocessor (PHP), NET, etc. Other object-oriented, functional, scripting and / or logical programming languages ​​can also be used. In an embodiment, the computer program code or software program is stored as object code on or in one or more media. In another embodiment, Figure 2-3The methods and various aspects of the surgical visualization and recording system (SVRS) 200 exemplified in the present invention are implemented in a non-programming environment, including, for example, documents created in Hypertext Markup Language (HTML), Extensible Markup Language (XML), or other formats that present aspects of a graphical user interface (GUI) or perform other functions (when viewed in a visible area or window of a browser program). In another embodiment, the methods and various aspects of the SVRS 200 disclosed herein are implemented as programming elements, or non-programming elements, or any suitable combination thereof.

[0096] When introducing a database (e.g. in Figure 3 3 (in the example shown in FIG. 2 ), the internal database 238 and the external database 304 in the external system 303 are shown. It will be understood by those skilled in the art that (i) alternative database structures to the described database structures may be employed, and (ii) other memory structures may be employed in addition to the database structures. Any description or illustration of any example database disclosed herein is an example structure for storing information. In embodiments, any number of other structures may be employed in addition to the structures suggested by tables shown in the figures or elsewhere. Similarly, any illustrated entries in the databases merely represent example information. It will be understood by those skilled in the art that the number and content of entries may vary from that disclosed herein. In another embodiment, although the databases are described as tables, other formats, including relational databases, object-based models, and / or distributed databases, may be used to store and manipulate the data types disclosed herein. The object methods or properties of the databases may be used to implement various processes, such as those disclosed herein. In another embodiment, the databases are stored in a known manner, either locally or remotely, from a device that accesses data in such databases. In embodiments where there are multiple databases in the surgical visualization and recording system 200, the databases are integrated to communicate with each other so that when any data in one database is updated, data linked across the databases can be updated simultaneously.

[0097] The method and surgical visualization and recording system (SVRS) 200 disclosed in the present invention can be configured to operate in a network environment comprising one or more computers. Figure 3301 and communicate with one or more devices. In an embodiment, the computer communicates directly or indirectly with the device via a wired medium or a wireless medium (e.g., the Internet, a local area network (LAN), a wide area network (WAN) or Ethernet, a token ring, or via any suitable communication medium or combination of communication media). Each device includes a processor for communicating with the computer, an example of which is disclosed above. In an embodiment, each computer is equipped with a network communication device, such as a network interface card, a modem, or other network connection device suitable for connection to the network 301. Each computer and device executes an operating system, an example of which is disclosed above. Although the operating system can vary depending on the type of computer, the operating system provides a suitable communication protocol to establish a communication link with the network 301. Any number and type of computers can communicate with the computer.

[0098] The method disclosed in the present invention and surgical visualization and recording system (SVRS) 200 are not limited to special computer system platforms, microprocessors, operating systems or networks. In an embodiment, one or more aspects of the method disclosed in the present invention and SVRS200 are distributed between one or more computer systems, which, for example, are servers, configured to provide one or more services to one or more client computers, or to perform an entire task in a distributed system. For example, according to various embodiments, one or more aspects of the method disclosed in the present invention and SVRS 200 are performed on a client-server system, which includes components distributed in one or more server systems that perform multiple functions. These components include, for example, executable code, intermediate code or interpreted code, which communicate using a communication protocol on a network 301. The method disclosed in the present invention and SVRS200 are not limited to performing on any special system or system group, and are not limited to any special distributed structure, network or communication protocol.

[0099] The foregoing examples are provided for explanation only and are in no way to be considered as limiting the method and surgical visualization and recording system (SVRS) 200 disclosed herein. Although the method and SVRS 200 have been described with reference to various embodiments, it should be understood that the words used herein are words of description and example, rather than words of limitation. Moreover, although the present invention has described the method and SVRS 200 with reference to specific means, materials, and embodiments, the method and SVRS 200 are not limited to the details disclosed herein; rather, the method and SVRS 200 extend to all functionally equivalent structures, methods, and uses, such as within the scope of the appended claims. Although multiple embodiments are disclosed, those skilled in the art who benefit from the teachings of this specification should understand that the method and SVRS 200 disclosed herein are capable of variation, and other embodiments may be implemented and changes may be made without departing from the scope and spirit of the method and SVRS 200 disclosed herein.

Claims

1. A method for capturing, communicating and displaying images of a surgical site having up to ultra-high definition resolution and associated with patient information in real time during a surgical procedure, the method comprising: A surgical visualization and recording system is provided, the surgical visualization and recording system comprising: An ultra-high definition camera system, the ultra-high definition camera system comprising an optical component and an image sensor located at a proximal end of a surgical viewing device, the image sensor being in optical communication with the optical component, for receiving reflected light from the surgical site through the optical component, and capturing an image of the surgical site having an ultra-high definition resolution and communicating it in real time to an embedded microcomputer of a display unit; and a universal serial bus interface for enabling real-time streaming of the captured image having an ultra-high definition resolution from the image sensor of the ultra-high definition camera system to one or more of a display unit, an external system, and a cloud computing environment in an ultra-high definition digital display format; a display unit including an embedded microcomputer in operable communication with said ultra high definition camera system, said embedded microcomputer including at least one processor configured to execute computer program instructions for receiving, converting and processing said captured and communicated images of said surgical site; and said display unit further comprising a tactile user interface in operable communication with said embedded microcomputer for receiving one or more user inputs for controlling operation of said ultra high definition camera system and for displaying said captured and communicated images of said surgical site having up to said ultra high definition resolution; receiving the patient information through the tactile user interface of the display unit of the surgical visualization and recording system via the embedded microcomputer of the display unit; recording the captured and communicated images of the surgical site having the ultra-high definition resolution and having the received patient information in a storage device in real time via the embedded microcomputer of the display unit; securely storing the captured and communicated images of the surgical site having the received patient information directly on an external system in real time via the embedded microcomputer of the display unit; storing the captured and communicated images of the surgical site having the received patient information in a cloud computing environment over a network via the embedded microcomputer of the display unit in real time; capturing the image of the surgical site having up to the ultra-high definition resolution via the image sensor of the ultra-high definition camera system of the surgical visualization and recording system and communicating in real-time to the embedded microcomputer of the display unit when receiving one or more user inputs via one of the tactile user interface of the display unit and one or more input devices operatively connected to the embedded microcomputer of the display unit; associating the captured and communicated image of the surgical site with the received patient information in real time via the embedded microcomputer of the display unit; displaying in real time via the tactile user interface of the display unit the captured and communicated image of the surgical site having up to the ultra-high definition resolution and associated with the received patient information; The embedded microcomputer of the display unit transmits the captured and communicated images of the surgical site having the ultra-high definition resolution and the received patient information to a client application on a user device in real time via a network, allowing the captured and communicated images of the surgical site having the received patient information to be viewed on the user device in real time.

2. The method according to claim 1, further comprising: When the tactile user interface of the display unit and one of the one or more input devices receive the one or more user inputs, the capturing, recording and displaying of the image of the surgical site having the ultra-high definition resolution are controlled by the embedded microcomputer of the display unit.

3. The method according to claim 1, further comprising: The captured and communicated images of the surgical site and the received patient information are organized in a file system by the embedded microcomputer of the display unit.

4. The method according to claim 1, wherein: The patient information includes a patient identifier, patient name, surgeon name, type of surgery, description of the surgery, and date of the surgery.

5. The method according to claim 1, further comprising: When the one or more user inputs are received through the tactile user interface of the display unit and one of the one or more input devices, one or more of the plurality of camera parameters of the ultra-high definition camera system are controlled by the embedded microcomputer of the display unit, wherein the camera parameters include white balance, brightness, sharpness, contrast, grayscale, saturation, resolution, gain, exposure and frame rate.

6. The method according to claim 1, wherein: The one or more input devices include a foot switch and a portable wireless controller operatively connected to the embedded microcomputer of the display unit.

7. The method according to claim 1, wherein: The ultra-high definition resolution is a resolution of 3840 pixels x 2160 lines.

8. A surgical visualization and recording system for capturing, communicating and displaying surgical site images with up to ultra-high definition resolution and associated with patient information in real time during a surgical procedure, the surgical visualization and recording system comprising: An ultra-high-definition camera system, the ultra-high-definition camera system comprising: an optical component located at a proximal end of the surgical viewing device; and an image sensor in optical communication with the optical component for receiving reflected light from the surgical site through the optical component and capturing the image of the surgical site having up to the ultra-high definition resolution and communicating in real time to the embedded microcomputer of the display unit upon receiving one or more user inputs through a tactile user interface of the display unit and one of one or more input devices operatively connected to an embedded microcomputer of the display unit; a universal serial bus interface for enabling real-time streaming of captured images having up to said ultra high definition resolution from said image sensor of said ultra high definition camera system to one or more of said display unit, an external system and a cloud computing environment in an ultra high definition digital display format; and The display unit is in operative communication with the ultra high definition camera system, the display unit comprising: a tactile user interface for receiving one or more user inputs for controlling operation of said ultra high definition camera system and for displaying captured and communicated images of said surgical site at said ultra high definition resolution; and The embedded microcomputer is in operative communication with the tactile user interface, the embedded microcomputer comprising at least one processor configured to execute computer program instructions determined by modules of the embedded microcomputer for receiving, converting and processing the captured and communicated images of the surgical site, the modules of the embedded microcomputer comprising: a data communications module for receiving the patient information through the tactile user interface and for receiving the one or more user inputs for controlling the operation of the ultra high definition camera system through the tactile user interface and the one of the one or more input devices; The data communication module is used to receive the captured and communicated images of the surgical site having the ultra-high definition resolution in real time from the image sensor of the ultra-high definition camera system; a patient information association module for associating the captured and communicated images of the surgical site with the received patient information in real time; a display module for displaying said captured and communicated image of said surgical site having said ultra-high definition resolution and associated with said received patient information on said tactile user interface in real time; an image recorder for recording said captured and communicated images of said surgical site having said ultra-high definition resolution and having said received patient information in real time in a storage device; a storage module for securely storing said captured and communicated images of said surgical site with said received patient information directly on an external system in real time; and for storing said captured and communicated images of said surgical site with said received patient information in a cloud computing environment over a network in real time; A data communication module transmits the captured and communicated images of the surgical site having the ultra-high definition resolution and the received patient information to a client application on a user device in real time via a network, so as to allow the captured and communicated images of the surgical site having the received patient information to be viewed in real time on the user device.

9. The surgical visualization and recording system of claim 8, wherein: The module of the embedded microcomputer of the display unit also includes a control module for controlling the capture, recording and display of the image of the surgical site with up to the ultra-high definition resolution when receiving one or more user inputs through the tactile user interface of the display unit and one of the one or more input devices.

10. The surgical visualization and recording system of claim 8, wherein: The patient information association module of the embedded microcomputer of the display unit organizes the captured and communicated image of the surgical site and the received patient information in a file system.

11. The surgical visualization and recording system of claim 8, wherein: The module of the embedded microcomputer of the display unit also includes a control module for controlling one or more of multiple camera parameters of the ultra-high-definition camera system when receiving the one or more user inputs through the tactile user interface of the display unit and one of the one or more input devices, wherein the camera parameters include white balance, brightness, sharpness, contrast, grayscale, saturation, resolution, gain, exposure and frame rate.

12. The surgical visualization and recording system of claim 8, wherein: The one or more input devices include a foot switch and a portable wireless controller operatively connected to the embedded microcomputer of the display unit.

13. The surgical visualization and recording system of claim 8, wherein: The UHD camera system also includes a C-shaped mounting interface, which is operatively connected to the optical component of the UHD camera system for adjusting the focal length of the optical component from 18 mm to 35 mm.

14. The surgical visualization and recording system of claim 8, wherein: The UHD camera system is waterproof.

15. A non-transitory computer readable storage medium having computer program code embodied thereon, the computer program code comprising instructions executable by at least one processor for capturing, communicating, and displaying surgical site images having up to ultra-high definition resolution and associated with patient information in real-time during a surgical procedure, the computer program code comprising: first computer program code for receiving patient information via a tactile user interface of a display unit of a surgical visualization and recording system and receiving one or more user inputs for controlling operation of an ultra high definition camera system of the surgical visualization and recording system via one of the tactile user interface and one or more input devices operatively connected to the display unit; second computer program code for receiving, in real time, an image of the surgical site captured and communicated by an image sensor of the ultra high definition camera system having the ultra high definition resolution while receiving the one or more user inputs through one of the tactile user interface of the display unit and the one or more input devices; third computer program code for associating said captured and communicated image of said surgical site with said received patient information in real time; as well as fourth computer program code for displaying said captured and communicated image of said surgical site having up to said ultra-high definition resolution and associated with said received patient information on said tactile user interface of said display unit in real-time; fifth computer program code for recording said captured and communicated images of said surgical site having said ultra high definition resolution and having said received patient information in real time in a storage device; sixth computer program code for securely storing said captured and communicated image of said surgical site with said received patient information directly on an external system in real time; seventh computer program code for storing said captured and communicated image of said surgical site with said received patient information in real time over a network in a cloud computing environment; A ninth computer program code for transmitting the captured and communicated image of the surgical site having the ultra-high definition resolution and the received patient information to a client application on a user device in real time via a network, for allowing the captured and communicated image of the surgical site having the received patient information to be viewed on the user device in real time.

16. The non-transitory computer-readable storage medium of claim 15, wherein: The computer program code also includes eighth computer program code for controlling the capture, recording and display of the image of the surgical site having the ultra high definition resolution when receiving the one or more user inputs through the tactile user interface of the display unit and one of the one or more input devices.

17. The non-transitory computer-readable storage medium of claim 15, wherein: The computer program code also includes tenth computer program code for organizing the captured and communicated images of the surgical site and the received patient information in a file system.

18. The non-transitory computer-readable storage medium of claim 15, wherein: The computer program code also includes an eleventh computer program code for controlling one or more of a plurality of camera parameters of the ultra-high definition camera system when the one or more user inputs are received through the tactile user interface of the display unit and the one of the one or more input devices, wherein the camera parameters include white balance, brightness, sharpness, contrast, grayscale, saturation, resolution, gain, exposure and frame rate.

Images