Modular surgical visualization system with eye tracking and integrated cooling, lighting and projection modules

Abstract

Modular surgical visualization system comprising an optical recording module with at least one camera, a lighting module, an optical magnification module, a projection module, a gaze tracking module for capturing the gaze direction of a surgeon, an active cooling system and a central control unit for aligning the optical modules according to the captured gaze direction, wherein the system can optionally be attached to a surgical cap, a shoulder mount, a tripod, a ceiling mount or a robotic support.

Description

1. Purpose of the invention

[0001] The invention serves to improve visual support during surgical procedures.

[0002] It allows the surgeon a stable, ergonomic and modular combination of: • optical magnification, • Lighting, • Camera display, • Projection, • Eye tracking, • as well as active cooling of the head area.

[0003] The system is designed to increase the precision, safety and efficiency of surgical procedures while reducing the strain on the surgeon. 2. Technical problem

[0004] Several problems arise during surgical procedures: • insufficient or incorrectly directed lighting, • missing or delayed visualization for the entire operations team, • Overheating and sweating of the surgeon, • limited mobility due to rigid or heavy equipment, • lack of synchronization between the operator's viewing direction and the camera display, • Lack of modularity and flexibility of existing systems.

[0005] These problems lead to fatigue, reduced precision, and more difficult team communication. 3. Technical field

[0006] The invention relates to the following areas: • Medical technology, • surgical visualization systems, • optical and electronic modules, • Imaging systems, • Ergonomic aids for surgery. 4. Object of the invention

[0007] The object of the invention is to provide a modular, lightweight and flexibly positionable surgical visualization system that: • recognizes the direction of the operator's gaze, • automatically aligns optical and electronic modules, • a clear and enlarged representation of the surgical field enables, • makes the operational environment visible to the entire team, • reduces the thermal stress on the surgeon, • and can be mounted both on the body and in a stationary position. 5. Solution to the task

[0008] The task is solved by a modular surgical visualization system, consisting of: • a surgical cap or a stationary holding system, • a camera module, • a lighting module, • an optical magnifying module, • a projector / beamer module, • an active cooling system, • a power supply and charger connection, • an eye-tracking module, • and a central control unit.

[0009] The system can be attached to the head, shoulder, tripod, ceiling mount or robot arm. 6. Solution approach of the invention

[0010] The core of the invention consists in the fact that the operator's direction of view is detected and: • Camera, • Lighting, • optical magnification, • The projection will be automatically aligned to the same point.

[0011] This results in a synchronized, intuitive and ergonomic visualization that benefits both the operator and the entire team. 7. Components 7.1 Mechanical Module • surgical cap / helmet (1) • Main bracket (9) • Additional bracket (10) • Housing for camera, projector and lighting • Modular connectors • Adjustable joints for tilt and rotation 7.2 Electrical Module • Camera unit • Lighting units • Magnifying module • Projector / beamer module • Cooling system(s) • Power source and charger • Charger connection • Eye-tracking sensors • central control electronics • Data transmission unit (wired or wireless) 8. Functionality and advantages • Automatic alignment with the operator's line of sight • magnified view through optical or digital magnifying glasses • Projection of the surgical field onto a wall, ceiling or monitor • Active cooling reduces sweating and fatigue • Modular mounting on head, shoulder, tripod or ceiling • Improved team communication through shared perspective • Lightweight construction and ergonomic shape • Compatible with existing operating room monitors and documentation systems 9. Compatibility with standard products

[0012] The system is compatible with: • Standard operating room monitors, • PACS systems, • medical camera interfaces, • standard power supplies, • Operating tables and ceiling mounts, • Robotics assistance systems. 10. Summary of the advantages • precise, intuitive visualization • less operator fatigue • Better visibility for the entire team • flexible positioning • Modular expandability • Cost-efficient components • High ergonomic quality • Future-proof architecture (robotics integration) 11. State of the art and comparison

[0013] Known systems include: • surgical headlamps, • Head-mounted cameras, • Ceiling-mounted operating lights with camera, • AR glasses.

[0014] However, these systems are: • not modular, • non-cooling, • not gaze-controlled, • not capable of projection, • Not flexibly positionable. 12. Comparison to the state of the art / today

[0015] In contrast to existing solutions, the invention offers: • Eye tracking (not available in the state of the art), • active cooling, • integrated projection, • modular spatial positioning, • combined optical and digital magnification, • Central control of all modules. 13. Degree of innovation

[0016] The invention represents a new class of device: • Combination of helmet, camera, projector, magnifying glasses and cooling • Eye tracking as a control mechanism • modular spatial configuration • Hybrid use (portable or stationary)

[0017] This results in a high degree of innovation and clear patentability. 14. Ergonomic and sustainable features • lightweight construction • reduced thermal stress • Interchangeable modules • Energy-efficient LED and projector technology • reusable components • Compatible with existing operating room infrastructures 15. Utility model patentability analysis

[0018] (Novelty + Inventive Step) 1. New feature

[0019] The present invention is novel within the meaning of Section 3 of the German Patent Act (PatG) or Article 54 of the European Patent Convention (EPC), since no known prior art document discloses a system which has the following features in combination: 1. Modular surgical visualization system that can be operated both portable (head, shoulder) and stationary (tripod, ceiling, robot arm). 2. Eye-tracking module that detects the operator's gaze direction and is used for automatic alignment of the optical modules. 3. Integrated projection module that projects the operational field in real time onto a wall, monitor or ceiling surface. 4. Active cooling system integrated into a surgical visualization system. 5. Combination of camera, lighting, optical magnification, projection and cooling in a single modular system. 6. Central control unit that synchronizes all modules and automatically aligns them with the viewing direction.

[0020] None of the known systems (surgical headlamps, headcams, operating room ceiling lights, AR glasses, endoscope cameras) reveal this combination of features.

[0021] In particular, there is no system that: • Uses eye tracking to control camera, light and projection, • is simultaneously portable and usable in a stationary setting, • has an integrated cooling system, • and features a modular, interchangeable architecture.

[0022] This makes the invention new. 2. Inventive step (Art. 56 EPC / § 4 PatG)

[0023] The invention is based on an inventive step, as it is not obvious to a person skilled in the art. 2.1 Starting point of the expert

[0024] The expert is a medical technology engineer with experience in: • surgical lighting systems, • medical cameras, • Surgical visualization, • AR systems.

[0025] He knows: • Headlamps with camera, • Operating room ceiling lights with camera, • AR glasses (HoloLens, Magic Leap), • Endoscope cameras, • Documentation systems. 2.2 Why the invention is not obvious A) Eye tracking in surgery is not state of the art

[0026] No known system uses eye tracking or head-gaze tracking to control: • Camera, • Lighting, • Projection.

[0027] Transferring eye-tracking technology from VR / AR fields to surgery is not trivial and not obvious to the expert. B) Combination of projection, eye tracking and camera

[0028] The combination of projection module, eye-tracking module, and camera module is novel, as projectors have not previously been used in surgical settings for real-time visualization of the surgical field. The idea that the system automatically projects the image the surgeon is looking at represents a conceptual and technological leap compared to the current state of the art. Such automatic, eye-tracking projection is not found in surgical headlamps, operating room ceiling lights, or AR glasses. C) Integration of a cooling system

[0029] The integration of an active cooling system into a surgical visualization system is unusual and not described in the prior art. Existing systems have neither active cooling of the head area nor a combination of cooling and optical modules. It would not be obvious to a person skilled in the art to combine a cooling system with a camera, lighting, magnification, and projection in a single modular device. D) Spatial modularity (head, shoulder, ceiling, robot)

[0030] Known systems are either wearable (e.g., headlamps, headcams) or stationary (e.g., ceiling lights, camera systems), but never both simultaneously. The present invention introduces a hybrid system that can be operated both on the surgeon's body and on external mounts or robotic supports. This spatial modularity represents a technical and conceptual innovation not indicated in the prior art. E) Synergistic effect

[0031] The combination of the modules creates a synergistic workflow that cannot be achieved by any single module alone. The process: "The surgeon looks → the system aligns the camera and lighting → the image is projected → the surgeon is cooled → visibility is improved" represents a closed control loop that does not exist in current technology. This synergy leads to a significant improvement in surgical precision, ergonomics, and team communication. 2.3 Technical Effect

[0032] The invention achieves several technical effects, including: • More precise and automatic alignment of the camera to the relevant surgical area, • improved and targeted lighting, • Reduced thermal stress on the surgeon through active cooling, • Improved communication and visibility for the entire operations team, • increased ergonomic relief for the surgeon, • Reduced probability of errors through stabilized and synchronized visualization.

[0033] These effects are technical, measurable, and directly attributable to the innovative features of the invention. 2.4 Conclusion on inventive step

[0034] The invention is based on an inventive step, since: • several technical fields (optics, projection, cooling, sensor technology, medical technology) are combined in a novel way, • no prior art document or combination of such documents suggests the combination of features, • the synergy of the modules creates a new overall technical effect that goes beyond the sum of the individual components.

[0035] The invention therefore meets the requirements of Art. 56 EPC or § 4 PatG and is to be regarded as inventive. Reference list (reference symbol list) Figure 3 1 Surgical cap / surgical helmet 2 lamps 3 Power source and charger connection 4 Magnifying module (optical magnification) 5 camera unit 6 Surgical lighting unit 7 Cooling system(s) / Cooling modules 8 Projector (beamer module) Reference list (reference symbol list) Figure 4 1 Surgical cap / surgical helmet 2 lamps 3 camera units 4 Power source and charger 5 Magnifying module (optical magnification) 6 Surgical lighting unit 7 Cooling system(s) / Cooling modules 8 Projector (beamer module) 9 Main bracket 10 Additional brackets / secondary brackets 11 Monitors for surgical monitoring

Claims

Modular surgical visualization system comprising an optical recording module with at least one camera, a lighting module, an optical magnification module, a projection module, a gaze tracking module for capturing the gaze direction of a surgeon, an active cooling system and a central control unit for aligning the optical modules according to the captured gaze direction, wherein the system can optionally be attached to a surgical cap, a shoulder mount, a tripod, a ceiling mount or a robotic support. System according to claim 1, characterized in that the eye tracking module comprises infrared-based sensors for detecting the eye movements of the operator. System according to claim 1 or 2, characterized in that the central control unit automatically aligns the camera to the point focused by the operator. System according to one of the preceding claims, characterized in that the projection module is a pico projector or laser projector which projects the operating field onto a wall, a monitor or a ceiling surface. System according to one of the preceding claims, characterized in that the optical magnification module provides a mechanical or digital magnifying function. System according to one of the preceding claims, characterized in that the cooling system comprises at least one air duct, a micro-fan or a thermoelectric element. System according to one of the preceding claims, characterized in that the surgical cap comprises replaceable, sterilizable inner pads. System according to one of the preceding claims, characterized in that the optical modules can be detachably attached via modular plug connections. System according to one of the preceding claims, characterized in that the power supply is provided via an external battery unit or a charger connection. System according to one of the preceding claims, characterized in that the central control unit supports wireless data transmission. System according to one of the preceding claims, characterized in that the system can be automatically switched between portable and stationary operation. System according to one of the preceding claims, characterized in that the lighting module is aligned coaxially to the operator's line of sight. System according to one of the preceding claims, characterized in that the system provides a real-time display of the operating field on an external monitor. System according to one of the preceding claims, characterized in that the holder comprises a main holder and an additional holder. System according to one of the preceding claims, characterized in that the system is compatible with existing operating room monitors, PACS systems and surgical documentation systems.

Images