Invisible Light Visualization Automatically Matched Augmented Reality Glasses

Abstract

To provide augmented reality (AR) glasses with auto coregistration of an invisible field on visible reality which allows eyes to directly recognize a real space and precisely performs coregistration on only diagnosis and treatment information of invisible light, which is emitted from a specific area, to the real space.SOLUTION: Augmented reality glasses include a glasses body to be worn on the face of a user, an invisible light emission unit arranged on one side of the glasses body and configured to emit invisible light toward a target object, an input unit arranged on one side of the glasses body and configured to input the invisible light emitted from the target object together with visible light to a waveguide, an information processing unit arranged on one side of the glasses body and configured to convert invisible light image information received from the input unit into visible light image information which is recognizable by a person, and an image output unit arranged on one side of the glasses body and configured to receive the visible light image information processed in the information processing unit and output the received visible light image information to eyeballs through the waveguide.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to augmented reality glasses (AR glasses) that automatically match invisible light visualization. More specifically, the real space is directly recognized by the eyes, and the real space is visualized by a specific part. This relates to an augmented reality glass with automatic invisible light visualization that automatically and precisely matches the diagnostic and treatment information of invisible light emitted only from the glass to the real space.

[0002] In addition, the present invention provides sufficient eye-box extension (extension of the range in which the eyes can move; Eye- This paper describes augmented reality glasses with automatic matching of invisible light visualization that provide a wide field of view (FOV) and a wide box expansion, while avoiding the problem of vergence-accommodation conflict (VAC). [Background technology]

[0003] Near-infrared light has a deep penetration depth into the human body, leading to the development of a variety of medical devices that utilize the principles of fluorescence, transmission, scattering, and absorption. Furthermore, cutting-edge photosensitizers have been developed and are being used in photodiagnosis and phototherapy. Among these, indocyanine green is a widely used photoreactive dye approved by the US FDA. Indocyanine green absorbs near-infrared light well in the 600-900 nm range and emits near-infrared fluorescence in the 750-950 nm range. Fluorescence imaging (or detection) equipment using indocyanine green fluorescence requires an excitation filter in front of the light source and an emission filter in front of the camera (or photodetector) to prevent overlap between the absorption and emission wavelength bands. For example, the excitation filter allows excitation light to pass only within a 20 nm band centered on 780 nm, while the emission filter allows fluorescence emission to pass only within a 20 nm band centered on 840 nm. Indocyanine green is injected intravenously into the human body and is more likely to deposit in tumors, which have more neovascularization than normal tissue. Fluorescence imaging equipment equipped with a light source, camera, excitation filter, and emission filter can be used to image the fluorescent light emitted from tumors, allowing the location of tumors to be determined in real time.

[0004] Near-infrared light is an invisible wavelength, so in medical settings, cameras sensitive to near-infrared light are used to capture near-infrared images for diagnosis and monitoring of treatment processes. Recently, CMOS cameras have been widely used for near-infrared monitoring because they are inexpensive and have near-infrared sensitivity, even if it is not the most sensitive. There are also expensive near-infrared-dedicated cameras, such as InGaAs cameras.

[0005] However, when using such a camera, the near-infrared light sensed by the camera must be converted into visible light that can be perceived by humans and then displayed on a monitor, which inevitably creates a drawback in that the surgeon must constantly change his or her line of sight and monitor the monitor during surgery.

[0006] Therefore, a device that can automatically align the near-infrared image with the surgeon's line of sight and display it as augmented reality is needed, and it is expected to be useful during surgery and treatment. However, current augmented reality and virtual reality (VR) glasses are unable to precisely align the augmented reality and virtual reality spaces with the real space. Furthermore, virtual reality glasses attempt to solve this by using multiple cameras to recognize the real space and displaying it on the virtual reality glasses. However, this requires relying entirely on cameras rather than directly perceiving the real space with the eyes, which is often objectionable in medical settings where safety must be guaranteed.

[0007] On the other hand, in augmented and virtual reality glasses, dizziness occurs when the digital image is positioned at a point where both eyes gaze at the same time and the lens focus of the eyes is not aligned with that point. If the gaze points of both eyes do not match the lens focus of the eyes, that is, if the vergence distance and the accommodation distance do not match, vergence-accommodation mismatch occurs. This can cause Voiding (VAC) and make it difficult to use the glasses for long periods of time. In particular, when surgery is performed near the near-infrared emitting area, the image perception distance approaches 80cm or less, causing a rapid increase in the VAC phenomenon. Therefore, in the case of augmented reality glasses, which overlay digital images on the real workspace located within the user's arm's length, it is extremely important to solve the VAC problem.

[0008] Furthermore, with augmented and virtual reality glasses, digital images cannot be seen unless the eyeballs are properly positioned relative to the glasses. However, since the alignment between the glasses and the eyes must be very precise, which is very inconvenient for the user, this problem must be solved by providing a certain degree of alignment gap in the position of the eyes. In other words, the image can be seen even if the glasses and the eyes are roughly aligned. Providing such a gap is called eye-box expansion.

[0009] It is also very important to ensure a wide field of view in augmented and virtual reality glasses. That is, the wider the field of view (FOV), the wider the digital image that can be viewed. For example, when surgery is performed near the near-infrared emitting area with the help of augmented reality (AR) glasses, if the field of view of the digital image that displays the near-infrared emitting area is narrow, it can cause great inconvenience during surgery. [Prior art documents] [Patent documents]

[0010] [Patent Document 1] Korean Patent No. 1678009 (2016.11.15) Summary of the Invention [Problem to be solved by the invention]

[0011] The present invention has been invented to solve the above-mentioned problems, and its purpose is to provide an augmented reality glasses with automatic invisible light visualization matching that allows the real space to be directly recognized by the eyes, and precisely matches only the diagnostic and treatment information of invisible light emitted only from specific areas with the real space.

[0012] In addition, the present invention includes visualization of invisible light such as ultraviolet light as well as near-infrared light and automatic matching with real space. The medical field is just one example, and the present invention can be applied to various industries where invisible light contains information and needs to be automatically matched with real space created by visible light. [Means for solving the problem]

[0013] In order to achieve the above object, the present invention provides an augmented reality eyeglasses with an invisible light visualization automatic matching function, which includes an eyeglass body to be worn on a user's face, an invisible light irradiation unit installed on one side of the eyeglass body to irradiate an object with invisible light, and a light wave guide (LWG) installed on the front of the eyeglass body to guide the invisible light emitted from the object together with visible light. an input unit for inputting a signal to a wave body or a wave guide plate; an information processing unit that converts the invisible light image information received from the input unit into visible light image information that can be recognized by a human; and an image processing unit that is installed on the rear surface of the eyeglass body, receives the visible light image information processed by the information processing unit, and outputs it to the naked eye through the waveguide. Includes a video output unit.

[0014] The point where the lines of sight of the left and right eyes converge, which is installed on one side of the glasses body, and the focus of the real and augmented reality (AR / VR) image information output from the image output unit are accurately aligned. Preferably, the eyeglasses further include a focus adjustment unit that adjusts the distance to match the distance of the image, and an eye tracking unit that is installed on one side of the eyeglasses body and that predicts the image perception distance and transmits distance information to the focus adjustment unit.

[0015] The input unit includes: (1) a first input formed at an end of the waveguide, into which invisible light is incident; (2) a second input coupler at the other end of the waveguide, spaced a predetermined distance from the first input coupler; (3) a first output coupler that outputs the invisible light beam incident from the first input coupler to the camera unit; and (4) a camera unit that captures the invisible light beam output from the first output coupler. It is preferable to have such a configuration.

[0016] The image output unit (1) outputs the information received from the information processing unit. a display unit; and (2) a light beam formed at an end of the waveguide and output from the display unit. (3) a second input coupler for receiving the image information from the second input coupler into the waveguide; and a second output coupler formed at a predetermined interval so that information received from the second input coupler can be output to the user's naked eye, and the second output coupler is formed so that an image output position corresponds to an actual position of the object.

[0017] The display unit transmits information contained in invisible light to the second input coupler in the form of visible light using a pseudo color that can be contrasted with real image information perceived by a user.

[0018] It is preferable that the camera section sends video information to the information processing unit, and the information processing unit processes the received video information and sends it to the display section.

[0019] The eyeball tracking unit tracks the line of sight of the eyeball as it views real space to grasp the image perception distance and inputs the grasped information into the information processing unit, which is characterized by calculating the image perception distance of the eyeball in real time based on the input information.

[0020] It is preferable that the focus adjustment unit includes a first focus adjustment section made up of a transparent optical system including one or more reflective, refractive, diffractive, holographic or polarizing elements to cause refraction of light, and a second focus adjustment section made up of a transparent optical system including one or more reflective, refractive, diffractive, holographic or polarizing elements to cause refraction of light.

[0021] The focus adjustment unit receives the image perception distance information measured by the eyeball tracking unit and calculated by the information processing unit in real time, and compares the focal length of the digital image containing invisible light information with the image perception distance of the eyeball so that the difference is maintained within 0.25 diopters.

[0022] It is preferable that the first focus adjustment unit is located on both sides to correspond to the user's eyes, and the second focus adjustment unit is located on both sides to correspond to the user's eyes, and is formed so that the image output position is aligned with the line of sight toward the object.

[0023] The image output unit (1) outputs the information received from the information processing unit. a display unit; and (2) a light beam formed at an end of the waveguide and output from the display unit. (3) a second input coupler for receiving the image information from the second input coupler and the second input coupler; and a second output coupler that is formed at a predetermined interval and is installed so that information received from the second input coupler can be output to the user's naked eye, and the second output coupler is formed so that the image output position corresponds to the actual position of the object, and it is preferable that the first input coupler, first output coupler, second input coupler and second output coupler include one or more reflective, refractive, diffractive, holographic or polarizing elements in combination to ensure a viewing angle of 80 degrees or more.

[0024] The first input couplers are located on both sides to correspond to the user's eyes, the first output couplers and camera unit are located on both sides within the eyeglass body, spaced apart from the first input couplers on both sides, the second output couplers are located on both sides to correspond to the user's eyes, the display unit and second input couplers are located on both sides within the eyeglass body, spaced apart from the second output couplers on both sides, and the second output couplers are formed so that the image output position is aligned with the line of sight facing the object.

[0025] The first input coupler and the second output coupler are either a diffractive optical element, a holographic optical element, or a pin-mirror.

[0026] The first input coupler or the first output coupler may further include a filter on a front surface thereof so that only invisible light can be transmitted to the camera unit.

[0027] The waveguide is composed of a first waveguide and a second waveguide. The first waveguide includes a first input coupler formed at an end of the first waveguide and receiving invisible light, a first output coupler formed in the first waveguide at a predetermined distance from the first input coupler and outputting the invisible light input at the first input coupler, and a camera unit for capturing the invisible light output from the first output coupler. The second waveguide includes a second input coupler formed at an end of the second waveguide and receiving image information output from the display unit, and a second output coupler formed in the second waveguide at a predetermined distance from the second input coupler so that information received from the second input coupler can be output to a user's naked eye.

[0028] The first input coupler is any one of a first diffractive optical element, a first holographic optical element, and a first pin mirror provided on one side of a first waveguide, and the second output coupler is any one of a second diffractive optical element, a second holographic optical element, and a second pin mirror provided on one side of a second waveguide.

[0029] The first input coupler or the first output coupler may further include a first filter on a front surface thereof so that only invisible light can be transmitted to the camera unit.

[0030] The invisible light irradiating unit includes a second filter so that only invisible light in a specific wavelength band can be irradiated toward the object.

[0031] The focus adjustment unit is characterized by having a parallel light structure that achieves the functions of securing the amount of light and expanding the eyebox by expanding the entrance pupil and exit pupil while maintaining the focus adjustment function to solve the VAC problem.

[0032] The waveguide is made of a transparent optical material through which visible light passes, and is suitable for freeform optics, planar optics, Any one of the curved optical elements can be used, and it can also serve to correct the user's vision like regular glasses.

[0033] Each of the input unit and the image output unit has a structure having one or more wavelength channels, and each channel is characterized by being configured to transmit only specific wavelengths, thereby resolving chromatic aberration.

[0034] The first focus adjustment unit is configured to work in combination with a lens installed in the first output coupler to exhibit an effect equivalent to the focal depth of an eyeball lens, and is characterized in that it can automatically impart realistic optical blur to the camera unit.

[0035] The eye tracking unit is characterized by having separate cameras and lighting corresponding to both eyes, or by having a vergence tracker structure using electrooculogram signals of both eyes.

[0036] The first output coupler and the second input coupler are configured to have a birdbath structure. [Effects of the Invention]

[0037] The non-visible light visualization automatic matching augmented reality glasses of the present invention directly recognize the real space with the eyes and precisely match only near-infrared diagnostic and treatment information emitted from specific areas with the real space, thereby achieving the technical effect of aligning near-infrared rays coaxially with the surgeon's line of sight during surgery or treatment, and displaying them in augmented reality. [Brief explanation of the drawings]

[0038] [Figure 1] 1 is a conceptual diagram (1) of a first embodiment of the non-visible light visualization automatic matching type augmented reality glasses according to the present invention. [Figure 2] 1 is a block diagram conceptually illustrating the configuration of a first embodiment of the non-visible light visualization automatic matching type augmented reality glasses according to the present invention. [Figure 3] FIG. 2 is a conceptual diagram (2) of the first embodiment of the non-visible light visualization automatic matching augmented reality glasses according to the present invention. [Figure 4] FIG. 1 is a conceptual diagram of a second embodiment of the non-visible light visualization automatic matching augmented reality glasses according to the present invention. [Figure 5] FIG. 10 is a conceptual diagram of a third embodiment of the non-visible light visualization automatic matching augmented reality glasses according to the present invention. [Figure 6]FIG. 10 is a conceptual diagram of a fourth embodiment of the non-visible light visualization automatic matching augmented reality glasses according to the present invention. [Figure 7] FIG. 7 is a conceptual diagram illustrating a first waveguide having three wavelength channels in FIGS. 5 and 6. [Figure 8] FIG. 7 is a conceptual diagram illustrating a second waveguide having three wavelength channels in FIGS. 5 and 6. [Figure 9] FIG. 9 is a conceptual diagram illustrating a birdbath structure of the first output coupler in FIGS. [Figure 10] FIG. 9 is a conceptual diagram illustrating a birdbath structure of the second input coupler in FIGS. DETAILED DESCRIPTION OF THE INVENTION

[0039] Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. The present invention may have various embodiments, and specific embodiments are illustrated in the drawings and described in detail herein. However, this is not intended to limit the present invention to the particular disclosed embodiment, and it should be understood that the present invention includes all modifications, equivalents, and alternatives falling within the spirit and technical scope of the present invention. In the description of the drawings, like reference numerals are used to refer to like components. In the accompanying drawings, the dimensions of structures are exaggerated to clarify the present invention.

[0040] Terms such as "first," "second," etc. may be used to describe various components, but the components should not be limited by these terms. These terms are used only to distinguish one component from another. For example, a first component may be called a "second component," and similarly, a second component may be called a "first component," without departing from the scope of the present invention.

[0041] The terms used in this application are merely used to describe specific embodiments and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "have" are intended to specify the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, and should be understood not to preclude the possibility of the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0042] Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by a person of ordinary skill in the art to which this invention pertains. Terms as defined in commonly used dictionaries should be interpreted to have a meaning consistent with the meaning they have in the context of the relevant art, and should not be interpreted in an idealized or overly formal sense unless expressly defined in this application.

[0043] 1 to 3 show a first embodiment of the invisible light visualization automatic matching augmented reality glasses 1 according to the present invention.

[0044] Referring to the drawings, the invisible light visualization automatic matching augmented reality glasses 1 include a glasses body, an invisible light irradiation unit 100, an input unit 200, an information processing unit 400, an image output unit 500, a focus adjustment unit 600, and an eye tracking unit 700.

[0045] The invisible light irradiation unit 100 is installed on one side of the glasses body and irradiates invisible light 20 toward the object 10. It may be attached to any point on the augmented reality glasses, or may be attached to a part of the user's head or body through a separate support, or may be formed as an integral part of a lighting fixture such as a shadowless lamp in an operating room or as a separate attachment. The invisible light irradiation unit 100 also includes a second filter so as to irradiate only invisible light of a specific wavelength band.

[0046] The input unit 200 is installed on one side of the eyeglass body and inputs the invisible light 20 emitted from the object 10 into the waveguide 300 together with the visible light 30, and includes a first input coupler 210, a first output coupler 220, and a camera unit 230.

[0047] The first input coupler 210 is formed at an end of the waveguide 300 and receives the invisible light 20, and the first output coupler 220 is formed at the other end of the waveguide 300 and is spaced a predetermined distance from the first input coupler 210 and outputs the invisible light 20 received at the first input coupler 210 to the camera unit 230.

[0048] The first input coupler 210 is a portion where the invisible light 20 enters the waveguide 300, and is made of an incident material into which light can enter. The first input coupler 210 may be inserted into the waveguide 300, or a separate pattern may be formed so that light can enter a portion of the waveguide 300.

[0049] The first output coupler 220 outputs the invisible light 20 incident from the first input coupler 210, and is formed in the waveguide 300 at a predetermined distance from the first input coupler 210. An incident material from which light can be output may be inserted inside the waveguide 300 or formed independently outside, or a separate pattern may be formed so that light can be output to a part of the waveguide 300.

[0050] The camera unit 230 captures the invisible light 20 output from the first output coupler 220 .

[0051] The image output unit 500 includes a display unit 530 , a second input coupler 510 , and a second output coupler 520 .

[0052] The display unit 530 transmits the augmented reality information contained in the invisible light 20 to the second input coupler 510 in the form of visible light augmented reality image information 40 using a pseudo color that can be contrasted with the visible light real image information 31 perceived by the user.

[0053] In this embodiment, assuming an operating room, the hue of organs and blood is red, so the display unit 530 outputs complementary colors such as blue and green to distinguish between the visible light real image information 31 and the visible light augmented reality image 40.

[0054] The display unit 530 may be configured with a micro OLED display, a micro LED display, a liquid crystal on silicon (LCoS) display, an OLED-on-Silicon (OLEDoS) display, etc. The image output unit 500 may be configured with a holographic display and a light field (light field) display. d) It is configured in the form of a display, which can solve the problems of VAC (Vergence-accommodation conflict; the focal point of the visible light augmented reality image information 40 output from the image output unit 500 and the visible light real image information 31 output from the object must be adjusted to exactly match the point where the lines of sight of both naked eyes 50 converge) and aberration. However, the type of the display is not limited to this.

[0055] The second input coupler 510 is formed at an end of the waveguide 300 and receives the visible light augmented reality image information 40 output from the display unit 530 .

[0056] The second output coupler 520 is installed so that the visible light augmented reality image information 40 received from the second input coupler 510 can be output to the user's naked eye 50, and is formed in the waveguide 300 at a predetermined distance from the second input coupler 510.

[0057] Here, the second output coupler 520 is preferably configured so that the image output position corresponds to the actual position of the object 10 .

[0058] The waveguide 300 is made of a transparent optical material so as to be able to guide the invisible light 20 between the first input coupler 210 and the first output coupler 220 and the visible light augmented reality image information 40 between the second input coupler 510 and the second output coupler 520, and is parallel. Whether it is a plate or a shape such as a rectangle or a circle, it is preferable that it is very light and has a small thickness.

[0059] The waveguide 300 is formed of a transparent optical material through which visible light 30 passes, and a freeform optic, a planar optical element, or a curved optical element can be used, and a function for correcting the user's vision can be added, like ordinary glasses.

[0060] For example, the waveguide 300 itself may be a lens with a curved surface or a free shape, instead of a flat surface, to enable vision correction, and may be custom-made for each user.

[0061] Each of the input unit 200 and the image output unit 500 may be configured with one or more wavelength channels, with each channel transmitting only a specific wavelength, thereby eliminating chromatic aberration.

[0062] The first input coupler 210, the first output coupler 220, the second input coupler 510, and the second output coupler 520 are characterized by including and combining one or more reflective, refractive, diffractive, holographic, or polarizing elements to ensure a large viewing angle of 80 degrees or more.

[0063] The first input coupler 210 is characterized by having a structure capable of securing the maximum amount of invisible light 20 through entrance pupil expansion.

[0064] The second output coupler 520 is capable of one-dimensional and two-dimensional eye-box expansion through exit pupil expansion, and is therefore characterized by providing a stable visual image even when there is a gap in the relative positions of the first input coupler 210 and the second output coupler 520 with respect to the human eye 50.

[0065] It is preferable to implement the expansion of the entrance pupil and the exit pupil using a parallel light structure in which the focal points of the light input to the first input coupler 210 and the light output from the second output coupler 520 are at infinity. The parallel light structure makes it easy to design the input unit 200 including the first input coupler 210 so that parallel light incident over a wide area converges at a single point on the camera unit 230. Therefore, in the parallel light structure, the larger the size of the entrance pupil, the more light the camera can secure. Furthermore, the parallel light structure makes it easy to create the image output unit 500 including the second output coupler 520 that converts light emitted from a single point on the display unit 530 into parallel light. Therefore, the parallel light structure makes it easy to expand the eyebox by expanding the exit pupil.

[0066] The focus adjustment unit 600 adjusts the first focus angle to prevent convergence-accommodation mismatch (VAC). It is preferable to use the focus adjustment unit 610 and the second focus adjustment unit 620 to position the virtual image of the digital augmented reality image in real time while maintaining a parallel light structure in which the focal points of the light input to the first input coupler 210 and the light output from the second output coupler 520 are at infinity.

[0067] The first focus adjusting part 610 of the focus adjusting unit 600 is installed on the target 10 side of the first input coupler 210 to have a positive focal length, and the second focus adjusting part 620 is The first focus adjustment unit 610 is spaced a predetermined distance from the first focus adjustment unit 610 and is installed on the side of the second output coupler 520 facing the naked eye 50, so that it has a negative focal length and the absolute values ​​of both focal lengths are the same, thereby maintaining a parallel light structure while eliminating distortion in the real world perceived by the eye.

[0068] That is, while maintaining the accommodative function to solve the problem of convergence-accommodation discrepancy (VAC). However, the method of simultaneously expanding the entrance pupil and exit pupil to ensure sufficient light and achieve the expansion of the eyebox is to create a "parallel light" structure.

[0069] Also, for users who require vision correction, the focal length of the second focus adjustment unit 620 may be increased by the diopter required for correction.

[0070] The focus adjustment unit 600 adjusts the focus of the visible light augmented reality image information 40 output from the image output unit 500 and the visible light real image information 31 emitted from the object so that the focus of the line of sight of both naked eyes 50 accurately coincides, and includes a first focus adjustment unit 610 and a second focus adjustment unit 620.

[0071] The first focus adjusting unit 610 preferably includes one or more reflective, refractive, diffractive, holographic or polarizing elements, and is located on both sides of the first focus adjusting unit 610 to correspond to both eyes of the user.

[0072] When the first focus adjustment unit 610 is configured to act in combination with a lens installed in the first output coupler 220 to exhibit an effect equivalent to the depth of focus of an eyeball lens, the first focus adjustment unit 610 receives input of invisible light 20 information and transmits it to the camera unit 230, and is characterized in that it can automatically add realistic optical blur to the digital image connected to the camera, i.e., invisible light 20 spatial information.

[0073] The optical blur serves to give a sense of perspective when the naked eye 50 recognizes an object and places its gaze on it, by blurring the surrounding environment. Without optical blur, the sense of perspective is lost, and too much optical blur can give a sense of strangeness.

[0074] Therefore, the present invention allows the user to perceive a well-matched three-dimensional image since the optical blur in the real space perceived by the naked eye 50 is the same as the optical blur in the digital image.

[0075] The second focus adjusting unit 620 preferably includes one or more reflective, refractive, diffractive, holographic, or polarizing elements, and is formed so that the image output position is aligned with the line of sight directed toward the object 10 .

[0076] The first focus adjusting unit 610 and the second focus adjusting unit 620 are configured as transparent optical systems that include one or more reflective, refractive, diffractive, holographic, or polarizing elements to cause light refraction, but may use variable focus lenses such as, but not limited to, multiple PBP lenses (Pancharatnam-Berry Phase Lenses), pancake lenses, liquid crystal lenses, or liquid lenses to reduce weight.

[0077] The eye tracking unit 700 predicts the image perception distance and transmits distance information to the focus adjustment unit 600. To function as a vergence tracker that tracks the line of sight of the naked eye 50 looking at the real space and grasps the image perception distance, separate cameras and lights corresponding to both eyes may be provided, or electrooculography signals of both eyes may be used.

[0078] It is preferable that the information processing unit 400 sends signals to the camera unit 230, the display unit 530, the first output coupler 220 and the second input coupler 510 to perform lens aperture adjustment, focus adjustment, frame rate adjustment, exposure time and ISO adjustment.

[0079] When the first embodiment of the present invention is applied to both eyes, the first input couplers 210 are located on both sides to correspond to the user's eyes, the first output couplers 220 and the camera unit 230 are located on both sides of the glasses body, spaced apart from the first input couplers 210 on both sides, the second output couplers 520 are located on both sides to correspond to the user's eyes, the display unit 530 and the second input couplers 510 are located on both sides of the glasses body, spaced apart from the second output couplers 520 on both sides, and it is preferable that the second output couplers 520 are formed so that the image output position is aligned with the line of sight facing the object 10.

[0080] The remaining components except for the first input coupler 210, the first output coupler 220, the camera unit 230, the second input coupler 510, and the second output coupler 520 are all the same as those described above, and therefore detailed description thereof will be omitted.

[0081] FIG. 4 shows a second embodiment of the non-visible light 20 visualization automatic matching augmented reality glasses 1 according to the present invention.

[0082] In this embodiment, the first input coupler 210 and the second output coupler 520 are configured with double-sided pin mirrors 213 .

[0083] As shown in Figures 9 and 10, the first output coupler 220 and the second input coupler 510 do not always need to be located in front of the camera unit 230 and the display unit 530, and may sometimes have the form of a birdbath-structured concave mirror at the opposite end of the waveguide 300.

[0084] It is preferable that the first input coupler 210 or the first output coupler 220 further includes a first filter 231 that allows only the invisible light ray 20 to be transmitted to the camera unit 230 .

[0085] In this embodiment, the remaining components except for the first input coupler 210, the first output coupler 220 and the first filter 231 in the waveguide 300 are the same as those in the first embodiment, and therefore detailed description thereof will be omitted.

[0086] FIG. 5 shows a third embodiment of the non-visible light visualization automatic matching augmented reality glasses 1 according to the present invention.

[0087] The waveguide 300 is composed of a first waveguide 301 and a second waveguide 302. The first waveguide 301 includes a first input coupler 210 formed at an end of the first waveguide 301 and into which the invisible light ray 20 is incident, and a first output coupler 220 formed on the first waveguide 301 at a predetermined distance from the first input coupler 210 and which outputs the invisible light ray 20 incident from the first input coupler 210.

[0088] The second waveguide 302 includes a second input coupler 510 formed at an end of the second waveguide 302 and receiving image information output from the display unit 530, and a second input coupler 510 formed at a predetermined distance from the second input coupler 510 on the second waveguide 302 and installed so that the information received from the second input coupler 510 can be output to the user's naked eye 50. An output coupler 520 is provided.

[0089] In this embodiment, the remaining components except for the first waveguide 301 and the second waveguide 302 are the same as those in the first embodiment, and therefore detailed description thereof will be omitted.

[0090] FIG. 6 shows a fourth embodiment of the non-visible light 20 visualization automatic matching augmented reality glasses 1 according to the present invention.

[0091] The first input coupler 210 is a first pin mirror 211 provided on one side of the first waveguide 301, and the second output coupler 520 is a second pin mirror 212 provided on one side of the second waveguide 302.

[0092] In this embodiment, the remaining components except for the first waveguide 301, the second waveguide 302, the first input coupler 210, and the second output coupler 520 are the same as those in the second embodiment, and therefore detailed description thereof will be omitted.

[0093] FIG. 7 shows a configuration in which the first waveguide 301 has three wavelength channels.

[0094] The wavelength channel is a structure for solving chromatic aberration, and is formed by stacking multiple layers to create a waveguide that matches a specific wavelength, and the diffraction angle or refraction angle of each wavelength band is always fixed to the same. As a result, it is preferable that each wavelength is always input to the camera unit 230 at the same position.

[0095] FIG. 8 illustrates an embodiment in which the second waveguide 302 has three wavelength channels.

[0096] The wavelength channel is a structure for solving chromatic aberration and is formed by stacking multiple layers to create a waveguide that matches a specific wavelength, and the diffraction angle or refraction angle of each wavelength band is always fixed to the same, so that each wavelength is preferably always output at the same position.

[0097] The above-described invisible light visualization automatic matching augmented reality glasses 1 can directly recognize the real space with the eyes and precisely match only the near-infrared diagnostic and treatment information emitted only from a specific area with the real space, thereby achieving the technical effect of aligning near-infrared rays coaxially with the surgeon's line of sight during surgery or treatment, and displaying it in augmented reality.

[0098] The description of the embodiments presented is provided to enable any person skilled in the art to use or practice the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the scope of the present invention. The present invention is not intended to be limited to the embodiments presented herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein. [Explanation of symbols]

[0099] 1: Invisible light visualization automatic matching augmented reality glasses 10: Object 20: Invisible light 30: Visible light 31: Visible light real image information 40: Visible light augmented reality image information 50: naked eye 100: Invisible light irradiation unit 200: Input unit 210: First input coupler 211: 1st pin mirror 212: 2nd pin mirror 213: Double-sided pin mirror 220: 1st output coupler 230: Camera department 231: First filter 300: Waveguide 301: First waveguide 302: Second waveguide 400: Information Processing Unit 500: Image output unit 510: Second input coupler 520: Second output coupler 530: Display unit 600: Focusing unit 610: 1st focus adjustment section 620:Second focus adjustment section 700: Eye Tracking Unit

Claims

1. A pair of glasses to be worn on the user's face; an invisible light irradiation unit installed on one side of the eyeglass body and irradiating an invisible light beam toward an object; an input unit that is installed on a front surface of the eyeglasses body and includes a camera unit that captures invisible light emitted from the object and inputs the invisible light together with visible light into a waveguide, the input unit including a first input coupler that is formed at an end of the waveguide and into which the invisible light is input, and a first output coupler input unit that is formed at the other end of the waveguide and spaced a predetermined distance from the first input coupler and outputs the invisible light input from the first input coupler to the camera unit; an information processing unit disposed on one side of the eyeglass body, for converting the invisible light image information received from the input unit into visible light image information that can be recognized by a human; an image output unit, which is installed on a rear surface of the eyeglasses body, receives visible light image information processed by the information processing unit and outputs the information to the naked eye from the waveguide, the image output unit including: a second input coupler formed at an end of the waveguide to receive the image information and configured to correspond to an actual position of a corresponding object; and a second output coupler formed on the waveguide at a predetermined distance from the second input coupler so that the information received from the second input coupler can be output to the naked eye of a user; a focus adjusting unit including a first focus adjusting unit and a second focus adjusting unit, the focus adjusting unit being installed on one side of the eyeglass body and adjusting the focus of the real and augmented reality image information output from the image output unit so that the focus of the real and augmented reality image information accurately coincides with the focus of the visual line of the two naked eyes, and configured as a transparent optical system including one or more reflective, refractive, diffractive, or holographic elements or polarizing elements to cause refraction of light; an eyeball tracking unit installed on one side of the eyeglass body, estimating an image perception distance and sending distance information to the focus adjustment unit; the first input coupler, the first output coupler, the second input coupler, and the second output coupler include one or more reflective, refractive, diffractive, holographic, or polarizing elements in combination to ensure a viewing angle of 80 degrees or more; The focus adjustment unit is The image perception distance information measured by the eyeball tracking unit and calculated by the information processing unit is received in real time, and the focal length of the digital image containing invisible light information is compared with the image perception distance of the eyeball, so that the difference is maintained within 0.25 diopters; The first focus adjustment unit is located on both sides of the user's eyes, and is configured to act in combination with a lens installed in the first output coupler to exhibit an effect equivalent to the focal depth of an eye lens, thereby automatically providing a realistic optical blur to the camera unit; The second focus adjustment units are located on both sides of the user's eyes, but are formed so that an image output position is aligned with a line of sight directed toward the object, The eye tracking unit It has a structure consisting of separate cameras and lighting for both eyes, or a vergence tracker using electrooculogram signals from both eyes. The information processing unit augmented reality information that can define an image using a pseudo color that is contrasted with visible light perceived by the user, and visible light augmented reality image information are transmitted to the second input coupler; Among visible light rays, organs and blood are represented in red, and blue and green are output as complementary colors contrasted with the red, to distinguish between visible light real image information and visible light augmented reality image information; The device is configured to receive information obtained by tracking the line of sight of the user's eyes from the eye tracking unit and calculating the image perception distance of the eyeball in real time based on the input information. Augmented reality glasses with automatic matching for invisible light visualization.

2. The invisible light irradiation unit includes: The eyeglasses are formed in a form that is attached to a part of the user's head or body through a separate support at one side of the eyeglasses body, or are formed integrally with a lighting device such as a shadowless lamp in an operating room at one side of the eyeglasses body, The waveguide is formed with freeform optics, planar optics and / or curved optics, The non-visible light visualization automatic matching augmented reality glasses according to claim 1.

Images