Method for calibrating data glasses with virtual retina display, computing unit and data glasses

Abstract

The invention relates to a method for calibrating data glasses (12) having a virtual retina display (10), in which a scanning image (16) is generated by a laser projector (14) of the virtual retina display (10) and is imaged as a sub-beam into an eye box of the data glasses (12) by means of an optical system (18) of the data glasses (12), wherein a calibration image (20) and / or a calibration pattern (22) is output to a wearer of the data glasses (12) by means of the sub-beams, and wherein user feedback given by the wearer of the data glasses (12) on the basis of the perception thereof is detected and used to calibrate the data glasses (12). According to the invention, in order to calibrate the data glasses (12), an automated mechanical actuator (24) is actuated by a computing unit (26) of the data glasses (12) in order to adjust the position of the sub-beam, or a manual mechanical actuator (28) is caused to be operated in order to manually adjust the position of the sub-beam, or a manual retrofit of the data glasses (12) is caused in order to manually adjust the position of the sub-beam, or the laser projector (14) and / or the optical system (18) are / is controlled by a computing unit (26) of the data glasses (12) in order to match the brightness, definition or hue of the reproduced calibration image (20) and / or calibration pattern (22).

Description

Background Technology

[0001] A method for calibrating data glasses with a virtual retina display has been proposed, wherein a scanned image is generated by a laser projector of the virtual retina display and imaged as beamlets through the optical system of the data glasses into the eyebox of the data glasses, wherein a calibration image and / or calibration pattern is output to the wearer of the data glasses by means of the beamlets, and wherein user feedback given by the wearer of the data glasses based on their perception is detected and used to calibrate the data glasses. Summary of the Invention

[0002] The present invention is based on a method for calibrating data glasses with a virtual retina display, wherein a scanned image is generated by a laser projector of the virtual retina display and imaged as a sub-beam into the eye box of the data glasses via the optical system of the data glasses, wherein a calibration image and / or calibration pattern is output to the wearer of the data glasses by means of the sub-beam, and wherein user feedback given by the wearer of the data glasses based on their perception is detected and used to calibrate the data glasses.

[0003] It is proposed that, in order to calibrate the data glasses, the computing unit of the data glasses controls automated mechanical actuators to adjust the position of the sub-beam, or causes the operation of manual mechanical actuators to manually adjust the position of the sub-beam, or causes the data glasses to be manually modified to manually adjust the position of the sub-beam, or the computing unit of the data glasses controls a laser projector and / or optical system to match the brightness, sharpness, or hue of the reproduced calibration image and / or calibration pattern.

[0004] This allows for advantageous optimization of calibration, especially on-site calibration. It can advantageously simplify and / or refine calibration. It facilitates user calibration. This advantageously eliminates the cost factor (visiting trained professionals to perform calibration), which can significantly reduce overall costs and significantly improve the overall user-friendliness and / or appeal of the data glasses.

[0005] "Data glasses" should be understood in particular as a wearable device (head-mounted display) that adds information to a user's field of vision. Data glasses preferably enable augmented reality, virtual reality, and / or mixed reality applications. Data glasses are also commonly referred to as smart glasses, VR glasses, or AR glasses. In particular, data glasses feature a virtual retinal display (also known as a retinal scanning display or light field display), which is well known to those skilled in the art. The virtual retinal display is specifically configured to sequentially scan image content by deflecting at least one visible laser beam (from at least one time-modulated light source, such as one or more (RGB) laser diodes of a laser projector) and image it directly onto the retina of the user's eye via optical elements. Virtual retinal displays are typically based on the use of at least one combiner. A combiner is an element that allows light from the environment to pass through to the eye (real image) while superimposing / combining the transmitted ambient light with the light of artificially generated image content (augmented image / scanned image) from the laser projector of the virtual retinal display. One known type of combiner is the so-called free-space combiner. Free-space combiners can be integrated into the lenses of the data glasses. However, alternatively, free-space combiners can also be constructed as independent optical elements separate from the lens. Free-space combiners superimpose / combine an enhanced image / scanned image with an environmental image via the reflective or diffractive surfaces of the image content (scanned image) projected by a laser projector used as a virtual retinal display. Conversely, free-space combiners essentially allow light of other wavelengths contained in the environmental image to pass through unobstructed. This reflection or diffraction can be generated by reflection at refractive index interfaces and / or through diffractive structures (e.g., holograms). For example, holographic optics (HOEs) can be integrated into a lens as free-space combiners. HOEs possess advantageous high angular selectivity and wavelength selectivity to achieve the desired selective reflection effect.

[0006] Laser projectors typically emit lasers in at least the red, green, and blue spectral ranges. Additionally, laser projectors can emit infrared laser beams, which can be used, for example, to track the eye movements of a data glasses user. For this purpose, the laser projector can, for example, incorporate a laser feedback interferometry sensor. Then, a scanned image is generated by two-dimensionally deflecting the laser emitted by the laser projector using, for example, a MEMS mirror system of the laser projector with one tilting element (2-D-MEMS mirror) or multiple tilting elements (two 1-D-MEMS mirrors). This laser then writes a raster image onto the retina of the data glasses user. The laser beam generated by the laser projector is preferably designed, using a MEMS mirror system and a free-space combiner, to have a small beam diameter / circle of confusion at the location of the user's pupil. This small circle of confusion in the pupil plane of the user's eye is also called a sub-beam. The sub-beam is preferably a small region within the user's pupil through which the individual rays of all pixels of the scanned image pass. Therefore, complete image information (pixels) for each scanned image is contained within the sub-beam. If pupil movement is caused by the user's eye movements, the user will see a vignetted scan / enhanced image as long as the sub-beam remains within the pupillary area of ​​their eye. The area where the center of the user's pupil can move while the user still sees the complete image is called the "eyebox." Therefore, the "eyebox" should preferably be understood as a spatial region within which all the light rays from the laser projector's scan projection can pass through the user's entrance pupil. Using known eye-tracking technology, the data glasses can obtain information about the user's current pupil position and other parameters. The sub-beam can then be continuously moved via a 2D tilting mirror system of the data glasses, different from the MEMS mirror system of the laser projector, to follow the user's pupil movement (the principle of moving the sub-beam). Furthermore, by using a variable focal length lens (variable focus lens) in the optical path of the virtual retinal display, the imaging performance and / or image sharpness of the scan / enhanced image can be optimized.

[0007] Calibration images and / or calibration patterns are images or patterns specifically designed for performing calibration methods, particularly field calibration methods. In particular, calibration images and / or calibration patterns are generated using a laser from a laser projector. User feedback can be provided by the wearer of the data glasses in various ways, such as through acoustic signals, gestures, eye movements, eyelid movements, head movements, operating elements of the data glasses, or another device communicating with the data glasses (e.g., a smartphone), or other conceivable means of communication. Calibration itself may include software and / or hardware settings changes to the data glasses, particularly one or more components of the data glasses (e.g., the optical system, the laser projector, or the head-to-data-glass positioning element). "Set up" or "configured" should be understood in particular as specifically programmed, designed, and / or equipped. An object being set up or configured to perform a specific function should be understood in particular as the object satisfying and / or performing that specific function in at least one application and / or operating state.

[0008] Automated mechanical actuators can be, for example, electrically actuated linear actuators or the electric motor of the data glasses. Manual mechanical actuators can include, for example, manually operable adjustment wheels or manually operable adjustment sliders of the data glasses. Automated and / or manual mechanical actuators can be configured to adjust the components of the optical system of the data glasses to each other or internally. Mechanical actuators can be configured to adjust the components of the laser projector of the data glasses to each other or internally. Mechanical actuators can be configured to adjust the components for positioning the data glasses relative to the wearer's head / eyes. Manually modifying data glasses can particularly include replacing or manually deforming one or more components of the data glasses, such as nose pads, temples, or lens spacers. In particular, repositioning the data glasses relative to the wearer's head / eyes also results in adjustment of the position of the sub-beam. Manual mechanical actuators can be, for example, adjustment screws for adjusting interpupillary distance. Manual mechanical actuators can be, for example, adjustment screws on the eyeglass frame (e.g., at the ear) for changing the geometry of the glasses, such as changing the tilt of the temples relative to the lenses. Manual mechanical actuators can be, for example, adjusting screws, which are used to move optical components of an optical system (e.g., within an eyeglass frame), such as projection optics, lenses, etc.

[0009] The term "computing unit" should be understood in particular as a unit having information input, information processing, and information output capabilities. Advantageously, the computing unit has at least one processor, memory, input and output devices, other electrical components, running programs, regulation routines, control routines, and / or calculation routines. Preferably, the components of the computing unit are arranged on a common circuit board and / or advantageously arranged in a common housing, especially in the housing of the data glasses. Alternatively, the computing unit may also be arranged at least partially outside the data glasses (e.g., on a connected mobile device) or distributed (e.g., in the cloud).

[0010] Furthermore, it is proposed that the data glasses, particularly through a visual display generated by a virtual retina display or through acoustic sound output, provide the wearer with instructions on how to operate manual mechanical actuators to calibrate the data glasses, or what manual modifications must be made to the data glasses for calibration. This can advantageously and significantly simplify and / or accelerate calibration. It can advantageously achieve high user-friendliness. It can advantageously reduce the risk of erroneous calibration. It can advantageously enable on-site calibration, which can be performed by the user of the data glasses themselves. For example, the data glasses can deliver instructions visually and / or audibly, such as: “Turn screw number two three turns to the right.”

[0011] Furthermore, it is proposed that the following settings can be achieved by operating manual or automated mechanical actuators: the relative position of the lenses of the data glasses and / or the tilt of the temples of the data glasses; the setting of the hinges of the data glasses; the setting of the distance between the lenses of the data glasses; or the relative positioning and / or tilting of the optical elements of the optical system of the data glasses. This allows for optimal calibration, particularly in the sense of fitting the data glasses to different users, especially to fit different users' head geometries.

[0012] Furthermore, it is proposed that the nose pads of the data glasses be modified or replaced during manual modification. This would advantageously allow for simple matching of the data glasses to different users, especially to different users' head geometry. In particular, the nose pads include at least one or at least two nose pads, or consist of one or more nose pads. However, alternative configurations of the data glasses nose pads without nose pads are also conceivable.

[0013] Furthermore, it is proposed that the position of at least one tilting mirror, particularly for modifying the position of a sub-beam, be set using an automated mechanical actuator, particularly in the optical system of a data glasses, as part of a 2-D tilting mirror system. This advantageously allows for particularly precise calibration, especially without requiring specialized personnel. High user-friendliness is also advantageously achieved. In particular, this tilting mirror differs from the MEMS mirror system of a laser projector. Specifically, the primary function of the tilting mirror is to move the sub-beam, preferably performing pupil tracking of the sub-beam within the framework of the sub-beam moving principle.

[0014] Furthermore, it is proposed that the calibration image and / or calibration pattern displayed to the wearer of the data glasses comprises multiple, preferably geometrically identical, white surfaces, especially rectangles, circles, or other shapes, whose brightness is mutually adapted by the wearer to calibrate the surface brightness of the data glasses' image output, particularly individually. This advantageously enables particularly simple calibration of the surface brightness of the data glasses' image output, especially on-site calibration. The uniformity of the scanned image is not always guaranteed due to various factors, including the angle, wavelength, and / or temperature-dependent diffraction efficiency of the hologram used as a free-space combiner in the data glasses. For calibration, for example, white rectangles can be displayed side-by-side within the user's field of view. One of these rectangles can then be marked and brightened or darkened by the user's command or input until it is as bright as the adjacent rectangles. For example, the brightness variation of the rectangles can be achieved by setting on the laser projector or the optical system of the data glasses. This process is repeated for multiple rectangles until relative brightness information is obtained throughout the image. This information can then be used to uniformly illuminate the entire field of view during virtual retina display operation, especially without relying on factory calibration, which may no longer be applicable at this point. In particular, the size of the white surface (especially the rectangle) can be chosen to minimize the possibility of local brightness abrupt changes or deviations. It's conceivable that if a user perceives a brightness difference within a white surface, the user can change the size or position of the white surface.

[0015] Furthermore, it is proposed that the calibration image and / or calibration pattern displayed to the wearer of the data glasses comprises multiple, preferably geometrically identical, colored surfaces, especially rectangles, circles, or other shapes. The wearer of the data glasses adapts the hues of these colored surfaces to each other in order to calibrate the planar color uniformity of the data glasses' image output, particularly by individually adapting them, preferably by changing the RGB color mixing of the data glasses' image output planar color. This advantageously enables a particularly simple calibration of the color uniformity of the data glasses' image output, especially for on-site calibration. In particular, color uniformity calibration using colored surfaces can be performed similarly to the above-described calibration of planar brightness, wherein only the white surfaces are replaced with colored surfaces. It is particularly conceivable that, for color uniformity calibration, each RGB color is individually matched / calibrated, and / or an RGB laser beam is superimposed during color uniformity calibration, so that the user aims to make the colored surfaces have the highest possible "whiteness" during calibration. In particular, RGB color mixing achieves optimal adaptation when the superimposed RGB laser beam appears white to the wearer of the data glasses. During color uniformity calibration, users can mark individual colored surfaces and coordinate the corresponding red, green, and blue components through user commands or input, such as by brightening, darkening, or changing the wavelength, until the color impression of the colored surface appears pure white to the user. Changes in the brightness or wavelength of color components can be achieved, for example, by setting the laser projector or optical system of the data glasses.

[0016] If the calibration pattern displayed to the wearer of the data glasses comprises multiple areas with preferably high-contrast lines or shapes, such as line-to-line pairs, the wearer can adapt the image sharpness of these areas to each other to calibrate the planar image sharpness impression of the data glasses' image output, particularly by adapting them individually. This allows for simple and / or rapid sharpness calibration. Changes in the sharpness impression of the calibration pattern can be achieved, particularly by setting on a laser projector and preferably by setting the optical system, for example, by an electrically actuated zoom lens / variable focus lens. Alternatively, changes in the sharpness impression of the calibration pattern can be achieved by moving optical components in the optical path of the data glasses' optical system, for example, by means of adjusting screws or automated actuators. Furthermore, to achieve changes in sharpness impression, the image representing the calibration pattern can also be softened by software, for example, if a certain image area is "too sharp" and thus stands out relative to other image areas. For example, displaying a high-contrast pattern, such as black-and-white separated lines, to the user within a portion of the field of view. The user now adjusts the sharpness of the lines using pre-set or instructed settings until they achieve a particularly satisfactory (high) contrast. Calibration is preferably performed at multiple locations within the user's field of view until the system is able to determine a good compromise sharpness setting for the entire image, for example, through interpolation or averaging.

[0017] Furthermore, it is proposed that the calibration pattern displayed to the wearer of the data glasses includes a grid structure and / or scale, wherein the wearer is asked to provide feedback as user feedback regarding which parts of the grid structure and / or scale are currently perceptible, wherein the coordinates of the center of the current field of view are determined based on this user feedback, and wherein the center of the future image output of the data glasses is calibrated based on the determined coordinates, particularly by manipulating the laser projector and / or optical system. This advantageously enables particularly simple calibration of the field of view, especially on-site calibration. To determine the current field of view, the sub-beam preferably remains in a fixed position and, for example, displays a grid structure. To perform calibration, the user, for example, informs the system / data glasses which intersection of the grid structure is directly in front of him. The data glasses (especially a virtual retinal display) can then, for example, match the image content of the output scanned image or the optical path of the virtual retinal display such that this position becomes the center of the new future field of view, and / or the image information to be displayed is arranged around the center of the determined field of view. Furthermore, it is conceivable that users could determine where the field of view should be located through this calibration or a similar process—for example, not in the center of their line of sight, but slightly offset to the right, left, up, or down. To do this, the user could read the desired eccentric coordinates of a calibration pattern constructed as a grid and inform the data glasses. The grid could be constructed as a Cartesian mesh. Alternatively, the grid could be constructed using markers in the field of view.

[0018] Furthermore, particularly high user-friendliness and / or suitability for field calibration can be advantageously achieved by means of at least one microphone for detecting voice commands, a push-button switch on the data glasses, a camera for gesture recognition, an eye-tracking system on the data glasses for detecting gaze commands, or by means of user feedback from the wearer of the data glasses input into an external mobile device (such as a smartphone or tablet).

[0019] Furthermore, it is proposed that wearer-specific calibration settings be stored in internal or external storage units (e.g., cloud, mobile devices, etc.), particularly in the storage unit of the data glasses, for later retrieval, such as for resetting wearer-specific calibration settings. This advantageously achieves high user-friendliness. It can advantageously simplify the use of data glasses by multiple users. In particular, the data glasses store and use / provide for use each of the aforementioned calibrations in order to present an optimized image with optimized usability to the user / multiple users of the data glasses. In particular, the data glasses are configured to store multiple calibrations assigned to different users.

[0020] Furthermore, a computing unit for performing the above-described methods and / or data glasses having a virtual retinal display and a computing unit are proposed. This advantageously provides data glasses with high user-friendliness, particularly incorporating on-site calibration options.

[0021] The method according to the invention, the computing unit according to the invention, and the data glasses according to the invention are not intended to be limited to the applications and embodiments described above. In particular, the method according to the invention, the computing unit according to the invention, and the data glasses according to the invention may have a number different from the number of individual elements, components, and units and method steps mentioned herein in order to achieve the functions described herein. Furthermore, the numerical ranges given in this disclosure should also be considered as values ​​falling within the stated limits being disclosed and freely usable. Attached Figure Description

[0022] Other advantages are described in the following figures. One embodiment of the invention is illustrated in the figures. The figures, description, and claims contain multiple combinations of features. Those skilled in the art will appropriately consider these features individually and combine them into other meaningful combinations.

[0023] The attached diagram shows: Figure 1a A schematic diagram of data glasses with a virtual retina display, viewed from above. Figure 1b A schematic diagram of the data glasses viewed from the front. Figure 2 A schematic flowchart of a method for calibrating data glasses. Figure 3 An exemplary calibration image used for area brightness calibration. Figure 4 An exemplary calibration image used for color uniformity calibration. Figure 5 An example calibration image used for image sharpness calibration. Figure 6 The first exemplary calibration image used for field of view calibration, and Figure 7 A second exemplary calibration image used for field of view calibration. Detailed Implementation

[0024] Figure 1a and Figure 1bDifferent views of the data glasses 12 are schematically shown. The data glasses 12 include a frame 62. The data glasses 12 include temples 32 and 32'. The data glasses 12 include eyeglass hinges 34 and 34'. Each temple 32 and 32' is hinged to the frame 62 via an eyeglass hinge 34 and 34'. The data glasses 12 include lenses 30 and 30'. The lenses 30 and 30' are embedded in the frame 62. The data glasses 12 include nose pads 38. The nose pads 38 are replaceable. Different nose pads 38 can be set / adapted for different users of the data glasses 12. The data glasses 12 includes a setting function for setting the distance 36 between the lenses 30 and 30'. The data glasses 12 includes a computing unit 26. The computing unit 26 is configured to be integrated into the data glasses 12. Alternatively, the computing unit 26 may also be integrated into an external mobile device 58, which is at least communicatively connected to the data glasses 12. The data glasses 12, particularly the computing unit 26, has a storage unit 60. The storage unit 60 is configured to store wearer-specific calibration settings. Based on the stored data in the storage unit 60, wearer-specific calibration settings can be reset, or settings can be switched between different wearers of the same data glasses 12. Furthermore, it is conceivable that the data glasses can automatically identify which currently stored calibration setting is appropriate, for example, based on user identification.

[0025] The data glasses 12 have a virtual retinal display 10. The virtual retinal display 10 is configured to display artificially generated image content / scanned image 16 (see...). Figures 3 to 7 The laser projector 14 is projected directly onto the retina of the user's eye on the data glasses 12. The data glasses 12 have a laser projector 14. The laser projector 14 is exemplarily integrated into one temple 32, 32' of the data glasses 12. The laser projector 14 is configured to generate visible laser light. The visible laser light generates a scanned image 16. The laser projector 14 includes a MEMS mirror system (not shown) for scanning the visible laser light from the laser projector 14 to generate the two-dimensional scanned image 16. The data glasses 12 includes a tilting mirror 40. The tilting mirror 40 is configured to control the position of the laser light output by the laser projector 14, particularly the position of a sub-beam of the virtual retina display 10. The data glasses 12 have an optical system 18. The optical system 18 includes a deflection element 64 (see...). Figure 1a and 1b(Comprehensive view). Deflection element 64 is configured as a holographic optical element (HOE). Deflection element 64 is integrated into one of lenses 30, 30'. Deflection element 64 is configured to deflect the laser output by laser projector 14 toward the pupil plane 66 of data glasses 12. The pupil plane 66 of data glasses 12 is defined by a plane in which the wearer's eyes are located when data glasses 12 are operated correctly. Deflection element 64 is configured to focus the laser output by laser projector 14 onto the pupil plane 66 of data glasses 12. Deflection element 64 is configured to generate a sub-beam. Optical system 18 may also include other optical elements (not shown here), such as a variable focus lens. The scanned image 16 generated by laser projector 14 is imaged as a sub-beam into the eye box of data glasses 12 through optical system 18 of data glasses 12.

[0026] The data glasses 12 have an automated mechanical actuator 24. During calibration, the automated mechanical actuator 24 is controlled by the computing unit 26 of the data glasses 12 to adjust the position of the sub-beams. The data glasses 12 also have a manual mechanical actuator 28. During calibration, the manual mechanical actuator 28 is operated by the wearer of the data glasses 12 to adjust the position of the sub-beams. The relative position and / or relative tilt of the lenses 30, 30' relative to the temples 32, 32' are set by operating the manual mechanical actuator 28 or the automated mechanical actuator 24. The eyeglass hinges 34, 34' of the data glasses 12 are set alternatively or additionally by operating the manual mechanical actuator 28 or the automated mechanical actuator 24. The distance 36 between the lenses 30, 30' of the data glasses 12 is set alternatively or additionally by operating the manual mechanical actuator 28 or the automated mechanical actuator 24. The relative positioning and / or tilting of the optical elements of the optical system 18 of the data glasses 12 are performed by operating a manual mechanical actuator 28 or an automated mechanical actuator 24, either by means of the optical actuator 28.

[0027] Data glasses 12 have microphone 50 (see Figure 1b The microphone 50 is configured to detect user feedback and / or voice commands from the wearer of the data glasses 12, particularly aspects related to the calibration of the data glasses 12. The data glasses 12 has a speaker 68 (see [link to speaker]). Figure 1b The speaker 68 is configured to output setting commands to the wearer of the data glasses 12 during calibration, especially when operating the manual mechanical actuator 28. The data glasses 12 has a push-button switch 52 (see...). Figure 1bThe push-button switch 52 is configured to manually set / adjust the status of the data glasses 12. The push-button switch 52 is also configured to receive user feedback from the wearer of the data glasses 12, particularly regarding the calibration of the data glasses 12. The data glasses 12 has a camera 54 (see [link]). Figure 1b Camera 54 is configured to perform gesture recognition. During calibration, the state of the data glasses 12 is changed / set based on the recognized gestures. Camera 54 is used to receive user feedback from the wearer of the data glasses 12 via gesture recognition. Computation unit 26 is configured to process and recognize the gestures recorded by camera 54. The data glasses 12 includes an eye-tracking system 56. The eye-tracking system 56 is exemplary constructed as a known LFI eye-tracking system that utilizes the "bright pupil effect". However, alternative configurations of the eye-tracking system 56 are also conceivable. The eye-tracking system 56 is configured to receive user feedback from the wearer of the data glasses 12. Computation unit 26 is configured to process and evaluate eye movements recorded by the eye-tracking system 56. For example, detecting a specific gaze direction or blink code (so-called gaze command) with the aid of the eye-tracking system 56 can be recognized as user feedback. In addition, an external mobile device 58 is configured to receive user feedback, such as through touchscreen control of the mobile device 58.

[0028] Figure 2 A schematic flowchart of a method for calibrating data glasses 12 is shown. In at least one method step 70, calibration is initiated by the user, particularly in-situ calibration. The user can select from multiple calibration options (area brightness calibration, color uniformity calibration, field of view calibration, etc.). Furthermore, it is conceivable that after calibration is initiated, all necessary calibration steps are automatically performed sequentially. In at least one method step 72, a scanned image 16 is generated by a laser projector 14 and imaged as a sub-beam into the eye socket of the data glasses 12 via the optical system 18 of the data glasses 12. The sub-beam generated in method step 72 contains a calibration image 20 and / or a calibration pattern 22. By being imaged into the eye socket of the data glasses 12, the calibration image 20 and / or the calibration pattern 22 are output to the current wearer of the data glasses 12 via the sub-beam.

[0029] In at least one method step 74, the area brightness of the image output of the data glasses 12 is calibrated. In at least one method step 76, the color uniformity of the image output of the data glasses 12 is calibrated. In at least one method step 78, the image sharpness impression of the image output of the data glasses 12 is calibrated. In at least one method step 80, the field of view of the data glasses 12 is calibrated. Calibration steps 74, 76, 78, and 80 can be performed independently of each other in any order. In at least one additional method step 82, which is particularly the same for all calibration steps 74, 76, 78, and 80, user feedback given by the wearer of the data glasses 12 based on their perception is detected and used to calibrate the data glasses 12. User feedback from the wearer of the data glasses 12 is detected here by means of at least one microphone 50 in the form of voice commands, by means of a push-button switch 52 on the data glasses 12, by means of a camera 54 in the form of recognized gestures, by means of an eye-tracking system 56 in the form of gaze commands, or by means of input to an external mobile device 58.

[0030] Based on user feedback, in at least one method step 84, to calibrate the data glasses 12, the computing unit 26 of the data glasses 12 manipulates an automated mechanical actuator 24 to adjust the position of the sub-beam. In method step 84, by manipulating the automated mechanical actuator 24, the position of the tilting mirror 40 of the optical system 18 of the data glasses 12, particularly modifying the position of the sub-beam, can be adjusted. Alternatively or additionally, in method step 86, the operation of a manual mechanical actuator 28 can be induced to manually adjust the position of the sub-beam. In method steps 84 and 86, by operating the manual mechanical actuator 28 or the automated mechanical actuator 24, the relative position of a lens 30, 30' and / or the tilt of the temples 32, 32' relative to the data glasses 12 can be matched, the distance 36 between the lenses 30, 30' of the data glasses 12 can be set, or the relative positioning and / or tilting of the optical elements of the optical system 18 of the data glasses 12 can be performed.

[0031] Alternatively or by using actuators 24 and 28, manual modification of the data glasses 12 can be induced during the calibration process in method step 88 to manually adjust the position of the sub-beams. In method step 88, when manually modifying the data glasses 12, for example, the nose pad 38 of the data glasses 12 can be modified or replaced. In method step 86 of performing manual adjustment and / or method step 88 of performing manual modification, instructions are output to the wearer of the data glasses 12 via a visual display generated by the virtual retinal display 10 or via acoustic sound output, such as the acoustic sound output of the data glasses 12 or the mobile device 58, indicating how the manual mechanical actuator 28 must be operated to calibrate the data glasses 12 accordingly, or what kind of manual modification must be performed on the data glasses 12 to calibrate it accordingly.

[0032] Alternatively, or by means of mechanical adjustment or modification using actuators 24, 28, in method step 90, during the calibration process, the computing unit 26 of the data glasses 12 controls the laser projector 14 and / or the optical system 18 to match the brightness, sharpness, or hue of the reproduced calibration image 20 and / or calibration pattern 22.

[0033] In at least one additional method step 92, wearer-specific calibration settings are stored in the internal or external storage unit 60 of the data glasses 12 for later retrieval, for example, for resetting the wearer-specific calibration settings.

[0034] In method step 74 of calibrating surface brightness, in sub-method step 94, a calibration image 20 is displayed to the wearer of the data glasses 12. This calibration image includes multiple geometrically identical white surfaces 42, 42' (see [link to method 74]). Figure 3 ). Figure 3 The white faces 42, 42' are exemplarily shown as rectangles. However, they can also be circles, polygons, or have other shapes. Based on user feedback, the brightness of the white faces 42, 42' is individually adapted to each other manually and / or automatically to calibrate the area brightness of the image output of the data glasses 12. To this end, in another sub-method step 96, the wearer of the data glasses 12 selects a white face 42, or displays one of the white faces 42 as active to the wearer of the data glasses 12. Figure 3 In this example, this is achieved by displaying two small triangles above and below the activated white surface 42. Method step 90 is performed, in which the computing unit 26 manipulates the laser projector 14 and / or the optical system 18 to match the brightness of a local surface, iteratively matching the brightness (e.g., by command or manual setting) until it is adapted to the adjacent white surface 42' in the wearer's field of view. This process is then repeated for the entire field of view.

[0035] In step 76 of the method for calibrating color uniformity, in sub-method step 98, a calibration image 20 is displayed to the wearer of the data glasses 12. This calibration image includes multiple geometrically identical color surfaces 44, 44' (see [link to method 1]). Figure 4 ). Figure 4 The colored (e.g., red, green, or blue) surfaces 44, 44' are exemplarily shown as rectangles. However, they can also be circles, polygons, or have other shapes. Based on user feedback, the hues of the colored surfaces 44, 44' are individually adapted to each other, either manually or automatically, to calibrate the surface brightness of the image output of the data glasses 12. To do this, in another sub-method step 100, the wearer of the data glasses 12 selects a colored surface 44, or one of the colored surfaces 44 is shown to the wearer of the data glasses 12 as active. Figure 4 In this example, this is achieved by displaying two small triangles above and below the activated colored surface 44. By performing method step 90, where the computing unit 26 manipulates the laser projector 14 and / or the optical system 18 to match local hues, iteratively matching the hues (e.g., by command or manual setting) until they fit with adjacent colored surfaces 44' in the wearer's field of view. This process is then repeated for the entire field of view. Alternatively, in method step 76 for calibrating color uniformity, the RGB color mixing can also be directly calibrated, i.e., all light colors can be superimposed, and the goal of the calibration can be to achieve the purest possible "whiteness" of colored surfaces 44, 44'.

[0036] In step 78 of the method for calibrating image sharpness impression, in sub-method step 102, a calibration pattern 22 is displayed to the wearer of the data glasses 12. This calibration pattern comprises multiple regions 46 having high-contrast lines or shapes, such as line-to-line (see [link to method]). Figure 5 Based on user feedback, the sharpness impressions of region 46 are individually or in groups adapted to each other, manually and / or automatically, to calibrate the image sharpness impressions of the image output from the data glasses 12. By performing method step 90, in which the computing unit 26 manipulates the laser projector 14 and / or the optical system 18 to match local image sharpness, the image sharpness of the calibration pattern 22 in a region 46 is iteratively matched (e.g., by command or manual setting) until it matches the image sharpness of adjacent regions 46 in the wearer's field of vision. Alternatively, local image sharpness can also be matched using optical elements (e.g., a variable focus lens) by performing one of method steps 84, 86 (in which actuators 24, 28 are automated or manually operated). This process is then repeated for the entire field of vision.

[0037] In method step 80 of calibrating the field of view, in sub-method step 108, a calibration pattern 22 is displayed to the wearer of the data glasses 12. This calibration pattern includes a grid structure 104 (see [link to method 108]). Figure 6) or scale 106 (see Figure 7 In at least one additional sub-method step 110, the wearer of the data glasses 12 is asked, by means of a virtual retinal display 10, to provide feedback as user feedback regarding which parts of the grid structure 104 or scale 106 are perceptible to him / her, and / or which coordinates of the grid structure 104 or scale 106 are currently the center of the field of view perceptible to the wearer of the data glasses 12. In another sub-method step 48, the center of the future image output of the data glasses 12 is set based on the coordinates thus determined. The new center of the future image output is here set by performing one or more method steps indicated by abbreviations 84, 86, 88, and 90, particularly by software-based manipulation, by computer-controlled or manually controlled actuators, and / or by manual modification of the data glasses 12.

Claims

1. A method for calibrating data glasses (12) with a virtual retinal scan display (10), wherein, A scanned image (16) is generated by the laser projector (14) of the virtual retinal display (10), and the scanned image is imaged as a sub-beam through the optical system (18) of the data glasses (12) into the eye box of the data glasses (12), wherein a calibration image (20) and / or a calibration pattern (22) are output to the wearer of the data glasses (12) by means of the sub-beam, and wherein user feedback, especially conscious user feedback, given by the wearer of the data glasses (12) based on their perception, is detected and used to calibrate the data glasses (12), characterized in that, in order to calibrate the data glasses (12). The computing unit (26) of the data glasses (12) controls an automated mechanical actuator (24) to adjust the position of the sub-beam, or The mechanical actuator (28) is activated to manually adjust the position of the sub-beam, or This prompts the data glasses (12) to be manually modified to manually adjust the position of the sub-beam, or The laser projector (14) and / or the optical system (18) are controlled by the computing unit (26) of the data glasses (12) to match the brightness, sharpness or hue of the reproduced calibration image (20) and / or calibration pattern (22).

2. The method according to claim 1, characterized in that, The data glasses (12) provide instructions to the wearer of the data glasses (12) in particular through a visual display generated by the virtual retina display (10) or through an acoustic sound output, indicating how the manual mechanical actuator (28) must be operated to calibrate the data glasses (12) or what manual modifications must be made to the data glasses (12) to calibrate the data glasses (12).

3. The method according to claim 1 or 2, characterized in that, The following settings are configured by operating the manual mechanical actuator (28) or the automated mechanical actuator (24): the relative position of the lenses (30, 30') of the data glasses (12) and / or the tilt of the temples (32, 32') of the data glasses (12), the setting of the eyeglass hinges (34, 34') of the data glasses (12), the setting of the distance (36) between the lenses (30, 30') of the data glasses (12), or the relative positioning and / or tilting of the optical elements of the optical system (18) of the data glasses (12) relative to each other.

4. The method according to any one of the preceding claims, characterized in that, When manually modifying the data glasses (12), modify or replace the nose pads (38) of the data glasses (12).

5. The method according to any one of the preceding claims, characterized in that, The position of at least one tilting mirror (40) of the optical system (18) of the data glasses (12) is set by manipulating the mechanical actuator (24) of the control automation, the at least one tilting mirror modifying the position of the sub-beam in particular.

6. The method according to any one of the preceding claims, characterized in that, The calibration image (20) and / or calibration pattern (22) displayed to the wearer of the data glasses (12) includes a plurality of white surfaces (42, 42'), preferably geometrically identical white surfaces, especially rectangular, circular or other shapes, the brightness of the white surfaces being mutually adapted by the wearer of the data glasses (12) in order to calibrate the surface brightness of the image output of the data glasses (12), especially individually.

7. The method according to any one of the preceding claims, characterized in that, The calibration image (20) and / or calibration pattern (22) displayed to the wearer of the data glasses (12) comprises multiple colored surfaces (44, 44'), preferably geometrically identical colored surfaces, especially rectangular, circular or other shapes, which are adapted by the wearer of the data glasses (12) to each other in order to calibrate the planar color uniformity of the image output of the data glasses (12), especially individually, preferably by means of planar changes in the RGB color mixing of the image output of the data glasses (12).

8. The method according to any one of the preceding claims, characterized in that, The calibration pattern (22) displayed to the wearer of the data glasses (12) comprises a plurality of regions (46) having lines or shapes with preferably high contrast, such as line-to-line, which are adapted by the wearer of the data glasses (12) to the image sharpness of the regions in order to calibrate the planar image sharpness impression of the image output of the data glasses (12), particularly individually or in groups.

9. The method according to any one of the preceding claims, characterized in that, The calibration pattern (22) displayed to the wearer of the data glasses (12) includes a grid structure (104) and / or a scale (106), wherein the wearer of the data glasses (12) is asked to provide feedback as user feedback regarding which parts of the grid structure (104) and / or the scale (106) are currently perceptible, wherein the coordinates of the center of the current field of view are determined based on the user feedback, and wherein the center of the future image output of the data glasses (12) is calibrated based on the determined coordinates, in particular by manipulating the laser projector (14) and / or the optical system (18).

10. The method according to any one of the preceding claims, characterized in that, User feedback from the wearer of the data glasses (12) is detected by means of: at least one microphone (50) for detecting voice commands; a push-button switch (52) on the data glasses (12); a camera (54) for gesture recognition; an eye-tracking system (56) of the data glasses (12) for detecting gaze commands; or input to an external mobile device (58), such as a smartphone or tablet.

11. The method according to any one of the preceding claims, characterized in that, The wearer-specific calibration settings are stored in an internal or external storage unit (60) for later retrieval, for example, for resetting the wearer-specific calibration settings.

12. A computing unit (26) for performing the method according to any one of the preceding claims.

13. Data glasses (12) having a virtual retina display (10) and a computing unit (26) according to claim 12.

Images