Method for customizing a head-mounted device adapted to generate virtual images - Patent Application 20070122997

Abstract

A method for customizing a head-mounted device adapted to generate a virtual image for a wearer, the method including: obtaining a 3D pupil position of the wearer in a reference frame and corresponding to a predetermined gaze direction; and customizing the head-mounted device based on the 3D pupil position such that a position of a focus area (EMB) at least partially coincides with the pupil position in the predetermined gaze direction, wherein customizing the head-mounted device includes controlling recording of a holographic mirror based on the 3D pupil position in the reference frame.

Description

Technical Field

[0001] The present invention relates to a method, a device, and a computer program product for customizing a head-mounted device adapted to generate a virtual image for a wearer.

Background Art

[0002] Existing display optical devices, especially those enabling see-around or see-through vision, are standard devices. In other words, in such devices, the possibility of adjustment is very limited even if provided. In particular, the display device does not adapt to a specific user even if it adapts to an average user.

[0003] In addition to this, even if the information displayed to the user appears at the same location on different devices, if the device is not customized for the user, a part of the virtual image may not be fully visible to the user, thereby restricting the virtual field of view.

[0004] Regarding conventional optical devices, especially ophthalmic devices, when using a standard display optical device, each individual user does not have the same visual experience.

[0005] For example, the information displayed to the user is not displayed at the same location within the field of view for each user. Typically, information that should appear on the side of the field of view may appear at the center of the user's field of view or may not even appear within the user's field of view depending on the user.

[0006] Therefore, there is a need for a method for providing a display optical device that is better adapted to the users of such devices.

Summary of the Invention

Means for Solving the Problems

[0007] For this purpose, the present invention proposes a method for customizing a head-mounted device adapted to generate a virtual image for a wearer, the method comprising - Reference coordinate system acquiring the 3D pupil position of the wearer corresponding to a predetermined gazing direction in - customizing the head-mounted device based on the 3D pupil position such that the position of the focus area (EMB) at least partially coincides with the pupil position in the predetermined gazing direction, and customizing the head-mounted device comprises Reference coordinate system controlling the recording of the holographic mirror based on the 3D pupil position in

[0008] Advantageously, the method enables customizing the head-mounted device so that the wearer can view the virtual image regardless of the anatomy of the wearer's face by customizing the head-mounted device based on the provided 3D pupil position, thereby ensuring an accurate focus of the virtual image through the wearer's pupils.

[0009] Another potential advantage of the method is to improve the wearer's comfort by acquiring the 3D pupil position, especially in a specific mode, and the method enables customizing the head-mounted device so that the wearer can view the virtual image regardless of the wearer's wearing preference or the wearing state most suitable for a given activity or a given visual task. Further, the provided 3D pupil position corresponds to a specific predetermined gazing direction, whereby the wearer can select to maximize comfort.

[0010] According to further embodiments that can be considered alone or in any possible combination, - the 3D pupil position is acquired in Reference coordinate system linked to the head-mounted device and / or - the method, before acquiring the 3D pupil position, in Reference coordinate systemfurther includes determining the 3D pupil position in, and / or - The customized head-mounted device comprises a light source configured to emit a light beam, and a reflective element configured to receive the light beam and redirect the light beam towards a focus area (EMB), and / or - The reflective element comprises a holographic mirror, and / or - The head-mounted device comprises a scanning element configured to receive the light beam and scan the received light beam towards the reflective element, and / or - During customization of the head-mounted device, at least one of the light source, the scanning element, and / or the reflective element is Reference coordinate system adapted based on the 3D pupil position in, and / or - During customization of the head-mounted device, the position and / or orientation of at least one of the light source, the scanning element, and the reflective element is Reference coordinate system adjusted based on the 3D pupil position in, and / or - During customization of the head-mounted device, the holographic mirror is Reference coordinate system recorded based on the 3D pupil position in, and / or - The method further includes obtaining at least one fitting parameter, the 3D pupil position is determined based on the at least one fitting parameter, and / or - The method further includes obtaining at least one centering parameter, the 3D pupil position is determined based on the at least one centering parameter, and / or - The method further includes, before customizing the head-mounted device, Reference coordinate system obtaining at least one set parameter value of the head-mounted device related to the position of the focus area in, and / or - During customization of the head-mounted device, at least one set parameter is customized and updated based on the obtained 3D pupil position, and / or - Obtaining the 3D pupil position and customizing the head-mounted device based on the obtained 3D pupil position are repeated over time and / or - The position of the focus area (EMB) includes the position of a point and / or - The position of the focus area (EMB) includes the position of a surface and / or - The position of the focus area (EMB) includes the position of a volume and / or - The position of the pupil includes the position of a point and / or - The position of the pupil includes the position of a surface and / or - The head-mounted device includes a frame and / or - The 3D pupil position is obtained in and / or linked to the frame of the head-mounted device Reference coordinate system and / or - The method further includes determining the 3D pupil position in and / or linked to the frame of the head-mounted device before obtaining the 3D pupil position and / or Reference coordinate system and / or - The method further includes positioning the head-mounted device on the wearer after providing the head-mounted device and / or - The head-mounted device includes a light source configured to emit a light beam and a scanning element configured to receive the light beam and reflect the received light beam and / or - The head-mounted device includes a reflecting element configured to receive the light beam reflected by the scanning element and redirect it towards the focus area (EMB) and / or - During customization of the head-mounted device, a reflecting element configured to receive the light beam reflected by the scanning element and redirect it towards the focus area (EMB) is added to the head-mounted device.

[0011] The present invention further relates to a method for customizing a head-mounted device adapted to generate a virtual image for a wearer, the method comprising - A head-mounted device configured to direct a light beam towards a focus area (EMB) is provided, a head-mounted device providing step, - The 3D pupil position of the wearer is linked to the head-mounted device and corresponds to a predetermined gaze direction Reference coordinate system is provided, a 3D pupil position providing step, - Customizing the head-mounted device based on the 3D pupil position such that the position of the focus area (EMB) at least partially coincides with the pupil position in a predetermined gaze direction, including a head-mounted device customizing step.

[0012] Advantageously, the method enables the head-mounted device to be customized so that the wearer can view a virtual image regardless of the anatomy of the wearer's face, by a head-mounted device customizing step in which customization is performed based on the provided 3D pupil position, thereby ensuring an accurate focus of the virtual image through the wearer's pupil.

[0013] Another potential advantage of the method is to improve the comfort of the wearer, especially in a particular mode, by the 3D pupil position providing step, the method enabling the head-mounted device to be customized so that the wearer can view a virtual image regardless of the wearer's wearing preference or the wearing state most suitable for a given activity or a given visual task. Further, the provided 3D pupil position corresponds to a specific predetermined gaze direction, whereby the wearer can select to maximize comfort.

[0014] According to further embodiments that can be considered alone or in any possible combination, - The position of the focus area (EMB) includes the position of a point and / or - The position of the focus area (EMB) includes the position of a surface and / or - The position of the focus area (EMB) includes the position of a volume and / or - The position of the pupil includes the position of the point, and / or - The position of the pupil includes the position of the surface, and / or - The head-mounted device includes a frame, and / or - During the 3D pupil position providing step, the 3D pupil position is linked to the frame of the head-mounted device Reference coordinate system and provided in, and / or - The method further includes a 3D pupil position determining step in which, before the 3D pupil position providing step, it is determined that the 3D pupil position is linked to the head-mounted device Reference coordinate system and / or - The method further includes a head-mounted device arranging step in which, after the head-mounted device providing step, the head-mounted device is arranged on the wearer, and / or - The head-mounted device provided during the head-mounted device providing step includes a light source configured to emit a light beam and a scanning element configured to receive the light beam and reflect the received light beam, and / or - The head-mounted device provided during the head-mounted device providing step includes a reflecting element configured to receive the light beam reflected by the scanning element and redirect it towards the focus area (EMB), and / or - During the head-mounted device customizing step, a reflecting element configured to receive the light beam reflected by the scanning element and redirect it towards the focus area (EMB) is added to the head-mounted device, and / or - During the head-mounted device customizing step, at least one of the light source, the scanning element, and / or the reflecting element is adapted based on the 3D pupil position linked to the head-mounted device Reference coordinate system and / or - During the head-mounted device customizing step, the position of at least one of the light source, the scanning element, and / or the reflecting element is linked to the head-mounted device Reference coordinate systemAdjusted based on the 3D pupil position in, and / or - During the head-mounted device customization step, the orientation of at least one of the light source, the scanning element, and / or the reflecting element is linked to the head-mounted device Reference coordinate system Adjusted based on the 3D pupil position in, and / or - The reflecting element comprises a holographic mirror, and / or - During the head-mounted device customization step, the holographic mirror is recorded based on the 3D pupil position linked to the head-mounted device Reference coordinate system Recorded based on the 3D pupil position in, and / or - The method further comprises a fitting parameter providing step in which at least one fitting parameter is provided, and / or - During the 3D pupil position providing step, the 3D pupil position is determined based on at least one fitting parameter, and / or - The method further comprises a centering parameter providing step in which at least one centering parameter is provided, and / or - During the 3D pupil position providing step, the 3D pupil position is determined based on at least one centering parameter, and / or - The method further comprises a setting parameter value providing step in which at least one setting parameter value related to the position of the focus area in the head-mounted device linked to the head-mounted device is provided before the head-mounted device customization step, and / or Reference coordinate system - During the head-mounted device customization step, at least one setting parameter is customized and updated based on the provided 3D pupil position, and / or - The 3D pupil position providing step and the head-mounted device customization step are repeated over time.

[0015] ​The present invention further relates to a device for determining the relative position of a head-mounted device configured to direct a light beam towards a focus area (EMB) and towards the wearer's pupil, the device comprising at least one position sensor, a memory, and a processing unit each communicating with one another, - the at least one position sensor is adapted to determine position data including the 3D position of the pupil when the wearer wears the head-mounted device and the 3D position of at least a part of the head-mounted device when the wearer wears the head-mounted device, - the memory is adapted to store the position data determined by the at least one position sensor, - the processing unit is adapted to determine the 3D position of the pupil in the Reference coordinate system linked to the head-mounted device based on the position data stored in the memory.

[0016] According to further embodiments that can be considered alone or in any possible combination, - the head-mounted device comprises a light source configured to emit a light beam and a scanning element configured to receive the light beam and reflect the received light beam, and / or - the head-mounted device comprises a reflecting element configured to receive the light beam reflected by the scanning element and redirect it towards the focus area (EMB), and / or - the device for determining the relative position between the head-mounted device and the wearer's pupil further comprises the head-mounted device.

[0017] According to a further aspect, the present invention relates to a computer program product comprising one or more stored instruction sequences accessible to a processor, the instructions, when executed by the processor, causing the processor to perform the steps of a method for customizing a head-mounted device according to the present invention.

[0018] The present invention further relates to a computer-readable medium carrying one or more instruction sequences of a computer program product according to the present invention.

[0019] Furthermore, the present invention relates to a program for causing a computer to execute a method for at least customizing the head-mounted device of the present invention.

[0020] The present invention also relates to a computer-readable storage medium on which a program is recorded, the program causing a computer to execute a method for at least customizing the head-mounted device of the present invention.

[0021] The present invention further relates to a device comprising a processor adapted to store one or more instruction sequences and to execute at least one of the steps of the method according to the present invention.

[0022] The present invention further relates to a device for customizing a head-mounted device adapted to generate a virtual image for a wearer, the device comprising at least a memory and at least one processing unit communicating with each other, - the memory is adapted to store position data including the 3D position of at least one pupil when the wearer wears the head-mounted device and the 3D position of at least a part of the head-mounted device when the wearer wears the head-mounted device, - the processing unit is based on the position data stored in the memory, Reference coordinate system is adapted to determine the 3D pupil position of the wearer therein, - the processing unit is adapted to determine data for customizing the head-mounted device based on the 3D pupil position of the wearer such that the position of the focus area (EMB) at least partially coincides with the 3D pupil position.

[0023] In an advantageous embodiment, the processing unit Reference coordinate systemconfigured to control the recording of a holographic mirror based on the 3D pupil position in

[0024] The present invention further relates to a head-mounted device configured to direct a light beam towards a focus area (EMB), the head-mounted device comprising the device described above.

[0025] The present invention further relates to a computer program product comprising one or more stored instruction sequences accessible to a processor, the instructions, when executed by the processor, causing the processor to - Reference coordinate system obtain the wearer's 3D pupil position corresponding to a predetermined gaze direction in - customize the head-mounted device based on the wearer's 3D pupil position such that the position of the focus area (EMB) at least partially coincides with the 3D pupil position.

[0026] In an advantageous embodiment, the one or more stored instruction sequences, when executed by the processor, cause the processor to Reference coordinate system control the recording of a holographic mirror based on the 3D pupil position in

[0027] Unless otherwise specified, as will be apparent from the following discussion, throughout this specification, in discussions using terms such as "computing", "calculating", etc., actions and / or processes of a computer or computing system, or similar electronic computing devices, which manipulate and / or transform data represented as physical quantities, such as electronic quantities in registers and / or memories of a computing system, to other data similarly represented as physical quantities in memories, registers, or other such information storage, transmission, or display devices of the computing system, are referred to.

[0028] Embodiments of the present invention may include an apparatus for performing the operations of this specification. This apparatus may be specially constructed for the desired purpose, or may comprise a general-purpose computer or a digital signal processor (``DSP'') selectively activated or reconfigured by a computer program stored in the computer. Such a computer program may be stored on a computer-readable storage medium, such as any type of disk, including floppy disks, optical disks, CD-ROMs, magneto-optical disks, read-only memory (ROM), random access memory (RAM), electrically programmable read-only memory (EPROM), electrically erasable and programmable read-only memory (EEPROM), magnetic or optical cards, or any other type of medium suitable for storing electronic instructions and capable of being coupled to a computer system bus, but not limited thereto.

[0029] The processes and displays are not inherently related to any particular computer or other apparatus. Various general-purpose systems may be used with programs in accordance with the teachings of this specification, or it may prove convenient to construct more specialized apparatus to perform the desired method. The various desired structures of these systems will become apparent from the following description. In addition, embodiments of the present invention are not described with reference to any particular programming language. It will be understood that a variety of programming languages may be used to implement the teachings of the invention described herein.

[0030] Here, non-limiting embodiments of the present invention will be described with reference to the accompanying drawings.

Brief Description of the Drawings

[0031]

Figure 1

Figure 2B

Figure 3A

Figure 3B

Figure 3C

Figure 4

Figure 5

Figure 6

Figure 7

[0032] Elements in the drawings are shown for simplicity and clarity and are not necessarily drawn to scale. For example, some dimensions of the elements in the drawings may be exaggerated relative to other elements to help improve the understanding of the embodiments of the present invention.

[0033] The present invention relates to a method for customizing a head-mounted device adapted to generate a virtual image for a wearer.

[0034] As shown in FIGS. 1, 2A, and 2B, the method aims to customize the head-mounted device 10 such that when the wearer wears the head-mounted device 10, the generated virtual image is focused through the wearer's pupil 8.

[0035] As shown in FIGS. 3A, 3B, and 3C, the method - includes a 3D pupil position acquisition step S6A and / or a provision step S6B, and - a head-mounted device customization step S8.

[0036] The 3D pupil position acquisition step S6A may include receiving a 3D pupil position.

[0037] The method may further include a head-mounted device provision step S1. The head-mounted device provision step S1 may be executed before, after, or simultaneously with the 3D pupil position acquisition step S6A and / or the provision step S6B.

[0038] The relative position of the pupil 8 with respect to the head-mounted device 10 depends on the usage method of the head-mounted device by the wearer, which may include the wearer's facial anatomy, and / or the wearer's wearing preference, and / or the wearing state corresponding to the wearer's specific visual task or activity.

[0039] Advantageously, the method according to the present disclosure enables the head-mounted device 10 to be customized for the wearer's usage method based on the 3D pupil position acquisition step S6A and / or the provision step S6B.

[0040] During the head-mounted device provision step S1, a head-mounted device 10 configured to direct a light beam towards a focus area (EMB) is provided.

[0041] The head-mounted device 10 may be an augmented reality glasses or a virtual reality head-mounted device. The head-mounted device 10 may include one or more optical lenses 12, such as spectacle lenses, plano lenses, single-focus ophthalmic lenses, bifocal ophthalmic lenses, progressive ophthalmic lenses, etc., that are adapted to the wearer. The head-mounted device 10 may include a frame 14 to which two spectacle lenses are attached.

[0042] The light beam includes information intended to be displayed to the wearer.

[0043] The head-mounted device 10 may include a light source 16 configured to emit a light beam, such as a switchable light source.

[0044] The head-mounted device 10 may include a scanning element 18 configured to receive a light beam and scan the received light beam. The light source and / or the scanning element 18 may be attached to or integrated with the frame 14 of the head-mounted device 10. The scanning of the received light beam may include reflection and / or refraction of the received light beam.

[0045] The head-mounted device 10 may include a reflecting element 20 configured to receive a light beam reflected by the light source and / or by the scanning element 18 and redirect it towards a focus area (EMB). For example, the reflecting element 20 may be embedded in the optical lens 12 of the head-mounted device 10.

[0046] As shown in FIG. 2, the light beam can follow different paths 18A, 18B, 18C corresponding to different rays of the full beam scanned by the scanning element 18.

[0047] The reflective element 20 may comprise a passive holographic mirror. The holographic mirror is defined as being recorded using a holographic process. The mirror is used to redirect an optical beam generated from an image source in order to cause visualization of an image by the wearer. The holographic mirror is not used for reconstruction of the recorded holographic image (as in the case of conventional hologram viewing). By the recording, the mirror is given an optical function and, when redirected by the mirror, can modify the wavefront of the optical beam originating from the image source, if applicable. Thereby, since the optical lens 12 incorporating the holographic mirror can modify the optical beam generating an image on the wearer's eye, it becomes possible to correct the virtual vision of the wearer.

[0048] The reflective element 20 may comprise an electro-active holographic mirror. The holographic mirror can be configured in one or more regions of adjustable optical properties such as one or more values of refractive index, phase, reflectivity (value, angle, wavelength, or spectral curve), transmittance, etc. Advantageously, the optical properties of the head-mounted device 10 may be customized to the needs of the wearer.

[0049] The focus area (EMB) is associated with the eye's motion box defined as the converging spot of the optical beam. In other words, the focus area can be represented as a 3D viewing cone through which the information carried by the optical beam and displayed can be visually recognized by the human eye. In the sense of the disclosure, the position of the focus area can be understood as the position of the entire 3D viewing cone, or a part of the 3D viewing cone, such as a 2D surface corresponding to a cross-section of the 3D viewing cone orthogonal to the axis of the 3D viewing cone, or a point located on the axis of the 3D viewing cone.

[0050] Considering the setting configuration of the head-mounted device 10, the position of the focus area is also set Reference coordinate system in that which is linked to the head-mounted device 10.

[0051] During the 3D pupil position acquisition step S6A and / or the provision step S6B, the wearer's 3D pupil position is Reference coordinate system in, for example, linked to the head-mounted device 10 Reference coordinate system is provided in. Reference coordinate system may be linked to the frame 14 of the head-mounted device 10. The 3D pupil position is defined by the wearer or measured on the wearer so as to correspond to a predetermined gaze direction, preferably the direction used when visualizing a virtual image.

[0052] In the sense of the present disclosure, the pupil 8 should be understood as the entrance pupil of the wearer's eye and can be represented as a disk. The 3D position of the pupil 8 can be understood as the 3D position of the disk or the 3D position of a point such as the center of the disk.

[0053] Advantageously, the wearer's 3D pupil position is the same as the position of the eye's motion box or focus area Reference coordinate system is known in.

[0054] During the head-mounted device customization step S8, the head-mounted device 10 is customized based on the 3D pupil position such that the position of the focus area (EMB) at least partially coincides with the position of the pupil 8 in a predetermined gaze direction.

[0055] Advantageously, the head-mounted device 10 is customized to the wearer's needs, and the information intended for the wearer to view is effectively directed towards the wearer's pupil 8.

[0056] The predetermined gaze direction may correspond to a specific visual task. For example, the wearer may be prompted to look at an object at a known position corresponding to the predetermined gaze direction. The predetermined gaze direction may correspond to an initial value or a default value.

[0057] In the context of the present disclosure, "the position of the focus area (EMB) at least partially coincides with the position of the pupil 8" should be understood to mean that both positions overlap such that the complete information contained in the light beam and intended to be viewed by the wearer is guided through the entrance pupil of the wearer's eye.

[0058] During the head-mounted device customization step S8, a reflective element 20 configured to receive the light beam reflected by the scanning element 18 and redirect it towards the focus area (EMB) may be added to the head-mounted device 10. The reflective element 20 may be integrated with the optical lens 12 of the head-mounted device 10.

[0059] During the head-mounted device customization step S8, at least one of the light source 16, the scanning element 18, and / or the reflective element may be adapted based on the provided 3D pupil position. This adaptation may include adjusting the position and / or orientation of the light source 16, the scanning element 18, and / or the reflective element 20 to direct the light beam towards the pupil 8 of the wearer.

[0060] During the head-mounted device customization step S8, a holographic mirror may be recorded based on the provided 3D pupil position.

[0061] The light source can be arranged and adjusted to emit a recording beam to record the holographic mirror such that after the holographic mirror is recorded, the recording beam is reflected by the holographic mirror and the reflected recording beam converges towards the focus area (EMB).

[0062] Advantageously, the method enables customizing a standard head-mounted device 10 for a particular wearer by recording a holographic mirror adapted to the wearer.

[0063] As shown in FIG. 4, the method may further include a step S2 of arranging the head-mounted device on the wearer after the head-mounted device providing step S1. The head-mounted device 10 can be adjusted with respect to the face of the wearer.

[0064] Advantageously, the head-mounted device 10 is arranged in an optimal position for the wearer, thereby improving the comfort of the wearer.

[0065] Another advantage provided by the step S2 of arranging the head-mounted device is that it becomes possible to directly determine the 3D pupil position of the wearer with respect to the worn head-mounted device 10.

[0066] As shown in FIG. 4, the method may further include, before the 3D pupil position acquisition step S6A and / or the providing step S6B, Reference coordinate system , for example, a step S3 of determining the 3D pupil position in, for example, the one linked to the head-mounted device 10. Reference coordinate system

[0067] During the step S3 of determining the 3D pupil position, the 3D position of the pupil 8 with respect to the head-mounted device 10 may be directly measured. For example, the position measurement may be performed directly on the wearer after arranging the head-mounted device on the wearer during the step S2 of arranging the head-mounted device.

[0068] Alternatively, the 3D position of the pupil 8 may be calculated from measured values or a model. Such a model may preferably include superimposing a virtual image of the head-mounted device on the face of the wearer or on an image of the face of the wearer according to a predetermined usage method of the wearer.

[0069] Such measured values or models may include the distance between the main surface of the optical lens 12 and the eye of the wearer, and / or the distance between the main surface of the optical lens 12 and the center of rotation 9 of the eye of the wearer, and / or the pantoscopic angle and / or the wrap angle.

[0070] The pantoscopic angle is the angle in the vertical plane between the optical axis of the spectacle lens and the visual axis of the eye in the primary position, and is usually considered horizontal.

[0071] The wrap angle is the angle in the horizontal plane between the optical axis of the spectacle lens and the visual axis of the eye in the primary position, and is usually considered horizontal.

[0072] Instead of using a dedicated measurement device to determine the 3D position of the pupil, it is possible to use a device adapted to determine the 2D position of the pupil and perform successive iterations of position determination.

[0073] An example of a suitable device is described in EP2134249 and comprises a 2D camera and a clip having a mark attached to the glasses.

[0074] The clip is linked to the glasses Reference coordinate system (Of, Xf, Yf, Zf) is defined. By measuring the pupil positions on two images having two different head postures and the same fixation direction facing the camera, the position of the center of rotation of the eye in the defined Reference coordinate system becomes possible to determine.

[0075] This Reference coordinate system From the position of the center of rotation of the eye in (Of, Xf, Yf, Zf), it is possible to derive the position of the pupil in this Reference coordinate system (Of, Xf, Yf, Zf) corresponding to any fixation direction.

[0076] As shown in Figure 4, the method may further include an acquisition step S4A and / or a provision step S4B of at least one fitting parameter.

[0077] The fitting parameter may include a parameter related to the position of the frame 14 with respect to the face of the wearer during wearing.

[0078] As shown in FIGS. 6 and 7, the fitting parameter may include a distance DVO corresponding to the distance between the optical lens of the head-mounted device and the corneal apex of the wearer's eye.

[0079] The fitting parameter may include a distance D(ERC-lens) corresponding to the distance between the center of rotation 9 of the eye and the eyeball side surface of the optical lens of the head-mounted device.

[0080] The fitting parameter may include a distance D(EntPup-lens) corresponding to the distance between the pupil 8 and the eyeball side surface of the optical lens of the head-mounted device.

[0081] At least one fitting parameter can be characterized by the position of the optical lens of the head-mounted device linked to the worn head-mounted device along two horizontal axes (X and Z in FIG. 1). Reference coordinate system At least one fitting parameter can be characterized by the position of the optical lens of the head-mounted device determined in the head-mounted device linked to the worn head-mounted device along two horizontal axes (X and Z in FIG. 1).

[0082] At least one fitting parameter can be characterized by the position of the optical lens of the head-mounted device linked to the worn head-mounted device along two horizontal axes (X and Z in FIG. 1). Reference coordinate system At least one fitting parameter can be characterized by the position of the optical lens of the head-mounted device determined in the head-mounted device linked to the worn head-mounted device along two horizontal axes (X and Z in FIG. 1).

[0083] Advantageously, the position of the focus area (EMB) in the head-mounted device linked to the worn head-mounted device can be determined with improved accuracy along its two horizontal axes, thereby achieving a better match between the focus area (EMB) and the pupil 8. Reference coordinate system At least one centering parameter acquisition step S5A and / or provision step S5B may be further included as shown in FIG. 4.

[0084] As shown in FIG. 4, the method may further include an acquisition step S5A and / or a provision step S5B of at least one centering parameter.

[0085] The centering parameter may include a parameter related to the position of the optical lens 12 or the ophthalmic lens with respect to the face of the wearer of the head-mounted device 10.

[0086] The centering parameter may include the fitting height FH corresponding to the distance 1 / 2PD between the center of the nose and the pupil and / or the distance between the pupil and the lower edge of the frame.

[0087] This position can be characterized by the position of the optical lens in the head-mounted device linked along the horizontal axis (X in FIG. 1) and the vertical axis (Y in FIG. 1). Reference coordinate system It can be characterized by the position of the optical lens in the head-mounted device linked along the horizontal axis (X in FIG. 1) and the vertical axis (Y in FIG. 1).

[0088] As shown in FIGS. 6 and 7, any measurement value and / or model, and / or fitting parameter and / or centering parameter obtained and / or provided by this method may be Reference coordinate system directly determined in, for example, the (O, X, Y, Z) axis system on FIG. 6, in the head-mounted device linked. Reference coordinate system It may be directly determined in, for example, the (O, X, Y, Z) axis system on FIG. 6, in the head-mounted device linked.

[0089] Alternatively, the measurement value, model, and parameter may be first provided in, corresponding to the (O, Xf, Yf, Zf) axis system on FIG. 7, in the wearer's eye linked, and then Reference coordinate system converted in the head-mounted device linked. Reference coordinate system It may be converted in the head-mounted device linked.

[0090] Furthermore, during the 3D pupil position acquisition step S6A and / or the providing step S6B, the 3D pupil position may be determined based on at least one fitting parameter and / or at least one centering parameter.

[0091] Advantageously, the method enables the head-mounted device 10 to be customized to a wearing state corresponding to better wearing comfort, improved visual comfort, and the best visual correction for the wearer.

[0092] As shown in FIG. 4, the method Reference coordinate system in, for example, linked to the head-mounted device 10 Reference coordinate system in, may further include at least one setting parameter value acquisition step S7A and / or provision step S7B of the head-mounted device 10 related to the position of the focus area.

[0093] Such setting parameters may include the position, and / or orientation, and / or operating state of the light source 16, the scanning element 18, and / or the reflecting element 20 so as to be able to direct the light beam towards the wearer's pupil 8.

[0094] Furthermore, during the head-mounted device customization step S8, at least one setting parameter may be customized and updated based on the provided 3D pupil position.

[0095] Advantageously, the method enables the customization of a single head-mounted device 10 for different wearers, different wearing states, or different visual tasks implying different gazing directions.

[0096] An additional advantage of this method is that it is possible to store the setting parameters adapted to a specific wearer of the head-mounted device 10 under specific wearing conditions, so that these setting parameters can be read out later and applied to the head-mounted device 10.

[0097] In one embodiment, the 3D pupil position acquisition step S6A and / or provision step S6B, and the head-mounted device customization step S8 are repeated over time.

[0098] Advantageously, the head-mounted device 10 may be adapted to the various needs of the wearer.

[0099] As shown in FIG. 5, the present invention further relates to a device for determining the relative position of a head-mounted device 10 configured to direct a light beam towards a focus area (EMB) and towards the wearer's pupil 8, the device comprising at least one position sensor 2, a memory 4, and a processing unit 6 that communicate with each other.

[0100] In the sense of the present disclosure, the sensor 2, the memory 4, and the processing unit 6 that communicate with each other should be understood as either wired or wireless communication.

[0101] In an embodiment, the processing unit 6 may be, for example, part of a remote computing system.

[0102] This specification describes components and functions implemented in embodiments with reference to specific standards and protocols, but the present disclosure is not limited to such standards and protocols. Each standard of Internet and other packet-switched network transmissions (e.g., TCP / IP, UDP / IP, HTML, HTTP) represents an example of the state of the art. Such standards are regularly replaced by faster or more efficient equivalents having essentially the same functions. Wireless standards (e.g., RFID), short-range communications (e.g., Bluetooth, WiFi, Zigbee), and long-range communications (e.g., WiMAX, GSM, CDMA, etc.) are envisioned for use by a device for determining the relative position between the head-mounted device 10 and the wearer's pupil 8.

[0103] At least one position sensor 2 is adapted to determine position data at a given Reference coordinate system The position data includes at least the 3D position of the pupil 8 when the wearer wears the head-mounted device 10 and the 3D position of at least a part of the head-mounted device 10 when the wearer wears the head-mounted device 10.

[0104] Memory 4 is adapted to store position data determined by at least one position sensor 2.

[0105] Based on the position data stored in the memory, processing unit 6 is adapted to determine the 3D position of the pupil 8 in the head-mounted device 10 Reference coordinate system linked thereto.

[0106] Advantageously, the device enables determination of the 3D position of the wearer's pupil 8 in the head-mounted device 10 Reference coordinate system linked thereto.

[0107] In an embodiment, memory 4 may also include instructions for customizing the head-mounted device 10 based on the determined 3D position of the wearer's pupil 8.

[0108] Advantageously, the device enables customization of the head-mounted device 10 based on the wearer's 3D pupil position.

[0109] The device for determining the relative position of the head-mounted device 10 may itself comprise the head-mounted device 10. For example, position sensor 2 may be adapted to determine the position of the wearer's pupil 8 relative to its own position on the head-mounted device 10.

[0110] Advantageously, position sensor 2 has a fixed position in the head-mounted device 10 linked thereto, Reference coordinate system thus reducing by one the sources of error in determining the 3D position of the wearer's pupil 8.

[0111] The head-mounted device 10 may comprise a light source 16 configured to emit a light beam and a scanning element 18 configured to receive the light beam and reflect the received light beam.

[0112] The head-mounted device 10 may include a reflective element 20 configured to receive a light beam reflected by the scanning element 18 and redirect it towards the focus area (EMB).

[0113] In an embodiment, the position data determined by the position sensor 2 and stored in the memory 4 may include the position and / or orientation of the light source 16, the scanning element 18, and / or the reflective element 20.

[0114] In an embodiment, the memory 4 may also be linked to the head-mounted device 10 Reference coordinate system and include at least one stored set of parameter values of the head-mounted device 10 related to the position of the focus area in the head-mounted device 10. Such set of parameters may include the position, and / or orientation, and / or operating state of the light source 16, the scanning element 18, and / or the reflective element 20 so as to be able to direct the light beam towards the wearer's pupil 8.

[0115] In an embodiment, the memory 4 may include means for customizing the position, and / or orientation, and / or operating state of the light source 16, the scanning element 18, and / or the reflective element 20, and / or means for recording a holographic mirror based on instructions and / or data stored in the memory 4.

[0116] Advantageously, the device enables the customization of the head-mounted device 10 by customizing and updating at least one set of parameters.

[0117] Another object of the present invention is a computer program product including one or more stored instruction sequences accessible to a processor, the instructions, when executed by the processor, causing the processor to execute the steps of a method for customizing a head-mounted device according to the present invention.

[0118] Another object of the present invention is a computer-readable medium carrying one or more instruction sequences of a computer program product according to the present invention.

[0119] Another object of the present invention is a program for causing a computer to execute a method for customizing at least the head-mounted device of the present invention.

[0120] Another object of the present invention is a computer-readable storage medium on which a program is recorded, the program causing a computer to execute a method for customizing at least the head-mounted device of the present invention.

[0121] Another object of the present invention is a device comprising a processor adapted to store one or more instruction sequences and to execute at least one of the steps of the method according to the present invention.

[0122] The present invention has been described above using embodiments without limiting the general inventive concept.

[0123] Referring to the foregoing exemplary embodiments, many further modifications and variations will suggest themselves to those skilled in the art, but these are given by way of example only and are not intended to limit the scope of the present invention, which is determined solely by the appended claims.

[0124] In the claims, the word "comprising" does not exclude other elements or steps, and the indefinite article "a" or "an" does not exclude a plurality. The mere fact that different features are recited in mutually different dependent claims does not indicate that a combination of these features cannot be advantageously used. No reference signs in the claims should be construed as limiting the scope of the present invention.

Description of Signs

[0125] 2 Position sensor 4 Memory 6 Processing unit 8 Pupil 9 Rotation center 10 Head-mounted device 12 Optical lens 14 Frame 16 Light source 18 Scanning element 20 Reflective element

Claims

1. A method for customizing a head-mounted device adapted to generate a virtual image for a wearer, comprising: - obtaining the 3D pupil position of the wearer corresponding to a predetermined gazing direction in a reference coordinate system; - customizing the head-mounted device based on the 3D pupil position such that the position of the focus area EMB at least partially coincides with the 3D pupil position in the predetermined gazing direction; including; The method of customizing the head-mounted device includes controlling the recording of a holographic mirror based on the 3D pupil position in the reference coordinate system.

2. The method according to claim 1, wherein the 3D pupil position is obtained in a reference coordinate system linked to the head-mounted device.

3. The method according to claim 1 or 2, further comprising determining the 3D pupil position in a reference coordinate system linked to the head-mounted device before obtaining the 3D pupil position.

4. The customized head-mounted device comprises a light source configured to emit a light beam, and a reflective element configured to receive the light beam and redirect it towards the focus area EMB, wherein the reflective element comprises the holographic mirror. The method according to any one of claims 1 to 3.

5. The method according to claim 4, wherein during the customization of the head-mounted device, at least one of the light source or the reflective element is adapted based on the 3D pupil position in the reference coordinate system.

6. The method according to claim 5, wherein the head-mounted device comprises a scanning element configured to receive the light beam and scan the received light beam towards the reflective element.

7. The method according to claim 6, wherein the scanning element is adapted based on the 3D pupil position in the reference coordinate system during the customization of the head-mounted device.

8. The method according to claim 7, wherein during the customization of the head-mounted device, the position and / or orientation of at least one of the light source, the scanning element, and the reflective element is adjusted based on the 3D pupil position in the reference coordinate system.

9. The method according to any one of claims 1 to 8, wherein during the customization of the head-mounted device, the holographic mirror is recorded based on the 3D pupil position in the reference coordinate system.

10. The method according to any one of claims 1 to 9, further comprising obtaining at least one fitting parameter, wherein the 3D pupil position is determined based on the at least one fitting parameter.

11. The method according to any one of claims 1 to 10, further comprising obtaining at least one centering parameter, wherein the 3D pupil position is determined based on the at least one centering parameter.

12. Before customizing the head-mounted device, - further comprising obtaining at least one setting parameter value of the head-mounted device related to the position of the focus area EMB in the reference coordinate system, The method according to any one of claims 1 to 11, wherein during the customization of the head-mounted device, the at least one setting parameter is customized and updated based on the obtained 3D pupil position.

13. The method according to any one of claims 1 to 12, wherein obtaining the 3D pupil position and customizing the head-mounted device based on the obtained 3D pupil position are repeated over time.

14. A device for customizing a head-mounted device adapted to generate a virtual image for a wearer, the head-mounted device comprising: - a light source configured to emit a light beam; and a reflective element comprising a holographic mirror configured to receive the light beam and redirect it towards a focus area EMB; - a scanning element configured to receive the light beam and scan the received light beam towards the reflective element; The device for customization comprises at least a memory and at least one processing unit communicating with each other. - The memory is adapted to store position data including the 3D position of at least one pupil when the wearer wears the head-mounted device and the 3D position of at least a part of the head-mounted device when the wearer wears the head-mounted device. - The at least one processing unit is adapted to determine the 3D pupil position of the wearer in a reference coordinate system based on the position data stored in the memory. - The at least one processing unit is adapted to determine data for customizing the head-mounted device based on the 3D pupil position of the wearer such that the position of the focus area EMB at least partially coincides with the 3D pupil position. The at least one processing unit is configured to control the recording of the holographic mirror based on the 3D pupil position in the reference coordinate system. The device for customization, wherein the data for customization is configured for the scanning element and / or the reflecting element adapted based on the 3D pupil position in the reference coordinate system.

15. A head-mounted device configured to direct a light beam towards a focus area EMB, the head-mounted device comprising: - A light source configured to emit a light beam, and a reflecting element configured to receive the light beam and redirect it towards the focus area EMB. - A scanning element configured to receive the light beam and scan the received light beam towards the reflecting element. A head-mounted device comprising the device for customization according to claim 14 for customizing the head-mounted device.

16. A computer program product including one or more stored instruction sequences accessible to a processor, wherein when the instruction sequences are executed by the processor, the processor is caused to: - Obtain the 3D pupil position of the wearer corresponding to a reference coordinate system and a predetermined gazing direction. - Customize the head-mounted device based on the 3D pupil position of the wearer such that the position of the focus area EMB at least partially coincides with the 3D pupil position. - A computer program product for causing a holographic mirror to be recorded based on the 3D pupil position in the reference coordinate system.

Images