Apparatus and method for enhancing vision system capabilities according to external conditions

Abstract

The present invention relates to a smart eye wear for improving the visual system capability of a wearer of a smart eye wear, the smart eye wear comprising at least one functionality, the method is specifically improved by receiving distance data (30) regarding one or more distances between a portion of a smart eye wear and one or more physical surfaces located in one or more directions of the wearer; determining actuation data (50) from the distance data, the actuation data being adapted to set one or more parameters of the functionalities in order to enhance the wearer's visual system capability; and 0 providing the actuation data to set the parameters. A current environment type (33) of the wearer is derived from the distance data, and actuation data is determined from the environment type. The method is applied to automatic setting of functions of the intelligent eye wearing object, in particular to an electrochromic intelligent eye wearing object.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of visual system capabilities and more specifically to smart eyewear. BACKGROUND

[0002] In the context of the present disclosure, "smart eyewear" refers to any head-mountable device intended to provide specific functions such as, notably, lens tinting, lens variable power, gaze direction determination, audio, image display, environment monitoring or health monitoring. The head-mountable device can comprise, for example, any eyewear, glasses, mask, goggles and head-mounted equipment. For example, electrochromic smart eyewear, or its acronym "echromic smart eyewear", refers to smart eyewear with an automatic mode that adjusts the lens tint level as a function of the light quantity measured at eye level.

[0003] Electrochromic smart eyewear can be particularly suitable for improving visibility in environments with too much light by reducing or counteracting the adverse effects of glare, while avoiding excessive darkening of the wearer's vision.

[0004] Smart eyewear can also be applied to control lighting conditions, notably indoor lighting conditions, for example for promoting synchronization of the circadian rhythm. The circadian rhythm regulates the sleep-wake cycle and can have multiple impacts on health, notably via sleep quality.

[0005] In other known technologies, smart eyewear is used to correct the wearer's behavior, which can notably help to slow down the progression of myopia in children, reduce visual fatigue or improve vision conditions. For example, in the patent application WO 2015 / 059566 by Essilor International, the behavior characteristics of a child are evaluated in various cases of use of the glasses over a given period of time. The glasses can notably be provided with a plurality of sensors suitable for measuring the luminosity of the work plane or the work distance, for example from the lens to the document or screen. The glasses also comprise a warning device (for example a buzzer that emits an alert to the wearer of the glasses or an emitter for sending a message to an operator) that is activated automatically in unfavorable situations (for example too close reading or writing distance or too low luminosity of the work plane).

[0006] Further smart eyewear achievements are notably described in the patent application WO 2018 / 184072 of the Brien Holden Vision Institute for slowing myopia progression, among others. They can notably encompass the presence of multiple sensors arranged to measure: the intensity of the light incident towards the considered wearable device, the spectral composition of such incident light, the wearer's movements, the distance between the wearable device and a fixated object, or the refractive power profile of the visual field (depth sensor). In particular, the type of environment of the wearer, i.e. indoor or outdoor facilities, can be inferred from light level and spectral composition analysis, while the working distance can be inferred from proximity or depth sensors. Actuators are also provided for changing the characteristics of the wearable device, e.g. the focal length, or triggering an alert according to the wearer's behavior features, based on the information received from the sensors. Such information can notably include the amount of time spent indoors or outdoors, or the amount of time the wearer focuses on near or far objects.

[0007] Thus, smart eyewear offers a wide opportunity for enhancing, maintaining or preserving the wearer's visual abilities in real time and in the long term.

[0008] In this respect, the contextual differentiation offers an attractive advantage, which enables to adapt the smart eyewear functionality according to the environment, for example to generate an alert in case of too long indoor stay, as mentioned above.

[0009] Identifying the type of wearer's environment can actually provide a variety of more attractive application scenarios for smart eyewear. This notably includes whether to trigger an automatic tinting mode, depending on whether the wearer is outdoors or indoors. Such a differentiation can avoid tinting the lenses in the home or office, which is often useless (as the attention is usually focused on the interior rather than the exterior), and can convey a potentially strong negative social message.

[0010] However, in a variety of cases, the identification of the wearer's environment by the prior art fails. In particular, when using light analysis, the presence of windows in indoor facilities and their non-uniform filtering properties, the potential light composition ambiguity in small spaces such as cars or buses, the variable outdoor wavelength composition depending on the period and season and the weather, and the presence of external objects such as walls or trees tend to cause the results to deviate and hamper the correct identification of the environment. Although more complex solutions can be developed, such as taking into account the period and the weather, this is still affected by a potentially high failure rate.

[0011] Camera images associated with scene analysis can provide good discrimination, but such a solution is not suitable for smart eyewear, especially because of the technical cost of image processing, whether it is done locally or through cloud computing, and data privacy management.

[0012] Other techniques include relying on an interactive environment provided with wireless communication capabilities, in order to directly inform the smart eyewear component of the current environment type, which can involve Internet of Things technology. Similarly, a reading or writing device such as a smartphone, tablet or laptop can be provided with distance measurement capabilities and transmit the relevant information to the smart eyewear, in order to appropriately adapt the lenses to the wearer or alert, while possibly also taking into account the wearer's environment.

[0013] While such solutions can prove quite reliable and efficient in suitable cases, they are entirely dependent on the presence of appropriate equipment and compatibility of the communication system, and are therefore only usable in specific limited cases involving specific objects and / or facilities, such as at home.

[0014] In yet other solutions, the smart eyewear can be provided with a user interface enabling the wearer to directly, or indirectly, for example via a communication to the smart eyewear via a smartphone, inform the smart eyewear of the surrounding environment type, such as outdoor or indoor, via for example sound or gesture-based input. Likewise, the wearer can indicate to the smart eyewear some specific ongoing action, such as reading or writing, so that distance monitoring can be activated as described above.

[0015] The advantage of such modes is that they are directly implemented and do not require complex mechanisms in a basic version. On the other hand, they are entirely dependent on the wearer's initiative and can be somewhat tedious or embarrassing.

[0016] There are therefore techniques for adapting the functionality of smart eyewear according to external conditions, including consideration of the environment and / or the distance between the wearer's eyes and the work surface. However, the effectiveness of these solutions is hampered by the above-mentioned drawbacks. SUMMARY

[0017] The purpose of the present disclosure relates to smart eyewear implementations that take external conditions into account to enhance visual system capabilities in a potentially efficient manner in a wide range of situations.

[0018] Another purpose of the present disclosure is to facilitate the identification of the wearer's environment or the identification of the wearer's situation for smart eyewear adaptation, thereby providing an alternative to the prior art and potentially enhancing the reliability of the identification.

[0019] An additional aim of the disclosure is to be able to properly automatically set the smart eyewear functionalities, thereby potentially reducing financial costs, power consumption, volume, surface, weight, data calculation and / or data bandwidth in advantageous implementations.

[0020] The applications of the disclosure, which aim to improve the visual system capabilities of the wearer, notably include the automatic adjustment or driving of the tinting of the lenses of electrochromic smart eyewear, electronic focusing, augmented reality, data collection and warning message display. They notably include supporting visual comfort, reducing visual fatigue, enhancing visual acuity, resynchronizing the circadian rhythm, preventing or reducing vision deterioration. Preliminary definitions

[0021] In the context of the disclosure, the following definitions complement the above.

[0022] "Wearer" is currently defined as a human or animal who has visual system capabilities, wears smart eyewear and uses the disclosed devices or methods as a patient or subject.

[0023] "Visual system capabilities" refer to the physiological characteristic capabilities of the wearer related to the visual system. This can encompass any visual characteristic such as notably visual acuity or refractive error, or any other capability related to the visual system of the wearer such as notably the circadian rhythm.

[0024] "Augmented reality" or AR refers to the combination of real world and computer-generated content in an interactive experience. These terms notably encompass the addition of virtual objects to the real world (i.e. constructive combination), but also encompass the hiding of parts of the real world (i.e. destructive combination, such as by masking operations). They also encompass "mixed reality" or MR, in which a real-world environment and computer-generated content are merged and can be interacted with in real time.

[0025] "Improving" the visual system capabilities means obtaining any physiological effect that is beneficial to the visual system, which can notably include preventing, mitigating, reducing or eliminating an adverse physiological effect, either short-term or long-term. For example, this can include or encompass slowing down the progression of myopia, hyperopia or presbyopia, avoiding glare, mitigating visual fatigue or discomfort, or helping to resynchronize the circadian rhythm. Improving the visual system capabilities can also include allowing the wearer to have better or more appropriate visibility, either for real-world scenes or for AR scenes.

[0026] "Setting" a functional parameter of the lenses of smart eyewear can include selecting, determining an on / off state, or adjusting the value of this parameter. This setting can be repeated over time.

[0027] The wearer's "environment" includes the external conditions that constitute the surrounding environment, that is, the conditions around the wearer. In this respect, the wearer's environment does not refer to a single object or group of objects placed near the wearer but not forming such an environment, such as a work surface. Accordingly, the type of environment cannot be simplified to the presence of such objects in the wearer's surrounding environment.

[0028] The "type" of an environment specifies a set of environments that share certain characteristics. It implies the existence of at least two types of environments, but the nature and number of these types depend on the underlying representation. For example, these types could be simplified to "indoor" and "outdoor," or environments could be categorized in a more granular way.

[0029] "Smart eyewear functionality" currently refers to one or more features of a smart eyewear that enable the wearer's visual system capabilities to be enhanced through appropriate manipulation or adjustment of the features(s). Functionality can be, in particular, visual, auditory, and / or tactile. Functionality can involve data recording and / or transmission. Functionality can be incorporated into any part of the smart eyewear, such as, in particular, lenses, visors, frames, temples, bridges, hinges, rims, wires, and / or nose pads. More specifically, if the smart eyewear includes one or more lenses, "lens functionality" refers to such features(s) in association with (multiple) lenses(s). Lens functionality can be particularly selected from the light transmission characteristics (intensity, wavelength composition, power, spatial distribution, etc.) of (multiple) lenses(s), AR display characteristics, AR content display, and / or selective collection of lens-related lighting data (e.g., on / off recording) for later use to enhance the wearer's visual system capabilities (e.g., increasing exposure to appropriate light to slow myopia progression).

[0030] The terms “suitable” and “configured” are used broadly in this disclosure to cover the initial configuration, subsequent adaptation or supplementation, or any combination thereof, of the device, whether implemented by physical or software means, including firmware.

[0031] The term "processor" should not be interpreted as hardware capable of executing software, but rather refers generally to a processing device, which may include, for example, a computer, microprocessor, integrated circuit, or programmable logic device (PLD). Furthermore, instructions and / or data capable of executing associated and / or resulting functionalities can be stored on any processor-readable medium, such as integrated circuits, hard disks, CDs, optical discs (e.g., DVDs, RAM, or ROM). Instructions can be stored, in particular, in hardware, software, firmware, or any combination thereof. The purpose of this disclosure

[0032] This disclosure relates to a device for enhancing the visual system capabilities of a wearer of a smart eye device, the smart eye device having at least one function. The device includes: - At least one input terminal, the at least one input terminal being adapted to receive distance data regarding one or more distances between at least one portion of the smart eye wear and one or more physical surfaces located in one or more directions on the wearer. - At least one processor configured to determine actuation data from the distance data, the actuation data being adapted to set one or more parameters of the one or more functionalities to enhance the wearer's visual system capabilities. - At least one output terminal, which is adapted to provide actuation data to set the one or more functional parameters(s).

[0033] According to this disclosure, (multiple) processors are configured to derive the wearer’s current environment type from the distance data and determine actuation data from the environment type.

[0034] In this respect, the device relies on a triple working mechanism integrated into the smart eye wearer: measuring reference values ​​(i.e., the distance between the smart eye wearer and the environment), fitting (via associated functionality), and influencing the wearer's visual system (through functional operation).

[0035] Moreover, compared to the aforementioned technologies (which, on the one hand, utilize distance monitoring of reading, writing, or working surfaces to provide corresponding recommendations to the wearer, and on the other hand, utilize specific methods to identify the wearer's environment (based on wavelength analysis or based on explicitly received information)), this device uses distance data itself to identify the environment.

[0036] This will be quite surprising to those skilled in the art, who will find that distance monitoring associated with smart eyewear is considered suitable for determining the position of objects in front of the wearer and being gazed at, but not for recognizing the wearer's environment. This is particularly unexpected for those skilled in the art, because in existing smart eyewear solutions, while environmental recognition and distance monitoring coexist, they serve different purposes, as disclosed, for example, in the aforementioned document WO 2018 / 184072.

[0037] This device overcomes the limitations and uncertainties of wavelength-based environmental identification in various situations where light cannot provide sufficiently reliable distinguishing indicators. Furthermore, this device can operate without any specific wearer action or placement of the equipment in a relevant or external location.

[0038] In the first category of distance data processing, (multiple) directions include at least one upward direction.

[0039] Using distance data corresponding to the upward direction to enhance a wearer's visual system capabilities would surprise someone skilled in the art, because the relevant direction associated with such an effect would be the frontal direction, for example, when monitoring distances to a work surface. However, the presence of a physical surface in the upward direction (or other directions) can be decisive in determining the type of the wearer's environment, which can depend, for example, on the presence or absence of a ceiling and, if present, its height.

[0040] "Upward direction" currently refers to the direction encompassed within an upward-pointing conic section, which has a vertical axis of symmetry defined relative to the wearer's environment. The half-angle of the conic section is at most 45°. In certain modes, the half-angle values ​​are 45°, between 35° and 45°, between 25° and 35°, between 15° and 25°, and between 5° and 15°. In special modes, the upward direction is vertical or approximately vertical, which is equivalent to making the half-angle of the conic section equal to or close to zero.

[0041] The vertical orientation of a smart eye wearer is defined as the orientation corresponding to the wearer standing, keeping their head upright, and properly wearing the smart eye wearer. This vertical orientation refers to the vertical axis of the wearer's head (given by the intersection of the coronal plane and the midline plane of the wearer's body). That is, if the wearer tilts their head, lies down, or removes the smart eye wearer, the vertical orientation of the smart eye wearer may not be vertical relative to the environment. In some cases, where the wearer is standing with their head upright (e.g., standing on a sloping surface), the vertical orientation of the smart eye wearer may even be non-vertical relative to the environment.

[0042] In a particular implementation (hereinafter referred to as the “simplified implementation”), the vertical direction of the smart eye wear is considered relative to the environment to achieve distance measurement in the upward direction. Such an embodiment makes it possible to simply and clearly arrange (multiple) distance sensors within the smart eye wear. To produce reliable results, it is then expected that the user maintains an upright head position while correctly wearing the smart eye wear (even if not standing, such as sitting), or that the individual smart eye wear is positioned in the correct corresponding orientation. In a related specific mode, the smart eye wear is provided with one or more orientation sensors (e.g., a gyroscope system) that indicate whether the smart eye wear is correctly oriented for upward distance measurement. The measurement operation can then be activated only if the smart eye wear orientation is at least approximately within a predetermined error limit (e.g., a 10% or 15% relative offset between the vertical axis of the smart eye wear and the vertical axis of the environment), and / or can send an alert signal when it is not within the predetermined error limit.

[0043] In other embodiments, the smart eye wearer is provided with a plurality of distance measuring sensors in respective fixed directions relative to the smart eye wearer, and one or more orientation sensors adapted to provide orientation data relative to the environment. The device is then adapted to infer distance data in the upward directions(s) using the distance data in these fixed directions and the orientation data. The distance data in the upward directions can be based on extrapolation, for example by assuming that the ceiling is horizontal based on one or more measurements, or that the ceiling has a constant slope based on two or more measurements.

[0044] Compared to simplified implementations, such implementations impose fewer constraints on the wearer, but require additional computational complexity and appropriate data collection.

[0045] In another embodiment, the smart eye wear is provided with one or more orientation sensors (from which the vertical direction of the environment can be obtained) and at least one distance measurement sensor (the at least one distance measurement sensor has an adjustable orientation). The distance measurement orientation of the smart eye wear(s) can then be automatically adjusted upward depending on the orientation of the smart eye wear and therefore on the positioning of the wearer's head.

[0046] Such an implementation can provide more diverse operating conditions than a simplified implementation, at the cost of additional physical layout complexity.

[0047] In a particular mode, the device is adapted to process distance data associated with at least two distinct items in the upward direction(s). For example, the device is configured to include two directions symmetrical about the vertical axis (i.e., the same polar angle, azimuths differing by 180°, e.g., forward and backward, or right and left), three directions regularly distributed around the vertical axis at the same tilt angle (i.e., the same polar angle, azimuths differing by 120°), and / or four directions regularly distributed around the vertical axis at the same tilt angle (i.e., the same polar angle, azimuths successively differing by 90°). In other examples that can be combined with the previous examples, the upward direction includes directions in the same vertical half-plane (i.e., the same azimuth, two or more polar angles). The vertical axis may belong to these half-plane directions.

[0048] In distance data processing of a second category that can be combined with the first category, (multiple) directions include at least two directions selected from the frontal direction and the opposite lateral direction.

[0049] That is, the selected direction includes the frontal direction and at least one lateral direction, or the selected direction includes the opposite lateral direction.

[0050] Using distance data that corresponds at least partially to the lateral direction to enhance a wearer's visual system capabilities would surprise someone skilled in the art, as the only relevant direction associated with this effect is the frontal direction. However, the presence of physical surfaces in the lateral directions (multiple of them) can be decisive in determining the type of environment for the wearer, which can depend, for example, on the presence or absence of walls or doors and their distance from the wearer. Of particular interest is the use of two or more directions (potentially including the frontal direction), as this potentially allows for reliable environmental determination in many different situations.

[0051] "Front orientation" currently refers to the orientation encompassed within a perfect circular cone having a forward axis of symmetry defined relative to the wearer and their environment. More precisely, this forward axis is defined corresponding to the wearer standing with their head upright and looking forward (its direction is given by the intersection of the wearer's transverse plane and midline plane). The cone's half-angle is at most 45°. In certain modes, the half-angle values ​​are 45°, between 35° and 45°, between 25° and 35°, between 15° and 25°, and between 5° and 15°. In special modes, the front orientation coincides precisely or approximately with the forward axis of symmetry, which is equivalent to the cone's half-angle being equal to or close to zero.

[0052] The forward axis lies in the horizontal plane, that is, in the plane perpendicular to the vertical axis. The "horizontal direction" relative to the environment is further defined as corresponding to any facing direction relative to the environment, but requiring a complete 360° rotation around the vertical axis.

[0053] The frontal orientation of a smart eye wearer is defined as the orientation of the wearer when, when normally wearing the smart eye wearer, they are standing in their environment, keeping their head upright and looking forward. That is, if the wearer tilts their head, lies down, or removes the smart eye wearer, the frontal orientation of the smart eye wearer may not be horizontal relative to the environment. If the wearer turns their head or does not wear the smart eye wearer properly, the frontal orientation may not be facing the wearer.

[0054] "Lateral direction" currently refers to the direction encompassed within a perfect cone having a lateral axis of symmetry, defined relative to the wearer and their environment. More precisely, this lateral axis is defined as lying in a horizontal plane and perpendicular to the forward axis (its direction is given by the intersection of the transverse plane and the coronal plane of the wearer's body) relative to the wearer standing, with their head upright and looking forward, and is either a right-hand or left-hand axis, depending on whether the lateral axis is oriented to the wearer's right or left. The cone's half-angle is at most 45°. In certain modes, the half-angle values ​​are 45°, between 35° and 45°, between 25° and 35°, between 15° and 25°, and between 5° and 15°. In special modes, the lateral direction coincides precisely or approximately with the lateral axis of symmetry, which is equivalent to the cone's half-angle being equal to or close to zero.

[0055] The lateral directions are "opposite" because one of the lateral directions points to the wearer's right side and the other points to the wearer's left side.

[0056] In some implementations (hereinafter referred to as "simplified implementations"), the frontal or (right or left) lateral orientation of the smart eye wear is considered as the frontal or lateral orientation relative to the wearer and the environment, respectively, to achieve corresponding distance measurements in the frontal or lateral orientation. Such implementations make it possible to simply and clearly arrange (multiple) distance sensors within the smart eye wear. For reliable results, it is then expected that the user maintains an upright head while correctly wearing the smart eye wear, or that the individual smart eye wear is positioned in the correct corresponding orientation. It is noteworthy that while a horizontal orientation is expected, the wearer's head can be turned to the right or left as needed without affecting the results. In a particular related mode, the smart eye wear is provided with one or more orientation sensors (e.g., a gyroscope system) that indicate whether the smart eye wear is correctly oriented for horizontal distance measurements. The measurement operation can then be activated only when the orientation of the smart eye wear is at least approximately within a predetermined error limit (e.g., a 10% or 15% relative offset between the forward or lateral axis of the smart eye wear and the horizontal plane of the environment), and / or can send an alert signal when it is not within the predetermined error limit.

[0057] In other embodiments, the smart eye wearer is provided with a plurality of distance measuring sensors in respective fixed directions relative to the smart eye wearer, and one or more orientation sensors adapted to provide orientation data relative to the environment. The device is then adapted to infer distance data in the frontal or lateral directions using the distance data in these fixed directions and the orientation data.

[0058] Compared to simplified implementations, such implementations impose fewer constraints on the wearer, but require additional computational complexity and appropriate data collection.

[0059] In another embodiment, the smart eye wear is provided with one or more orientation sensors (from which horizontal positioning in the environment can be obtained) and at least one distance measurement sensor (the at least one distance measurement sensor has an adjustable orientation). The multiple distance measurement orientations of the smart eye wear can then be automatically adjusted depending on the orientation of the smart eye wear and therefore on the positioning of the wearer's head.

[0060] Such an implementation can provide more diverse operating conditions than a simplified implementation, at the cost of additional layout complexity.

[0061] In a particular mode, the device is adapted to process distance data associated with at least two distinct items of any of the forward, right, or left directions. For example, the device is configured to include, for instance, two directions symmetrical about the forward axis (i.e., identical polar angles with azimuths differing by 180°, e.g., up and down, or right and left), three directions regularly distributed around the forward axis at the same tilt angle (i.e., identical polar angles with azimuths differing by 120°), and / or four directions regularly distributed around the forward axis at the same tilt angle (i.e., identical polar angles with azimuths successively differing by 90°). In other examples that can be combined with the previous examples, the forward direction includes directions in the same half-plane defined by the forward axis (i.e., identical azimuths, two or more polar angles). The forward axis may belong to these half-plane directions. Similar examples can also be used where a right-hand or left-hand direction replaces the forward direction.

[0062] Multiple distance data points can be accumulated through the movement of the wearer and / or the smart eye device, and these data can be used together to infer the type of environment. In particular, the wearer can move within the environment and / or can turn their head.

[0063] In a variant that can be combined with distance data processing of the first category, the measurement direction includes one or more frontal directions relative to the smart eye wearer but excludes lateral directions. Then, processors are configured to deduce the environment type from distance data collected in multiple directions via rotational movements of the wearer or the wearer's head.

[0064] In a particular embodiment, the smart eye wearable includes at least one lens, and one or more functional parameters include the following parameters associated with the lens(s): transmittance level, reflectance level, polarization level, wavelength filter level, optical power, spatial light distribution characteristics, AR visual characteristics, AR display content, and / or selective collection of lens-related lighting data.

[0065] In some related modes, the inputs are adapted to receive lens light data related to the light received by the lenses, and the actuation data is adapted to set one or more functional parameters based on the lens light data.

[0066] As mentioned above, the environment type can be specifically identified as indoor or outdoor.

[0067] In the corresponding embodiment, the derived current environment type is selected from at least an indoor type and an outdoor type. When the type is an outdoor type, the actuation data is adapted to set (a plurality of) parameters to a first parameter type, and when the type is an indoor type, the actuation data is adapted to set (a plurality of) parameters to a second parameter type.

[0068] For example, for electrochromic smart glasses, the hue level can be fixed to transparent if indoors, and to classic auto mode if outdoors.

[0069] The distinction between environment types can be refined. Therefore, in a more specific implementation, the derived current environment type is also selected from the vehicle type, and when the type is a vehicle type, the actuation data is adapted to set (multiple) parameters to a third parameter type.

[0070] Typically, indoor conditions, outdoor conditions, and vehicle conditions can be represented by medium, large, and small volumes, respectively, which should be distinguished from distance data.

[0071] For example, for electrochromic smart glasses, the hue level can be fixed to transparent if indoors, and to classic auto mode if outdoors or in a vehicle.

[0072] Through this potential identification of indoor type, outdoor type and vehicle type, in a specific mode, when the current environment type is identified as vehicle type, (multiple) inputs are adapted to receive driving prompts indicating driving operations, and (multiple) processors are configured to deduce the wearer's driving state from the driving prompts and also determine actuation data based on the driving state.

[0073] Driving prompts may include, in particular, acceleration data, which can provide information, for example, about the movement of the vehicle, and may also provide information about the movement of the wearer inside the vehicle. For example, in the case of electrochromic lenses, automatic lens tinting can be activated for outdoor and vehicle types when the driving status indicates that the vehicle is in motion, but can be deactivated for indoor and vehicle types when the driving status indicates that the vehicle has been stationary for more than five minutes.

[0074] In another example involving electrochromic smart eyewear, the hue level can be fixed to a transparent state indoors, to a classic auto mode outdoors or as a driver in a vehicle, and to an enhanced auto mode (e.g., lower transmittance than in classic auto mode, involving stronger eye protection) as a passenger in a vehicle.

[0075] In some implementations, one of the environment types is identified as unidentified, which may correspond to the "unknown" type.

[0076] In a favorable configuration, the actuation data is adapted to trigger at least one distance measurement, which is adapted to set one or more functional parameters(s).

[0077] That is, the next measurement is based on the results of (multiple) previous measurements, from which an initial estimate of the environment type has been determined. This implementation can enhance the reliability and / or accuracy of the assessed environment type, while reducing energy consumption by providing limited distance measurement operations and triggering further distance measurement operations only when appropriate.

[0078] In some models, in addition to environmental recognition relying on distance measurements, the device further incorporates other environmental recognition capabilities, such as any of the solutions described above. This can help further enhance the device's recognition capabilities. In practice, the success rate of this device in distance-based environmental recognition may vary depending on the implementation and may be compromised in specific modes (e.g., a coarse-grained implementation) or situations (e.g., the presence of interfering objects, unusual environmental types). In this regard, although it may increase complexity and cost, combining distance-based recognition with one or more other technologies (sensor fusion) can improve reliability and / or broaden the range of environmental applications.

[0079] Therefore, in some implementations, the inputs are adapted to receive wearer light data relating to light received by at least a portion of the wearer, and the processors are configured to also derive the current environment type from the wearer light data.

[0080] In certain embodiments that can be combined with previous implementations, the device includes a switch function that allows the wearer to control the activation and deactivation of distance-based environmental recognition. This can be advantageous in terms of energy consumption (and therefore operational autonomy), privacy (by avoiding unwanted measurements, such as in confidential locations), and / or wearer comfort (by preventing accidental and embarrassing distance measurement operations). In a more specific mode, such an implementation is coupled with the aforementioned environmental recognition obtained directly through user input, allowing the wearer to choose between deactivating environmental recognition, explicitly specifying the environment type, and allowing the device to determine the environment type automatically.

[0081] In some embodiments, in addition to deriving the current environment type and / or therefore actuation data from distance data, the processor(s) of the device are configured to receive information about the distance to a work surface, reading surface, or writing surface and to determine further actuation data from that information. In a more specific mode, the distance data encompasses both environment-related and object-related information, and the processor(s) are configured to provide instructions or recommendations related to the wearer's work, reading, or writing habits while taking into account the wearer's environment.

[0082] The device’s multiple distance-related capabilities then enable diverse and / or combined uses, thereby reducing the need for additional technologies and thus reducing potential complexity and cost.

[0083] In a specific mode: - (Multiple) input terminals are adapted to receive motion data about the wearer's movements. - (Multiple) processors are configured to determine, at least from motion data, whether the wearer's current environment type is likely to change, and only generate distance measurement instructions if such a change is possible. - (Multiple) output terminals are adapted to provide the distance measurement command for obtaining distance data.

[0084] By enabling selective triggering of distance measurement operations, such a configuration can potentially save significant energy consumption.

[0085] Additionally, this disclosure relates to a smart eyewear device used to enhance the visual system capabilities of the wearer. The smart eyewear device has at least one function and includes: -At least one lens, - At least one sensor, the at least one sensor being adapted to assess one or more distances between at least one portion of a smart eye wear and one or more physical surfaces located in one or more directions on the wearer. - At least one actuator, the at least one actuator being adapted to set one or more functional parameters. - A device for enhancing the capabilities of a vision system by receiving distance data from (multiple) sensors as distance data; and providing actuation data dependent on the distance data to (multiple) actuators to set one or more functional (multiple) parameters to enhance the wearer's vision system capabilities.

[0086] According to this disclosure, the device for enhancing the capabilities of the vision system conforms to any of the above-mentioned modes.

[0087] In a particular embodiment, the sensors include a time-of-flight sensor, a pair of left and right cameras, and / or a pair of left and right microphones.

[0088] This disclosure further relates to a method executed by one or more processors for enhancing the visual system capabilities of a wearer of a smart eye device, the smart eye device having at least one functionality. The method includes: - Receive distance data regarding one or more distances between at least one portion of the smart eye wear and one or more physical surfaces located in one or more directions relative to the wearer. - Actuation data is determined from the distance data, which is suitable for setting at least one parameter of one or more functions to enhance the wearer's visual system capabilities. - Provides actuation data to set one or more functional parameters.

[0089] According to this disclosure, the method includes deriving the wearer's current environment type from the distance data and determining actuation data from the environment type.

[0090] The method for enhancing the capabilities of a vision system is advantageously performed by any device for enhancing a vision system that conforms to any pattern of this disclosure.

[0091] Additionally, this disclosure relates to a computer program that includes software code, which, when executed by a processor, is adapted to implement a method for enhancing the capabilities of a vision system in accordance with any of the above-described execution modes.

[0092] This disclosure further relates to a computer-readable non-transitory program storage device that tangibly implements an instruction program that can be executed by a computer to implement a method for enhancing the capabilities of a vision system in accordance with this disclosure.

[0093] Such non-transitory program storage devices can be, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor devices, or any suitable combination of the foregoing. It should be understood that the following, while providing more specific examples, is merely illustrative and not exhaustive, and includes, as will be readily understood by one of ordinary skill in the art: portable computer floppy disks, hard disks, ROM (read-only memory), EPROM (erasable programmable ROM), or flash memory, portable CD-ROM (compact optical disc ROM). Attached Figure Description

[0094] This disclosure will be better understood by reading the following description of specific and non-limiting illustrative embodiments, and other specific features and advantages will become apparent, with reference to the accompanying drawings, in which:

[0095] Figure 1 This is a block diagram, schematically illustrating an embodiment of a system for enhancing the visual system capabilities of a wearer of a smart eye device, the system including means consistent with this disclosure;

[0096] Figure 2 It is a block diagram that focuses on Figure 1The implementation methods of the devices included in the system;

[0097] Figure 3 Demonstrated as Figure 1 The system and Figure 2 Examples of the classification of environmental types utilized by the device;

[0098] Figure 4 The image shows glasses equipped with LED-based time-of-flight sensors, which are... Figure 1 The system is utilized in a first example distance measurement implementation involving the upward direction;

[0099] Figure 5 The image shows glasses equipped with LED-based time-of-flight sensors, which are... Figure 1 The system is utilized in a second example distance measurement implementation involving the upward direction;

[0100] Figure 6 The image shows glasses equipped with LED-based time-of-flight sensors, which are... Figure 1 The system is utilized in a third example distance measurement implementation involving lateral directions;

[0101] Figure 7 The image shows glasses equipped with LED-based time-of-flight sensors, which are... Figure 1 The system is utilized in a fourth example distance measurement implementation involving the combined frontal and lateral directions;

[0102] Figure 8 The image shows glasses equipped with LED-based time-of-flight sensors, which are... Figure 1 The system is utilized in a fifth example distance measurement implementation involving the combination of upward and frontal directions;

[0103] Figure 9 The image shows glasses equipped with two side camera sensors, which are... Figure 1 The system is utilized in the example distance measurement implementation;

[0104] Figure 10 It presents the epipolar geometric representation of points in a 3D scene, such as using Figure 9 The example system is utilized in stereo vision;

[0105] Figure 11 The image shows eyeglasses equipped with two side microphones arranged in the temples of the glasses. Figure 1 The system is utilized in the example distance measurement implementation;

[0106] Figure 12 yesFigure 11 A top view of the temples of the glasses, highlighting the location of the microphone;

[0107] Figure 13A This schematically illustrates what happens when in free space. Figure 11 and Figure 12 Examples;

[0108] Figure 13B Shown in Figure 13A In the case of Figure 9 and Figure 10 Examples of the types of waves received by the microphone;

[0109] Figure 14A This schematically illustrates what happens when in an enclosed space. Figure 9 and Figure 10 Examples;

[0110] Figure 14B Shown in Figure 14A In the case of Figure 9 and Figure 10 Examples of the types of waves received by the microphone;

[0111] Figure 15 It's a flowchart, showing how to use... Figure 1 The system execution method and steps;

[0112] Figure 16 It is a flowchart that shows the method steps corresponding to a specific pattern of the method shown in Figure 13;

[0113] Figure 17 It schematically illustrates the combination in Figure 1 The equipment included in the system.

[0114] In the accompanying drawings, the same or similar elements are indicated by the same reference numerals.

[0115] and, Figure 1 , Figure 2 and Figure 15 The dashed lines on the top indicate optional aspects. Detailed Implementation

[0116] This specification illustrates the principles of this disclosure. Therefore, it will be understood that those skilled in the art will be able to design various arrangements that, although not expressly described or shown herein, implement the principles of this disclosure and are contained within its spirit and scope.

[0117] All examples and conditional language described herein are intended for educational purposes to help readers understand the principles of this disclosure and the ideas that the inventors have contributed to the advancement of the art, and are to be interpreted as not being limited to such specific examples and conditions.

[0118] Furthermore, all statements and specific examples of the principles, aspects, and embodiments described herein are intended to cover both structural and functional equivalents. Additionally, such equivalents are intended to include both currently known equivalents and future-developed equivalents; that is, any element developed to perform the same function, regardless of its structure.

[0119] Therefore, for example, those skilled in the art will understand that the block diagrams presented herein represent conceptual views of illustrative circuit systems or apparatuses for implementing the principles of this disclosure. Similarly, it should be understood that any flowchart, block diagram, etc., represents various processes that can be substantially represented in a computer-readable medium and thus executed by a computer or processor, or can be executed by dedicated or suitable apparatus, whether or not such computer or processor or such apparatus is explicitly shown.

[0120] The functionality of the various data processing elements shown in the accompanying drawings can be provided using dedicated hardware and hardware capable of executing software in association with appropriate software. When provided by a processor, the functionality can be provided by a single dedicated processor, a single shared processor, or multiple separate processors, some of which may be shared.

[0121] It should be understood that the data processing elements shown in the accompanying drawings can be implemented in various forms of hardware, software, or a combination thereof. Preferably, these elements are implemented in a combination of hardware and software on one or more appropriately programmed general-purpose devices, which may include processors, memory, and input / output interfaces.

[0122] like Figure 1 The present disclosure is described with reference to a specific functional embodiment of System 1 for enhancing the visual system capabilities of wearers of smart eyewear.

[0123] System 1 is adapted to configure one or more functionalities of a smart eye wear by taking into account the wearer's environment. In this regard, the system is equipped with suitable equipment capable of measuring distances between the smart eye wear or at least a portion thereof, and inferring the current wearer environment from these measured distances.

[0124] The functionality of one or more smart eye-wearing devices can be selected from one or more of the following: adjustment of lens tint, power, or wavelength components; AR content display; audio messaging; visual or auditory alarm transmission; wireless data transmission; and data recording. Each of the relevant smart eye-wearing device functionalities can be at least partially controlled by setting one or more related parameters. Moreover, such parameter settings are configured to and are intended to enhance the wearer's visual system capabilities in the short, medium, and / or long term.

[0125] Visual system capabilities can include visual acuity, and in particular can involve refractive errors and / or visual acuity in at least one eye of the wearer. Therefore, visual system capabilities can be associated with myopia, hyperopia, astigmatism, and / or presbyopia. For example, the functionality of smart eyewear can include alerting capabilities (e.g., visual, auditory, tactile) suitable for drawing the wearer's attention when the wearer spends significantly more time indoors than outdoors, as adequate exposure to natural light can prevent or inhibit myopia progression. For greater relevance, such assessments can be combined with time, season, weather, and / or light monitoring, as well as possible analytical information. The functionality of smart eyewear can alternatively or further include data recording and / or data transmission capabilities to store cumulative time spent indoors and / or outdoors and potentially related specificities (e.g., frequency, duration, time period) to provide appropriate resulting recommendations. Among the many sources of information, readers may refer to, for example, the following paper and the references cited therein: E.G. Landis et al., “Ambient Light Regulates Dopamine Signaling and Myopia Susceptibility”, Invest. Ophthalmol. Vis. Sci., 2021, Vol. 62, No. 1.

[0126] Visual capabilities can involve visual comfort and / or safety. For example, the functionality of smart eye wearables can include lens tinting, focusing, and / or wavelength filtering, which are adapted to adapt lens characteristics to the wearer's surrounding environment, and parameter settings, when adjusting these lens characteristics, can, for example, take into account whether the wearer is indoors, outdoors, or in a vehicle. In another example, such smart eye wearable functionality is adapted to adapt lens characteristics to the visualization of AR scenes depending on whether the wearer is indoors or outdoors.

[0127] Visual system capabilities may include resistance to visual fatigue and / or circadian rhythm quality. For example, the functionality of smart eye wearables may include recommendation capabilities (e.g., AR displays, wireless messaging) suitable for providing lighting suggestions to the wearer or another person based on the daily routine spent indoors. The functionality of smart eye wearables may also include, or alternatively may include, data logging and / or data transmission capabilities designed to track behavior in order to provide subsequent lighting suggestions. Such recommendations may, for example, relate to circadian stimuli (CS), as described in particular in the following article: MS Rea and MG Figueiro, “Light as a circadian stimulus for architectural lighting”, Lighting Res. Technol., 2016, Vol. 0, pp. 1-14; or as set forth in the following CIE (International Commission on Illumination) standard: CIE S 026 / E:2018 “CIE System for Metrology of Optical Radiation for ipRGC-influenced Responses to Light”.

[0128] More specifically, system 1 includes: a distance measurement unit 3 responsible for operating distance measurement and generating distance data 30; an actuation unit 5 responsible for processing the distance data to infer the wearer's environment and establish appropriate resulting actuation data 50; and a smart eye wear functionality setting unit 57 responsible for setting one or more parameters of one or more smart eye wear functionalities based on the actuation data 50. In a variant, the actuation unit 5 is further configured to further determine the wearer's state in the identified wearer's environment (e.g., distinguishing between a driver and a passenger in a car, or between an active driver and a stationary driver), and to take the wearer's state into account when establishing the actuation data 50.

[0129] Optionally, conditional operation unit 2 is implemented upstream of system 1 to make distance measurements performed by unit 3 dependent on certain determined factors. That is, unit 2 is responsible for determining whether distance measurement should be activated and transmitting the corresponding trigger data 20 to distance measurement unit 3 for re-execution. This trigger data 20 may include any kind of instruction or message to guide unit 3 to start, continue, pause, resume, and / or abort distance measurement. For clarity, they may be adapted to only some of these functions, for example, specifically designed to start distance measurement, in which case unit 3 runs for a given preset time period, for example, between 10 ms and 1 s, or between 1 s and 10 s. The trigger data 20 may alternatively be specifically designed to start and stop distance measurement, thus involving two messages. In variations, they may further allow, for example, pausing and resuming distance measurement, for example, periodically, so that unit 3 can keep some measurement functions active or in a certain standby mode in the case of pausing, and turn off these measurement functions or put them in a lower level of standby mode in the case of abortion.

[0130] For example, the conditional operation unit 2 is configured to receive explicit instructions from the wearer via a user interface (e.g., an on / off button) and to reflect these explicit instructions in the trigger data 20.

[0131] In other examples, unit 2 has light measurement capabilities, such as involving one or more photodiodes and / or ambient light sensors (ALS) incorporated in a smart eye wearer, and is adapted to command distance measurement operations when the measured light meets some predetermined indicators (e.g., when the brightness decreases to below a first threshold and / or increases to above a second threshold, or when the brightness changes by more than one or more preset percentages, or when the wavelength composition is substantially modified according to predetermined conditions).

[0132] In other examples, unit 2 incorporates motion measurement capabilities, such as involving one or more IMUs (Inertial Measurement Units), accelerometers, and / or gyroscopes integrated into a smart eye-wearing device, and is adapted to command distance measurement operations only when the motion meets some predetermined criteria (e.g., when the motion is identified as corresponding to a change in position of the wearer from sitting to standing and / or when the wearer moves from one place to another over a predetermined distance). In particular, unit 2 may include an activity pattern detector. Unit 2 can implement this context change detection with only low power requirements.

[0133] Unit 2 can use previous distance measurements obtained as distance data 30 to determine whether to trigger further distance measurements. For example, a simple upward distance estimation can be used to determine whether to perform a more complete and / or more complex distance measurement. More specifically, in a specific implementation: if no physical surface is detected above the smart eye wearer, it can be directly inferred that the wearer is outdoors; if a physical surface is detected above the wearer at a distance similar to the previous measurement, and limited wearer movement is detected simultaneously (i.e., within an appropriate threshold), it can be inferred that the wearer remains indoors. Only in other cases, such as if a physical surface is detected above the wearer at a closer distance to the smart eye wearer than in the previous measurement, can a further distance measurement be triggered.

[0134] In some embodiments, unit 2 is provided with a wearing sensor included in the smart eye wear, which is capable of determining whether the smart eye wear is being worn by a wearer. Such a result is described, for example, in the applicant's patent application WO 2022 / 018080. Unit 2 can then be configured to allow distance measurement only when the smart eye wear is being worn.

[0135] Conditional operation unit 2 can be adapted to perform event detection based on typical patterns and / or to detect changes in environmental conditions. This conditional operation unit can further combine multiple solutions in a hybrid decision-making process. A potentially significant advantage is that the sensor is powered on only when appropriate.

[0136] Alternatively, system 1 includes a supplementary measurement unit 4, which measures physical quantities other than the distance obtained by unit 3 (i.e., supplementary measurement data 40) and transmits these physical quantities to actuation unit 5 so as to be considered together with distance data 30 when determining actuation data 50. The supplementary measurements may involve movement of the smart eye wearer and / or the wearer, which can be obtained via one or more IMUs, accelerometers, and / or gyroscopes. Detecting specific vibration patterns can particularly support the identification or exclusion of different types of traffic, such as trains or buses, associated with medium distances. Alternatively or additionally, the supplementary measurements may involve light components, for example, obtained by one or more photodiodes and / or ALS. The supplementary measurements may involve the smart eye wearer itself (e.g., light received by at least one lens of the smart eye wearer) and / or the wearer (e.g., light received by at least a portion of the wearer).

[0137] The supplementary measurement data 40 can be used by the actuation unit 5 to determine the wearer's environment and / or the wearer's state within that environment. The supplementary measurement data can be used to provide input to the conditional operation unit 2 for potential further measurement steps, similar to and possibly in combination with the distance data 30 described above.

[0138] In the presence of conditional operation unit 2 in system 1, unit 4 can be activated and / or deactivated by unit 2 in a manner similar to that of distance measurement unit 3. In variant implementations that can be combined with previous implementations, unit 4 can be triggered by actuation unit 5 under certain predetermined conditions, such as triggering only when one or more specific environmental types are identified as corresponding to the current smart eye wear environment.

[0139] The functional setting unit 57 can be configured to perform the following operations: adjusting lens hue, power or wavelength components, displaying AR content, transmitting audio messages, emitting visual or sound alarms, transmitting wireless data, and / or recording data.

[0140] In one embodiment, the smart eye wearable is provided with transmissive lenses, each comprising an electrochromic material layer controlled to modify the optical transmittance of the lens upon detecting a change in the wearer's ambient light (typically from tens of lux in a dark room to thousands of lux in bright outdoor weather). Generally, higher intensity light received by the lens causes increased tinting, while lower intensity light causes decreased tinting.

[0141] These electrochromic smart eyewear can be differentiated based on their light attenuation capabilities. In this regard, reference can be made to sunglasses standards used to define grades or categories. Specifically, according to the international ISO standard ISO 12312-1:2022 and the European standard EN 1836:2005, five categories 0, 1, 2, 3, and 4 are defined in relation to increased absorption characteristics (visible light transmittance in the ranges of 80% to 100%, 43% to 80%, 18% to 43%, 8% to 18%, and 3% to 8%, respectively, with specific requirements for UVB, UVA, and IR transmittance ranges), and these categories are required to be marked on the frames of smart eyewear. According to the US standard ANSI Z 80.3-2001, three transmittance categories are distinguished. Electrochromic smart eyewear can be classified into one of the existing categories based on maximum absorption capability. For example, for transmittance varying between 90% and 10%, the electrochromic smart eye wear is classified into the range [0; 3], and for transmittance varying between 90% and 4%, it is classified into the range [0; 4]. The electrochromic smart eye wear may further include dynamic control that enables enhanced wearer comfort in the event of sudden changes in ambient light, as described in the applicant's patent application EP-3985429 A1.

[0142] In some modes, the electrochromic smart eye wearer can switch from one of at least two available transmittance levels to another, such as between levels 3 and 4 mentioned above, or between levels 2, 3, and 4. The actuation unit 5 is then configured to determine, within the actuation data 50, an indicator specifying the selected transmittance level and transmit it to the functionality setting unit 57.

[0143] Although units 2, 3, 4, 5, and 57 are presented as separate functional entities, their actual implementation can involve any possible complete or partial combination in one or more devices or apparatuses. For example, the data processing capabilities of these units can be partially or completely centralized as associated software in one or more CPUs (Central Processing Units) and / or one or more ICs (Integrated Circuits). Moreover, motion measurement and / or optical measurement can, for example, be shared by conditional operation unit 2 and supplementary measurement unit 4. Conversely, each functional entity can be distributed across two or more physical devices, such as two LEDs (Light Emitting Diodes), associated photodiodes, and a corresponding processing circuit system for distance measurement unit 3.

[0144] The following section will elaborate on further insights into System 1 in conjunction with the associated data processing components, which are denoted as... Figure 2The device 10 shown herein is for enhancing the visual system capabilities of a wearer. Device 10 is advantageously a device or physical part of a device designed, configured, and / or adapted to perform the mentioned functions and produce the mentioned effects or results. In alternative embodiments, device 10 is implemented as a group of devices or physical parts of devices, either grouped in the same machine or grouped in different, possibly remote, machines. In some modes, device 10 is incorporated into a smart eye wear. In alternative modes, device 10 is completely or partially disconnected from the smart eye wear and is available, for example, in a mobile device (e.g., a smartphone). Wireless capabilities can then be provided to the smart eye wear, allowing remote communication between circuitry located in the smart eye wear and device 10, for example via a short-range wireless technology commercialized under the name Bluetooth and standardized in IEEE 802.15.1.

[0145] In the following text, modules should be understood as functional entities, not physically distinct components. Therefore, they can be implemented as grouped together within the same tangible component, or distributed across several such components. Furthermore, each of these modules may be shared between at least two physical components. Additionally, these modules can be implemented in hardware, software, firmware, or any hybrid form thereof. Modules belonging to a device are preferably implemented within at least one processor of the device.

[0146] The device 10 is adapted to receive distance data 30 and generate actuation data 50 by extracting environment type 33 from the distance data 30.

[0147] In this respect, the device 10 includes: an upstream input module 11; and a downstream output module 17; and a module 13 for deriving an environment type 33 from at least distance data 30 received from the input module 11; and a module 15 for generating actuation data 50 from the environment type 33 and transmitting such actuation data to the output module 17 in order to set one or more of the functional parameters of the smart eye wear.

[0148] Optionally, the device 10 is adapted to receive supplementary measurement data 40 and take it into account in module 15 for determining actuation data 50. For example, the supplementary measurement data 40 includes acceleration and orientation data, which are used in conjunction with distance data 30 to efficiently distinguish between indoor and vehicle environments.

[0149] In some modes, device 10 further includes a state determination module 14 configured to generate a wearer state 34, and module 15 generates actuation data 50 from the wearer state 34 and the environment type 33. In some embodiments, module 14 is adapted to derive the wearer state 34 using distance data 30 and / or supplementary measurement data 40. For example, the wearer state may be identified as a "driver" or "passenger" state based on short distances around the wearer and / or specific acceleration and head movement patterns provided by motion measurements.

[0150] Module 14 can be input with the environment type 33 obtained from module 13 and used to determine the wearer state 34. This determination can be made only for one or more specific items of environment type 33, and not for others; in the latter case, module 15 can generate actuation data 50 solely from environment type 33. For example, differentiation between multiple wearer states for actuation of functional parameters is considered only when environment type 33 is identified as a vehicle, while no differentiation is considered when the environment type is identified as indoors (i.e., in a stable location) or outdoors. Such states can then include, for example, "driver" or "passenger," "currently driving," or "currently stationary." All of the above aspects of device 10 can correspond to actuation unit 5.

[0151] In a particular embodiment, the device 10 is also adapted to receive a condition factor 21 intended to make a decision on the activation of a distance measurement. A trigger analysis module 12 is then provided to the device 10, configured to analyze the condition factor 21, generate trigger data 20 based on the results of the analysis, and transmit the trigger data 20 to an output 17 to perform a distance measurement operation and generate distance data 30.

[0152] The latter aspects of device 10 may correspond to a portion of conditional operation unit 2.

[0153] In some configurations, the device 10 further includes a delay module 16, which is downstream of the actuation data generation module 15 and (where applicable) downstream of the trigger analysis module 12, and upstream of the output terminal 17. This delay module is responsible for delaying the transmission of actuation data 50 and / or trigger data 20. The delay module 16 allows for the introduction of a latency period to avoid overly rapid or unstable changes during operation. In some embodiments, the relevant delay is predetermined (e.g., 100 ms, 1 s, or between 2 s and 5 s). In other embodiments, the relevant delay may be user-inputted, with a default value preset.

[0154] Device 10 can access data from one or more local or remote databases 18 and record the data into the one or more local or remote databases when appropriate. The databases 18 can take the form of storage resources available from any kind of suitable local or remote storage devices, which can be in particular RAM or EEPROM (Electrically Erasable Programmable Read-Only Memory), such as flash memory, possibly within an SSD (Solid State Drive).

[0155] Additionally, device 10 can interact with user interface 19, through which a user can input and retrieve information. User interface 19 includes any device suitable for inputting or retrieving data, information, or instructions, particularly visual, tactile, and / or audio capabilities. These devices may encompass any one or more of the following devices well known to those skilled in the art: screen, keyboard, trackball, touchpad, touchscreen, speaker, and voice recognition system. Interaction with user interface 19 can be indirect, for example, where device 10 takes the form of a hardware component, such as all or part of an integrated circuit embedded in a device.

[0156] Environmental type 33 and (where appropriate) wearer status 34 can be determined within a closed list of possibilities, each associated with a specific indicator of the input data, which includes at least distance data 30 and may also include supplementary measurement data 40. This list can be based on a partition of the input data under consideration to avoid definite ambiguity or uncertainty. The list may further include an "unknown" category, which may be impossible to determine for any reason.

[0157] Module 13 and / or module 14 may rely on distance data 30 and / or supplementary measurement data 40 acquired simultaneously and / or sequentially. For example, in a mode involving sequential distance measurements, distance data 30 may be recorded into database(s) 18 over time and retrieved and processed by module 13 or 14 in the form of information clusters, such as after cumulative distance measurements in at least a predetermined number of different directions or after a given preset distance measurement time period.

[0158] For example, such as Figure 3As shown, environment type 33 and wearer state 34 are selected from possibility sets 130 and 140, respectively. Set 130 includes environment types 131, 132, 133, and 134 corresponding to “outdoor” environment, “indoor” environment, “vehicle” environment, and “unknown” environment, respectively. In addition, set 140 is dedicated to the “vehicle” environment 133 and includes: first-level wearer state categories 141, 142, and 143 corresponding to “driver”, “passenger”, and “unknown”, respectively; and second-level wearer state categories 1411, 1412, and 1413 associated with the first-level wearer state 141 of “driver” and corresponding to “moving”, “stationary”, and “unknown”, respectively.

[0159] In a specific implementation, module 13 is configured to determine which of the available environment types is the current environment type by considering the distance between the smart eye wearer and the nearest physical surface in the upward direction. If the distance is greater than a first predetermined threshold (e.g., selected between 2 and 5 meters), the current environment is considered to belong to type 131, "Outdoor". Otherwise, if the distance is not greater than the first threshold but greater than a second predetermined threshold smaller than the first threshold (e.g., selected between 0.5 and 1 meter), the current environment is considered to belong to type 132, "Indoor". Otherwise, if the distance is not greater than the second threshold, the current environment is considered to belong to type 133, "Vehicle". This set can be refined, for example, by distinguishing between personal vehicles (smaller distance range) and group vehicles (larger distance range) within the "Vehicle" environment type.

[0160] In one variant, determining the environment type in set 130 is done using two or more distances in distinct upward directions (e.g., with opposite inclinations relative to the vertical). In other variants, the aforementioned metrics can then be applied to both directions, and a valid environment type identification is obtained only if the two results are consistent; otherwise, the current environment is classified as type 134 "unknown" and may be measured repeatedly for clarification.

[0161] In other variations, the environment type in set 130 is determined by distance measurements in the frontal direction (hereinafter referred to as "frontal distance") in addition to the upward direction (hereinafter referred to as "upward distance"). For example: - If the upward distance is greater than a first predetermined upward threshold (e.g., selected between 2 and 5 meters), the current environment is considered to be type 131 "outdoor"; - Otherwise, if the upward distance is not greater than the first upward threshold but is greater than the second predetermined upward threshold (e.g., selected from 0.5 to 1 meter) which is smaller than the first upward threshold, and the frontal distance is greater than the first predetermined frontal threshold (e.g., selected from 15 to 20 meters), then the current environment is considered to be type 131 "outdoor" (e.g., this may happen if the wearer is under an umbrella or parasol). - Otherwise, if the upward distance is not greater than the first upward threshold but is greater than the second predetermined upward threshold, and the frontal distance is not greater than the first predetermined frontal threshold, then the current environment is considered to belong to type 132 "indoor"; - Otherwise, if the upward distance is not greater than the second upward threshold and the frontal distance is greater than the first predetermined frontal threshold, the current environment is considered to belong to type 131 "outdoor"; - Otherwise, if the upward distance is not greater than the second upward threshold and the frontal distance is not greater than the first predetermined frontal threshold but greater than the second predetermined frontal threshold (e.g., selected between 0.2 and 0.5 meters), the current environment is considered to belong to type 132 "indoor"; Otherwise, if the upward distance is not greater than the second upward threshold and the frontal distance is not greater than the second frontal threshold, the current environment is considered to belong to type 133 "vehicle".

[0162] In a less complex mode, the frontal distance is assessed using only the second frontal threshold, without using the first frontal threshold; the environment is considered "outdoor" when the upward distance is greater than the first upward threshold; the environment is considered "indoor" when the upward distance is between the first and second upward thresholds, or when the upward distance is not greater than the second upward threshold and the frontal distance is greater than the second frontal threshold; and the environment is considered "vehicle" when the upward distance is not greater than the second upward threshold and the frontal distance is not greater than the second frontal threshold.

[0163] In other variations, the environmental type in set 130 is determined by distance measurements in the opposite lateral directions, in addition to the upward direction (hereinafter referred to as "lateral distance," meaning on the wearer's right and left sides, not necessarily aligned along the same axis). For example: - If the upward distance is greater than a first predetermined upward threshold (e.g., selected between 2 and 5 meters), the current environment is considered to be type 131 "outdoor"; - Otherwise, if the upward distance is not greater than a first upward threshold but greater than a second predetermined upward threshold (e.g., selected from 0.5 to 1 meter) smaller than the first upward threshold, and at least one of the lateral distances is greater than a first predetermined lateral threshold (e.g., selected from 15 to 20 meters), then the current environment is considered to be type 131 "outdoor"; - Otherwise, if the upward distance is not greater than the first upward threshold but is greater than the second upward threshold, and these lateral distances are not greater than the first lateral threshold, then the current environment is considered to belong to type 132 "indoor"; - Otherwise, if the upward distance is not greater than the second upward threshold and at least one of the lateral distances is greater than the first predetermined lateral threshold, the current environment is considered to belong to type 131 "outdoor"; - Otherwise, if the upward distance is not greater than a second upward threshold and these lateral distances are not greater than a first lateral threshold, but at least one of these lateral distances is greater than a second predetermined lateral threshold (e.g., selected from 1 to 1.5 meters), then the current environment is considered to be type 132 "indoor"; Otherwise, if the upward distance is not greater than the second upward threshold and neither of the two lateral distances is greater than the second lateral threshold, the current environment is considered to belong to type 133 "vehicle".

[0164] It is worth noting that even when a single lateral distance measurement (e.g., on the left) is combined with an upward distance measurement, useful environmental information can be provided, but in some cases, System 1 is less applicable than when it relies on two opposite lateral distances.

[0165] Furthermore, in a less complex mode, the lateral distance is assessed using only the second lateral threshold and not the first lateral threshold; the environment is considered "outdoor" when the upward distance is greater than the first upward threshold; the environment is considered "indoor" when the upward distance is between the first upward threshold and the second upward threshold, or when the upward distance is not greater than the second upward threshold and at least one of the lateral distances is greater than the second frontal threshold; and the environment is considered "vehicle" when the upward distance is not greater than the second upward threshold and these lateral distances are not greater than the second frontal threshold.

[0166] In other example embodiments that can be combined with previous implementations, system 1 is adapted to distinguish between wearing a hat or baseball cap and being in a low-ceilinged location (e.g., in a car). This can be based on a very small upward distance threshold, for example, selected between 10 and 15 cm. This distinction is advantageously combined with frontal and / or lateral distance measurements, which, upon identifying the presence of a hat or baseball cap, can confirm the presence of an outdoor environment or exclude it in a constructive manner that indicates another environment (e.g., “indoors” or “vehicle”).

[0167] Depending on the implementation, the upward direction, the frontal direction, and the lateral direction can be combined in any relevant manner.

[0168] In the above example implementation, the state determination module 14 is configured to be activated only when module 13 identifies the current environment as belonging to "vehicle" type 133. Then, for example, the wearer state in set 140 is determined using measured movement received as part or all of supplementary measurement data 40: - If these movements are sufficiently distant from substantial changes in wearer status (leaving the vehicle, moving within the vehicle, etc.) and involve head movements sufficiently close to the reference driver's head configuration (proximity is calculated based on appropriate metrics), the wearer status is identified as belonging to category 141 "Driver"; this status category is recorded and maintained for later use as long as these movements remain sufficiently distant from substantial changes in wearer status. In the presence of movements identified as vehicle movement, the wearer status is selected as subcategory 1411 "Moving", and in the absence of such movements, it is selected as subcategory 1412 "Stationary"; - If these movements are sufficiently distant from the substantial change in wearer state and do not involve head movements sufficiently close to the reference driver head configuration, the wearer state is classified as category 142 "passenger"; the state is recorded and maintained for later use as long as these movements remain sufficiently distant from the substantial change in wearer state. - If these movements are close enough to a substantial change in the wearer's state, the state is set to category 143 "unknown", and the identification process is repeated later.

[0169] As is known to those skilled in the art, the metric used to calculate the distance between the measured movement and the reference movement may, for example, involve Euclidean distance, taxi distance, or Chebyshev distance, and is based on a distance threshold associated with the metric used.

[0170] Continuing with the illustrative implementation above, once the environment type 33 in set 130 and (if appropriate) the wearer state 34 in set 140 are known, module 15 determines the associated actuation data 50 during operation. For example, the functionality of a smart eyewear includes adjusting the lens tint (electrochromic case) based on the amount of light received at eye level: - If the current environment is type 131 "Outdoor", then the classic automatic mode is run (the electrochromic parameter is set to "On", which may correspond, for example, to the sunglasses rating range [0; 3]). - If the current environment is type 132 "Indoor", the hue level is fixed to transparent (the electrochromic parameter is set to "Off"); - If the current environment is type 133 "Vehicle" and the wearer's status is category 142 "Passenger", then the classic automatic mode is run (the electrochromic parameter is set to "On"); in the variant, the tint level is then fixed to the enhanced tint mode (the electrochromic parameter is set to "Enhanced", which may, for example, correspond to the sunglasses rating range [0; 4]). - If the current environment is type 133 "Vehicle" and the wearer's status is category 141 "Driver" and subcategory 1411 "Moving", then the classic automatic mode is run (the electrochromic parameter is set to "On"). - If the current environment is type 133 "Vehicle" and the wearer's status is category 141 "Driver" and subcategory 1412 "Stationary", the hue level is fixed to transparent (the electrochromic parameter is set to "Off").

[0171] In the variant, special electrochromic modes are provided and selected for active drivers, such as enabling attenuating lens tinting and / or using a lower light threshold for tinting.

[0172] In a more refined version of System 1, the set of environment types allows for the differentiation of vehicle types between a car on one side and a bus or train on the other. This can be based on a combination of measured distance and movement. Consistently, the electrochromic treatment can vary depending on whether the wearer is a passenger in a car or a passenger on a bus or train (i.e., corresponding to public transportation). For example: - If the current environment is of the "car" type and the wearer's state is of the "passenger" type, then run enhanced shading state; - If the current environment is of the "bus or train" type and the wearer's status is of the "passenger" category, the hue level is fixed to the transparent state (the electrochromic parameter is set to "off").

[0173] The following describes various implementation examples of the distance measurement unit 3. As is clear from the above explanation, the parts of system 1 (including device 10) interact closely and depend on each other, such that their characteristics and functionality are determined in close relation to the distance measurement capability. In particular, the number and identification of measurement directions are crucial to the indicators used by module 13 in determining environment type 33. Moreover, the set of available environment types and (if appropriate) the set of available wearer states (selected from which environment type 33 and wearer state 34 are respectively) can depend on the distance measurement capability, and these sets are further refined as the distance measurement capability is enhanced. For example, schemes involving improving the level of differentiation between environment and possible wearer states may include: -Indoor and outdoor, -Indoor, outdoor, and vehicle, -Indoor and outdoor vehicles, personal vehicles and group vehicles, - Indoors, outdoors, vehicles as drivers, private vehicles as passengers, group vehicles as passengers.

[0174] The selection of a suitable implementation of the distance measurement unit 3 can be based on several considerations, including, in particular, the desired level of refinement, conspicuousness versus concealment, weight, cost, wearer convenience, security, and / or privacy. Perhaps of further particular interest is the implementation of sensor fusion, which allows the following embodiments to be combined in any manner across different implementation categories. Example 1 - Time of flight distance measurement

[0175] In the first category of embodiments, the distance measurement unit 3 includes one or more Time-of-Flight (ToF) sensors arranged, for example, on (two) temples, (two) rims, bridge of the nose, or (two) hinges of a pair of glasses. Such ToF sensors are configured to send a signal toward a target and to capture a corresponding return signal from the target, and to infer the distance to the target from the time elapsed between signal transmission and reception (i.e., the round-trip time).

[0176] The signal can be an electromagnetic signal, particularly in the form of an artificial light signal, and the ToF sensor can correspondingly include an LED (light-emitting diode) or a laser diode. The signal utilized can include light pulses. They can alternatively be adapted for specific identification to avoid interference, especially when two or more ToF sensors are operating in parallel on the same smart eye wear. For example, time-division multiplexing, modulation, and / or related techniques can be used, as known to those skilled in the art.

[0177] LEDs can operate in the infrared (IR) or ultraviolet (UV) range. LEDs are made of materials such as InGaAs (indium gallium arsenide), InGaN (indium gallium nitride), or AlGaN (aluminum gallium nitride). They can be used for both light emission and light detection. In an alternative example, an LED is associated with a photodiode that is electrically isolated from the LED by an optical isolator. This photodiode is, for example, based on a PIN junction.

[0178] The use of one or more LEDs for ToF sensors may be attractive due to their low power consumption (e.g., between 1 and 100 mW on average during operation), low maintenance, and small size (e.g., between 1 and 2 mm).

[0179] In other implementations, the ToF sensor includes a laser and operates in Lidar mode (representing "light detection and ranging"). It can involve an injection laser diode (ILD). The injection laser diode can be made of compound semiconductor materials such as gallium arsenide, indium phosphide, gallium antimonyide, and gallium nitride. The injection laser diode can be a dual heterostructure (DH) laser, which involves a pair of materials comprising gallium arsenide and aluminum gallium arsenide. In some modes, the ILD is configured for IR emission. The one or more ILDs can be associated with one or more photodiodes. In alternative modes, interferometric distance measurements are provided, depending on the inherent coherence properties of the laser beam.

[0180] exist Figure 4 In the first example of this category shown, a pair of glasses 31 includes two ToF sensors 311 and 312, which are positioned on the corresponding right and left temples of the eyewear to generate upward light emission. These sensors 311 and 312 can be located near the temple hinges. As described above, the obtained distance information allows for the differentiation of indoor and outdoor environments, and possibly vehicular environments, based on the presence of a ceiling and its distance to the eyewear. Even with potential errors, the success rate is likely to be relatively high, and satisfactory performance is generally provided. Furthermore, the obtained assessments can be coupled with relevant sources, automatic parameter settings can be reserved for configurations without critical risks (e.g., no automatic changes by a vehicle driver), and the results can be made available for direct input by the wearer for correction.

[0181] In some implementations, the upward direction has a fixed tilt to the right and left relative to the vertical direction, for example, an offset between 10° and 15°. This allows for a safer estimation of the physical surface above the wearer by avoiding misleading considerations, particularly for locally reflective objects or surfaces with limited overhang.

[0182] In other embodiments, ToF sensors 311 and 312 enable flexible adjustment of the upward emission direction. Therefore, multiple upward directions can be targeted sequentially, allowing spatial scanning and thereby enhancing support for current environment identification. Alternatively, in cases of uncertainty (e.g., signal ambiguity or poor detectability), the upward directions can be adjusted.

[0183] exist Figure 5 In the second example of this category shown, a pair of glasses 32 differs from the previous examples in that it includes two ToF sensors 321 and 322, which are arranged on the outer edges of the right and left lens rims of the eyewear, respectively, to generate upward light emission.

[0184] existFigure 6 In the third example of this category shown, a pair of glasses 33 includes two ToF sensors 331 and 332, which are positioned on the corresponding right and left temples of the eyewear to generate right-side and left-side light emission, respectively. The obtained distance information allows for the differentiation of indoor and outdoor environments, and possibly vehicular environments, based on the presence of walls and their distance from the eyewear.

[0185] For example, module 13 can identify the current environment as: - Outdoors, when at least one of the lateral distances to the physical surface is greater than 10 m; -Indoors, when both lateral distances are less than 10 m and at least one of them is greater than 1 m; - For vehicles, when both lateral distances are less than 1 m.

[0186] The same explanations above regarding directional flexibility or scanning, success rate, and potential errors in the upward direction apply here as well. In this regard, it is worth noting that while unilateral directional distance information carries a relatively high risk of being misleading (e.g., if the wearer is walking near an exterior wall), using the opposite direction can significantly reduce the error rate.

[0187] exist Figure 7 In the fourth example of this category shown, a pair of glasses 34 includes two pairs of ToF sensors: (341, 342) and (343, 344). Sensors 341 and 342 are positioned on the corresponding right and left temples of the eyewear to generate outward light emission in opposite lateral directions. Other sensors 343 and 344 are positioned at the height of the right and left temple hinges, respectively, and are configured to generate light emission in a frontal direction. The obtained distance information allows for the differentiation of indoor and outdoor environments, and possibly vehicular environments, based on the presence of walls and their distance to the eyewear.

[0188] exist Figure 8 In the fifth example of this category shown, a pair of glasses 35 includes two ToF sensors 351 and 352, both of which are located on the bridge of the nose of the eyewear and are arranged for light emission in the upward and forward directions, respectively.

[0189] The above observations regarding other examples involving the category of ToF sensors also apply in a similar manner. More specifically, in the particular embodiment of this case, system 1 is configured to collect and process distance measurements and orientation information, which are obtained by sensor 352 in several forward directions and caused by rotational movements of the wearer's head or body, and which are obtained, for example, by a gyroscope and associated with these distance measurements.

[0190] Advantageously protect the ToF sensor, especially from dust and / or condensation, for example, through a cover and / or protective layer.

[0191] Readers will readily notice that other configurations are possible and covered in this category of implementations. In particular, upward light emission and side light emission and / or frontal light emission can be combined in smart eye wear.

[0192] In alternative embodiments of this category, the ToF sensor is based on ultrasound rather than light, with echoes from a reflective physical surface collected for distance assessment. Such a sensor can be implemented by creating an opening in the frame of a smart eye-wearing lens. Example 2 - Stereo vision distance measurement

[0193] In the second category of embodiments, the distance measurement unit 3 includes at least two camera sensors arranged on the right and left sides of the smart eye wear, for example, in the temples, hinges, and / or the outer edges of the frame of a pair of glasses. These camera sensors are oriented in an upward direction, an opposite lateral direction, and / or a frontal and lateral direction. Furthermore, module 13 is configured to perform epipolar distance assessment based on at least a pair of images jointly acquired by the respective camera sensors, as is well known to those skilled in the art.

[0194] exist Figure 9 In the specific example shown, the smart eye wear 36 is provided with two camera sensors 361 and 362, which are respectively arranged on the left and right sides of the smart eye wear frame, and the module 13 is configured to utilize the paired images obtained by the respective camera sensors 361 and 362.

[0195] For this example, Figure 10 A typical correlated triangulation operation conforming to epipolar geometry (i.e., stereo vision geometry) is illustrated. Specifically, camera sensors 361 and 362 have corresponding optical centers O1 and O2 (which represent the camera sensor in the pinhole camera model) and virtual image planes P1 and P2 in front of them, with the point of interest Q having corresponding projections q1 and q2 on image planes P1 and P2. Inferring the 3D point Q from the 2D projections q1 and q2 is the basis for triangulation and enables distance estimation.

[0196] In certain modes, the image resolution of each camera is limited to a few lines, such as a horizontal line. This can prove to be reliable for privacy and / or attractive in terms of power consumption.

[0197] In the variant, at least two of the camera sensors are positioned at two different locations on the same smart eye wearing objective lens temple.

[0198] Camera sensors can be based, for example, on components with dimensions between 1 mm and 2 mm. Example 3 - Audio based distance measurement

[0199] In the third category of implementations, the distance measurement unit 3 includes at least two microphones arranged on the right and left sides of the smart eye wear, for example, in the temples, hinges and / or outer edges of the frame of a pair of glasses.

[0200] Module 13 is then configured to analyze the delay between reflected sound waves received at the respective microphones and to infer the distance and position of the solid interface relative to the wearer by taking into account sound wave propagation and the distance between the microphones. In this regard, the shape of the instantaneous sound wave pattern around the wearer can be estimated in an intermediate step. Additionally, an autocorrelation algorithm can be used to quantify the delay. Furthermore, the absence of reflected sound waves indicates a free-space environment. The distance between the microphones can be, for example, preset by the mechanical design or obtained through a calibration procedure.

[0201] Interestingly, smart eye wearers do not require an audio source, but only an audio receiver.

[0202] The microphones can be further offset not only in width (i.e., parallel to the wearer's coronal axis (i.e., the axis connecting the outer corners of the wearer's eyes) when the smart glasses are worn normally), but also in depth (i.e., parallel to the wearer's sagittal axis (i.e., relative to the eyes) when the smart glasses are worn normally), and / or in height (i.e., along the wearer's vertical axis when the smart glasses are worn normally). Such an arrangement allows for more robust distance estimation due to the greater spacing between the microphones, and allows for finer distance assessment around the wearer.

[0203] Some relevant patterns involve 2D audio recognition based on at least two microphones used. Other relevant patterns involve 3D audio recognition based on at least three microphones used.

[0204] exist Figure 11In the specific example shown, the smart eye wear 37 is equipped with two microphones 371 and 372, which are positioned on both the right and left temples of the smart eye wear. The right microphone 371 is located in the front region of the right temple, while the left microphone 372 is located in the rear region of the left temple. The temples of the smart eye wear are extended as in the wearing condition, and the gap between microphones 371 and 372 has orthogonal projections onto the wearer's coronal and sagittal axes, with values ​​Dx and Dy, respectively. Figure 12 As can be seen in the text.

[0205] When operating in free space, see Figure 13A Therefore, no reflected sound waves will occur. Thus, when the incident sound wave 373 arrives successively at microphones 372 and 371, the associated audio pattern 374 merely represents the delayed propagation relative to the gap between the microphones. This associated audio pattern includes waves 374A and 374B captured at microphones 371 and 372 respectively (e.g., ...). Figure 13B (As shown).

[0206] In contrast, in enclosed spaces, see Figure 14A The incident sound wave 375, after passing through microphones 372 and 371 respectively, is reflected by a solid interface 370 (e.g., a wall) as a reflected sound wave 376. This reflected sound wave is both attenuated and delayed relative to the incident wave 375 (for simplicity only, the reflected wave 376 is represented as parallel to the incident wave 375 and offset relative to the incident wave, and both the reflected and incident waves are perpendicular to the solid interface 370). Accordingly, in the associated audio pattern 377 including waves 377A and 377B captured at microphones 371 and 372 respectively, as... Figure 14B As shown, there is a specific amplitude difference and phase difference between waves 377A and 377B. From these captured data, the distance between the right microphone 371 and the solid-state interface 370, as well as the orientation of the solid-state interface 370 relative to the wearer's positioning, can be estimated.

[0207] Of particular interest is the following master's thesis, which demonstrates an artificial intelligence (AI) implementation of deriving distance from stereo capture: G. Bologni, “Room geometry estimation from stereorecordings using neural networks”, Delft University of Technology, 2020. More specifically, the sources to be located are mirror sources, which reveal the geometry of the environment being analyzed (including the location of reflective surfaces) through a compact array of two microphones. Readers are also drawn to the thesis' extensive references section in the field of audio-based distance measurement, which points to a variety of existing AI and non-AI solutions.

[0208] In a variant implementation, the distance measurement unit 3 includes at least one microphone disposed on at least one of the right and left sides of the smart eye wear, and the module 13 is configured to analyze sound waves received by the microphone or by each microphone. From such signal processing, the distance measurement unit 3 is adapted to infer the distance and position of the solid interface relative to the wearer by taking into account the propagation of the sound waves and the combination between the incident wave and (possibly multiple) reflected waves.

[0209] Previous embodiments can be combined, for example, to refine single-microphone analysis using multi-microphone results.

[0210] The following is combined with Figure 15 A process, possibly executed by System 1, for enhancing the visual system capabilities of a wearer is described. This process 6 includes: - In the optional execution mode, obtain condition factors 21 (step 62), analyze these condition factors 21 (step 621), determine whether the distance measurement must be activated accordingly (step 622), and if not, loop back to the update item of condition factors 21; - If a distance measurement is determined, proceed to generating distance data 30 (step 623); optionally, this distance data is used as part of condition factor 21 for additional distance measurement; - In an optional execution mode, supplementary measurement data 40 is further obtained (step 624); this supplementary data may correspond to a portion or all of the condition factor 21, and / or may be fully or partially triggered in accordance with the distance measurement; - The environment type 33 can be inferred from at least the distance data 30 and possibly from the supplementary measurement data 40 (step 643). - Optionally, depending on the identified environment type 33 and via relevant checks (step 640), the wearer's status 34 may be inferred from the distance data 30 and / or measurement data 40 (step 64). - Where appropriate, determine actuation data 50 from at least environment type 33 and also from wearer status 34 (step 65). - In the optional execution mode, the setting of the functional parameters of the smart eye wear is delayed in order to allow for an appropriate operation wait time (step 66). - Set (multiple) functional parameters (step 67) and loop back to the original process steps for updates.

[0211] exist Figure 16 In the more specific example process 7 shown, the process is performed with respect to system 1 as follows: -Activate System 1 for enhancing the wearer’s visual system capabilities (step 70). - Initialize the sensors used, including the distance measurement sensor of unit 3 and the motion sensor of unit 2 (step 71). - Use unit 2 to detect at least from the motion sensor whether the wearer is changing between sitting and standing, or between walking and standing (step 72); if not, then repeat the check; potential low-power motion detection can always be on; - If this change is detected, the distance measurement sensor of unit 3 is powered on and a distance measurement is performed (step 73). - By extracting environment type 33, the context is set by unit 5 based on the measured distance value (i.e., distance data 30) (step 75); steps 73 and 75 can be equivalent to fine-grained context sensing triggered by events; - Use units 5 and 57 to set appropriate functional parameters for the smart eye wear (if relevant) (step 77); - Place the distance measurement sensor in standby mode (step 720) and repeat the movement check in step 72.

[0212] exist Figure 17 The specific device 8 visible above implements the aforementioned data processing apparatus 10. This data processing apparatus may particularly correspond to a microchip integrated in a smart eye wear. In alternative embodiments, the smart eye wear has power supply capabilities, measurement capabilities, functional actuation capabilities, and communication capabilities (e.g., Bluetooth), and the device 8 corresponds, for example, to a smartphone, tablet, head-mounted display (HMD), or laptop computer configured to communicate with the smart eye wear.

[0213] Device 8 includes the following components, which are interconnected via an address and data bus 85, which also transmits clock signals: - Microprocessor 81 (or CPU); -ROM-type non-volatile memory 86; - Random Access Memory (RAM) 87; - One or more I / O (input / output) devices 84, such as voice recognition or gesture recognition capabilities, keyboard, mouse or joystick; - Power supply 88; and - Radio Frequency (RF) Unit 89.

[0214] According to the variant, the power supply 88 is external to the device 8.

[0215] Device 8 also includes a display device 83 of the display screen type. According to variations, the display device is external to device 8 and is connected to the device via cable or wirelessly for transmitting display signals. Device 8 includes an interface for transmission or connection, adapted to transmit display signals to an external display device, such as an LCD (liquid crystal display) or OLED (organic light-emitting diode) screen or video projector. In this regard, an RF unit 89 can be used for associated wireless transmission.

[0216] It should be noted that the term "register" used in the description of memory 87 can refer to both low-capacity memory areas (some binary data) and large-capacity memory areas (enabling the storage of the entire program or representing all or part of the calculated or displayed data) in each of the mentioned memories. Furthermore, registers can be arranged and configured in any manner, and each of them does not necessarily correspond to an adjacent memory location, and can be distributed in other ways (this particularly covers the case where a register comprises several smaller registers).

[0217] RAM 87 specifically includes: - The operating program of microprocessor 81 is stored in register 870; - Register 871 contains information indicating a distance of 30. - Register 872 contains information about environment type 33 and wearer status 34; - The information in register 873 represents the actuation data 50; - In register 874, information about condition factor 21 is represented; - In register 875, information about trigger data 20 is displayed.

[0218] When powered on, the microprocessor 81 loads and executes the instructions of the program contained in RAM 87.

Claims

1. A device (1; 32; 33; 34; 35; 36; 37) for enhancing the visual system capabilities of a wearer of a smart eye device (31; 32; 33; 34; 35; 36; 37). 8； 10) The smart eye wearable has at least one function, and the device includes: - At least one input terminal (11), said at least one input terminal being adapted to receive distance data (30) regarding at least one distance between at least one portion of the smart eye wear and at least one physical surface located in at least one direction of the wearer. - At least one processor configured to determine actuation data (50) from the distance data, the actuation data being adapted to set at least one parameter of the at least one function in order to enhance the visual system capabilities of the wearer. - At least one output terminal (17), said at least one output terminal being adapted to provide said actuation data to set said at least one parameter of said at least one function. The feature is that the at least one processor is configured to derive the wearer’s current environment type (33) from the distance data, and determine the actuation data from the environment type.

2. The apparatus (1; 10) for enhancing the capabilities of the vision system according to claim 1, characterized in that, The at least one direction includes at least one upward direction.

3. The apparatus (1; 10) for enhancing the capabilities of the vision system according to claim 1 or claim 2, characterized in that, The at least one direction includes at least two directions selected from the frontal direction and the lateral direction.

4. The apparatus (1; 10) for enhancing the capabilities of the vision system according to any one of the preceding claims, characterized in that, The smart eye wearable (31; 32; 33; 34; 35; 36; 37) includes at least one lens, and the at least one functional parameter includes at least one of the following parameters associated with the at least one lens: transmittance level, reflectance level, polarization level, wavelength filter level, optical power, spatial light distribution characteristics, augmented reality visual characteristics, augmented reality display content, and selective collection of lens-related lighting data.

5. The apparatus (1; 10) for enhancing the capabilities of the vision system according to claim 4, characterized in that, The at least one input (11) is adapted to receive lens light data (40) related to light received by the at least one lens, and the actuation data (50) is adapted to set the at least one parameter of the at least one function based on the lens light data.

6. The apparatus (1; 10) for enhancing the capabilities of the vision system according to any one of the preceding claims, characterized in that, The derived current environment type (33) is selected from at least an indoor type (132) and an outdoor type (131). When the type is the outdoor type, the actuation data (50) is adapted to set the at least one parameter to a first parameter type, and when the type is the indoor type, the actuation data is adapted to set the at least one parameter to a second parameter type.

7. The apparatus (1; 10) for enhancing the capabilities of the vision system according to claim 6, characterized in that, The derived current environment type (33) is also selected from the vehicle type (133), and when the type is the vehicle type, the actuation data (50) is adapted to set the at least one parameter to a third parameter type.

8. The apparatus (1; 10) for enhancing the capabilities of the vision system according to claim 7, characterized in that, When the current environment type (33) is identified as the vehicle type (133), the at least one input terminal (11) is adapted to receive a driving prompt (30) indicating a driving operation; 40), and the at least one processor is configured to derive the wearer’s driving state (34) from the driving prompt and also determine the actuation data (50) based on the driving state.

9. The apparatus (1; 10) for enhancing the capabilities of the vision system according to any one of the preceding claims, characterized in that, The actuation data (50) is adapted to trigger at least one distance measurement, the at least one distance measurement being adapted to set at least one parameter of the at least one functionality.

10. The apparatus (1; 10) for enhancing the capabilities of the vision system according to any one of the preceding claims, characterized in that, The at least one input (11) is adapted to receive wearer light data (40) related to light received by at least a portion of the wearer, and the at least one processor is configured to further derive the current environment type (33) from the wearer light data.

11. The apparatus (1; 10) for enhancing the capabilities of the vision system according to any one of the preceding claims, characterized in that: - The at least one input terminal (11) is adapted to receive motion data (21) about the wearer's movements. - The at least one processor is configured to determine, at least from the motion data, whether the wearer’s current environment type (33) is likely to change, and to generate a distance measurement command (20) only if it is likely to change. - The at least one output terminal (17) is adapted to provide the distance measurement command for obtaining the distance data (30).

12. A smart eyewear (31; 32; 33; 34; 35; 36; 37), said smart eyewear for enhancing the visual system capabilities of the wearer of said smart eyewear, said smart eyewear having at least one function and comprising: - At least one sensor (311, 312; 321, 322; 331, 332; 341, 342; 343, 344; 351, 352; 361, 362; 371, 372), said at least one sensor being adapted to evaluate at least one distance between at least one portion of said smart eye wear and at least one physical surface located in at least one direction of said wearer. - At least one actuator, said at least one actuator being adapted to set at least one parameter of said at least one function. - A device (10) for enhancing the capabilities of the visual system, the device enhancing the capabilities of the visual system by: receiving distance data (30) representing the at least one distance from the at least one sensor; and providing actuation data (50) dependent on the distance data to the at least one actuator to set the at least one parameter of the at least one function in order to enhance the visual system capabilities of the wearer. The device for enhancing the capabilities of the vision system is characterized in that it conforms to any one of the preceding claims.

13. The smart eye-wearing device according to claim 12, characterized in that, The at least one sensor (311, 312; 321, 322; 331, 332; 341, 342, 343, 344; 351, 352; 361, 362; 371, 372) includes at least one of the following: a time-of-flight sensor (311, 312; 321, 322; 331, 332; 341, 342, 343, 344; 351, 352); a pair of left and right cameras (361, 362); and a pair of left and right microphones (371, 372).

14. A method (6; 7) executed by at least one processor for enhancing the visual system capabilities of a wearer of a smart eyewear (31; 32; 33; 34; 35; 36; 37), the smart eyewear having at least one functionality, the method comprising: - Receive distance data (30) regarding at least one distance between at least one portion of the smart eye wear and at least one physical surface located in at least one direction of the wearer. - Actuation data (50) is determined from the distance data (654; 75, 76), the actuation data being adapted to set at least one parameter of the at least one function in order to enhance the visual system capabilities of the wearer. - Provide the actuation data to set (66; 76) the at least one parameter of the at least one functionality. The method is characterized by comprising deriving the wearer's current environment type (33) from the distance data, and determining the actuation data from the environment type. The method for enhancing the capabilities of the vision system is advantageously performed by an apparatus (1; 10) for enhancing the capabilities of the vision system according to any one of claims 1 to 11.

15. A computer program comprising software code adapted to perform the method (6; 7) for enhancing the capabilities of a vision system according to claim 14.

Images