Self-adaptive adjustment method and system of glasses and self-adaptive intelligent glasses

Adaptively adjusting the position of glasses through the gaze tracing technology, the visual deviation problem caused by the nose pad sliding in the prior art is solved, and the user experience and security are improved.

CN119291947APending Publication Date: 2025-01-10SHANGHAI LIANGMING TECH DEV

Patent Information

Application Number
CN202411831726.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-12
Publication Date
2025-01-10

AI Technical Summary

Technical Problem

The fixed connection between the existing glasses nose pad and temples makes it impossible to adjust according to user needs, which affects the wear comfort and user experience, especially when the nose pad slides down after the user lowers his head, causing the center of the lens to deviate from the sight area, which may cause bad eye habits and safety. Hidden danger.

Method used

The line of sight tracking technology is used to detect the user's line of sight deviation, control the action of the glasses position adjustment module, adjust the relative position of the lens and the human eye, so that the user's line of sight falls into the central area of ​​the lens, and realize adaptive adjustment.

Benefits of technology

It reduces user manual adjustment operations, improves the comfort and safety of wearing glasses, ensures clear vision, and avoids bad eye habits and safety hazards.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119291947A_ABST
    Figure CN119291947A_ABST
Patent Text Reader

Abstract

The invention discloses a self-adaptive adjustment method and system of glasses and self-adaptive intelligent glasses, and relates to the technical field of intelligent glasses. The method comprises the following steps: carrying out sight tracking detection on a glasses wearing user; according to the sight line tracking detection, judging whether the sight line of the user deviates from the lens center area of the glasses or not; and when judging that the sight line deviation reaches the preset condition, controlling a position adjusting module on the glasses to act to adjust the relative positions of the lenses and the human eyes, so that the sight line of the user falls into the central area of the lenses. According to the invention, the sight tracking technology is combined into the detection and judgment of the position of the glasses, and the position of the glasses lens is dynamically and adaptively adjusted according to the sight of the user, so that the manual adjustment operation of the user is reduced, and the user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of smart glasses, and in particular to a glasses adaptive adjustment method and system and adaptive smart glasses. Background Art

[0002] Glasses are widely used, including myopia glasses, hyperopia glasses, defocus glasses, sunglasses, AR (augmented reality) smart glasses, etc. The nose pad components of various traditional glasses are usually fixedly connected to the glasses frame, resulting in a fixed relative position between the nose pad components and the glasses frame, which cannot be adjusted according to the needs of users, affecting the user's comfort and use experience when wearing.

[0003] Based on this, the prior art also provides glasses that can adjust the position of nose pads and the length of temples. As an example, Chinese patent ZL202311291862.X discloses a pair of adjustable high-precision myopia defocus prevention and control glasses, including: a prevention and control frame and a prevention and control lens. Two prevention and control lenses are fixed in the prevention and control frame. The prevention and control frame includes a frame body, nose pads and temples. Both the nose pads and temples can be slid and adjusted on the frame body. The tail of the temple is rotatably connected with an ear hook. The prevention and control lens is a defocus lens with a degree of 5 degrees. The relative position between the center of the defocus lens and the center of the eye can be quickly adjusted by adjusting the position of the nose pads, so as to facilitate the correct use of the defocus lens. According to the change of head shape, the length of the temple can be freely extended and retracted and the curvature of the ear hook can be adjusted to be suitable for adolescent children with different head shapes. Specifically, a slider 1 is slidably connected to the crossbeam of the frame, and a scale line 1 is provided on the slider 1, and the scale line 1 corresponds to the edge of the crossbeam of the frame. A cavity is provided inside the crossbeam of the frame, and a spring 1 is provided in the cavity One end of the spring is fixed on the crossbeam of the frame, and the other end of the spring is fixedly connected to the limiting ball, which is slidably connected in the cavity. The two sides of the slider that contacts the crossbeam of the frame are provided with grooves, and the volume of the limiting ball is placed in the groove. The volume of the limiting ball placed in the crossbeam of the frame is greater than the volume placed in the groove. A fixed column is fixed on the slider, and the fixed column is slidably connected to the fixed plate, and the fixed plate is fixedly connected to the nose pad. By sliding the slider downward or upward, the slider drives the nose pad to move up or down one unit, so that the nose pad can be adjusted up and down relative to the main body of the frame. In this way, the position of the nose pad can be adjusted according to the different nose shapes of children and adolescents, so that the glasses and the prevention and control lenses are placed at a reasonable height and distance; the freely retractable temples are realized by the temple frame frame sliding in the cavity of the temples, and a plurality of gear lines are provided on the temple frame, so that the temples can slide on the main body of the frame, and the length of the temples can be extended or shortened according to the size of the heads of children and adolescents, so that the temples are supported on the ears at a suitable length.

[0004] However, when adjusting the nose pad position and temple length of the above-mentioned glasses, the user needs to perform manual operations, and cannot perform adaptive adjustments according to the user's dynamic glasses usage needs. For example, when the user wearing the glasses lowers his head and then raises his head, the nose pad of the glasses may slide down under the action of gravity, and the nose pad after sliding down cannot automatically slide up, causing the center area of ​​the glasses lens to deviate from the user's field of vision. The user may not be able to see clearly or can only see a partial picture, which brings inconvenience to the user. At the same time, it may also cause users (especially children) to develop bad eye habits. In particular, in some cases, it may also bring safety hazards-for example, when the user is driving, the glasses slide down and cause unclear vision and cannot see vehicles, pedestrians, and road conditions.

[0005] On the other hand, with the development of gaze estimation technology, the existing technology has provided various gaze tracking and gaze interaction solutions based on gaze estimation, which can be performed without the user's perception. For example, the gaze screen assisted operation on a smartphone captures the eye movement of the user's face through the front camera of the mobile phone, monitors the user's gaze (the gaze associated with the eye or what the eye is looking at, such as the direction of the gaze can be obtained by tracking the Purkinje image on the eye), analyzes the gaze point of the gaze (that is, the landing point corresponding to the direction of the gaze, such as the distance and viewing angle between the user and the screen, and the position of the user on the screen, i.e., the gaze point), and determines whether the user is looking at the screen (thereby deciding whether to continue to light up the screen or turn off the screen to save power), or controls the device according to the user's gaze point - for example, according to the location of the gaze point, open the application or link at the gaze point, etc. Summary of the invention

[0006] The purpose of the present invention is to overcome the shortcomings of the prior art and provide an adaptive adjustment method and system for glasses and adaptive smart glasses. The adaptive adjustment scheme for glasses provided by the present invention uses the line of sight tracking technology to detect whether the user's line of sight deviates from the center area of ​​the lens of the glasses through line of sight tracking, and when the line of sight deviation reaches a preset condition, controls the position adjustment module on the glasses to adjust the relative position of the lens and the human eye, so that the user's line of sight falls into the center area of ​​the lens. In this way, the adaptive and precise adjustment of the position of the glasses is achieved according to the user's glasses usage dynamics, reducing the manual adjustment operation of the user when wearing the glasses, and improving the user experience.

[0007] To achieve the above objectives, the present invention provides the following technical solutions: A method for adaptively adjusting glasses comprises the following steps: Conducting eye tracking detection for users wearing glasses; According to the aforementioned gaze tracking detection, determining whether the user's gaze deviates from the central area of ​​the lens of the aforementioned glasses; When it is determined that the sight line deviation reaches a preset condition, the position adjustment module on the glasses is controlled to adjust the relative position of the lens and the human eye so that the user's sight line falls into the center area of ​​the lens.

[0008] Furthermore, the preset condition is: The user's line of sight is shifted outside the center area of ​​the lens; or, The user's line of sight deviates from the center area of ​​the lens and the deviation state lasts longer than a preset time threshold; or, The deviation between the user's line of sight and the center area of ​​the lens exceeds a preset displacement threshold; or, The offset between the user's line of sight and the central area of ​​the lens exceeds a preset displacement threshold, and the duration of the offset state exceeds a preset time threshold.

[0009] Furthermore, the glasses are defocus glasses, and the lenses of the defocus glasses at least include a clear area in the central region and a defocus area arranged around the clear area, the clear area has a refractive power, and the defocus area is provided with a microlens array; the aforementioned central area of ​​the lens is the clear area of ​​the defocus lens.

[0010] Furthermore, the glasses are provided with a sight tracking module, and both the sight tracking module and the position adjustment module are communicatively connected with the control module and receive control from the control module; The gaze tracking module is configured to: direct light into the eye, detect at least one reflection from at least one surface associated with the eye using an image capture unit, determine gaze information associated with the eye based on the detected reflection, and send the determined gaze information to the control module, wherein the gaze is an angular direction associated with a gaze of the eye; The control module is configured to: determine whether the user's line of sight deviates from the central area of ​​the lens of the glasses based on the line of sight information detected by the line of sight tracking module; and, when it is determined that the line of sight deviation reaches a preset condition, generate a glasses adjustment instruction, and control the action of the position adjustment module on the glasses based on the glasses adjustment instruction; the glasses adjustment instruction includes a lens position adjustment parameter.

[0011] Further, the lens position adjustment parameters include nose pad adjustment parameters and / or temple adjustment parameters, which are generated by a lens position adjustment model; The lens position adjustment model is configured to perform the following steps: Receive input data; the input data includes sight line offset information and current glasses wearing position information, the sight line offset information includes sight line deviation amount and offset direction, the current glasses wearing position information includes current nose pad position information, current temple length information and current temple inclination angle information relative to the horizontal plane; Determine the lens displacement amount and adjustment direction to be adjusted according to the aforementioned sight line deviation information; wherein the lens displacement amount to be adjusted is a function related to the sight line deviation amount, and the adjustment direction is the opposite direction of the sight line deviation direction; According to the aforementioned lens displacement amount and adjustment direction that need to be adjusted, calculate the nose pad adjustment parameters and / or temple adjustment parameters; wherein the nose pad adjustment parameters are functions related to the lens displacement amount and adjustment direction that need to be adjusted, and the temple adjustment parameters are functions related to the aforementioned current wearing position information of the glasses, as well as the lens displacement amount and adjustment direction that need to be adjusted.

[0012] Furthermore, the position adjustment module includes a nose pad moving component arranged corresponding to the nose pad, and the control unit controls the movement of the nose pad moving component according to the nose pad adjustment parameters to make the nose pad and the lens move relative to each other or drive the nose pad to move relative to the user's nose to drive the lens to move, so that the user's line of sight falls into the center area of ​​the lens.

[0013] Furthermore, the nose pad includes a nose pad base and a nose pad upper portion, the nose pad base is worn on the user's nose, and the nose pad upper portion is connected to the frame; a nose pad track is installed on the nose pad base, and the nose pad upper portion is movably installed on the nose pad track and can move along the nose pad track; When the nose pad moving assembly drives the upper part of the nose pad to move on the nose pad track, the lens is driven to move together to adjust the position of the lens, while the relative position of the nose pad base and the user's nose remains unchanged.

[0014] Furthermore, the position adjustment module includes a temple adjustment component arranged corresponding to the temple, and the control unit controls the movement of the temple adjustment component according to the temple adjustment parameters to adjust the length and / or tilt angle of the temple, thereby driving the movement of the lens so that the user's line of sight falls into the center area of ​​the lens.

[0015] Furthermore, it also includes a temple adjustment track arranged corresponding to the temple, the temple adjustment track is installed through the temple base, the temple base is worn on the ear of the user, and the temple is movably installed on the temple adjustment track and can move along the temple adjustment track; When the temple adjustment assembly drives the temple to move on the temple adjustment track to adjust the length and / or tilt angle of the temple, the nose pad and lens of the frame are driven to move together, while the relative position of the temple base and the user's ear remains unchanged.

[0016] Further, for the nose pad, the nose pad moving assembly drives the nose pad to move in a rolling, sliding or stepping manner; For the temples, the length of the temples can be adjusted by using a temple adjustment assembly, such as piston telescopic adjustment, thread telescopic adjustment, connecting rod telescopic adjustment, gear rack telescopic adjustment or spring telescopic adjustment; the inclination angle of the temples can be adjusted by using a temple adjustment assembly, such as pulling down or pushing up one end of the temple to move the end downward or lift it up to change the inclination angle of the temple, thereby driving the lens connected to the other end of the temple to rise or fall.

[0017] Furthermore, a head movement monitoring module is provided corresponding to the eye tracking module. The head movement monitoring module is used to monitor the head movement of the user wearing the glasses, and when a head movement event is detected, a trigger instruction is sent to the eye tracking module to start the eye tracking module.

[0018] Furthermore, it also includes a user posture monitoring module for monitoring the body posture and / or the distance of the gaze target of the user wearing the glasses. When the user's body posture and / or the distance of the gaze target do not meet preset conditions, an adverse event prompt message is issued.

[0019] The present invention also provides an adaptive adjustment system for glasses, the system comprising glasses and a portable control device. The glasses are provided with a sight tracking module and a position adjustment module; the sight tracking module is used to perform sight tracking detection on the user wearing the glasses, determine whether the user's sight is offset from the center area of ​​the lens of the glasses, and send the sight offset information to the portable control device; the position adjustment module is used to adjust the relative position of the lens and the human eye; The portable control device is used to receive the line of sight deviation information of the line of sight tracking module, and when it is determined that the line of sight deviation reaches a preset condition, control the aforementioned position adjustment module to adjust the relative position of the lens and the human eye so that the user's line of sight falls into the center area of ​​the lens.

[0020] Furthermore, the portable control device can be detachably mounted on the frame of the glasses via a connecting piece. When the portable control device is mounted on the frame of the glasses, the power source of the portable control device can supply power to the electrical components on the glasses and / or charge the power source on the glasses.

[0021] The present invention also provides an adaptive smart glasses, comprising a glasses body for a user to wear, wherein the glasses body is provided with a sight tracking module and a position adjustment module; The sight tracking module is configured to: perform sight tracking detection on the user wearing the glasses, determine whether the user's sight is offset from the center area of ​​the lens of the glasses, and send a signal to the position adjustment module when it is determined that the sight offset reaches a preset condition; The position adjustment module is configured to: perform actions according to the aforementioned signal to adjust the relative position of the lens and the human eye so that the user's line of sight falls into the central area of ​​the lens.

[0022] Due to the adoption of the above technical scheme, the present invention has the following advantages and positive effects compared with the prior art, as an example: the adaptive adjustment scheme of the glasses provided by the present invention utilizes the line of sight tracking technology, which can detect whether the user's line of sight deviates from the central area of ​​the lens of the glasses through line of sight tracking, and when the line of sight deviation reaches a preset condition, control the action of the position adjustment module on the glasses to adjust the relative position of the lens and the human eye, so that the user's line of sight falls into the central area of ​​the lens. In this way, adaptive and precise adjustment of the position of the glasses is achieved according to the user's glasses usage dynamics, reducing the manual adjustment operation of the user when wearing the glasses, and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 The present invention provides a flowchart of a method for adaptively adjusting glasses.

[0024] Figure 2 A schematic diagram of the structure of glasses provided by an embodiment of the present invention.

[0025] Figure 3 A schematic structural diagram of a mirror frame provided in an embodiment of the present invention.

[0026] Figure 4 A schematic diagram of the structure of glasses when the nose pads are adjusted according to an embodiment of the present invention.

[0027] Figure 5 A schematic diagram of nose pad adjustment with nose pad tracks provided in an embodiment of the present invention.

[0028] Figure 6 A schematic diagram of the structure of adjusting the length of temples provided in an embodiment of the present invention.

[0029] Figure 7 A schematic diagram of the structure of adjusting the tilt angle of temples provided in an embodiment of the present invention.

[0030] Figure 8 A schematic diagram of the structure of an adaptive adjustment system for glasses provided in an embodiment of the present invention.

[0031] Fig. 9 A schematic diagram of the structure of a portable control device provided in an embodiment of the present invention.

[0032] Description of reference numerals: System 1, glasses 10, 11, portable control device 12, housing 1202, clamping portion 1201; Spectacle frame 100; spectacles frame assembly 110; temple assembly 120, temple 121, temple base 122, front temple 1211, rear temple 1212, temple length adjustment structure 123, hinge shaft 124, temple tilt angle adjustment structure 125; nose pad assembly 130, nose pad 131, nose pad gasket 1301, lifting structure 132, nose pad base 1311, nose pad upper part 1312, nose pad rail 1313, slider / pulley 1314; Lens 200, lens center area 210, out-of-focus area 220, lens peripheral area 230; Eye tracking module 300; Motion sensor 400. DETAILED DESCRIPTION

[0033] The following is a further detailed description of the adaptive adjustment method, system and adaptive smart glasses of the glasses disclosed in the present invention in combination with the accompanying drawings and specific embodiments. It should be noted that the technical features or combinations of technical features described in the following embodiments should not be considered isolated, and they can be combined with each other to achieve better technical effects. In the drawings of the following embodiments, the same reference numerals appearing in each drawing represent the same features or components, which can be applied to different embodiments. Therefore, once an item is defined in one drawing, it does not need to be further discussed in subsequent drawings.

[0034] It should be noted that the structures, proportions, sizes, etc. illustrated in the drawings of this specification are only used to match the contents disclosed in the specification for people familiar with this technology to understand and read, and are not used to limit the limiting conditions for the implementation of the invention. Any modification of the structure, change of the proportion relationship or adjustment of the size should fall within the scope of the technical content disclosed by the invention without affecting the effects and purposes that can be achieved by the invention. The scope of the preferred embodiments of the present invention includes other implementations, in which the functions can be performed in a substantially simultaneous manner or in a reverse order according to the functions involved, which should be understood by those skilled in the art of the technical field to which the embodiments of the present invention belong.

[0035] Techniques, methods, and devices known to those of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, the techniques, methods, and devices should be considered part of the specification. In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limiting. Therefore, other examples of the exemplary embodiments may have different values.

[0036] In the description of the embodiments of the present application, " / " means or, and "and / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" means: A and B exist alone, B exists alone, and A and B exist at the same time. In the description of the embodiments of the present application, "multiple" means two or more.

[0037] Technical term explanation: Eye tracking: also called gaze tracking, is the process of tracking (or tracking) the direction of the user's gaze. The core of eye tracking is eye estimation. There are many different methods for eye estimation, among which pupil-corneal reflection technology (light from the light source enters the pupil, and the retina reflects the light from the pupil. The direction of the eye can be calculated based on the angle between the cornea and the pupil reflection light) is the most commonly used technology in the current eye tracking system. Eye tracking based on pupil-corneal reflection technology is widely used in various fields such as smartphones, architectural design, industrial engineering, traffic driving and military.

[0038] Fixation point: refers to a point on an object that the line of sight is focused on during visual perception. The object can be any object in the external space, such as a physical object or virtual projection data.

[0039] Lens center area: a central area of ​​the lens set with the optical center of the lens (the optical center is aligned with the pupil of the user who wears the glasses, and the light transmitted through the optical center can maintain the original direction and shape without refraction) or the geometric center (the geometric center is the contour center of the lens, which is related to the geometric shape of the frame. Ordinary glasses generally require the geometric center of the lens to coincide with the optical center, but there may be a slight offset in reality) as the center point. Example

[0040] See also Figure 1 As shown, a method for adaptive adjustment of glasses provided by the present invention comprises the following steps.

[0041] S100, performing eye tracking detection on the user wearing the glasses. Specifically, the eye tracking detection can be implemented by a dedicated eye tracking device.

[0042] S200, judging whether the user's line of sight deviates from the center area of ​​the lens of the glasses according to the aforementioned line of sight tracking detection. Specifically, information on the intersection of the line of sight and the lens of the glasses can be obtained according to the detected line of sight direction, and judging whether the line of sight deviates from the center area of ​​the lens of the glasses by comparing the position relationship between the position of the intersection and the center area of ​​the lens. When the line of sight has no intersection with the lens of the glasses (the line of sight does not pass through the lens), it can be directly judged that the line of sight deviates from the center area of ​​the lens of the glasses.

[0043] S300, when it is determined that the sight line deviation reaches a preset condition, the position adjustment module on the glasses is controlled to adjust the relative position of the lens and the human eye so that the user's sight line falls into the center area of ​​the lens. That is, the user's sight line passes through the center area of ​​the lens by adjusting the lens position.

[0044] Generally, the above adjustment is performed to make the user's left eye sight pass through the center area of ​​the left eye lens, and the user's right eye sight pass through the center area of ​​the right eye lens. In some cases, the user's dominant eye (or main eye, in most cases the right eye, and the other eye is the auxiliary eye) information can also be obtained, and the lens of the dominant eye is taken as the priority adjustment object. In this case, the adjustment of the dominant eye is given priority, so that the user's dominant eye sight (such as the right eye sight) passes through the center area of ​​the dominant eye lens (such as the right eye lens).

[0045] The glasses include a frame and lenses, wherein the frame includes a lens mounting structure (which may be framed or frameless), temples and nose pads. Figure 2 As shown, taking framed glasses as an example, the frame 100 of the glasses 10 may specifically include a frame assembly 110, a temple assembly 120 and a nose pad assembly 130, and the geometric parameters of the frame 100 may include frame size information, temple size information and nose pad size information. The lens 200 is installed in the frame 100, and the geometric parameters of the lens 200 may include lens size, lens curvature radius, light transmittance, lens thickness and other information.

[0046] The central area of ​​the lens is a central area of ​​the lens formed based on the optical center or geometric center of the lens. The central area of ​​the lens is preferably a circular area or an elliptical area.

[0047] In this embodiment, the glasses are preferably defocus glasses, and the lenses of the defocus glasses at least include a clear area (or clear vision area) in the central area and a defocus area arranged around the clear area, the clear area has a refractive power, and the defocus area is provided with a microlens array. The aforementioned central area of ​​the lens is the clear area of ​​the defocus lens. It should be noted that, for defocus glasses, considering that the optical center and the geometric center of the defocus lens may not coincide in order to correct certain optical defects, when setting the central area of ​​the lens, it is preferred to configure the central area of ​​the lens based on the optical center of the lens.

[0048] Take myopia defocus glasses as an example, see Figure 3 As shown, the lens center area 210 is located in the center of the myopia defocus lens 200. In this embodiment, the inner central area is a clear area with a diopter that has myopia correction characteristics according to the prescription (alternatively, when the glasses are hyperopia glasses, the central area can be a clear area with hyperopia correction characteristics). The periphery of the clear area is the defocus area 220, and a microlens array is arranged in the defocus area 220.

[0049] Specifically, the edge of the clear area extends outward to form a ring-shaped defocusing area 220. As an example but not a limitation, the defocusing area 220 can be composed of multiple aspherical microlens arrays with a diameter of 1 mm or multiple micro-column lens arrays with a width of 1 mm. The micro-column lens array is a plurality of concentrically arranged defocusing rings. Adjacent defocusing rings can be closely connected or separated by gaps. The plurality of concentrically arranged defocusing rings are arranged radially outward. The edge of the defocusing area 220 extends outward to the edge of the lens to form the lens peripheral area 230. The defocusing structure design and defocusing principle of defocusing glasses belong to the prior art and will not be described in detail here.

[0050] For defocused glasses, when judging whether the line of sight of the user wearing the glasses deviates from the central area of ​​the lens, it is mainly judged whether the line of sight of the user deviates from the clear area of ​​the defocused lens.

[0051] Optionally, the range of the clear area of ​​the defocus glasses can be set between 3mm and 30mm. Taking the circular area as an example, the radius of the clear area can be set between 2mm and 4mm. Taking the elliptical area as an example, the short diameter of the clear area can be set between 4mm and 6mm, and the long diameter is larger than the short diameter, preferably about twice the short diameter.

[0052] In this embodiment, the preset condition may be one of the following conditions.

[0053] Condition 1: The user's line of sight is deviated outside the center area of ​​the lens.

[0054] As an example but not limitation, for example, the central area of ​​the lens is a circular area with a radius of R and an optical center point O of the lens as the center. When it is detected that the user's line of sight deviates outside the aforementioned circular area, it is determined that the condition is met and the glasses position adjustment is triggered.

[0055] Condition 2: The user's line of sight deviates outside the center area of ​​the lens and the deviation state lasts longer than a preset time threshold.

[0056] Considering that some of the user's line of sight deviation behaviors are temporary behaviors - for example, the user's eyes looked at the lamp on the ceiling (the gaze point of this gaze) and quickly moved back to the line of sight. In this case, if the glasses are adjusted according to the user's line of sight deviation, the frequency of glasses adjustment will be too frequent, which will reduce the user experience and increase the information processing burden of the system. Therefore, the determination of the line of sight deviation time is added to this implementation. At this time, when it is detected that the user's line of sight is deviated outside the center area of ​​the lens - for example, the user's line of sight is deviated outside the aforementioned circular area, the timer can be controlled to start timing. When the duration t of the monitored deviation state exceeds the preset time threshold T, it is determined that the condition is met and the glasses position adjustment is triggered. In this way, not only can the user discomfort caused by frequent glasses position adjustment operations be avoided, but also the information processing burden of the system can be reduced.

[0057] Preferably, when it is detected that the user's line of sight deviates from the center area of ​​the lens, the user's corresponding behavior information (which can be realized by a motion sensor) is collected, and then it is determined based on the user's behavior information whether the user's line of sight deviation is based on a head movement event or an eye movement event. When it is determined to be based on a head movement event, the aforementioned timer is controlled to start timing. When the duration t of the deviation state exceeds the preset time threshold T, it is determined that the condition is met and the glasses position adjustment is triggered; when it is determined to be based on an eye movement event, it is determined that there is no need to trigger the glasses position adjustment, that is, there is no need to start the timer. In this way, by combining the user's behavior to screen the situations in which the user needs or expects to adjust the glasses position, the user experience is improved.

[0058] Condition 3: The offset between the user's line of sight and the center area of ​​the lens exceeds a preset displacement threshold.

[0059] At this time, the condition for triggering the position adjustment is that the sight line offset reaches a preset displacement threshold. In this embodiment, the displacement threshold can be set by the user as needed, so that the user can set the sight line offset value that can trigger the glasses position adjustment according to actual requirements. Preferably, the displacement threshold is related to the radius of the central area of ​​the lens.

[0060] As an example of a typical method, the steps for calculating the line of sight offset can be as follows: obtain the intersection position of the user's line of sight on the lens (such as the coordinate position on the lens), determine whether the aforementioned intersection coordinates are located in the central area of ​​the aforementioned lens, and when the intersection coordinates fall into the central area, determine that no line of sight offset has occurred; when the intersection coordinates do not fall into the central area, determine that line of sight offset has occurred, and obtain the distance value d between the intersection coordinates and the edge of the central area of ​​the lens as the line of sight offset, where d=LR, L is the distance between the intersection coordinates and the center point O of the lens (the center point of the central area of ​​the lens), R is the radius of the central area of ​​the lens, and d is a number greater than 0.

[0061] Then, the distance value d is compared with a preset displacement threshold. When the distance value d is greater than the preset displacement threshold, it is determined that the condition is met, and the glasses position adjustment is triggered.

[0062] Condition 4: The offset between the user's line of sight and the center area of ​​the lens exceeds a preset displacement threshold, and the duration of the offset state exceeds a preset time threshold.

[0063] Similar to condition 2, this implementation screens out temporary sight deviation behaviors of users by adding the determination of sight deviation time to avoid too frequent glasses position adjustment operations. At this time, when it is detected that the sight deviation of the user exceeds the preset displacement threshold value, for example, when it is detected that the distance value d is greater than the preset displacement threshold value, the timer can be controlled to start timing. When the duration t of the monitored deviation state exceeds the preset time threshold value T, it is determined that the condition is met and the glasses position adjustment is triggered.

[0064] Preferably, when it is detected that the user's line of sight is shifted, the user's corresponding behavioral action information can be collected, and then it can be determined whether the user's line of sight shift is based on a head movement event or an eye movement event based on the user's behavioral action information. When it is determined to be based on a head movement event, the aforementioned timer is controlled to start timing. When the duration t of the shifted state exceeds the preset time threshold T, it is determined that the condition is met, and the glasses position adjustment is triggered; when it is determined to be based on an eye movement event, it is determined that there is no need to trigger the glasses position adjustment, that is, there is no need to start the timer.

[0065] In this embodiment, continue to refer to Figure 3 As shown, a sight tracking module 300 can be directly set on the glasses to perform the aforementioned sight tracking detection. The sight tracking module 300 and the position adjustment module are both connected to the control module for communication and receive control from the control module. The control module can be directly set on the glasses or can be set separately from the glasses, which is not limited here.

[0066] The line of sight tracking module 300 can be arranged to determine the line of sight direction of each eye of the user wearing the glasses by any existing line of sight tracking method. Preferably, the line of sight tracking module 300 is configured to: direct light (such as infrared light) into the eye, use an image capture unit to detect at least one reflection (visible reflection, such as faint light) from at least one surface associated with the eye, determine (usually estimated by a geometric model) the line of sight information (such as the line of sight direction) associated with the eye based on the aforementioned detected reflection, and send the determined line of sight information to the aforementioned control module. The line of sight is an angular direction associated with the gaze of the eye (corresponding to the gaze point). In a specific implementation, the line of sight tracking module 300 may include a projector and an image capture unit mounted on the frame corresponding to the user's eye setting, the projector may include a laser, and the image capture unit may include a line of sight tracking camera. Light is directed into the eye using a projector, such as by using discrete IR light emitting diodes (LEDs) to direct discrete infrared (IR) light sources into the eye, the IR light being well reflected by the cornea or other components of the eye (e.g., the pupil), and the reflections being readily detected by an IR image capture unit; at least one reflection from at least one surface associated with the eye is then detected using a gaze tracking camera (e.g., an IR camera); and a gaze associated with the eye is subsequently determined based on the detected reflections. Gaze tracking may be performed by tracking various characteristics associated with the glimmer, such as the distance, direction, and orientation of the glimmer relative to a gaze tracking module (e.g., a light source and / or an image capture module), the orientation including at least one of an azimuth, elevation, or tilt angle associated with the glimmer.

[0067] Important parts of the human eye include the cornea, iris, pupil, lens, retina and optic nerve. The cornea is a clear convex surface in front of the eye. The cornea is the main refractive surface of the eye. The iris is the colored part of the eye that adjusts the amount of light entering the eye. The pupil is the opening at the center of the iris. The iris changes or adjusts the size of the pupil and thereby controls the amount of light entering the eye. The lens is the clear part of the eye behind the iris that focuses light on the retina. The retina is a photosensitive tissue arranged at the back of the eye. The retina converts light into electrical signals, which are transmitted to the brain via the optic nerve. The aqueous humor is a gel-like liquid that is located in the space between the lens and the cornea. The function of the aqueous humor is to maintain intraocular pressure and expand the eyeball. In this embodiment, the surface associated with the reflection can be at least one of the cornea, pupil, iris or retina (or retinal blood vessels) associated with the eye. As an example, taking the pupil as an example, the vector formed by the angle between the glimmer and the pupil reflection can be combined with other geometric data to determine the gaze direction.

[0068] When the gaze tracking module detects eye movements and determines gaze information, it can also capture relevant data of the user's eyes, such as calculating the pupil size, iris image, blinking frequency, eyelid closure, eye saccade trajectory, gaze duration, etc. The above eye movement data detection and calculation are all existing technologies and will not be elaborated here.

[0069] In this embodiment, the glasses may further include one or more motion sensors 400, which are arranged to collect and measure motion data of the glasses. As an example and not limitation, the motion sensor may include an inertial measurement unit IMU, and the IMU may specifically include a gyroscope (e.g., a three-axis gyroscope) and / or a magnetometer (e.g., a three-axis magnetometer). The motion data obtained using the motion sensor can be used to determine changes in the position and / or orientation of the glasses, and can also reflect changes in the position and direction of the user's head.

[0070] The control module is configured to: determine whether the user's line of sight deviates from the center area of ​​the lens of the glasses according to the line of sight information detected by the line of sight tracking module; and generate a glasses adjustment instruction when it is determined that the line of sight deviation reaches a preset condition, and control the position adjustment module on the glasses to act according to the glasses adjustment instruction. The glasses adjustment instruction includes a lens position adjustment parameter.

[0071] A method for determining whether the user's line of sight deviates from the central area of ​​the lenses of the aforementioned glasses may be: after obtaining the user's line of sight information, obtain the line of sight position on the lens according to the lens position monitored by the glasses position sensor; obtain regional parameter information of the lens (such as a defocused lens), the regional parameter information at least including position information of the central area of ​​the lens (for example, it may include parameters such as the center point coordinates of the central area, the area boundary, and the area diameter), compare the aforementioned line of sight position with the central area position of the lens, and when the line of sight position is located within the central area position of the lens, determine that the line of sight has not deviated from the central area of ​​the lenses of the aforementioned glasses, otherwise, determine that the line of sight deviates from the central area of ​​the lenses of the aforementioned glasses.

[0072] The regional parameter information of the lens may be pre-stored in the control module, or may be stored in an associated external server / database and the data of the external server / database may be accessed by the control module. For a defocused lens, since its clear area and defocused area can be visually identified, the regional parameter information of the lens may also be obtained by performing image recognition on the captured lens image data through an image recognition device.

[0073] The lens position adjustment parameters may include nose pad adjustment parameters and / or temple adjustment parameters, which may be generated by a preset lens position adjustment model.

[0074] The lens position adjustment model is configured to perform the following steps: S310, receiving input data, wherein the input data may include line of sight offset information and current glasses wearing position information. Specifically, the line of sight offset information includes line of sight deviation amount and offset direction, and the current glasses wearing position information may include current nose pad position information, current temple length information, and current temple inclination angle information relative to the horizontal plane, which may be obtained by monitoring multiple position sensors / motion sensors etc. arranged at relevant positions.

[0075] S320, determining the lens displacement amount and adjustment direction to be adjusted according to the aforementioned line of sight offset information; wherein the lens displacement amount to be adjusted is a function related to the line of sight deviation, and the adjustment direction is the opposite direction of the line of sight offset direction.

[0076] S330, calculating nose pad adjustment parameters and / or temple adjustment parameters according to the lens displacement and adjustment direction to be adjusted. The nose pad adjustment parameters are functions related to the lens displacement and adjustment direction to be adjusted; and the temple adjustment parameters are functions related to the current wearing position information of the glasses, and the lens displacement and adjustment direction to be adjusted.

[0077] In this embodiment, the function can be set by the system by default or can be set by the user. Preferably, the sum of the sight deviation and the radius of the lens center area is used as the lens displacement that needs to be adjusted.

[0078] The nose pad adjustment parameters may specifically include nose pad displacement distance information and nose pad displacement direction information, the nose pad displacement distance may be equal to the lens displacement amount, and the nose pad displacement direction may be the lens adjustment direction. The temple adjustment parameters may specifically include temple length adjustment parameters and temple tilt angle adjustment parameters. Specifically, after obtaining the current wearing position information of the glasses in the input data, the temple length adjustment parameters and temple tilt angle adjustment parameters may be calculated according to the lens displacement amount and adjustment direction that need to be adjusted.

[0079] Preferably, the temple adjustment parameters are: after calculating the target temple length based on the distance between the target nose pad position and the current nose pad position and the current temple length, the difference between the target temple length and the current temple length is deducted, and a positive difference indicates that the temple is lengthened, and a negative difference indicates that the temple is shortened.

[0080] The temple tilt angle adjustment parameter is: according to the position of the top of the user's ear, with the top of the user's ear as the center of the circle, calculate the arc angle corresponding to the nose pad moving from the current nose pad position to the target nose pad position.

[0081] In this embodiment, the position adjustment module provided on the glasses may specifically include a nose pad moving component provided corresponding to the nose pad and a temple adjusting component provided corresponding to the temple.

[0082] On the one hand, the control unit can control the movement of the nose pad moving assembly according to the nose pad adjustment parameter to make the nose pad and the lens move relative to each other, so that the user's line of sight falls into the center area of ​​the lens. Preferably, the position of the nose pad on the user's nose is kept unchanged, and the lifting structure on the nose pad controls the lifting of the frame, thereby driving the lens to lift relative to the nose pad, and the position of the lens is adjusted so that the user's line of sight re-enters the center area of ​​the lens.

[0083] By way of example and not limitation, see Figure 4 As shown, for example, the nose pad assembly 130 may include a nose pad 131 and a lifting structure 132. Nose pad gaskets 1301 are provided on both sides of the nose pad 131. The nose pad gaskets 1301 are symmetrically arranged and connected through a connecting portion. The lifting structure 132 is movably mounted in the middle of the connecting portion, and the upper end of the lifting structure 132 is fixedly connected to the frame. The lifting structure 132 can move up and down relative to the connecting portion of the nose pad 131 to adjust the distance between the nose pad 131 and the frame. When the frame moves, the lens thereon moves together, thereby achieving relative movement between the nose pad and the lens. After moving into position, the lifting structure 132 can also be limited (or locked) to keep the position fixed.

[0084] Alternatively, the nose pad moving component is controlled to move according to the nose pad adjustment parameter to drive the nose pad to move relative to the user's nose, thereby driving the lens to move, so that the user's line of sight falls into the center area of ​​the lens. At this time, when the nose pad moves relative to the nose, the nose pad drives the frame to move together, so that the relative position of the lens and the eye changes. Specifically, when the nose pad moves upward or downward relative to the user's nose, the relative position of the lens and the eye also changes, and the position of the nose pad is adjusted so that the lens is located in front of the pupil of the user's eye, and the user's line of sight falls into the center area of ​​the lens.

[0085] In this embodiment, the nose pad moving component drives the nose pad to move in a rolling, sliding or stepping manner. The driving structure of the nose pad moving component is preferably a micro motor. It should be noted that the scheme of driving an object to move relative to a surface by a motor in a rolling, sliding or stepping manner can be used in the nose pad movement of the present invention, and reference can be made to various relative motion control schemes in the prior art, which will not be repeated here.

[0086] Preferably, see Figure 5 As shown, the nose pad may include a nose pad base 1311 and a nose pad upper part 1312, the nose pad base 1311 is worn on the user's nose, and the nose pad upper part 1312 is connected to the frame; a nose pad rail 1313 is installed on the nose pad base 1311, and the nose pad upper part 1312 is movably installed on the nose pad rail 1313 through a slider / pulley 1314 and can move along the track direction of the nose pad rail 1313, while movements in other directions are restricted.

[0087] The nose pad moving component, such as a driving motor, can drive the nose pad upper part 1312 to move on the nose pad track 1313, and the nose pad upper part 1312 drives the frame and the lens to move together to adjust the position of the lens, while the relative position of the nose pad base 1311 and the user's nose remains unchanged. After the nose pad upper part 1312 moves into position on the nose pad track 1313, the control unit can also control the locking structure to act on the nose pad upper part 1312 to limit the nose pad upper part (the locking structure enters a locking state), so that the nose pad upper part can maintain this position.

[0088] In this way, by setting the nose pad separately and installing the upper part of the nose pad through the nose pad track, when the upper part of the nose pad moves, the position of the base of the nose pad worn on the nose does not move, reducing the user's discomfort when the position of the nose pad is adjusted.

[0089] On the other hand, the control unit can control the movement of the temple adjustment assembly according to the temple adjustment parameters to adjust the length and / or tilt angle of the temple, thereby driving the lens to move so that the user's line of sight falls into the center area of ​​the lens.

[0090] The temple adjustment assembly may include a temple telescopic adjustment structure and a temple tilt angle adjustment structure. The control unit can control the temple telescopic adjustment structure to extend or shorten the temple length according to the temple length adjustment parameter, and can control the temple tilt angle adjustment structure to adjust the temple tilt angle relative to the horizontal plane according to the temple tilt angle adjustment parameter. In this way, the position of the lens of the glasses is adjusted by adjusting the temple length and the tilt angle.

[0091] Specifically, the length of the temples can be adjusted by the temple adjustment assembly in one or more of the following ways: piston telescopic adjustment, thread telescopic adjustment, connecting rod telescopic adjustment, gear rack telescopic adjustment, and spring telescopic adjustment. Figure 6 As shown, a piston telescopic adjustment scheme is exemplified, which adjusts the length of the temple 121 by setting a piston rod as a temple length adjustment structure 123 between the front temple 1211 and the rear temple 1212 of the temple 121.

[0092] The method of adjusting the inclination angle of the temple by the temple adjustment assembly is to pull down or push up one end of the temple to move it downward or tilt it so as to change the inclination angle of the temple, thereby driving the lens connected to the other end of the temple to rise or fall. Figure 7As shown, an example is given of using an upper supporting structure as the temple inclination angle adjustment structure 125, pushing up (or lifting up) one end of the temple 121 (for example, the front temple 121) to tilt the temple at that end. At this time, the rear temple 1212 of the temple can rotate based on the hinge shaft 124, so that the inclination angle of the temple 121 changes, and when the front temple 121 end moves, it drives the frame connected to the temple to move together, thereby driving the lens to move.

[0093] Preferably, after the control unit controls the movement of the nose pad moving component according to the nose pad adjustment parameters (the user's line of sight falls into the center area of ​​the lens), it can also collect the current contact position information between the temple and the user's ear and / or the pressure information of the ear contact position, and judge whether the temple length is appropriate based on the collected information. When it is determined that the temple length is not appropriate, the control unit controls the temple to extend or shorten so that the contact position and contact position pressure of the temple and the ear are within a preset appropriate range.

[0094] Preferably, the position adjustment mechanism also includes a temple adjustment track corresponding to the temple, the temple adjustment track can be installed through the temple base, the temple base can be worn on the user's ear, and the temple is movably installed on the temple adjustment track and can move along the temple adjustment track. When the temple is driven to move on the temple adjustment track by the temple adjustment assembly to adjust the length and / or tilt angle of the temple, the nose pad and lens of the frame are driven to move together, while the relative position of the temple base and the user's ear remains unchanged. In this way, by setting the temple adjustment track, when the temple is adjusted, the position of the temple base worn on the ear does not move, which can reduce the discomfort of the user's ear when the temple is adjusted.

[0095] It should be noted that when adjusting the length of the temples and / or the inclination angle of the temples, corresponding to the scheme of setting the nose pad track, the locking structure of the upper part of the nose pad should be controlled to be in an unlocked state first, so that the upper part of the nose pad can move freely relative to the nose pad track. At this time, the force applied to the temples can drive the frame connected to the temples to move together, and when the frame moves, the upper part of the nose pad and the lens connected thereto can be driven to move together. When the temples are adjusted to the right position, the upper part of the nose pad also moves to the right position on the nose pad track. At this time, the control unit can control the locking structure to enter the locked state, so that the upper part of the nose pad can be maintained in the current position.

[0096] In another implementation of the present embodiment, a head movement monitoring module may also be provided corresponding to the eye tracking module. The head movement monitoring module is used to monitor the head movement of the user wearing the glasses, and when a head movement event is detected, a trigger instruction is sent to the eye tracking module to start the eye tracking module.

[0097] In another implementation of this embodiment, the user can also be reminded of bad eye behavior. Specifically, a user posture monitoring module can be set up, and the user posture monitoring module is used to monitor the body posture and / or the distance of the gaze target of the user wearing the glasses, and when the user's body posture and / or the distance of the gaze target do not meet the preset conditions, an adverse event prompt information is issued.

[0098] Another embodiment of the present invention further provides an adaptive adjustment system for glasses.

[0099] See also Figure 8 As shown, the system 1 comprises glasses 11 and a portable control device 12 .

[0100] The glasses 11 may be provided with a sight tracking module and a position adjustment module.

[0101] The sight tracking module is used to perform sight tracking detection on a user wearing glasses, determine whether the user's sight is offset from the central area of ​​the lens of the glasses, and send sight offset information to a portable control device.

[0102] The position adjustment module is used to adjust the relative position of the lens and the human eye.

[0103] The portable control device 12 is used to receive the sight line deviation information from the sight line tracking module, and when it is determined that the sight line deviation reaches a preset condition, control the aforementioned position adjustment module to adjust the relative position between the lens and the human eye so that the user's sight line falls into the center area of ​​the lens. That is, by adjusting the lens position, the user's sight line passes through the center area of ​​the lens.

[0104] In this embodiment, the portable control device can be detachably mounted on the frame of the glasses through a connector. Preferably, the portable control device can be detachably mounted on the temple of the glasses. The connector can be a snap-fit ​​structure, a plug-in structure, a magnetic adsorption structure, an adhesive structure, or any other detachable connection structure.

[0105] During specific implementation, the portable control device 12 can be directly a mobile phone, or the portable control device 12 can be a dedicated glasses control device.

[0106] As an example of a typical approach, see Fig. 9 As shown, the dedicated glasses control device may include a housing 1202 and a clamping portion 1201. A control chip and other electronic components are disposed in the housing 1202. Human-machine interaction structures such as operation buttons, a display screen, and indicator lights may also be disposed on the housing 1202. The housing 1202 may be mounted on the frame of the glasses 11, such as the temples, through the clamping portion 1201.

[0107] Preferably, the size of the housing 1202 meets the daily carrying requirements of users who wear glasses. For example, the housing of the glasses control device can be designed to be sized to be placed in a pencil case or a glasses case.

[0108] In this embodiment, when the portable control device is mounted on the frame of the glasses, the power supply of the portable control device can supply power to the electrical components on the glasses and / or charge the power supply on the glasses. That is, when the portable control device is mounted on the frame of the glasses, the two can be electrically connected.

[0109] Taking the plug-in structure as an example, an electrical interface / electronic interface is also provided on the mechanical interface of the plug-in structure, and the mechanical interface of the portable control device is configured to easily and stably fasten the portable control device to the corresponding mechanical interface on the temple, and at the same time, the device is electrically / electronically connected to the circuit of the smart glasses through the electrical interface / electronic interface on the mechanical interface.

[0110] After charging is complete, the user can detach the portable control unit.

[0111] It should be noted that the gaze tracking module on the glasses may also adopt a detachable connection method. For example, the gaze tracking module may include a clamping mechanism, which is used to install the module body on the glasses so that the projector and the gaze tracking camera correspond to the settings of the human eyes, and gaze tracking detection is performed through the gaze tracking module.

[0112] For other technical features, please refer to the description of the previous embodiment and will not be repeated here.

[0113] Another embodiment of the present invention further provides a pair of adaptive glasses, including a glasses body for a user to wear, wherein a sight tracking module and a position adjustment module are provided on the glasses body.

[0114] The sight tracking module is configured to: perform sight tracking detection on the user wearing the glasses, determine whether the user's sight is offset from the center area of ​​the lens of the glasses, and send a signal to the position adjustment module when it is determined that the sight offset reaches a preset condition; The position adjustment module is configured to: perform actions according to the aforementioned signal to adjust the relative position of the lens and the human eye so that the user's sight falls into the central area of ​​the lens, that is, the user's sight passes through the central area of ​​the lens by adjusting the position of the lens.

[0115] For other technical features, please refer to the description of the previous embodiment and will not be repeated here.

[0116] In the above description, the disclosure of the present invention is not intended to limit itself to these aspects. Rather, within the scope of the target protection of the present disclosure, the components can be selectively and operatively combined in any number. In addition, words such as "including", ... The terms "encompass" and "have" should be interpreted as inclusive or open by default, rather than exclusive or closed, unless they are expressly defined to the contrary. All technical, scientific or other terms have the meanings understood by those skilled in the art unless they are defined to the contrary. Common terms found in dictionaries should not be interpreted in an idealistic or unrealistic way in the context of relevant technical documents, unless the present disclosure expressly defines them as such. Any changes and modifications made by a person of ordinary skill in the field of the present invention based on the above disclosure are within the scope of protection of the claims.

Claims

1. A method for adaptively adjusting glasses, characterized in that Includes steps: Conducting eye tracking detection for users wearing glasses; According to the aforementioned gaze tracking detection, determining whether the user's gaze deviates from the central area of ​​the lens of the aforementioned glasses; When it is determined that the sight line deviation reaches a preset condition, the position adjustment module on the glasses is controlled to adjust the relative position of the lens and the human eye so that the user's sight line falls into the center area of ​​the lens.

2. The method according to claim 1, characterized in that: The preset conditions are: The user's line of sight is shifted outside the center area of ​​the lens; or, The user's line of sight deviates from the center area of ​​the lens and the deviation state lasts longer than a preset time threshold; or, The deviation between the user's line of sight and the center area of ​​the lens exceeds a preset displacement threshold; or, The offset between the user's line of sight and the central area of ​​the lens exceeds a preset displacement threshold, and the duration of the offset state exceeds a preset time threshold.

3. The method according to claim 2, characterized in that: The glasses are defocus glasses, and the lenses of the defocus glasses at least include a clear area in the central region and a defocus area arranged around the clear area, the clear area has a refractive power, and the defocus area is provided with a microlens array; the aforementioned central area of ​​the lens is the clear area of ​​the defocus lens.

4. The method according to any one of claims 1 to 3, characterized in that: The glasses are provided with a sight tracking module, and both the sight tracking module and the position adjustment module are communicatively connected with the control module and receive control from the control module; The gaze tracking module is configured to: direct light into the eye, detect at least one reflection from at least one surface associated with the eye using an image capture unit, determine gaze information associated with the eye based on the detected reflection, and send the determined gaze information to the control module, wherein the gaze is an angular direction associated with a gaze of the eye; The control module is configured to: determine whether the user's line of sight deviates from the central area of ​​the lens of the glasses based on the line of sight information detected by the line of sight tracking module; and, when it is determined that the line of sight deviation reaches a preset condition, generate a glasses adjustment instruction, and control the action of the position adjustment module on the glasses based on the glasses adjustment instruction; the glasses adjustment instruction includes a lens position adjustment parameter.

5. The method according to claim 4, characterized in that: The lens position adjustment parameters include nose pad adjustment parameters and / or temple adjustment parameters, which are generated by a lens position adjustment model; The lens position adjustment model is configured to perform the following steps: Receive input data; the input data includes sight line offset information and current glasses wearing position information, the sight line offset information includes sight line deviation amount and offset direction, the current glasses wearing position information includes current nose pad position information, current temple length information and current temple inclination angle information relative to the horizontal plane; Determine the lens displacement amount and adjustment direction to be adjusted according to the aforementioned sight line deviation information; wherein the lens displacement amount to be adjusted is a function related to the sight line deviation amount, and the adjustment direction is the opposite direction of the sight line deviation direction; According to the aforementioned lens displacement amount and adjustment direction that need to be adjusted, calculate the nose pad adjustment parameters and / or temple adjustment parameters; wherein the nose pad adjustment parameters are functions related to the lens displacement amount and adjustment direction that need to be adjusted, and the temple adjustment parameters are functions related to the aforementioned current wearing position information of the glasses, as well as the lens displacement amount and adjustment direction that need to be adjusted.

6. The method according to claim 5, characterized in that: The position adjustment module includes a nose pad moving component arranged corresponding to the nose pad, and the control unit controls the movement of the nose pad moving component according to the nose pad adjustment parameters to make the nose pad and the lens move relative to each other or drive the nose pad to move relative to the user's nose to drive the lens to move, so that the user's line of sight falls into the center area of ​​the lens.

7. The method according to claim 6, characterized in that: The nose pad comprises a nose pad base and a nose pad upper portion, the nose pad base is worn on the user's nose, and the nose pad upper portion is connected to the frame; a nose pad track is installed on the nose pad base, and the nose pad upper portion is movably installed on the nose pad track and can move along the nose pad track; When the nose pad moving assembly drives the upper part of the nose pad to move on the nose pad track, the lens is driven to move together to adjust the position of the lens, while the relative position of the nose pad base and the user's nose remains unchanged.

8. The method according to claim 5, characterized in that: The position adjustment module includes a temple adjustment component arranged corresponding to the temple. The control unit controls the movement of the temple adjustment component according to the temple adjustment parameters to adjust the length and / or tilt angle of the temple, thereby driving the lens to move so that the user's line of sight falls into the center area of ​​the lens.

9. The method according to claim 8, characterized in that: It also includes a temple adjustment track arranged corresponding to the temple, the temple adjustment track is installed through the temple base, the temple base is worn on the ear of the user, and the temple is movably installed on the temple adjustment track and can move along the temple adjustment track; When the temple adjustment assembly drives the temple to move on the temple adjustment track to adjust the length and / or tilt angle of the temple, the nose pad and lens of the frame are driven to move together, while the relative position of the temple base and the user's ear remains unchanged.

10. The method according to any one of claims 6 to 9, characterized in that: For the nose pad, the nose pad moving component drives the nose pad to move in a rolling, sliding or stepping manner; For the temples, the length of the temples can be adjusted by using a temple adjustment assembly, such as piston telescopic adjustment, thread telescopic adjustment, connecting rod telescopic adjustment, gear rack telescopic adjustment or spring telescopic adjustment; the inclination angle of the temples can be adjusted by using a temple adjustment assembly, such as pulling down or pushing up one end of the temple to move the end downward or lift it up to change the inclination angle of the temple, thereby driving the lens connected to the other end of the temple to rise or fall.

11. The method according to claim 4, characterized in that: A head movement monitoring module is provided corresponding to the sight tracking module. The head movement monitoring module is used to monitor the head movement of the user wearing the glasses, and when a head movement event is detected, a trigger instruction is sent to the eye tracking module to start the eye tracking module.

12. The method according to claim 1, characterized in that: It also includes a user posture monitoring module for monitoring the body posture and / or the distance of the gaze target of the user wearing the glasses. When the user's body posture and / or the distance of the gaze target do not meet preset conditions, an adverse event prompt message is issued.

13. An adaptive adjustment system for glasses, characterized in that: including glasses and a portable control device, The glasses are provided with a sight tracking module and a position adjustment module; the sight tracking module is used to perform sight tracking detection on the user wearing the glasses, determine whether the user's sight is offset from the center area of ​​the lens of the glasses, and send the sight offset information to the portable control device; The position adjustment module is used to adjust the relative position of the lens and the human eye; The portable control device is used to receive the line of sight deviation information of the line of sight tracking module, and when it is determined that the line of sight deviation reaches a preset condition, control the aforementioned position adjustment module to adjust the relative position of the lens and the human eye so that the user's line of sight falls into the center area of ​​the lens.

14. The system according to claim 13, characterized in that: The portable control device can be detachably mounted on the frame of the glasses via a connecting piece. When the portable control device is mounted on the frame of the glasses, the power source of the portable control device can supply power to the electrical components on the glasses and / or charge the power source on the glasses.

15. An adaptive smart glasses, comprising a glasses body for a user to wear, characterized in that: The glasses body is provided with a sight tracking module and a position adjustment module; The sight tracking module is configured to: perform sight tracking detection on the user wearing the glasses, determine whether the user's sight is offset from the center area of ​​the lens of the glasses, and send a signal to the position adjustment module when it is determined that the sight offset reaches a preset condition; The position adjustment module is configured to: perform actions according to the aforementioned signal to adjust the relative position of the lens and the human eye so that the user's line of sight falls into the central area of ​​the lens.

Citation Information

Patent Citations

  • A kind of myopia defocus prevention and control glasses with adjustable high precision

    CN117111328B

Cited By

  • Adjusting method of intelligent glasses, intelligent glasses and storage medium

    CN116626902A