Automatic adjustment method of glasses, intelligent glasses and system

Abstract

The invention discloses an automatic adjustment method of glasses, intelligent glasses and a system, and relates to the technical field of glasses. The method comprises the following steps: tracking sight line information of a glasses wearing user; judging whether the sight line of the user strabismus the refraction area of the glasses lens or not; and when the strabismus angle between the sight line of the user and the refraction area of the lenses reaches a preset condition, controlling a lens adjusting mechanism on the glasses to move the lenses, so that the strabismus angle between the sight line of the user and the refraction area of the lenses is within a preset reasonable range. The relative positions of the lenses and the human eyes can be dynamically and automatically adjusted according to the sight line of the user, so that the sight line of the user can be orthogonal to the refraction area of the lenses as far as possible, the degree accuracy when the user wears the glasses to see an object is improved, and the user can conveniently obtain a clearer visual effect.

Description

Technical Field

[0001] The present invention relates to the technical field of glasses, and in particular to an automatic adjustment method for glasses, smart glasses and a system. Background Art

[0002] Glasses are mainly used to correct visual defects. For example, the lenses of glasses are equipped with refractive areas to correct the refractive error of the user's eyes. Refractive error is a common ophthalmic problem, including myopia, hyperopia and astigmatism. Myopia refers to the situation in which parallel light rays fall in front of the retina after refraction in the eye when the eye is in a static state of adjustment, causing distant objects to be blurred; hyperopia is the opposite, with the focus falling behind the retina, causing nearby objects to be blurred; astigmatism is due to the irregular curvature of the cornea or lens, which causes the light to be unable to focus accurately on the retina, forming multiple focal points.

[0003] When a user wears glasses to correct (compensate for) refractive errors of the eyes, an ophthalmologist or optometrist first detects the user's visual defects and provides a corresponding eye prescription (the prescription usually records the refractive power, astigmatism, astigmatism direction, refractive index of the lens material and other parameters of the lenses the user needs to wear); then, the lens maker designs and manufactures glasses suitable for the user based on the eye prescription.

[0004] However, when users wear glasses, there may be a difference between the degree of the glasses lens and the degree actually felt by the eyes. This difference can be used to evaluate the accuracy of the degree of the glasses. This difference is affected by many factors, mainly including whether the optometry is accurate, whether the lens production and processing are standardized, whether the frame is properly selected (such as the matching degree between the wearer's face shape and the shape of the glasses frame, the type of nose pads, the size of the frame, etc.), whether the eye habits are bad, whether there are scratches / stains on the lenses that affect the optical performance of the lenses, whether the user wears the glasses correctly, etc. Among them, the focus of evaluating whether the user wears the glasses correctly is the relative position of the glasses lens and the human eye. The relevant position parameters mainly include the eye-to-eye distance of the glasses (that is, the distance between the lens and the eye), the tilt angle of the lens (the degree of tilt of the lens relative to the vertical / horizontal direction, that is, the angle formed by the lens and the vertical / horizontal plane), etc. In other words, the relative position of the glasses lens and the human eye will affect the accuracy of the degree of the glasses worn by the user and affect the user's vision effect.

[0005] Currently, the lenses of various traditional glasses are usually fixedly connected to the frames, resulting in a fixed relative position between the lenses and the frames. The lenses cannot be automatically adjusted according to the dynamic viewing needs of the user, which affects the accuracy of the degree when the user wears the glasses to see. Summary of the invention

[0006] The purpose of the present invention is to overcome the deficiencies of the prior art and provide an automatic adjustment method for glasses, smart glasses and a system. The automatic adjustment scheme for glasses provided by the present invention tracks the sight line information of the user wearing the glasses. When it is determined that the squint angle between the user's sight line and the refractive area of ​​the lens reaches a preset condition, the lens adjustment mechanism on the glasses can be controlled to move the lens so that the squint angle between the user's sight line and the refractive area of ​​the lens is within a preset reasonable range. The present invention can automatically adjust the relative position of the lens and the human eye according to the user's sight line, so that the user's sight line can be kept as orthogonal as possible with the refractive area of ​​the lens. In this way, the accuracy of the degree when the user wears the glasses to see objects is improved, and the user can obtain a clearer visual effect.

[0007] To achieve the above objectives, the present invention provides the following technical solutions: A method for automatically adjusting glasses comprises the following steps: Tracking the sight information of the user wearing the glasses; Determine whether the user's line of sight is squinting at the refractive area of ​​the glasses lens; When the squint angle between the user's sight line and the lens's refractive area reaches a preset condition, the lens adjustment mechanism on the glasses is controlled to move the lens so that the squint angle between the user's sight line and the lens's refractive area is within a preset reasonable range.

[0008] Furthermore, the refractive area of ​​the glasses lens is located in the central area of ​​the lens. When it is detected that the user's line of sight deviates from the central area of ​​the lens, the lens adjustment mechanism on the glasses is controlled to move the lens so that the user's line of sight is emitted through the refractive area of ​​the lens.

[0009] Furthermore, the glasses are defocus glasses, the lenses of which include at least a clear area in the central region and a defocus area arranged around the clear area, and the defocus area is provided with a microlens array; the aforementioned refractive area is located in the clear area of ​​the defocus lens.

[0010] Further, the way to move the lens is: Control the movement of the lens adjustment mechanism to drive the lens to translate and / or rotate relative to the human eye.

[0011] Furthermore, the lens is movably mounted on a frame through a lens adjustment mechanism, and the frame is worn in front of the user's eyes; the lens adjustment mechanism is controlled to drive the lens to translate and / or rotate relative to the frame, thereby causing the lens to translate and / or rotate relative to the human eye.

[0012] Further, the lens adjustment mechanism comprises a first multi-degree-of-freedom mechanical arm and a second multi-degree-of-freedom mechanical arm, and the left lens and the right lens of the glasses are respectively mounted on the frame through the first multi-degree-of-freedom mechanical arm and the second multi-degree-of-freedom mechanical arm, and the lenses are driven to translate and / or rotate relative to the frame through the multi-degree-of-freedom mechanical arm; Alternatively, the lens adjustment mechanism includes a transverse driving structure, a lifting driving structure and / or a rotational driving structure, and the left lens and the right lens of the glasses are respectively mounted on the frame via the transverse driving structure, the lifting driving structure and / or the rotational driving structure, and the lenses are driven to translate and / or rotate relative to the frame via the transverse driving structure, the lifting driving structure and / or the rotational driving structure.

[0013] Furthermore, the lens is fixedly mounted on a frame, and the frame is worn in front of the user's eyes; the lens adjustment mechanism is controlled to drive the nose pad assembly and / or temple assembly on the frame to move, and the movement of the nose pad assembly and / or temple assembly drives the lens to translate and / or rotate.

[0014] Furthermore, the preset condition is: The squint angle between the user's line of sight and the lens's refractive area exceeds the upper limit threshold of the aforementioned preset reasonable range; or The squint angle between the user's line of sight and the lens refractive area exceeds the upper limit threshold of the aforementioned preset reasonable range, and the duration of the squint state exceeds the preset time threshold.

[0015] Furthermore, the glasses are provided with a sight tracker and a motion sensor, wherein the sight tracker is used to track the sight information of the user wearing the glasses, and the motion sensor is used to collect and measure the position and direction data of the glasses lens, wherein the direction data includes the angular direction of the plane of the glasses ring; The steps for calculating the squint angle between the user's line of sight and the refractive area of ​​the lens are as follows: Detecting the sight line information of the user's current viewing object through a sight tracker, where the sight line is the angular direction associated with the gaze of the eye; and obtaining the position and direction data of the eyeglass lens of the user's current viewing object through a motion sensor, and determining the current position of the refractive area of ​​the lens and the angular direction of the current normal line in combination with the lens parameters of the eyeglasses; The squint angle between the current line of sight and the refractive area of ​​the lens is calculated according to the angular direction of the current line of sight and the angular direction of the current normal line of the refractive area.

[0016] Furthermore, an eye movement monitoring module is provided corresponding to the eye tracker. The eye movement monitoring module is used to monitor the eye movements of the user wearing the glasses, and when an eye movement event is detected, a trigger instruction is sent to the gaze tracker to start the gaze tracker.

[0017] The present invention also provides an automatically adjustable smart glasses, comprising a frame and lenses, wherein a refractive area is arranged on the lenses; The glasses are provided with a sight tracker and a lens adjustment mechanism; The sight tracker is used to track the sight information of the user wearing the glasses and send it to the associated control module; The lens adjustment mechanism is used to move the lens according to the control instruction of the control module so that the squint angle between the user's line of sight and the refractive area of ​​the lens is within a preset reasonable range.

[0018] The present invention also provides an automatic adjustment system for glasses, the system comprising glasses and a portable control device. The glasses are provided with a sight tracker and a lens adjustment mechanism; the sight tracker is used to track sight information of the user wearing the glasses; The portable control device is configured to: receive the user's line of sight information tracked by the line of sight tracker, and determine whether the user's line of sight is squinting at the refractive area of ​​the glasses lens; when the squinting angle between the user's line of sight and the refractive area of ​​the lens reaches a preset condition, control the lens adjustment mechanism on the aforementioned glasses to move the lens, so that the squinting angle between the user's line of sight and the refractive area of ​​the lens is within a preset reasonable range.

[0019] Furthermore, the portable control device is detachably mounted on the frame of the glasses via a connecting piece. When the portable control device is mounted on the frame of the glasses, the power source of the portable control device can supply power to the electrical components on the glasses and / or charge the power source on the glasses.

[0020] Due to the adoption of the above technical solution, the present invention has the following advantages and positive effects compared with the prior art, as an example: by tracking the sight line information of the user wearing the glasses, when it is determined that the squint angle between the user's sight line and the refractive area of ​​the lens reaches a preset condition, the lens adjustment mechanism on the glasses can be controlled to move the lens so that the squint angle between the user's sight line and the refractive area of ​​the lens is within a preset reasonable range. The present invention can automatically adjust the relative position of the lens and the human eye according to the user's sight line, so that the user's sight line can be kept as orthogonal as possible with the refractive area of ​​the lens, thereby improving the degree accuracy of the user when wearing the glasses to see objects, and facilitating the user to obtain a clearer visual effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 The present invention provides a flowchart of a method for automatically adjusting glasses.

[0022] Figure 2 A schematic diagram of adjusting the squint angle between the line of sight of a human eye and the refractive area of ​​a lens provided in an embodiment of the present invention.

[0023] Figure 3 A schematic diagram of the structure of glasses provided by an embodiment of the present invention.

[0024] Figure 4 A schematic structural diagram of a defocus lens provided in an embodiment of the present invention.

[0025] Figure 5 A schematic diagram of adjusting the driving lens to rotate provided in an embodiment of the present invention.

[0026] Figure 6 A schematic diagram of the structure of a multi-degree-of-freedom robotic arm controlling the movement of a lens provided in an embodiment of the present invention.

[0027] Description of reference numerals: Glasses 10; Spectacle frame 100, frame assembly 110, lens adjustment mechanism 111, temple assembly 120, temple 121, temple base 122, nose pad assembly 130; Lens 200, clear area / clear vision area 210, defocused area 220, lens peripheral area 230; Eye tracking device 300; Motion sensor 400. DETAILED DESCRIPTION

[0028] The automatic adjustment method of glasses, smart glasses and system disclosed in the present invention are further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that the technical features or combinations of technical features described in the following embodiments should not be considered isolated, and they can be combined with each other to achieve better technical effects. In the drawings of the following embodiments, the same reference numerals appearing in each drawing represent the same features or components, which can be applied to different embodiments. Therefore, once an item is defined in one drawing, it does not need to be further discussed in subsequent drawings.

[0029] It should be noted that the structures, proportions, sizes, etc. illustrated in the drawings of this specification are only used to match the contents disclosed in the specification for people familiar with this technology to understand and read, and are not used to limit the limiting conditions for the implementation of the invention. Any modification of the structure, change of the proportion relationship or adjustment of the size should fall within the scope of the technical content disclosed by the invention without affecting the effects and purposes that can be achieved by the invention. The scope of the preferred embodiments of the present invention includes other implementations, in which the functions can be performed in a substantially simultaneous manner or in a reverse order according to the functions involved, which should be understood by those skilled in the art of the technical field to which the embodiments of the present invention belong.

[0030] Techniques, methods, and devices known to those of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, the techniques, methods, and devices should be considered part of the specification. In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limiting. Therefore, other examples of the exemplary embodiments may have different values.

[0031] In the description of the embodiments of the present application, " / " means or, and "and / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" means: A and B exist alone, B exists alone, and A and B exist at the same time. In the description of the embodiments of the present application, "multiple" means two or more.

[0032] Technical term explanation: Eye tracking: also called gaze tracking, is the process of tracking (or tracking) the direction of the user's gaze. The core of eye tracking is eye estimation. There are many different methods for eye estimation, among which pupil-corneal reflection technology (light from the light source enters the pupil, and the retina reflects the light from the pupil. The direction of the eye can be calculated based on the angle between the cornea and the pupil reflection light) is the most commonly used technology in the current eye tracking system. Eye tracking based on pupil-corneal reflection technology is widely used in various fields such as smartphones, architectural design, industrial engineering, traffic driving and military.

[0033] Fixation point: refers to a point on an object that the line of sight is focused on during visual perception. The object can be any object in the external space, such as a physical object or virtual projection data. Example

[0034] See also Figure 1 As shown, it is a flow chart of an automatic adjustment method of glasses provided by the present invention.

[0035] The method comprises the following steps: S100, tracking the sight line information of the user wearing the glasses.

[0036] Tracking the user's gaze can be achieved through a dedicated gaze tracker.

[0037] S200, determining whether the user's line of sight is squinting at the refractive area of ​​the glasses lens.

[0038] The refractive area of ​​the strabismus glasses lens refers to the user's line of sight being tilted relative to the normal of the lens refractive area (i.e., the user's line of sight is not coincident with or parallel to the normal of the lens refractive area), so that the user's line of sight cannot be vertically directed to the lens refractive area of ​​the glasses, i.e., the line of sight cannot be perpendicular to the lens, which will affect the user's vision and may also cause the user's vision to be blurred and uncomfortable. The normal of the lens refractive area can be the lens ring plane normal (or lens plane normal). Taking the curved lens as an example, the lens ring plane normal refers to the normal of the vertex section of the curved lens.

[0039] S300, when the squint angle between the user's sight line and the lens's refractive area reaches a preset condition, the lens adjustment mechanism on the glasses is controlled to move the lens so that the squint angle between the user's sight line and the lens's refractive area is within a preset reasonable range.

[0040] Preferably, the refractive area of ​​the eyeglass lens is located in the central area of ​​the lens. In this case, it is also possible to detect whether the user's line of sight deviates from the central area of ​​the lens. When it is detected that the user's line of sight deviates from the central area of ​​the lens, the lens adjustment mechanism on the eyeglasses can be controlled to move the lens so that the user's line of sight is emitted through the refractive area of ​​the lens.

[0041] The method of moving the lens can specifically be to control the movement of the lens adjustment mechanism to drive the lens to translate and / or rotate relative to the human eye. Translation refers to driving the lens to move along a straight line, including up and down movement, left and right movement, front and back movement, and tilt movement. The rotation refers to driving the lens to rotate around a certain point or axis.

[0042] The preset reasonable range can be set by the system default or by the user. Preferably, the reasonable range of the squint angle is 0-10°, and more preferably, the reasonable range of the squint angle is less than or equal to 5°.

[0043] The squint angle between the user's sight line and the lens's refractive area refers to the tilt angle of the user's sight line relative to the normal line of the lens's refractive area. Figure 2 As shown, in the initial state, the target object viewed by the user is level, the gaze point is located on the horizontal plane N, the glasses lens is at position r0, and the lens ring plane is the vertical plane S. At this time, the user's line of sight is perpendicular to the glasses lens at position r0, and the user's line of sight coincides with the normal of the lens's refractive area (i.e., the normal y1 of the lens ring plane), that is, the inclination angle of the user's line of sight relative to the normal of the lens's refractive area is 0, which is within the preset reasonable range. Subsequently, because the position of the target object viewed by the user has changed, the user's line of sight has also changed, such as the gaze point O has moved below the original horizontal plane N. At this time, the squint angle between the user's line of sight and the refractive area of ​​the glasses lens (at position r0) is a. When the squint angle a exceeds the preset reasonable range, such as a=20°, which exceeds the upper limit of the preset range of 5°, it is necessary to control the lens adjustment mechanism on the aforementioned glasses to move the lens. As an example, Figure 2 The lens of the glasses moves from position r0 to position r1. After the lens moves, the normal line of the lens ring plane is adjusted from y1 to y2, and the new normal line y2 of the lens ring plane coincides with the user's new line of sight. The adjusted inclination angle of the user's line of sight relative to the normal line of the lens refractive area becomes 0 again, which is in line with the preset reasonable range.

[0044] It should be noted that Figure 2When the eyeglass lens moves from position r0 to position r1, the movement of the lens includes lens position translation and angle rotation: on the one hand, the center point of the lens moves from the first position to the second position (so that the user's changed line of sight can pass through the center of the lens), and on the other hand, the lens rotates clockwise downward by an angle d. The above lens movement method is used as an example rather than a limitation. For example, the movement of the lens may only involve the rotation of the lens angle, but it involves angle rotation in more spatial dimensions (3 dimensions). The specific movement method of the lens can be adjusted according to the actual adjustment needs, as long as the movement of the lens can make the user's line of sight orthogonal to the lens refractive area (the lens refractive area is preferably a range of areas).

[0045] In this embodiment, the reasonable range of the squint angle can also be configured according to the distance of the user's viewing object (i.e., the distance between the human eye and the gaze point, the gaze point being the target object that the human eye is gazing at). As a preferred typical method, for example, a preset distance threshold is preset. When the distance between the gaze point of the viewing object and the user's human eye is less than or equal to the aforementioned preset distance threshold, it is determined to be close viewing; when the distance between the gaze point of the viewing object (the target object that the human eye is gazing at) and the user's human eye is greater than the aforementioned preset distance threshold, it is determined to be far viewing; when the reasonable range of squint angles is configured, the angle number of the reasonable range of squint angles for the distant viewing object is greater than the angle number of the reasonable range of squint angles for the near viewing object. As an example and not a limitation, for example, the reasonable range of squint angles for the distant viewing object is configured to be 5-8°, and the reasonable range of squint angles for the near viewing object is configured to be 0-4°.

[0046] Normally, the above adjustment is performed to make the user's left eye sight and the squint angle of the refractive area of ​​the left eye lens within a preset reasonable range, and at the same time, make the user's right eye sight and the squint angle of the refractive area of ​​the right eye lens within a preset reasonable range, so that the sights of the left and right eyes of the user can be kept perpendicular to the lens. In some special cases, if the sights of the left and right eyes cannot be made perpendicular to the lens at the same time, the user's dominant eye (or the main eye, in most cases the right eye, and the other eye is the auxiliary eye) information can also be obtained, and the lens of the dominant eye is taken as the priority adjustment object. At this time, the adjustment of the dominant eye is given priority, so that the user's dominant eye sight (such as the right eye sight) and the squint angle of the refractive area of ​​the dominant eye lens are within the preset reasonable range.

[0047] In a specific implementation, the glasses may include a frame and lenses, wherein the frame includes a lens mounting structure (which may be framed or frameless), temples and nose pads. Figure 3As shown, taking framed glasses as an example, the frame 100 of the glasses 10 may specifically include a frame assembly 110, a temple assembly 120 and a nose pad assembly 130, and the geometric parameters of the frame 100 may include frame size information, temple size information and nose pad size information. The lens 200 is installed in the frame 100, and the geometric parameters of the lens 200 may include lens size, lens curvature radius, light transmittance, lens thickness and other information.

[0048] The refractive area of ​​the lens 200 is preferably arranged in the central area of ​​the lens. The central area of ​​the lens can be formed based on the optical center or geometric center of the lens. The central area of ​​the lens is preferably a circular area or an elliptical area.

[0049] In this embodiment, the glasses are preferably defocus glasses, and the lenses of the defocus glasses at least include a clear area (or clear vision area) in the central area and a defocus area arranged around the clear area, the clear area has a refractive power, and the defocus area is provided with a microlens array. The aforementioned refractive area is located in the clear area of ​​the defocus lens. It should be noted that, for the defocus glasses, considering that the optical center and the geometric center of the defocus lens may not coincide in order to correct certain optical defects, when setting the center area of ​​the lens, it is preferred to configure the center area of ​​the lens based on the optical center of the lens.

[0050] Take myopia defocus lenses as an example, see Figure 4 As shown, the clear area / clear vision area 210 of the defocus lens is located in the central area of ​​the myopia defocus lens 200. In this embodiment, this central area is a clear area with diopter that has myopia correction characteristics according to the prescription (alternatively, when the glasses are hyperopia glasses, the central area can be a clear area with hyperopia correction characteristics). The periphery of the clear area is the defocus area 220, and a microlens array is arranged in the defocus area 220.

[0051] Specifically, the edge of the clear area / clear vision area 210 can be extended outward to form a ring-shaped defocus area 220. As an example but not limitation, the defocus area 220 can be composed of multiple aspherical microlens arrays with a diameter of 1 mm or multiple micro-column lens arrays with a width of 1 mm. The micro-column lens array is a plurality of concentrically arranged defocus rings. Adjacent defocus rings can be closely connected or separated by gaps. The plurality of concentrically arranged defocus rings are arranged radially outward. The edge of the defocus area 220 extends outward to the edge of the lens to form the lens peripheral area 230. The defocus structure design and defocus principle of defocus glasses belong to the prior art and will not be repeated here.

[0052] Optionally, the range of the clear area of ​​the defocus glasses can be set between 3mm and 30mm. Taking the circular area as an example, the radius of the clear area can be set between 2mm and 4mm. Taking the elliptical area as an example, the short diameter of the clear area can be set between 4mm and 6mm, and the long diameter is larger than the short diameter, preferably about twice the short diameter.

[0053] In this embodiment, the preset condition in step S300 may specifically be one of the following conditions.

[0054] Condition 1: The squint angle between the user's line of sight and the lens's refractive area exceeds the upper limit threshold of the aforementioned preset reasonable range.

[0055] In this embodiment, the condition for triggering the lens adjustment operation is that the squint angle between the user's line of sight and the refractive area of ​​the lens exceeds the upper limit threshold of the aforementioned preset reasonable range.

[0056] Condition 2: The strabismus angle between the user's line of sight and the refractive area of ​​the lens exceeds the upper limit threshold of the aforementioned preset reasonable range, and the duration of the strabismus state exceeds the preset time threshold.

[0057] This implementation screens out temporary eye tilt behaviors of users by adding the determination of the time of eye tilt (not perpendicular to the lens) to avoid too frequent lens adjustment operations. At this time, when it is detected that the squint angle between the user's eye and the lens refractive area exceeds the upper threshold of the aforementioned preset reasonable range, the timer can be controlled to start timing. When the duration t of the aforementioned event exceeds the preset time threshold T, it is determined that the condition is met and the lens adjustment operation is triggered. In this way, not only can the user discomfort caused by frequent eyeglass position adjustment operations be avoided, but also the information processing burden of the system can be reduced.

[0058] Continue to see Combination Figure 3 and Figure 4 As shown, the glasses may be provided with an eye tracker 300 and a plurality of motion sensors 400 .

[0059] The line of sight tracker 300 is used to track the line of sight information of the user wearing glasses. The line of sight tracker 300 can be arranged to determine the line of sight direction of each eye of the user wearing glasses by any existing line of sight tracking method. Preferably, the line of sight tracker 300 is configured to: direct light (such as infrared light) into the eye, use an image capture unit to detect at least one reflection (visible reflection, such as faint light) from at least one surface associated with the eye, determine (usually estimated by a geometric model) the line of sight information (such as the line of sight direction) associated with the eye based on the aforementioned detected reflection, and send the determined line of sight information to the aforementioned control module. The line of sight is the angular direction associated with the gaze of the eye (corresponding to the gaze point). In a specific implementation, the line of sight tracker 300 may include a projector and an image capture unit mounted on a frame corresponding to the user's eye setting, the projector may include a laser, and the image capture unit may include a line of sight tracking camera. Directing light into the eye with a projector, such as by directing a discrete infrared IR light source into the eye using a discrete IR light emitting diode LED, the IR light being well reflected by the cornea or other component of the eye (e.g., the pupil), and the reflection being readily detected by an IR image capture unit; then, detecting at least one reflection from at least one surface associated with the eye using a gaze tracking camera (e.g., an IR camera); and then, determining a gaze associated with the eye based on the detected reflection. Gaze tracking can be performed by tracking various characteristics associated with the glimmer, such as the distance, direction, and orientation of the glimmer relative to a gaze tracker (e.g., a light source and / or an image capture module), the orientation including at least one of an azimuth, elevation, or tilt angle associated with the glimmer.

[0060] Important parts of the human eye include the cornea, iris, pupil, lens, retina and optic nerve. The cornea is a clear convex surface in front of the eye. The cornea is the main refractive surface of the eye. The iris is the colored part of the eye that adjusts the amount of light entering the eye. The pupil is the opening at the center of the iris. The iris changes or adjusts the size of the pupil and thereby controls the amount of light entering the eye. The lens is the clear part of the eye behind the iris that focuses light on the retina. The retina is a photosensitive tissue arranged at the back of the eye. The retina converts light into electrical signals, which are transmitted to the brain via the optic nerve. The aqueous humor is a gel-like liquid that is located in the space between the lens and the cornea. The function of the aqueous humor is to maintain intraocular pressure and expand the eyeball. In this embodiment, the surface associated with the reflection can be at least one of the cornea, pupil, iris or retina (or retinal blood vessels) associated with the eye. As an example, taking the pupil as an example, the vector formed by the angle between the glimmer and the pupil reflection can be combined with other geometric data to determine the gaze direction.

[0061] When the gaze tracker detects eye movements to determine gaze information, it can also capture relevant data of the user's eyes, such as calculating the pupil size, iris image, blinking frequency, eyelid closure, eye saccade trajectory, gaze duration, etc. The above eye movement data detection and calculation are all existing technologies and will not be elaborated here.

[0062] The motion sensor 400 is used to collect and measure the position and orientation data of each component of the glasses. By way of example and not limitation, the motion sensor may include an inertial measurement unit (IMU), which may specifically include a gyroscope (e.g., a three-axis gyroscope) and / or a magnetometer (e.g., a three-axis magnetometer). The motion data obtained using the motion sensor may be used to determine changes in the position and / or orientation of the glasses, and may also reflect changes in the position and orientation of the user's head.

[0063] In this embodiment, a lens motion sensor is preferably provided on the lens of the glasses to collect and measure the position and direction data of the glasses lens. The direction data includes the angular direction of the lens ring plane of the glasses, such as the inclination angle between the lens ring plane and the vertical plane.

[0064] At this time, the steps for calculating the squint angle between the user's line of sight and the refractive area of ​​the lens are as follows: first, the line of sight information of the user's current viewing object is detected by a line of sight tracker, and the line of sight is the angular direction associated with the gaze of the eyes. Then, after obtaining the position and direction data of the eyeglass lens of the user's current viewing object through the motion sensor on the lens, the current position of the refractive area of ​​the lens and the angular direction of the current normal are determined in combination with the lens parameters of the glasses, such as the center point coordinates, area boundaries, area diameter and other parameters of the refractive area of ​​the lens; preferably, the current position of the refractive area of ​​the lens can be directly referenced to the current lens center point coordinate position, and the angular direction of the current normal of the refractive area of ​​the lens can be referenced to the angular direction of the normal of the lens ring plane, and the angular direction of the normal of the lens ring plane is perpendicular to the angular direction of the lens ring plane.

[0065] According to the angular direction of the current line of sight and the angular direction of the current normal of the lens refractive area, the squint angle between the current line of sight and the lens refractive area can be calculated, for example Figure 2 Angle a in.

[0066] In this embodiment, the lens adjustment mechanism can move the lens by directly driving the lens to move, or it can drive the lens to move indirectly - for example, by driving the frame, nose pads, and temple components on the frame to move to cause the lens to move.

[0067] For the solution of directly driving the movement of the lens, preferably, the lens is movably mounted on a frame through a lens adjustment mechanism, and the frame is worn in front of the user's eyes; the movement of the lens adjustment mechanism is controlled to drive the lens to translate and / or rotate relative to the frame, thereby causing the lens to translate and / or rotate relative to the human eye.

[0068] See also Figure 5 As shown, an example is given of a method of driving the lens to rotate relative to the frame through the lens adjustment mechanism 111. As an example of a typical method, at this time, the lens can be mounted on the frame through a hinge shaft, a rotation drive motor is set corresponding to the hinge shaft to drive the hinge shaft to rotate so as to drive the lens to rotate, and the rotation angle and coordinate position change of the lens are monitored through a motion sensor on the lens.

[0069] In one embodiment, the lens adjustment mechanism 111 may include a first multi-degree-of-freedom mechanical arm and a second multi-degree-of-freedom mechanical arm. The left lens and the right lens of the glasses are respectively mounted on the frame through the first multi-degree-of-freedom mechanical arm and the second multi-degree-of-freedom mechanical arm. The multi-degree-of-freedom mechanical arm drives the lens to translate and / or rotate relative to the frame. Figure 6 As shown, an example of using a six-degree-of-freedom robotic arm to drive the movement of the lens is shown.

[0070] In another embodiment, the lens adjustment mechanism includes a transverse driving structure, a lifting driving structure and / or a rotational driving structure, and the left lens and the right lens of the glasses are respectively installed on the frame through the transverse driving structure, the lifting driving structure and / or the rotational driving structure, and the lenses are driven to translate and / or rotate relative to the frame through the transverse driving structure, the lifting driving structure and / or the rotational driving structure.

[0071] For the solution of indirectly driving the movement of the lens, preferably, the lens is fixedly mounted on a frame, and the frame is worn in front of the user's eyes; the lens adjustment mechanism is controlled to drive the nose pad assembly and / or temple assembly on the frame to move, and the movement of the nose pad assembly and / or temple assembly drives the lens to translate and / or rotate.

[0072] Taking the movement of nose pads as an example, the lens adjustment mechanism provided on the glasses may specifically include a nose pad moving assembly provided corresponding to the nose pads. In one embodiment, the control unit may control the movement of the nose pad moving assembly to make the nose pads and the lenses move relative to each other, thereby achieving the position adjustment of the lenses relative to the human eyes, and the position adjustment may involve the translation of the lenses and / or the rotation of the lenses, which is not limited here. At this time, the position of the nose pads on the user's nose is kept unchanged, and the frame is controlled to translate or rotate by the lifting structure on the nose pads, thereby driving the lenses to translate or rotate relative to the nose pads. In another embodiment, the control unit may control the movement of the nose pad moving assembly to drive the nose pads to move relative to the user's nose, thereby driving the lenses to move, thereby achieving the position adjustment of the lenses relative to the human eyes, and the position adjustment may involve the translation of the lenses and / or the rotation of the lenses, which is not limited here. At this time, when the nose pads move relative to the nose, the nose pads drive the frame to move together, thereby changing the relative position of the lenses and the eyes. Specifically, when the nose pads move upward, downward, forward or backward relative to the user's nose, the relative position of the lenses and the eyes also changes. In this embodiment, the nose pad moving component drives the nose pad to move in a rolling, sliding or stepping manner. The driving structure of the nose pad moving component is preferably a micro motor. It should be noted that the scheme of driving an object to move relative to a surface by a motor in a rolling, sliding or stepping manner can be used in the nose pad movement of the present invention, and reference can be made to various relative motion control schemes in the prior art, which will not be repeated here.

[0073] Preferably, the nose pad may include a nose pad base and a nose pad upper portion, the nose pad base is worn on the user's nose, and the nose pad upper portion is connected to the frame; a nose pad rail is installed on the nose pad base, and the nose pad upper portion is movably installed on the nose pad rail through a slider / pulley and can move along the track direction of the nose pad rail, while movement in other directions is restricted.

[0074] By using a nose pad moving component, such as a driving motor, the upper part of the nose pad can be driven to move along the nose pad track, and the upper part of the nose pad drives the frame and the lens to move together to adjust the position of the lens, while the relative position of the base of the nose pad and the user's nose remains unchanged. After the upper part of the nose pad moves into position on the nose pad track, the control unit can also control the locking structure to act on the upper part of the nose pad to limit the upper part of the nose pad (the locking structure enters a locked state), so that the upper part of the nose pad can maintain this position. In this way, by setting the nose pad separately and installing the upper part of the nose pad through the nose pad track, when the upper part of the nose pad moves, the position of the base of the nose pad worn on the nose does not move, reducing the user's discomfort when the position of the nose pad is adjusted.

[0075] Taking temple adjustment as an example, the lens adjustment mechanism provided on the glasses may specifically include temple adjustment components provided corresponding to the temples. The control unit may control the temple adjustment components to move to adjust the length and / or tilt angle of the temples, thereby achieving position adjustment of the lens relative to the human eye, and the position adjustment may involve lens translation and / or lens rotation, which is not limited here.

[0076] Specifically, the length of the temple can be adjusted by the temple adjustment assembly by one or more of the following: piston telescopic adjustment, thread telescopic adjustment, connecting rod telescopic adjustment, gear rack telescopic adjustment, and spring telescopic adjustment. The tilt angle of the temple can be adjusted by the temple adjustment assembly by pulling down or pushing up one end of the temple to move it downward or tilt it up to change the tilt angle of the temple, thereby driving the lens connected to the other end of the temple to rise or fall.

[0077] Preferably, the temple adjustment track is provided corresponding to the temple, and the temple adjustment track can be installed through the temple base, and the temple base can be worn on the ear of the user, and the temple is movably installed on the temple adjustment track and can move along the temple adjustment track. When the temple is driven to move on the temple adjustment track by the temple adjustment assembly to adjust the length and / or tilt angle of the temple, the nose pad and the lens of the frame are driven to move together, while the relative position of the temple base and the user's ear remains unchanged. In this way, by providing the temple adjustment track, when the temple is adjusted, the position of the temple base worn on the ear does not move, which can reduce the discomfort of the user's ear when the temple is adjusted.

[0078] In another implementation of this embodiment, an eye movement monitoring module is provided corresponding to the eye gaze tracker. The eye movement monitoring module is used to monitor the eye movements of the user wearing the glasses, and when an eye movement event is detected, a trigger instruction is sent to the eye gaze tracker to start the eye gaze tracker.

[0079] In another implementation of this embodiment, the user can also be reminded of bad eye behavior. Specifically, a user posture monitoring module can be set up, and the user posture monitoring module is used to monitor the body posture and / or the distance of the gaze target of the user wearing the glasses, and when the user's body posture and / or the distance of the gaze target do not meet the preset conditions, an adverse event prompt information is issued.

[0080] Another embodiment of the present invention further provides automatically adjustable smart glasses.

[0081] The smart glasses include a frame and lenses, and a refractive area is arranged on the lenses.

[0082] The glasses are provided with a sight tracker and a lens adjustment mechanism.

[0083] The sight tracker is used to track the sight information of the user wearing the glasses and send it to the associated control module.

[0084] The lens adjustment mechanism is used to move the lens according to the control instruction of the control module so that the squint angle between the user's line of sight and the refractive area of ​​the lens is within a preset reasonable range.

[0085] For other technical features, please refer to the description of the previous embodiment and will not be repeated here.

[0086] Another embodiment of the present invention provides an automatic adjustment system for glasses, which includes glasses and a portable control device.

[0087] The glasses are provided with a sight tracker and a lens adjustment mechanism; the sight tracker is used to track the sight information of the user wearing the glasses; the lens adjustment mechanism is used to move the lens to adjust the relative position of the lens and the human eye.

[0088] The portable control device is configured to: receive the user's line of sight information tracked by the line of sight tracker, and determine whether the user's line of sight is squinting at the refractive area of ​​the glasses lens; when the squinting angle between the user's line of sight and the refractive area of ​​the lens reaches a preset condition, control the lens adjustment mechanism on the aforementioned glasses to move the lens, so that the squinting angle between the user's line of sight and the refractive area of ​​the lens is within a preset reasonable range.

[0089] In this embodiment, the portable control device is detachably mounted on the frame of the glasses via a connector, which may be a snap-fit ​​structure, a plug-in structure, a magnetic adsorption structure, an adhesive structure, or any other detachable connection structure.

[0090] In specific implementation, the portable control device can be directly a mobile phone, or the portable control device is a dedicated glasses control device. For the latter, as an example of a typical method, the dedicated glasses control device may include a housing and a clamping portion, a control chip and other electronic components are arranged in the housing, and a human-machine interaction structure such as operation buttons, display screens, indicator lights and other components may also be arranged on the housing. The housing may be mounted on the frame of the glasses, such as the temples, through the clamping portion.

[0091] Preferably, the size of the shell meets the daily carrying requirements of users who wear glasses. For example, the shell of the glasses control device can be designed to be sized to be placed in a pencil case or a glasses case.

[0092] In this embodiment, when the portable control device is mounted on the frame of the glasses, the power supply of the portable control device can supply power to the electrical components on the glasses and / or charge the power supply on the glasses. That is, when the portable control device is mounted on the frame of the glasses, the two can be electrically connected.

[0093] Taking the plug-in structure as an example, an electrical interface / electronic interface is also provided on the mechanical interface of the plug-in structure, and the mechanical interface of the portable control device is configured to easily and stably fasten the portable control device to the corresponding mechanical interface on the temple, and at the same time, the device is electrically / electronically connected to the circuit of the smart glasses through the electrical interface / electronic interface on the mechanical interface.

[0094] After charging is complete, the user can detach the portable control unit.

[0095] It should be noted that the gaze tracker on the glasses may also adopt a detachable connection method. For example, the gaze tracker may include a clamping mechanism, which is used to install the gaze tracker body on the glasses. The projector and the gaze tracking camera correspond to the settings of the human eyes, and gaze tracking is performed through the gaze tracker.

[0096] For other technical features, please refer to the description of the previous embodiment and will not be repeated here.

[0097] In the above description, the disclosure of the present invention is not intended to limit itself to these aspects. Rather, within the scope of the target protection of the present disclosure, the components can be selectively and operatively combined in any number. In addition, terms such as "include", "encompass" and "have" should be interpreted as inclusive or open by default, rather than exclusive or closed, unless they are explicitly defined to the contrary. All technical, scientific or other terms are consistent with the meanings understood by those skilled in the art, unless they are defined to the contrary. Common terms found in dictionaries should not be interpreted too idealistically or too impractically in the context of relevant technical documents, unless the present disclosure explicitly defines them as such. Any changes and modifications made by a person of ordinary skill in the field of the present invention based on the above disclosure belong to the scope of protection of the claims.

Claims

1. A method for automatically adjusting glasses, characterized in that Includes steps: Tracking the sight information of the user wearing the glasses; Determine whether the user's line of sight is squinting at the refractive area of ​​the glasses lens; When the squint angle between the user's sight line and the lens's refractive area reaches a preset condition, the lens adjustment mechanism on the glasses is controlled to move the lens so that the squint angle between the user's sight line and the lens's refractive area is within a preset reasonable range.

2. The method according to claim 1, characterized in that: The refractive area of ​​the glasses lens is located in the central area of ​​the lens. When it is detected that the user's line of sight deviates from the central area of ​​the lens, the lens adjustment mechanism on the glasses is controlled to move the lens so that the user's line of sight is emitted through the refractive area of ​​the lens.

3. The method according to claim 1, characterized in that: The glasses are defocus glasses, and the lenses of the defocus glasses at least include a clear area in the central area and a defocus area arranged around the clear area, and the defocus area is provided with a microlens array; the aforementioned refractive area is located in the clear area of ​​the defocus lens.

4. The method according to any one of claims 1 to 3, characterized in that The method of moving the lens is: controlling the movement of the lens adjustment mechanism to drive the lens to translate and / or rotate relative to the human eye.

5. The method according to claim 4, characterized in that: The lens is movably mounted on a frame through a lens adjustment mechanism, and the frame is worn in front of the user's eyes; the lens adjustment mechanism is controlled to drive the lens to translate and / or rotate relative to the frame, thereby causing the lens to translate and / or rotate relative to the human eye.

6. The method according to claim 5, characterized in that: The lens adjustment mechanism comprises a first multi-degree-of-freedom mechanical arm and a second multi-degree-of-freedom mechanical arm, the left lens and the right lens of the glasses are respectively mounted on the frame through the first multi-degree-of-freedom mechanical arm and the second multi-degree-of-freedom mechanical arm, and the lenses are driven to translate and / or rotate relative to the frame through the multi-degree-of-freedom mechanical arm; Alternatively, the lens adjustment mechanism includes a transverse driving structure, a lifting driving structure and / or a rotational driving structure, and the left lens and the right lens of the glasses are respectively mounted on the frame via the transverse driving structure, the lifting driving structure and / or the rotational driving structure, and the lenses are driven to translate and / or rotate relative to the frame via the transverse driving structure, the lifting driving structure and / or the rotational driving structure.

7. The method according to claim 4, characterized in that: The lens is fixedly mounted on a frame, and the frame is worn in front of the user's eyes; the lens adjustment mechanism is controlled to drive the nose pad assembly and / or the temple assembly on the frame to move, and the movement of the nose pad assembly and / or the temple assembly drives the lens to translate and / or rotate.

8. The method according to any one of claims 1 to 3, characterized in that The preset conditions are: The squint angle between the user's line of sight and the lens's refractive area exceeds the upper limit threshold of the aforementioned preset reasonable range; or The squint angle between the user's line of sight and the refractive area of ​​the lens exceeds the upper limit threshold of the aforementioned preset reasonable range, and the duration of the squint state exceeds the preset time threshold.

9. The method according to claim 8, characterized in that The glasses are provided with a sight tracker and a motion sensor, wherein the sight tracker is used to track the sight information of the user wearing the glasses, and the motion sensor is used to collect and measure the position and direction data of the glasses lens, wherein the direction data includes the angular direction of the plane of the glasses ring; The steps for calculating the squint angle between the user's line of sight and the refractive area of ​​the lens are as follows: Detecting the sight line information of the user's current viewing object through a sight tracker, where the sight line is the angular direction associated with the gaze of the eye; and obtaining the position and direction data of the eyeglass lens of the user's current viewing object through a motion sensor, and determining the current position of the refractive area of ​​the lens and the angular direction of the current normal line in combination with the lens parameters of the eyeglasses; The squint angle between the current line of sight and the refractive area of ​​the lens is calculated according to the angular direction of the current line of sight and the angular direction of the current normal line of the refractive area.

10. The method according to claim 9, characterized in that: An eye movement monitoring module is provided corresponding to the eye tracker. The eye movement monitoring module is used to monitor the eye movements of the user wearing the glasses, and when an eye movement event is detected, a trigger instruction is sent to the gaze tracker to start the gaze tracker.

11. An automatically adjustable smart glasses, comprising a frame and a lens, wherein a refractive area is arranged on the lens, characterized in that: The glasses are provided with a sight tracker and a lens adjustment mechanism; The sight tracker is used to track the sight information of the user wearing the glasses and send it to the associated control module; The lens adjustment mechanism is used to move the lens according to the control instruction of the control module so that the squint angle between the user's line of sight and the refractive area of ​​the lens is within a preset reasonable range.

12. An automatic adjustment system for glasses, characterized in that: including glasses and a portable control device, The glasses are provided with a sight tracker and a lens adjustment mechanism; the sight tracker is used to track sight information of the user wearing the glasses; The portable control device is configured to: receive the user's line of sight information tracked by the line of sight tracker, and determine whether the user's line of sight is squinting at the refractive area of ​​the glasses lens; when the squinting angle between the user's line of sight and the refractive area of ​​the lens reaches a preset condition, control the lens adjustment mechanism on the aforementioned glasses to move the lens, so that the squinting angle between the user's line of sight and the refractive area of ​​the lens is within a preset reasonable range.

13. The system according to claim 12, characterized in that: The portable control device is detachably mounted on the frame of the glasses via a connecting piece. When the portable control device is mounted on the frame of the glasses, the power source of the portable control device can supply power to the electrical components on the glasses and / or charge the power source on the glasses.

Images