Vision dynamic guiding method and device of intelligent glasses and storage medium
The eye images are acquired and analyzed through smart glasses, and the deformation and brightness of the guide image are adjusted by the cross-quantity of eye features, which solves the problems of insufficient eye movement ability and poor concentration ability on smart glasses, and improves visual acuity and activation of brain potential.
Patent Information
- Application Number
- CN202311663445.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-06
- Publication Date
- 2025-06-06
AI Technical Summary
The prior art is difficult to effectively solve the problems of insufficient eye movement ability and poor concentration ability on smart glasses, and it is impossible to effectively carry out eye-brain training to improve visual acuity.
The guide image and eye images are obtained through smart glasses, the eye features are extracted and the crossover amount is calculated, and the deformation and brightness of the guide image is adjusted according to the crossover amount, thereby attracting user attention and performing vision training.
It realizes irregular reminders of users' attention, attracting users' attention and following guided graphics for training, improving visual acuity and activating brain potential.
Smart Images
Figure CN120093568A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of smart glasses, and in particular to a method, device and storage medium for dynamic vision guidance of smart glasses. Background Art
[0002] Smart glasses are a general term for wearable eyewear devices with independent operating systems. They can be controlled by voice or motion to add schedules, map navigation, interact with friends, take photos and videos, and make video calls with friends. In addition to daily life, smart glasses also have many applications in medical treatment or recovery training.
[0003] Vision training is a method of training the eyes and brain through optics and psychophysics, especially for people with insufficient eye movement and poor eye focus, to enhance visual skills, develop visual potential, improve visual function, etc. In order to implement eye-brain training for people with insufficient eye movement and poor eye focus on smart glasses, a new method needs to be designed. Summary of the invention
[0004] In order to provide an eye-brain training method suitable for use with smart devices for people with insufficient eye movement ability and poor eye concentration ability, so as to improve visual acuity and activate brain potential, the present application provides a dynamic vision guidance method for smart glasses.
[0005] On the one hand, the present application provides a method for dynamic vision guidance of smart glasses, which adopts the following technical solution:
[0006] A method for dynamically guiding vision of smart glasses comprises the following steps:
[0007] Obtaining a guide image;
[0008] Acquiring an eye image;
[0009] Extracting a first eye feature and a second eye feature from the eye image;
[0010] Calculating an intersection amount between the first eye feature and the second eye feature, and adjusting a deformation amount and a brightness value of the guide image according to the intersection amount;
[0011] The crossing amount includes crossing uniformity and crossing depth; the higher the crossing uniformity, the smaller the deformation amount, and the lower the crossing uniformity, the smaller the deformation amount; the greater the crossing depth, the greater the brightness value, and the smaller the crossing depth, the lower the brightness value.
[0012] By adopting the above technical solution, in order to improve the user's attention, the intersection of eye features is used to adjust the deformation or brightness of the guiding image, thereby attracting the user's attention and conducting training under the guidance of the guiding image.
[0013] Optionally, the method further includes the following features:
[0014] The guidance image includes a first graphical feature;
[0015] extracting pupil features from the eye image;
[0016] Identify the visual direction of the pupil feature, and when the visual direction of the pupil feature is toward the position of the first graphic feature, the first graphic feature moves to the target area along a preset path; during the movement, if the visual direction of the pupil feature does not match the position of the first graphic feature, output a prompt message.
[0017] By adopting the above technical solution, when the vision of the eye is directed toward the first graphic feature, the pupil follows the displacement of the first graphic feature, thereby guiding the user to perform vision training; during the movement, if the pupil fails to follow successfully, a prompt will be given.
[0018] Optionally, the method further includes the following features:
[0019] extracting pupil features from the eye image;
[0020] Calculating the area size of the pupil feature;
[0021] The color saturation of the guide image is adjusted according to the area of the pupil feature; the larger the area of the pupil feature, the lower the color saturation of the guide image; the smaller the area of the pupil feature, the higher the color saturation of the guide image.
[0022] By adopting the above technical solution, the pupil area size characteristics are used as the basis for adjusting the guiding image, which is beneficial to reduce stimulation to the eyes, relieve eye fatigue, and form adjustable interactive actions between the user and the smart glasses to attract the user's attention, thereby helping to achieve eye and brain training.
[0023] Optionally, the method further includes the following features:
[0024] identifying a mirror image of the guide image from the eye image;
[0025] Calculating the mirror contrast between the mirror image and the image of its surrounding area;
[0026] The action of the guide image is guided according to the jump generated by the mirror contrast adjustment; if the mirror contrast jumps to a larger value, the guide image executes the set first action instruction; if the mirror contrast jumps to a smaller value, the guide image executes the set second action instruction.
[0027] By adopting the above technical solution, by processing the mirror graphics in the eye image and calculating the mirror contrast, the corresponding action command is executed according to the degree of contrast jump, so as to realize the interaction between the eyes and the smart device, attract the user's attention, and thus help to achieve eye and brain training.
[0028] Optionally, the method further comprises the following steps:
[0029] The second action instruction restores and executes the first action instruction.
[0030] By adopting the above technical solution, since the mirror image and the guiding image are mirror-related, the first action instruction is a restoration instruction of the second action instruction.
[0031] Optionally, the method further comprises the following steps:
[0032] identifying a mirror pattern of the guide image from the pupil features;
[0033] The area size of the guide image is adjusted according to the color saturation of the mirror image; the higher the color saturation of the mirror image, the smaller the area of the guide image; the lower the color saturation of the mirror image, the larger the area of the guide image.
[0034] By adopting the above technical solution, the area of the guiding image can be changed with the color saturation according to the mirror pattern of the guiding image reflected in the mirror pattern, so that the image can attract the user's attention more and be more conducive to the user's eye and brain training.
[0035] Optionally, the method further comprises the following steps:
[0036] The action speed of the guiding image executing the action instruction is adjusted according to the overlapping area of the pupil feature and the first eye feature.
[0037] By adopting the above technical solution, by measuring and comparing the overlapping areas, the system can adjust the appropriate action speed of the guiding image to execute the action instruction to attract the user's attention.
[0038] Optionally, the method further comprises the following steps:
[0039] The action speed of the guiding image executing the action instruction is adjusted according to the overlapping area of the pupil feature, the first eye feature and the second eye feature.
[0040] By adopting the above technical solution, by measuring and comparing the overlapping areas, the system can adjust the appropriate action speed of the guiding image to execute the action instruction to attract the user's attention.
[0041] Optionally, the method further comprises the following steps:
[0042] The action amplitude of the guiding image executing the action instruction is adjusted according to the overlapping area of the mirror pattern and the first eye feature.
[0043] By adopting the above technical solution, by measuring and comparing the overlapping areas, the system can adjust the appropriate movement amplitude of the guiding image to execute the action instruction to attract the user's attention.
[0044] On the other hand, the present application provides a vision dynamic guidance device for smart glasses, which adopts the following technical solution:
[0045] A method and device for dynamically guiding vision of smart glasses comprises a processor, in which a program for the method for dynamically guiding vision of smart glasses is running.
[0046] On the other hand, the present application provides a storage medium, which adopts the following technical solution:
[0047] A storage medium stores a program of the above-mentioned vision dynamic guidance method for smart glasses.
[0048] In summary, the present application includes at least one of the following beneficial technical effects: by real-time analysis of the intersection of features corresponding to the guide image and the eye image, irregular reminders of the user's attention are achieved, which helps to attract the user's attention, and eye and brain training is performed following the training of the guide graphics to improve visual acuity and activate brain potential. BRIEF DESCRIPTION OF THE DRAWINGS
[0049] Figure 1 This is a step diagram of a method for dynamically guiding vision of smart glasses according to an embodiment of the present application.
[0050] Figure 2 It is a schematic diagram of the change in the amount of intersection between the upper eyelashes and the lower eyelashes during a blinking action in a method for dynamic vision guidance of smart glasses in an embodiment of the present application.
[0051] Figure 3 It is a schematic diagram of guiding image deformation in a method for dynamic vision guidance of smart glasses in an embodiment of the present application.
[0052] Figure 4 This is a step diagram of a first graphic feature moving to a target area along a preset path in a method for dynamic vision guidance of smart glasses in an embodiment of the present application.
[0053] Figure 5 This is a schematic diagram of a first graphic feature moving to a target area along a preset path in a method for dynamic vision guidance of smart glasses in an embodiment of the present application.
[0054] Figure 6 It is a schematic diagram of matching multiple first graphic features with multiple target areas in a method for dynamic vision guidance of smart glasses in an embodiment of the present application.
[0055] Figure 7 This is a step diagram of adjusting the color saturation of a guidance image according to the area size of pupil features in a method for dynamic vision guidance of smart glasses in an embodiment of the present application.
[0056] Figure 8 This is a schematic diagram of the change in pupil area size in a method for dynamic vision guidance of smart glasses in an embodiment of the present application.
[0057] Fig. 9 This is a step diagram of the action of a jump guidance image generated by adjusting the mirror contrast in a method for dynamic vision guidance of smart glasses in an embodiment of the present application.
[0058] Fig.10 This is a step diagram of adjusting the area size of a guidance image according to the color saturation of a mirror graphic in a method for dynamic vision guidance of smart glasses in an embodiment of the present application. DETAILED DESCRIPTION
[0059] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.
[0060] It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present disclosure can be combined with each other.
[0061] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.
[0062] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".
[0063] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.
[0064] The embodiment of the present application discloses a method for dynamically guiding vision of smart glasses.
[0065] Reference Figure 1 and Figure 2 and Figure 3 , a method for dynamic vision guidance of smart glasses, comprising the following steps:
[0066] Obtaining a guiding image: Obtaining a real-time guiding image, which is a guiding image played in real time by the smart glasses to guide vision. The image can be static or dynamic. For example, it can be a dynamic graphic of a five-pointed star, attracting the eyes to follow the dynamic image to draw a five-pointed star.
[0067] Acquire eye images; acquire eye images in real time through built-in cameras or other sensors to facilitate subsequent analysis of eye features.
[0068] A first eye feature and a second eye feature are extracted from the eye image; the eye features include pupils, whites of eyes, eyebrows or eyelashes; in this embodiment, for example, the first eye feature is the upper eyelashes, and the second eye feature is the lower eyelashes.
[0069] Reference Figure 2 and Figure 3 , calculate the intersection amount of the first eye feature and the second eye feature, and adjust the deformation amount and brightness value of the guidance image according to the intersection amount; the intersection amount is a unit of measurement corresponding to the degree of intersection between the first eye feature and the second eye feature. In this embodiment, the intersection amount is expressed as the degree of intersection of the upper and lower eyelashes, such as blinking, closing or opening the eyes, etc., and the two-dimensional features of the deformation amount and brightness value of the guidance image are adjusted according to the intersection degree, so as to adjust the guidance image according to the eye features to attract more attention of the user and realize the function of guiding vision.
[0070] The crossover amount includes crossover uniformity and crossover depth; the higher the crossover uniformity, the smaller the deformation amount, and the lower the crossover uniformity, the smaller the deformation amount; the greater the crossover depth, the greater the brightness value, and the smaller the crossover depth, the lower the brightness value. Crossover uniformity can reflect the degree of proximity between two features, and crossover depth can reflect the degree of overlap between two features in the image. If the crossover uniformity is high, it means that the two features are close, so the deformation amount will decrease accordingly; if the crossover uniformity is low, it means that the two features are far away, so the deformation amount will increase accordingly; according to the image information collected in real time, when there is a blinking action, the crossover uniformity changes, so that the deformation amount will increase or decrease, which will attract the user's attention, thereby helping the user's attention to be attracted by the guiding image, thereby guiding the vision to follow the guiding image for training. Among them, blinking is an action that is not controlled by consciousness, and it takes 0.3-0.4 seconds for a normal person to blink. On average, a person blinks 10,000 times a day, and a person can blink more than 10,000 times a day, that is, under normal circumstances, a person blinks 15 times a minute, and normal people blink in a certain pattern. Blinking is a rapid eye-closing action, known as the blink reflex. Involuntary blinking is actually a protective action that can evenly distribute tears on the cornea and conjunctiva to keep them moist. Blinking can also give the retina and eye muscles a temporary rest. Similarly, if the crossover depth is large, it means that the two features overlap more, so the brightness value will increase accordingly; if the crossover depth is small, it means that the two features overlap less, so the brightness value will decrease accordingly; that is, when a blink occurs, the brightness of the guide image can also be adjusted to further improve the effect of the prompt.
[0071] In order to improve the user's attention, the intersection of eye features is used to deform or adjust the brightness of the guiding image, thereby attracting the user's attention and conducting training under the guidance of the guiding image.
[0072] Reference Figure 4 and Figure 5 , the method also includes the following features:
[0073] The guide image includes a first graphic feature; the first graphic feature may be a fixed graphic or a graphic such as an animated icon.
[0074] Extract pupil features from eye images; use eye tracking technology to determine the visual direction of the pupil and track it.
[0075] The visual direction of the pupil feature is identified, and when the visual direction of the pupil feature is toward the position where the first graphic feature is located, the first graphic feature moves to the target area according to a preset path. During the movement, if the visual direction of the pupil feature does not match the position where the first graphic feature is located, a prompt message is output.
[0076] When the vision of the eye is directed toward the first graphic feature, the pupil moves along with the first graphic feature, thereby guiding the user to perform vision training; during the movement, if the pupil fails to follow the first graphic feature, a prompt will be given. The prompt may be in the form of vibration, prompt box, or sound alarm.
[0077] Reference Figure 6 In other embodiments, a plurality of first graphic features are provided, and the graphic features of the plurality of first graphic features are different; the graphic features include features such as position, size, color, and depth. A plurality of first feature graphics corresponding to the target area are also provided, and the graphic features of the first graphic features match the graphic features of the target area one by one. Eye tracking technology can also be used to first find the position of the first feature image, then make the first feature graphic move along the visual direction of the pupil, and move the first feature image to the target area. If the target area matches the first feature graphic, it means that the visual guidance active training is correct, otherwise, it means that the training fails; and the training results are output. By tracking the user's eye movement, the first graphic feature matches the target area one by one to achieve eye and brain training. The above can adjust the guidance strategy according to the user's feedback through machine learning calculation method. For example, if the user always looks at the wrong position when looking for a specific image element, the guidance strategy can be adjusted through the algorithm to attract more attention to the correct position. The specific way to attract the user's attention can refer to the following method.
[0078] Reference Figure 7 and Figure 8 , the method also includes the following features:
[0079] Pupil features are extracted from eye images; pupil features are extracted through image recognition technology. Pupil features correspond to the small round hole in the center of the iris in the eye. The pupil is the channel for light to enter the eye. The contraction of the pupillary sphincter on the iris can shrink the pupil, and the contraction of the pupil dilator muscle can dilate the pupil. The dilation and contraction of the pupil control the amount of light entering the pupil. When the light changes from weak to strong, the pupil will shrink, and when the light changes from strong to weak, the pupil will dilate.
[0080] Calculate the area size of the pupil feature; Calculate the area size of the pupil to facilitate subsequent processing; Since the eye image is collected in real time, the properties of the guide image can be adjusted in combination with the change of the pupil area, thereby realizing the interaction between the user and the smart glasses, so that the guide image looks more comfortable.
[0081] The color saturation of the guide image is adjusted according to the size of the pupil feature area; the larger the pupil feature area, the lower the color saturation of the guide image; the smaller the pupil feature area, the higher the color saturation of the guide image. The color saturation of an image refers to the vividness of the color. When the pupil area is larger, the color saturation is lower, which is more conducive to reducing eye stimulation and thus helping to protect the eyes; conversely, when the pupil feature area is smaller, it means that the color saturation can be increased, which helps to match the appropriate color saturation.
[0082] Using the pupil area size characteristics as the basis for adjusting the guiding image can help reduce stimulation to the eyes, relieve eye fatigue, and form adjustable interactive actions between the user and the smart glasses to attract the user's attention, thereby helping to achieve eye and brain training.
[0083] Reference Fig. 9 , the method also includes the following features:
[0084] Identify the mirror image of the guide image from the eye image; since the surface of the eye is equivalent to a mirror, the image presented is a mirror image, and the image presented by directly shooting the eye image with a camera is a mirror image of the real image, so mirror processing of the eye image is helpful for subsequent comparative analysis. Through image processing techniques such as edge detection, morphological operations, and region extraction, the mirror image of the guide image is identified from the eye image.
[0085] Calculate the mirror contrast between the mirror image and the image around it; the mirror contrast is compared by calculating the grayscale or color intensity of the image. The mirror image corresponds to the mirror image of the guide image, and the image around the mirror image is the frame of the glasses or the surrounding environment.
[0086] The action of the jump guide image generated by the mirror contrast adjustment; when the mirror contrast increases, the guide image is allowed to execute the set first action instruction; when the mirror contrast decreases, the guide image is allowed to execute the set second action instruction. According to the size of the mirror contrast, the guide image is allowed to execute the corresponding action instruction. For example, when the mirror contrast has a large jump, it means that the brightness or color intensity of the mirror image has a large difference from the surrounding image, then the first action instruction can be executed, such as moving the guide image to a certain position, or changing the color, etc. When the mirror contrast has a small jump, that is, the brightness and color intensity of the mirror image are small from the surrounding image, then the second action instruction can be executed. For example, the guide image moves to another position, or changes shape, etc. The mirror contrast can be affected by, for example, eyelashes. When blinking, the crossing of eyelashes will cause changes in image attributes. Therefore, executing the corresponding action instruction helps to attract the user's attention.
[0087] By processing the mirror graphics in the eye image and calculating the mirror contrast, the corresponding action command is executed according to the degree of contrast jump, so as to realize the interaction between the eyes and smart devices, attract the user's attention, and thus help to achieve eye and brain training.
[0088] The method further comprises the steps of:
[0089] The second action instruction restores the execution of the first action instruction.
[0090] By adopting the above technical solution, since the mirror image and the guiding image are mirror-related, the first action instruction is a restoration instruction of the second action instruction.
[0091] Reference Fig.10 , the method further comprises the following steps:
[0092] The mirror image of the guide image is identified from the pupil features; the mirror image of the guide image is identified from the pupil features through image recognition technology.
[0093] The size of the guide image is adjusted according to the color saturation of the mirror image. The higher the color saturation of the mirror image, the smaller the area of the guide image. The lower the color saturation of the mirror image, the larger the area of the guide image. The size of the guide image is adjusted according to the color saturation. The higher the color saturation, the brighter the corresponding image and the smaller the area of the guide image. Conversely, the lower the color saturation, the larger the area of the guide image. The color saturation can be affected by eyelashes, for example. When blinking, the crossing of eyelashes will cause a change in the image attributes, thus attracting more attention from the user.
[0094] According to the mirror pattern of the guiding image reflected in the mirror pattern, the area of the guiding image follows the change of color saturation, which can make the image more attractive to the user's attention and is more conducive to the user's eye and brain training.
[0095] The method further comprises the steps of:
[0096] The speed of the guiding image executing the action instruction is adjusted according to the overlapping area of the pupil feature and the first eye feature. For example, the first eye feature is the upper eyelashes, and the pupil feature is the size of the pupil area; the overlapping area is generally caused by blinking or squinting; the speed of the guiding image executing the action instruction is adjusted according to the overlapping area.
[0097] By measuring and comparing the overlapping areas, the system can adjust the appropriate speed of the guiding image to execute the action instruction to attract the user's attention.
[0098] The method further comprises the steps of:
[0099] The speed of the guiding image executing the action instruction is adjusted according to the overlapping area of the pupil feature, the first eye feature and the second eye feature. For example, the first eye feature is the upper eyelashes, the second eye feature is the lower eyelashes, and the pupil feature is the size of the pupil area; the overlapping area is generally caused by blinking or squinting; the speed of the guiding image executing the action instruction is adjusted according to the overlapping area.
[0100] By measuring and comparing the overlapping areas, the system can adjust the appropriate speed of the guiding image to execute the action instruction to attract the user's attention.
[0101] The method further comprises the steps of:
[0102] The amplitude of the action command of the guiding image is adjusted according to the overlapping area of the mirror image and the first eye feature. The first eye feature is the upper eyelashes; the size of the overlapping area of the mirror image and the first eye feature corresponds to the matching degree of the two images; the speed of guiding the image to execute the action command is adjusted according to the matching degree. For example, when blinking, the upper eyelashes are more covered in the image, and by changing the speed of executing the action command, further attention can be attracted.
[0103] By measuring and comparing the overlapping areas, the system can adjust the appropriate movement amplitude of the guiding image to execute the action instruction to attract the user's attention.
[0104] In addition, identification can also be performed based on the crossover frequency of the first eye feature and the second eye feature, and the crossover frequency corresponds to the blinking frequency of the eyes. When the crossover frequency is low, that is, there is no blinking for a long time, the deformation, brightness, contrast, and color saturation of the guide image and other attributes can be adjusted, or the speed of the guide graphic to execute the corresponding action instructions can be changed, so that the user can be reminded to pay attention to the guide image. Among them, the adjustment can be increased, decreased, or unchanged. On the contrary, when the crossover frequency is high, that is, the blinking frequency is high, the deformation, brightness, contrast, and color saturation of the guide image and other attributes can be adjusted, or the speed of the guide graphic to execute the corresponding action instructions can be changed, so that the user can be reminded to pay attention to the guide image.
[0105] An embodiment of the present application discloses a device for dynamically guiding vision of smart glasses, including a processor, in which a program of the method for dynamically guiding vision of smart glasses described above is run.
[0106] An embodiment of the present application discloses a storage medium storing a program of the above-mentioned method for dynamic vision guidance of smart glasses.
[0107] It should be noted that the computer-readable medium recorded in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
[0108] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.
[0109] Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages or a combination thereof, including object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).
[0110] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0111] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.
[0112] The above descriptions are only some preferred embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalent features without departing from the above-mentioned inventive concept. For example, a technical solution formed by replacing the above-mentioned features with the technical features with similar functions disclosed in the embodiments of the present disclosure (but not limited to)
[0113] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.
Claims
1. A method for dynamic vision guidance of smart glasses, It is characterized in that The steps include: Obtaining a guide image; Acquiring an eye image; Extracting a first eye feature and a second eye feature from the eye image; Calculating an intersection amount between the first eye feature and the second eye feature, and adjusting a deformation amount and a brightness value of the guide image according to the intersection amount; The crossing amount includes crossing uniformity and crossing depth; the higher the crossing uniformity, the smaller the deformation amount, and the lower the crossing uniformity, the smaller the deformation amount; the greater the crossing depth, the greater the brightness value, and the smaller the crossing depth, the lower the brightness value.
2. The method for dynamic vision guidance of smart glasses according to claim 1, It is characterized in that The method also includes the following features: The guidance image includes a first graphical feature; extracting pupil features from the eye image; Identify the visual direction of the pupil feature, and when the visual direction of the pupil feature is toward the position of the first graphic feature, the first graphic feature moves to the target area along a preset path; during the movement, if the visual direction of the pupil feature does not match the position of the first graphic feature, output a prompt message.
3. The method for dynamic vision guidance of smart glasses according to claim 1, It is characterized in that The method also includes the following features: extracting pupil features from the eye image; Calculating the area size of the pupil feature; The color saturation of the guide image is adjusted according to the area of the pupil feature; the larger the area of the pupil feature, the lower the color saturation of the guide image; the smaller the area of the pupil feature, the higher the color saturation of the guide image.
4. The method for dynamic vision guidance of smart glasses according to claim 3, It is characterized in that The method also includes the following features: identifying a mirror image of the guide image from the eye image; Calculating the mirror contrast between the mirror image and the image of its surrounding area; The action of the guide image is guided according to the jump generated by the mirror contrast adjustment; if the mirror contrast jumps to a larger value, the guide image executes the set first action instruction; if the mirror contrast jumps to a smaller value, the guide image executes the set second action instruction.
5. The method for dynamic vision guidance of smart glasses according to claim 4, It is characterized in that The method further comprises the steps of: The second action instruction restores and executes the first action instruction.
6. The method for dynamic vision guidance of smart glasses according to claim 3, It is characterized in that The method further comprises the steps of: identifying a mirror pattern of the guide image from the pupil features; The area size of the guide image is adjusted according to the color saturation of the mirror image; the higher the color saturation of the mirror image, the smaller the area of the guide image; the lower the color saturation of the mirror image, the larger the area of the guide image.
7. The method for dynamic vision guidance of smart glasses according to claim 3, It is characterized in that The method further comprises the steps of: The action speed of the guiding image executing the action instruction is adjusted according to the overlapping area of the pupil feature and the first eye feature.
8. The method for dynamic vision guidance of smart glasses according to claim 3, It is characterized in that The method further comprises the steps of: adjusting the speed at which the guiding image executes the action instruction according to the overlapping area between the pupil feature and the first eye feature and the second eye feature; and / or, The action amplitude of the guiding image executing the action instruction is adjusted according to the overlapping area of the mirror pattern and the first eye feature.
9. A vision dynamic guidance device for smart glasses, It is characterized in that It comprises a processor, in which runs a program of the method for dynamic vision guidance of smart glasses as described in any one of claims 1 to 8.
10. A storage medium, It is characterized in that A program storing the method for dynamic vision guidance of smart glasses as described in any one of claims 1-8.