Eyesight fatigue early warning method and device based on AR glasses and storage medium

Abstract

The invention relates to the technical field of intelligent glasses, and discloses an asthenopia early warning method and device based on AR glasses and a storage medium, and the method comprises the following steps: obtaining a shot image through a front camera of the AR glasses; identifying a standard feature object and a target feature object from the shot image; calculating a size relative parameter between the standard feature object and the target feature object; calculating a target distance value between the standard feature object and the target feature object based on a preset size value of the standard feature object and the size relative parameter; calculating a standard distance value between the standard characteristic object and a preset setting point; a first distance value is calculated according to the target distance value and the standard distance value, and according to whether the time associated with the first distance value exceeds a threshold value or not, information prompting is carried out in a display screen of the AR glasses so as to warn a user of the possible asthenopia state. The method has the advantages that the posture of the user is detected and prompted, so that the user can keep a good posture.

Description

Technical Field

[0001] The present application relates to the field of smart glasses, and in particular to a method, device and storage medium for early warning of visual fatigue based on AR glasses. Background Art

[0002] AR glasses are a product of augmented reality (AR) technology that can provide users with futuristic functions used by handsome male and female protagonists in science fiction movies. Such glasses can achieve many functions, such as determining the user's state by tracking the eye's line of sight and activating corresponding functions.

[0003] Long-term use of electronic products will affect the eye's adjustment function and bring more harm, such as eye fatigue, dry eyes, decreased vision, blurred vision, red eyes, etc. In order to maintain good eye habits, in addition to time requirements, you also need to maintain a good sitting posture to avoid eye fatigue caused by long-term viewing at a close distance. Summary of the invention

[0004] In order to help users maintain a good sitting posture and relieve visual fatigue, the present application provides a visual fatigue warning method, device and storage medium based on AR glasses.

[0005] On the one hand, the present application provides a method, device and storage medium for early warning of visual fatigue based on AR glasses, which adopts the following technical solutions:

[0006] A visual fatigue warning method based on AR glasses includes the following steps:

[0007] Acquire the captured image through the front camera of the AR glasses;

[0008] Identifying standard features and target features from the captured image;

[0009] Calculating relative size parameters between the standard feature and the target feature;

[0010] Calculating a target distance value between the standard feature object and the target feature object based on a preset size value of the standard feature object and the size relative parameter;

[0011] Calculating a standard distance value between the standard feature object and a preset setting point;

[0012] A first distance value is calculated based on the target distance value and the standard distance value, and based on whether the time associated with the first distance value exceeds a threshold, an information prompt is displayed on the display screen of the AR glasses to warn the user that he or she may be in a state of visual fatigue.

[0013] By adopting the above technical solution, the distance parameter between the target feature object and the user is calculated by referring to the size parameters of the standard feature object, and whether fatigue will occur is judged according to the time corresponding to the distance parameter, which helps to judge whether the user's sitting posture is appropriate and whether the time is appropriate. If exceeded, an early warning prompt is issued to help users maintain good eye habits and maintain a correct sitting posture.

[0014] Optionally, the method further comprises the following steps:

[0015] The posture data is acquired in real time, and the time associated with the first distance value is calculated according to the posture data.

[0016] By adopting the above technical solution, the user's maintenance time within the set posture range can be judged through posture data, so that an early warning can be provided to the user.

[0017] Optionally, the method further comprises the following steps:

[0018] Based on the first invisible light and the second invisible light, capturing a light image;

[0019] Fitting or extracting a visual intersection image of the first invisible light ray and the second invisible light ray from the light image;

[0020] identifying a visual intersection point from the visual intersection image;

[0021] Obtaining shooting coordinates and intersection coordinates based on the visual intersection positioning;

[0022] Obtaining relative coordinates based on the position of the target feature on the path of the first invisible light ray and the second invisible light ray;

[0023] Calculate the target coordinates according to the intersection coordinates and the relative coordinates;

[0024] Calculating the distance between the shooting coordinates and the target coordinates to obtain a second distance value;

[0025] An actual distance value is obtained by fusing the first distance value and the second distance value.

[0026] By adopting the above technical solution, the coordinates of the target feature are established by shooting two invisible lights, and then the actual distance value is calculated, which is helpful to judge whether the user's sitting posture is correct.

[0027] Optionally, the method further comprises the following steps:

[0028] The hardware on the smart glasses emits a first invisible light;

[0029] The hardware at the waist emits a second invisible light;

[0030] Smart glasses or waist-mounted invisible light shooting hardware.

[0031] By adopting the above technical solution, by setting the first invisible light and the second invisible light distributed up and down, and setting a device for collecting invisible light on the smart glasses or the waist, subsequent image processing is facilitated.

[0032] Optionally, the method further comprises the following steps:

[0033] The hardware on one side of the smart glasses emits a first invisible light;

[0034] The hardware on the other side of the smart glasses emits a second invisible light;

[0035] Invisible light shooting hardware is set on the top or bottom of the smart glasses.

[0036] By adopting the above technical solution, by setting the first invisible light and the second invisible light distributed on the left and right sides of the smart glasses, and setting a device for collecting invisible light on the top or bottom of the smart glasses, subsequent image processing is facilitated.

[0037] Optionally, the method further comprises the following steps:

[0038] The hardware on one side of the waist emits a first invisible light;

[0039] The hardware on the other side of the waist emits a second invisible light;

[0040] Invisible light shooting hardware is set on the top or bottom of the smart glasses.

[0041] By adopting the above technical solution, by setting the first invisible light and the second invisible light distributed on the left and right sides of the waist, a device for collecting invisible light is set on the top or bottom of the smart glasses to facilitate subsequent image processing.

[0042] Optionally, the method further comprises the following steps:

[0043] The warning prompt content is matched according to the actual distance value and displayed.

[0044] By adopting the above technical solution, the actual distance value is compared with the preset distance threshold, and the corresponding warning prompt content is selected according to the comparison result.

[0045] Optionally, the method further includes the following steps: the actual distance value includes a first distance value, and the size of the warning prompt content is adjusted according to the first distance value.

[0046] By adopting the above technical solution, the size of the warning prompt content is adjusted according to the size of the first distance value, so that it can be more suitable for different usage scenarios and user needs.

[0047] Optionally, the method further includes the following steps: the actual distance value includes a second distance value, and the brightness or flashing frequency of the warning prompt content is adjusted according to the second distance value.

[0048] By adopting the above technical solution, the brightness or flashing frequency of the warning prompt content is adjusted according to the size of the second distance value, so that it can be more adapted to different usage scenarios and user needs.

[0049] On the other hand, the present application provides a visual fatigue warning device based on AR glasses, which adopts the following technical solution:

[0050] A visual fatigue warning device based on AR glasses includes a processor, in which a program of the above-mentioned visual fatigue warning method based on AR glasses is running.

[0051] On the other hand, the present application provides a storage medium, which adopts the following technical solution:

[0052] A storage medium stores a program of the above-mentioned visual fatigue warning method based on AR glasses.

[0053] In summary, the present application includes at least one of the following beneficial technical effects: by photographing a standard feature object, a preliminary calculation of the distance parameter between the target feature object and the user is determined; and by identifying and calculating the intersection of two invisible lights, the coordinates are established, and the distance parameters are further accurately calculated, which is facilitating the judgment of whether the user's sitting posture is accurate. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] Figure 1 This is a step diagram of a visual fatigue warning method based on AR glasses in this application.

[0055] Figure 2 This is a step diagram for calculating the actual distance value in a visual fatigue warning method based on AR glasses in the present application.

[0056] Figure 3 This is a schematic diagram of a visual intersection point falling in front of a target feature object in a visual fatigue warning method based on AR glasses in the present application.

[0057] Figure 4 This is a schematic diagram of a visual fatigue warning method based on AR glasses in the present application, in which the visual intersection point falls behind the target feature object.

[0058] Figure 5This is a schematic diagram of a visual fatigue warning method based on AR glasses in the present application, in which a first invisible light beam and a second invisible light beam do not intersect in reality.

[0059] Figure 6 This is a method step diagram corresponding to setting hardware that emits invisible light on smart glasses and the waist in a method for early warning of visual fatigue based on AR glasses in the present application.

[0060] Figure 7 This is a schematic diagram of hardware that emits invisible light set on smart glasses and the waist in a method for early warning of visual fatigue based on AR glasses in the present application.

[0061] Figure 8 This is a schematic diagram of the hardware provided on the smart glasses and the waist emitting invisible light in a method for early warning of visual fatigue based on AR glasses in the present application.

[0062] Fig. 9 This is a method step diagram corresponding to setting up hardware emitting invisible light on both sides of smart glasses in a method for early warning of visual fatigue based on AR glasses in the present application.

[0063] Fig.10 This is a schematic diagram of a method for early warning of visual fatigue based on AR glasses in the present application, in which hardware for emitting invisible light is arranged on both sides of smart glasses.

[0064] Fig.11 This is a schematic diagram of the hardware on both sides of the smart glasses emitting invisible light in a method for early warning of visual fatigue based on AR glasses in the present application.

[0065] Fig.12 This is a method step diagram corresponding to setting up hardware emitting invisible light on both sides of the waist in a visual fatigue warning method based on AR glasses in the present application.

[0066] Fig.13 This is a schematic diagram of a method for early warning of visual fatigue based on AR glasses in the present application, in which hardware for emitting invisible light is arranged on both sides of the waist.

[0067] Fig.14 This is a schematic diagram of the hardware located on both sides of the waist emitting invisible light in a visual fatigue warning method based on AR glasses in the present application. DETAILED DESCRIPTION

[0068] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0069] It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present disclosure can be combined with each other.

[0070] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0071] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0072] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0073] The embodiment of the present application discloses a visual fatigue warning method based on AR glasses.

[0074] Reference Figure 1 , a visual fatigue warning method based on AR glasses, comprising the following steps:

[0075] The captured image is obtained through the front camera of the AR glasses; the captured image is an image of a real object in front of the user's visual field while wearing the AR glasses.

[0076] Identify standard features and target features from the captured image; for example, the standard feature may be a hardware box (power supply or CPU) connected to the smart glasses, and the target feature may be a book or a screen.

[0077] Calculate the relative size parameters between the standard feature and the target feature; for example, box:book is 1:1.5.

[0078] The target distance value between the standard feature object and the target feature object is calculated based on the preset size value and the size relative parameter of the standard feature object. For example, the preset size value is the box length dimension, which is a fixed value. The target distance value is the value calculated based on the length of the box and the image distance between the box and the book.

[0079] The standard distance value between the standard feature object and the preset setting point is calculated; for example, the preset setting point is the shooting point or one end of the shooting picture, such as the side where the user is located.

[0080] The first distance value is calculated based on the target distance value and the standard distance value. According to whether the time associated with the first distance value exceeds the threshold, an information prompt is provided on the display screen of the AR glasses to warn the user that he may be in a state of visual fatigue. For example, the first distance value is the estimated distance between the book and the shooting point or one end of the shooting screen, and the estimated distance is approximately equal to the distance at which the user reads the book. This can be achieved by combining SLAM technology with image recognition. SLAM technology is a technology for building an environmental map on a mobile device. It gradually builds and improves the cognitive map of the environment by capturing the movement and posture changes of the device in space, combined with the observation and matching of environmental feature points. Through SLAM technology, the user's current position and the direction he is facing can be determined. Then, the coordinate position of the content (screen or book) that the user is watching is identified through image recognition technology; finally, the relative coordinate position of the person and the content being watched by the user is calculated.

[0081] Acquire posture data in real time, and calculate the time associated with the first distance value based on the posture data. Among them, the acquisition of posture data can be achieved through a six-axis sensor to obtain the user's motion information. The six-axis sensor refers to a three-axis gyroscope + a three-axis accelerometer. The three-axis gyroscope measures the angle between the vertical axis of the gyro rotor and the device in the three-dimensional coordinate system, and calculates the angular velocity, and determines the motion state of the object in three-dimensional space by the angle and angular velocity. The accelerometer obtains the result by measuring the force of the component in a certain axis, which is expressed as the magnitude and direction of the axial acceleration (XYZ). When the user maintains a certain posture for a long time, the time is the time that the posture data corresponds to the first distance value. Specifically, the movement deviation range of the posture is determined. If the deviation range is less than the set value, it means that the posture remains basically unchanged during the time period, and the time is counted.

[0082] By referring to the size parameters of standard feature objects, the distance parameters between the target feature object and the user are calculated, which helps to determine whether the user's sitting posture is appropriate and whether the sitting posture can be maintained for an appropriate time, so as to help the user maintain a correct sitting posture and a good eye use time to relieve visual fatigue.

[0083] Reference Figure 2 , the method further comprises the following steps:

[0084] Based on the first invisible light and the second invisible light, a light image is captured. The invisible light is infrared light or ultraviolet light, and invisible light is used to capture image information that is not detectable by the human eye, such as an infrared camera.

[0085] The visual intersection image of the first invisible light ray and the second invisible light ray is fitted or extracted from the light image; the light image is processed by using image processing technology to identify and extract the intersection image of the first invisible light ray and the second invisible light ray.

[0086] A visual intersection point is identified from the visual intersection image; and an image processing technique is used to further identify the intersection point of the visual intersection image, that is, the intersection point of the first invisible light ray and the second invisible light ray.

[0087] Reference Figure 3 , the visual intersection point falls in front of the target feature, and the intersection point of the two beams of light can be identified and processed based on image recognition.

[0088] Reference Figure 4 The visual intersection point falls behind the target feature object. There is no actual visual intersection point in the light image, but image processing technology can be used to extend the two beams of light to obtain the visual intersection point, and then image recognition technology can be used to identify the virtual visual intersection point.

[0089] Reference Figure 5 The visual intersection does not exist in the actual display, that is, the two beams of light do not intersect in space. However, after the light image is taken, the spatial perspective can be converted according to the coordinate position of the light, and then the image processing technology can be used to extend the two beams of light to obtain the visual intersection, and then the image recognition technology can be used to identify the virtual visual intersection.

[0090] Based on the visual intersection positioning, the shooting coordinates and the intersection coordinates are obtained; the coordinate position of the shot image and the coordinate position of the intersection are calculated and positioned.

[0091] Relative coordinates are obtained based on the positions of the target features on the first invisible light path and the second invisible light path; the positions of the target features on the two invisible light paths are identified and determined, thereby obtaining relative coordinate values, that is, the positions of the content (screen or book) that the user is watching on the two invisible light paths.

[0092] The target coordinates are calculated based on the intersection coordinates and the relative coordinates; the target coordinates are calculated by combining the intersection coordinates and the relative coordinates of the target features.

[0093] The distance between the shooting coordinates and the target coordinates is calculated to obtain a second distance value; and the distance from the shooting coordinates to the target coordinates is calculated.

[0094] The actual distance value is obtained by fusing the first distance value and the second distance value. The first distance value and the second distance value are combined and calculated to obtain a more accurate actual distance value.

[0095] By shooting visible light combined with invisible light, the coordinates of the target features are established, and then the actual distance value is calculated, which helps to determine whether the user's sitting posture is accurate.

[0096] Reference Figure 6-8 , the method further comprises the steps of:

[0097] The hardware on the smart glasses emits a first invisible light; the hardware that emits the first invisible light is a light-emitting element that emits an invisible light beam; the hardware that emits the first invisible light is located on the smart glasses, which means that the hardware that emits the first invisible light is located at the head position and above the hardware that emits the second invisible light.

[0098] The hardware on the waist emits a second invisible light; the hardware emitting the second invisible light is a light-emitting element that emits an invisible light beam; the hardware emitting the second invisible light is located on the waist, which means that the user wears a device on the waist, and the device can be a belt or other small devices. The emission of the second invisible light is located below the first invisible light.

[0099] Smart glasses or waist-mounted devices are equipped with invisible light shooting hardware. Smart glasses or waist-mounted devices are equipped with cameras or other image acquisition devices that can capture invisible light.

[0100] By arranging the first invisible light and the second invisible light distributed up and down, and arranging a device for collecting invisible light on the smart glasses or the waist, subsequent image processing is facilitated.

[0101] Reference Figure 9-11 , the method further comprises the steps of:

[0102] The hardware on one side of the smart glasses emits a first invisible light; the hardware emitting the first invisible light is a light-emitting element that emits an invisible light beam; the hardware emitting the first invisible light is located on one side of the smart glasses.

[0103] The hardware on the other side of the smart glasses emits a second invisible light; the hardware that emits the second invisible light is a light-emitting element that emits an invisible light beam; the hardware that emits the second invisible light is located on the other side of the smart glasses, which means that the first visible light and the second visible light are distributed on the left and right sides of the user.

[0104] Invisible light shooting hardware is set on the top or bottom of the smart glasses.

[0105] By arranging the first invisible light and the second invisible light distributed on the left and right sides of the smart glasses, and arranging a device for collecting invisible light on the top or bottom of the smart glasses, subsequent image processing is facilitated.

[0106] Reference Figure 12-14 , the method further comprises the following steps:

[0107] The hardware on one side of the waist emits a first invisible light ray; the hardware emitting the first invisible light ray is a light-emitting element that emits an invisible light beam; the hardware emitting the first invisible light ray is located on one side of the waist, which means that the user wears a device on one side of the waist, and the device can be a belt or other forms of small devices.

[0108] The hardware on the other side of the waist emits a second invisible light; the hardware that emits the second invisible light is a light-emitting element that emits an invisible light beam; the hardware that emits the second invisible light is located on the other side of the waist, which means that the user wears a device on his waist, which can be a belt or other forms of small devices.

[0109] Invisible light shooting hardware is set on the top or bottom of the smart glasses.

[0110] By arranging the first invisible light and the second invisible light distributed on the left and right sides at the waist, a device for collecting invisible light is arranged on the top or bottom of the smart glasses to facilitate subsequent image processing.

[0111] The method further comprises the steps of:

[0112] The warning prompt content is matched and displayed according to the actual distance value.

[0113] The actual distance value is compared with the preset distance threshold, and the corresponding warning prompt content is selected according to the comparison result. For example, if the actual distance value is less than the preset close distance threshold, a warning prompt of "too close distance" can be matched; if the actual distance value is greater than the preset long distance threshold, a warning prompt of "too far distance" can be matched. The matched warning prompt content is displayed to the user, which can be achieved through the display screen of the smart glasses or other visualization devices. The warning prompt content can be in the form of text, sound, image, etc., and can be selected according to specific needs.

[0114] The method further comprises the following steps: the actual distance value comprises a first distance value, and the size of the warning prompt content is adjusted according to the first distance value. The first distance value is a distance value measured by SLAM.

[0115] According to the size of the first distance value, the size of the warning prompt content is adjusted to make it more suitable for different usage scenarios and user needs. For example, if the first distance value is small, the warning prompt content can be enlarged so that the user can see the prompt content more clearly; if the first distance value is large, the warning prompt content can be reduced to display more information in a larger range. The adjusted warning prompt content is displayed to the user, which can be achieved through the display screen of the smart glasses or other visualization devices.

[0116] The method further comprises the following steps: the actual distance value comprises a second distance value, and the brightness or flickering frequency of the warning prompt content is adjusted according to the second distance value. The second distance value is a distance value measured by the invisible light method.

[0117] According to the size of the second distance value, the brightness or flashing frequency of the warning prompt content is adjusted to make it more suitable for different usage scenarios and user needs. For example, if the second distance value is small, the brightness of the warning prompt content can be increased so that the user can see the prompt content more clearly; if the second distance value is large, the flashing frequency of the warning prompt content can be increased to attract the user's attention by flashing. The adjusted warning prompt content is displayed to the user, which can be achieved through the display screen of the smart glasses or other visualization devices.

[0118] An embodiment of the present application discloses a visual fatigue warning device based on AR glasses, including a processor, in which a program of the above-mentioned visual fatigue warning method based on AR glasses runs.

[0119] An embodiment of the present application discloses a storage medium storing a program of the above-mentioned visual fatigue warning method based on AR glasses.

[0120] It should be noted that the computer-readable medium recorded in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0121] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0122] Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0123] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0124] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0125] The above descriptions are only some preferred embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalent features without departing from the above-mentioned inventive concept. For example, a technical solution formed by replacing the above-mentioned features with the technical features with similar functions disclosed in the embodiments of the present disclosure (but not limited to)

[0126] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A visual fatigue warning method based on AR glasses, It is characterized in that The steps include: Acquire the captured image through the front camera of the AR glasses; Identifying standard features and target features from the captured image; Calculating relative size parameters between the standard feature and the target feature; Calculating a target distance value between the standard feature object and the target feature object based on a preset size value of the standard feature object and the size relative parameter; Calculating a standard distance value between the standard feature object and a preset setting point; A first distance value is calculated based on the target distance value and the standard distance value, and based on whether the time associated with the first distance value exceeds a threshold, an information prompt is displayed on the display screen of the AR glasses to warn the user that he or she may be in a state of visual fatigue.

2. The method for early warning of visual fatigue based on AR glasses according to claim 1, It is characterized in that The method further comprises the steps of: The posture data is acquired in real time, and the time associated with the first distance value is calculated according to the posture data.

3. The method for early warning of visual fatigue based on AR glasses according to claim 1, It is characterized in that The method further comprises the steps of: Based on the first invisible light and the second invisible light, capturing a light image; Fitting or extracting a visual intersection image of the first invisible light ray and the second invisible light ray from the light image; identifying a visual intersection point from the visual intersection image; Obtaining shooting coordinates and intersection coordinates based on the visual intersection positioning; Obtaining relative coordinates based on the position of the target feature on the path of the first invisible light ray and the second invisible light ray; Calculate the target coordinates according to the intersection coordinates and the relative coordinates; Calculating the distance between the shooting coordinates and the target coordinates to obtain a second distance value; An actual distance value is obtained by fusing the first distance value and the second distance value.

4. The method for early warning of visual fatigue based on AR glasses according to claim 3, It is characterized in that The method further comprises the steps of: The hardware on the smart glasses emits a first invisible light; The hardware at the waist emits a second invisible light; Smart glasses or waist are equipped with invisible light shooting hardware.

5. The method for early warning of visual fatigue based on AR glasses according to claim 3, It is characterized in that The method further comprises the steps of: The hardware on one side of the smart glasses emits a first invisible light; The hardware on the other side of the smart glasses emits a second invisible light; Invisible light shooting hardware is set on the top or bottom of the smart glasses.

6. The method for early warning of visual fatigue based on AR glasses according to claim 3, It is characterized in that The method further comprises the steps of: The hardware on one side of the waist emits a first invisible light; The hardware on the other side of the waist emits a second invisible light; Invisible light shooting hardware is set on the top or bottom of the smart glasses.

7. The method for early warning of visual fatigue based on AR glasses according to claim 3, It is characterized in that The method further comprises the steps of: The warning prompt content is matched according to the actual distance value and displayed.

8. The method for early warning of visual fatigue based on AR glasses according to claim 7, It is characterized in that The method further comprises the steps of: The actual distance value includes a first distance value, and the size of the warning prompt content is adjusted according to the first distance value; and / or, The actual distance value includes a second distance value, and the brightness or flashing frequency of the warning prompt content is adjusted according to the second distance value.

9. A visual fatigue warning device based on AR glasses, It is characterized in that It includes a processor, in which runs a program of the visual fatigue warning method based on AR glasses as described in any one of claims 1 to 8.

10. A storage medium, It is characterized in that A program for the visual fatigue warning method based on AR glasses as described in any one of claims 1 to 8 is stored.

Images