Intelligent glasses interaction method and system
The smart glasses system solves the problems of excessive human intervention, low efficiency, and poor interactivity in existing vision testing methods through voice interaction and light compensation technology, and realizes the automation of vision testing and efficient and accurate vision detection.
Patent Information
- Application Number
- CN202510405826.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-04-02
- Publication Date
- 2025-12-09
- Estimated Expiration
- 2045-04-02
AI Technical Summary
Existing vision testing methods require manual intervention, which is inefficient and lacks interactivity, resulting in insufficient accuracy of test results.
The system utilizes smart glasses to automatically project vision charts, recognize characters, and output results via voice interaction. Combined with light compensation and filtering technologies, it enhances interactivity and accuracy.
It has automated and intelligentized vision testing, reduced manual intervention, improved testing efficiency and accuracy, and simplified the operation process.
Smart Images

Figure CN120335606B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to the technical field of vision detection, in particular to an intelligent glasses interaction method and system. BACKGROUND
[0002] The eye is an important organ of human beings, and through the eye people can see the beautiful things in the outside world. However, with the increasing pressure of people's learning, work and life, the vision is seriously damaged. In this case, the vision examination is very important. If the problem is found, the eye can be intervened and protected in advance. The vision examination method usually has the following two kinds: (1) vision chart, which is divided into far vision chart and near vision chart. The far vision chart is usually given by the hospital, that is, the E-shaped vision chart at a distance of 5 meters. When the vision measured by the vision chart is poor, less than 1.0, the near vision chart can be measured. The distance of the near vision chart is usually 30 cm. If 1.0 can be read out, it means that the far vision is a problem, and the near vision is good. In other words, it is nearsightedness. If the far vision chart is good and the near vision chart is poor, it means that the far vision or presbyopia is a problem; (2) optometry. The computer optometry instrument can measure the degree of normal adults, and the degree of related lenses can be tried on to improve the vision. The refractive state of the patient can be measured more accurately. However, the existing vision examination needs the cooperation of the vision examination personnel, which is time-consuming and laborious, and the examination efficiency is not high, which wastes resources and reduces the accuracy of the examination results to some extent.
[0003] Prior art one, CN201310608989.X, a vision examination instrument and a vision examination method, including a vision chart display device, a lens with the function of extending the observation distance of the human eye, and a box with a certain shape; the vision chart display device and the lens with the function of extending the observation distance of the human eye are installed in the box with a certain shape; the box with a certain shape is provided with an observation hole in front of the lens with the function of extending the observation distance of the human eye. Although the lens with the function of extending the observation distance of the human eye extends the distance of the human eye to see the vision chart to the standard distance of the vision examination, it can solve the problem that the vision examination is limited by manpower and environmental conditions, and realize the real-time handheld vision examination instrument for vision examination, but it lacks the initiative of the vision examination, and the examined object is passive to do the examination. Moreover, due to some objective factors (language, speaking strength and speed, etc.) of the vision examination personnel, the examined object cannot accurately obtain the information of the vision chart, which reduces the efficiency of the vision examination.
[0004] Prior art two, CN201610866738.5 A kind of vision inspection device, including support, gear assembly and shielding component, shielding component includes first baffle and second baffle, first baffle and second baffle are located at the two sides of support, first baffle and second baffle are installed on the two rotating rods of support respectively;Gear assembly includes first gear, second gear and third gear, first gear, second gear and third gear are bevel gears, rotating rod can be rotated with first baffle and second baffle, the end of rotating rod connected with first baffle is installed first gear, the end of rotating rod connected with second baffle is installed second gear, first gear and second gear are simultaneously engaged with third gear.Although it is convenient to wear and shield single eye to realize vision detection, ensure the accuracy of inspection, but lack the interactivity of the object and the vision detector, leading to poor interaction ability, to some extent, affect the efficiency of vision inspection.
[0005] Prior art three, CN201780017914.0, vision inspection method, vision inspection instrument and download server of the program of the vision inspection method, the vision inspection method includes the following steps: display the image of the target and a plurality of reference images;Receive the response corresponding to the target image;And determine whether the reference image is the same shape as the target image in the plurality of reference images determined by the response, in addition, one of the plurality of reference images is the same shape as the target image.Although accurate vision inspection can be carried out, this vision inspection instrument lacks cooperation with the glasses when checking vision, leading to poor interaction ability.
[0006] At present, prior art one, prior art two and prior art three exist to make the object passive to do the inspection, due to objective factors, the object cannot accurately obtain the information of the visual acuity chart, reduces the efficiency of vision inspection, and lacks the interactivity of the object and the vision detector, leading to poor interaction ability, to some extent, affect the efficiency of vision inspection. Thus, the present application provides an intelligent glasses interaction method and system, which realizes voice interaction between glasses and vision inspection instrument through voice interaction function, accurately transmits the visual acuity chart information to the object, and enhances the interactivity between devices. SUMMARY
[0007] In order to solve the above technical problems, the present application provides an intelligent glasses interaction method, comprising the following steps:
[0008] The object wears glasses, turns on the power of the glasses, and the projector projects a character in the visual acuity chart to the curtain under the control of the voice interactor;
[0009] The object speaks the voice of the direction of the character on the curtain, the receiver receives the voice and transmits it to the voice interactor for identification;
[0010] The voice interactor sends a voice signal for continuing to recognize the character, the voice signal is played by the player, and the voice interactor continues to control the projector according to the preset program and outputs the recognition result of the visual examination table to the terminal.
[0011] Optionally, the process of light compensation of the projector comprises:
[0012] The light compensation module is started under the control of the projector;
[0013] The light compensation module feeds back the light intensity to the projector through the light sensor, the projector judges the light intensity, if the light intensity reaches the preset light threshold, the projection is continued, and if the light intensity does not reach the preset light threshold, the light compensation is performed.
[0014] The projector filters the character image to be projected and retains the edge information of the character of the visual examination table.
[0015] Optionally, the process of the voice interactor for recognition comprises:
[0016] The voice interactor receives the voice of the feedback of the character of the visual examination table by the subject to be examined;
[0017] The voice interactor compares the feedback voice with the opening direction of the pre-stored character;
[0018] When the error rate exceeds the first preset threshold, the character of the visual examination table is automatically moved up by one line;
[0019] When the accuracy rate of the feedback voice reaches the second preset threshold, the visual result of the subject to be examined is recorded.
[0020] Optionally, when the error rate exceeds the first preset threshold, the visual examination table starts to let the subject to be examined read the character of the previous line, if the error rate still exceeds the first preset threshold, the moving up is continued until the top line of the visual examination table is reached, and when the accuracy rate reaches the second preset threshold, the line where the character is located is the visual value of the subject to be examined, and the visual value is displayed.
[0021] Optionally, the process of the voice interactor for comparing the feedback voice with the opening direction of the pre-stored character comprises:
[0022] The voice interactor pre-stores the voice of the opening direction of each character of the visual examination table; each voice corresponds to the character of the visual examination table one by one;
[0023] When the feedback voice reaches the voice interactor, the pre-stored voice of the current character is compared with the feedback voice, when the waveform spectrum of the pre-stored voice of the current character and the feedback voice is consistent, it is proved that the feedback voice is correct, otherwise the feedback voice is incorrect.
[0024] Optionally, the process that the player plays the voice instruction comprises:
[0025] The player collects the sound decibel of the surrounding environment, and adjusts the volume of the player according to the sound decibel.
[0026] The player receives the voice signal of continuing to identify the character.
[0027] The player plays the voice signal of continuing to identify the character issued by the voice interactor according to the adjusted volume.
[0028] Optionally, the process that the player adjusts the volume of the player according to the sound decibel comprises:
[0029] The sound sensor collects the change of the surrounding environmental sound.
[0030] The change of the environmental sound signal of the current time is generated according to the change, and a sensing signal is generated.
[0031] The data of the audio signal amplification and damping of the voice instruction is adjusted according to the sensing signal, the change of the voice audio output at each current time is controlled, and the automatic adjustment of the volume of the player is realized.
[0032] The present application provides an intelligent glasses interaction system, comprising:
[0033] The projector, the voice interactor, the glasses, the receiver, the terminal, the power supply and the player.
[0034] The voice interactor, the receiver and the player are installed on the glasses; the voice interactor is connected with the projector, the receiver and the player by wire; the power supply is connected with the projector, the voice interactor, the glasses, the receiver and the player; and the voice interactor is wirelessly connected with the terminal.
[0035] Optionally, the player is provided with a sound sensor and an audio current adjustment module; the sound sensor is connected with the audio current adjustment module.
[0036] Optionally, the projector is provided with a light compensation module, a light sensor and a filter.
[0037] The light compensation module is connected with the light sensor and the filter.
[0038] The application firstly makes the examinee wear glasses, turns on the power supply of the glasses, and the projector projects a character in the visual acuity examination table to the curtain under the control of the voice interactor; then the examinee speaks the voice of the direction of the curtain character, the receiver receives the voice and transmits it to the voice interactor for identification; finally, the voice interactor sends a voice signal for continuing to identify the character, the voice signal is played by the player, and the voice interactor continues to control the projection according to the preset program, and finally outputs the identification result of the visual acuity examination table to the terminal; the above scheme sets the voice interactor, realizes the interactive function of the glasses, automatically projects the character, automatically identifies the result, realizes the automatic display and automatic identification of the visual acuity examination table, saves the complexity of manual participation, and improves the intelligent capability of the system; the projector and the voice interactor are set to realize the interactivity of the visual acuity examination instrument; the receiver and the player are set on the glasses to improve the intelligence of the glasses (the glasses are worn by the examinee when checking the visual acuity), and the participation of the examiner is not required, and the examinee can complete the operation alone, simplifies the procedure of the visual acuity examination, improves the visual acuity examination efficiency, effectively improves the interactivity of the glasses, and improves the precision and accuracy of the visual acuity examination.
[0039] Other features and advantages of the present application will be set forth in the following description, and in part will become apparent to those skilled in the art from the description, or can be learned by practice of the present application. The objects and other advantages of the present application can be realized and attained by the structure particularly pointed out in the written description and the appended drawings.
[0040] The technical solutions of the present application will be further described in detail below with the help of the drawings and examples. BRIEF DESCRIPTION OF DRAWINGS
[0041] The accompanying drawings are included to provide a further understanding of the present application, and constitute a part of the specification, illustrate embodiments of the present application, and are used to explain the present application, and do not constitute a limitation on the present application. In the drawings:
[0042] Figure 1 It is an interactive method flow chart of the intelligent glasses in embodiment 1 of the present application;
[0043] Figure 2 It is a collection process chart of the image in embodiment 2 of the present application;
[0044] Figure 3 It is a processing process chart of the voice instruction in embodiment 4 of the present application;
[0045] Figure 4 It is an adjustment process chart of the volume of the player in embodiment 5 of the present application;
[0046] Figure 5 It is a process chart of the judgment result of the visual acuity examination table by the visual acuity examination instrument in embodiment 6 of the present application;
[0047] Figure 6 Figure 8 is a block diagram of an intelligent glasses interaction system according to an embodiment of the present application. DETAILED DESCRIPTION
[0048] The preferred embodiments of the present application will be described herein below with reference to the accompanying drawings, in which it is understood that the preferred embodiments described herein are merely for the purpose of illustrating and explaining the present application and are not intended to limit the present application.
[0049] The terminology used in the present application is merely for the purpose of describing particular embodiments and is not intended to limit the present application. The singular forms "a", "an" and "the" used in the present application are also intended to include the plural forms, unless the context clearly indicates otherwise. It should be understood that the term "and / or" used herein is intended to mean any or all possible combinations of one or more associated listed items.
[0050] The following description refers to the accompanying drawings. Wherever possible, the same reference numbers in different drawings refer to the same or similar elements. The following exemplary embodiments are described hereinbelow with reference to the drawings. The embodiments described herein are merely exemplary and do not represent all possible embodiments in accordance with the present application. Rather, they are merely examples of apparatus and methods in accordance with some aspects of the present application. In the description of the present application, it should be understood that the terms "first", "second", etc. are used merely to distinguish similar objects from one another, and do not necessarily indicate a particular order or sequence, nor do they necessarily indicate relative importance. The specific meanings of the above terms in the present application can be understood by the person of ordinary skill in the art according to the specific circumstances.
[0051] Embodiment 1
[0052] As shown in Figure 1 The present application provides an intelligent glasses interaction method, comprising the following steps:
[0053] S100: The examinee wears the glasses, turns on the power of the glasses, and the projector under the control of the voice interactor projects a character in the vision test table to the curtain;
[0054] S200: The examinee speaks the voice of the direction of the character on the curtain, the receiver receives the voice and transmits it to the voice interactor for recognition;
[0055] S300: The voice interactor sends a voice signal for continuing to recognize the character, the voice signal is played by the player, the voice interactor continues to control the projector according to the preset program, and the recognition result of the vision test table is output to the terminal;
[0056] The working principle and beneficial effects of the above technical solution are as follows: In this embodiment, the examinee first wears glasses and turns on the glasses. Under the control of the voice interactive device, the projector projects a character from the vision test chart onto the screen. Then, the examinee speaks the direction the character on the screen is facing. The receiver receives the voice and sends it to the voice interactive device for recognition. Finally, the voice interactive device sends a voice signal to continue recognizing characters. The voice signal is played by the player, and the voice interactive device continues to control the projection according to a preset program. Finally, the recognition result of the vision test chart is output to the terminal. In the above solution, the distance between the examinee and the screen is preset and does not need to be adjusted. By setting up the voice interactive device, the interactive function of the glasses is realized, characters are automatically projected, and the results are automatically recognized. This realizes the automatic display and automatic recognition of the vision test chart, saving energy. This system eliminates the complexity of manual intervention and enhances its intelligence. The inclusion of a projector and voice interaction device enables interactivity in the vision testing instrument. In this embodiment, the glasses utilize the frame without involving the lens structure, mounting the projector, voice interaction device, receiver, and player on the frame. Users can operate the devices by wearing them, centralizing the equipment on the frame and automating the vision test. The receiver and player on the glasses enhance the intelligence of the glasses (worn by the examinee during the vision test), eliminating the need for human intervention. The test can be completed by the examinee alone, simplifying the vision test procedure, improving efficiency, enhancing interactivity, and increasing accuracy.
[0057] Example 2
[0058] like Figure 2 As shown, based on Embodiment 1, the light compensation process of the projector provided in this embodiment of the invention includes:
[0059] S101: Activate the light compensation module under the control of the projector;
[0060] S102: The light compensation module feeds back the light intensity to the projector through the light sensor. The projector judges the light intensity. If the light intensity reaches the preset light threshold, it continues to project; if the light intensity does not reach the preset light threshold, it performs light compensation.
[0061] S103: The projector filters the character image to be projected, preserving the edge information of the characters in the vision test chart.
[0062] The working principle and beneficial effects of the technical solution are as follows: first, the light compensation module is started under the control of the projector; second, the light compensation module feeds back the light intensity to the projector through the light sensor, the projector judges the light intensity, if the light intensity reaches the preset light threshold, the projection continues; if the light intensity does not reach the preset light threshold, light compensation is performed; finally, the projector filters the character image to be projected, and retains the edge information of the characters of the visual acuity chart; the above scheme realizes that the characters projected by the projector can be clearly displayed through the light compensation module, greatly reduces the problem that the visual acuity examination of the examined object is inaccurate due to the objective factor of light, and further improves the accuracy of the visual acuity examination result. The visual acuity tester also pre-judges the intensity of the light to ensure that the light is within a reasonable threshold range, so that the examined object can obtain the best light; after light compensation, the characters are projected, and because the light has been compensated in advance, the characters seen by the examined object are clearer. The projector pre-processes the characters of the visual acuity chart, mainly filters, eliminates the noise of the character image through filtering, and retains the edge information of the characters of the visual acuity chart, so that the characters projected by the projector are complete and do not affect the accuracy of the visual acuity examination result.
[0063] Embodiment 3
[0064] On the basis of embodiment 2, the filter model used by the projector to filter the character image is as follows:
[0065] ;
[0066] ;
[0067] wherein, represents the gray value of the character image before filtering at the coordinate , represents the gray value of the character image after filtering at the coordinate , r represents the window radius of the filter, represents the coordinate set of the pixels in the square region with the center of and the side length of (2r+1), represents the gray similarity weight of the coordinate , and respectively represent the spatial standard deviation and the gray standard deviation.
[0068] The working principle and beneficial effects of the technical solution are as follows: the projector filters the character image to be projected, retains the edge information of the characters of the visual acuity chart, realizes filtering through the above filtering model, removes the noise in the character image, maximally retains the edge information of the characters, improves the integrity and accuracy of the character image, maintains the gray value of the character image, guarantees the accuracy of the visual acuity test result, and improves the experience and comfort of the person being tested.
[0069] Embodiment 4
[0070] As shown in the embodiment 1, the process of the voice interactor for recognition includes: Figure 3
[0071] S201: The voice interactor receives the voice of the person being tested for feedback of the characters of the visual acuity chart;
[0072] S202: The voice interactor compares the feedback voice with the opening direction of the pre-stored characters;
[0073] S203: When the error rate exceeds the first preset threshold, the characters of the visual acuity chart are automatically moved up by one row;
[0074] S204: When the accuracy of the feedback voice reaches the second preset threshold, the visual acuity result of the person being tested is recorded.
[0075] The working principle and beneficial effects of the technical solution are as follows: the voice interactor first receives the voice of the person being tested for feedback of the characters of the visual acuity chart; secondly, the voice interactor compares the feedback voice with the opening direction of the pre-stored characters; then, when the error rate exceeds the first preset threshold, the characters of the visual acuity chart are automatically moved up by one row; finally, when the accuracy of the feedback voice reaches the second preset threshold, the visual acuity result of the person being tested is recorded; the voice interactor judges through the feedback voice, compares the feedback of the person being tested with the correct character opening direction, realizes the automatic judgment of the person being tested for reading the characters of the visual acuity chart, improves the recognition efficiency, when the error rate exceeds the first preset threshold, the visual acuity chart starts to let the person being tested read the characters of the previous row, if the error rate still exceeds the first preset threshold, continues to move up until the top row of the visual acuity chart; when the accuracy reaches the second preset threshold, the row of the current characters is the visual acuity value of the person being tested, and the visual acuity value is displayed, which is convenient for professionals to refer and use; through the above scheme, the workload of professionals is greatly reduced, the person being tested truly checks the visual acuity, time is saved, efficiency is improved, and the examination cost of the hospital is reduced.
[0076] Embodiment 5
[0077] Based on Example 4, the process by which the voice interaction device provided in this embodiment of the invention compares the feedback voice with the opening direction of pre-stored characters includes:
[0078] The voice interactive device pre-stores the voice of the opening direction of each character on the vision chart; each voice corresponds one-to-one with a character on the vision chart.
[0079] When the feedback voice arrives at the voice interaction device, it compares the pre-stored current character voice with the feedback voice. If the waveform spectrum of the pre-stored current character voice and the feedback voice are consistent, it proves that the feedback voice is correct; otherwise, the feedback voice is incorrect.
[0080] The working principle and beneficial effects of the above technical solution are as follows: In this embodiment, the voice interactive device first stores the voice of the opening direction of each character of the vision test chart; each voice corresponds one-to-one with a character of the vision test chart; secondly, when the feedback voice arrives at the vision test instrument, the pre-stored current character voice is compared with the feedback voice. When the waveform spectrum of the pre-stored current character voice and the feedback voice are consistent, it proves that the feedback voice is correct; otherwise, the feedback voice is incorrect. The verification of whether the feedback voice is correct is achieved by comparing the waveform spectrum of the voice. The pre-set voice corresponding to each character improves the efficiency of feedback voice recognition, eliminates the complexity of multiple judgments and comparisons, and is fast and accurate.
[0081] Example 6
[0082] like Figure 4 As shown, based on Embodiment 1, the process of the player providing this embodiment of the invention playing voice commands includes:
[0083] S301: The player collects the ambient sound decibels and adjusts the player's volume according to the sound decibels.
[0084] S302: The player receives a voice signal to continue recognizing characters;
[0085] S303: The player plays the voice signal from the voice interaction device to continue recognizing characters, according to the adjusted volume.
[0086] The working principle and beneficial effects of the technical solution are: first, the player collects the sound decibel of the surrounding environment, and adjusts the volume of the player according to the sound decibel; second, the player receives a voice signal for continuing to identify characters; and finally, the player plays the voice signal for continuing to identify characters sent by the voice interactor according to the adjusted volume. The above-mentioned scheme realizes automatic adjustment of the volume of the player by collecting the sound decibel of the surrounding environment, makes the glasses more humanized and intelligent, provides a comfortable examination environment for the examinee, and helps the vision examination; the player plays the voice signal of the voice interactor, so that the examinee can know in time which character needs to be judged by the examinee, and the examiner does not need to operate, which saves time and effort, realizes the independent examination of the examinee, and is simple and convenient.
[0087] Embodiment 7
[0088] As shown in Figure 5 , on the basis of Embodiment 6, the process of adjusting the volume of the player according to the sound decibel provided by the present embodiment includes:
[0089] S3011: collecting the change of the ambient sound of the surrounding environment through the sound sensor;
[0090] S3012: generating the change of the ambient sound signal of the current time according to the change and generating a sensing signal;
[0091] S3013: adjusting the data of the audio signal amplification and damping of the voice instruction according to the sensing signal, controlling the change of the voice audio output at each current time, and realizing automatic adjustment of the volume of the player.
[0092] The working principle and beneficial effects of the technical solution are: first, the player collects the sound decibel of the surrounding environment, and adjusts the volume of the player according to the sound decibel; second, the player receives a voice signal for continuing to identify characters; and finally, the player plays the voice signal for continuing to identify characters sent by the voice interactor according to the adjusted volume. The above-mentioned scheme realizes automatic adjustment of the volume of the player by collecting the sound decibel of the surrounding environment, makes the glasses more humanized and intelligent, provides a comfortable examination environment for the examinee, and helps the vision examination; the player plays the voice signal of the voice interactor, so that the examinee can know in time which character needs to be judged by the examinee, and the examiner does not need to operate, which saves time and effort, realizes the independent examination of the examinee, and is simple and convenient.
[0093] Embodiment 8
[0094] As shown in Figure 6As shown, the intelligent glasses interaction system provided in the embodiment of the present application comprises a projector, a voice interactor, glasses, a receiver, a terminal, a power supply and a player on the basis of embodiment 1.
[0095] The voice interactor, the receiver and the player are mounted on the glasses; the voice interactor is connected with the projector, the receiver and the player in a wired manner; the player is provided with a sound sensor and an audio current adjustment module; the sound sensor is connected with the audio current adjustment module; the power supply is connected with the projector, the voice interactor, the glasses, the receiver and the player; and the voice interactor is connected with the terminal in a wireless manner.
[0096] The working principle and beneficial effects of the above technical solution are as follows: first, the projector is controlled by the voice interactor to project a certain character in the visual acuity test table to the curtain; then the examinee speaks the voice of the direction of the curtain character, the receiver receives the voice and transmits it to the voice interactor for recognition; finally, the voice interactor sends a voice signal for continuing to recognize the character, the voice signal is played by the player, and the voice interactor continues to control the projection according to the preset program, and finally outputs the recognition result of the visual acuity test table to the terminal; the voice interactor is provided in the above scheme, the interaction of the glasses is realized; the projector is provided to realize the automatic collection of the visual acuity test table, and the complexity of manual participation is saved; the change of the environmental sound signal of the current time is generated according to the change, and a sensing signal is generated; the data of the audio signal amplification and damping of the voice instruction is adjusted according to the sensing signal, the change of the voice audio output at each current time is controlled, and the automatic adjustment of the volume of the player is realized; the sensing signal is generated by collecting the change of the sound of the surrounding environment of the examinee, the accurate transmission of the voice signal is realized by the automatic adjustment of the volume, and the efficiency of the visual acuity test can be effectively improved.
[0097] Embodiment 9
[0098] On the basis of embodiment 8, the projector provided in the embodiment of the present application is provided with a light compensation module, a light sensor and a filter.
[0099] The light compensation module is connected with the light sensor and the filter.
[0100] The working principle and beneficial effects of the above technical solution are as follows: the light compensation module is started under the control of the projector in this embodiment; the light compensation module feeds back the light intensity to the projector through the light sensor, the projector judges the light intensity, if the light intensity reaches the preset light threshold, the projection is continued; if the light intensity does not reach the preset light threshold, light compensation is performed; the projector filters the character image to be projected, and retains the edge information of the character of the visual acuity test table.
[0101] It will be apparent to those skilled in the art that various modifications and variations can be made to the present application without departing from the spirit or scope of the application. Thus, it is intended that the present application cover modifications and variations of this application provided they come within the scope of the application and their equivalent technology.
Claims
1. A smart glasses interaction method, characterized in that, The method comprises the following steps: The subject wears glasses, turns on the power of the glasses, and the projector under the control of the voice interactor projects a character in the visual acuity test table to the screen; The subject speaks the voice of the character on the screen, and the receiver receives the voice and transmits it to the voice interactor for recognition; The voice interactor sends a voice signal for continuing to recognize the character, the voice signal is played by the player, and the voice interactor continues to control the projector according to the preset program and outputs the recognition result of the visual acuity test table to the terminal; The process of light compensation of the projector comprises: Starting the light compensation module under the control of the projector; The light compensation module feeds back the light intensity to the projector through the light sensor, the projector judges the light intensity, if the light intensity reaches the preset light threshold, the projection continues, if the light intensity does not reach the preset light threshold, the light compensation is performed; The projector filters the character image to be projected, and retains the edge information of the character of the visual acuity test table; The filter model used by the projector for filtering the character image is: ; ; wherein, denotes the gray value of the character image before filtering at coordinate , denotes the gray value of the character image after filtering at coordinate , r denotes the window radius of the filter, denotes the set of coordinates of the pixels in the square region centered at with side length (2r+1), denotes the gray similarity weight at coordinate , and denote the spatial standard deviation and the gray standard deviation, respectively; The process of recognition by the voice interactor comprises: The voice interactor receives the voice of the subject fed back to the character of the visual acuity test table; The voice interactor compares the fed back voice with the opening direction of the pre-stored character; When the error rate exceeds the first preset threshold, the character line of the visual acuity test table is automatically moved up; When the accuracy rate of the fed back voice reaches the second preset threshold, the visual result of the subject is recorded; When the error rate exceeds the first preset threshold, the visual acuity test table starts to let the subject read the character of the previous line, if the error rate still exceeds the first preset threshold, the moving up continues until the top line of the visual acuity test table is reached, when the accuracy rate reaches the second preset threshold, the line where the character is located is the visual value of the subject, and the visual value is displayed.
2. The smart glasses interaction method of claim 1, wherein, The process of comparing the fed back voice with the opening direction of the pre-stored character by the voice interactor comprises: The voice interactor pre-stores the voice of the opening direction of each character of the visual acuity test table; each voice corresponds to one character of the visual acuity test table; When the fed back voice reaches the voice interactor, the pre-stored voice of the current character is compared with the fed back voice, when the waveform spectrum of the pre-stored voice of the current character is consistent with the fed back voice, it is proved that the fed back voice is correct, otherwise the fed back voice is incorrect.
3. The smart glasses interaction method of claim 1, wherein, The process of the player playing the voice instruction comprises: The player collects the sound decibel of the surrounding environment, and adjusts the volume of the player according to the sound decibel; The player receives the voice signal for continuing to recognize the character; The player plays the voice signal for continuing to recognize the character sent by the voice interactor according to the adjusted volume.
4. The smart glasses interaction method of claim 3, wherein, The process of the player adjusting the volume of the player according to the sound decibel comprises: Collecting the change of the surrounding environmental sound through the sound sensor; Generating the change of the environmental sound signal of the current time according to the change, and generating a sensing signal; Adjusting the data of the audio signal amplification and damping of the voice instruction according to the sensing signal, controlling the change of the voice audio output at each current time, and realizing the automatic adjustment of the volume of the player.
5. An intelligent eyewear interaction system, characterized in that, It comprises: The projector, the voice interactor, the glasses, the receiver, the terminal, the power supply and the player; The glasses are provided with a voice interactor, a receiver and a player; The voice interactor is wired connected with the projector, the receiver and the player; the power supply is connected with the projector, the voice interactor, the glasses, the receiver and the player; and the voice interactor is wirelessly connected with the terminal; The process of light compensation of the projector includes: Starting the light compensation module under the control of the projector; The light compensation module feeds back the light intensity to the projector through the light sensor; the projector judges the light intensity; if the light intensity reaches the preset light threshold, the projection continues; if the light intensity does not reach the preset light threshold, the light compensation is performed; The projector filters the character image to be projected, and retains the edge information of the characters of the visual acuity chart; The filter model used by the projector for filtering the character image is: ; ; wherein, represents a gray value of a character image before filtering at coordinates , represents a gray value of a character image after filtering at coordinates , r represents a window radius of a filter, represents a set of coordinates of pixels in a square region centered at with a side length of (2r+1), represents a gray similarity weight at coordinates , and respectively represent a spatial standard deviation and a gray standard deviation; The process of recognition of the voice interactor includes: The voice interactor receives the voice feedback of the characters of the visual acuity chart by the examinee; The voice interactor compares the feedback voice with the opening direction of the pre-stored characters; When the error rate exceeds the first preset threshold, the characters of the visual acuity chart are automatically moved up one line; When the accuracy rate of the feedback voice reaches the second preset threshold, the visual acuity result of the examinee is recorded; When the error rate exceeds the first preset threshold, the visual acuity chart starts to let the examinee read the characters of the previous line; if the error rate still exceeds the first preset threshold, the moving up continues until the top line of the visual acuity chart is reached; when the accuracy rate reaches the second preset threshold, the line where the characters are located is the visual acuity value of the examinee, and the visual acuity value is displayed.
6. The smart glasses interaction system of claim 5, wherein, The player is provided with a sound sensor and an audio current adjusting module; the sound sensor is connected with the audio current adjusting module.
7. The smart glasses interaction system of claim 5, wherein, The projector is provided with a light compensation module, a light sensor and a filter; The light compensation module is connected with the light sensor and the filter.
Citation Information
Patent Citations
Vision examining device
CN106343944A
A download server for vision testing methods, vision testing instruments, and programs storing the vision testing methods.
CN108882843B
Intelligent visual chart
CN119073894A
KR20240113869A