Intelligent glasses
By integrating image acquisition, control and prompt modules in smart glasses, the convenience of disabled people in environmental perception is solved, and precise environmental information transmission and assistance to visually impaired users are realized.
Patent Information
- Application Number
- CN202510749958.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-06-06
- Publication Date
- 2025-07-04
- Estimated Expiration
- 2045-06-06
AI Technical Summary
Existing smart glasses are insufficient in assisting people with disabilities in their lives, especially in terms of spatial perception and environmental information transmission.
A smart glasses are designed, including an image acquisition module, a control module and a prompt module. The environment information is obtained through the image acquisition module. The control module determines the target unit based on the requirements instructions and image information, and provides relative position and parameter information through the prompt module.
It improves the convenience of using smart glasses for people with disabilities, and helps visually impaired users to better understand their surroundings through precise spatial perception and environmental information transmission.
Smart Images

Figure CN120255162A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the technical field of smart wearable devices, and particularly to a smart glasses. Background Art
[0002] Smart glasses, currently a popular smart wearable device, provide a great deal of convenience in users' life, work, and entertainment. However, in terms of assisting the life of disabled people, the adaptation of smart glasses is still lacking. Summary of the Invention
[0003] The main purpose of this application is to provide a smart glasses, aiming to realize the life assistance of smart glasses for disabled people, thereby helping to improve the convenience of disabled people using smart glasses.
[0004] To achieve the above object, this application provides a smart glasses, including: A glasses body; An image acquisition module, disposed on the glasses body, the image acquisition module is used to acquire images of the environment around the glasses body and output corresponding image information; A control module, disposed inside the glasses body, the control module is electrically connected to the image acquisition module; A prompt module, disposed on the glasses body, the prompt module is electrically connected to the control module; Wherein, the control module is used to determine a target unit corresponding to the demand instruction in the environment around the glasses body based on the demand instruction and the image information, and control the prompt module to prompt the user with the relative position information between the target unit and the glasses body and / or the parameter information of the target unit.
[0005] Optionally, the image acquisition module includes: a six-degree-of-freedom camera; The control module is used to generate three-dimensional world information corresponding to the environment around the glasses body based on the image information output by the six-degree-of-freedom camera, and determine the target unit corresponding to the demand instruction in the environment around the glasses body based on the demand instruction and the three-dimensional world information; and, The control module is further used to control the prompt module to prompt the user with the relative position information between the target unit and the glasses body and / or the parameter information of the target unit based on the three-dimensional world information.
[0006] Optionally, the glasses body includes a frame and temple arms respectively disposed on both sides of the frame, and the six-degree-of-freedom camera includes a plurality of binocular cameras, and the plurality of binocular cameras are respectively disposed on the two temple arms of the glasses body; The binocular camera is used to collect image information of the environment around the glasses body and output a first image signal and a second image signal; wherein, the image information includes a plurality of first image signals and a plurality of second image signals.
[0007] Optionally, the control module is configured to determine the depth information of different objects in the environment around the glasses body collected by each binocular camera based on the first image signal and the second image signal output by each binocular camera, generate a three-dimensional model of different objects in the environment around the glasses body collected by each binocular camera according to the depth information, and generate three-dimensional world information corresponding to the environment around the glasses body from the plurality of three-dimensional models; The control module is further configured to determine a target unit corresponding to the requirement instruction in the environment around the glasses body based on the requirement instruction and the three-dimensional world information, and control the prompting module to prompt the user with the relative position information between the target unit and the glasses body and / or the parameter information of the target unit based on the three-dimensional world information.
[0008] Optionally, the control module determines the depth information of different objects in the environment around the glasses body collected by each binocular camera based on the first image signal and the second image signal output by each binocular camera, including: The control module is configured to extract a plurality of feature points in the corresponding images of the two based on the first image signal and the second image signal, and perform one-to-one correspondence matching on the plurality of features in the corresponding images of the two to generate a plurality of matched feature point groups; wherein, each matched feature point group includes a feature point in the image corresponding to the first image signal and a feature point in the image corresponding to the second image signal that are matched with each other. The control module is further configured to determine the position difference between the feature points in the image corresponding to the first image signal and the image corresponding to the second image signal based on the plurality of matched feature point groups, and determine the depth information of different objects in the environment around the glasses body collected by each binocular camera based on the parameters of each binocular camera and the corresponding position difference.
[0009] Optionally, the image acquisition module further includes: an RGB camera, and the RGB camera is electrically connected to the control module; The spectacle frame has a first side close to the user and a second side facing away from the user, and the RGB camera is disposed on the second side of the spectacle frame; The RGB camera is configured to acquire an image of the environment facing the second side of the spectacle frame and output a corresponding third image signal to the control module; wherein, the image information includes the third image signal.
[0010] Optionally, the control module is configured to determine the depth information of different objects in the environment around the glasses body collected by each binocular camera based on the first image signal and the second image signal output by each binocular camera, generate a three-dimensional model of different objects in the environment around the glasses body collected by each binocular camera according to the depth information, and generate three-dimensional world information corresponding to the environment around the glasses body from the multiple three-dimensional models; The control module is further configured to determine a target unit corresponding to the requirement instruction in the environment around the glasses body based on the requirement instruction and the three-dimensional world information, and control the prompting module to prompt the user with the relative position information between the target unit and the glasses body and / or the parameter information of the target unit based on the third image signal.
[0011] Optionally, when the control module determines that the target unit corresponding to the requirement instruction is not within the shooting range of the RGB camera based on the requirement instruction and the three-dimensional world information, the control module determines the relative position information between the target unit and the glasses body based on the three-dimensional world information and controls the prompting module to prompt the user.
[0012] Optionally, the smart glasses further include: A voice recognition module, disposed on the glasses body, electrically connected to the control module; the voice recognition module is configured to recognize voice information issued by the user and output the corresponding requirement instruction to the control module.
[0013] Optionally, the prompting module includes a voice prompting module; the control module is configured to control the voice prompting module to emit a prompting audio to prompt the user with the relative position information between the target unit and the glasses body and / or the parameter information of the target unit.
[0014] This application discloses a smart glasses, including: a glasses body, an image acquisition module, a control module, and a prompting module; the image acquisition module is configured to acquire an image of the environment around the glasses body and output corresponding image information; the control module is configured to determine a target unit corresponding to the requirement instruction in the environment around the glasses body based on the requirement instruction and the image information, and control the prompting module to prompt the user with the relative position information between the target unit and the glasses body and / or the parameter information of the target unit. In this way, in practical applications, the smart glasses of this application can transmit useful information in the space to the visually impaired user based on the actual needs of the visually impaired user to assist their perception of the surrounding environment, thereby effectively improving the convenience of the disabled using the smart glasses. Description of the Drawings
[0015] To more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the accompanying drawings required in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on the structures shown in these drawings.
[0016] Figure 1 Schematic diagram of the circuit module of an embodiment of the smart glasses of the present application; Figure 2 Schematic diagram of the circuit module of another embodiment of the smart glasses of the present application; Figure 3 Schematic diagram of the circuit module of yet another embodiment of the smart glasses of the present application; Figure 4 Schematic diagram of the circuit module of still another embodiment of the smart glasses of the present application; Figure 5 Schematic diagram of the structural module of an embodiment of the smart glasses of the present application; Figure 6 Schematic diagram of the structural module of another embodiment of the smart glasses of the present application; Figure 7 Schematic diagram of a chair in the environment being in the front right of the visually impaired user; Figure 8 Schematic diagram of a chair in the environment being in the rear right of the visually impaired user.
[0017] Explanation of the reference numerals in the drawings:
[0018] The realization of the purpose of the present application, functional features and advantages will be further described with reference to the embodiments and the accompanying drawings. Detailed implementation manners
[0019] The following will clearly and completely describe the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only some embodiments of the present application, rather than all embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present application without creative efforts fall within the scope of protection of the present application.
[0020] It should be noted that if there are directional indications (such as up, down, left, right, front, back...) involved in the embodiments of the present application, the directional indications are only used to explain the relative positional relationship and movement conditions between components in a specific posture. If the specific posture changes, the directional indications will also change accordingly.
[0021] In addition, if descriptions such as "first" and "second" are involved in the embodiments of the present application, the descriptions of "first", "second", etc. are only for descriptive purposes and should not be construed as indicating or implying their relative importance or implicitly specifying the quantity of the indicated technical features. Thus, features defined with "first" and "second" may explicitly or implicitly include at least one such feature. In addition, if "and / or" or "and / or" appears throughout the text, its meaning includes three parallel scenarios. Taking "A and / or B" as an example, it includes scenario A, or scenario B, or the scenario where both A and B are satisfied simultaneously. In addition, the technical solutions between various embodiments can be combined with each other, but it must be based on what can be achieved by those of ordinary skill in the art. When the combination of technical solutions is contradictory or cannot be achieved, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection required by this application.
[0022] As a currently popular intelligent wearable device, smart glasses provide a great deal of convenience in users' lives, work, and entertainment. However, in terms of assisting the lives of disabled people, the adaptation of smart glasses is still lacking.
[0023] For this reason, referring to Figure 1 、 Figure 5 and Figure 6 , this application proposes a pair of smart glasses, including: A glasses main body 00; An image acquisition module 10, disposed on the glasses main body 00, and the image acquisition module 10 is used to acquire images of the environment around the glasses main body 00 and output corresponding image information; A control module 20, disposed inside the glasses main body 00, and the control module 20 is electrically connected to the image acquisition module 10; A prompt module 30, disposed on the glasses main body 00, and the prompt module 30 is electrically connected to the control module 20; Wherein, the control module 20 is used to determine a target unit corresponding to the demand instruction in the environment around the glasses main body 00 based on the demand instruction and the image information, and control the prompt module 30 to prompt the user with the relative position information between the target unit and the glasses main body 00 and / or the parameter information of the target unit.
[0024] In this embodiment, optionally, in one embodiment, the demand instruction can be triggered by the user through an external terminal, so that the external terminal outputs the demand instruction to the control module 20 of the smart glasses through the communication module. For example, the control module 20 in the smart glasses is communicatively connected to a mobile phone through the communication module. A visually impaired person operates the APP corresponding to the smart glasses on the mobile phone based on the visual impairment assistance function of the mobile phone to output the current demand instruction and cause the external terminal to output it to the control module 20 through the communication module of the smart glasses.
[0025] Optionally, in another embodiment, the smart glasses can also obtain the user's demand instruction through the circuit module thereon. In one embodiment, referring to Figure 4 , the smart glasses further include: a voice recognition module 40, disposed on the glasses body 00, and the voice recognition module 40 is electrically connected to the control module 20; the voice recognition module 40 is configured to recognize the voice information issued by the user and output the corresponding demand instruction to the control module 20. In this embodiment, the voice recognition module 40 includes a voice collection unit and a voice recognition chip to implement. The voice collection unit can be implemented by a microphone. After the microphone obtains the user's voice, the voice recognition chip will determine the corresponding demand instruction based on the user's voice information. For example, if a visually impaired user wearing the smart glasses of the present application says "I want to sit down and rest for a while", then the voice recognition module 40 will collect the above voice of the user and determine that the current corresponding target unit is a chair based on a preset voice recognition algorithm or a voice recognition model, and then generate a demand instruction representing "chair" to the control module 20. At the same time, it can be understood that the smart glasses may only include a voice collection unit, and the control module 20 obtains the user's voice information through the voice collection unit and then parses and generates the corresponding demand instruction. In another embodiment, for visually impaired users, not all visually impaired users are completely blind. Some visually impaired users may have ophthalmic diseases such as high myopia, cataract, and glaucoma. Sometimes they can partially recognize the targets in front of them. Therefore, the control module 20 can also generate a demand instruction corresponding to the "gazed target" based on the target gazed by the current visually impaired user. For example, the control module 20 determines the unit gazed by the user based on the image in front of the visually impaired user obtained by the camera module disposed on the glasses body 00, and generates a demand instruction corresponding to the "gazed target".
[0026] Optionally, in another embodiment, the demand instruction can also be generated by the control module 20 itself. For example, the control module 20 will generate a demand instruction corresponding to the safety requirement based on a preset safety control logic. During the process of the visually impaired user wearing the smart glasses, the control module 20 will determine the target unit related to the safety requirement in the environment around the glasses body 00 based on the autonomously generated above demand instruction and the image information, such as traffic lights, blind paths, steps, etc., and prompt the user through the prompt module 30 in a timely manner.
[0027] Optionally, in one embodiment, the prompting module 30 may be implemented by a voice prompting module 30. The control module 20 is used to control the voice prompting module 30 to emit a prompting audio to prompt the user with the relative position information between the target unit and the glasses body 00 and / or the parameter information of the target unit. Among them, the voice prompting module 30 may be implemented by a combination of a speaker and a power amplifier module or a bone conduction audio module. For example, the control module 20 controls the voice prompting module 30 to play for the visually impaired user: "The target unit, the chair, is 10m in front of your right, and this chair is a seat without a backrest", so as to prompt the visually impaired user with the relative position information between the target unit and the glasses body 00 and / or the parameter information of the target unit. Optionally, in another embodiment, the prompting module 30 may also be implemented by a vibration module. For example, when the control module 20 determines that the target unit poses a safety threat to the visually impaired user, such as when crossing a zebra crossing, and the control module 20 judges based on the countdown time of the green light of the zebra crossing that the oncoming car will pose a safety threat to the user crossing the zebra crossing, then it will control the vibration module to vibrate in time to remind the user to stop the action.
[0028] Optionally, in one embodiment, the image acquisition module 10 may be implemented by a camera module, such as a six-degree-of-freedom camera 11, a fish-eye camera, a camera array. The control module 20 may generate three-dimensional world information around the glasses body 00 of the corresponding smart glasses based on the image information of the camera module, so as to realize the recognition and distance calculation of the target unit, or the control module 20 determines the image around the glasses body 00 based on the image information, performs image recognition on the image to confirm the target unit, and calculates the target unit information based on the feature points in the image using template matching or the nearest neighbor algorithm, such as the size, category, and distance from the eye body of the target unit.
[0029] Optionally, in another embodiment, the image acquisition module 10 may also be implemented by a scanning module, such as a lidar, a MEMS micromirror scanning module, etc. The control module 20 may, based on the scanning result (image information) fed back by the scanning module, use algorithms such as point cloud algorithms and time-of-flight algorithms to realize the recognition of units around the glasses body 00, determine the target unit, and obtain the relative position information between the target unit and the glasses body 00 and / or the parameter information of the target unit.
[0030] Optionally, in one embodiment, the control module 20 may be implemented by a controller, such as an MCU, a DSP (Digital Signal Process, digital signal processing chip), an FPGA (Field Programmable Gate Array, programmable logic gate array chip), a PLC, a SOC (System On Chip, system-level chip), etc.
[0031] In this embodiment, when a visually impaired user wears the smart glasses of the present application, the control module 20 will, based on the image information and the demand instruction, determine the target unit corresponding to the demand instruction in the surrounding environment of the glasses main body 00 based on the above process, and then control the prompting module 30 to prompt the visually impaired user, so as to prompt the relative position information between the current target unit and the glasses main body 00 (which can be considered as the visually impaired user when worn by the visually impaired user) and / or the parameter information of the target unit. In an example, referring to Figure 7 , a visually impaired user wears the smart glasses of the present application and walks on the road. Then, the user is a little tired and wants to find a place to rest. At this time, the visually impaired user can speak the voice information of "I want to rest". After the voice recognition process in the above embodiment, the control module 20 will obtain the demand instruction representing "rest area", and then, based on the above image information and the process of the above embodiment, identify the surrounding environment of the user to determine whether there is a target unit corresponding to the "rest area". After identifying that there is a target unit of "chair", the prompting module 30 will be controlled to prompt the visually impaired user with the relative position information between the target unit and the glasses main body 00 and / or the parameter information of the target unit. For example, based on the voice prompt "There is an unoccupied public seat 15 meters in front of your right. This seat has no backrest", the life assistance for the visually impaired is realized.
[0032] The present application discloses a smart glasses, which includes: a glasses main body 00, an image acquisition module 10, a control module 20, and a prompting module 30; the image acquisition module 10 is used to acquire the image of the surrounding environment of the glasses main body 00 and output the corresponding image information; the control module 20 is used to determine the target unit corresponding to the demand instruction in the surrounding environment of the glasses main body 00 based on the demand instruction and the image information, and control the prompting module 30 to prompt the user with the relative position information between the target unit and the glasses main body 00 and / or the parameter information of the target unit. In this way, in practical applications, the smart glasses of the present application can transmit useful information in the space to the visually impaired user based on the actual needs of the visually impaired user, so as to assist their perception of the surrounding environment, thereby effectively improving the convenience of the disabled using the smart glasses.
[0033] Referring to Figure 2 , in an embodiment of the present application, the image acquisition module 10 includes: a six-degree-of-freedom camera 11; The control module 20 is used to generate three-dimensional world information corresponding to the surrounding environment of the glasses main body 00 based on the image information output by the six-degree-of-freedom camera 11, and determine the target unit corresponding to the demand instruction in the surrounding environment of the glasses main body 00 based on the demand instruction and the three-dimensional world information; and, The control module 20 is further configured to control the prompting module 30 to prompt the user with the relative position information between the target unit and the glasses main body 00 and / or the parameter information of the target unit based on the three-dimensional world information.
[0034] In this embodiment, the six-degree-of-freedom camera 11 can be implemented by using a plurality of binocular cameras 111, or a plurality of fisheye cameras, or a plurality of camera arrays, etc. The control module 20 can generate three-dimensional world information corresponding to the environment around the glasses main body 00 based on the image information output by the six-degree-of-freedom camera 11.
[0035] In one embodiment, refer to Figure 2 and Figure 6, the glasses body 00 includes a frame 01 and temple arms 02 respectively disposed on both sides of the frame 01. The six-degree-of-freedom camera 11 includes a plurality of binocular cameras 111, and the plurality of binocular cameras 111 are respectively disposed on the two temple arms 02 of the glasses body 00; the binocular camera 111 is configured to collect image information of the surrounding environment of the glasses body 00 and output a first image signal and a second image signal; wherein, the image information includes a plurality of first image signals and a plurality of second image signals. In this embodiment, the control module 20 will determine the depth information of different objects in the surrounding environment of the glasses body 00 collected by each binocular camera 111 based on the first image signal and the second image signal output by each binocular camera 111. For example, the control module 20 extracts a plurality of feature points in the corresponding images of the two based on the first image signal and the second image signal, and performs one-to-one correspondence matching on the plurality of features in the corresponding images of the two to generate a plurality of matching feature point groups. Among them, the matching feature point group includes a set of feature points in the image corresponding to the first image signal and a set of feature points in the image corresponding to the second image signal that are matched with each other. For example, through a matching algorithm, such as the SIFT algorithm, the SURF algorithm, the ORB algorithm, or the deep learning fusion algorithm, etc., to realize the matching of two feature points in two images to form a matching feature point group. Then, the control module 20 determines the position difference between the feature points in the image corresponding to the first image signal and the image corresponding to the second image signal based on the plurality of matching feature point groups. Then, the control module 20 determines the depth information of different objects in the surrounding environment of the glasses body 00 collected by each binocular camera 111 based on the parameters of each binocular camera 111 and its corresponding position difference. For example, in combination with the parameters of the binocular camera 111 (such as focal length, baseline distance, etc.), using the principle of triangulation or other depth calculation methods, the depth information of the object is inferred based on the position difference. Finally, the control module 20 generates three-dimensional models of different objects in the surrounding environment of the glasses body 00 collected by each binocular camera 111, and generates three-dimensional world information corresponding to the surrounding environment of the glasses body 00 from the plurality of three-dimensional models. In this way, the control module 20 can determine the target unit corresponding to the demand instruction in the surrounding environment of the glasses body 00 based on the demand instruction and the three-dimensional world information, and control the prompt module 30 to prompt the user of the relative position information between the target unit and the glasses body 00 and / or the parameter information of the target unit based on the three-dimensional world information.
[0036] Through the above settings, the control module 20 can realize the three-dimensional modeling of the environment around the visually impaired user through the image information output by the image acquisition module 10, and identify the units around the visually impaired user through the three-dimensional modeling, and can more accurately identify the planes, edges and obstacles in the spatial layout, so as to better assist the visually impaired user to perceive the environment.
[0037] It should be understood that, based on the above embodiments of the multiple binocular cameras 111, although the three-dimensional construction of the surrounding environment of the user wearing the smart glasses can already be achieved, and the corresponding target units can be obtained therein, and the relative position between the target unit and itself and the relevant parameters of the target features can be determined, there is still room for improvement in its accuracy. For this reason, referring to Figure 3 and Figure 5 , in an embodiment of the present application, the image acquisition module 10 further includes: an RGB camera 12, and the RGB camera 12 is electrically connected to the control module 20; The spectacle frame 01 has a first side close to the user and a second side facing away from the user, and the RGB camera 12 is disposed on the second side of the spectacle frame 01; The RGB camera 12 is configured to acquire an image of the environment facing the second side of the spectacle frame 01 and output a corresponding third image signal to the control module 20; wherein, the image information includes the third image signal.
[0038] In this embodiment, it can be understood that the image acquired by the RGB camera 12 has a relatively high resolution and a large FOV (Field of View). Therefore, the RGB camera 12 placed on the second side of the spectacle frame 01 can capture the image directly in front of the visually impaired user during use.
[0039] Optionally, in an embodiment, the control module 20 can jointly construct three-dimensional world information corresponding to the circumferential environment of the glasses main body 00 based on the third image signal output by the RGB camera 12 and the first image signal and the second image signal given by the above multiple binocular cameras 111, so as to improve the image accuracy of the environment directly in front of the wearing user in the constructed three-dimensional world.
[0040] Optionally, in another embodiment, based on the above embodiment in which the control module 20 generates three-dimensional world information corresponding to the surrounding environment of the glasses body 00 according to the first image signal and the second image signal output by each binocular camera 111. The control module 20 is further configured to determine, based on the demand instruction and the three-dimensional world information, a target unit corresponding to the demand instruction in the surrounding environment of the glasses body 00, and control the prompting module 30 to prompt the user with the relative position information between the target unit and the glasses body 00 and / or the parameter information of the target unit based on the third image signal. In this embodiment, when the control module 20 identifies the target unit required by the user around the user based on the demand instruction and the three-dimensional world information, it will further identify and remind the user of the relative position information between the target unit and the glasses body 00 and / or the parameter information of the target unit based on the third image signal given by the RGB camera 12, thereby further improving the accuracy of the intelligent glasses in identifying information related to the target unit, and thus playing a better assisting role for visually impaired persons.
[0041] Furthermore, it can be understood that from the above content, for visually impaired persons, their main image recognition needs are mainly for image recognition directly in front. Therefore, the RGB camera 12 with a higher resolution is arranged on the second side of the spectacle frame 01. However, if the current target unit is not within the shooting range of the RGB camera 12, the control module 20 cannot identify the relevant information of the target unit based on the third image signal output by the RGB camera 12. For example, refer to Figure 8 as shown, where the target unit is at the right rear of the user. For this reason, in one embodiment, the control module 20 is further configured to, when determining that the target unit corresponding to the demand instruction is not within the shooting range of the RGB camera 12 based on the demand instruction and the three-dimensional world information, determine the relative position information between the target unit and the glasses body 00 based on the three-dimensional world information and control the prompting module 30 to prompt the user. In this embodiment, when the control module 20 determines, based on the third image signal, that the current target unit is not within the shooting range of the RGB camera 12, that is, it cannot identify the corresponding target unit based on the third image signal; or when determining, based on the three-dimensional world information, that the current target unit is not in front of the visually impaired user wearing the glasses, it will determine the relative position information between the target unit and the glasses body 00 based on the three-dimensional world information and control the prompting module 30 to prompt the user. For example, refer to Figure 8, when the current target unit is a chair and the control module 20 recognizes, based on the three-dimensional world information, that the chair is behind the user's right rear, it will control the prompting module 30 of the voice prompting module 30 to send out the voice message "The chair is behind your right rear currently", so that the visually impaired user can clearly know that the target unit chair they need is behind their right rear, and then they will turn to face the target unit, so that the control module 20 can recognize the target unit "chair" based on the third image signal output by the RGB camera 12, and obtain more accurate relative position information between the target unit and the glasses main body 00 and / or parameter information of the target unit, and recognize and remind the user.
[0042] The above are only exemplary embodiments of the present application, and do not limit the patent scope of the present application. Any equivalent structural transformation made under the technical concept of the present application by using the content of the specification and drawings of the present application, or any direct / indirect application in other related technical fields, is included in the patent protection scope of the present application.
Claims
1. An intelligent glasses, characterized in that, Comprising: A glasses body; An image acquisition module, disposed on the glasses body, for acquiring an image of the environment around the glasses body and outputting corresponding image information; A control module, disposed inside the glasses body, electrically connected to the image acquisition module; A prompting module, disposed on the glasses body, electrically connected to the control module; Wherein, the control module is used to determine a target unit corresponding to the demand instruction in the environment around the glasses body based on the demand instruction and the image information, and control the prompting module to prompt the user with the relative position information between the target unit and the glasses body and / or the parameter information of the target unit.
2. The smart glasses according to claim 1, characterized in that The image acquisition module includes: a six-degree-of-freedom camera; The control module is used to generate three-dimensional world information corresponding to the environment around the glasses body based on the image information output by the six-degree-of-freedom camera, and determine the target unit corresponding to the demand instruction in the environment around the glasses body based on the demand instruction and the three-dimensional world information; and, The control module is further used to control the prompting module to prompt the user with the relative position information between the target unit and the glasses body and / or the parameter information of the target unit based on the three-dimensional world information.
3. The smart glasses according to claim 2, characterized in that, The glasses body includes a frame and temple arms respectively disposed on both sides of the frame, and the six-degree-of-freedom camera includes a plurality of binocular cameras, and the plurality of binocular cameras are respectively disposed on the two temple arms of the glasses body; The binocular camera is used to acquire image information of the environment around the glasses body and output a first image signal and a second image signal; wherein, the image information includes a plurality of first image signals and a plurality of second image signals.
4. The smart glasses according to claim 3, characterized in that, The control module is used to determine the depth information of different objects in the environment around the glasses body acquired by each binocular camera based on the first image signal and the second image signal output by each binocular camera, generate three-dimensional models of different objects in the environment around the glasses body acquired by each binocular camera according to the depth information, and generate three-dimensional world information corresponding to the environment around the glasses body from the plurality of three-dimensional models; The control module is further used to determine the target unit corresponding to the demand instruction in the environment around the glasses body based on the demand instruction and the three-dimensional world information, and control the prompting module to prompt the user with the relative position information between the target unit and the glasses body and / or the parameter information of the target unit based on the three-dimensional world information.
5. The smart glasses according to claim 4, characterized in that, The control module determines the depth information of different objects in the environment around the glasses body acquired by each binocular camera based on the first image signal and the second image signal output by each binocular camera, including: The control module is configured to extract a plurality of feature points in the images corresponding to the first image signal and the second image signal, and perform one-to-one correspondence matching on the features in the images corresponding to the two, so as to generate a plurality of matched feature point groups; wherein, each matched feature point group includes a set of feature points in the image corresponding to the first image signal and the feature points in the image corresponding to the second image signal that are matched with each other. The control module is further configured to determine the position difference between the feature points in the image corresponding to the first image signal and the image corresponding to the second image signal based on the plurality of matched feature point groups, and determine the depth information of different objects in the environment around the glasses body collected by each binocular camera based on the parameters of each binocular camera and the corresponding position difference.
6. The smart glasses according to claim 3, characterized in that, The image acquisition module further includes: an RGB camera, and the RGB camera is electrically connected to the control module. The spectacle frame has a first side close to the user and a second side facing away from the user, and the RGB camera is disposed on the second side of the spectacle frame. The RGB camera is configured to acquire an image of the environment facing the second side of the spectacle frame and output a corresponding third image signal to the control module; wherein, the image information includes the third image signal.
7. The smart glasses according to claim 6, characterized in that, The control module is configured to determine the depth information of different objects in the environment around the glasses body collected by each binocular camera based on the first image signal and the second image signal output by each binocular camera, generate a three-dimensional model of different objects in the environment around the glasses body collected by each binocular camera according to the depth information, and generate three-dimensional world information corresponding to the environment around the glasses body from the plurality of three-dimensional models. The control module is further configured to determine a target unit corresponding to the requirement instruction in the environment around the glasses body based on the requirement instruction and the three-dimensional world information, and control the prompting module to prompt the user with the relative position information between the target unit and the glasses body and / or the parameter information of the target unit based on the third image signal.
8. The smart glasses according to claim 7, characterized in that, The control module is further configured to, when it is determined that the target unit corresponding to the requirement instruction is not within the shooting range of the RGB camera based on the requirement instruction and the three-dimensional world information, determine the relative position information between the target unit and the glasses body based on the three-dimensional world information and control the prompting module to prompt the user.
9. The smart glasses according to any one of claims 1-8, characterized in that, The smart glasses further include: A voice recognition module, disposed on the glasses body, and the voice recognition module is electrically connected to the control module; the voice recognition module is configured to recognize the voice information issued by the user and output a corresponding requirement instruction to the control module.
10. The smart glasses according to any one of claims 1-8, characterized in that, The prompting module includes a voice prompting module; the control module is configured to control the voice prompting module to issue a prompting audio to prompt the user with the relative position information between the target unit and the glasses body and / or the parameter information of the target unit.
Citation Information
Patent Citations
Foreground information prompt method based on intelligent glasses, and intelligent glasses
CN106372610A
Visually impaired people passage prediction glasses based on RGB-D camera and stereophonic sound
CN106597690A
Visual impaired person stair detecting glasses based on RGB-D camera and stereophonic sound
CN106821693A
Multi-sensor-based vehicle-mounted environment recognition system and omni-directional vision module
CN106878687A
Navigation glasses
CN112494290A