Smart glasses

Abstract

This application discloses a pair of smart glasses, comprising: a glasses body, an image acquisition module, a control module, and a prompt module; the image acquisition module is used to capture images of the environment surrounding the glasses body and output corresponding image information; the control module is used to determine a target unit in the environment surrounding the glasses body corresponding to the demand instruction based on the demand instruction and the image information, and to control the prompt module to prompt the user with the relative position information between the target unit and the glasses body and / or parameter information of the target unit. This application aims to enable smart glasses to assist people with disabilities in their daily lives, thereby helping to improve the convenience of using smart glasses for people with disabilities.

Description

Technical Field

[0001] The present application relates to the technical field of smart wearable devices, and in particular to smart glasses. Background Art

[0002] Smart glasses are currently a popular smart wearable device, providing users with a lot of convenience in life, work, and entertainment. However, they are still lacking in adaptability to assist people with disabilities. Summary of the Invention

[0003] The main purpose of this application is to provide a kind of smart glasses, aiming to realize that smart glasses can assist disabled people in their daily life, thereby helping to improve the convenience of disabled people in using smart glasses.

[0004] To achieve the above objectives, the present application proposes a pair of smart glasses, comprising:

[0005] Glasses body;

[0006] An image acquisition module is provided on the glasses body, and is used to acquire images of the environment around the glasses body and output corresponding image information;

[0007] A control module is provided in the glasses body, and the control module is electrically connected to the image acquisition module;

[0008] a prompt module, disposed on the glasses body, the prompt module being electrically connected to the control module;

[0009] Among them, the control module is used to determine the target unit corresponding to the demand instruction in the environment around the glasses body based on the demand instruction and the image information, and control the prompt module to prompt the user with the relative position information between the target unit and the glasses body and / or the parameter information of the target unit.

[0010] Optionally, the image acquisition module includes: a six-degree-of-freedom camera;

[0011] The control module is configured to generate three-dimensional world information corresponding to the environment around the glasses body based on the image information output by the six-degree-of-freedom camera, and determine a target unit in the environment around the glasses body corresponding to the demand instruction based on the demand instruction and the three-dimensional world information; and

[0012] The control module is further configured to control the prompt module to prompt the user of relative position information between the target unit and the glasses body and / or parameter information of the target unit based on the three-dimensional world information.

[0013] Optionally, the glasses body includes a frame and temples disposed on both sides of the frame, and the six-degree-of-freedom camera includes a plurality of binocular cameras, and the plurality of binocular cameras are respectively disposed on the two temples of the glasses body;

[0014] The binocular camera is used to collect image information of the environment around the glasses body and output a first image signal and a second image signal; wherein the image information includes multiple first image signals and multiple second image signals.

[0015] Optionally, the control module is configured to determine, based on the first image signal and the second image signal output by each of the binocular cameras, depth information of different objects in the environment around the glasses body captured by each of the binocular cameras, generate three-dimensional models of the different objects in the environment around the glasses body captured by each of the binocular cameras according to the depth information, and generate three-dimensional world information corresponding to the environment around the glasses body from the multiple three-dimensional models;

[0016] The control module is further configured to determine a target unit in the environment surrounding the glasses body that corresponds to the demand instruction based on the demand instruction and the three-dimensional world information, and to control the prompt module to prompt the user with relative position information between the target unit and the glasses body and / or parameter information of the target unit based on the three-dimensional world information.

[0017] Optionally, the control module determines, based on the first image signal and the second image signal output by each binocular camera, the depth information of different objects in the surrounding environment of the glasses body collected by each binocular camera, including:

[0018] The control module is configured to extract, based on the first image signal and the second image signal, a plurality of feature points in the images corresponding to the first image signal and the second image signal, and perform one-to-one matching of the plurality of features in the images corresponding to the second image signal to generate a plurality of matching feature point groups; wherein the matching feature point groups include a set of mutually matching feature points in the image corresponding to the first image signal and feature points in the image corresponding to the second image signal;

[0019] The control module is further configured to determine, based on a plurality of matching feature point groups, a position difference between a feature point in an image corresponding to the first image signal and an image corresponding to the second image signal, and to determine, based on parameters of each binocular camera and the corresponding position difference, depth information of different objects in the surrounding environment of the eyeglass body captured by each binocular camera.

[0020] Optionally, the image acquisition module further includes: an RGB camera, wherein the RGB camera is electrically connected to the control module;

[0021] The frame has a first side close to the user and a second side facing away from the user, and the RGB camera is disposed on the second side of the frame;

[0022] The RGB camera is used to acquire an image of the environment toward which the second side of the frame is facing, and output a corresponding third image signal to the control module; wherein the image information includes the third image signal.

[0023] Optionally, the control module is configured to determine, based on the first image signal and the second image signal output by each of the binocular cameras, depth information of different objects in the environment around the glasses body captured by each of the binocular cameras, generate three-dimensional models of the different objects in the environment around the glasses body captured by each of the binocular cameras according to the depth information, and generate three-dimensional world information corresponding to the environment around the glasses body from the multiple three-dimensional models;

[0024] The control module is further used to determine a target unit corresponding to the demand instruction in the environment around the glasses body based on the demand instruction and the three-dimensional world information, and to control the prompt module to prompt the user with the relative position information between the target unit and the glasses body and / or the parameter information of the target unit based on the third image signal.

[0025] Optionally, the control module is further used to determine, based on the demand instruction and the three-dimensional world information, that when a target unit corresponding to the demand instruction is not within the shooting range of the RGB camera, determine the relative position information between the target unit and the glasses body based on the three-dimensional world information and control the prompt module to prompt the user.

[0026] Optionally, the smart glasses further include:

[0027] A voice recognition module is provided on the glasses body and is electrically connected to the control module; the voice recognition module is used to recognize the voice information sent by the user and output the corresponding demand instructions to the control module.

[0028] Optionally, the prompt module includes a voice prompt module; the control module is used to control the voice prompt module to emit a prompt audio to prompt the user of the relative position information between the target unit and the glasses body and / or parameter information of the target unit.

[0029] The present application discloses a pair of smart glasses comprising: a glasses body, an image acquisition module, a control module, and a prompt module; the image acquisition module is used to acquire images of the environment surrounding the glasses body and output corresponding image information; the control module is used to determine the target unit in the environment surrounding the glasses body corresponding to the demand instruction based on the demand instruction and the image information, and control the prompt module to prompt the user with the relative position information between the target unit and the glasses body and / or the parameter information of the target unit. In this way, in actual application, the smart glasses of the present application can transmit useful information in the space to the visually impaired user based on the actual needs of the visually impaired user, so as to assist the user in perceiving the environment in which he is located, thereby effectively improving the convenience for disabled people to use smart glasses. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying any creative work.

[0031] Figure 1 This is a schematic diagram of a circuit module of an embodiment of the smart glasses of the present application;

[0032] Figure 2 This is a schematic diagram of a circuit module of another embodiment of the smart glasses of the present application;

[0033] Figure 3 This is a schematic diagram of a circuit module of another embodiment of the smart glasses of the present application;

[0034] Figure 4 This is a schematic diagram of a circuit module of another embodiment of the smart glasses of the present application;

[0035] Figure 5 This is a schematic diagram of the structural modules of an embodiment of the smart glasses of the present application;

[0036] Figure 6 This is a schematic diagram of the structural modules of another embodiment of the smart glasses of the present application;

[0037] Figure 7 A diagram showing a chair in the environment in front of the right side of the visually impaired user;

[0038] Figure 8 Schematic diagram of the environment where the chair is located to the right rear of the visually impaired user.

[0039] Description of Figure Numbers:

[0040]

[0041] The realization of the objectives, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0042] The following will be combined with the accompanying drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments of this application, all other embodiments obtained by ordinary technicians in this field without making any creative efforts are within the scope of protection of this application.

[0043] It should be noted that if the embodiments of the present application involve directional indications (such as up, down, left, right, front, back, etc.), such directional indications are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture. If the specific posture changes, the directional indication will also change accordingly.

[0044] In addition, if there are descriptions involving "first", "second", etc. in the embodiments of the present application, the descriptions of "first", "second", etc. are only for descriptive purposes and cannot be understood as indicating or suggesting their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features limited to "first" and "second" may explicitly or implicitly include at least one of such features. In addition, if "and / or" or "and / or" appears in the full text, its meaning includes three parallel schemes. Taking "A and / or B" as an example, it includes scheme A, or scheme B, or a scheme in which A and B are satisfied at the same time. In addition, the technical solutions between the various embodiments can be combined with each other, but it must be based on the ability of ordinary technicians in this field to implement it. When the combination of technical solutions is mutually contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0045] Smart glasses are currently a popular smart wearable device, providing users with a lot of convenience in life, work, and entertainment. However, they are still lacking in adaptability to assist people with disabilities.

[0046] For this purpose, refer to Figure 1 、 Figure 5 and Figure 6 , this application proposes a pair of smart glasses, comprising:

[0047] Glasses body 00;

[0048] An image acquisition module 10 is provided on the glasses body 00 and is used to acquire images of the surrounding environment of the glasses body 00 and output corresponding image information;

[0049] A control module 20 is provided in the glasses body 00 and is electrically connected to the image acquisition module 10;

[0050] The prompt module 30 is provided on the glasses body 00 and is electrically connected to the control module 20;

[0051] Among them, the control module 20 is used to determine the target unit corresponding to the demand instruction in the environment around the glasses body 00 based on the demand instruction and the image information, and control the prompt module 30 to prompt the user with the relative position information between the target unit and the glasses body 00 and / or the parameter information of the target unit.

[0052] In this embodiment, optionally, in one embodiment, the demand instruction can be triggered by the user through an external terminal, so that the external terminal outputs the demand instruction to the control module 20 of the smart glasses via the communication module. For example, the control module 20 in the smart glasses is connected to the mobile phone via the communication module. The visually impaired person uses the mobile phone's visual assistance function to operate the corresponding smart glasses app on the mobile phone to output the current demand instruction and cause the external terminal to output the output to the control module 20 via the communication module of the smart glasses.

[0053] Optionally, in another embodiment, the smart glasses can also obtain the user's demand instructions through the circuit module thereon. Figure 4The smart glasses further include: a voice recognition module 40, which is disposed on the glasses body 00 and electrically connected to the control module 20; the voice recognition module 40 is configured to recognize the user's voice information and output the corresponding demand instruction to the control module 20. In this embodiment, the voice recognition module 40 includes a voice acquisition unit and a voice recognition chip. The voice acquisition unit can be implemented using a microphone. After the microphone acquires the user's voice, the voice recognition chip determines the corresponding demand instruction based on the user's voice information. For example, if a visually impaired user wearing the smart glasses of the present application says "I want to sit down and rest for a while", the voice recognition module 40 will acquire the user's voice and, based on a preset voice recognition algorithm or voice recognition model, determine that the current corresponding target unit is a chair. It will then generate a demand instruction representing "chair" to the control module 20. At the same time, it is understandable that the smart glasses can also include only the voice acquisition unit, and the control module 20 will acquire the user's voice information through the voice acquisition unit and then analyze and generate the corresponding demand instruction. In another embodiment, not all visually impaired users are completely blind. Some visually impaired users may suffer from eye diseases such as severe myopia, cataracts, and glaucoma, and may sometimes be able to partially recognize objects in front of them. Therefore, the control module 20 may also generate a corresponding "gaze target" request instruction based on the target currently being gazed at by the visually impaired user. For example, the control module 20 may determine the unit being gazed at by the visually impaired user based on an image captured by a camera module provided on the eyeglass body 00, and generate a corresponding "gaze target" request instruction.

[0054] Optionally, in another embodiment, the demand instructions can also be generated by the control module 20 itself. For example, the control module 20 will generate demand instructions corresponding to safety requirements based on the preset safety control logic. When the visually impaired user wears the smart glasses, the control module 20 will determine the target units related to safety requirements in the surrounding environment of the glasses body 00 based on the image information based on the above-mentioned demand instructions generated autonomously, and promptly prompt the user through the prompt module 30.

[0055] Optionally, in one embodiment, the prompt module 30 can be implemented as a voice prompt module 30, and the control module 20 is configured to control the voice prompt module 30 to emit an audio prompt to inform the user of the relative position information between the target unit and the eyeglass body 00 and / or the parameter information of the target unit. The voice prompt module 30 can be implemented using a combination of a speaker and an amplifier module, or a bone conduction audio module. For example, the control module 20 can control the voice prompt module 30 to play the following message to the visually impaired user: "The target unit chair is 10 meters in front of you to the right. This chair has no backrest." This provides the visually impaired user with the relative position information between the target unit and the eyeglass body 00 and / or the parameter information of the target unit. Optionally, in another embodiment, the prompt module 30 can also be implemented as a vibration module. For example, if the control module 20 determines that the target unit poses a safety threat to the visually impaired user, such as when crossing a zebra crossing, the control module 20, based on the countdown to the green light on the zebra crossing, determines that a car about to pass poses a safety threat to the user, then controls the vibration module to vibrate in time to remind the user to stop.

[0056] Optionally, in one embodiment, the image acquisition module 10 can be implemented using a camera module, such as a six-degree-of-freedom camera 11, a fisheye camera, or a camera array. The control module 20 can generate three-dimensional world information around the glasses body 00 of the corresponding smart glasses based on the image information of the camera module, thereby realizing the recognition of the target unit and distance calculation, or the control module 20 can obtain an image around the glasses body 00 based on the image information, and perform image recognition on the image to confirm the target unit, and calculate the target unit information based on the feature points in the image, based on template matching or the nearest neighbor algorithm, such as the size, category, and distance from the eye body of the target unit.

[0057] Alternatively, in another embodiment, the image acquisition module 10 may be implemented using a scanning module, such as a laser radar, a MEMS micromirror scanning module, etc. The control module 20 may identify units around the eyeglass body 00 based on the scanning results (image information) fed back by the scanning module through a point cloud algorithm, a time-of-flight algorithm, etc., to determine the target unit and obtain relative position information between the target unit and the eyeglass body 00 and / or parameter information of the target unit.

[0058] Optionally, in one embodiment, the control module 20 can be implemented by a controller, such as an MCU, a DSP (Digital Signal Process), an FPGA (Field Programmable Gate Array), a PLC, a SOC (System On Chip), etc.

[0059] In this embodiment, when a visually impaired user wears the smart glasses of the present application, the control module 20 determines the target unit corresponding to the demand instruction in the environment around the glasses body 00 based on the image information and the demand instruction, and then controls the prompt module 30 to prompt the visually impaired user to prompt the user with the relative position information between the current target unit and the glasses body 00 (which can be considered as a visually impaired user when wearing the glasses) and / or the parameter information of the target unit. In one example, refer to Figure 7 A visually impaired user is walking on the road wearing the smart glasses of the present application, and then feels a little tired and wants to find a place to rest. At this time, the visually impaired user can say the voice message "I want to rest". After the voice recognition process in the above embodiment, the control module 20 will obtain the demand instruction representing the "rest area", and then identify the environment around the user based on the above image information and the process of the above embodiment to determine whether there is a target unit corresponding to the "rest area". After identifying that there is a "chair" target unit, the prompt module 30 will prompt the visually impaired user with the relative position information between the target unit and the glasses body 00 and / or the parameter information of the target unit, such as based on the voice prompt "There is a public seat with no one sitting 15 meters in front of you to the right. The seat is a backless seat", thereby realizing life assistance for the visually impaired.

[0060] The present application discloses a pair of smart glasses comprising: a glasses body 00, an image acquisition module 10, a control module 20 and a prompt module 30; the image acquisition module 10 is used to acquire images of the environment surrounding the glasses body 00 and output corresponding image information; the control module 20 is used to determine, based on a demand instruction and the image information, a target unit in the environment surrounding the glasses body 00 corresponding to the demand instruction, and control the prompt module 30 to prompt the user with the relative position information between the target unit and the glasses body 00 and / or parameter information of the target unit. In this way, in actual application, the smart glasses of the present application can transmit useful information in space to visually impaired users based on their actual needs, so as to assist them in perceiving their surroundings, thereby effectively improving the convenience for disabled people to use smart glasses.

[0061] refer to Figure 2 ,In one embodiment of the present application, the image acquisition module 10 includes: a six-degree-of-freedom camera 11;

[0062] The control module 20 is configured to generate three-dimensional world information corresponding to the surrounding environment of the eyeglass body 00 based on the image information output by the six-degree-of-freedom camera 11, and to determine a target unit in the surrounding environment of the eyeglass body 00 corresponding to the demand instruction based on the demand instruction and the three-dimensional world information; and

[0063] The control module 20 is further configured to control the prompt module 30 to prompt the user, based on the three-dimensional world information, the relative position information between the target unit and the glasses body 00 and / or parameter information of the target unit.

[0064] In this embodiment, the six-degree-of-freedom camera 11 can be implemented using multiple binocular cameras 111, multiple fisheye cameras, or multiple camera arrays. The control module 20 can generate three-dimensional world information corresponding to the surrounding environment of the eyeglass body 00 based on the image information output by the six-degree-of-freedom camera 11.

[0065] In one embodiment, reference Figure 2 and Figure 6The eyeglass body 00 includes a frame 01 and temples 02 disposed on either side of the frame 01. The six-degree-of-freedom camera 11 includes multiple binocular cameras 111, each disposed on one of the temples 02 of the eyeglass body 00. The binocular cameras 111 are configured to capture image information of the surrounding environment of the eyeglass body 00 and output a first image signal and a second image signal. The image information includes multiple first image signals and multiple second image signals. In this embodiment, the control module 20 determines depth information of different objects in the surrounding environment of the eyeglass body 00 captured by each binocular camera 111 based on the first image signal and the second image signal output by each binocular camera 111. For example, the control module 20 extracts multiple feature points from the corresponding images of the first image signal and the second image signal, and performs one-to-one matching on the multiple features in the corresponding images to generate multiple matching feature point groups. The matching feature point groups include a set of matching feature points in the image corresponding to the first image signal and the image corresponding to the second image signal. For example, a matching algorithm, such as the SIFT algorithm, SURF algorithm, ORB algorithm, or deep learning fusion algorithm, is used to match two feature points in the two images to form a matched feature point group. Then, based on the multiple matched feature point groups, the control module 20 determines the position difference between the feature points in the image corresponding to the first image signal and the image corresponding to the second image signal. The control module 20 then determines depth information for different objects in the environment surrounding the eyeglass body 00 captured by each binocular camera 111 based on the parameters of each binocular camera 111 and the corresponding position difference. For example, by combining the parameters of the binocular camera 111 (such as focal length, baseline distance, etc.), triangulation principles or other depth calculation methods are used to infer the depth information of the objects based on the position difference. Finally, the control module 20 generates three-dimensional models of the different objects in the environment surrounding the eyeglass body 00 captured by each binocular camera 111 based on the depth information, and combines the multiple three-dimensional models to generate three-dimensional world information corresponding to the environment surrounding the eyeglass body 00. In this way, the control module 20 can determine the target unit corresponding to the demand instruction in the surrounding environment of the glasses body 00 based on the demand instruction and the three-dimensional world information, and control the prompt module 30 based on the three-dimensional world information to prompt the user of the relative position information between the target unit and the glasses body 00 and / or the parameter information of the target unit.

[0066] Through the above settings, the control module 20 can realize three-dimensional modeling of the environment around the visually impaired user through the image information output by the image acquisition module 10, and identify the units around the visually impaired user through three-dimensional modeling, so as to more accurately identify the planes, edges and obstacles in the spatial layout, thereby better assisting the visually impaired user to perceive the environment.

[0067] It should be understood that, based on the embodiment of the above-mentioned multiple binocular cameras 111, although it is possible to realize the three-dimensional construction of the surrounding environment of the user wearing smart glasses, obtain the corresponding target unit therein, and determine the relative position of the target unit and itself and the relevant parameters of the target characteristics, its accuracy still has room for improvement. Figure 3 and Figure 5 In one embodiment of the present application, the image acquisition module 10 further includes: an RGB camera 12, the RGB camera 12 being electrically connected to the control module 20;

[0068] The frame 01 has a first side close to the user and a second side facing away from the user, and the RGB camera 12 is disposed on the second side of the frame 01;

[0069] The RGB camera 12 is used to acquire an image of the environment toward which the second side of the frame 01 is facing, and output a corresponding third image signal to the control module 20 ; wherein the image information includes the third image signal.

[0070] In this embodiment, it is understood that the images captured by the RGB camera 12 have a high resolution and a large field of view (FOV). Therefore, the RGB camera 12, placed on the second side of the frame 01, can capture images directly in front of the visually impaired user during use.

[0071] Optionally, in one embodiment, the control module 20 can jointly construct three-dimensional world information corresponding to the surrounding environment of the glasses body 00 based on the third image signal output by the RGB camera 12 and the first image signal and the second image signal provided by the above-mentioned multiple binocular cameras 111, thereby improving the image accuracy of the environment directly in front of the wearer in the constructed three-dimensional world.

[0072] Optionally, in another embodiment, the control module 20 generates three-dimensional world information corresponding to the surrounding environment of the eyeglass body 00 based on the first and second image signals output by each of the binocular cameras 111. The control module 20 is further configured to determine a target unit in the surrounding environment of the eyeglass body 00 corresponding to the request instruction and the three-dimensional world information, and control the prompt module 30 to prompt the user with the relative position information between the target unit and the eyeglass body 00 and / or the parameter information of the target unit based on the third image signal. In this embodiment, after the control module 20 identifies the target unit desired by the user in the surrounding environment based on the request instruction and the three-dimensional world information, it further identifies the relative position information between the target unit and the eyeglass body 00 and / or the parameter information of the target unit based on the third image signal provided by the RGB camera 12 and prompts the user, thereby further improving the accuracy of the smart glasses in identifying relevant information about the target unit, thereby providing better assistance to the visually impaired.

[0073] Furthermore, it is understandable that, as can be seen from the above, for visually impaired people, their main image recognition needs are mainly image recognition facing the front, so the RGB camera 12 with a higher resolution is set on the second side of the frame 01. However, if the current target unit is not within the shooting range of the RGB camera 12, the control module 20 cannot recognize the relevant information of the target unit based on the third image signal output by the RGB camera 12. For example, Figure 8 As shown, the target unit is behind the right of the user. To this end, in one embodiment, the control module 20 is further used to determine, based on the demand instruction and the three-dimensional world information, that when the target unit corresponding to the demand instruction is not within the shooting range of the RGB camera 12, determine the relative position information between the target unit and the glasses body 00 based on the three-dimensional world information and control the prompt module 30 to prompt the user. In this embodiment, the control module 20, when it is determined based on the third image signal that the current target unit is not within the shooting range of the RGB camera 12, that is, based on the third image signal, the corresponding target unit cannot be identified therein; or, when it is determined based on the three-dimensional world information that the current target unit is not in front of the visually impaired user wearing glasses, it will determine the relative position information between the target unit and the glasses body 00 based on the three-dimensional world information and control the prompt module 30 to prompt the user. For example, refer to Figure 8, the current target unit is a chair. When the control module 20 recognizes that the chair is behind the right of the user based on the three-dimensional world information, it will control the voice prompt module 30 to issue a voice message "The chair is behind your right now" to make the visually impaired user clearly know that the target unit chair he needs is behind his right, and then turn to face the target unit, so that the control module 20 can recognize the target unit "chair" based on the third image signal output by the RGB camera 12, and obtain more accurate relative position information between the target unit and the glasses body 00 and / or recognition of parameter information of the target unit and remind the user.

[0074] The above description is merely an exemplary embodiment of the present application and does not limit the patent scope of the present application. Any equivalent structural transformation made using the contents of the present application specification and drawings under the technical concept of the present application, or directly / indirectly applied in other related technical fields, is included in the patent protection scope of the present application.

Claims

1. A pair of smart glasses, characterized in that: include: The glasses body comprises a frame and temples provided on both sides of the frame, wherein the frame has a first side close to the user and a second side facing away from the user; An image acquisition module is provided on the glasses body, the image acquisition module is used to acquire images of the environment around the glasses body and output corresponding image information; wherein the image acquisition module includes: a six-degree-of-freedom camera and an RGB camera, the six-degree-of-freedom camera includes a plurality of binocular cameras respectively provided on the two temples of the glasses body; the RGB camera is provided on the second side of the frame and is used to acquire images of the environment facing the second side of the frame; A control module is provided in the glasses body, and the control module is electrically connected to the image acquisition module; a prompt module, disposed on the glasses body, the prompt module being electrically connected to the control module; The control module is configured to generate three-dimensional world information corresponding to the environment around the glasses body and determine a target unit in the environment around the glasses body corresponding to the demand instruction based on the demand instruction and image information of the environment around the glasses body collected by the multiple binocular cameras; The control module is further configured to, based on the demand instruction and the three-dimensional world information, determine, when a target unit corresponding to the demand instruction is not within the shooting range of the RGB camera, determine, based on the three-dimensional world information, relative position information between the target unit and the glasses body and control the prompt module to prompt a user; and, when the target unit is within the shooting range of the RGB camera, control the prompt module to prompt the user with the relative position information between the target unit and the glasses body and / or parameter information of the target unit based on the image acquired by the RGB camera.

2. The smart glasses according to claim 1, wherein: The control module is further configured to control the prompt module to prompt the user of relative position information between the target unit and the glasses body and / or parameter information of the target unit based on the three-dimensional world information.

3. The smart glasses according to claim 2, wherein: The binocular camera is used to collect image information of the environment around the glasses body and output a first image signal and a second image signal; wherein the image information includes multiple first image signals and multiple second image signals.

4. The smart glasses according to claim 3, wherein: The control module is configured to determine, based on the first image signal and the second image signal output by each of the binocular cameras, depth information of different objects in the environment around the glasses body captured by each of the binocular cameras, generate three-dimensional models of the different objects in the environment around the glasses body captured by each of the binocular cameras based on the depth information, and generate three-dimensional world information corresponding to the environment around the glasses body from the multiple three-dimensional models; The control module is further configured to determine a target unit in the environment surrounding the glasses body that corresponds to the demand instruction based on the demand instruction and the three-dimensional world information, and to control the prompt module to prompt the user with relative position information between the target unit and the glasses body and / or parameter information of the target unit based on the three-dimensional world information.

5. The smart glasses according to claim 4, wherein: The control module determines, based on the first image signal and the second image signal output by each of the binocular cameras, the depth information of different objects in the surrounding environment of the glasses body collected by each of the binocular cameras, including: The control module is configured to extract, based on the first image signal and the second image signal, a plurality of feature points in the images corresponding to the first image signal and the second image signal, and perform one-to-one matching of the plurality of features in the images corresponding to the second image signal to generate a plurality of matching feature point groups; wherein the matching feature point groups include a set of mutually matching feature points in the image corresponding to the first image signal and feature points in the image corresponding to the second image signal; The control module is further configured to determine, based on a plurality of matching feature point groups, a position difference between a feature point in an image corresponding to the first image signal and an image corresponding to the second image signal, and to determine, based on parameters of each binocular camera and the corresponding position difference, depth information of different objects in the surrounding environment of the eyeglass body captured by each binocular camera.

6. The smart glasses according to claim 1, wherein: The RGB camera is used to acquire an image of the environment toward which the second side of the frame is facing, and output a corresponding third image signal to the control module; wherein the image information includes the third image signal.

7. The smart glasses according to claim 6, wherein: The control module is configured to determine, based on the first image signal and the second image signal output by each of the binocular cameras, depth information of different objects in the environment around the glasses body captured by each of the binocular cameras, generate three-dimensional models of the different objects in the environment around the glasses body captured by each of the binocular cameras based on the depth information, and generate three-dimensional world information corresponding to the environment around the glasses body from the multiple three-dimensional models; The control module is further used to determine a target unit corresponding to the demand instruction in the environment around the glasses body based on the demand instruction and the three-dimensional world information, and to control the prompt module to prompt the user with the relative position information between the target unit and the glasses body and / or the parameter information of the target unit based on the third image signal.

8. The smart glasses according to any one of claims 1 to 7, wherein: The smart glasses further include: A voice recognition module is provided on the glasses body and is electrically connected to the control module; the voice recognition module is used to recognize the voice information sent by the user and output the corresponding demand instructions to the control module.

9. The smart glasses according to any one of claims 1 to 7, wherein: The prompt module includes a voice prompt module; the control module is used to control the voice prompt module to emit a prompt audio to prompt the user of the relative position information between the target unit and the glasses body and / or parameter information of the target unit.

Images