Multi-mode intelligent glasses for visually impaired people

Abstract

The utility model belongs to the technical field of auxiliary tools for blind people, and provides a pair of multi-mode intelligent glasses for visually impaired people, which comprises a glasses frame, two sides of the glasses frame are respectively connected with a first glasses leg and a second glasses leg, a binocular camera module is arranged at the center of the glasses frame, a headset module is arranged at the joint of the first glasses leg and the glasses frame, and the headset module is connected with the second glasses leg. The glasses frame is further provided with a plurality of electroencephalogram signal collecting modules, and temple artery signal collecting modules are arranged at the ear supporting positions of the first glasses leg and the second glasses leg. The binocular camera module, the headset module, the electroencephalogram signal acquisition module and the temporal artery signal acquisition module are respectively in communication connection with an external main control processing device through a wireless transmission module. In order to solve the problem that a single camera commonly used in the prior art is not ideal in ranging effect, the utility model has a more efficient and accurate ranging function and a more efficient man-machine interaction mode, and also can collect the physiological information of a wearer.

Description

Technical Field

[0001] The utility model relates to the technical field of blind auxiliary tools, and particularly relates to a multi-modal intelligent glasses for visually impaired people. Background Art

[0002] Data from the China National Blindness Council in 2019 showed that there were 17.31 million people with visual disabilities in China, accounting for one-fifth of the total number of visually impaired people in the world, making China the country with the largest number of visually impaired people in the world. Facing such a large group, their travel problems are particularly prominent. At present, visually impaired people mainly rely on three methods to travel: barrier-free facilities, using a cane to explore the way, and being led by a guide dog. Moreover, there are no means of transportation specifically designed for visually impaired people to use on the market, and the surrounding products are also quite scarce. As of 2021, the adaptation rate of disabled aids in China was only 62.9%, far from meeting the growing needs of disabled people. Therefore, auxiliary devices suitable for visually impaired people urgently need to be improved and innovated.

[0003] Currently, most existing intelligent glasses use a single camera. However, due to the limitations of a single camera, the effect of position ranging is often not ideal. For example, a single camera can only capture information from one angle, its ranging range is limited by the camera's focal length and the size of the object, and it cannot obtain depth information through parallax, resulting in relatively limited information provided by a single camera when performing three-dimensional reconstruction or scene understanding. Existing auxiliary devices for visually impaired people are also equipped with many practical functions, but in terms of function switching, the traditional button method is adopted. Due to the perspective problem, such function switching is rather inconvenient, especially for visually impaired people and the elderly who may not be able to accurately find the position of the button. In addition, the position information, physical health, and mental health of visually impaired people all need to be paid attention to in a timely manner. Content of the Utility Model

[0004] The utility model aims to overcome the defects of the above-mentioned prior art, such as the unsatisfactory ranging effect of a single camera, inconvenient function switching, and the inability to collect the physiological information of the wearer, and provides a multi-modal intelligent glasses for visually impaired people.

[0005] To solve the above technical problems, the technical solution of the utility model is as follows:

[0006] A multi-modal intelligent glasses for the visually impaired, including a frame, the frame is respectively connected to the first temple and the second temple, a binocular camera module is provided at the center of the frame, a headset module is provided at the connection of the first temple and the frame, electroencephalogram signal acquisition modules are also provided on both sides and at the center of the frame, temporal artery signal acquisition modules are provided at the ear support positions of the first temple and the second temple, and the binocular camera module, the headset module, the electroencephalogram signal acquisition module and the temporal artery signal acquisition module are respectively communicatively connected to an external main control processing device through a wireless transmission module.

[0007] As a preferred solution, an acquisition electrode and a digital-to-analog conversion module are provided inside the electroencephalogram signal acquisition module (5), and the acquisition electrode is electrically connected to the digital-to-analog conversion module.

[0008] As a preferred solution, a digital-to-analog conversion module and a digital-to-analog conversion module are provided inside the temporal artery signal acquisition module (6), and the acquisition electrode is electrically connected to the digital-to-analog conversion module.

[0009] As a preferred solution, the main control processing device includes a processor and a communication module, the processor is communicatively connected to the wireless transmission module through the communication module, and is also communicatively connected to a cloud server.

[0010] As a preferred solution, the main control processing device is also provided with a positioning module, and the positioning module is communicatively connected to the cloud server through the communication module; it is used to collect the position information of the glasses wearer.

[0011] As a preferred solution, a built-in battery is provided on one side of the frame, and the output terminals of the built-in battery are respectively electrically connected to the binocular camera module, the headset module, the electroencephalogram signal acquisition module, the temporal artery signal acquisition module and the wireless transmission module.

[0012] As a preferred solution, the built-in battery is a rechargeable battery, and the glasses are provided with a magnetic charging module electrically connected to the built-in battery; the built-in battery is charged through the magnetic charging module.

[0013] As a preferred solution, the main control processing device is also provided with an external battery, and the output terminals of the external battery are respectively electrically connected to the processor, the communication module and the positioning module.

[0014] As a preferred solution, the external battery is a rechargeable battery, and a power interface is provided on one side of the external battery.

[0015] As a preferred solution, the glasses are also provided with a magnetic charging cable, and the power interface is connected to the magnetic charging module through the magnetic charging cable.

[0016] Compared with the prior art, the beneficial effects of the technical solution of the present utility model are as follows: By using a binocular camera module to replace the traditional single camera, the distance detection algorithm of the present utility model is more accurate, improving the accuracy of distance measurement of the glasses; at the same time, by replacing the traditional button method with an earphone module, man-machine interaction control through sound is realized, enabling users to operate the device more conveniently. Visually impaired people do not need to search for buttons laboriously and can switch functions through simple voice commands, improving the convenience and efficiency of use. In addition, physiological information of visually impaired people is collected through an electroencephalogram signal acquisition module and a temporal artery signal acquisition module. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It is a schematic structural diagram of a multi-modal intelligent glasses for visually impaired people.

[0018] Figure 2 It is a schematic structural diagram of a main control processing device.

[0019] Figure 3 It is a system architecture diagram of the present utility model.

[0020] Among them, 1 - frame, 101 - first temple, 102 - second temple, 2 - binocular camera module, 3 - wireless transmission module, 4 - earphone module, 5 - electroencephalogram signal acquisition module, 6 - temporal artery signal acquisition module, 7 - built-in battery, 8 - magnetic charging module, 9 - main control processing device, 901 - external battery, 902 - power interface. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0021] The drawings are only for illustrative purposes and should not be construed as limitations on this patent;

[0022] To better illustrate this embodiment, some components in the drawings are omitted, enlarged or reduced, and do not represent the actual size of the product;

[0023] For those skilled in the art, it is understandable that some well-known structures and their descriptions in the drawings may be omitted.

[0024] The technical solution of the present utility model will be further described below with reference to the drawings and embodiments.

[0025] Embodiment 1

[0026] This embodiment provides a multi-modal intelligent glasses for visually impaired people, as Figure 1 shown, it is a schematic structural diagram of the multi-modal intelligent glasses for visually impaired people in this embodiment.

[0027] The multi-modal intelligent glasses for the visually impaired proposed in this embodiment include a frame 1. First temple 101 and second temple 102 are respectively connected to both sides of the frame 1. A binocular camera module 2 is provided at the center of the frame. An earphone module 4 is provided at the connection of the first temple 101 and the frame 1. The frame 1 is also provided with a plurality of electroencephalogram signal acquisition modules 5. Temporal artery signal acquisition modules 6 are provided at the ear supports of the first temple 101 and the second temple 102. The binocular camera module 2, the earphone module 4, the electroencephalogram signal acquisition module 5, and the temporal artery signal acquisition module 6 are respectively communicatively connected to an external main control processing device 9 through a wireless transmission module 3.

[0028] In this embodiment, the earphone module 4 is used to realize the human-computer interaction between the wearer and the glasses. The instructions of the wearer will be received by the earphone module 5 and communicated with the main control processing device 9 through the wireless transmission module 3. After the main control processing device 9 processes the information, the result will be returned to the earphone module 5 to output voice information or realize function switching, so as to realize human-computer interaction by voice. When it is detected that the wearer turns on the binocular ranging function, the binocular camera module 2 will collect information and transmit the information to the main control processing device 9 through the wireless transmission module 3. The main control processing device 9 analyzes and processes the collected information. After the processing is completed, the result will be returned to the wireless transmission module 3 and transmitted to the earphone of the earphone module 5 to play the data processing result in voice form. In addition, the electroencephalogram signal acquisition module 5 is placed on the side of the frame close to the wearer's forehead. The three acquisition electrodes inside the electroencephalogram signal acquisition module 5 located at the center and both sides of the frame can collect the electroencephalogram signals of the triple conductive potential Fp1, Fpz, and Fp2 in the frontal lobe area of the wearer. The temporal artery signal is collected by the temporal artery signal acquisition module provided at the ear support of the temple. The collected electroencephalogram signals are transmitted to the main control processing device 9 through the wireless transmission module 3 and then analyzed.

[0029] It should be noted that relevant processing programs are preset in the main control processing device 9, which are routine settings for those skilled in the art to perform instruction analysis, ranging processing, or physiological information acquisition according to voice signals, binocular images, or body signals. Therefore, it will not be described in detail here.

[0030] In an alternative embodiment, an acquisition electrode and a digital-to-analog conversion module are provided inside the electroencephalogram signal acquisition module 5, and the acquisition electrode is electrically connected to the digital-to-analog conversion module.

[0031] Further, a digital-to-analog conversion module and a digital-to-analog conversion module are provided inside the temporal artery signal acquisition module 6, and the acquisition electrode is electrically connected to the digital-to-analog conversion module.

[0032] As an exemplary illustration, the electroencephalogram (EEG) signal acquisition module 5 is placed on the side of the frame close to the wearer's forehead. The acquisition electrodes inside the EEG signal acquisition module 5, located at the center and both sides of the frame, can collect the EEG signals of the triple conductive potentials Fp1, Fpz, and Fp2 in the frontal lobe area of the wearer.

[0033] In this embodiment, the physiological information of the wearer can be collected through the acquisition electrodes inside the EEG signal acquisition module 5 and the temporal artery signal acquisition module 6. Subsequently, the captured analog signal is converted into a digital signal by the analog-to-digital conversion module, and then the digital signal is transmitted to the wireless transmission module for subsequent processing.

[0034] In this embodiment, the ranging function is realized through a binocular camera; compared with other single-camera smart glasses, the algorithm for distance detection by the binocular camera is more accurate, and it has strong anti-interference ability in the case of large light changes or complex environments; the man-machine interaction is realized through the earphone module, and information consultation or function switching can be carried out according to needs. Compared with the traditional button setting, it enables visually impaired people to achieve man-machine interaction more conveniently; the physiological information of the wearer is collected through the acquisition module. For example, the EEG signal of the user is obtained through the triple conductive potential on the forehead, and the EEG signal is decomposed into five brain characteristic rhythms for analysis, which not only avoids the problem of high energy consumption of multi-potential association conduction, but also avoids the problem of single information of the EEG signal of single-conductive potential. In addition, when the main control processing device 9 realizes the heart rate detection function, the temporal artery signal is obtained through the signal acquisition module at the temporal artery, and the heart rate of the wearer is calculated, providing a key evaluation index for the wearer's physical health. After obtaining the physiological information, the acquired analog signal will be first converted into a digital signal to avoid data loss or noise interference problems in the subsequent transmission process.

[0035] Embodiment 2

[0036] This embodiment makes improvements on the basis of a multi-modal smart glasses for visually impaired people proposed in Embodiment 1.

[0037] The multi-modal smart glasses for visually impaired people proposed in this embodiment include a frame 1. First temple 101 and second temple 102 are respectively connected to both sides of the frame 1. A binocular camera module 2 is provided at the center of the frame. An earphone module 4 is provided at the connection of the first temple 101 and the frame 1. The frame 1 is also provided with a plurality of EEG signal acquisition modules 5. Temporal artery signal acquisition modules 6 are provided at the ear supports of the first temple 101 and the second temple 102. The binocular camera module 2, the earphone module 4, the EEG signal acquisition module 5, and the temporal artery signal acquisition module 6 are respectively in communication connection with an external main control processing device 9 through a wireless transmission module 3.

[0038] In an alternative embodiment, the main control processing device 9 includes a processor and a communication module. The processor is communicatively connected to the wireless transmission module 3 through the communication module and is also communicatively connected to a cloud server.

[0039] Furthermore, the main control processing device 9 is further provided with a positioning module. The positioning module is communicatively connected to the cloud server through the communication module.

[0040] It should be noted that relevant processing programs are preset in the main control processing device 9, which are conventional settings for those skilled in the art to realize the communication between the main control processing device 9 and the cloud server, so no further details will be provided here.

[0041] In this embodiment, the main control processing device 9 realizes diversified data interaction and processing functions. The main control processing device 9 mainly obtains information by receiving various types of data transmitted by the wireless transmission module 3 through the built-in communication module. And the built-in communication module of the main control processing device 9 also supports an efficient communication connection with the cloud server, realizing data upload and download, and also supports remote data processing and storage, expanding the application scope and data processing ability of the device. Through the powerful computing power and big data analysis of the cloud, the user experience can be further enhanced. In addition, the main control processing device 9 is also built with a positioning module, enabling the device to collect the geographical location information of the wearer in real time, providing a basis for location-based services and environmental interaction.

[0042] Embodiment 3

[0043] This embodiment makes improvements on the basis of the multi-modal smart glasses for visually impaired people proposed in Embodiment 1 or 2.

[0044] The multi-modal smart glasses for visually impaired people proposed in this embodiment include a frame 1. The two sides of the frame 1 are respectively connected with a first temple 101 and a second temple 102. A binocular camera module 2 is provided at the center of the frame. An earphone module 4 is provided at the connection of the first temple 101 and the frame 1. The frame 1 is also provided with a plurality of electroencephalogram signal acquisition modules 5. Temporal artery signal acquisition modules 6 are provided at the ear supports of the first temple 101 and the second temple 102. The binocular camera module 2, the earphone module 4, the electroencephalogram signal acquisition modules 5 and the temporal artery signal acquisition modules 6 are respectively communicatively connected to an external main control processing device 9 through a wireless transmission module 3.

[0045] In an alternative embodiment, a built-in battery 7 is provided on one side of the frame 1. The output terminals of the built-in battery are respectively electrically connected to the binocular camera module 2, the earphone module 4, the electroencephalogram signal acquisition modules 5, the temporal artery signal acquisition modules 6 and the wireless transmission module 3.

[0046] The built-in battery 7 is a rechargeable battery, and the glasses are provided with a magnetic charging module 8 electrically connected to the built-in battery 7.

[0047] In this embodiment, a battery 7 is built into one side of the frame 1 to provide power supply for the modules inside the glasses. In addition, the glasses are equipped with a magnetic charging module 8, which is electrically connected to the built-in battery 7. Through this magnetic charging module, it can be magnetically connected to an external power source that supports magnetic charging, thereby charging the built-in battery 7. This design not only improves the convenience of user charging but also enhances the waterproofness of the glasses by replacing the traditional charging socket with a magnetic interface.

[0048] Embodiment 4

[0049] This embodiment is an improvement based on the multi-modal smart glasses for the visually impaired people proposed in any one of Embodiments 1 to 3. As Figure 2 shown, it is a schematic structural diagram of the external main control processing device 9.

[0050] The multi-modal smart glasses for the visually impaired people proposed in this embodiment include a frame 1. First temple 101 and second temple 102 are respectively connected to both sides of the frame 1. A binocular camera module 2 is provided at the center of the frame. An earphone module 4 is provided at the connection of the first temple 101 and the frame 1. The frame 1 is also provided with several electroencephalogram signal acquisition modules 5. Temporal artery signal acquisition modules 6 are provided at the ear support parts of the first temple 101 and the second temple 102. The binocular camera module 2, the earphone module 4, the electroencephalogram signal acquisition module 5 and the temporal artery signal acquisition module 6 are respectively in communication connection with an external main control processing device 9 through a wireless transmission module 3.

[0051] In an optional embodiment, the main control processing device 9 is also provided with an external battery 901, and the output end of the external battery is electrically connected to a processor, a communication module and a positioning module respectively.

[0052] The external battery 901 is a rechargeable battery, and a power interface 902 is provided on one side of the external battery 901.

[0053] The glasses are also provided with a magnetic charging cable, and the power interface 902 is connected to the magnetic charging module 8 through the magnetic charging cable.

[0054] In this embodiment, the main control processing device 9 is configured with an external battery 901, which is directly electrically connected to the processor, communication module, and positioning module through its output terminal, providing power supply for the internal modules. A power interface 902 is designed on one side of the external battery 901, which provides a way for charging the battery. Considering the usage requirements of the smart glasses, the device is also equipped with a magnetic charging cable. The magnetic charging cable is magnetically adsorbed to the power interface 902 and then connected to the magnetic charging module 8. Such a design improves the safety and efficiency of charging, optimizes the user's charging experience, makes the charging process more convenient and rapid, and meets the continuous usage requirements in daily and special situations.

[0055] As Figure 3 shown, it is the system architecture diagram of the present utility model.

[0056] Among them, the smart glasses end is the glasses main body, worn on the user's head to realize the function of data collection. The main control end processes the data received from the smart glasses end and returns the results to the smart glasses end. It can also supply power to the built-in battery in the smart glasses end through the external battery. In addition, the main control end can also perform data interaction with the cloud server.

[0057] The same or similar reference numerals correspond to the same or similar components;

[0058] The terms used to describe the positional relationship in the drawings are only for illustrative purposes and should not be construed as a limitation to this patent;

[0059] Obviously, the above embodiments of the present utility model are merely examples for clearly illustrating the present utility model and are not limitations to the implementation manners of the present utility model. For those of ordinary skill in the art, other different forms of changes or modifications can be made based on the above description. It is not necessary and impossible to enumerate all the implementation manners here. Any modifications, equivalent replacements, and improvements made within the spirit and principle of the present utility model shall be included in the protection scope of the claims of the present utility model.

Claims

1. A multi-modal smart glasses for visually impaired people, including a frame (1), and first and second temple arms (101, 102) are respectively connected to two sides of the frame (1), characterized in that, A binocular camera module (2) is provided at the center of the spectacle frame. An earphone module (4) is provided at the connection of the first temple (101) and the spectacle frame (1). The spectacle frame (1) is further provided with a plurality of electroencephalogram signal acquisition modules (5). Temporal artery signal acquisition modules (6) are provided at the ear support positions of the first temple (101) and the second temple (102). The binocular camera module (2), the earphone module (4), the electroencephalogram signal acquisition module (5), and the temporal artery signal acquisition module (6) are respectively in communication connection with an external main control processing device (9) through a wireless transmission module (3); An acquisition electrode and an analog-to-digital conversion module are arranged inside the electroencephalogram signal acquisition module (5), and the acquisition electrode is electrically connected to the analog-to-digital conversion module; An acquisition electrode and an analog-to-digital conversion module are arranged inside the temporal artery signal acquisition module (6), and the acquisition electrode is electrically connected to the analog-to-digital conversion module; The electroencephalogram signal acquisition module (5) is placed on the side of the spectacle frame close to the wearer's forehead, and the acquisition electrodes are arranged at the center and both sides of the spectacle frame.

2. The multimodal smart glasses for visually impaired people according to claim 1, characterized in that, The main control processing device (9) includes a processor and a communication module. The processor is in communication connection with the wireless transmission module (3) through the communication module, and is also in communication connection with a cloud server.

3. The multi-modal smart glasses for visually impaired people according to claim 2, wherein The main control processing device (9) is further provided with a positioning module, and the positioning module is in communication connection with the cloud server through the communication module.

4. A multi-modal intelligent glasses for visually impaired people according to any one of claims 1 to 3, characterized in that, A built-in battery (7) is provided on one side of the spectacle frame (1), and the output end of the built-in battery is electrically connected to the binocular camera module (2), the earphone module (4), the electroencephalogram signal acquisition module (5), the temporal artery signal acquisition module (6), and the wireless transmission module (3) respectively.

5. The multi-modal smart glasses for the visually impaired according to claim 4, characterized in that, The built-in battery (7) is a rechargeable battery, and the spectacle is provided with a magnetic charging module (8) electrically connected to the built-in battery (7).

6. The multimodal intelligent glasses for visually impaired people according to claim 5, characterized in that, The main control processing device (9) is further provided with an external battery (901), and the output end of the external battery is electrically connected to the processor, the communication module, and the positioning module respectively.

7. The multi-modal intelligent glasses for visually impaired people according to claim 6, characterized in that, The external battery (901) is a rechargeable battery, and the external battery (901) is provided with a power interface (902).

8. The multimodal smart glasses for visually impaired people according to claim 7, characterized in that, The spectacle is further provided with a magnetic charging cable, and the power interface (902) is connected to the magnetic charging module (8) through the magnetic charging cable.

Images