Intelligent blind-assisting glasses system and method capable of realizing stereoscopic perception of environment

Abstract

The invention discloses an intelligent blind-assisting glasses system and method for stereoscopic perception of an environment, relates to the field of voice prompt, and solves the problem of lack of accuracy of voice prompt of existing intelligent blind-assisting glasses, and the system comprises a data acquisition module which carries out the radar scanning of an external environment, and obtains environment data; the model construction module is used for processing the environment data, performing three-dimensional space mapping on the environment data to obtain a mapping value, and performing model construction on an external environment according to the mapping value to obtain an environment model; the intelligent judgment module is used for collecting action information of a user of the intelligent blind-assisting glasses, judging obstacles in combination with an environment model according to the action information of the user and carrying out audio feedback on the user; the voice interaction module is used for autonomously setting audio feedback and obtaining different audio feedback according to a setting result of a user; the voice prompt accuracy of the intelligent blind-helping glasses can be effectively improved, and the travel safety of visually impaired people is guaranteed.

Description

Technical Field

[0001] This invention pertains to intelligent assistive glasses for the blind, and more specifically to the field of voice prompts. Specifically, it relates to an intelligent assistive glasses system and method for three-dimensional environmental perception. Background Technology

[0002] Smart glasses for the blind are key devices to help visually impaired people walk, and they also serve as voice prompt devices to guide visually impaired people in their explorations and ensure the safety of visually impaired people when they go out. Existing smart assistive glasses for the blind have the following specific drawbacks when in use: Existing smart glasses for the blind offer limited functionality, lack customization options to meet individual user needs, and have low applicability to users with different preferences, making them difficult to promote in the market. For example, while smart glasses may alert users to objects within one meter, some visually impaired individuals may not need to receive alerts for all nearby objects, or they may require more detailed descriptions or different prompts for objects in specific scenarios.

[0003] Existing smart glasses for the blind also have shortcomings in terms of the three-dimensionality and accuracy of environmental perception, making it difficult to accurately determine the specific location, size, and shape of obstacles, thus affecting the convenience and safety of use; and making it difficult to guarantee the quality of life and travel safety of visually impaired people.

[0004] To this end, we propose an intelligent assistive glasses system and method for stereoscopic environmental perception. Summary of the Invention

[0005] To address the shortcomings of existing technologies, the purpose of this invention is to provide an intelligent assistive glasses system and method for three-dimensional environmental perception, aiming to improve the matching degree between employers and platform employees.

[0006] To achieve the above objectives, the present invention adopts the following technical solution: a smart assistive glasses system and method for stereoscopic environmental perception, the specific working process of each module is as follows: Data acquisition module: The system uses smart glasses for the blind to perform radar scans of the external environment, records the radar scan data, and obtains environmental data. Model building module: Processes environmental data, maps the environmental data into three-dimensional space with the smart assistive glasses as the origin, obtains the mapping value, and builds a model of the external environment based on the mapping value to obtain the environmental model; Intelligent judgment module: Collects the action information of the user of the smart assistive glasses, judges obstacles based on the user's action information and the environmental model, and provides audio feedback to the user based on the obstacle judgment result; Voice interaction module: Users of smart assistive glasses can customize the audio feedback, and different audio feedback will be obtained based on the user's settings.

[0007] Furthermore, environmental data is acquired, specifically as follows: The system transmits radio waves through smart glasses for the blind, recording the transmission time and angle. When the radio waves touch an object, they are reflected to obtain a reflected wave. The power and reception time of the reflected wave are obtained from the reflected wave. The reflection time difference of the reflected wave is obtained from the reception time and the transmission time of the radio wave. Environmental data is constructed based on the reflection time difference, the transmission angle of the radio wave, and the power of the reflected wave.

[0008] Furthermore, a model of the external environment is constructed, as follows: A three-dimensional coordinate system is constructed with the smart assistive glasses as the origin, with the vertical upward direction as the z-axis, the horizontal forward direction of the glasses as the y-axis, and the direction perpendicular to both the y-axis and z-axis as the x-axis; environmental data is then processed based on this three-dimensional coordinate system. Based on environmental data, the reflection time difference of the reflected wave, the transmission angle of the radio wave, and the power of the reflected wave are obtained. The reflection time difference of the reflected wave is denoted as fsc, the transmission angle of the radio wave is denoted as fsj, and the power of the reflected wave is denoted as fgl. The wave velocity of the reflected wave is obtained and denoted as bsv; the reflection distance of the reflected wave is calculated based on the wave velocity and the reflection time difference of the reflected wave to obtain the reflection distance fjl. By mapping the radio wave transmission angle fsj to the three-dimensional coordinate system, we can obtain the angle fsjx between the radio wave transmission angle and the x-axis, the angle fsjy between the radio wave transmission angle and the y-axis, and the angle fsjz between the radio wave transmission angle and the z-axis. Based on the angle fsjx between the radio wave emission angle and the x-axis and the reflection distance fjl, the distance component of the reflecting object on the x-axis is obtained, denoted as flx; Based on the angle fsjy between the radio wave emission angle and the y-axis and the reflection distance fjl, the distance component of the reflecting object on the y-axis is obtained, denoted as fly; Based on the angle fsjz between the radio wave emission angle and the z-axis and the reflection distance fjl, the distance component of the reflecting object on the z-axis is obtained, denoted as flz; Map the coordinate system based on the distance component.

[0009] Furthermore, the coordinate system is mapped according to the distance components, as follows: Based on the distance components of the reflecting object on the x-axis, y-axis, and z-axis, the mapping value fzb of the reflection point is obtained, where fzb = (flx, fly, flz). The number of radio waves transmitted is obtained; the reflected radio waves of each radio wave are obtained according to the number of radio waves transmitted, and the mapping value of the reflected radio waves to the reflection point is calculated to obtain fzb(1) to fzb(fs); the reflected radio wave power of each reflected radio wave is recorded as fgl(1) to fgl(fs); where: fs represents the number of reflected radio waves; Based on the mapping values ​​fzb(1) to fzb(fs) of the reflection points, the three-dimensional coordinate system is mapped, and each reflection point is represented in the three-dimensional coordinate system according to its mapping value to obtain the mapping point; combined with the reflected wave power fgl(1) to fgl(fs) of each reflected wave, each mapping point is labeled to obtain the labeled value; the mapping point is analyzed through the labeled value.

[0010] Furthermore, the mapping points are analyzed as follows: Extract mapping points with the same labeled value, determine the continuity of the mapping points, extract continuous mapping points, and obtain the spatial model of the object based on the space enclosed by the continuous mapping points. All labeled values ​​and mapping points are processed to obtain spatial models of all objects scanned by the smart assistive glasses. Based on the spatial models of all objects scanned by the smart assistive glasses, an environmental model is constructed.

[0011] Furthermore, obstacle identification is performed using an environmental model, as detailed below: Based on the user's action information, obtain the user's leg lift height, denoted as tgd; obtain the user's stride length, denoted as kcd; obtain the user's minimum standing area, denoted as zxl; Based on the environmental model, the spatial model of the object is obtained. The object is judged by the user's leg lift height, stride length and minimum standing area. If the user can stand on the object or straddle the object, the object is judged as a non-obstacle. If the user cannot pass through the object, it is judged as an obstacle.

[0012] Furthermore, the object is judged as follows: Based on the spatial model of the object, obtain the height of the object; denote the height of the object as wgd; obtain the plane area of ​​the highest point of the object to obtain the object plane wpm; obtain the cross-domain distance kjl of the object based on the length of the object in the y-axis direction. The standing value zlz is obtained by calculating the height of the object, the user's leg lift height, the plane area of ​​the highest point of the object, and the user's minimum standing area. The standing value is used to determine whether a user can pass over an object by standing on top of it. If the standing value is less than 0, it means that the user cannot pass over the object by standing on top of it. The stride value kyz is obtained by calculating the height of the object and the user's leg lift, as well as the stride distance of the object and the user's stride length. Based on the standing value zlz and the crossing value kyz, it is determined whether the object is an obstacle.

[0013] Furthermore, the determination of whether an object is an obstacle is as follows: If zlz < 0 and kyz < 0, it means that the user cannot pass through the object without changing the path forward, and therefore it is an obstacle. If zlz≥0 or kyz≥0, it means that the user can pass through the object without changing the path forward, and therefore it is not an obstacle. When a user of smart assistive glasses approaches an object that is an obstacle, the smart assistive glasses will issue a warning to the user; When a user of smart assistive glasses approaches a non-obstacle object, the glasses alert the user to the object and guide them on how to pass it.

[0014] Furthermore, users of smart assistive glasses can customize their audio feedback settings, as follows: Users of smart assistive glasses can customize the audio feedback settings, which can be set to high-frequency radar sensing target audio, mid-frequency radar sensing target audio, or low-frequency radar sensing target audio. Set the target audio of low-frequency radar to level 1, the target audio of medium-frequency radar to level 2, and the target audio of high-frequency radar to level 3; denote the set level as dj; that is, the level of the target audio of low-frequency radar, dj=1; When the setting level is the first level, obtain its alarm distance bj (1); when the setting level is the second level, obtain its alarm distance bj (2); when the setting level is the third level, obtain its alarm distance bj (3). Based on the environmental model, the distance between the user and the obstacle is obtained and denoted as zjl; the warning value jgz is calculated based on the distance zjl between the user and the obstacle, the setting level dj, and the alarm distance. When jgz≤1, a warning is issued to the user; When 1 < jgz ≤ 2, a rapid alarm will be sounded for the user; When 2 < jgz, a long beep warning will be issued to the user; When a user triggers a warning, the smart assistive glasses simultaneously provide a location alert to the user.

[0015] A method for providing intelligent assistive glasses for the blind that enables stereoscopic environmental perception, the assistive method including: Step S1: Use smart assistive glasses to perform radar scanning on the external environment, record the radar scan data, and obtain environmental data; Step S2: Process the environmental data. Using the smart assistive glasses as the origin, map the environmental data into three-dimensional space to obtain the mapping value. Based on the mapping value, construct a model of the external environment to obtain the environmental model. Step S3: Collect the motion information of the user of the smart assistive glasses, judge the obstacles based on the user's motion information and the environmental model, and provide audio feedback to the user based on the obstacle judgment results. Step S4: Users of smart assistive glasses can customize the audio feedback settings, and different audio feedback will be obtained based on the user's settings.

[0016] In summary, due to the adoption of the above technical solution, the beneficial effects of the present invention are: It offers multiple customizable settings options, allowing users to select different modes according to their needs. Different warnings are also given to users depending on the mode, which enhances the scope of use of smart assistive glasses, meets the needs of more visually impaired people, and improves the applicability of smart assistive glasses.

[0017] By using data modeling, the surrounding environment of smart assistive glasses is analyzed in detail. Combined with multi-dimensional data calculations, obstacles can be judged more accurately, improving the accuracy of the prompts provided by smart assistive glasses, enhancing their safety and practicality, and ensuring the quality of life and travel safety of visually impaired people. Attached Figure Description

[0018] To facilitate understanding by those skilled in the art, the present invention will be further described below with reference to the accompanying drawings.

[0019] Figure 1 This is an overall system block diagram of the present invention; Figure 2 This is a schematic diagram of the model of the present invention; Figure 3 This is a schematic diagram of the method of the present invention; Detailed Implementation

[0020] The technical solution of the present invention will be clearly and completely described below with reference to the embodiments. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present invention.

[0021] Example 1 Please see Figure 1 The present invention relates to a smart assistive glasses for the blind with a stereoscopic perception environment, which belongs to the category of voice prompt devices. It provides a smart assistive glasses system for the blind with a stereoscopic perception environment, including a data acquisition module, a model building module, an intelligent judgment module, a voice interaction module, and a server. The data acquisition module, model building module, intelligent judgment module, and voice interaction module are respectively connected to the server, and the server controls the data acquisition module, model building module, intelligent judgment module, and voice interaction module respectively. Data acquisition module: The system uses smart glasses for the blind to perform radar scans of the external environment, records the radar scan data, and obtains environmental data. The specific workflow of the data acquisition module is as follows: The system transmits radio waves through smart assistive glasses, recording the transmission time and angle. When the radio waves touch an object, they are reflected to obtain a reflected wave. The power and reception time of the reflected wave are then obtained. The reflection time difference of the reflected wave is calculated from the reception time and the transmission time of the radio wave. Environmental data is then constructed based on the reflection time difference, the transmission angle of the radio wave, and the power of the reflected wave. Model building module: Processes environmental data, maps the environmental data into three-dimensional space with the smart assistive glasses as the origin, obtains the mapping value, and builds a model of the external environment based on the mapping value to obtain the environmental model; The specific workflow of the model building module is as follows: Please see Figure 2 A three-dimensional coordinate system is constructed with the smart assistive glasses as the origin. The z-axis is the direction perpendicular to the ground upwards, the y-axis is the direction horizontally forward of the glasses, and the x-axis is the direction perpendicular to both the y-axis and z-axis. Environmental data is processed based on this three-dimensional coordinate system as follows: Based on environmental data, the reflection time difference of the reflected wave, the transmission angle of the radio wave, and the power of the reflected wave are obtained. The reflection time difference of the reflected wave is denoted as fsc, the transmission angle of the radio wave is denoted as fsj, and the power of the reflected wave is denoted as fgl. The wave velocity of the reflected wave is obtained and denoted as bsv; the reflection distance of the reflected wave is calculated based on the wave velocity and the reflection time difference of the reflected wave to obtain the reflection distance fjl. ; It should be noted that the wave speed of a reflected wave refers to its propagation speed in the atmosphere. For example, the speed of ultrasound is v = 331.4 + 0.6T (where T is temperature in °C). Example: When the temperature T = 30 °C, v ≈ 349.4 m / s.

[0022] By mapping the radio wave transmission angle fsj to the three-dimensional coordinate system, we can obtain the angle fsjx between the radio wave transmission angle and the x-axis, the angle fsjy between the radio wave transmission angle and the y-axis, and the angle fsjz between the radio wave transmission angle and the z-axis. Based on the angle fsjx between the radio wave emission angle and the x-axis and the reflection distance fjl, the distance component of the reflecting object on the x-axis is obtained, denoted as flx; ; Based on the angle fsjy between the radio wave emission angle and the y-axis and the reflection distance fjl, the distance component of the reflecting object on the y-axis is obtained, denoted as fly; ; Based on the angle fsjz between the radio wave emission angle and the z-axis and the reflection distance fjl, the distance component of the reflecting object on the z-axis is obtained, denoted as flz; ; The coordinate system is mapped based on the distance components, as follows: Based on the distance components of the reflecting object on the x-axis, y-axis, and z-axis, the mapping value fzb of the reflection point is obtained, where fzb = (flx, fly, flz). The number of radio waves transmitted is obtained; the reflected radio waves of each radio wave are obtained according to the number of radio waves transmitted, and the mapping value of the reflected radio waves to the reflection point is calculated to obtain fzb(1) to fzb(fs); the reflected radio wave power of each reflected radio wave is recorded as fgl(1) to fgl(fs); where: fs represents the number of reflected radio waves; Based on the mapping values ​​fzb(1) to fzb(fs) of the reflection points, the three-dimensional coordinate system is mapped, and each reflection point is represented in the three-dimensional coordinate system according to its mapping value to obtain the mapping point; combined with the reflected wave power fgl(1) to fgl(fs) of each reflected wave, each mapping point is labeled to obtain the labeled value; It should be noted that reflected radio wave power can identify the material of the reflecting object, extract identical objects, and separate different objects.

[0023] Analyze the mapped points based on the labeled values: Extract mapping points with the same labeled value, determine the continuity of the mapping points, extract continuous mapping points, and obtain the spatial model of the object based on the space enclosed by the continuous mapping points. All labeled values ​​and mapping points are processed to obtain a spatial model of all objects scanned by the smart assistive glasses. An environmental model is then constructed based on the spatial model of all objects scanned by the smart assistive glasses. It should be noted that by constructing an environmental model, the user's surrounding environment can be assessed, reducing the difficulty of assessing the surrounding environment and improving the accuracy of smart assistive glasses in judging obstacles. Intelligent judgment module: Collects the action information of the user of the smart assistive glasses, judges obstacles based on the user's action information and the environmental model, and provides audio feedback to the user based on the obstacle judgment result; The specific workflow of the intelligent judgment module is as follows: Based on the user's action information, obtain the user's leg lift height, denoted as tgd; obtain the user's stride length, denoted as kcd; obtain the user's minimum standing area, denoted as zxl; Based on the environmental model, the spatial model of the object is obtained. The object is judged by the user's leg height, stride length and minimum standing area. If the user can stand on the object or stride over the object, the object is judged as a non-obstacle. If the user cannot pass through the object, it is judged as an obstacle. The specific steps for judging an object are as follows: Based on the spatial model of the object, obtain the height of the object; denote the height of the object as wgd; obtain the plane area of ​​the highest point of the object to obtain the object plane wpm; obtain the cross-domain distance kjl of the object based on the length of the object in the y-axis direction. The standing value zlz is obtained by calculating the height of the object, the user's leg lift height, the plane area of ​​the highest point of the object, and the user's minimum standing area. ; It should be noted that the difference between the height of the object and the height of the user's raised leg is used to determine whether the user can pass the highest point of the object. The difference between the plane area of ​​the highest point of the object and the user's minimum standing area is used to determine whether the user can stand on the object. The two factors are combined to determine whether the user can pass the object by standing on it.

[0024] The standing value is used to determine whether a user can pass over an object by standing on top of it. If the standing value is less than 0, it means that the user cannot pass over the object by standing on top of it. The stride value kyz is obtained by calculating the height of the object and the user's leg lift, as well as the stride distance of the object and the user's stride length. ; It should be noted that: the ability of a user to directly cross an object is determined by the object's span distance and the user's stride length. The height of the object and the user's leg lift height are combined to constrain the ability to directly cross the object, thereby enhancing the accuracy of the calculation results. For example, if the width of an object is less than the user's span length, but its height is too high for the user to pass through, then the user cannot directly cross the object.

[0025] Based on the standing value zlz and the crossing value kyz, determine whether the object is an obstacle; If zlz < 0 and kyz < 0, it means that the user cannot pass through the object without changing the path forward, and therefore it is an obstacle. If zlz≥0 or kyz≥0, it means that the user can pass through the object without changing the path forward, and therefore it is not an obstacle. When a user of smart assistive glasses approaches an object that is an obstacle, the smart assistive glasses will issue a warning to the user; When a user of smart assistive glasses approaches a non-obstacle object, the glasses alert the user to the object and guide them on how to pass it.

[0026] It should be noted that: by using multiple data to evaluate objects, the accuracy of obstacle assessment is ensured; and the warning accuracy of smart assistive glasses for the blind is improved.

[0027] Voice interaction module: Users of smart assistive glasses can customize the audio feedback, and different audio feedback will be obtained based on the user's settings; The specific workflow of the voice interaction module is as follows: Users of smart assistive glasses can customize the audio feedback settings, which can be set to high-frequency radar sensing target audio, mid-frequency radar sensing target audio, or low-frequency radar sensing target audio. Set the target audio of low-frequency radar to level 1, the target audio of medium-frequency radar to level 2, and the target audio of high-frequency radar to level 3; denote the set level as dj; that is, the level of the target audio of low-frequency radar, dj=1; When the setting level is the first level, obtain its alarm distance bj (1); when the setting level is the second level, obtain its alarm distance bj (2); when the setting level is the third level, obtain its alarm distance bj (3). Based on the environmental model, the distance between the user and the obstacle is obtained and denoted as zjl; the warning value jgz is calculated based on the distance zjl between the user and the obstacle, the setting level dj, and the alarm distance. ; When jgz≤1, a warning is issued to the user; When 1 < jgz ≤ 2, a rapid alarm will be sounded for the user; When 2 < jgz, a long beep warning will be issued to the user; When a user triggers a warning, the smart assistive glasses simultaneously provide the user's location information. It should be noted that different warning levels allow users to better perceive the distance between themselves and obstacles, thereby avoiding obstacles and ensuring user safety.

[0028] Example 2 Please see Figure 3 This invention relates to a set of intelligent assistive glasses for the blind that provides stereoscopic environmental perception, belonging to the category of voice prompt devices. It also provides a method for using such glasses, comprising: Step S1: Use smart assistive glasses to perform radar scanning on the external environment, record the radar scan data, and obtain environmental data; Step S2: Process the environmental data. Using the smart assistive glasses as the origin, map the environmental data into three-dimensional space to obtain the mapping value. Based on the mapping value, construct a model of the external environment to obtain the environmental model. Step S3: Collect the motion information of the user of the smart assistive glasses, judge the obstacles based on the user's motion information and the environmental model, and provide audio feedback to the user based on the obstacle judgment results. Step S4: Users of smart assistive glasses can customize the audio feedback settings, and different audio feedback will be obtained based on the user's settings.

[0029] The preferred embodiments of the present invention disclosed above are merely illustrative of the invention. These preferred embodiments do not exhaustively describe all details, nor do they limit the invention to any specific implementation. Clearly, many modifications and variations can be made based on the content of this specification. This specification selects and specifically describes these embodiments to better explain the principles and practical applications of the invention, thereby enabling those skilled in the art to better understand and utilize the invention. The invention is limited only by the claims and their full scope and equivalents.

Claims

1. A smart assistive glasses system for the blind that enables stereoscopic environmental perception, characterized in that, include: Data acquisition module: The system uses smart glasses for the blind to perform radar scans of the external environment, records the radar scan data, and obtains environmental data. Model building module: Processes environmental data, maps the environmental data into three-dimensional space with the smart assistive glasses as the origin, obtains the mapping value, and builds a model of the external environment based on the mapping value to obtain the environmental model; Intelligent judgment module: Collects the action information of the user of the smart assistive glasses, judges obstacles based on the user's action information and the environmental model, and provides audio feedback to the user based on the obstacle judgment result; Voice interaction module: Users of smart assistive glasses can customize the audio feedback, and different audio feedback will be obtained based on the user's settings.

2. The intelligent assistive glasses system for the blind with stereoscopic environmental perception according to claim 1, characterized in that, The environmental data was acquired as follows: The system transmits radio waves through smart glasses for the blind, recording the transmission time and angle. When the radio waves touch an object, they are reflected to obtain a reflected wave. The power and reception time of the reflected wave are obtained from the reflected wave. The reflection time difference of the reflected wave is obtained from the reception time and the transmission time of the radio wave. Environmental data is constructed based on the reflection time difference, the transmission angle of the radio wave, and the power of the reflected wave.

3. The intelligent assistive glasses system for the blind with stereoscopic environmental perception according to claim 1, characterized in that, The external environment is modeled as follows: A three-dimensional coordinate system is constructed with the smart assistive glasses as the origin, with the vertical upward direction as the z-axis, the horizontal forward direction of the glasses as the y-axis, and the direction perpendicular to both the y-axis and z-axis as the x-axis; environmental data is then processed based on this three-dimensional coordinate system. Based on environmental data, the reflection time difference of the reflected wave, the transmission angle of the radio wave, and the power of the reflected wave are obtained. The reflection time difference of the reflected wave is denoted as fsc, the transmission angle of the radio wave is denoted as fsj, and the power of the reflected wave is denoted as fgl. The wave velocity of the reflected wave is obtained and denoted as bsv; the reflection distance of the reflected wave is calculated based on the wave velocity and the reflection time difference of the reflected wave to obtain the reflection distance fjl. By mapping the radio wave transmission angle fsj to the three-dimensional coordinate system, we can obtain the angle fsjx between the radio wave transmission angle and the x-axis, the angle fsjy between the radio wave transmission angle and the y-axis, and the angle fsjz between the radio wave transmission angle and the z-axis. Based on the angle fsjx between the radio wave emission angle and the x-axis and the reflection distance fjl, the distance component of the reflecting object on the x-axis is obtained, denoted as flx; Based on the angle fsjy between the radio wave emission angle and the y-axis and the reflection distance fjl, the distance component of the reflecting object on the y-axis is obtained, denoted as fly; Based on the angle fsjz between the radio wave emission angle and the z-axis and the reflection distance fjl, the distance component of the reflecting object on the z-axis is obtained, denoted as flz; Map the coordinate system based on the distance component.

4. The intelligent assistive glasses system for the blind with stereoscopic perception of the environment according to claim 3, characterized in that, The coordinate system is mapped based on the distance components, as follows: Based on the distance components of the reflecting object on the x-axis, y-axis, and z-axis, the mapping value fzb of the reflection point is obtained, where fzb = (flx, fly, flz). The number of radio waves transmitted is obtained; the reflected radio waves of each radio wave are obtained according to the number of radio waves transmitted, and the mapping value of the reflected radio waves to the reflection point is calculated to obtain fzb(1) to fzb(fs); the reflected radio wave power of each reflected radio wave is recorded as fgl(1) to fgl(fs); where: fs represents the number of reflected radio waves; Based on the mapping values ​​fzb(1) to fzb(fs) of the reflection points, the three-dimensional coordinate system is mapped, and each reflection point is represented in the three-dimensional coordinate system according to its mapping value to obtain the mapping point; combined with the reflected wave power fgl(1) to fgl(fs) of each reflected wave, each mapping point is labeled to obtain the labeled value; the mapping point is analyzed through the labeled value.

5. The intelligent assistive glasses system for the blind with stereoscopic environmental perception according to claim 4, characterized in that, The mapping points are analyzed as follows: Extract mapping points with the same labeled value, determine the continuity of the mapping points, extract continuous mapping points, and obtain the spatial model of the object based on the space enclosed by the continuous mapping points. All labeled values ​​and mapping points are processed to obtain spatial models of all objects scanned by the smart assistive glasses. Based on the spatial models of all objects scanned by the smart assistive glasses, an environmental model is constructed.

6. The intelligent assistive glasses system for the blind with stereoscopic environmental perception according to claim 1, characterized in that, Obstacle detection is performed using an environmental model, as detailed below: Based on the user's action information, obtain the user's leg lift height, denoted as tgd; obtain the user's stride length, denoted as kcd; obtain the user's minimum standing area, denoted as zxl; Based on the environmental model, the spatial model of the object is obtained. The object is judged by the user's leg lift height, stride length and minimum standing area. If the user can stand on the object or straddle the object, the object is judged as a non-obstacle. If the user cannot pass through the object, it is judged as an obstacle.

7. The intelligent assistive glasses system for the blind with stereoscopic environmental perception according to claim 1, characterized in that, The object is judged as follows: Based on the spatial model of the object, obtain the height of the object; denote the height of the object as wgd; obtain the plane area of ​​the highest point of the object to obtain the object plane wpm; obtain the cross-domain distance kjl of the object based on the length of the object in the y-axis direction. The standing value zlz is obtained by calculating the height of the object, the user's leg lift height, the plane area of ​​the highest point of the object, and the user's minimum standing area. The standing value is used to determine whether a user can pass over an object by standing on top of it. If the standing value is less than 0, it means that the user cannot pass over the object by standing on top of it. The stride value kyz is obtained by calculating the height of the object and the user's leg lift, as well as the stride distance of the object and the user's stride length. Based on the standing value zlz and the crossing value kyz, it is determined whether the object is an obstacle.

8. The intelligent assistive glasses system for the blind with stereoscopic environmental perception according to claim 7, characterized in that, The determination of whether an object is an obstacle is as follows: If zlz < 0 and kyz < 0, it means that the user cannot pass through the object without changing the path forward, and therefore it is an obstacle. If zlz≥0 or kyz≥0, it means that the user can pass through the object without changing the path forward, and therefore it is not an obstacle. When a user of smart assistive glasses approaches an object that is an obstacle, the smart assistive glasses will issue a warning to the user; When a user of smart assistive glasses approaches a non-obstacle object, the glasses will alert the user to the object and inform them that they are about to pass.

9. The intelligent assistive glasses system for the blind with stereoscopic environmental perception according to claim 1, characterized in that, Users of smart assistive glasses can customize their audio feedback settings, as follows: Users of smart assistive glasses can customize the audio feedback settings, which can be set to high-frequency radar sensing target audio, mid-frequency radar sensing target audio, or low-frequency radar sensing target audio. Set the target audio of low-frequency radar to level 1, the target audio of medium-frequency radar to level 2, and the target audio of high-frequency radar to level 3; denote the set level as dj; that is, the level of the target audio of low-frequency radar, dj=1; When the setting level is the first level, obtain its alarm distance bj (1); when the setting level is the second level, obtain its alarm distance bj (2); when the setting level is the third level, obtain its alarm distance bj (3). Based on the environmental model, the distance between the user and the obstacle is obtained and denoted as zjl; the warning value jgz is calculated based on the distance zjl between the user and the obstacle, the setting level dj, and the alarm distance. When jgz≤1, a warning is issued to the user; When 1 < jgz ≤ 2, a rapid alarm will be sounded for the user; When 2 < jgz, a long beep warning will be issued to the user; When a user triggers a warning, the smart assistive glasses simultaneously provide a location alert to the user.

10. A method for providing intelligent assistive glasses for the blind with stereoscopic environmental perception, applicable to the intelligent assistive glasses system for the blind with stereoscopic environmental perception as described in any one of claims 1-9, characterized in that, Methods to assist the blind include: Step S1: Use smart assistive glasses to perform radar scanning on the external environment, record the radar scan data, and obtain environmental data; Step S2: Process the environmental data. Using the smart assistive glasses as the origin, map the environmental data into three-dimensional space to obtain the mapping value. Based on the mapping value, construct a model of the external environment to obtain the environmental model. Step S3: Collect the motion information of the user of the smart assistive glasses, judge the obstacles based on the user's motion information and the environmental model, and provide audio feedback to the user based on the obstacle judgment results. Step S4: Users of smart assistive glasses can customize the audio feedback settings, and different audio feedback will be obtained based on the user's settings.

Images