241 results about "Blind persons" patented technology

The invention relates to a blind person travel assisting robot which comprises a hardware structure and a control module, and the control module comprises a navigation and positioning module, an AI intelligent control module and a remote monitoring module. The navigation and positioning module comprises map drawing, path planning and obstacle avoidance and fusion positioning, the AI intelligent control module comprises a sensor system, a voice interaction module, a tactile feedback module and an intelligent decision module, the hardware structure comprises a traction device and a mobile robot, and the traction device is provided with a touch feedback device. The touch feedback device comprises multiple sets of linear motors, obstacle information is coded through vibration of different frequencies, the mobile robot is of a circular structure, and a crawler belt is arranged at the bottom of the mobile robot. According to the auxiliary robot, through fusion of multiple positioning modes, the positioning precision and reliability are improved, it is ensured that the robot accurately knows the position of the blind person, and therefore the guiding service is better provided for the blind person.

The invention relates to the technical field of intelligent travel, in particular to a blind person positioning and yaw early warning device, system and method based on optical fiber vibration signals. Firstly, an optical fiber sensor network is laid in a hospital, vibration signals generated when the blind walk are obtained in real time, and step frequency, direction and vibration amplitude behavior data are obtained. Secondly, constructing a hospital space structure network, and determining an optimal path of the blind person from the current position to a target department through a path planning unit; and then positioning the position of the blind person in real time through a multi-sensor data fusion technology in combination with a blind person behavior data set and hospital space structure information. And finally, obtaining yaw information by calculating the yaw angle between the actual advancing path of the blind person and the standard path. And when the yaw angle exceeds a preset threshold value, the safety early warning unit sends out a correction prompt. Meanwhile, the device can dynamically adjust the path of the blind and give an early warning in advance according to temporary crowded areas or emergency situations occurring in hospitals, and walking safety is ensured.

The invention discloses an intelligent ring for a blind person, relates to the technical field of travel assistance for the blind person, and aims to solve the problem that an existing travel auxiliary tool for the blind person cannot provide comprehensive and timely travel assistance for the blind person, the intelligent ring comprises a wearing ring and a protection ring which are used for forming the ring, and is characterized in that a storage cavity is formed between the wearing ring and the protection ring; a 360-degree ultrasonic sensor array, a high-precision microprocessor, four groups of linear vibration feedback modules, a low-power-consumption Bluetooth 4.0 module and a rechargeable lithium battery are arranged in the accommodating cavity; the 360-degree ultrasonic sensor array comprises four sets of micro sensors which are located on the front side, the rear side, the left side and the right side of the containing cavity respectively, and the range of a single set of micro sensors is 120 degrees, so that all-directional coverage of the surrounding 360-degree space is achieved, and the blind can sense obstacles from all directions. The method has the advantage that the blind user can comprehensively and timely obtain the travel information.

The invention relates to a color temperature-based blind person color pattern emotion perception enhancement method and system, and the method comprises the steps: collecting a target image, and extracting the contour information and color information in the image; performing HSV judgment to obtain a cooling and heating classification result; mapping the cooling and heating classification result to a preset temperature interval, and generating a temperature control signal; according to the contour information, driving a target pin in the tactile array to protrude to form a tactile contour area; a temperature control signal is applied to the heating unit corresponding to the touch contour area, so that the temperature of the protruding pin is adjusted to be the target temperature corresponding to the cold and warm classification result. The method has the beneficial effects that the image color temperature is mapped into five grades of temperature gradients, so that a blind user can perceive a complete color emotion pedigree through touch, accurate touch expression of color emotion information is realized, and a visual color temperature-temperature sensing corresponding relation is established.

The invention discloses a road recognition early warning system and method for a blind guide stick, and belongs to the technical field of auxiliary travel of blind persons. Perturbation vibration signals generated when the blind guide stick makes contact with the ground are collected, and a perturbation vibration feature vector set is constructed; inputting the feature vectors into a multi-layer fusion feature analysis model, and extracting abnormal sensitive features such as low-amplitude periodic disturbance, heterogeneous feedback response and contact delay gradient change; constructing a perturbation anomaly risk map based on the features, and dividing risk levels; further extracting a high-risk area and identifying a dangerous point set; performing space fitting on the dangerous point and the blind guiding user path prediction trajectory, and judging whether a path crossing risk exists or not; if the intersection exists, multi-mode early warning including vibration, voice and directional prompt is triggered; according to the invention, accurate identification and dynamic early warning of small road abnormity can be realized, the blind guiding safety and environmental adaptability are improved, and the system has low power consumption and high real-time performance.

The invention relates to the technical field of intelligent walking assisting equipment, and discloses a blind person intelligent guiding walking assisting method and system based on deep learning. The intelligent guiding power-assisted walking method for the blind is applied to guiding power-assisted electronic equipment, and specifically comprises the following steps: S101, receiving a starting signal sent by a user terminal, starting a multi-source sensor array to collect environment data in parallel, executing a Kalman-Transform space-time alignment algorithm, establishing a multi-modal data space-time unified coordinate system, and establishing a multi-modal data space-time unified coordinate system; when gait phase changes are collected and detected, a multi-source sensor array is activated and dynamically triggered for high-precision scanning, and a threat evaluation model is generated to calculate an obstacle collision probability point cloud matrix; and S102, processing the obstacle collision probability point cloud matrix through Point VoxelNet to generate a three-dimensional environment skeleton. The cross-modal attention mechanism of the millimeter wave radar and the vision improves the rain and fog weather recognition accuracy, and in addition, the dynamic threat evaluation module is combined with the double-threshold early warning strategy, so that the collision false alarm rate is effectively reduced.

The invention relates to the technical field of speech synthesis, can be applied to business scenes of blind navigation, financial science and technology, medical health and the like, and discloses a navigation method based on environmental perception and path data, which comprises the following steps: acquiring environmental data through an environmental perception sensor, generating environmental perception data, and generating navigation path data in combination with a positioning module; a navigation instruction is generated through the voice synthesis module and is output through the voice broadcast module, a vibration feedback instruction is generated according to the environment sensing data and is output through the vibration module, a touch prompt instruction is generated according to the navigation path data and is output through the touch module, and real-time multi-mode feedback is provided. And the user can obtain accurate navigation information in a complex environment. According to the invention, voice, vibration and tactile feedback are generated by combining the environmental perception data and the navigation path data, and multi-modal navigation information is provided, so that the safety and navigation accuracy of a user in a complex environment are remarkably improved, and the collision risk and the probability of getting lost are reduced.

The invention discloses a blind person navigation and positioning system and method, and relates to the technical field of intelligent assistance and positioning navigation, and the system comprises a positioning service unit and a navigation service unit. In the positioning service unit, an IMU module collects three-axis acceleration and three-axis angular velocity information of a user in real time and calculates motion data of the user; the GNSS module receives satellite signals in real time and calculates position data of a user; and the data processing module carries out positioning according to the data of the IMU module and the GNSS module, and sends the positioning result of the user to the navigation service unit. In the navigation service unit, a demand acquisition module is used for user interaction and acquiring terminal point information of a user; the path planning module generates an optimal path according to the starting point information and the terminal point information of the user; and the navigation guiding module guides the user to advance along the planned path through voice prompt. And more accurate navigation information is provided for the blind. According to the invention, real-time positioning and navigation services are provided for the blind, and the travel safety and convenience of the blind are enhanced.

The invention discloses a blind guide stick local obstacle avoidance navigation method based on multi-sensor fusion, which comprises a telescopic blind guide stick, an RGB-D depth camera, a radar and other sensors and a high-performance processor, so as to realize accurate environmental perception and intelligent navigation functions and improve the travel safety and convenience of blind people and visually impaired people. The method comprises the following steps: acquiring depth information of a surrounding environment through an RGB-D depth camera, providing a three-dimensional perception capability of a scene, performing auxiliary correction on information acquired by the RGB-D depth camera through a plurality of sensors such as radar, transmitting the information acquired by the sensors to a high-performance processor, and performing SLAM (Simultaneous Localization and Map Construction) algorithm so as to obtain the three-dimensional perception capability of the scene. According to the method, information collected by multiple sensors is fused, the pose information of the current blind guiding stick is calculated, nonlinear optimization is carried out according to the calculated pose information and measured depth information, the result of nonlinear optimization is used for establishing an octree map of the environment, and a reasonable obstacle avoidance path is generated according to the octree map. And the obstacle avoidance path is fed back to the blind and visually impaired people in real time in a voice or vibration mode.

The invention discloses a wearable intelligent obstacle avoidance system, and belongs to the technical field of blind person auxiliary travel. The invention aims to solve the problem that the existing blind person travel auxiliary equipment is inconvenient to use or high in cost. The method includes the steps that an image collection module collects blind sidewalk obstacle images; the GPS positioning module obtains position coordinates of a user; the lightweight target detection model performs obstacle recognition on the blind sidewalk obstacle image based on the position coordinates of the user to obtain obstacle information; the monocular distance measurement module obtains a distance signal between the current position of the user and the obstacle according to the obstacle information; the control module sends the current distance signal to the prompt module and sends a danger prompt signal when the distance between the current position of the user and the obstacle is smaller than a set threshold value; the prompting module sends a distance signal to a user; an alarm is sent to a user according to the danger prompt signal; all the modules are integrated on the wearable article to form the wearable device. The method is used for assisting the blind in going out.

The invention discloses a blind person intelligent navigation system based on multi-modal sensor fusion, and relates to the field of blind person intelligent navigation systems, and the blind person intelligent navigation system comprises an initialization module, a data acquisition module, a data processing module, a first judgment module, a second judgment module, a path correction module and a navigation prompt module. The initialization module generates an initial path according to the initial position and the target position and starts a path guiding mode; the data acquisition module synchronously acquires image, radar and inertial measurement data; the data processing module calculates an image coherence index and generates an auxiliary judgment mark; the first judgment module determines whether to switch an obstacle avoidance mode or not according to the index continuity and the auxiliary mark; a second judgment module evaluates a condition of return path guidance in an obstacle avoidance mode; the path correction module judges a path correction mode through the spatial relationship and the deviation coefficient; the navigation prompting module outputs guiding information according to the mode; according to the invention, the accuracy and stability of navigation mode switching can be improved.

The invention provides an environment identification method and system for assisting a blind person in going out, and relates to the technical field of environment identification, an environment monitoring image and object information are acquired, and the object information comprises a target position and a current position of an object; determining a local action track of the object through the environment monitoring image and the object information; the object moves according to the local action track; acquiring an obstacle on the local action track from the environment monitoring image; acquiring information of obstacles in real time to obtain obstacle information; determining a risk value of the obstacle relative to the object through the object information and the obstacle information; and when the risk value is equal to or greater than a preset risk threshold value, generating a risk avoiding strategy executed by the object. And measures are taken in advance before the danger occurs, so that the blind person is helped to actively avoid the obstacle instead of passively dealing with the danger after the danger occurs, and the probability of accidents in the traveling process of the blind person is reduced.

The invention discloses a direction identification method and system of blind person intelligent glasses in an outdoor environment, and relates to the technical field of direction positioning of the blind person intelligent glasses. And according to the current position of the blind person intelligent glasses and the current position of each feature of the stereo model, determining the primary direction of the blind person intelligent glasses in the outdoor environment, and carrying out primary direction identification in the stereo model. Therefore, a direction deviation value is determined according to the ultrasonic positioning information, the front side image and the characteristics recorded by the three-dimensional model in the primary direction; according to the direction deviation value, the primary direction and the moving direction of the blind intelligent glasses, the final direction of the blind intelligent glasses in the outdoor environment is determined, dynamic movement of the blind intelligent glasses is fully considered, and the accuracy of the final direction of the blind intelligent glasses in the outdoor environment is further guaranteed; and multi-stage identification from the primary direction to the final direction is realized.

The invention discloses a pair of blind glasses based on an AI language vision large model, and the glasses comprise a glasses body which is used for being worn on the head of an external person; the image acquisition camera is mounted in the glasses body and is used for acquiring image data of obstacles in the external environment in real time; the processing module communicates with the image acquisition camera and is used for analyzing the acquired image data and generating detailed environmental understanding; and the natural language processing and intelligent feedback system communicates with the processing module and is used for receiving the detailed environmental understanding output by the processing module and generating voice output from the environmental understanding through voice synthesis. According to the glasses for the blind based on the AI language visual large model, voice is finally output by adopting a natural language processing and intelligent feedback system, and voice output in a complex environment can be realized.

The invention discloses an intelligent blind person walking stick based on artificial intelligence, and relates to the field of intelligent walking sticks, and the intelligent blind person walking stick comprises a sensing module used for collecting environmental physical information in the advancing direction of a user in real time, and a processing module used for receiving multi-source environmental information collected by the sensing module, establishing a dynamic three-dimensional space model of the current local environment by taking a landing point at the bottom end of the walking stick as a current origin of coordinates; when the user touches the walking stick to the ground once, a'drop point event 'is triggered once, the three-dimensional space model is updated based on new drop point data, and the space offset between the current drop point and the previous drop point is calculated, including the moving distance and the direction change; compared with a scheme only based on distance perception or fixed path navigation, the method has higher environment understanding capability, navigation adaptive capability and real-time correction capability.

The invention discloses a hospital internal positioning, navigation and obstacle avoidance system for assisting a blind person in seeing a doctor, which adopts a visual SLAM (Simultaneous Localization and Mapping) algorithm, a multi-view stereo matching algorithm and a global optimization algorithm Bundle AdJustent to reconstruct a three-dimensional map in a hospital, and adopts a PnP algorithm and an RANSAC (Random Sample Consensus) algorithm to obtain three-dimensional coordinates of equipment. A large language model GPT-4o is adopted to analyze the dialogue between the blind person and medical staff to obtain the destination of the blind person, a navigation algorithm A * is combined with a three-dimensional map, built in advance, of a hospital where the device is located in a cloud server, a navigation path is formulated and played to the blind person in real time, action guidance is provided for the blind person, and the blind person can conveniently and rapidly enter the medical staff. And detecting and segmenting a front obstacle by adopting an instance segmentation algorithm YOLOv8-seg, obtaining information of the front obstacle in combination with the depth image and coordinate transformation, and broadcasting the position of the obstacle to the blind.

The application belongs to the technical field of virtual reality, and particularly relates to a sound-driven VR serious game interaction control method for semi-blind people. The method comprises the following steps: constructing a 3D sound scene space and a motion guide field, and converting a motion path into a sound change rule; collecting and fusing user pose and physiological feedback signals in real time; dynamically adjusting sound source parameters and tactile feedback according to pose deviation to realize non-visual orientation guidance; performing boundary verification and area determination through ray projection to ensure interaction safety; synchronously processing collision by using a bounding box model and quaternion interpolation; and establishing a mapping model of emotional parameters and sound characteristics to synthesize exciting sound effects. Through multi-modal collaborative interaction, the application significantly improves the perception accuracy and safety of semi-blind users in a virtual space, realizes the cooperation of psychological intervention and motion rehabilitation, and has excellent real-time response capability.

The multi-mode AI-based blind person full-scene perception interaction method comprises the following steps: in the moving process of a user, acquiring a first video in a first direction, and acquiring a second video in a second direction based on the selection of the user; using a pre-trained traffic signal analysis model to locally analyze the first video and the second video to obtain traffic signal information, and converting the traffic signal information into traffic signal audio; uploading the first video and the second video to a cloud end, analyzing the first video and the second video by using a pre-trained complex environment analysis model to obtain complex environment information, and converting the complex environment information into complex environment audio; and acquiring position data of the user in real time, uploading the position data to the Internet of Vehicles to generate risk early warning information, and converting the risk early warning information into risk early warning audio. The safety of a user in the moving process can be fully guaranteed, and dignity of the user is effectively prevented from being damaged.

The invention relates to a method and system for avoiding information leakage of blind persons and a medium, and the method constructs a multi-level security verification mechanism, and comprises the following steps: carrying out voice retelling and voiceprint verification confirmation on a navigation instruction; carrying out credible authentication and integrity verification on the environment perception data; an expected navigation behavior is generated locally, and multi-dimensional consistency verification is carried out; voiceprint authentication and physical key secondary confirmation are required for suspicious and high-risk instructions. A corresponding system comprises an instruction confirmation module, a sensing data verification module, a local decision-making module, a consistency verification module, an intensified verification module, an execution control module and the like, and all the modules cooperate to achieve the method. The invention also relates to a computer storage medium for implementing the method. By establishing a safe closed loop of'user confirmation-data verification-behavior verification ', the technical problems of external data intrusion and misleading of the blind by malicious instructions are fundamentally solved, and the safety and reliability of the navigation equipment are remarkably improved.

This invention discloses a dynamic obstacle avoidance method for assistive visually impaired scenarios. First, a feature extraction module based on a hierarchical residual structure constructed within residual blocks is built, which expands the receptive field of deep features. Second, a spatial feature recovery module based on bilinear interpolation and transposed convolution upsampling is designed to make segmentation edges more accurate. Third, a discrete sampling strategy is used to extract obstacle category, distance, and contour information, and path planning is performed using a heuristic search algorithm considering safe distance constraints. Finally, priority rules and logical order rules for the obstacle avoidance warning system are assumed, and a decision is generated based on the planned path, effectively guiding blind users to avoid obstacles through auditory and tactile information. This invention solves the problem that single-stage instance segmentation algorithms struggle to simultaneously and accurately segment small target obstacles and background road surfaces, overcoming the difficulty of providing effective information for obstacle avoidance decisions in assistive visually impaired scenarios with instance segmentation results, enabling blind users to avoid obstacles more intelligently and autonomously.

The invention discloses a multi-modal perception-based intelligent travel auxiliary system and method for blind people, and the system and method take a smart phone as a carrier, and shoot the surrounding environment and obstacles in real time through a camera shooting function. And the AI multi-target sensing module identifies and analyzes the image, and carries out dynamic path planning by fusing GPS / Beidou positioning and a high-precision map. And finally, voice graded broadcasting and vibration reminding are carried out through the multi-mode interaction module. Therefore, the purpose of avoiding obstacles is achieved, and the travel difficulty of the blind is reduced. On the basis, the functions of volunteers and the guiding function of related traffic facilities such as bus stations, subway stations, railway stations, high-speed railway stations and airports can be expanded. In addition, inertial navigation is automatically switched to when no network exists, so that the blind person is continuously assisted to go out.

The invention discloses a method and a system for identifying obstacles by using intelligent glasses for blind people, and relates to the technical field of obstacle identification by using intelligent glasses for blind people, and the method comprises the following steps: determining a moving obstacle area according to real-time environment image detection; each obstacle image is determined according to the moving obstacle area, and the corresponding obstacle is determined based on the recognition of each obstacle image, so that the obstacle is dynamically recognized along with the movement of the blind smart glasses, and the accuracy of the obstacle is ensured. Determining a plurality of touch risk parts according to the sharp form of each obstacle and the posture of each obstacle, and determining a blind person risk area according to the positions of the plurality of touch risk parts, the position of the blind person intelligent glasses and the movement range of the blind person; the safe moving area is determined according to the blind person risk area, the moving direction of the blind person and the moving path of the blind person, accurate control over the blind person risk area and the safe moving area is achieved, and risk control over moving of the blind person through the blind person intelligent glasses is achieved.

The utility model discloses a blind guiding device which comprises a stick head arranged at the top of a stick body, a handle arranged on one side of the stick head and used for being supported by a user, a moving module arranged at the bottom of the stick body, a positioning module arranged in the stick head, an inertia measurement module and a data processing module arranged in the stick body, and a data processing module arranged in the stick body. The power module, the camera and the laser radar are arranged on the outer side face of the stick body, the camera and the laser radar are arranged at the positions, close to the stick head, of the stick body and are arranged in the direction opposite to the extending direction of the handle, and the data processing module is used for conducting SLAM mapping and obstacle information detection. The navigation module is used for receiving the SLAM mapping result and generating navigation data capable of avoiding obstacles based on the SLAM mapping result and the obstacle information, and the moving module is used for receiving the navigation data and moving according to the navigation data. By the adoption of the embodiment, real-time movement in a complex environment can be achieved, the blind person can go out only by following traction walking of the blind guiding device, and the going-out efficiency of the blind person is improved.

The invention belongs to the technical field of intelligent service robots, and discloses a wheelchair type robot capable of automatically climbing stairs and fusing bionic motion control and a deep learning algorithm, which is particularly suitable for the vertical movement requirement of the disabled and the going-out requirement of the blind in a barrier-free environment deficiency scene. Comprising a chassis, a seat, a front base, a rear base, a driving assembly, an environment information collecting assembly, a calculation control unit, a power supply assembly, a man-machine conversation assembly with a display screen and an operation handle.

This invention discloses a Braille drum score teaching device, relating to the field of Braille drum score teaching technology. It includes a protective vest connected to teaching components. The teaching components include: a control assembly installed on the back of the protective vest; a control box fixedly connected to the back of the vest; a speaker fixedly connected to the control box; two sets of shoulder armor; and two sets of monitoring devices installed on the underside of the two sets of shoulder armor for monitoring the user's arm position. This Braille drum score teaching device, through the seven-degree inclined self-locking structure of the control box and the Braille display components, and electromagnetic drive transmission, achieves accurate display of the Braille drum score. It allows the blind user to read the drum score content promptly without affecting their drum practice; and it updates the Braille drum score promptly when the drum practice is correct, and pauses the update when the drum score is incorrect.

A system and method for urban mobility assistance intended for integration into an urban environment. The system notifies or alerts users to potential obstacles in their path and guides them to a destination of interest. Assistance is provided by the detection via a support element worn by the user of an electromagnetic field generated by a conductive wire installed below ground level when receiving alternating current. The invention offers an efficient solution to the lack of adaptability and personalization in current assistance solutions for blind people, as it provides continuous and specific guidance based on environmental information and the user's needs.

The embodiment of the invention discloses a playing game system for blind people. A specific implementation mode of the system comprises terminal equipment, a touch pen and a background service system, the terminal equipment comprises a handwriting board, a loudspeaker, a tactile feedback assembly and a voiceprint recognition assembly, and the loudspeaker can play the content of a script; the touch pen is in communication connection with the terminal equipment, and the touch pen is matched with the handwriting board; the tactile feedback assembly comprises a reading key and a vibration device, the reading key can provide tactile navigation for the blind through a protrusion and a recess of a pressing rod of the reading key, and the vibration device can provide tactile navigation for the blind through vibration; the voiceprint recognition component can record and recognize voiceprint features of players; and the background service system is in communication connection with the terminal equipment, and can store the playing content, manage the player information and control the interaction process. According to the implementation mode, the game is performed through the terminal equipment, the touch pen and the background service system, and the game experience of the blind is improved through touch, hearing and voice interaction.

The application discloses a blind person assisting system based on artificial intelligence and smart home, and relates to the field of intelligent assistance, comprising: a perception module collects voice data of a blind person and binocular vision data in front of the blind person, and obtains three-dimensional point cloud data of an indoor environment; a voice recognition module recognizes the voice data, and confirms a voice instruction of the blind person; an assisting module performs real-time object recognition based on the binocular vision data, and assists the blind person in picking up objects according to the voice instruction; the three-dimensional point cloud data are used to identify a position of the blind person and obstacles, and the blind person is assisted to reach a target position according to the voice instruction; and a smart home linkage module controls each smart home device according to the voice instruction. Through deep integration of artificial intelligence and smart home, the application comprehensively solves the problems of environment perception, action assistance and device control for the blind person at home, and significantly improves the independence, convenience and safety of the blind person at home.

The invention discloses a psychological health assessment system, method and equipment for deaf-mute and blind people, a medium and a product. The system comprises a behavior data acquisition device, a physiological data acquisition device and a display device, the behavior data acquisition device comprises a plurality of acquisition devices adaptive to deaf-mute and blind people and is used for acquiring tactile behavior data of a target object in a test process, and the physiological data acquisition device is worn on a signal acquisition part of the target object and is used for acquiring physiological data of the target object in the test process; the processing device receives the tactile behavior data and the physiological data, and analyzes and processes the tactile behavior data and the physiological data based on a pre-trained evaluation model to obtain a recommendation analysis result of the target object for the psychological health state; and the output equipment comprises multiple types of output equipment adaptive to the deaf-mute and blind people, converts the recommendation analysis result into different types of output information, and outputs the output information. According to the method, the problem that the evaluation process is difficult to execute due to lack of visual, auditory and language functions of deaf-mute and blind people is solved.

1. Name of the product in this design: Electronic Guide Dog. 2. Purpose of this design: To be used as an electronic guide dog, replacing the work of a guide dog, and assisting blind people in their daily lives and travel. 3. The key design feature of this product is its shape. 4. The image or photograph that best illustrates the design's key points: a 3D model.