271 results about "Visually Impaired Persons" patented technology

The invention discloses an image processing method and system for intelligent glasses, and relates to the technical field of image recognition. The method comprises the following steps: synchronizing and preprocessing data collected by heterogeneous sensors in the intelligent glasses; constructing a global space-time coordinate system; a high-risk area is determined through dynamic saliency analysis, a high-resolution detection ROI is generated, full-pixel analysis is performed on a focus area, and an obstacle list with 3D positions, categories and danger levels is output; and generating a personalized safety path through a safety corridor generation algorithm based on the 3D position of the obstacle, the motion model of the visually impaired person and the real-time position. Data collected by heterogeneous sensors in the intelligent glasses are synchronized, a global space-time coordinate system is constructed, path planning is performed after obstacles are identified, high-frequency IMU angular velocity data and a self-adaptive optical flow correction network are fused, the image reverse compensation precision in a dynamic scene is improved, and navigation safety in a complex scene is guaranteed.

The invention discloses a multi-mode tactile and visual fusion identification method for medicine box braille salient point characters. The method comprises the following steps: acquiring three-dimensional morphology and pressure data of Braille salient points through a tactile sensor, acquiring an image and the like through a visual sensor, and performing preprocessing (improved U-Net segmentation, illumination correction and the like); hardware is utilized to trigger synchronization, an ICP algorithm is improved to complete space-time alignment, and a feature level (attention mechanism) and a decision level (D-S evidence theory) are fused; character semantics are analyzed by means of a multi-mode neural network, and multi-channel feedback is visualized through voice, tactile vibration and AR. A dynamic optimization mechanism is set, and sensor scheduling, incremental learning and safety verification are covered. The system comprises a tactile / visual perception module, a data processing module (FPGA + NPU), a feedback execution module and a communication module. According to the scheme, the problems of low traditional recognition precision and poor environmental adaptability are solved, high-precision medicine box braille recognition is achieved, and a reliable scheme suitable for multiple scenes is provided for safe medicine use of visually impaired people.

The invention relates to the technical field of blind guiding robot interactive navigation, and particularly discloses a blind guiding robot interactive navigation system combining vision, inertial navigation and voice, which is characterized in that environmental vision, movement and voice data are synchronously acquired through a multi-modal perception data acquisition module, and are analyzed through a situation-user joint state feature extraction module; a user potential intention deduction module is combined to predict a user intention and generate a self-adaptive guide strategy; a self-adaptive guiding path optimization module adjusts a navigation path according to a strategy to ensure safety and high efficiency; finally, the situational multi-mode interaction instruction output module provides voice and tactile feedback, and interaction experience and navigation autonomy are enhanced. According to the method, the travel problem of the visually impaired person in a complex environment is solved, the individuation, context perception capability and safety of blind guiding are improved, and more natural and efficient navigation assistance is brought to the visually impaired person.

The invention provides a visual aiding system and method for visually impaired people based on a multi-mode large model, intelligent glasses and application software. The system comprises a multi-mode large model, blind-helping application software and intelligent glasses, enables a visually impaired person to ask questions through simple voice, achieves the recognition of all things such as environment, obstacles, text information, road names / shop names, flowers and plants, and feeds back the questions to the visually impaired person through voice. According to the scheme, the visually impaired person can conveniently and quickly see all information around the person in a hearing mode, then the independence of work and life is greatly improved, and the visual impaired person has wide application prospects and huge social value.

The invention provides an intelligent tactile stick interaction method and system based on multi-modal perception and edge calculation, and relates to the technical field of intelligent auxiliary equipment. The method comprises the following steps: acquiring environment and position data through a camera, a GPS and an inertial measurement unit; performing multi-modal data fusion and deep learning identification by using an edge calculation module to generate a dynamic environment map; performing real-time path planning and obstacle avoidance based on a map and a destination; analyzing a user instruction through voice recognition and interactively adjusting a path; haptic and auditory bimodal feedback is provided through a vibration module and a voice synthesis module according to a navigation result; and when an emergency obstacle is detected or a user actively alarms, a local and remote alarm mechanism is triggered. The system correspondingly comprises an intelligent tactile stick terminal and a cloud server. According to the invention, accurate and real-time perception and intelligent navigation of the environment are realized, visual and natural interaction experience is provided, an effective emergency help channel is established, and the safety, independence and convenience of travel of visually impaired people are significantly improved.

The invention relates to the field of immersive competition watching, in particular to an immersive sports competition watching method and system for visually impaired people. The method comprises the following steps: acquiring a real-time competition video of a court monitoring device, and determining real-time movement information of a ball and player state information in a competition process according to the real-time competition video; determining vibration information of the magnetic adsorption cursor according to the real-time motion information; determining response information of wearing the ring according to the state information of the player; the wearing ring is controlled according to the response information, and the magnetic adsorption cursor is controlled according to the vibration information. According to the method and the device, the immersive game watching experience is provided for visually impaired people by acquiring the game video and the motion information in real time. Through vibration feedback of the magnetic adsorption cursor and response control of wearing the ring, the game dynamic state and the player state are perceived in real time, the sense of participation and interactivity are enhanced, and the game watching pleasure and the information acquisition accuracy are improved.

The invention discloses a large-model visual impairment assisting robot system based on edge cloud collaboration, and is applied to the technical field of intelligent robots. Comprising a walking assembly, a framework support, a sitting and lying structure and an electrical control system. The walking assembly is arranged below the framework support and used for achieving movement and steering of the auxiliary robot. The sitting-lying structure is arranged in the middle of the framework support and used for achieving a seat function. And the electrical control system is used for realizing sensing and control functions. According to the invention, a large language model, a visual identification model, a voice synthesis model and a mobile robot platform are fused, multiple auxiliary services such as autonomous navigation, environment description, voice interaction and the like can be provided for visually impaired people in public culture or living places, and the travel independence, the information acquisition capability and the culture participation degree of the visually impaired people are remarkably improved.

The invention belongs to the field of visual impairment assistance, and particularly relates to a visual impairment person perception guide interaction control system and method, and the system comprises a multi-source sensor module, an information processing and analysis unit, an interaction feedback module, an intelligent Internet of Things module, and a user preference and scene self-adaption module. According to the visual impaired person perception guide interaction control system and method, through a multi-source sensor fusion technology, the limitation of a single sensor is effectively overcome. The high-definition imaging and low-light enhancement capability of the visual sensor, the close-range precise detection of the ultrasonic sensor, the stable motion monitoring of the inertial measurement unit and the high-precision positioning of the global navigation satellite system cooperate with one another, so that the comprehensive and precise sensing of the environment is realized, and the system is convenient to adapt to different environments. The accuracy of obstacle detection, target recognition and positioning is greatly improved, a solid and reliable environment cognition basis is provided for visually impaired people, and the visually impaired people can more accurately know the surrounding environment condition.

The invention discloses a radar-vision-I MU fused visual impaired person navigation system, which relates to the technical field of multi-source data processing, and is characterized in that a multi-source data collection module is arranged to collect obstacle distance information, ground feature image data and user motion state data in an environment; a time synchronization module is arranged to carry out space-time alignment on obstacle distance information and ground feature image data to generate multi-modal sensing data, a dynamic map generation module and a fusion model based on a particle filter algorithm are arranged, a dynamic environment map is constructed in combination with motion state data, and the spatial relationship between the current position of a user and surrounding obstacles is output. Setting a trajectory prediction module to perform path planning through a reinforcement learning algorithm to generate a prediction trajectory of user motion, and setting a multi-mode interaction module to output a voice navigation instruction to the visually impaired person through a bone conduction earphone based on the prediction trajectory and a dynamic environment map; the problem of intelligent navigation of a dynamic environment faced by visually impaired people is solved.

Proposed are a braille block with a QR code displayed for guiding the visually impaired and an information guidance system using the same, which more accurately provides the next movement information to the visually impaired on the basis of the movement route of the visually impaired and the entry direction into the current braille block analyzed through recognition of the QR code contained in the braille block, especially which analyzes and provides the information necessary to make corrections to the location of the braille block or corrections related to the QR code information contained in the braille block by analyzing whether the visually impaired actually move to or enter the guided braille block in the correct direction, and additionally which selects and provides customized information suitable for the corresponding visually impaired person among information contained in the QR code or content provided through the center server.

The invention discloses a tactile stick and a safe path navigation method thereof, electronic equipment and a storage medium, and is applied to the technical field of blind navigation. The method comprises the steps of planning a path according to a current position and a target position of a user, and generating an initial path; guiding a user to advance along the initial path; establishing a path width model, and obtaining a safe path width through the path width model; the position of the user is monitored in real time in the advancing process, and it is ensured that the user is within the safe path width range all the time. Through organic combination of the tactile stick and the visual camera, a cooperative working system is formed, and the position relation between a user and the safety path width is monitored in real time; through vibration feedback of different levels, the user is reminded to adjust the advancing direction in real time so as to ensure that the user always advances within the safe path width range of the path. And the safety and independence of visually impaired people are greatly improved.

The invention discloses a real-time stair detection method based on iOS equipment carrying laser radar. Firstly, coarse recognition is performed on stairs through YOLOv8 (S1), then depth data is acquired by using a laser radar and converted into point cloud data, and voxel downsampling, radius denoising and height filtering preprocessing are performed (S2). In the fine detection stage, judgment is carried out according to the height relation between the point cloud and the ground: when the point cloud is lower than the ground, a plane is detected by adopting an RANSAC algorithm, and downstairs are identified by combining the area and a normal vector threshold value; and when the height is higher than the ground, analyzing the height difference, the normal vector and the number of point clouds of adjacent planes by using a region growing method, and judging stair climbing (S3). According to the method, computer vision and a point cloud processing technology are fused, efficient and accurate stair detection is realized, reliable stair sensing ability is provided for visually impaired people, and travel safety is remarkably improved.

The invention discloses a blind guide stick local obstacle avoidance navigation method based on multi-sensor fusion, which comprises a telescopic blind guide stick, an RGB-D depth camera, a radar and other sensors and a high-performance processor, so as to realize accurate environmental perception and intelligent navigation functions and improve the travel safety and convenience of blind people and visually impaired people. The method comprises the following steps: acquiring depth information of a surrounding environment through an RGB-D depth camera, providing a three-dimensional perception capability of a scene, performing auxiliary correction on information acquired by the RGB-D depth camera through a plurality of sensors such as radar, transmitting the information acquired by the sensors to a high-performance processor, and performing SLAM (Simultaneous Localization and Map Construction) algorithm so as to obtain the three-dimensional perception capability of the scene. According to the method, information collected by multiple sensors is fused, the pose information of the current blind guiding stick is calculated, nonlinear optimization is carried out according to the calculated pose information and measured depth information, the result of nonlinear optimization is used for establishing an octree map of the environment, and a reasonable obstacle avoidance path is generated according to the octree map. And the obstacle avoidance path is fed back to the blind and visually impaired people in real time in a voice or vibration mode.

The invention discloses a handicapped friendly smart home system based on an AI large model, and the system comprises the following modules: a voice control module which is used for receiving and analyzing a voice instruction of a user through the voice recognition and natural language processing technology, and generating a corresponding control signal; the visual auxiliary module is used for collecting environment information through a camera and a sensor, performing object recognition, text reading and environment perception in combination with an AI large model, and providing real-time assistance for visually impaired people; the automatic task module is used for automatically executing control tasks, including light adjustment, temperature control, music playing and the like, of the household equipment according to the behavior mode of the user and a preset condition; the health monitoring module is used for collecting health data of a user through a sensor, performing data analysis in combination with an AI large model, and giving an alarm under an abnormal condition; and the barrier-free navigation module is used for providing an intelligent navigation function for the physically handicapped people through an AI technology and helping the physically handicapped people move freely at home.

The invention relates to the technical field of intelligent traffic equipment, in particular to an induction blind sidewalk brick, a trigger type tactile stick and a blind sidewalk cooperation system. The sensing blind sidewalk brick comprises a blind sidewalk brick body and a sensing device, wherein a cavity is formed in the blind sidewalk brick body; the trigger device is arranged on the blind sidewalk brick body and is used for receiving a trigger signal triggered by short-distance wireless induction; the sensing device is arranged in the cavity and is in signal connection with the triggering device, and the sensing device sends out a warning signal after the triggering device receives the triggering signal; wherein the trigger device is a tactile stick trigger device; a trigger signal triggered by short-distance wireless induction is sent out by the tactile stick. According to the tactile stick, a point-to-point identification relation is established through close-range induction (magnetism, metal and radio frequency), and the effect that the brick responds only when a visually impaired person carrying the tactile stick arrives is achieved; the selective triggering suppresses broadcast flooding caused by scene noise (raindrops, footsteps, baby carriages and the like), so that information fatigue and urban noise pollution are avoided.

A guide dog robot for visually impaired persons is provided. The guide dog robot includes a harness unit configured to grip a visually impaired person, a spring damper unit connected to the harness unit and configured to move in an axial direction, based on an external force acting between the visually impaired person and the guide dog robot, and a body part configured to perform movement based on a movement intention of the visually impaired person and a moving motion of the guide dog robot, the body part including an upper surface with the spring damper unit mounted thereon. Each of the harness unit, the spring damper unit, and the body part comprises an inertia measurement unit (IMU), and the IMU measures a position and a speed at a position at which the IMU is equipped.

A self-service checkout terminal for vision-based checkout includes a computing device having a processor and a memory. A camera coupled to the computing device has a predefined field of view focused on a scan zone and provides a video output signal of the scan zone to the computing device. A checkout tray has a tactile surface formed from a predefined number of rows and a predefined number of columns of raised dot. The checkout tray is positioned within the scan zone. The processor processes the video output signal from the camera to attempt to identify an item placed on the checkout tray by a user during a transaction, provides a description of the item to the user via the user interface when the item is identified, and provides the user of an indication of a location of the item via a user interface when the item is not identified.

The invention provides an information processing system. The information processing system comprises an image acquisition device used for acquiring front image data; the analysis server device is used for analyzing the collected image data; the voice output device is used for carrying out voice prompt on visually impaired people according to the analyzed image data; and the display device is used for performing augmented reality display according to the analyzed image data.

The invention discloses a complex environment recognition and intelligent interaction system for blind person navigation, and aims to provide safer and humanized travel assistance for blind persons or visually impaired persons. Based on a travel route planned by map software, a YOLOv8 target detection algorithm added with a CBAM attention mechanism is combined with a visual large model to carry out complex scene recognition, and a recognition result is transmitted to the large language model. And the large language model generates an active warning text or answers questions of the user according to the recognition result, and feeds back the questions to the user in a voice form to realize intelligent interaction. Meanwhile, on the basis of the average step length calculated by the monocular vision technology and the self-correlation analysis algorithm, the broadcasting unit is converted from'meter 'to'step', and the humanization of voice broadcasting is improved. According to the invention, front and back end information transmission is combined, and complex environment identification, voice interaction and humanized guidance technologies are introduced, so that the safety, interactivity and user experience of blind person navigation assistance are remarkably improved.

1. Name of the Design Product: Scent Cognition Book for Visually Impaired Persons. 2. Use of the Design Product: Reading materials for visually impaired persons. 3. Design Key Points of the Design Product: Lies in the shape. 4. Picture or Photograph that Best Shows the Design Key Points: Front View.

The invention discloses an indoor path planning method based on fusion of an improved He-Map algorithm and a DWA and a wearable blind guiding robot dog. A user activates a blind guiding robot dog system through a voice instruction, a stable holder is adjusted to a working state, stable operation of a sensor is ensured, and a path grid map is created by taking a user demand as a blind guiding punctuation; inputting the created path grid map into the improved He-Map algorithm, and outputting a global planning track; performing local refinement on the obtained global planning trajectory by using a DWA algorithm, generating a local collision avoidance trajectory, and obtaining an optimal trajectory; smoothing the optimal trajectory generated by the DWA algorithm by using a B spline optimization method, and generating an optimal speed and angular acceleration instruction; and when the user approaches the target point, the system provides an arrival prompt to ensure that the visually impaired person can safely arrive at the destination, and the navigation service is ended. According to the invention, visually impaired people can be smoothly guided to arrive at a destination, obstacles can be avoided in time, and safe and efficient indoor navigation experience is ensured.

An object of the system according to the embodiment is to enable a hearing-impaired person to perform a carrying procedure without sign language or assistance.SOLUTION: A system according to an embodiment includes a generation AI and an explanation unit. The generation AI generates contract contents. The explanation unit explains the contract content generated by the generation AI by voice in cooperation with the transcription application. The explanation part explains by characters for the hearing-impaired person and explains by voice for the visually impaired person.SELECTED DRAWING: Figure 1

To provide a route data processing device and the like capable of guiding even a visually impaired person to travel safely.SOLUTION: A route data processing device includes the steps of: acquiring sound data indicating a guide point recognizable by a visually impaired person and location data indicating the location of the guide point; recording guide point data PT for the visually impaired person in map data MP based on the acquired sound data and position data; acquiring a request to send route data that shows the route to the destination; generating a route that corresponds to the acquired sent request and includes the guide point; and transmitting the route data indicating the generated route to a sender of the request.SELECTED DRAWING: Figure 4

An apparatus (1 ) for assisting visually impaired persons, comprising: - at least one image or video acquisition camera (2) positionable on a device wearable by a person; said camera (2) being configured to generate a video signal (3) in real time; - a processing unit (4) connected to the camera (2) and configured to: receive said video signal (3); process the images contained in said video signal (3); characterised in that said processing unit (4) is further configured to transduce said video signal into an audio and / or vibration signal, preferably a 3D sound, which can be played back on an audio or vibration playback device (6) associable with the user so that the latter can perceive such sound or vibration corresponding to the configuration of the environment and the position of the obstacles.

To provide an elevator car capable of making it easier for visually impaired people to recognize the number of car doors.SOLUTION: An elevator car comprises car doors 12 and 13 that open and close, and a car handrail 20 arranged inside. The car handrail 20 comprises a handrail part 22 extending in a first lateral direction, and a door display part 24 formed in an uneven shape on a surface of the handrail part 22 to indicate the number of the car doors 12 and 13.SELECTED DRAWING: Figure 4

The utility model relates to an electric plugboard for the blind. The electric plugboard comprises an electric plugboard main body; a jack is arranged on the electric plugboard main body, one board surface of the electric plugboard main body is inclined upwards, and the jack is arranged on the inclined board surface; guiding grooves extend above the inserting openings, and the number of the inserting openings corresponds to the number of the guiding grooves. The electric plugboard main body is simple in structure, visually impaired people can touch the fixed electric plugboard main body and rapidly move a plug according to the groove length direction of a guide groove through the guide groove formed in the upper portion of the socket of the inclined panel, and then the plug is inserted into the socket, so that the plug is rapidly and correspondingly inserted into the jack in the socket, and the safety is improved. And visually impaired people can use the electric plug board conveniently and are not easy to get an electric shock.

The utility model belongs to the technical field of Bluetooth equipment, and discloses blind person traffic signal prompting equipment based on low-power RSSI Bluetooth, which is used for being matched with a Bluetooth terminal arranged on an intersection signal lamp to carry out signal receiving and transmitting and intersection passing prompting, and comprises a shell and a circuit board arranged in the shell, the circuit board is connected with a Bluetooth module, a loudspeaker module and a battery through pin welding; the front surface of the housing is provided with a horn mouth corresponding to the internal horn module, and the horn mouth is filled with waterproof sound transmission cotton. According to the utility model, the prompting device worn on the body of the visually impaired person can be identified at the intersection provided with the corresponding Bluetooth terminal, and after the visually impaired person wearing the prompting device is captured within a certain range through the low-power-consumption Bluetooth technology, information is pushed to guide pedestrians to cross the street. Compared with existing camera recognition auxiliary equipment, the camera recognition auxiliary equipment is low in cost, and compared with existing GPS auxiliary equipment, the camera recognition auxiliary equipment is high in accuracy.

The invention provides a blind guiding system, a blind guiding method and a blind guiding waistcoat, and relates to the technical field of blind guiding assistance, the system comprises an ultrasonic sensor for monitoring surrounding obstacles, a camera for acquiring traffic light image data, a microphone for acquiring human voice signals, and a positioning module for acquiring satellite signals; the obstacle avoidance module performs early warning on surrounding obstacles and outputs early warning information to the loudspeaker for playing; the traffic light recognition module inputs the traffic light image data into a pre-trained traffic light recognition model and outputs a traffic light recognition result to a loudspeaker for playing; the voice recognition and broadcast module performs voice recognition processing on the human voice signal and outputs a voice interaction result to the loudspeaker for playing; the navigation module carries out path planning processing on the satellite signals and outputs navigation information of path planning to the loudspeaker for playing. According to the invention, the environment identification precision and accuracy can be effectively improved, and the life quality and autonomous movement ability of visually impaired people are improved.

A computer-implemented procedure comprises: (i) determining a user's current location using location data, (ii) determining, using location data, a user device's starting point based on the current location and a user device's destination based on user input, (iii) identifying, via a pedestrian route planner of a route planning application communicating with a navigation system, a pedestrian route between the starting point and the destination, (iv) identifying, via the navigation system, waypoints between the starting point and the destination, (v) transmitting the pedestrian route to the user device, (vi) outputting, via the route planning application, i) a haptic feedback protocol and / or ii) an acoustic feedback protocol associated with the waypoints.are, (vii) receiving pedestrian route data from the user device, and (viii) processing the pedestrian route data to determine user behavior.

The utility model discloses an intelligent bracelet, which relates to the field of blind guiding, and is characterized in that an environment detection module is integrated in the intelligent bracelet, so that blind sidewalks and obstacles in a preset range can be identified; a main control chip integrated in the intelligent bracelet can control a prompt module to give out corresponding prompts according to the blind sidewalk and the obstacles recognized by an environment monitoring module, so that a wearer can walk on the blind sidewalk according to the prompts and safely avoid the obstacles, and in addition, compared with a blind guiding stick, the intelligent bracelet provided by the scheme is lighter, easier to carry and more convenient to use. And secondly, compared with the purchasing of a seeing-eye dog, the use of the intelligent bracelet is lower in cost, easy to obtain, simple to maintain, less in use limitation, free from the influence of factors such as territory and environment, and richer in functionality. And the braille button is arranged at the power switch of the intelligent bracelet, so that the intelligent bracelet is more convenient for the old and visually impaired people to use.