215 results about "Visually Impaired Persons" patented technology

The invention discloses an image processing method and system for intelligent glasses, and relates to the technical field of image recognition. The method comprises the following steps: synchronizing and preprocessing data collected by heterogeneous sensors in the intelligent glasses; constructing a global space-time coordinate system; a high-risk area is determined through dynamic saliency analysis, a high-resolution detection ROI is generated, full-pixel analysis is performed on a focus area, and an obstacle list with 3D positions, categories and danger levels is output; and generating a personalized safety path through a safety corridor generation algorithm based on the 3D position of the obstacle, the motion model of the visually impaired person and the real-time position. Data collected by heterogeneous sensors in the intelligent glasses are synchronized, a global space-time coordinate system is constructed, path planning is performed after obstacles are identified, high-frequency IMU angular velocity data and a self-adaptive optical flow correction network are fused, the image reverse compensation precision in a dynamic scene is improved, and navigation safety in a complex scene is guaranteed.

The invention discloses a multi-mode tactile and visual fusion identification method for medicine box braille salient point characters. The method comprises the following steps: acquiring three-dimensional morphology and pressure data of Braille salient points through a tactile sensor, acquiring an image and the like through a visual sensor, and performing preprocessing (improved U-Net segmentation, illumination correction and the like); hardware is utilized to trigger synchronization, an ICP algorithm is improved to complete space-time alignment, and a feature level (attention mechanism) and a decision level (D-S evidence theory) are fused; character semantics are analyzed by means of a multi-mode neural network, and multi-channel feedback is visualized through voice, tactile vibration and AR. A dynamic optimization mechanism is set, and sensor scheduling, incremental learning and safety verification are covered. The system comprises a tactile / visual perception module, a data processing module (FPGA + NPU), a feedback execution module and a communication module. According to the scheme, the problems of low traditional recognition precision and poor environmental adaptability are solved, high-precision medicine box braille recognition is achieved, and a reliable scheme suitable for multiple scenes is provided for safe medicine use of visually impaired people.

The invention relates to the technical field of blind guiding robot interactive navigation, and particularly discloses a blind guiding robot interactive navigation system combining vision, inertial navigation and voice, which is characterized in that environmental vision, movement and voice data are synchronously acquired through a multi-modal perception data acquisition module, and are analyzed through a situation-user joint state feature extraction module; a user potential intention deduction module is combined to predict a user intention and generate a self-adaptive guide strategy; a self-adaptive guiding path optimization module adjusts a navigation path according to a strategy to ensure safety and high efficiency; finally, the situational multi-mode interaction instruction output module provides voice and tactile feedback, and interaction experience and navigation autonomy are enhanced. According to the method, the travel problem of the visually impaired person in a complex environment is solved, the individuation, context perception capability and safety of blind guiding are improved, and more natural and efficient navigation assistance is brought to the visually impaired person.

The invention provides an intelligent tactile stick interaction method and system based on multi-modal perception and edge calculation, and relates to the technical field of intelligent auxiliary equipment. The method comprises the following steps: acquiring environment and position data through a camera, a GPS and an inertial measurement unit; performing multi-modal data fusion and deep learning identification by using an edge calculation module to generate a dynamic environment map; performing real-time path planning and obstacle avoidance based on a map and a destination; analyzing a user instruction through voice recognition and interactively adjusting a path; haptic and auditory bimodal feedback is provided through a vibration module and a voice synthesis module according to a navigation result; and when an emergency obstacle is detected or a user actively alarms, a local and remote alarm mechanism is triggered. The system correspondingly comprises an intelligent tactile stick terminal and a cloud server. According to the invention, accurate and real-time perception and intelligent navigation of the environment are realized, visual and natural interaction experience is provided, an effective emergency help channel is established, and the safety, independence and convenience of travel of visually impaired people are significantly improved.

The invention discloses a large-model visual impairment assisting robot system based on edge cloud collaboration, and is applied to the technical field of intelligent robots. Comprising a walking assembly, a framework support, a sitting and lying structure and an electrical control system. The walking assembly is arranged below the framework support and used for achieving movement and steering of the auxiliary robot. The sitting-lying structure is arranged in the middle of the framework support and used for achieving a seat function. And the electrical control system is used for realizing sensing and control functions. According to the invention, a large language model, a visual identification model, a voice synthesis model and a mobile robot platform are fused, multiple auxiliary services such as autonomous navigation, environment description, voice interaction and the like can be provided for visually impaired people in public culture or living places, and the travel independence, the information acquisition capability and the culture participation degree of the visually impaired people are remarkably improved.

The invention belongs to the field of visual impairment assistance, and particularly relates to a visual impairment person perception guide interaction control system and method, and the system comprises a multi-source sensor module, an information processing and analysis unit, an interaction feedback module, an intelligent Internet of Things module, and a user preference and scene self-adaption module. According to the visual impaired person perception guide interaction control system and method, through a multi-source sensor fusion technology, the limitation of a single sensor is effectively overcome. The high-definition imaging and low-light enhancement capability of the visual sensor, the close-range precise detection of the ultrasonic sensor, the stable motion monitoring of the inertial measurement unit and the high-precision positioning of the global navigation satellite system cooperate with one another, so that the comprehensive and precise sensing of the environment is realized, and the system is convenient to adapt to different environments. The accuracy of obstacle detection, target recognition and positioning is greatly improved, a solid and reliable environment cognition basis is provided for visually impaired people, and the visually impaired people can more accurately know the surrounding environment condition.

The invention discloses a radar-vision-I MU fused visual impaired person navigation system, which relates to the technical field of multi-source data processing, and is characterized in that a multi-source data collection module is arranged to collect obstacle distance information, ground feature image data and user motion state data in an environment; a time synchronization module is arranged to carry out space-time alignment on obstacle distance information and ground feature image data to generate multi-modal sensing data, a dynamic map generation module and a fusion model based on a particle filter algorithm are arranged, a dynamic environment map is constructed in combination with motion state data, and the spatial relationship between the current position of a user and surrounding obstacles is output. Setting a trajectory prediction module to perform path planning through a reinforcement learning algorithm to generate a prediction trajectory of user motion, and setting a multi-mode interaction module to output a voice navigation instruction to the visually impaired person through a bone conduction earphone based on the prediction trajectory and a dynamic environment map; the problem of intelligent navigation of a dynamic environment faced by visually impaired people is solved.

Proposed are a braille block with a QR code displayed for guiding the visually impaired and an information guidance system using the same, which more accurately provides the next movement information to the visually impaired on the basis of the movement route of the visually impaired and the entry direction into the current braille block analyzed through recognition of the QR code contained in the braille block, especially which analyzes and provides the information necessary to make corrections to the location of the braille block or corrections related to the QR code information contained in the braille block by analyzing whether the visually impaired actually move to or enter the guided braille block in the correct direction, and additionally which selects and provides customized information suitable for the corresponding visually impaired person among information contained in the QR code or content provided through the center server.

The invention discloses a real-time stair detection method based on iOS equipment carrying laser radar. Firstly, coarse recognition is performed on stairs through YOLOv8 (S1), then depth data is acquired by using a laser radar and converted into point cloud data, and voxel downsampling, radius denoising and height filtering preprocessing are performed (S2). In the fine detection stage, judgment is carried out according to the height relation between the point cloud and the ground: when the point cloud is lower than the ground, a plane is detected by adopting an RANSAC algorithm, and downstairs are identified by combining the area and a normal vector threshold value; and when the height is higher than the ground, analyzing the height difference, the normal vector and the number of point clouds of adjacent planes by using a region growing method, and judging stair climbing (S3). According to the method, computer vision and a point cloud processing technology are fused, efficient and accurate stair detection is realized, reliable stair sensing ability is provided for visually impaired people, and travel safety is remarkably improved.

The invention discloses a blind guide stick local obstacle avoidance navigation method based on multi-sensor fusion, which comprises a telescopic blind guide stick, an RGB-D depth camera, a radar and other sensors and a high-performance processor, so as to realize accurate environmental perception and intelligent navigation functions and improve the travel safety and convenience of blind people and visually impaired people. The method comprises the following steps: acquiring depth information of a surrounding environment through an RGB-D depth camera, providing a three-dimensional perception capability of a scene, performing auxiliary correction on information acquired by the RGB-D depth camera through a plurality of sensors such as radar, transmitting the information acquired by the sensors to a high-performance processor, and performing SLAM (Simultaneous Localization and Map Construction) algorithm so as to obtain the three-dimensional perception capability of the scene. According to the method, information collected by multiple sensors is fused, the pose information of the current blind guiding stick is calculated, nonlinear optimization is carried out according to the calculated pose information and measured depth information, the result of nonlinear optimization is used for establishing an octree map of the environment, and a reasonable obstacle avoidance path is generated according to the octree map. And the obstacle avoidance path is fed back to the blind and visually impaired people in real time in a voice or vibration mode.

The invention discloses a handicapped friendly smart home system based on an AI large model, and the system comprises the following modules: a voice control module which is used for receiving and analyzing a voice instruction of a user through the voice recognition and natural language processing technology, and generating a corresponding control signal; the visual auxiliary module is used for collecting environment information through a camera and a sensor, performing object recognition, text reading and environment perception in combination with an AI large model, and providing real-time assistance for visually impaired people; the automatic task module is used for automatically executing control tasks, including light adjustment, temperature control, music playing and the like, of the household equipment according to the behavior mode of the user and a preset condition; the health monitoring module is used for collecting health data of a user through a sensor, performing data analysis in combination with an AI large model, and giving an alarm under an abnormal condition; and the barrier-free navigation module is used for providing an intelligent navigation function for the physically handicapped people through an AI technology and helping the physically handicapped people move freely at home.

The invention relates to the technical field of intelligent traffic equipment, in particular to an induction blind sidewalk brick, a trigger type tactile stick and a blind sidewalk cooperation system. The sensing blind sidewalk brick comprises a blind sidewalk brick body and a sensing device, wherein a cavity is formed in the blind sidewalk brick body; the trigger device is arranged on the blind sidewalk brick body and is used for receiving a trigger signal triggered by short-distance wireless induction; the sensing device is arranged in the cavity and is in signal connection with the triggering device, and the sensing device sends out a warning signal after the triggering device receives the triggering signal; wherein the trigger device is a tactile stick trigger device; a trigger signal triggered by short-distance wireless induction is sent out by the tactile stick. According to the tactile stick, a point-to-point identification relation is established through close-range induction (magnetism, metal and radio frequency), and the effect that the brick responds only when a visually impaired person carrying the tactile stick arrives is achieved; the selective triggering suppresses broadcast flooding caused by scene noise (raindrops, footsteps, baby carriages and the like), so that information fatigue and urban noise pollution are avoided.

A guide dog robot for visually impaired persons is provided. The guide dog robot includes a harness unit configured to grip a visually impaired person, a spring damper unit connected to the harness unit and configured to move in an axial direction, based on an external force acting between the visually impaired person and the guide dog robot, and a body part configured to perform movement based on a movement intention of the visually impaired person and a moving motion of the guide dog robot, the body part including an upper surface with the spring damper unit mounted thereon. Each of the harness unit, the spring damper unit, and the body part comprises an inertia measurement unit (IMU), and the IMU measures a position and a speed at a position at which the IMU is equipped.

A self-service checkout terminal for vision-based checkout includes a computing device having a processor and a memory. A camera coupled to the computing device has a predefined field of view focused on a scan zone and provides a video output signal of the scan zone to the computing device. A checkout tray has a tactile surface formed from a predefined number of rows and a predefined number of columns of raised dot. The checkout tray is positioned within the scan zone. The processor processes the video output signal from the camera to attempt to identify an item placed on the checkout tray by a user during a transaction, provides a description of the item to the user via the user interface when the item is identified, and provides the user of an indication of a location of the item via a user interface when the item is not identified.

The invention provides an information processing system. The information processing system comprises an image acquisition device used for acquiring front image data; the analysis server device is used for analyzing the collected image data; the voice output device is used for carrying out voice prompt on visually impaired people according to the analyzed image data; and the display device is used for performing augmented reality display according to the analyzed image data.

The invention discloses a complex environment recognition and intelligent interaction system for blind person navigation, and aims to provide safer and humanized travel assistance for blind persons or visually impaired persons. Based on a travel route planned by map software, a YOLOv8 target detection algorithm added with a CBAM attention mechanism is combined with a visual large model to carry out complex scene recognition, and a recognition result is transmitted to the large language model. And the large language model generates an active warning text or answers questions of the user according to the recognition result, and feeds back the questions to the user in a voice form to realize intelligent interaction. Meanwhile, on the basis of the average step length calculated by the monocular vision technology and the self-correlation analysis algorithm, the broadcasting unit is converted from'meter 'to'step', and the humanization of voice broadcasting is improved. According to the invention, front and back end information transmission is combined, and complex environment identification, voice interaction and humanized guidance technologies are introduced, so that the safety, interactivity and user experience of blind person navigation assistance are remarkably improved.

1. Name of the Design Product: Scent Cognition Book for Visually Impaired Persons. 2. Use of the Design Product: Reading materials for visually impaired persons. 3. Design Key Points of the Design Product: Lies in the shape. 4. Picture or Photograph that Best Shows the Design Key Points: Front View.

An object of the system according to the embodiment is to enable a hearing-impaired person to perform a carrying procedure without sign language or assistance.SOLUTION: A system according to an embodiment includes a generation AI and an explanation unit. The generation AI generates contract contents. The explanation unit explains the contract content generated by the generation AI by voice in cooperation with the transcription application. The explanation part explains by characters for the hearing-impaired person and explains by voice for the visually impaired person.SELECTED DRAWING: Figure 1

To provide an elevator car capable of making it easier for visually impaired people to recognize the number of car doors.SOLUTION: An elevator car comprises car doors 12 and 13 that open and close, and a car handrail 20 arranged inside. The car handrail 20 comprises a handrail part 22 extending in a first lateral direction, and a door display part 24 formed in an uneven shape on a surface of the handrail part 22 to indicate the number of the car doors 12 and 13.SELECTED DRAWING: Figure 4

The utility model belongs to the technical field of Bluetooth equipment, and discloses blind person traffic signal prompting equipment based on low-power RSSI Bluetooth, which is used for being matched with a Bluetooth terminal arranged on an intersection signal lamp to carry out signal receiving and transmitting and intersection passing prompting, and comprises a shell and a circuit board arranged in the shell, the circuit board is connected with a Bluetooth module, a loudspeaker module and a battery through pin welding; the front surface of the housing is provided with a horn mouth corresponding to the internal horn module, and the horn mouth is filled with waterproof sound transmission cotton. According to the utility model, the prompting device worn on the body of the visually impaired person can be identified at the intersection provided with the corresponding Bluetooth terminal, and after the visually impaired person wearing the prompting device is captured within a certain range through the low-power-consumption Bluetooth technology, information is pushed to guide pedestrians to cross the street. Compared with existing camera recognition auxiliary equipment, the camera recognition auxiliary equipment is low in cost, and compared with existing GPS auxiliary equipment, the camera recognition auxiliary equipment is high in accuracy.

A computer-implemented procedure comprises: (i) determining a user's current location using location data, (ii) determining, using location data, a user device's starting point based on the current location and a user device's destination based on user input, (iii) identifying, via a pedestrian route planner of a route planning application communicating with a navigation system, a pedestrian route between the starting point and the destination, (iv) identifying, via the navigation system, waypoints between the starting point and the destination, (v) transmitting the pedestrian route to the user device, (vi) outputting, via the route planning application, i) a haptic feedback protocol and / or ii) an acoustic feedback protocol associated with the waypoints.are, (vii) receiving pedestrian route data from the user device, and (viii) processing the pedestrian route data to determine user behavior.

The utility model discloses an intelligent bracelet, which relates to the field of blind guiding, and is characterized in that an environment detection module is integrated in the intelligent bracelet, so that blind sidewalks and obstacles in a preset range can be identified; a main control chip integrated in the intelligent bracelet can control a prompt module to give out corresponding prompts according to the blind sidewalk and the obstacles recognized by an environment monitoring module, so that a wearer can walk on the blind sidewalk according to the prompts and safely avoid the obstacles, and in addition, compared with a blind guiding stick, the intelligent bracelet provided by the scheme is lighter, easier to carry and more convenient to use. And secondly, compared with the purchasing of a seeing-eye dog, the use of the intelligent bracelet is lower in cost, easy to obtain, simple to maintain, less in use limitation, free from the influence of factors such as territory and environment, and richer in functionality. And the braille button is arranged at the power switch of the intelligent bracelet, so that the intelligent bracelet is more convenient for the old and visually impaired people to use.

Input system (1) for inputting a code comprising a string containing at least numbers, wherein the input system (1) comprises: - a touch panel (2) configured to generate a contact detection signal (20) in response to the detection of a touch input gesture performed by a user (U) on the touch panel (2), wherein the contact detection signal (20) is an indicator of contact of one or more fingers (10) on the touch panel (2) during the touch input gesture; - a processing unit (3) configured to detect the contact detection signal (20) generated by the touch panel (2) and to select a single character depending on the contact detection signal (20) corresponding to the detected touch input gesture;wherein the input system (1) is characterized in that the processing unit (3) is configured to operate in an input mode to select numbers from a first string of characters comprising all or some of the numbers “0” to “9” by performing the following steps: - Determining that the touch input gesture is performed in the form of a main swipe movement (4) corresponding to the swipe movement of at least one finger (10) on the touch field (2) from a main starting point (41) to a main end point (42), where the main swipe movement (4) is interrupted by retracting the at least one finger (10), depending on the contact detection signal (20); - Determining a swipe movement vector (40) of the main swipe movement (4) depending on the contact detection signal (20);- Selecting a number from the first row of characters depending on the swipe movement vector (40) of the main swipe movement (4) independently of the main starting point (41) on the touch field (2).;

Tactile floor guidance system for persons with impaired vision, comprising an arrangement of guidance elements (100) laid on a floor with a tactilely perceptible surface structure (120), wherein the arrangement extends along a predefinable path to guide persons along this path, and wherein the arrangement of guidance elements (100) includes at least one curved guidance element (300) in addition to straight guidance elements (200).

The invention relates to the technical field of visual impaired people equipment, in particular to a visual impaired people out-of-user travel system based on a target detection technology and application thereof. Comprising a core processing module and an intelligent bracelet module, the core processing module is used for detecting the front environment; the intelligent bracelet module is used for vibrating at the wrist of a user according to data detected by the core processing module, the core processing module comprises a shell, a cooling fan is fixed to the top of the shell, a first data processing board is fixed in the top end of the shell, and a start button is fixed in one side of the shell; and a second data processing board is fixed in the shell and located at the top of the first data processing board. According to the visual impaired person out-of-user travel system based on the target detection technology and the application thereof provided by the invention, the response speed of dangerous information feedback is improved through a method of combining local visual model identification and distance detection; in addition, through the combination of multiple functions, the safety of the visually impaired patient is guaranteed more comprehensively.

The present invention relates to a structure for holding aromatic liquids for the process of learning colours and carrying out craft activities by the visually impaired. The movable colour structure for holding paint and aromatic liquids makes it possible for the visually impaired to learn the colours by smell, and allows the use thereof as a colour palette for craft activities involving colours, such as drawing and painting. The palette comprises a small polygonal base (1B) fastened to a rotating connector (1A), which is connected to a large polygonal base (4, 5,6 and 7), the perimeter of which contains circular cavities (C) in which paint bottles (B) are fastened or paint is added directly without the use of a bottle, and openings (A) into which separate bottles (D) may be inserted, in which the aromatic liquids are stored.

The invention discloses a control method, device and equipment for a visually impaired person friendly scrubber and a medium, the control method for the visually impaired person friendly scrubber comprises the steps of collecting an environment image through a visual module of the scrubber, constructing a space model containing obstacle state information by utilizing cloud artificial intelligence, and planning a cleaning path according to the space model; a user is actively pulled to move through the driving module, and guiding type cleaning is achieved. In the cleaning process, the system continuously monitors environment images and dynamically compares obstacle state changes, once abnormity is detected, the system uploads an image of a change area to a cloud end for accurate type recognition, and a recognition result is fed back to a user in a multi-sense-organ mode such as voice and vibration. According to the method, a user with visual impairment can independently and safely operate the scrubber through non-visual perception, the problem that in the prior art, adaptability is poor is solved, and barrier-free use experience and safety of products are improved.

The invention discloses a manufacturing method of a medicine use manual for visually impaired people, and the manufacturing method of the medicine use manual comprises the following steps: 1, determining the content information of medicines; step 2, performing braille translation and determining audio; step 3, making a manual; step 4, carrying out pilot distribution; step 5, performing improvement and large-scale distribution; according to the manufacturing method of the medication manual for the visually impaired people, a brand new medication guidance mode is provided for the visually impaired people through combination of braille alphabets and audios and two sensory experiences of tactile sense and auditory sense. The innovation breaks through a traditional medication guidance mode depending on vision, so that medication information is more diversified, and inclusiveness is higher. The barrier-free design concept is throughout the whole project, and the use requirements of visually impaired people are fully considered. Therefore, the barrier in the traditional product design can be broken, and the social inclusiveness and peaceability can be promoted.

A guide dog robot for visually impaired persons is provided. The guide dog robot includes a harness unit configured to grip a visually impaired person, a spring damper unit connected to the harness unit and configured to move in an axial direction, based on an external force acting between the visually impaired person and the guide dog robot, and a body part configured to perform movement based on a movement intention of the visually impaired person and a moving motion of the guide dog robot, the body part including an upper surface with the spring damper unit mounted thereon. Each of the harness unit, the spring damper unit, and the body part comprises an inertia measurement unit (IMU), and the IMU measures a position and a speed at a position at which the IMU is equipped.

A drug administration management method according to one embodiment disclosed herein may comprise the steps of: receiving identification information of a first drug from a pharmacist terminal; transmitting permission information corresponding to the identification information of the first drug to the pharmacist terminal; receiving customized medication guidance, in which the permission information is personalized according to patient profile information of a patient, from the pharmacist terminal, and storing the customized medication guidance in a patient information database; receiving identification information of a drug from a patient terminal and searching for the identification information of the drug in an internal database; and generating a customized administration schedule for the patient according to administration schedule information of the first drug included in the customized medication guidance if the searched identification information of the drug is the identification information of the first drug.