163 results about "Visually Impaired Persons" patented technology

The invention relates to the technical field of blind guiding robot interactive navigation, and particularly discloses a blind guiding robot interactive navigation system combining vision, inertial navigation and voice, which is characterized in that environmental vision, movement and voice data are synchronously acquired through a multi-modal perception data acquisition module, and are analyzed through a situation-user joint state feature extraction module; a user potential intention deduction module is combined to predict a user intention and generate a self-adaptive guide strategy; a self-adaptive guiding path optimization module adjusts a navigation path according to a strategy to ensure safety and high efficiency; finally, the situational multi-mode interaction instruction output module provides voice and tactile feedback, and interaction experience and navigation autonomy are enhanced. According to the method, the travel problem of the visually impaired person in a complex environment is solved, the individuation, context perception capability and safety of blind guiding are improved, and more natural and efficient navigation assistance is brought to the visually impaired person.

The invention provides an intelligent tactile stick interaction method and system based on multi-modal perception and edge calculation, and relates to the technical field of intelligent auxiliary equipment. The method comprises the following steps: acquiring environment and position data through a camera, a GPS and an inertial measurement unit; performing multi-modal data fusion and deep learning identification by using an edge calculation module to generate a dynamic environment map; performing real-time path planning and obstacle avoidance based on a map and a destination; analyzing a user instruction through voice recognition and interactively adjusting a path; haptic and auditory bimodal feedback is provided through a vibration module and a voice synthesis module according to a navigation result; and when an emergency obstacle is detected or a user actively alarms, a local and remote alarm mechanism is triggered. The system correspondingly comprises an intelligent tactile stick terminal and a cloud server. According to the invention, accurate and real-time perception and intelligent navigation of the environment are realized, visual and natural interaction experience is provided, an effective emergency help channel is established, and the safety, independence and convenience of travel of visually impaired people are significantly improved.

The invention discloses a large-model visual impairment assisting robot system based on edge cloud collaboration, and is applied to the technical field of intelligent robots. Comprising a walking assembly, a framework support, a sitting and lying structure and an electrical control system. The walking assembly is arranged below the framework support and used for achieving movement and steering of the auxiliary robot. The sitting-lying structure is arranged in the middle of the framework support and used for achieving a seat function. And the electrical control system is used for realizing sensing and control functions. According to the invention, a large language model, a visual identification model, a voice synthesis model and a mobile robot platform are fused, multiple auxiliary services such as autonomous navigation, environment description, voice interaction and the like can be provided for visually impaired people in public culture or living places, and the travel independence, the information acquisition capability and the culture participation degree of the visually impaired people are remarkably improved.

The invention belongs to the field of visual impairment assistance, and particularly relates to a visual impairment person perception guide interaction control system and method, and the system comprises a multi-source sensor module, an information processing and analysis unit, an interaction feedback module, an intelligent Internet of Things module, and a user preference and scene self-adaption module. According to the visual impaired person perception guide interaction control system and method, through a multi-source sensor fusion technology, the limitation of a single sensor is effectively overcome. The high-definition imaging and low-light enhancement capability of the visual sensor, the close-range precise detection of the ultrasonic sensor, the stable motion monitoring of the inertial measurement unit and the high-precision positioning of the global navigation satellite system cooperate with one another, so that the comprehensive and precise sensing of the environment is realized, and the system is convenient to adapt to different environments. The accuracy of obstacle detection, target recognition and positioning is greatly improved, a solid and reliable environment cognition basis is provided for visually impaired people, and the visually impaired people can more accurately know the surrounding environment condition.

The invention discloses a radar-vision-I MU fused visual impaired person navigation system, which relates to the technical field of multi-source data processing, and is characterized in that a multi-source data collection module is arranged to collect obstacle distance information, ground feature image data and user motion state data in an environment; a time synchronization module is arranged to carry out space-time alignment on obstacle distance information and ground feature image data to generate multi-modal sensing data, a dynamic map generation module and a fusion model based on a particle filter algorithm are arranged, a dynamic environment map is constructed in combination with motion state data, and the spatial relationship between the current position of a user and surrounding obstacles is output. Setting a trajectory prediction module to perform path planning through a reinforcement learning algorithm to generate a prediction trajectory of user motion, and setting a multi-mode interaction module to output a voice navigation instruction to the visually impaired person through a bone conduction earphone based on the prediction trajectory and a dynamic environment map; the problem of intelligent navigation of a dynamic environment faced by visually impaired people is solved.

The invention relates to the technical field of intelligent traffic equipment, in particular to an induction blind sidewalk brick, a trigger type tactile stick and a blind sidewalk cooperation system. The sensing blind sidewalk brick comprises a blind sidewalk brick body and a sensing device, wherein a cavity is formed in the blind sidewalk brick body; the trigger device is arranged on the blind sidewalk brick body and is used for receiving a trigger signal triggered by short-distance wireless induction; the sensing device is arranged in the cavity and is in signal connection with the triggering device, and the sensing device sends out a warning signal after the triggering device receives the triggering signal; wherein the trigger device is a tactile stick trigger device; a trigger signal triggered by short-distance wireless induction is sent out by the tactile stick. According to the tactile stick, a point-to-point identification relation is established through close-range induction (magnetism, metal and radio frequency), and the effect that the brick responds only when a visually impaired person carrying the tactile stick arrives is achieved; the selective triggering suppresses broadcast flooding caused by scene noise (raindrops, footsteps, baby carriages and the like), so that information fatigue and urban noise pollution are avoided.

A guide dog robot for visually impaired persons is provided. The guide dog robot includes a harness unit configured to grip a visually impaired person, a spring damper unit connected to the harness unit and configured to move in an axial direction, based on an external force acting between the visually impaired person and the guide dog robot, and a body part configured to perform movement based on a movement intention of the visually impaired person and a moving motion of the guide dog robot, the body part including an upper surface with the spring damper unit mounted thereon. Each of the harness unit, the spring damper unit, and the body part comprises an inertia measurement unit (IMU), and the IMU measures a position and a speed at a position at which the IMU is equipped.

The invention provides an information processing system. The information processing system comprises an image acquisition device used for acquiring front image data; the analysis server device is used for analyzing the collected image data; the voice output device is used for carrying out voice prompt on visually impaired people according to the analyzed image data; and the display device is used for performing augmented reality display according to the analyzed image data.

An object of the system according to the embodiment is to enable a hearing-impaired person to perform a carrying procedure without sign language or assistance.SOLUTION: A system according to an embodiment includes a generation AI and an explanation unit. The generation AI generates contract contents. The explanation unit explains the contract content generated by the generation AI by voice in cooperation with the transcription application. The explanation part explains by characters for the hearing-impaired person and explains by voice for the visually impaired person.SELECTED DRAWING: Figure 1

The utility model belongs to the technical field of Bluetooth equipment, and discloses blind person traffic signal prompting equipment based on low-power RSSI Bluetooth, which is used for being matched with a Bluetooth terminal arranged on an intersection signal lamp to carry out signal receiving and transmitting and intersection passing prompting, and comprises a shell and a circuit board arranged in the shell, the circuit board is connected with a Bluetooth module, a loudspeaker module and a battery through pin welding; the front surface of the housing is provided with a horn mouth corresponding to the internal horn module, and the horn mouth is filled with waterproof sound transmission cotton. According to the utility model, the prompting device worn on the body of the visually impaired person can be identified at the intersection provided with the corresponding Bluetooth terminal, and after the visually impaired person wearing the prompting device is captured within a certain range through the low-power-consumption Bluetooth technology, information is pushed to guide pedestrians to cross the street. Compared with existing camera recognition auxiliary equipment, the camera recognition auxiliary equipment is low in cost, and compared with existing GPS auxiliary equipment, the camera recognition auxiliary equipment is high in accuracy.

A computer-implemented procedure comprises: (i) determining a user's current location using location data, (ii) determining, using location data, a user device's starting point based on the current location and a user device's destination based on user input, (iii) identifying, via a pedestrian route planner of a route planning application communicating with a navigation system, a pedestrian route between the starting point and the destination, (iv) identifying, via the navigation system, waypoints between the starting point and the destination, (v) transmitting the pedestrian route to the user device, (vi) outputting, via the route planning application, i) a haptic feedback protocol and / or ii) an acoustic feedback protocol associated with the waypoints.are, (vii) receiving pedestrian route data from the user device, and (viii) processing the pedestrian route data to determine user behavior.

The utility model discloses an intelligent bracelet, which relates to the field of blind guiding, and is characterized in that an environment detection module is integrated in the intelligent bracelet, so that blind sidewalks and obstacles in a preset range can be identified; a main control chip integrated in the intelligent bracelet can control a prompt module to give out corresponding prompts according to the blind sidewalk and the obstacles recognized by an environment monitoring module, so that a wearer can walk on the blind sidewalk according to the prompts and safely avoid the obstacles, and in addition, compared with a blind guiding stick, the intelligent bracelet provided by the scheme is lighter, easier to carry and more convenient to use. And secondly, compared with the purchasing of a seeing-eye dog, the use of the intelligent bracelet is lower in cost, easy to obtain, simple to maintain, less in use limitation, free from the influence of factors such as territory and environment, and richer in functionality. And the braille button is arranged at the power switch of the intelligent bracelet, so that the intelligent bracelet is more convenient for the old and visually impaired people to use.

Input system (1) for inputting a code comprising a string containing at least numbers, wherein the input system (1) comprises: - a touch panel (2) configured to generate a contact detection signal (20) in response to the detection of a touch input gesture performed by a user (U) on the touch panel (2), wherein the contact detection signal (20) is an indicator of contact of one or more fingers (10) on the touch panel (2) during the touch input gesture; - a processing unit (3) configured to detect the contact detection signal (20) generated by the touch panel (2) and to select a single character depending on the contact detection signal (20) corresponding to the detected touch input gesture;wherein the input system (1) is characterized in that the processing unit (3) is configured to operate in an input mode to select numbers from a first string of characters comprising all or some of the numbers “0” to “9” by performing the following steps: - Determining that the touch input gesture is performed in the form of a main swipe movement (4) corresponding to the swipe movement of at least one finger (10) on the touch field (2) from a main starting point (41) to a main end point (42), where the main swipe movement (4) is interrupted by retracting the at least one finger (10), depending on the contact detection signal (20); - Determining a swipe movement vector (40) of the main swipe movement (4) depending on the contact detection signal (20);- Selecting a number from the first row of characters depending on the swipe movement vector (40) of the main swipe movement (4) independently of the main starting point (41) on the touch field (2).;

Tactile floor guidance system for persons with impaired vision, comprising an arrangement of guidance elements (100) laid on a floor with a tactilely perceptible surface structure (120), wherein the arrangement extends along a predefinable path to guide persons along this path, and wherein the arrangement of guidance elements (100) includes at least one curved guidance element (300) in addition to straight guidance elements (200).

The invention discloses a control method, device and equipment for a visually impaired person friendly scrubber and a medium, the control method for the visually impaired person friendly scrubber comprises the steps of collecting an environment image through a visual module of the scrubber, constructing a space model containing obstacle state information by utilizing cloud artificial intelligence, and planning a cleaning path according to the space model; a user is actively pulled to move through the driving module, and guiding type cleaning is achieved. In the cleaning process, the system continuously monitors environment images and dynamically compares obstacle state changes, once abnormity is detected, the system uploads an image of a change area to a cloud end for accurate type recognition, and a recognition result is fed back to a user in a multi-sense-organ mode such as voice and vibration. According to the method, a user with visual impairment can independently and safely operate the scrubber through non-visual perception, the problem that in the prior art, adaptability is poor is solved, and barrier-free use experience and safety of products are improved.

A guide dog robot for visually impaired persons is provided. The guide dog robot includes a harness unit configured to grip a visually impaired person, a spring damper unit connected to the harness unit and configured to move in an axial direction, based on an external force acting between the visually impaired person and the guide dog robot, and a body part configured to perform movement based on a movement intention of the visually impaired person and a moving motion of the guide dog robot, the body part including an upper surface with the spring damper unit mounted thereon. Each of the harness unit, the spring damper unit, and the body part comprises an inertia measurement unit (IMU), and the IMU measures a position and a speed at a position at which the IMU is equipped.

A drug administration management method according to one embodiment disclosed herein may comprise the steps of: receiving identification information of a first drug from a pharmacist terminal; transmitting permission information corresponding to the identification information of the first drug to the pharmacist terminal; receiving customized medication guidance, in which the permission information is personalized according to patient profile information of a patient, from the pharmacist terminal, and storing the customized medication guidance in a patient information database; receiving identification information of a drug from a patient terminal and searching for the identification information of the drug in an internal database; and generating a customized administration schedule for the patient according to administration schedule information of the first drug included in the customized medication guidance if the searched identification information of the drug is the identification information of the first drug.

The invention relates to the field of audio-visual conversion, and provides intelligent audio-visual auxiliary glasses, an audio-visual auxiliary method, electronic equipment and a storage medium, and the intelligent audio-visual auxiliary glasses comprise a glasses frame which comprises a microphone and lenses; the character conversion unit is used for receiving external sound information through the microphone, converting the sound information into characters and displaying the characters on the lens; and the voice conversion unit is used for receiving external visual information through the visual sensor, converting the visual information into voice and playing the voice. The invention provides an integrated audio-visual conversion device, which is used for solving the defect of lack of audio-visual conversion devices for visually impaired people and hearing impaired people in the prior art, can help the visually impaired people to obtain front visual information and can also help the hearing impaired people to obtain sound information, so that the audio-visual conversion effect is improved. And bidirectional enhancement of visual information and auditory information is realized.

The utility model provides a crossing auxiliary device for visually impaired people, which relates to the technical field of traffic auxiliary devices and comprises a shell, a camera, an auxiliary monitoring sensor, a voice broadcast module and a trigger switch are arranged on the shell, and a power supply and a control mainboard are arranged in the shell. The camera, the auxiliary monitoring sensor, the voice broadcast module and the trigger switch are respectively in signal connection with the control mainboard, the power supply is used for supplying power to the camera, the voice broadcast module and the control mainboard, the camera is used for shooting intersection traffic light images, and the auxiliary monitoring sensor is used for monitoring pedestrian crossing traffic flow. According to the utility model, through combination of traffic light state identification and traffic flow detection, street-crossing auxiliary guidance is provided for visually impaired people, so that the safety risk of street crossing of the visually impaired people is further reduced.

The invention discloses an intelligent blind guiding stick based on stride frequency self-adaption. The intelligent blind guiding stick comprises a stick body, a sensor group, a prompt group and a stride frequency self-adaption control module, the sensor group comprises an ultrasonic sensor, an infrared sensor, an IMU (Inertial Measurement Unit) sensor and a photosensitive sensor; the ultrasonic sensor and the infrared sensor cooperatively detect obstacles; the prompting group executes prompting according to the detection result; the stride frequency adaptive control module dynamically coordinates the weight distribution of the ultrasonic sensor and the infrared sensor according to the user walking stride frequency f detected by the IMU sensor in real time and the ambient light intensity L detected by the photosensitive sensor in real time, and the scanning interval of the ultrasonic sensor and the infrared sensor is dynamically adjusted according to the weight distribution result. The working mode of the sensor can be intelligently adjusted according to the walking state of the user, and the method is particularly suitable for daily travel navigation and safety protection of visually impaired people.

A cane comprises a pole structure and a stand-up mount. The pole structure has a handle and a tip. The stand-up mount has at least three legs that transition between a retracted position and an engaged position. The legs are nearer to the pole structure in the retracted position. The legs extend outwardly from the pole structure in the engaged position to permit the cane to stand upright on its own. The stand-up mount can be manually activated or it can include a battery-powered actuator to be automatically activated by the user.

The invention discloses a visual impaired people barrier-free travel multi-source perception aid decision-making method and system, and belongs to the technical field of barrier-free travel. The system comprises an intelligent wearable device end and a public carrier end. The wearable device end adopts a visual SLAM and UWB-IMU tight coupling algorithm to realize hybrid positioning; and the public carrier end generates a high-precision local point cloud by adopting LiDAR-SLAM, and broadcasts the high-precision local point cloud to the outside after carrying out lightweight processing on the high-precision local point cloud. And when the user approaches, the wearable device end receives and matches the point cloud, and calculates the accurate relative pose with the vehicle door of the carrier. And finally, the system generates a three-dimensional audio signal with clear spatial directivity by using a head-related transfer function model based on the pose, so as to realize visual guidance for the user. According to the invention, through human-vehicle cooperative sensing and positioning, full-scene seamless navigation and centimeter-level accurate docking are realized, and through visual spatial audio guidance, the travel safety and convenience of visually impaired people are significantly improved.

An electronic price information and / or product information display device, abbreviated as display device, configured to visually reproduce product price information and / or product information and configured to store reproduction data representative of price information and / or product information, the display device comprising a first near-field communication device, in particular a first Near-Field-Communication device, abbreviated as NFC device, configured in particular for short-range contactless communication with a reproduction device having NFC functionality, the reproduction data comprising display reproduction data defined for visual reproduction of the price information and / or product information by the electronic price information and / or product information display device itself and output reproduction data provided in particular as reproduction data in audio and / or text format for output to the reproduction device by means of short-range contactless communication and enabling acoustic reproduction of the price information and / or product information by the reproduction device therein, the short-range communication device being configured to access the output reproduction data and to output the output reproduction data in the course of the short-range contactless communication.

To provide ticket paper which enables a visually handicapped person to easily discriminate the front and rear and can be used without anxiety.SOLUTION: In the ticket paper 1 in which a perforated line 11 not intended for cutting is provided on a paper base material 2 on which an optical code 4 is printed on the surface, a plurality of incision line parts penetrating the paper base material 2 are intermittently formed on the perforated line 11, and a tactile sense fine projecting part projecting only to the rear side of the paper base material 2 and generating a tactile sense different from that of the peripheral rear surface is formed on the incision line part of the perforated line 11. According to such a constitution, a visually handicapped person can touch and feel the tactile fine projection part of the perforation 11 and can easily and stably discriminate the front and back by the tactile feeling.SELECTED DRAWING: Figure 1

The utility model discloses a mechanism for identifying color information through touch. The mechanism comprises a carrier; the six contact points are arranged on the carrier, and the six contact points are arranged in a mode of two columns and three rows; the six contact points are respectively a pair of positioning points, a lightness point and three color points; the pair of positioning points are used for positioning directions; one lightness point is used for identifying the depth of the carrier color; the three color points are respectively a red point, a yellow point and a blue point, and the three color points are used for identifying the color of the carrier. The color touch recognition device is good in touch effect, convenient to use, high in adaptability and low in learning cost, performs color touch recognition according to the color composition principle, can be learned by visually impaired people within a few minutes, and effectively helps the visually impaired people to mark and recognize the color of an object.

The utility model relates to the technical field of braille dot matrixes, in particular to a braille dot matrix display device with a self-locking function. A braille dot matrix display device with a self-locking function comprises a base, a middle shell and the like, the top of the base is fixedly connected with the middle shell, the top of the middle shell is fixedly connected with a top cover, six contact blocks are slidably arranged on the top cover at intervals, six electromagnet assemblies are evenly arranged in the base, and jacking assemblies are arranged in the six electromagnet assemblies. The six jacking assemblies correspond to the six contact blocks respectively. According to the utility model, the permanent magnet and the ejector pin move up and down by controlling the current direction so as to drive the contact block to ascend and descend, and self-locking is realized when the contact block ascends to the highest position or descends to the lowest position by utilizing the interaction of the steel ball, the iron core and the ejector pin, so that the problem that most braille display devices are difficult to realize dot matrix self-locking is solved, and the heating value is effectively reduced; stable touch force feedback is provided for a user, and the reading requirements of visually impaired people are better met.

The system according to the embodiment aims to enable a visually impaired person to grasp the environment of their current location in a timely manner. [Solution] A system according to an embodiment includes an image acquisition unit, a position acquisition unit, an analysis unit, and a feedback unit. The image acquisition unit acquires image information. The position acquisition unit acquires position information. The analysis unit analyzes the information acquired by the image acquisition unit and the position acquisition unit. The feedback unit provides audio feedback of the information analyzed by the analysis unit.

The utility model discloses an intelligent blind guiding robot which comprises two sets of planet wheels. The power assembly, the control main body, the traction rod and the handle are sequentially arranged on the planet wheel from bottom to top; wherein each group of planet wheels comprises three rollers which are the same in size and are arranged in a central symmetry manner; the power assembly is used for providing driving force for the planet wheel and controlling the moving direction of the planet wheel. The control main body comprises a power supply, a processor and a sensor assembly which are packaged into a whole, and the processor is used for controlling the power assembly to adjust the moving direction of the planet wheel according to an obstacle image acquired by the sensor assembly; the traction rod is a rigid rod with the telescopic and adjustable length. The intelligent blind guiding robot is provided with the two planet wheels facilitating step climbing, the planet wheels are connected with the power assembly enabling the robot to walk autonomously, the rigid traction rod is arranged, the safety of visually impaired people is guaranteed, and the intelligent blind guiding robot can assist the visually impaired people in walking.

1. The name of the design product: intelligent identification gloves (for the visually impaired). 2. The use of the design product: as a wearable intelligent identification tool, to realize object, sign, etc. identification and voice prompt, especially for the visually impaired in daily life. 3. The design points of the design product: in shape. 4. The picture or photo that best indicates the design points: perspective drawing.

The application discloses a complex environment recognition and intelligent interaction system for blind navigation, aiming to provide a safer and more personalized travel assistance for the blind or visually impaired. Based on the travel route planned by the map software, the YOLOv8 target detection algorithm with added CBAM attention mechanism is combined with the visual large model to recognize the complex scene, and the recognition result is transmitted to the large language model. The large language model generates active warning text or answers user questions according to the recognition result, and feeds back to the user in the form of voice, realizing intelligent interaction. At the same time, relying on the average step length calculated by the monocular vision technology and the autocorrelation analysis algorithm, the broadcast unit is converted from "meters" to "steps", improving the personalization of voice broadcast. The application combines front-end and back-end information transmission, introduces complex environment recognition, voice interaction and personalized guidance technology, and significantly improves the safety, interactivity and user experience of blind navigation assistance.