An obstacle warning system and method for visually impaired people based on rgb-d camera and stereo

A stereo and obstacle technology, applied in stereo systems, electro-acoustic musical instruments, image analysis, etc., can solve the problems of different wearing experience, delay, burden on visually impaired people, etc., and achieve the effect of ensuring accuracy

Active Publication Date: 2019-09-24
山西视氪科技有限公司
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Haptic vibration uses vibration belt or vibrating vest as hardware to prompt the orientation of obstacles. The vibration device can solve the problem of delay, but it brings a burden to the visually impaired. Different people have different wearing experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An obstacle warning system and method for visually impaired people based on rgb-d camera and stereo
  • An obstacle warning system and method for visually impaired people based on rgb-d camera and stereo
  • An obstacle warning system and method for visually impaired people based on rgb-d camera and stereo

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] Such as figure 1 As shown, an obstacle warning system for visually impaired persons based on RGB-D camera and stereo sound, said system includes an infrared projector, two identical infrared cameras, a color camera, a USB hub, a small processor, One bone conduction headphone module, two bone conduction vibration modules, and one battery module. An infrared projector, two infrared cameras, and a color camera are connected to the small processor through a USB hub, and the battery module is connected to the small processor. A color camera and an infrared projector are located between the two infrared cameras. The optical axes of the two infrared cameras and the color camera are parallel to each other. The small processor controls the infrared projector to project invisible static near-infrared speckle to the front three-dimensional scene, two infrared cameras collect two infrared images of the projected three-dimensional scene in real time, and the color camera collects ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an RGB-D camera and stereo-based barrier early warning system and method for a visually impaired person. The method comprises the steps of projecting invisible near-infrared static speckles by utilizing an infrared projector; collecting images by utilizing two infrared cameras and an RGB camera; processing the collected images by a small processor; performing calculation to obtain a depth image; performing block segmentation on the depth image; converting depth information obtained by block segmentation into a stereo signal; and finally transmitting the stereo signal to the visually impaired person by utilizing a bone conduction earphone to perform assistance. According to the system and the method, the barrier early warning requirement of the visually impaired person can be well met.

Description

technical field [0001] The invention belongs to the technical fields of assistive technology for visually impaired persons, binocular vision technology, three-dimensional environment perception technology and stereo interaction technology. The invention includes an obstacle early warning method for visually impaired persons based on RGB-D camera and stereo sound, and relates to a method for projecting invisible near-infrared static speckles by using an infrared projector, and collecting images by using two infrared cameras and one RGB camera , the small processor processes the collected image, obtains the depth image, and divides the depth image into blocks, and finally converts the block depth information into a stereo signal, and finally uses the bone conduction earphone to pass it to the visually impaired for assistance. early warning method. Background technique [0002] According to the World Health Organization, there are 285 million visually impaired people worldwide...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/13G06T7/30G06T7/55G06T7/80H04R3/00H04N13/20G10H1/00
Inventor 于红雷胡伟健孙俊伟
Owner 山西视氪科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap