Visual impaired person stair detecting glasses based on RGB-D camera and stereophonic sound

A stereo and camera technology, applied in the input/output of user/computer interaction, computer components, mechanical mode conversion, etc., can solve problems such as delay, different wearing experience, burden of visually impaired people, etc., to achieve timely interactive feedback and guarantee safety effect

Active Publication Date: 2017-06-13
杭州视氪科技有限公司
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Haptic vibration uses vibration belt or vibrating vest as hardware to prompt some orientation information with vibration, which can solve the problem of delay, but it brings burden to the visually impaired, and different people have different wearing experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Visual impaired person stair detecting glasses based on RGB-D camera and stereophonic sound
  • Visual impaired person stair detecting glasses based on RGB-D camera and stereophonic sound
  • Visual impaired person stair detecting glasses based on RGB-D camera and stereophonic sound

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] Such as figure 2 Shown, a kind of stair detection glasses for the visually impaired based on an RGB-D camera and stereo sound, the glasses include a glasses body, an RGB-D camera fixed on the glasses body, an attitude angle sensor, a USB hub, a A small processor, a bone conduction headphone module, two bone conduction vibration modules and a battery module. The RGB-D camera is fixed above the lens of the glasses, and the two bone conduction vibration modules are located at the middle and back of the two temples, fitting the skull in front of the ears of the blind; the USB hub, the attitude angle sensor and the small processor are embedded in a mirror Inside the foot; the bone conduction headphone module and the battery module are embedded in the other temple.

[0043] figure 1 As shown, the RGB-D camera and the attitude angle sensor are connected to the small processor through the USB hub, and the battery module is connected to the small processor. The two bone cond...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a visual impaired person stair detection system and method based on an RGB-D camera and stereophonic sound. The method comprises the steps that the RGB-D camera is used for collecting a depth image, and an attitude angle sensor is used for obtaining attitude angle information of the camera; a small processor utilizes the depth information and the attitude angle information for calculation to obtain three-dimensional coordinates and surface normal vector information, the surface normal vector information is used for performing extraction on a plane in a three-dimensional scene, whether stairs exist in the current scene or not is judged, if the stairs exist, the distance and direction of each stair are calculated, and finally bone conduction earphones are used for transmitting the distance and the direction to visual impaired persons for assistance. The requirement of the visual impaired persons for predicting stairs can be well met.

Description

technical field [0001] The invention belongs to the field of assistive technology for the visually impaired, three-dimensional environment perception technology, stair detection technology, and stereo interaction technology, and relates to stair detection glasses for the visually impaired based on an RGB-D camera and stereo. Background technique [0002] According to the World Health Organization, there are 285 million visually impaired people worldwide. Visually impaired people have lost their normal vision and have difficulty understanding colors, shapes, distances, and movements. Their lives have been greatly affected in daily life and travel. [0003] Traditional assistive tools for the visually impaired, such as walking sticks for the blind, require the visually impaired to move the stick repeatedly to only know the situation at their feet. It is also inconvenient to use the walking stick for the blind when going up and down stairs. [0004] Guide dogs can help the vis...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): A61H3/06G06K9/00G06F3/01
CPCG06F3/016A61H3/061G06V20/20
Inventor 于红雷杨恺伦林书妃陈天雪汪凯巍
Owner 杭州视氪科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap