RGB-D camera and stereophonic sound-based passage prediction system and method for visually impaired people

A stereo and channel technology, applied in the direction of devices that help people move around, image data processing, instruments, etc., can solve the problems of burden on the visually impaired, different wearing experience, delay, etc.

Active Publication Date: 2017-11-10
杭州视氪科技有限公司
View PDF3 Cites 13 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Haptic vibration uses vibration belt or vibrating vest as hardware to prompt the orientation of obstacles. The vibration devic...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • RGB-D camera and stereophonic sound-based passage prediction system and method for visually impaired people
  • RGB-D camera and stereophonic sound-based passage prediction system and method for visually impaired people
  • RGB-D camera and stereophonic sound-based passage prediction system and method for visually impaired people

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] Such as figure 1 As shown, a path prediction system for visually impaired persons based on RGB-D camera and stereo sound, the system includes an infrared projector, two identical infrared cameras, a color camera, an attitude angle sensor, a USB hub, a A small processor, a bone conduction headphone module, two bone conduction vibration modules, and a battery module. An infrared projector, two infrared cameras, a color camera, and an attitude angle sensor are connected to the small processor through a USB hub, and the battery module is connected to the small processor. A color camera and an infrared projector are located between the two infrared cameras. The optical axes of the two infrared cameras and the color camera are parallel to each other. The attitude angles of the three cameras are consistent, and are acquired in real time by attitude angle sensors. The small processor controls the infrared projector to project invisible static near-infrared speckles to the fr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an RGB-D camera and stereophonic sound-based passage prediction system and method for visually impaired people. The method comprises the steps of projecting invisible near-infrared static speckles by utilizing an infrared projector; collecting an image by utilizing two infrared cameras and an RGB color camera; processing the collected image by a small processor; and performing calculation to obtain a depth image. According to the method, attitude angle information of the cameras is obtained by utilizing an attitude angle sensor; the small processor performs calculation by utilizing depth information and the attitude angle information to obtain a height image; the height image is subjected to block segmentation; the depth information obtained by the block segmentation is converted into a stereophonic sound signal; and finally the stereophonic sound signal is transmitted to the visually impaired people for performing assistance by utilizing bone conduction earphones, so that the passage prediction requirements of the visually impaired people can be well met.

Description

technical field [0001] The invention belongs to the technical fields of assistive technology for visually impaired persons, binocular vision technology, three-dimensional environment perception technology and stereo interaction technology. The present invention includes a path prediction method for visually impaired persons based on RGB-D cameras and stereo sound, and relates to a method for projecting invisible near-infrared static speckles by using an infrared projector, and collecting images by using two infrared cameras and an RGB camera. The small processor processes the collected images, calculates and obtains the depth image. The small processor uses the attitude angle sensor to obtain the attitude angle information of the camera. The small processor uses the depth information and attitude angle information to calculate and obtain the height image, and divides the height image into blocks, converts the depth information obtained by the blocks into a stereo signal, and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/00A61H3/06G06T7/70G06T7/30
CPCA61H3/061G06T2207/10024G06T2207/10028G06T2207/10048G06T2207/30244
Inventor 于红雷杨恺伦程瑞琦陈浩汪凯巍
Owner 杭州视氪科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap