Unlock instant, AI-driven research and patent intelligence for your innovation.

A zebra crossing detection glasses for the visually impaired based on rgb-d camera and stereo sound

A zebra crossing, stereo technology, applied in glasses/goggles, image analysis, image enhancement, etc., can solve the problems of visually impaired people's burden, different wearing experience, delay, etc., to improve accuracy and reliability, small amount of calculation, Fast processing effects

Active Publication Date: 2019-11-22
杭州视氪科技有限公司
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Haptic vibration uses vibration belt or vibrating vest as hardware to prompt some orientation information with vibration, which can solve the problem of delay, but it brings burden to the visually impaired, and different people have different wearing experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A zebra crossing detection glasses for the visually impaired based on rgb-d camera and stereo sound
  • A zebra crossing detection glasses for the visually impaired based on rgb-d camera and stereo sound
  • A zebra crossing detection glasses for the visually impaired based on rgb-d camera and stereo sound

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] like figure 2 Shown, a kind of zebra crossing detection glasses for the visually impaired based on RGB-D camera and stereo sound, said glasses include glasses body and an RGB-D camera fixed on the glasses body, an attitude angle sensor, a USB hub, a A small processor, a bone conduction headphone module, two bone conduction vibration modules and a battery module. The RGB-D camera is fixed above the lens of the glasses, and the two bone conduction vibration modules are located at the middle and back of the two temples, fitting the skull in front of the ears of the blind; the USB hub, the attitude angle sensor and the small processor are embedded in a mirror In the foot; the bone conduction earphone module and the battery module are embedded in another temple;

[0045] like figure 1 As shown, the RGB-D camera and the attitude angle sensor are connected to the small processor through the USB hub, and the battery module is connected to the small processor; the two bone co...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention discloses a pair of RGB-D camera and stereo-based visually impaired people zebra crossing detection spectacles. According to the spectacles, an RGB-D camera is utilized to acquire a color image and a depth images; an attitude angle sensor is utilized to acquire the attitude angle information of the camera; a small processor calculates the three-dimensional coordinates of a scene according to depth information and attitude angle information; the small processor processes three-dimensional information and removes interference on crossing detection caused by an object in the air in the color image; and the small processor divides the color image into blocks, calculates the bipolar coefficient of each block, screens out possible zebra crossing blocks and detects a zebra crossing region through using connected domain analysis. The distance and direction of a zebra crossing are transmitted through a bone conduction headphone, so that visually impaired people can be assisted, and the requirements of the visually impaired people for predicting zebra crossings can be well satisfied.

Description

technical field [0001] The invention belongs to the field of assistive technology for visually impaired persons, three-dimensional environment perception technology, zebra crossing detection technology, and stereo interaction technology, and in particular relates to a zebra crossing detection glasses for visually impaired persons based on RGB-D camera and stereo sound, and uses RGB-D camera to collect color images And the depth image, using the attitude angle sensor to obtain the attitude angle information of the camera. The small processor uses the depth information and attitude angle information to calculate and obtain the three-dimensional coordinates of the scene. The small processor processes the three-dimensional information and removes the interference of objects in the air on the zebra crossing detection in the color image. The small processor divides the color image into blocks, calculates the bipolar coefficient of each block, screens out blocks that may be zebra cr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/11G06T7/90G02C11/00
CPCG02C11/10G06T2207/10024G06T2207/10028G06T2207/20021
Inventor 杨恺伦程瑞琦赵向东于红雷
Owner 杭州视氪科技有限公司