Unlock instant, AI-driven research and patent intelligence for your innovation.

A zebra crossing detection system and method for the visually impaired based on rgb-d camera and stereo

A zebra crossing and stereo sound technology, applied to devices that help people move around, physical therapy, etc., can solve problems such as delays, different wearing experiences, and the burden of visually impaired people, and achieve small calculations, improve accuracy and reliability, and process speed fast effect

Active Publication Date: 2019-03-01
杭州视氪科技有限公司
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Haptic vibration uses vibration belt or vibrating vest as hardware to prompt some orientation information with vibration, which can solve the problem of delay, but it brings burden to the visually impaired, and different people have different wearing experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A zebra crossing detection system and method for the visually impaired based on rgb-d camera and stereo
  • A zebra crossing detection system and method for the visually impaired based on rgb-d camera and stereo
  • A zebra crossing detection system and method for the visually impaired based on rgb-d camera and stereo

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0044] Such as figure 1 Shown, a kind of visually impaired person's zebra crossing detection system based on RGB-D camera and stereo sound, said system comprises an RGB-D camera, an attitude angle sensor, a USB hub, a small processor, a bone conduction earphone module, Two bone conduction vibration modules and one battery module. The RGB-D camera and the attitude angle sensor are connected to the small processor through the USB hub, and the battery module is connected to the small processor. The RGB-D camera collects the color image and the depth image of the 3D scene in real time. The attitude angle sensor acquires the attitude angle of the RGB-D camera in real time. The small processor analyzes the color image and depth image collected by the RGB-D camera and the attitude angle information collected by the attitude angle sensor, detects the zebra crossing area of ​​the three-dimensional scene, calculates the zebra crossing area and direction, and converts the processing re...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a system and method for detecting zebra stripes for visually impaired people based on an RGB-D camera and stereophonic sound. According to the method, a colored image and a depth image are acquired by means of the RGB-D camera, and the attitude angle information of the camera is acquired by means of an attitude angle sensor. A minitype processor computes the three-dimensional coordinates of a scene according to depth information and attitude angle information. The minitype processor processes three-dimensional information to eliminate interferences of objects in the air in the colored image on zebra stripe detection. The minitype process conducts partitioning on the colored image, computes the bipolar coefficient of each block, screens out blocks which could be zebra stripes, and finds out zebra stripe areas through connected domain analysis. The distance and the direction of zebra stripes are finally transmitted to visually impaired people through a bone conduction headset, and the requirement of visually impaired people for predicting zebra stripes can be well met.

Description

technical field [0001] The invention belongs to the technical fields of assistive technology for visually impaired persons, three-dimensional environment perception technology, zebra crossing detection technology and stereo interaction technology. The invention includes a zebra crossing detection method for visually impaired persons based on an RGB-D camera and stereo sound, and relates to a method for collecting color images and depth images by using an RGB-D camera, and acquiring attitude angle information of the camera by using an attitude angle sensor. The small processor uses the depth information and attitude angle information to calculate and obtain the three-dimensional coordinates of the scene. The small processor processes the three-dimensional information and removes the interference of objects in the air on the zebra crossing detection in the color image. The small processor divides the color image into blocks, calculates the bipolar coefficient of each block, scr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): A61H3/06
CPCA61H3/061
Inventor 于红雷杨恺伦程瑞琦赵向东汪凯巍
Owner 杭州视氪科技有限公司