System and method for detecting obstacles and ramps

A technology for detecting systems and obstacles, applied in physical therapy, appliances to help people walk, etc., can solve problems such as high cost

Active Publication Date: 2017-07-11
杭州视氪科技有限公司
View PDF5 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Bionic eyes can help blind people regain some vision, but the implantation of bionic eyes requires expensive surgery
And

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and method for detecting obstacles and ramps
  • System and method for detecting obstacles and ramps
  • System and method for detecting obstacles and ramps

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] An obstacle and slope detection system, including an infrared projector, two infrared cameras, a serial port to USB module, a USB hub, a bone conduction headset, two bone conduction vibration modules, a small processor, and a battery ; The field of view of the two infrared cameras is Φ 1 (In this embodiment, Φ 1 is 50), the optical axes of the two infrared cameras are inclined downward, and the included angle with the horizontal plane is Φ 2 , in this example, Φ 2 for 10. The small processor controls the infrared projector to project invisible near-infrared static speckles into the 3D scene ahead, and the two infrared cameras collect the infrared images of the 3D scene ahead in real time. The attitude angle sensor obtains the attitude angle of the camera in real time, and the attitude angle data is converted into USB data through the serial port to USB module. The USB hub passes the USB data and image data to the small processor. The small processor processes the i...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a method and a system for detecting small and short obstacles and ramps based on RGB-D cameras and an attitude angle sensor. According to the system, an infrared projector is used for projecting invisible near-infrared static speckles; the two infrared cameras are used for collecting images; the attitude angle sensor is used for acquiring the attitude angle information of the cameras; the depth information and the attitude angle information in the images are processed, so that the azimuths, heights and distances of the ramps and the ground obstacles in the front three-dimensional scene are detected; finally, the detection results are converted into semantic sound and transmitted to a blind person through bone conduction headphones for realizing assistance.

Description

technical field [0001] The invention belongs to the technical fields of blind assisting technology, binocular vision technology, three-dimensional environment perception technology and sound coding technology. The invention includes a new type of ground obstacle detection system, which involves an infrared projector to project an invisible near-infrared static speckle, uses two infrared cameras to collect images, and uses an attitude angle sensor to obtain the attitude angle information of the camera. The sensor processes the depth information and attitude angle information in the image, detects small obstacles on the ground and up and down slopes in the image, and finally converts the detection results into semantic content, which is transmitted to the blind through bone conduction earphones for assistance system. Background technique [0002] Blind people lack the vision that normal people have, which causes great inconvenience to their daily life and travel. Blind peopl...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): A61H3/06
CPCA61H3/061A61H2003/063A61H2201/5007
Inventor 于红雷杨恺伦孙俊伟
Owner 杭州视氪科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products