Object detection, analysis, and alert system for use in providing visual information to the blind

Abstract

A portable, closed-loop system of capture, analysis, and feedback uses a headset containing a small unobtrusive camera and a control computer that communicates wirelessly with a wireless network and / or remote platform. The headset may also contain user controls, an audio feedback component, a battery, interconnection circuitry, cables, and connections for an intraoral device. The camera component of the headset captures images during an activity to be analyzed, such as walking or viewing a room, and sends data (e.g., visual data) to the controller. The controller transmits the data to a database on the remote platform that includes software that instantly analyzes the image information represented in the data, then provides immediate feedback to the headset. The controller may independently process the data.

Description

[0001] This invention was made with government support under DM090217 and DM130076 of the Defense Medical Research and Development Program (DMRDP) of the Department of Defense (DoD). The government has certain rights in this invention. technical field [0002] The present invention generally relates to methods and apparatus for providing visual information to visually impaired or blind persons. More specifically, the present invention relates to methods and devices designed to provide totally blind persons with the ability to detect and identify landmarks and navigate within their surroundings. The device includes a portable closed-loop system of acquisition, analysis, and feedback using a headset containing an unobtrusive camera and a control computer that communicates wirelessly with a wireless network and / or a remote platform. The camera component of the headset captures images during the activity to be analyzed (eg, walking or looking around a room) and sends the data (eg...

AI Technical Summary

Problems solved by technology

[0009] However, such devices have significant limitations in that they provide a deeply blind user with little information about the user's far-side environment

For example, devices that rely on monitors to provide blind persons with information about their surroundings do not provide humans with usable information

Also, using audio signals alone to convey information about the surrounding environment to the user is not suitable for noisy environments, such as streets with heavy traffic, or for deaf-blind people who cannot hear audio signals

Furthermore, for users who are profoundly blind, these and other existing devices cannot identify landmarks (e.g., signs or navigation cues) in the personal environment for the blind beyond the distances that can be swiped and touched with a cane

Images