Object Recognition System for Visually Impaired Users

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current solutions for the visually impaired are limited in their applicability due to their fragmented nature, making it difficult for individuals to effectively interact with their environment through object recognition and location.

Innovation Solution

A system comprising a camera and processing circuitry that captures images, determines characteristic features, and compares them to an object identification dataset to provide object recognition, location, and presentation feedback using an assistance feedback device, allowing users to identify and locate objects through audio or haptic cues.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple separate solutions are used to assist the visually impaired, then specific functions can be provided, but the overall system complexity increases and applicability decreases

Engineering Contradiction:
ImproveapplicabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines camera-based object detection, image processing, and multiple output modalities (audio, visual, haptic) into a single integrated system. The processing circuitry receives images from a camera, identifies objects through feature comparison, and simultaneously provides feedback through multiple channels, eliminating the need for separate fragmented solutions.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The assistance feedback device is designed to perform multiple functions: it detects objects in the environment, processes visual information, and provides feedback through multiple modalities (audio outputs, visual displays, haptic feedback). This multi-functional device replaces multiple separate solutions with a single universal system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If real-time object recognition is implemented, then interaction capability is improved, but processing time and computational resources increase

Engineering Contradiction:
Improveinteraction capabilityVSAvoidprocessing time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system pre-processes and stores characteristic features of objects in a database before actual recognition occurs. When an object needs to be identified, the system compares captured image features against this pre-organized database, significantly reducing the time required for real-time recognition compared to analyzing from scratch.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces complex mechanical image analysis with electronic feature comparison. Instead of traditional computer vision algorithms that require extensive computation, the system extracts key features and compares them against stored templates, reducing processing time and computational requirements while maintaining real-time capability.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10843299B2Object recognition and presentation for the visually impaired
Publication Date: 2020.11.24 JOHNS HOPKINS UNIVERSITY
  • US10843299B2 patent drawing
  • US10843299B2 patent drawing
  • US10843299B2 patent drawing

AI summary

An apparatus configured to perform object recognition is provided that includes a camera, an assistance feedback device, and processing circuitry. The processing circuitry may be configured to receive the plurality of images from the camera and repeatedly determine characteristic features within the plurality of images and compare the characteristic features within the plurality of images to an object identification dataset to determine object matches for identified objects within the plurality of images. The processing circuitry may be further configured to determine a name for identified objects from the object identification dataset, output, using the assistance feedback device, a position indicator for identified objects, and output the name of identified objects within the assistance feedback device field of view.