Stereo Vision Smart Necklace for Depth Perception

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Wearable cameras lack real-time processing and depth perception capabilities, limiting users' environmental awareness and navigation, particularly for individuals who are blind or visually impaired.

Innovation Solution

A smart necklace equipped with stereo camera pairs on either side, a vibration unit, and a processor that provides audio and haptic feedback based on object recognition, enhancing environmental awareness and navigation through real-time object detection and route guidance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If wearable cameras are used to record user experience, then recording and documenting capability is provided, but real-time processing and depth perception information are lacking

Engineering Contradiction:
Improvedepth perception informationVSAvoidcamera system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The camera system is divided into multiple stereo pairs positioned at different locations (front, rear, left, right) of the necklace. Each stereo pair independently captures depth information from its specific viewpoint, and the processor integrates data from all pairs to provide comprehensive environmental awareness and reliable depth perception without requiring a single complex camera system

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Multiple stereo camera pairs are combined into a single integrated necklace device. The processors merge video frames from all stereo pairs to create a unified three-dimensional understanding of the environment, providing complete depth perception information that no single camera could achieve alone

Inventive Principle:
Principle #5Merging (Combining)

2Reliability

If stereo camera pairs are added to provide depth perception, then environmental awareness is improved, but device weight and complexity increase

Engineering Contradiction:
Improvedepth perception reliabilityVSAvoidnecklace weight
Core Design Contradiction:
ReliabilityVSWeight of moving object

Solution Approach 1:

The necklace is segmented into multiple sections with camera pairs distributed throughout. This allows the use of smaller, lighter individual camera modules rather than one large heavy camera system, while still achieving reliable depth perception through the combined input from multiple stereo pairs

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different stereo pairs are positioned at specific locations (front, rear, left, right) to capture depth information from different perspectives. Each location provides localized depth perception quality tailored to that viewing direction, and the processor integrates these local qualities into comprehensive environmental awareness

Inventive Principle:
Principle #3Local quality

3Productivity

If multiple stereo pairs are used for comprehensive object recognition, then navigation capability is improved, but energy consumption increases

Engineering Contradiction:
Improvenavigation efficiencyVSAvoidprocessor energy consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The processor selectively processes video frames from stereo pairs based on navigation needs. Rather than continuously processing all camera inputs at full resolution, the system processes only the necessary portions or uses reduced resolution for certain functions, providing efficient navigation capability while managing energy consumption

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system maintains continuous monitoring and processing from all stereo pairs to provide uninterrupted navigation guidance. The processor continuously integrates depth information and object recognition data, ensuring uninterrupted navigation capability while optimizing energy use through efficient processing algorithms

Inventive Principle:
Principle #20Continuity of useful action

4Reliability

If real-time object recognition is implemented, then obstacle avoidance is improved, but processing time and computational load increase

Engineering Contradiction:
Improveobstacle avoidance reliabilityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary processing of video frames from stereo pairs, pre-identifying potential objects and depth features before final obstacle detection. This preliminary action prepares data structures and identifies regions of interest in advance, enabling faster real-time obstacle avoidance decisions when needed

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces complex mechanical image processing with computational algorithms that efficiently analyze video frames from stereo pairs. The processor uses software-based object recognition and depth mapping instead of mechanical or optical processing methods, achieving reliable real-time obstacle detection with reduced processing time

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS9578307B2Smart necklace with stereo vision and onboard processing
Publication Date: 2017.02.21 TOYOTA JIDOSHA KK
  • US9578307B2 patent drawing
  • US9578307B2 patent drawing
  • US9578307B2 patent drawing

AI summary

A wearable neck device for providing environmental awareness to a user, the wearable neck device includes a flexible tube. A first stereo pair of cameras is encased in a left portion of the flexible tube and a second stereo pair of cameras is encased in a right portion of the flexible tube. A vibration motor within the flexible tube provides haptic and audio feedback to the user. A processor in the flexible tube recognizes objects from the first stereo pair of cameras and the second stereo pair of cameras. The vibration motor provides haptic and audio feedback of the items or points of interest to the user.