Eye Reflection Image Analysis for Point-of-View Life-Logs

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current wearable computing technologies face challenges in efficiently capturing and processing eye reflection images to generate accurate point-of-view images for life-log recording, particularly in real-time applications such as augmented or virtual reality, due to artifacts from eye features and limited image quality.

Innovation Solution

A method involving inward-facing cameras to capture electromagnetic radiation reflected from the eye, filtering techniques to remove eye-related artifacts, and super-resolution methods to enhance image quality, allowing for the generation and storage of point-of-view images, which can be used to create life-log entries with associated data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If eye reflection images are captured using inward-facing cameras, then point-of-view images can be generated for life-log recording, but artifacts from eye features degrade image quality

Engineering Contradiction:
Improveimage qualityVSAvoideye feature artifacts
Core Design Contradiction:
Loss of informationVSObject-generated harmful factors

Solution Approach 1:

The patent extracts and removes eye-related artifacts from the captured reflection images through filtering techniques. The system identifies and separates unwanted eye feature artifacts from the useful point-of-view information, eliminating the harmful components while preserving the desired image content.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent converts the harmful eye reflection artifacts into beneficial information by analyzing the reflection patterns to determine eye orientation and gaze direction. The same reflected light that causes artifacts also provides valuable data about the user's viewing direction, which is then used to correct and enhance the point-of-view image.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

2Measurement precision

If filtering techniques are applied to remove eye-related artifacts, then image quality improves, but processing complexity increases

Engineering Contradiction:
Improveimage accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the image processing into distinct stages: initial capture of reflection images, identification of eye feature artifacts, application of filtering techniques, and final reconstruction of point-of-view images. This segmentation allows each processing stage to be optimized independently, managing complexity while maintaining accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces intermediate processing steps that act as mediators between the raw captured images and the final point-of-view images. Filtering algorithms and artifact removal techniques serve as intermediaries that systematically reduce complexity by breaking down the complex task of artifact removal into manageable computational steps.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If super-resolution methods are used to enhance image quality, then point-of-view image detail improves, but computational requirements increase

Engineering Contradiction:
Improveimage detail qualityVSAvoidcomputational power
Core Design Contradiction:
Manufacturing precisionVSPower

Solution Approach 1:

The patent applies preliminary filtering and artifact removal before super-resolution enhancement. By preprocessing the images to remove eye-related artifacts and optimize the input quality, the subsequent super-resolution processing requires less computational power to achieve the same level of detail enhancement.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent adjusts processing parameters dynamically based on the specific characteristics of each captured image. By optimizing super-resolution parameters according to the quality and content of the input reflection images, the system achieves high detail quality while minimizing unnecessary computational expenditure.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables the creation of accurate and high-quality point-of-view images for life-log entries, enhancing the capability of wearable computing devices in real-time data recording and interaction, particularly in mission-critical and recreational applications like augmented or virtual reality.

Implementation Method 1

detecting electromagnetic radiation reflected from a human eye

Methodology Applied
Scientific EffectElectromagnetic radiation reflection: Reflection

Data Source

PatentUS9684374B2Eye reflection image analysis
Publication Date: 2017.06.20 GOOGLE LLC
  • US9684374B2 patent drawing
  • US9684374B2 patent drawing
  • US9684374B2 patent drawing

AI summary

Example methods and devices are disclosed for generating life-logs with point-of-view images. An example method may involve: receiving image-related data based on electromagnetic radiation reflected from a human eye, generating an eye reflection image based on the image-related data, generating a point-of-view image by filtering the eye reflection image, and storing the point-of-view image. The electromagnetic radiation reflected from a human eye can be captured using one or more video or still cameras associated with a suitably-configured computing device, such as a wearable computing device.