Dominant-Eye Image Synthesis for Wearable Camera Perspective
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Wearable devices such as smartglasses and AR headsets capture images from a camera perspective that differs from the user's perspective due to offset positioning and dominant eye considerations, leading to inaccurate image capture and interaction with virtual objects.
Innovation Solution
A system that detects hand gestures to define image boundaries, accounts for dominant eye characteristics, and synthesizes images from the user's perspective using positional offsets and interpolation techniques to align camera views with the user's intended view.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If images are captured using a camera with offset positioning from the user's eye, then the device structure is simplified and easier to manufacture, but the captured image perspective differs from the user's intended view
Solution Approach 1:
The patent introduces an image synthesis module as an intermediary that processes images from multiple cameras and generates a synthesized image that matches the user's dominant eye perspective. This mediator reconciles the physical offset between camera and eye by computationally transforming the camera views into the desired perspective, thus maintaining ease of manufacture while achieving perspective accuracy.
Solution Approach 2:
The system changes the parameter of image perspective by applying geometric transformations and interpolation algorithms. By adjusting parameters such as viewpoint position, rotation angle, and projection parameters, the system transforms images captured from offset camera positions into images that appear as if captured from the user's eye position, resolving the contradiction between simple hardware design and accurate perspective representation.
2Measurement precision
If multiple cameras are used to compensate for eye dominance, then image perspective accuracy is improved, but device complexity and power consumption increase
Solution Approach 1:
The patent segments the imaging function across multiple cameras positioned at different locations (e.g., left and right cameras). Each camera captures a portion of the scene from its specific position, and the image synthesis module combines these segmented views into a complete synthesized image that represents the dominant eye perspective. This segmentation allows accurate perspective representation without requiring a single complex camera system.
Solution Approach 2:
The image synthesis module serves multiple functions: it processes images from multiple cameras, determines dominant eye characteristics, performs geometric transformations, and generates the final synthesized image. This multi-functional module reduces overall device complexity by consolidating multiple specialized components into a single versatile processing unit that handles all perspective correction tasks.
3Measurement precision
If image synthesis processing is performed to align camera view with user perspective, then image capture accuracy from user perspective is improved, but computational power and processing time increase
Solution Approach 1:
The system performs preliminary actions by pre-determining the user's dominant eye characteristic and storing it for future use. Additionally, it pre-calculates transformation parameters such as positional offsets between cameras and the dominant eye position. These preliminary computations reduce the real-time processing burden during actual image capture, as the system only needs to apply pre-determined transformations rather than calculating everything from scratch.
Solution Approach 2:
The image synthesis module performs partial processing by focusing computational resources on the most critical aspects of perspective transformation. It applies interpolation techniques selectively to regions requiring higher accuracy and uses approximation methods for less critical areas. This partial action approach achieves sufficient image boundary alignment accuracy without performing exhaustive computations on every pixel.
4Ease of operation
If hand gesture detection is used to define image boundaries, then ease of operation is improved, but measurement precision of gesture position differs from user perception
Solution Approach 1:
The image synthesis module acts as an intermediary that transforms hand gesture positions detected from the camera view into positions that align with the user's dominant eye perspective. It applies the same geometric transformations used for image synthesis to the gesture coordinates, ensuring that the gesture-defined image boundaries accurately reflect the user's intended view from their eye position rather than the camera position.
Data Source
AI summary
System and method are provided for capturing images based on dominant eye characteristics of a user. The system detects, by a wearable device, a hand gesture of the user indicating an image boundary for capturing an image from one or more cameras of the wearable device. The system generates, by the wearable device, the image based on (a) a dominant eye characteristic of the user, (b) the image boundary indicated by the hand gesture of the user, and (c) one or more images captured from the one or more cameras of the wearable device. The system stores, by the wearable device, the generated image to memory.