AR Gesture Menus With Server-Assisted Low-Latency Rendering
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Enabling computing devices to perform image processing operations on digital images captured in varying conditions, such as changes in scale, noise, lighting, movement, or geometric distortion, is computationally intensive and challenging, particularly in resource-constrained environments.
Innovation Solution
An augmented reality (AR) system integrates real and virtual environments, allowing for efficient image processing and interaction with AR content, including 3D content and AR effects, using motion sensor input and external asset data, while reducing latency and power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If image processing operations are performed on client devices to capture and render AR content, then AR content rendering capability is improved, but power consumption and latency increase
Solution Approach 1:
The patent divides the AR content processing workload between server-side systems and client devices. Server-side image processing operations handle complex image analysis and AR content generation, while client devices perform lighter rendering tasks. This segmentation reduces the computational burden on mobile devices, thereby lowering power consumption while maintaining AR rendering capability.
Solution Approach 2:
The patent introduces server-side processing as an intermediary between image capture and AR content display. The server performs heavy image processing operations and sends processed results to client devices for rendering. This intermediary approach allows complex processing to occur on powerful servers while client devices only need to display pre-processed content, reducing their power consumption.
2Reliability
If image processing operations are performed on client devices to capture and render AR content, then AR content rendering capability is improved, but processing latency increases
Solution Approach 1:
The patent segments processing tasks by time and complexity. Time-critical rendering operations are performed on client devices with low latency requirements, while non-time-critical heavy processing operations are offloaded to servers. This temporal segmentation allows the system to meet real-time rendering deadlines while still performing comprehensive image processing.
Solution Approach 2:
The patent performs preliminary image processing and AR content generation on server-side systems before transmitting results to client devices. By pre-processing images and generating AR content in advance, the system reduces the amount of processing needed on client devices, thereby minimizing rendering latency and improving real-time performance.
3Measurement precision
If advanced image processing techniques are used to handle varying capture conditions, then image quality is improved, but device complexity increases
Solution Approach 1:
The patent uses server-side systems as intermediaries to perform advanced image processing techniques for handling varying capture conditions such as noise, lighting, and geometric distortion. These complex processing operations are executed on powerful servers rather than on resource-constrained client devices, thereby achieving high image quality without increasing device complexity.
Data Source
AI summary
The subject technology detects a first location and a first position of a first representation of a first finger and a second location and a second position of a second representation of a second finger. The subject technology detects a first particular location and a first particular position of a first particular representation of a first particular finger and a second particular location and a second particular position of a second particular representation of a second particular finger. The subject technology detects a first change in the first location and the first position and a second change in the second location and the second position. The subject technology detects a first particular change in the first particular location and the first particular position and a second particular change in the second particular location and the second particular position. The subject technology generates a set of virtual objects.