AR Interface Pose Detection and Lighting Feedback

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing computer systems for augmented reality lack efficient and intuitive methods for user interaction, requiring numerous inputs and lacking clear feedback, which hinders efficient human-machine interfaces.

Innovation Solution

The system displays user interfaces in a three-dimensional environment with virtual lighting effects, and updates interactive elements based on the user's pose, reducing the number of inputs needed and enhancing user understanding of device responses.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional input methods are used in augmented reality environments, then users can interact with virtual elements, but the number of inputs required increases and user understanding of device responses decreases

Engineering Contradiction:

ImproveUser interaction efficiencyVSAvoidNumber of inputs required

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The system provides visual feedback by displaying a representation of the user's hand within the augmented reality environment, showing the current pose and enabling the user to understand device responses to their inputs, thereby improving interaction efficiency and reducing the number of inputs needed

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The system automatically detects hand pose and translates it into navigation commands without requiring additional input actions from the user, allowing the system to serve itself by interpreting natural hand movements as interaction inputs

Inventive Principle:

Principle #25Self-service

2Ease of operation

If traditional user interface navigation is used, then users can control content applications, but the number of inputs increases and interaction intuitiveness decreases

Engineering Contradiction:

ImproveNavigation intuitivenessVSAvoidTime for user inputs

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

The system replaces traditional mechanical input devices (buttons, joysticks, touch screens) with optical detection of hand pose, using computer vision and machine learning to translate natural hand movements into navigation commands, thereby reducing input time and improving intuitiveness

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS20250036253A1Devices, methods, and graphical user interfaces for content applications

Publication Date: 2025.01.30 APPLE INC

AI summary

In some embodiments, an electronic device displays a user interface of a content application in a three-dimensional environment with or without virtual lighting effects applied to the three-dimensional environment depending on whether the user interface is in a mode that does not include virtual lighting or a mode that includes virtual lighting. In some embodiments, an electronic device updates display of interactive user interface elements in response to detecting a respective pose of a respective portion of a user of the electronic device.