XR Media Feed Anchoring via Visual Code Image Links

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems for displaying image sensor data within a three-dimensional environment often result in suboptimal viewing conditions due to asynchronous refresh rates and physical constraints of the display device, leading to visual artifacts and limited user control over the display location and size.

Innovation Solution

A system and method for directly receiving image sensor data within a computer system and displaying it within the three-dimensional environment using a communication link established through a visual code, allowing users to anchor, move, and resize the image sensor data as desired, independent of the display device's limitations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If image sensor data is displayed on the display device of the electronic device, then the display is integrated with the three-dimensional environment, but the image fidelity is degraded due to asynchronous refresh rates and physical constraints

Engineering Contradiction:
Improveimage fidelityVSAvoiduser control over display location and size
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent introduces a visual code as an intermediary element that enables the computer system to establish a communication link with the image sensor. This mediator allows the system to bypass the electronic device's display constraints while maintaining integration with the three-dimensional environment through the visual code interface.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent separates the image sensor data display function from the electronic device's display system. By enabling direct rendering on the computer system's display, the image feed is segmented from the constrained display pipeline, allowing independent optimization of image fidelity and display parameters.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If image sensor data is displayed directly on the electronic device display, then the display is physically constrained to fixed locations, but user flexibility in positioning and sizing is limited

Engineering Contradiction:
Improveuser control over display location and sizeVSAvoidcommunication link establishment
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The visual code serves as an intermediary that simplifies the communication link establishment between the computer system and image sensor. Users interact with the visual code to initiate data transmission, avoiding complex direct connection procedures while enabling flexible display control.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system enables self-service configuration where the visual code contains necessary information for the computer system to automatically establish the communication link and begin displaying image sensor data without requiring complex manual setup or configuration by the user.

Inventive Principle:
Principle #25Self-service

3Reliability

If the computer system establishes a direct communication link with the image sensor, then image fidelity is improved, but the system complexity increases

Engineering Contradiction:
Improveimage fidelityVSAvoidcommunication link and data transmission setup
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The visual code acts as an intermediary that simplifies the direct communication link establishment. It encapsulates necessary connection information and protocols, allowing the computer system to connect directly to the image sensor for high-fidelity data transmission without requiring complex configuration or intermediate software layers.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12561924B2Displaying extended reality media feed using media links
Publication Date: 2026.02.24 APPLE INC
  • US12561924B2 patent drawing
  • US12561924B2 patent drawing
  • US12561924B2 patent drawing

AI summary

Some examples of the disclosure are directed to systems and methods for communicating image sensor data to a computer system using one or more media links that allow for image sensor data to be displayed within a three-dimensional environment. In some examples, while presenting a three-dimensional environment that includes an electronic device that is communicatively coupled to an image sensor (e.g., a camera, or some other imaging device) within the three-dimensional environment, the electronic device utilizes a visual code displayed on the electronic device to establish a communication link with the image sensor receiving an indication to display image sensor data from the image sensor that is communicatively coupled to the electronic device. In some examples, while presenting a three-dimensional environment that includes a first pre-defined location within the three-dimensional environment, the electronic device facilitates the user to choose an image sensor to display at the pre-defined location.