AR Virtual Frame for Guided Image Composition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face challenges in capturing images as desired when asking others to take photos, due to difficulties in conveying composition and settings, especially across language barriers.

Innovation Solution

A photo guide system using augmented reality (AR) that allows a first user to define a reference frame for the desired composition, which is then used to guide a second user in positioning and orienting their image capture device to match the desired view, ensuring the captured image meets the first user's expectations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a first user asks a second user to take a photo, then the photo can be captured, but the composition and settings may not meet the first user's expectations due to difficulty in conveying requirements

Engineering Contradiction:
Improvecomposition accuracyVSAvoidcommunication of desired composition
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent creates a visual copy of the desired composition through a reference frame image. The first user captures a reference frame that exactly represents the desired composition, and this reference frame is then overlaid as a transparent guide on the second user's viewfinder, allowing precise replication without verbal communication.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces an intermediary system (the AR-guided capture system) that mediates between the first user's intent and the second user's action. The system translates the first user's reference frame into real-time visual guidance for the second user, eliminating the need for direct communication.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If AR guidance is provided to the second user, then the composition accuracy is improved, but the device complexity increases

Engineering Contradiction:
Improvecomposition accuracyVSAvoidAR guidance system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent makes the image capture device perform multiple functions: it serves as both the reference frame capture device (first device) and the guided capture device (second device). The same hardware components (camera, display, processor) are used in sequence for different purposes, reducing the need for additional specialized equipment.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses the device's own resources to provide AR guidance. The display that normally shows the live view is used to overlay the AR guidance, and the processor that normally processes images is used to generate the guidance information in real-time, eliminating the need for separate guidance hardware.

Inventive Principle:
Principle #25Self-service

3Ease of operation

If real-time AR feedback is provided to guide positioning, then the ease of operation is improved, but the processing requirements and energy consumption increase

Engineering Contradiction:
Improveease of positioningVSAvoidenergy consumption
Core Design Contradiction:
Ease of operationVSUse of energy by moving object

Solution Approach 1:

The patent applies partial action by only processing and displaying the necessary portions of the reference frame and live view for guidance. The AR overlay focuses only on the relevant alignment information needed for composition, rather than processing the entire image data set, reducing computational load.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The reference frame is captured and processed in advance before the guided capture session. The composition guidelines and alignment markers are pre-calculated from the reference frame, so that during the actual guided capture, the system only needs to compare the live view against these pre-established guidelines, reducing real-time processing requirements.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11024090B2Virtual frame for guided image composition
Publication Date: 2021.06.01 ADOBE INC
  • US11024090B2 patent drawing
  • US11024090B2 patent drawing
  • US11024090B2 patent drawing

AI summary

Techniques are disclosed for providing guidance information for guiding a user to capture an image according to a predefined composition. A first user may provide information identifying a reference frame that defines a composition desired by the first user. The reference frame depicts a particular view of the real-world environment that the first user desires as the composition of the photo-to-be-taken by a second user. Based upon the reference frame and using augmented reality techniques, AR content is presented to a second user that guides the second user in positioning and orienting the image capture device such that the live view captured by the image capture device matches the particular view. When the live view aligns with the particular view, the second user may take a photo. The composition of such a photo matches the composition desired by the first user and represented by the reference frame.