AR Glasses Content Switching via Smartphone Virtual Object

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality (AR) technologies face challenges in intuitively supporting screen switching and content movement between devices, as well as determining optimal display modes for virtual content presentation in AR environments, leading to suboptimal user experience and content operation.

Innovation Solution

An AR device equipped with a processor that detects external objects and determines display modes to control content display on either the electronic device or wearable device, allowing for seamless content switching and operation based on interaction and device processing entities.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If virtual content is displayed through a wearable electronic device in an AR environment, then the user experience is enhanced with hands-free operation, but it becomes difficult to support screen switching and content movement between devices intuitively

Engineering Contradiction:
Improvehands-free operationVSAvoidscreen switching and content movement control
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces a camera as an intermediary device to capture the physical smartphone and translate it into a virtual representation within the AR environment. This virtual smartphone object serves as a mediator that allows users to interact with content switching and movement functions through natural physical gestures (picking up, moving, placing the smartphone) rather than complex wearable device controls. The camera captures images of the smartphone, and the processor generates corresponding virtual objects that users can manipulate through voice commands or simple gestures while wearing the AR device.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If content is displayed only through the wearable electronic device display area, then the AR environment is maintained, but it is difficult to support various content operations and provide adequate display space for all content

Engineering Contradiction:
Improvecontent operation supportVSAvoiddisplay area
Core Design Contradiction:
Adaptability or versatilityVSArea of stationary object

Solution Approach 1:

The patent extends the display space from the two-dimensional wearable device display to the three-dimensional physical space by projecting virtual content onto real-world surfaces. When the camera detects a smartphone being placed on a surface, the system generates a virtual extension display area on that surface, effectively expanding the display space from the small wearable screen to a larger external surface. This allows content to be displayed across multiple dimensions - the original wearable display and the extended external display area simultaneously - providing both AR immersion and adequate content operation space.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Extent of automation

If the wearable electronic device independently processes and displays all virtual content, then the standalone AR function is achieved, but the ability to interact with and control content through an external electronic device is reduced

Engineering Contradiction:
Improvestandalone AR functionVSAvoidcontent control through external device
Core Design Contradiction:
Extent of automationVSEase of operation

Solution Approach 1:

The patent merges the processing capabilities of both the wearable electronic device and the external electronic device (smartphone). The wearable device's processor generates virtual content and manages the AR environment, while simultaneously recognizing the smartphone as a control interface. The system combines the autonomous AR processing of the wearable device with the tactile interaction capabilities of the external smartphone, allowing users to control content operations (such as switching between videos or adjusting playback) by physically manipulating the smartphone in the real world, which is then reflected in the virtual AR environment.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11934735B2Apparatus and method for providing contents related to augmented reality service between electronic device and wearable electronic device
Publication Date: 2024.03.19 SAMSUNG ELECTRONICS CO LTD
  • US11934735B2 patent drawing
  • US11934735B2 patent drawing
  • US11934735B2 patent drawing

AI summary

A method and a device capable of supporting various display methods using an electronic device and/or glasses-type wearable electronic device (e.g., AR glasses) in an augmented reality (AR) are provided. An AR providing device for AR services includes a display and a processor. The processor is configured to provide content through an AR screen, detect a specified external object through the AR screen while providing the content, determine a display mode for providing the content, based on detection of the specified external object, control to display the content through a display of the specified external object, based on the determined display mode, and perform control to display the content through a virtual display area associated with the specified external object on the AR screen, based on the determined display mode.