Augmented Reality Device Control Interface

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for controlling devices using portable terminals lack the ability to effectively display type and service information of accessible devices and require users to photograph devices individually for recognition, which is inconvenient and may result in failed recognition.

Innovation Solution

A system and method utilizing Augmented Reality (AR) that includes a device server for registering device information, an AR server for generating AR screens displaying device type and service information, and a portable terminal for connecting with selected devices to perform specific functions, enabling intuitive device control and information retrieval.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If icons of searched devices are simply arranged on the display unit, then the device can be controlled, but the user cannot recognize device types, service information, and actual locations

Engineering Contradiction:
Improvedevice type information and service informationVSAvoidinformation display complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent transitions from a two-dimensional icon arrangement to a three-dimensional augmented reality display that overlays device information onto the actual visual field. The AR display unit projects virtual images containing device type, service, and location information onto the real-world view, adding a spatial dimension to information presentation and enabling simultaneous visualization of both physical devices and their metadata.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces an AR server and AR display unit as intermediary components between the portable terminal and the user. The AR server processes device information and generates augmented reality content, while the AR display unit acts as a mediator that overlays this processed information onto the user's visual field, bridging the gap between simple icons and comprehensive device information.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If the user photographs devices one by one for recognition, then device information can be obtained, but the operation becomes inconvenient and time-consuming

Engineering Contradiction:
Improvedevice information retrievalVSAvoidtime for photographing and recognizing devices
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent implements preliminary action by having devices pre-register their location and type information with the server before the user needs to access them. When the user activates the AR display, the portable terminal automatically retrieves and displays information about devices in the surrounding area without requiring the user to photograph each device individually. This pre-registration and automatic retrieval eliminates the time-consuming one-by-one photographing process.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system enables self-service by allowing devices to automatically broadcast or register their presence and information, which the portable terminal then automatically retrieves and displays through AR. The user simply needs to activate the AR display function, and the system autonomously performs device detection, information retrieval, and presentation without requiring manual photographing or active user intervention for each device.

Inventive Principle:
Principle #25Self-service

3Reliability

If the portable terminal fails to recognize the shape of a photographed device, then the user must re-photograph, but this increases operational complexity and time loss

Engineering Contradiction:
Improvedevice recognition accuracyVSAvoidoperation convenience
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent eliminates recognition failures by implementing preliminary registration where devices pre-register their unique identifiers, types, and location information with the server. Instead of relying on shape recognition that may fail, the system uses this pre-registered data to automatically identify and display device information when the device is detected in the AR field, ensuring 100% recognition accuracy without requiring re-photographing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces the mechanical/optical shape recognition system with an information-based identification system. Instead of analyzing device shapes through camera imaging and pattern matching, the system substitutes this with automatic retrieval of pre-registered device information from the server, replacing a fallible recognition mechanism with a reliable data lookup approach.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Adaptability or versatility

If no information about the photographed device is available, then device control becomes impossible, but this limits system functionality

Engineering Contradiction:
Improvedevice control capabilityVSAvoiddevice information availability
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent implements universality by creating a comprehensive information registration system where all devices, regardless of type, register their presence and capabilities with the server. The AR display then universally displays information for all detected devices, enabling the portable terminal to control diverse device types (televisions, refrigerators, washing machines, etc.) through a single unified interface, greatly expanding system adaptability and versatility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent ensures device information availability through preliminary registration, where devices pre-register their types, services, and control capabilities with the server before user interaction. This ensures that when devices are detected through AR, their information is already available in the system, enabling immediate control functionality without requiring additional information gathering or limiting system versatility.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8847987B2System and method for controlling device
Publication Date: 2014.09.30 SAMSUNG ELECTRONICS CO LTD
  • US8847987B2 patent drawing
  • US8847987B2 patent drawing
  • US8847987B2 patent drawing

AI summary

Provided is a system and method for controlling a device using Augmented Reality (AR). A system for controlling a device using Augmented Reality (AR) includes a device server, an AR server, and a portable terminal. The device server registers information about each device. The AR server generates an AR screen displaying type information and service-related information of at least one device searched in response to a request of a portable terminal by using the registered device information, and provides the generated AR screen to the portable terminal. The portable terminal connects with a device selected among devices displayed on the AR screen and performs a specific function with the connected device.