AR Apparatus Using Real Object Position for Virtual Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality technologies do not allow direct operation of virtual information or objects using real-world objects, limiting user interaction and convenience.

Innovation Solution

An information processing apparatus and method that utilize a tangible, movable real object to issue control commands based on its positional relationship with virtual or other real objects, enabling direct operation of virtual information or objects by recognizing and responding to the real object's position and movement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional AR technologies are used to display virtual information, then virtual information can be superimposed on real-world images, but direct operation of virtual objects using real-world objects is not enabled

Engineering Contradiction:
Improvedirect operation of virtual objectsVSAvoidinteraction system complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent introduces a camera as an intermediary device that captures real-world objects and translates their physical positions into virtual coordinate positions. This intermediary mechanism enables real objects to indirectly operate virtual objects without requiring complex direct interaction interfaces, thus improving ease of operation while managing system complexity through a well-defined mediation layer.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces traditional mechanical or manual interaction mechanisms (such as buttons, sliders, or direct touch interfaces) with a vision-based recognition system. By using image capture and object recognition technology, the system translates physical object positions into control commands, substituting mechanical interaction with optical and computational processes, thereby simplifying the user interface.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If complex interaction interfaces are used to control virtual information, then precise control is achieved, but user convenience is reduced

Engineering Contradiction:
Improveuser convenienceVSAvoidcontrol precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system enables real objects to serve themselves as control interfaces. When a user places or moves a real object, the system automatically recognizes the object, determines its position, and executes the corresponding control operation without requiring the user to manually configure or navigate complex interfaces. This self-service mechanism maintains control precision through automated object recognition and coordinate mapping while maximizing user convenience.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary actions by pre-establishing the mapping relationships between real objects and virtual control interfaces. Through object recognition and coordinate system alignment, the system prepares the control environment in advance, so that when users simply place objects, the precise control operations are already configured and ready to execute, eliminating the need for users to manually adjust complex parameters.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If manual control methods are used for virtual objects, then control accuracy is maintained, but operation time increases

Engineering Contradiction:
Improveoperation speedVSAvoidcontrol time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system implements continuous object recognition and coordinate mapping, maintaining an ongoing relationship between real object positions and virtual control states. Rather than requiring discrete, step-by-step manual controls, the system continuously monitors object positions and automatically updates control commands, enabling users to perform operations more quickly while maintaining accuracy through persistent spatial awareness.

Inventive Principle:
Principle #20Continuity of useful action

Solution Approach 2:

The patent replaces time-consuming manual control operations with automated vision-based recognition and coordinate transformation. The system rapidly captures images, identifies objects, calculates positions, and executes control commands in a streamlined automated sequence, significantly reducing the time required for operations compared to manual interface navigation while maintaining control precision through algorithmic accuracy.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentEP2812776B1Information processing apparatus, and information processing method
Publication Date: 2019.12.04 SONY GROUP CORP
  • EP2812776B1 patent drawingFigure 1~2
  • EP2812776B1 patent drawingFigure 3(A)~3(B)
  • EP2812776B1 patent drawingFigure 4(A)~4(B)

AI summary

An information processing apparatus includes processing circuitry that is configured to issue a control command relating to a real object based on a displayed positional relationship between the real object and a predetermined object. The real object being a tangible, movable object and the predetermined object being at least one of another real object and a virtual object.