AR Device Gravity Detection for Realistic Virtual Object Movement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality technologies cannot effectively reflect gravitational information on virtual objects superimposed over real space information, limiting their ability to mimic the movements of real-world objects.

Innovation Solution

An information processing device and method that analyzes the 3D space structure to recognize a virtual space, detects the direction of gravitational force using sensors like acceleration sensors, and reflects this information in the virtual space, allowing for accurate representation and movement of virtual objects based on gravitational forces.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If virtual digital information is superimposed on real space information using position and posture information only, then the virtual object can be positioned in 3D space, but the virtual object cannot exhibit realistic movements consistent with real-world physics

Engineering Contradiction:
Improverealism of virtual object movementVSAvoidgravity information
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The system performs preliminary detection of gravity direction using acceleration sensors before rendering virtual objects. By detecting the gravity direction in advance and reflecting it in the virtual space coordinate system, the system ensures that virtual objects will exhibit realistic gravitational behavior (such as falling downward) from the moment they are displayed, rather than requiring post-processing or user input.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If the system detects and reflects gravity direction in real-time, then virtual objects can move realistically, but the system requires additional sensors and processing complexity

Engineering Contradiction:
Improveaccuracy of gravitational force reflectionVSAvoiddetection and processing system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The acceleration sensor serves multiple functions: it detects both the device's motion/acceleration for general AR tracking purposes and simultaneously detects the gravity direction for realistic virtual object behavior. By making the detection system multi-functional, the patent avoids adding dedicated gravity sensors while still achieving accurate gravity reflection in the virtual space.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If the virtual space coordinate system is fixed relative to the device, then rendering is simple, but the virtual object does not respond to changes in device orientation relative to gravity

Engineering Contradiction:
Improverendering simplicityVSAvoidresponse to gravitational orientation
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The virtual space coordinate system is made dynamic by continuously updating its orientation based on detected gravity direction. Instead of being fixed to the device, the coordinate system adapts its orientation to reflect the actual gravity direction detected by sensors, allowing virtual objects to consistently respond to gravity regardless of device orientation while maintaining rendering efficiency through systematic coordinate transformation.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the realistic simulation of objects in augmented reality by incorporating gravitational forces, enhancing the visual fidelity and interaction with virtual objects in real-world environments.

Implementation Method 1

a detection unit for detecting a direction of gravitational force of the real space

Methodology Applied
Scientific EffectGravitation: Gravitation

Implementation Method 2

The detection unit may detect the direction of gravitational force using an acceleration sensor

Methodology Applied
Scientific EffectAcceleration sensor detection: Accelerometer

Data Source

PatentUS8854393B2Information processing device, information processing method, and program
Publication Date: 2014.10.07 SONY GROUP CORP
  • US8854393B2 patent drawing
  • US8854393B2 patent drawing
  • US8854393B2 patent drawing

AI summary

There is provided an information processing device includes a virtual space recognition unit for analyzing 3D space structure of a real space to recognize a virtual space, a storage unit for storing an object to be arranged in the virtual space, a display unit for making a display unit display the object arranged in the virtual space, a direction of gravitational force detection unit for detecting a direction of gravitational force of a real space, and a direction of gravitational force reflection unit for reflecting the direction of gravitational force detected by the detection unit in the virtual space.