AR Virtual Object Control via Spatial Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current joystick-based control methods in Augmented Reality (AR) racing applications are complex, leading to a poor gaming experience.

Innovation Solution

A method and apparatus for controlling virtual objects in AR, where a virtual moving area is generated within the image capture range of a control device, and a virtual object is guided based on the real movement of the device, adjusting its position and speed proportionally to a virtual identifier, while avoiding obstacles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a traditional joystick control mode is used in AR racing applications, then the control functionality is complete, but the operation complexity increases and gaming experience deteriorates

Engineering Contradiction:
Improvecontrol simplicityVSAvoidcontrol mode complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces the traditional mechanical joystick control system with an optical-based AR control system. The control device captures real-world images through a camera, generates virtual identifiers on the image, and uses image processing to track movement. This substitution eliminates the need for physical joysticks and their complex mechanical structures, providing simpler and more intuitive control while maintaining complete control functionality for racing games.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a virtual copy of the control interface by generating virtual identifiers (such as virtual joysticks or control points) overlaid on the captured image. These virtual identifiers replicate the functionality of traditional joysticks but are rendered as graphical elements on the display screen. Users interact with these visual copies through touch or gesture, eliminating the need for physical mechanical components while preserving the expected control behavior.

Inventive Principle:
Principle #26Copying

2Ease of operation

If a traditional joystick control mode is used in AR racing applications, then the control functionality is complete, but the gaming experience deteriorates

Engineering Contradiction:
Improvegaming experienceVSAvoidcontrol mode complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent transitions from two-dimensional joystick control on a screen to three-dimensional spatial control in the real world. The control device captures the real environment, places virtual identifiers at specific spatial positions in the captured image, and tracks movement in three-dimensional space. This dimensional expansion provides more intuitive and immersive control for racing games, enhancing gaming experience while maintaining manageable complexity through software-based implementation.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11504624B2Method and apparatus for controlling movement of virtual object in augmented reality, and terminal
Publication Date: 2022.11.22 NETEASE (HANGZHOU) NETWORK CO LTD
  • US11504624B2 patent drawing
  • US11504624B2 patent drawing
  • US11504624B2 patent drawing

AI summary

A method and apparatus for controlling a movement of a virtual object in AR, and a terminal are provided. The method includes: a virtual moving area is generated within a current image capture range of a control device; a virtual object is generated in the virtual moving area; and a position of a virtual identifier in the virtual moving area is adjusted according to a real movement of the control device, and the virtual object is guided to virtually move according to the position of the virtual identifier. The present disclosure solves a technical problem in the related art that a joystick-based racing control mode provided in an AR scene is complex and game experience is poor.