Adjustable Robot Scale Cues for Accurate Virtual Object Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Actors in video game production face challenges in simulating interactions with virtual objects without a frame of reference, leading to time-consuming edits to correct scaling issues in action sequence data, which increases production costs.

Innovation Solution

A robot is used to provide a physical attribute adjustment at a three-dimensional location in the performance space to simulate the scale of virtual objects, allowing actors to perform interactions accurately without the need for subsequent data editing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the actor estimates the location of virtual objects without a frame of reference, then the actor can perform interactions independently, but the scaling accuracy of interactions deteriorates

Engineering Contradiction:
Improveactor independenceVSAvoidinteraction scaling accuracy
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

A robot is introduced as an intermediary physical object in the performance space to represent virtual objects. The robot provides a tangible frame of reference that the actor can interact with physically, while sensors track the interaction and translate it to the virtual environment. This mediator resolves the contradiction by enabling both actor independence and scaling accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the actor's mental estimation process with an automated sensor-based measurement system. Cameras and depth sensors automatically track the robot's position and the actor's movements, eliminating the need for the actor to mentally calculate scales and positions, thereby ensuring precise scaling without compromising ease of operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If the actor's estimate of the location is off by a significant margin, then the actor can still perform the action, but the production time and cost increase due to editing requirements

Engineering Contradiction:
Improveaction recording efficiencyVSAvoidediting time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The robot is positioned in advance at the precise location representing the virtual object before the actor performs the interaction. This preliminary setup ensures that the actor's natural movements are captured at the correct scale from the outset, eliminating the need for subsequent editing to correct scaling errors.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system provides real-time visual feedback to the actor through the robot's physical presence and positioning. The actor can see and interact with the robot as a tangible reference, allowing for immediate correction of any positioning issues during the performance, thereby preventing errors that would require later editing.

Inventive Principle:
Principle #23Feedback

3Manufacturing precision

If a robot is used to provide scale reference, then the scaling precision of virtual object interactions is improved, but the device complexity increases

Engineering Contradiction:
Improvevirtual object scale accuracyVSAvoidperformance space equipment
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The robot is designed as a multi-functional device that simultaneously serves as a physical frame of reference for the actor, a tracked object for sensor systems, and a representative of the virtual object. This universal design consolidates multiple functions into a single device, reducing overall system complexity while maintaining scaling precision.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The robot creates a physical copy or representation of the virtual object in the performance space. By replicating the virtual object's key characteristics (position, scale, orientation) in the physical realm, the system enables accurate interactions without requiring complex virtual-to-physical translation mechanisms during the performance.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12373907B2Adjustable robot for providing scale of virtual assets and identifying objects in an interactive scene
Publication Date: 2025.07.29 SONY INTERACTIVE ENTERTAINMENT LLC
  • US12373907B2 patent drawing
  • US12373907B2 patent drawing
  • US12373907B2 patent drawing

AI summary

A method for generating action sequence data for a character to be rendered in a video game is provided. The method includes, during recording of an actor in a performance space, providing a cue to the actor to perform an action that simulates interacting with a virtual object at a location in the performance space. The method also includes instructing a robot to move to the location in the performance space at which the actor is to simulate interaction with the virtual object, and instructing the robot to adjust a physical attribute of the robot when at the location. The physical attribute of the robot, when adjusted, is placed at a three-dimensional location in the performance space to simulate a scale of the virtual object with which the actor is to simulate interaction. The virtual object can be either an animated object or a non-animated object.