Reconfigurable Robot Control for Immersive VR Object Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing VR and AR applications face challenges in providing immersive user experiences due to the use of conventional peripherals, which can break the sense of immersion, and alternative methods like gesture-based inputs are limited in handling multiple objects effectively.

Innovation Solution

A robotic platform with a control system and configurable apparatus that can mimic the shape of objects in a virtual environment, allowing users to interact with virtual objects in a more intuitive and immersive manner by physically manipulating a robot that adapts its shape to match the object being interacted with.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional peripherals (mouse, keyboard) are used in VR/AR applications, then basic input functionality is provided, but the sense of immersion is broken because the peripherals do not match the virtual objects

Engineering Contradiction:
Improveinput functionalityVSAvoidimmersion quality
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The robotic platform dynamically reconfigures its physical shape to match the virtual object being interacted with. The robot can transform from one configuration to another in real-time, allowing the same physical device to adapt to different virtual objects (cup, book, tool, etc.), thereby maintaining immersion while providing versatile input functionality

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

A single robotic platform is designed to perform multiple functions by changing its configuration. Instead of requiring separate peripherals for each virtual object type, the universal robot can morph into various shapes to represent different objects, providing both basic input functionality and high immersion quality across multiple scenarios

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If specialised peripherals or clip-on attachments are provided for each virtual object, then the sense of immersion is increased, but the number of peripherals and device complexity increases directly with the number of different objects

Engineering Contradiction:
Improveimmersion qualityVSAvoidnumber of peripherals
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system employs a single universal robotic platform that can assume multiple configurations to represent different virtual objects. This eliminates the need for multiple specialised peripherals or clip-on attachments, reducing device complexity while maintaining high immersion quality across various virtual object interactions

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The robotic platform uses dynamic reconfiguration capabilities to transform its physical form factor in real-time. This dynamic adaptation allows one device to replace many static peripherals, significantly reducing the total number of components needed while maintaining object-specific immersion quality

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If gesture-based inputs are used to eliminate peripherals, then more intuitive inputs are provided, but the ability to handle multiple objects effectively is limited

Engineering Contradiction:
Improveinput intuitivenessVSAvoidmulti-object handling capability
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The robotic platform combines the intuitiveness of gesture-based interaction with the versatility of physical object representation. The robot can dynamically change its configuration to match each virtual object, providing tactile and visual cues that enhance intuitive interaction while maintaining the ability to handle multiple different object types effectively

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11312002B2Apparatus control system and method
Publication Date: 2022.04.26 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11312002B2 patent drawing
  • US11312002B2 patent drawing
  • US11312002B2 patent drawing

AI summary

A system for controlling a configurable apparatus includes a configuration identification unit operable to identify a preferred configuration of the apparatus in response to media content to be provided to a user, and a configuration modification unit operable to modify the configuration of the apparatus in dependence upon the identified preferred configuration, where different configurations of the apparatus correspond to the shapes of different objects relating to the media content.