Virtual Manipulator Force Feedback via Color Indicators

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional information processing systems face low operability due to the difficulty in providing users with clear feedback on whether virtual objects are pinched and the force used for pinching, as virtual objects and manipulators appear differently in the virtual space.

Innovation Solution

An information processing apparatus that includes receiving, displaying, and determining virtual force applied to virtual objects, presenting this force information to the user through visual cues such as color changes, texture, or vibrations, allowing users to better understand the grasping and manipulation of virtual objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If virtual manipulator and virtual object are displayed in virtual space, then the user can operate virtual objects, but the user cannot clearly perceive whether the object is pinched or how much force is applied

Engineering Contradiction:

ImproveoperabilityVSAvoidforce feedback information

Core Design Contradiction:

Ease of operationVSLoss of information

Solution Approach 1:

The patent implements feedback by displaying force information indicators that show the magnitude of force applied by the virtual manipulator to the virtual object. This allows users to perceive the pinching state and force level, resolving the information loss problem while maintaining virtual operation capability

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent uses color changes in the force information indicator to represent different force magnitudes. The indicator changes color based on the force level, providing intuitive visual feedback to users about the pinching force without requiring complex displays

Inventive Principle:

Principle #32Color changes

2Adaptability or versatility

If virtual manipulator is displayed in virtual space, then the user can interact with virtual objects, but the visual representation does not match reality making pinching perception difficult

Engineering Contradiction:

Improvevirtual interaction capabilityVSAvoidpinching force perception

Core Design Contradiction:

Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent introduces a force information indicator as an intermediary element between the virtual manipulator and the user. This indicator mediates the transmission of force information from the virtual interaction to the user's perception, making the invisible force visible and measurable

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent adds a new dimension of information display by showing force magnitude indicators alongside the three-dimensional virtual manipulator and object. This additional dimensional information helps users perceive force levels that cannot be judged from the 3D visual representation alone

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11385759B2Information processing apparatus, information processing method, and program

Publication Date: 2022.07.12 SONY INTERACTIVE ENTERTAINMENT LLC

AI summary

A virtual object is arranged in a virtual space, and an image in the virtual space is generated to be presented to a user. In addition, information indicating an operation from the user is received, a virtual manipulator for operating the virtual object is displayed in the virtual space in accordance with the received information indicating the operation, the magnitude of a virtual force applied to the virtual object by the virtual manipulator is determined, and information indicating the determined magnitude of the force is presented to the user.