Adaptive AI Haptic Feedback for VR Immersion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current haptic feedback technologies in virtual reality environments do not adapt to changes in the properties of virtual objects over time, leading to a disconnect between users and the virtual environment, reducing immersion and engagement.

Innovation Solution

A system and method for rendering AI-based haptic feedback with recommendations, utilizing neural networks to detect and track virtual object attributes, scene information, and user interactions, generating adaptive tactile and thermal feedback through haptic devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If fixed-level haptic feedback is used, then device complexity is reduced, but adaptability to virtual object property changes deteriorates

Engineering Contradiction:
Improveadaptability to virtual object property changesVSAvoidhaptic feedback system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The haptic feedback system transitions from a static, fixed-level feedback mechanism to a dynamic system that continuously adapts to changing virtual object properties. The system monitors object attributes in real-time and adjusts haptic parameters accordingly, enabling the feedback to evolve with the virtual environment while maintaining manageable complexity through modular architecture.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes haptic feedback parameters based on detected virtual object properties. By monitoring attributes such as texture, temperature, and mechanical characteristics of virtual objects, the system dynamically adjusts haptic parameters including vibration frequency, amplitude, and thermal output to match the virtual object state, achieving adaptability without proportionally increasing system complexity.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If neural network-based detection and tracking is implemented, then measurement precision of virtual object attributes is improved, but device complexity and computational requirements worsen

Engineering Contradiction:
Improvedetection precision of virtual object attributesVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The neural network-based detection system is segmented into specialized modules, each responsible for detecting specific virtual object attributes such as texture, temperature, and mechanical properties. This modular approach allows for high measurement precision in each attribute category while managing overall system complexity through distributed processing and specialized function allocation across separate network components.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11954258B1Rendering AI-based haptic feedback with recommendations in a VR environment
Publication Date: 2024.04.09 SONY GROUP CORP
  • US11954258B1 patent drawing
  • US11954258B1 patent drawing
  • US11954258B1 patent drawing

AI summary

A system and method for rendering AI-based haptic feedback and recommendations in a VR environment is provided. The system detects an active VR session on a VR device that renders immersive content associated with a VR environment that includes a digital avatar and a virtual object. The system acquires the immersive content based on the detection and determines physical attributes of the virtual object, scene information associated with the VR environment, and an activity of the digital avatar based on a first network-based analysis, a second network-based analysis, a third neural network-based analysis, respectively, of the content. The system further detects an interaction between the digital avatar and the virtual object in a duration of the activity, and generates a feedback signal based on the interaction, the scene information, and the physical attributes. The system further controls a haptic device based on the feedback signal to generate a haptic feedback.