Tangible Mixed Reality Learning Activity Deployment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current mixed reality technologies lack dynamic interaction deployment capabilities that effectively integrate real and virtual objects for learning activities, limiting their educational and interactive potential in environments like education and healthcare.

Innovation Solution

A method and system for tangible mixed reality that identifies real objects and interactions, generates learning activities, and deploys them using haptic devices and mixed reality headsets, incorporating learner models and reactive engines to create interactive and adaptive learning experiences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If mixed reality technologies are used for learning activities, then educational potential and user engagement are improved, but dynamic interaction deployment capabilities are lacking

Engineering Contradiction:
Improveeducational potentialVSAvoidinteraction deployment capability
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments learning activities into discrete interactive elements that can be independently deployed and managed within the mixed reality environment, allowing complex educational content to be broken down into manageable interaction units

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements dynamic interaction deployment that allows learning activities to be adapted and modified in real-time based on user engagement and educational objectives, enabling the mixed reality environment to respond dynamically to user actions and learning progress

Inventive Principle:
Principle #15Dynamics

2Reliability

If real and virtual objects are integrated for learning activities, then educational outcomes are improved, but system complexity increases

Engineering Contradiction:
Improveeducational outcomeVSAvoidsystem integration complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system merges real-world objects with virtual representations to create integrated learning experiences where physical and digital elements coexist and interact, allowing users to manipulate virtual objects that are anchored to real-world counterparts for enhanced educational outcomes

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system introduces intermediary layers that facilitate interaction between real and virtual objects, including haptic feedback devices and reactive engine components that mediate the interaction and reduce the complexity of direct integration

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If haptic devices and reactive engines are incorporated, then interactive learning experiences are enhanced, but device complexity and cost increase

Engineering Contradiction:
Improveinteractive learning experienceVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system implements multi-functional haptic feedback mechanisms that serve multiple purposes including providing tactile guidance, confirming user actions, and enhancing virtual object manipulation, allowing a single device component to fulfill several interactive functions

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The reactive engine incorporates self-adjusting haptic feedback that automatically adapts to user interactions without requiring manual configuration, allowing the system to self-optimize the interactive learning experience based on real-time user behavior and reduce operational complexity

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11494996B2Dynamic interaction deployment within tangible mixed reality
Publication Date: 2022.11.08 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11494996B2 patent drawing
  • US11494996B2 patent drawing
  • US11494996B2 patent drawing

AI summary

A method, a structure, and a computer system for tangible mixed reality. Exemplary embodiments may include identifying one or more real objects within an environment and identifying one or more interactions between the one or more real objects, one or more reactive objects, and one or more animations therebetween. The exemplary embodiments may further include generating one or more learning activities for a user of a mixed reality headset that include at least one of the one or more interactions, and deploying the one or more learning activities to the mixed reality headset.