Negative Refraction Panel for 3D Virtual Object Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current interaction methods with three-dimensional virtual objects are limited and do not meet user requirements, lacking the ability for effective interaction beyond traditional screen-based interfaces.

Innovation Solution

A method and apparatus that utilize a display device with a negative refraction panel to project three-dimensional virtual objects into a sensing region outside the device, allowing users to perform motion sensing interactions and updates based on user gestures, combined with tactile feedback for enhanced interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional screen-based interaction methods are used with three-dimensional virtual objects, then the interaction method is simple to implement, but the interaction capability is limited and does not meet user requirements

Engineering Contradiction:
Improveinteraction capabilityVSAvoidinteraction system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent transitions from traditional two-dimensional screen-based interaction to three-dimensional spatial interaction by projecting virtual objects into a three-dimensional display region. Users can interact with virtual objects from multiple angles and positions in space, not just from a fixed frontal view on a screen. This dimensional expansion enables richer interaction capabilities including spatial manipulation, multi-angle observation, and immersive engagement.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces a projection system as an intermediary between the user and the virtual objects. The projection device maps virtual objects onto a three-dimensional display region, creating a mediator that enables natural spatial interaction. This intermediary layer allows users to interact with virtual objects using natural hand gestures and body movements in physical space, bridging the gap between digital virtual objects and physical user actions.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If motion sensing interaction is added to enable users to interact with three-dimensional virtual objects in space, then the user experience is enhanced, but the device complexity increases

Engineering Contradiction:
Improveuser interaction easeVSAvoiddisplay device complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system employs motion sensing technology to automatically detect and track user gestures and positions in the three-dimensional space without requiring explicit commands or complex control interfaces. The motion sensing module continuously monitors user movements and automatically translates them into interaction operations on the virtual objects, enabling intuitive and effortless interaction. Users simply perform natural movements, and the system self-adapts to their actions.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent implements a feedback mechanism where the system responds to user motion sensing inputs by updating and re-projecting the virtual objects in real-time. When users perform gestures or move within the interaction space, the system detects these movements and provides immediate visual feedback by modifying the virtual objects' state or position in the three-dimensional display region, creating a responsive and engaging interaction loop.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables users to interact with three-dimensional virtual objects in a more immersive and dimensional manner, providing visual and tactile feedback, thereby enhancing user experience and interaction capabilities.

Implementation Method 1

an optical panel, configured to negatively refract an optical signal of a three-dimensional virtual object transmitted to the first region of the space, so that an image of the three-dimensional virtual object is generated in the second region of the space

Methodology Applied
Scientific EffectNegative refraction: Negative Refraction

Data Source

PatentUS12354213B2Three-dimensional virtual object interaction method and apparatus, display device, and storage medium
Publication Date: 2025.07.08 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • US12354213B2 patent drawing
  • US12354213B2 patent drawing
  • US12354213B2 patent drawing

AI summary

This application discloses an interaction method performed by a computer device. A three-dimensional virtual object is obtained; an optical signal of the virtual object is transmitted to a first side of an optical panel and then projected from the first side into a second side of the optical panel through the optical panel, so that an image of the virtual object is generated on the second side of the optical panel via negative refraction; when it is detected that a user performs a motion sensing operation on the image of the three-dimensional virtual object, updating the three-dimensional virtual object based on the motion sensing operation, to obtain an updated three-dimensional virtual object.