AI Scene Interaction Mapping for Real-Time Online-Offline Integration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing online and offline activities are separate, leading to difficulties in direct interaction and limited interaction efficiency and quality, especially with the rise of diverse user groups seeking enhanced engagement.

Innovation Solution

A scene interaction method and apparatus utilizing artificial intelligence technologies, including computer vision and speech processing, to integrate and interact real-time offline and online scenes by extracting scene features from real scenes and mapping them to virtual scenes, enhancing interaction efficiency and variety.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If online and offline activities are kept separate, then activity organization is simple, but interaction efficiency and quality are limited

Engineering Contradiction:
Improveinteraction efficiencyVSAvoidactivity organization complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent merges online and offline activity scenes into a unified interaction system. The server integrates real scene information from offline locations with virtual scene data, enabling participants to interact across both environments simultaneously. This combination resolves the contradiction by improving interaction efficiency through unified processing while managing complexity through modular system architecture.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The server acts as an intermediary that bridges online and offline scenes. It receives real scene information from offline locations, processes it, and maps it to the virtual scene, enabling seamless interaction between participants in different environments. This mediator approach allows integrated interaction without requiring direct complex connections between all components.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If real-time integration of offline and online scenes is implemented, then interaction variety is enhanced, but system complexity increases

Engineering Contradiction:
Improveinteraction varietyVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments the integration process into distinct functional modules: real scene information acquisition, feature extraction, scene mapping, and interaction processing. Each module handles a specific aspect of the integration, enabling enhanced interaction variety while managing system complexity through modular design. The server divides the complex task of real-time integration into manageable segments that can be processed independently.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system extracts key features from real scene information (such as location data, participant status, and environmental context) and separates them from the complete raw data. This extraction allows the system to work with essential interaction elements while filtering out unnecessary complexity, thereby enhancing interaction variety without proportionally increasing system complexity.

Inventive Principle:
Principle #2Taking out (Extraction)

3Speed

If feature extraction and mapping is performed in real-time, then interaction responsiveness is improved, but processing load increases

Engineering Contradiction:
Improveinteraction responsivenessVSAvoidprocessing load
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The system performs partial feature extraction by focusing on key interaction-relevant features from real scene information rather than processing all available data. The server extracts essential elements such as participant location, activity status, and basic environmental context, omitting unnecessary detailed processing. This partial action approach maintains interaction responsiveness while reducing overall processing load and energy consumption.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP3998550B1Scene interaction method and apparatus, electronic device, and computer storage medium
Publication Date: 2026.04.01 TENCENT TECHNOLOGY (SHENZHEN) CO LTD
  • EP3998550B1 patent drawingFigure 1~2
  • EP3998550B1 patent drawingFigure 3~4
  • EP3998550B1 patent drawingFigure 5~6

AI summary

The present application relates to the technical field of artificial intelligence, and provides a scene interaction method and apparatus, an electronic device, and a computer storage medium. The method comprises: determining at least one reality scene interacting with a virtual scene; acquiring reality scene information of each reality scene in real time; performing feature extraction on each piece of reality scene information to obtain a corresponding scene feature of each reality scene; and mapping the scene feature of the at least one reality scene into the virtual scene according to a correspondence between the virtual scene and the reality scene. By means of embodiments of the present application, the interaction efficiency can be improved, and richer and more diverse interaction effects can also be obtained.