AR Comment Display via Spatial Coordinate Conversion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for displaying comment information in video playback interfaces are limited, offering simple user interactions and only superimposing comments on the interface, lacking immersive and diverse interaction experiences.

Innovation Solution

A method and device that utilize Augmented Reality (AR) technology to convert camera position information into spatial position information, allowing comment information to be displayed in real space, enabling comments to appear as if floating in the air, with interactive motion tracks and speeds, and incorporating object recognition and geographical location-based comments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If comment information is displayed by superimposing on the video playback interface, then the implementation is simple, but the user interaction is limited and lacks immersion

Engineering Contradiction:
Improveimplementation simplicityVSAvoiduser interaction diversity
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent transitions comment display from a two-dimensional screen superposition to a three-dimensional spatial presentation using AR technology. Comments are positioned in virtual 3D space with depth, height, and width coordinates, allowing users to interact with comments from different angles and positions, thereby enhancing immersion and interaction diversity while maintaining implementation feasibility through coordinate transformation algorithms

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Device complexity

If comment information is displayed by superimposing on the video playback interface, then the system complexity is low, but the user experience is limited

Engineering Contradiction:
Improvesystem complexityVSAvoiduser experience quality
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent creates a virtual copy of the comment information in AR space that mirrors the original 2D comment content but presents it in a 3D environment. This virtual copy includes spatial coordinates, motion tracks, and interaction parameters, allowing enhanced user experience through immersive display while the underlying system maintains relatively simple architecture by reusing existing comment data structures with added spatial dimensions

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If AR technology is used to display comment information in real space, then user experience and interaction diversity are improved, but the device complexity increases

Engineering Contradiction:
Improveuser interaction diversityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a multi-functional coordinate transformation module that handles multiple tasks: converting camera coordinates to world coordinates, calculating comment generation positions, determining spatial positions for display, and managing motion tracks. This universal module consolidates various AR functions into a single system component, reducing overall device complexity while enabling diverse user interactions through unified spatial processing

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11651560B2Method and device of displaying comment information, and mobile terminal
Publication Date: 2023.05.16 SHANGHAI BILIBILI TECH CO LTD
  • US11651560B2 patent drawing
  • US11651560B2 patent drawing
  • US11651560B2 patent drawing

AI summary

The present disclosure describes techniques for displaying comment information. The disclosed techniques comprise determining position information of a mobile terminal in a first coordinate system, the mobile terminal comprising a camera, a focus point of the camera being an origin of the first coordinate system; determining first position information associated with at least one comment in the first coordinate system based on the position information of the mobile terminal; converting the first position information associated with the at least one comment to second position information associated with the at least one comment in a second coordinate system based on one or more predetermined rules; obtaining the at least one comment; and displaying the at least one comment based on the second position information associated with the at least one comment in the second coordinate system.