Multi-User AR Interaction Mapping With Camera Parameter Transformation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video creation platforms lack support for interactions between multiple users, relying solely on the creativity of a single user, and require high network bandwidth for transmitting interaction information.
Innovation Solution
Implementing a method and system for augmented reality (AR) interactions between multiple users by generating graphic objects based on user interactions, using camera parameters to reduce network bandwidth requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If video creation platforms provide personalized creation methods relying on single user creativity, then users can create video content with filters and special effects, but the platforms cannot provide support for interactions between multiple users
Solution Approach 1:
The patent uses screen coordinate copying and transformation to enable multi-user interaction. The first device captures interaction coordinates from its screen, transforms them using camera parameters, and transmits the transformed coordinates to the second device. This allows the second device to replicate the same interaction effect on its own screen without requiring complex real-time synchronization of entire interface states, thus enabling multi-user interaction while controlling system complexity.
Solution Approach 2:
The patent introduces camera parameters as an intermediary element to bridge between different devices' coordinate systems. Instead of directly mapping coordinates between devices, the system uses camera parameters (resolution, aspect ratio, field of view) as a mediation layer to transform coordinates into a common reference frame. This intermediary approach simplifies the interaction system by providing a standardized transformation method rather than requiring direct device-to-device coordination.
2Adaptability or versatility
If interaction information is transmitted between devices to enable multi-user AR interactions, then user experience is enhanced, but network bandwidth requirements increase
Solution Approach 1:
The patent extracts only the essential interaction information needed for AR interactions - specifically screen coordinates and camera parameters - and transmits only this extracted data between devices. Instead of transmitting entire interface states or video streams, the system extracts and transmits only the minimal necessary data (interaction coordinates and device camera parameters), significantly reducing network bandwidth consumption while maintaining full AR interaction capability.
Solution Approach 2:
The patent transforms interaction coordinates using camera parameters to adapt them for different devices. By changing the coordinate parameters through mathematical transformation based on camera resolution, aspect ratio, and field of view, the system enables the same interaction to be accurately represented across devices with different specifications. This parameter transformation approach allows efficient data transmission by sending only the base coordinates and relying on parameter-based transformation rather than transmitting device-specific coordinate mappings.
Data Source
AI summary
Provided are an interaction method and system, and a device, a storage medium and a program product. A first device receives a first interaction on a first interface and generates a first graphic object presented on the first interface, wherein the first interface presents a first image that is captured by a first camera of the first device. The first device generates first interaction information for indicating the first interaction based on a first camera parameter of the first camera and sends the first interaction information to a second device, which presents on a second interface a second graphic object corresponding to the first interaction based on the first interaction information and a second camera parameter of a second camera of the second device, wherein the second interface presents a second image captured by the second camera.