AR Display System Multi-User Camera Attitude Overlay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality systems are unable to simultaneously overlay content on images taken by multiple users in real-time, especially in dynamic environments like sports stadiums, where accurate camera attitude estimation and content positioning are challenging due to symmetric markers and varying camera angles.

Innovation Solution

An augmented reality display system comprising a wide camera system, cloud server, and terminal device that produces and transmits position information of objects, estimates camera attitude using seven parameters, and overlays content on images based on transformed position information, allowing simultaneous overlay of useful content on images taken by multiple users.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If augmented reality systems use traditional content overlay methods, then content can be displayed on individual images, but multiple users cannot simultaneously view personalized content from their respective perspectives

Engineering Contradiction:
Improvemulti-user perspective adaptationVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments the content delivery process by creating separate data streams for each user device. Each terminal device receives customized position information and content data tailored to its specific camera attitude and user perspective, enabling personalized AR overlays without requiring complex inter-device coordination

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary server that acts as a mediator between the content source and multiple user devices. This server receives camera attitude information from each device, calculates transformed position information, and distributes appropriate content to each user, thereby managing multi-user personalization without increasing individual device complexity

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If the system transforms position information based on camera attitude estimation, then accurate content positioning is achieved, but the processing time and computational load increase

Engineering Contradiction:
Improvecontent positioning accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-calculating and storing transformation matrices and position information in a database before actual content overlay is needed. When a user views content, the system simply retrieves pre-computed data rather than performing real-time calculations, thereby maintaining high positioning accuracy while minimizing processing time

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes parameters by using pre-computed transformation matrices that capture camera attitude information. Instead of performing complex real-time coordinate transformations, the system retrieves and applies pre-calculated transformation parameters, significantly reducing computational load while maintaining positioning precision

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10152826B2Augmented reality display system, terminal device and augmented reality display method
Publication Date: 2018.12.11 PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
  • US10152826B2 patent drawing
  • US10152826B2 patent drawing
  • US10152826B2 patent drawing

AI summary

An augmented reality display system includes: a data producing system that produces position information of an object; a cloud server that receives the position information produced by the data producing system; and a terminal device connectable to the cloud server through a network. The terminal device includes: an imaging unit that produces an image data; a camera attitude estimating unit that estimates an attitude of the imaging unit from the image data; a data receiving unit that receives a content and the position information regarding the content from the cloud server; a data overlaying unit that transforms the position information correspondingly to the attitude of the imaging unit estimated by the camera attitude estimating unit, and overlays the content on the image data based on a reference position indicated by the transformed position information to obtain an overlay image data; and a display unit that displays the overlay image data.