AR Terminal Overlay Alignment Using Beam-Specific Correction Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In large-scale facilities like stadiums, spectators at different locations have varying viewing directions of real and virtual objects, making it challenging to provide synchronized augmented reality experiences due to limited camera performance and processing capacity of AR devices, which affects capturing and image recognition accuracy.

Innovation Solution

A terminal device equipped with a camera and processor that receives synchronization signals from a base station, determines a suitable beam, and aligns virtual objects with real objects using correction information for accurate augmented reality image display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If AR devices use standard camera and processing capacity, then device complexity is reduced, but capturing and image recognition accuracy deteriorates in large-scale facilities

Engineering Contradiction:
Improvedevice complexityVSAvoidcapturing and image recognition accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent introduces a base station as an intermediary that transmits correction information to terminal devices. This intermediary provides external assistance to compensate for the limited processing capacity and camera performance of AR devices, enabling accurate image recognition and virtual object alignment without increasing device complexity

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The base station performs preliminary actions by pre-calculating and transmitting correction information before the terminal device needs to display augmented reality content. This preliminary processing of spatial relationship data allows the terminal device to accurately align virtual objects without requiring high processing power

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If AR devices increase processing capacity and camera performance, then capturing and image recognition accuracy is improved, but device complexity increases

Engineering Contradiction:
Improvecapturing and image recognition accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The base station acts as an intermediary that performs the complex processing tasks externally. By receiving images from terminal devices, calculating spatial relationships, and transmitting correction information back, the base station enables high accuracy without requiring terminal devices to have high processing capacity or advanced camera systems

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If spectators at different locations view the same real object, then user experience commonization is improved, but viewing direction alignment becomes more difficult

Engineering Contradiction:
Improveuser experience commonizationVSAvoidviewing direction alignment complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies local quality by providing location-specific correction information to terminal devices. The base station calculates and transmits correction data tailored to each spectator's position, allowing all users to view the same real object from their respective locations while maintaining accurate virtual object alignment for each individual's viewing direction

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system implements feedback by having terminal devices transmit their location information to the base station, which then calculates and returns appropriate correction information. This feedback loop enables the system to adapt to different spectator positions and provide personalized viewing experiences while maintaining overall system coordination

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12488545B2Terminal device, application server, receiving method, and transmitting method
Publication Date: 2025.12.02 SONY GROUP CORP
  • US12488545B2 patent drawing
  • US12488545B2 patent drawing
  • US12488545B2 patent drawing

AI summary

A terminal device (10) includes a transceiver (110), a camera (140), a display (130), and a processor (150). The processor (150) determines a first synchronization signal whose radio quality satisfies a predetermined threshold from a plurality of synchronization signals beamformed and transmitted from the base station (20), and reports the first synchronization signal to the base station (20). The processor (150) superimposes a virtual object corrected by using correction information on a captured image of the camera (140) and displays the image on the display (130). The correction information is information for indicating a position of an area covered by the first synchronization signal with respect to a real object. The correction information includes information regarding a direction of the virtual object to be displayed on the display (130) in the area and a distance from the real object to the area.