AR Terminal Beam Selection for Accurate Virtual Object Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In large-scale facilities like stadiums, spectators viewing augmented reality (AR) services from different locations face challenges in accurately superimposing virtual objects on real objects due to limited camera performance and processing capacity of AR devices, leading to inconsistent viewing directions and discomfort.

Innovation Solution

A terminal device equipped with a camera and processor that utilizes synchronization signals beamformed in different directions to determine the best beam for each user, receiving correction information from an application server to align virtual objects with real objects, ensuring accurate AR image rendering based on user location.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If marker-based recognition or natural feature tracking is used for AR superimposition, then virtual objects can be overlaid on real objects, but viewing direction accuracy deteriorates when spectators are at different locations in large-scale facilities

Engineering Contradiction:
Improveviewing direction accuracyVSAvoidlocation adaptability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The base station performs preliminary beamforming to transmit synchronization signals in multiple directions before the AR service begins. The terminal device receives these signals in advance to determine its location and viewing direction, allowing the application server to pre-correct the AR image data accordingly. This preliminary positioning and correction action ensures accurate virtual object superimposition for spectators at different locations without requiring real-time adjustment during the event.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If correction information is transmitted to each terminal device, then AR image accuracy improves for different viewing directions, but communication load increases

Engineering Contradiction:
ImproveAR image alignment accuracyVSAvoiddata transmission volume
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

Instead of transmitting identical correction information to all terminal devices, the system determines the specific viewing direction for each terminal device based on its location (identified through beamforming synchronization signal reception). The application server then transmits customized correction information tailored to each device's local viewing conditions. This local quality approach ensures high AR image alignment accuracy for each spectator while optimizing communication efficiency by sending only the necessary correction data to each device.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If beamforming synchronization signals are transmitted in multiple directions, then location identification accuracy improves, but base station processing complexity increases

Engineering Contradiction:
Improvelocation identification accuracyVSAvoidbase station processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The base station divides the service area into multiple directional beams and transmits synchronization signals through each beam separately. Each beam corresponds to a specific spatial sector, allowing the terminal device to identify its location by detecting which beam's synchronization signal it receives. This segmentation of the coverage area into discrete beam directions enables accurate location identification while managing base station processing complexity through structured signal transmission.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20260045050A1Terminal device, application server, receiving method, and transmitting method
Publication Date: 2026.02.12 SONY GROUP CORP
  • US20260045050A1 patent drawing
  • US20260045050A1 patent drawing
  • US20260045050A1 patent drawing

AI summary

A terminal device includes a transceiver, a camera, a display, and a processor. The processor determines a first synchronization signal whose radio quality satisfies a predetermined threshold from a plurality of synchronization signals beamformed and transmitted from the base station, and reports the first synchronization signal to the base station. The processor superimposes a virtual object corrected by using correction information on a captured image of the camera and displays the image on the display. The correction information is information for indicating a position of an area covered by the first synchronization signal with respect to a real object. The correction information includes information regarding a direction of the virtual object to be displayed on the display in the area and a distance from the real object to the area.