Free-Viewpoint Replay Control Using Rotation Center Visualization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies face challenges in quickly creating free-viewpoint images, especially for live broadcasts, as they require rapid generation and processing of images from multiple viewpoints to replay scenes in sports events.

Innovation Solution

An information processing device with a display control unit that visualizes and controls the rotation center position of a viewpoint for generating free-viewpoint images, utilizing a system configuration that includes imaging devices, servers, and controllers to facilitate quick creation and display of free-viewpoint images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If conventional free-viewpoint image generation methods are used, then image quality can be maintained, but the time required for creating clips is excessive for live broadcast requirements

Engineering Contradiction:
Improveclip creation speedVSAvoidtime delay for replay
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-generating and storing multiple candidate viewpoint images and camera path data during the live broadcast. When a replay is needed, the selection and assembly of these pre-prepared materials significantly reduces the time required compared to generating images from scratch at the moment of replay request.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If multiple camera paths are generated and stored for later selection, then clip creation time is reduced, but the device complexity and storage requirements increase

Engineering Contradiction:
Improveclip creation efficiencyVSAvoidsystem configuration complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system segments the complex task of free-viewpoint image generation into distinct components: multiple candidate camera paths are generated independently, stored separately, and then selected/combined based on replay requirements. This segmentation allows parallel processing and reduces the computational burden at any single point in time.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically selects and adjusts camera paths based on real-time broadcast requirements and operator preferences. Rather than using a fixed, predetermined path, the system can adaptively choose from multiple stored paths or generate new paths as needed, providing flexibility without requiring all possible paths to be actively maintained.

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If the rotation center position is not visualized, then the interface remains simple, but the operator cannot accurately control or understand the viewpoint configuration

Engineering Contradiction:
Improveviewpoint control accuracyVSAvoidinterface complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system uses visual indicators such as colored markers or highlights to represent the rotation center position and other viewpoint parameters on the display interface. These visual cues change color or intensity based on selection state, helping operators quickly identify and control viewpoint configuration without requiring complex numerical interfaces.

Inventive Principle:
Principle #32Color changes

Data Source

PatentUS12470679B2Information processing device, information processing method, program, and display system
Publication Date: 2025.11.11 SONY GROUP CORP
  • US12470679B2 patent drawing
  • US12470679B2 patent drawing
  • US12470679B2 patent drawing

AI summary

An information processing device according to the present technology includes a display control unit that controls a display of rotation center position information on a target space captured image that is an image in which a real space for which a free-viewpoint image is to be generated is captured, the rotation center position information indicating a position of viewpoint rotation center of the free-viewpoint image.