Visual Target Density Evaluation for Free-Viewpoint Image Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies fail to effectively determine an appropriate target position in a space for generating expressive and attractive images, as they lack sufficient methods for deciding on the optimal viewpoint for image generation.

Innovation Solution

An information processing device and method that collect and evaluate visual target positions from multiple viewpoints in a space based on their density, using spatial ratings to determine attention-attracting areas, allowing for the generation of free-viewpoint images focused on high-interest regions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If multiple cameras capture images from different viewpoints to generate expressive images, then the image expressiveness is improved, but the difficulty of selecting appropriate target positions increases

Engineering Contradiction:
Improveimage expressivenessVSAvoidtarget position selection difficulty
Core Design Contradiction:
Ease of manufactureVSDifficulty of detecting and measuring

Solution Approach 1:

The system automatically evaluates and selects optimal target positions based on density calculations from multiple viewpoint images, eliminating the need for manual position selection by users. The device performs self-service by autonomously determining which positions to capture images from based on the analyzed spatial distribution of visual targets.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If manual selection of target positions is used, then image generation is simple, but the attractiveness and expressiveness of images deteriorates

Engineering Contradiction:
Improveoperation simplicityVSAvoidimage attractiveness
Core Design Contradiction:
Ease of operationVSEase of manufacture

Solution Approach 1:

The system performs preliminary evaluation of multiple candidate target positions by calculating density values from images captured at different viewpoints before final image generation. This preliminary analysis identifies the most attractive positions automatically, allowing the system to maintain operational simplicity while ensuring image attractiveness through pre-computed density-based selection.

Inventive Principle:
Principle #10Preliminary action

3Area of stationary object

If images are captured from all positions in space, then complete coverage is achieved, but data processing complexity and storage requirements increase

Engineering Contradiction:
Improvespatial coverageVSAvoiddata processing complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

Instead of uniformly processing all spatial positions, the system applies local quality assessment by calculating density values specifically for regions where visual targets are concentrated. This approach focuses computational resources on high-interest areas with significant visual targets, reducing overall data processing complexity while maintaining coverage of important regions.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system captures and processes images from more positions than strictly necessary by evaluating multiple candidate positions with density calculations, then selectively uses only the most relevant positions for final image generation. This partial action approach ensures complete coverage of important areas while avoiding unnecessary processing of low-value positions.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP3229459B1Information processing device, information processing method and program
Publication Date: 2022.08.24 SONY GROUP CORP
  • EP3229459B1 patent drawingFigure 1
  • EP3229459B1 patent drawingFigure 2
  • EP3229459B1 patent drawingFigure 3~4

AI summary

[Object] To appropriately decide an image generation target position in a space. [Solution] Provided is an information processing device including a processor configured to achieve a function of collecting information indicating visual target positions from a plurality of viewpoints existing in a space, and a function of evaluating positions in the space in accordance with density of the visual target positions.