Virtual Viewpoint Image Synchronization for Electronic Sign Timing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

In virtual viewpoint images generated from multiple camera viewpoints, the independent changes in virtual content and physical content displayed on electronic signs can distract viewers, making it difficult for them to focus on the intended subject, such as a sporting event, as the frequent changes in advertisements on electronic signs and virtual advertisements can draw attention away from the main event.

Innovation Solution

An image processing apparatus that synchronizes the display timing of virtual advertisements with electronic signs within the virtual viewpoint image, ensuring that both types of content change in unison, thereby minimizing visual distraction and maintaining viewer focus on the primary event.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If virtual content and content on display device change independently, then advertising effectiveness is improved, but viewer focus on main event deteriorates

Engineering Contradiction:

Improveadvertising effectivenessVSAvoidviewer distraction

Core Design Contradiction:

Adaptability or versatilityVSObject-affected harmful factors

Solution Approach 1:

The patent merges the control of virtual content display with physical display device content by introducing a synchronization mechanism. The image processing apparatus receives control signals from the display device controller and adjusts the virtual content display timing to match the physical display content timing, thereby combining their operations to avoid viewer distraction while maintaining advertising effectiveness

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The system implements feedback control where the image processing apparatus receives timing information from the display device controller and adjusts virtual content display accordingly. This closed-loop control ensures that virtual and physical content changes are synchronized, preventing the harmful effect of independent changes that distract viewers

Inventive Principle:

Principle #23Feedback

2Productivity

If multiple advertisements change frequently, then advertising coverage is improved, but visual clarity deteriorates

Engineering Contradiction:

Improveadvertising coverageVSAvoidvisual clarity

Core Design Contradiction:

ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies periodic action by synchronizing advertisement changes across multiple displays to occur at regular, coordinated intervals. Instead of random or independent changes, advertisements follow a synchronized periodic pattern that maintains advertising coverage while reducing visual chaos and improving overall visual clarity

Inventive Principle:

Principle #19Periodic action

Data Source

PatentUS11563928B2Image processing apparatus, image processing method, and storage medium

Publication Date: 2023.01.24 CANON KK

AI summary

Provided is an image processing apparatus including: a virtual viewpoint image generating unit that generates a virtual viewpoint image which is a video, based on captured images captured by image capturing apparatuses from different directions; an electronic sign information obtaining unit that obtains information indicating a timing at which a content displayed on an electronic sign changes, the electronic sign being contained in the virtual viewpoint image and configured to change the content to be displayed on a time basis; and a control unit that performs control to cause a display unit to display the virtual viewpoint image having a virtual content inserted, the virtual content being a content that is virtual and not contained in the captured images. Based on the information, the control unit controls how the virtual content is displayed on the virtual viewpoint image.