Virtual Camera Viewpoint Switching for Free-Viewpoint Video

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users, especially those unfamiliar with the operation, face difficulties in setting and switching virtual camera viewpoints for free-viewpoint videos, leading to potential loss of concentration or missed significant scenes during events like sports games, as existing techniques do not effectively detect or assist with user struggles in setting optimal viewpoints.

Innovation Solution

An information processing system comprising a user-specified video creation unit, an accepting unit, a determination unit, and a switching unit that accepts user instructions, determines if assistance is needed in setting the virtual camera viewpoint, and switches the displayed image when necessary, allowing for automatic assistance in maintaining optimal viewing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the user manually sets and switches virtual camera viewpoints, then the user can control the viewing angle, but the operation becomes difficult for users unfamiliar with the controls and may cause loss of concentration or missed scenes

Engineering Contradiction:
Improveease of setting virtual camera viewpointVSAvoidreliability of maintaining optimal viewpoint
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system automatically detects user struggle states and performs viewpoint switching without requiring manual user input. The determination unit monitors user operations and autonomously decides when to switch viewpoints, allowing the system to serve itself rather than requiring continuous user intervention.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements feedback by monitoring user operations and detecting struggle states through the determination unit. This feedback mechanism allows the system to adapt to user needs in real-time, switching viewpoints when users show signs of difficulty or loss of concentration, thereby improving both ease of operation and reliability.

Inventive Principle:
Principle #23Feedback

2Productivity

If the system provides automatic viewpoint switching assistance, then users unfamiliar with operations can maintain concentration on the event, but the system complexity increases

Engineering Contradiction:
Improveefficiency of viewpoint settingVSAvoidcomplexity of viewpoint control system
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The determination unit automatically monitors user operations and detects struggle states without requiring additional user input or complex interaction interfaces. This self-service approach improves productivity by enabling automatic assistance while keeping the system relatively simple.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The determination unit acts as an intermediary between the user and the viewpoint control system. It monitors user behavior and translates struggle detection into automatic viewpoint switching decisions, simplifying the overall system architecture while maintaining high productivity.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If the user manually monitors and adjusts virtual camera settings during the event, then the user can adapt to target movements, but the user may lose concentration or miss significant scenes due to operation time required

Engineering Contradiction:
Improveadaptability to target movementVSAvoidtime required for viewpoint switching
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs preliminary detection of user struggle states and proactively switches viewpoints before the user can manually adjust them. This preliminary action eliminates the time lag associated with manual operations while maintaining adaptability to target movements.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The determination unit continuously monitors user operations and maintains continuous adaptive viewpoint switching throughout the event. This continuity ensures that the system responds to target movements without interruption or time loss, keeping the useful action of viewpoint adjustment ongoing without breaking the user's concentration.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS11330240B2Information processing system, information processing method and non-transitory computer readable medium
Publication Date: 2022.05.10 JVC KENWOOD CORP
  • US11330240B2 patent drawing
  • US11330240B2 patent drawing
  • US11330240B2 patent drawing

AI summary

An information processing system includes a user-specified video creation unit configured to create a user-specified video to be distributed to a user terminal from a free-viewpoint video created based on a plurality of captured images captured by a plurality of cameras, an accepting unit configured to accept an instruction of changing setting of a virtual camera from the user terminal, a determination unit configured to determine whether a user needs assistance in setting a viewpoint of the virtual camera based on the instruction from the user accepted by the accepting unit, and a switching unit configured to switch an image being displayed on the user terminal to another image when the determination unit determines that the user needs assistance in setting the viewpoint.