Virtual Viewpoint Coordination for Multi-Device Coaching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques for generating virtual viewpoint images do not effectively coordinate the virtual viewpoint among multiple users, particularly in scenarios where a coach needs to instruct players using virtual viewpoint images from a basketball game, with the coach and players viewing the images on separate devices.
Innovation Solution
An image processing apparatus that includes multiple units: an acquisition unit for obtaining images from multiple cameras, viewpoint determination units for generating camera parameters based on input values from multiple devices, and video generation units for creating virtual viewpoint videos based on these parameters and images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual viewpoint images are generated from multiple cameras without coordination mechanisms, then each user can view the image independently, but the coach cannot coordinate the viewpoint to reflect desired shots while allowing players to operate for situational awareness
Solution Approach 1:
The system divides the virtual viewpoint control into separate segments: a coach's viewpoint control unit and a player's viewpoint control unit. Each unit can independently generate virtual viewpoint images based on its own control inputs, while both feed into a common image synthesis unit. This segmentation allows coordinated control without requiring a single complex centralized system.
Solution Approach 2:
The system merges the outputs of multiple viewpoint control units and image synthesis units into a coordinated virtual viewpoint image. The image synthesis unit combines images from different virtual cameras with coordinated camera parameters, allowing multiple users to view synchronized perspectives that reflect both coach-controlled and player-operated viewpoints.
2Ease of operation
If the coach controls the virtual viewpoint image completely, then the desired shot can be reflected accurately, but the players cannot operate the viewpoint to grasp their surroundings
Solution Approach 1:
The system implements dynamic viewpoint control where the virtual camera parameters can be adjusted based on user input. The coach's viewpoint control unit and player's viewpoint control unit can independently modify camera parameters such as position and orientation, allowing flexible adaptation between coach-controlled precision and player-operated exploration.
Solution Approach 2:
Different users are granted different levels of control authority over the virtual viewpoint. The coach can control the overall viewpoint for instructional purposes, while players can independently adjust their own viewpoint for situational awareness. This local quality differentiation allows each user to operate within their designated scope without interfering with others.
3Adaptability or versatility
If multiple users view virtual viewpoint images on separate devices, then each user has independent viewing capability, but coordinating the virtual viewpoint across devices becomes difficult
Solution Approach 1:
The system creates a universal virtual viewpoint coordination mechanism that works across multiple independent devices. Each device can receive virtual viewpoint images from the same coordinated camera parameters, allowing coaches and players to view synchronized perspectives on separate screens without requiring device-specific integration.
Solution Approach 2:
The system incorporates feedback mechanisms where viewpoint control inputs from multiple users are processed and synchronized. The coordination unit receives control signals from both coach and player devices, adjusts camera parameters accordingly, and ensures that the virtual viewpoint images displayed on each device reflect the coordinated state, preventing information loss between devices.
Data Source
AI summary
An image processing apparatus for generating a virtual viewpoint video includes a first viewpoint determination unit arranged to generate a camera parameter of a first virtual camera based on an input value from a first input device, a playback-position determination unit arranged to determine a playback position of a virtual viewpoint image based on the input value from the first input device, a first-video generation unit arranged to generate a first virtual viewpoint video based on the first virtual camera and the playback position, a second viewpoint determination unit arranged to generate a camera parameter of a second virtual camera based on the input value from the first input device and an input value from a second input device, and a second video generation unit arranged to generate a second virtual viewpoint video based on the second virtual camera and the playback position.