3D Reference Area Rendering for Arbitrary Viewpoint Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies fail to allow users to view dynamic areas, such as the strike zone in baseball, from arbitrary viewpoints in virtual viewpoint images, limiting the realism and user experience.
Innovation Solution
An image processing system that captures images from multiple cameras, generates object shape information, identifies key positions, and creates reference area information to display dynamic zones like the strike zone from any viewpoint, using three-dimensional shape reconstruction and rendering techniques.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a virtual viewpoint image is generated using multiple digital cameras, then the user can view the image from an arbitrary viewpoint, but the user cannot view dynamic areas (such as the strike zone) from any viewpoint
Solution Approach 1:
The patent applies 3D spatial coordinate transformation to map the reference area (e.g., strike zone) from the chief umpire's viewpoint coordinate system to the user's arbitrary viewpoint coordinate system. This dimensional transformation enables the reference area to be correctly positioned and displayed from any viewpoint in the virtual viewpoint image, resolving the contradiction between viewpoint flexibility and visibility of dynamic areas.
2Measurement precision
If a reference image indicating the strike zone is displayed on a head-mounted display, then the chief umpire can view the strike zone, but other viewpoints cannot view the strike zone
Solution Approach 1:
The patent creates a universal reference area information structure that can be displayed from any viewpoint. By generating reference area information in a viewpoint-independent manner using 3D coordinate transformations, the system enables the strike zone indication to be universally accessible from any viewpoint, not just the chief umpire's viewpoint, thus achieving multi-functionality.
Solution Approach 2:
The patent transforms the reference area from a 2D head-mounted display overlay to a 3D spatial object that can be viewed from any angle. By using 3D coordinate systems and transformation matrices, the reference area is positioned in three-dimensional space, allowing it to be correctly rendered from any viewpoint while maintaining its functional accuracy for strike zone indication.
Data Source
AI summary
An image processing system includes one or more memories storing instructions, and one or more processors executing the instructions to capture images of a predetermined range by using a plurality of image capturing units, generate object shape information based on a plurality of pieces of image data obtained by the plurality of image capturing units, identify a first position and a second position of the object shape information to calculate object range information, acquire predetermined object information containing a position and a shape of a predetermined object, and generate reference area information based on the object range information and the predetermined object information.