3D Live View Image Composition With Depth-Based Virtual Object Placement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing systems fail to provide users with three-dimensional decoration options that allow for dynamic and interactive integration of virtual objects with real subjects, limiting the creative possibilities in image composition.
Innovation Solution
An image processing device that acquires distance information from an imaging apparatus to combine live view images with three-dimensional objects, allowing for the placement and manipulation of virtual objects on real subjects based on distance information, and supports augmented reality integration with pseudo-optical characteristics and occlusion effects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual objects are integrated with real subjects in two-dimensional images, then image composition creativity is improved, but three-dimensional spatial realism is lost
Solution Approach 1:
The patent transitions from two-dimensional image composition to three-dimensional virtual space construction. By building a 3D virtual space that matches the real shooting environment and placing virtual objects within it, the system achieves realistic spatial relationships while maintaining compositional creativity. The 3D coordinates of virtual objects are calculated based on camera parameters and distance information, enabling accurate positioning in three-dimensional space.
Solution Approach 2:
The patent introduces a 3D virtual space as an intermediary between the real subject and virtual objects. This virtual space acts as a container that preserves spatial relationships, allowing virtual objects to be positioned realistically relative to the real subject. The virtual space is constructed using camera intrinsic parameters, extrinsic parameters, and distance information, creating a bridge that maintains spatial accuracy while enabling creative composition.
2Measurement precision
If distance information is used to position virtual objects in three-dimensional space, then spatial accuracy is improved, but processing complexity increases
Solution Approach 1:
The patent performs preliminary calculations of camera intrinsic parameters, extrinsic parameters, and rotation matrices before positioning virtual objects. By pre-computing these transformation parameters based on camera data and distance information, the system establishes a ready-to-use 3D coordinate system that simplifies subsequent virtual object placement. This preliminary processing organizes the complex calculations in advance, making the actual positioning operation more straightforward.
3Adaptability or versatility
If multiple virtual objects are placed on divided surfaces, then decoration flexibility is improved, but determination complexity increases
Solution Approach 1:
The patent divides the installation surface into multiple regions and places different virtual objects on different divided surfaces. This segmentation allows for flexible decoration where each region can be independently configured with appropriate virtual objects. The system determines which virtual object to place on which divided surface based on the object's intended function and the characteristics of the surface, enabling modular and flexible virtual decoration.
Data Source
AI summary
An image processing device includes a processor. The processor is configured to acquire distance information related to a distance from an imaging apparatus to a subject. The processor is configured to output a composite image obtained by combining a live view image obtained by capturing the subject with the imaging apparatus and an object defined in three dimensions based on at least the distance information.