3D Image Synthesis Using RGB-D Depth Sensors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for generating high-definition images of specific objects are time-consuming and impractical, especially when creating three-dimensional models, as they require manual effort or specialized equipment, limiting the feasibility of collecting a large number of images.
Innovation Solution
An information processing apparatus that acquires three-dimensional information using sensors like RGB-D cameras, selects recognition targets, cuts images to generate foreground images, and synthesizes them with background images to create a large number of images, allowing for easy generation without the need for high-definition three-dimensional models or specialized environments.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If manual method is used to create a three-dimensional model, then high-definition three-dimensional model can be obtained, but the process becomes very time consuming
Solution Approach 1:
The patent uses depth information from RGB-D cameras to automatically generate three-dimensional models by copying and processing real-world object data, eliminating the need for manual modeling while maintaining high definition quality through automated depth map processing and mesh generation
Solution Approach 2:
The patent replaces manual mechanical modeling processes with automated computer vision systems that use depth sensors and image processing algorithms to generate three-dimensional models automatically, substituting human labor with computational processes
2Manufacturing precision
If special environment such as turntable is used to create a three-dimensional model, then three-dimensional model can be obtained, but the method cannot create a model unless the object fits the equipment constraints
Solution Approach 1:
The patent creates a universal three-dimensional modeling system that can handle objects of any size by using depth cameras and automated processing, replacing specialized equipment like turntables with a flexible computational approach that adapts to different object dimensions
Solution Approach 2:
The patent transitions from two-dimensional image processing to three-dimensional modeling by incorporating depth information from RGB-D cameras, enabling the system to capture and process objects in three-dimensional space without physical constraints
3Quantity of substance
If conventional image synthesis method is used, then images can be generated, but high-definition three-dimensional model is required which is difficult to obtain
Solution Approach 1:
The system performs self-service by automatically generating three-dimensional models from depth camera data and using these models to synthesize images, eliminating the need for external high-definition three-dimensional model sources and enabling autonomous image generation
Data Source
AI summary
An information processing apparatus (100) include a memory to store a plurality of background images; a sensor to acquire three-dimensional information including a plurality of images; and processing circuitry. The processing circuitry selects a recognition target from the three-dimensional information; cuts an image of a recognition target range corresponding to the selected recognition target from each of the plurality of images to generate a plurality of foreground images from the plurality of images; synthesizes each of the plurality of foreground images with each of the plurality of background images to generate a plurality of synthesized images. The processing circuitry generates recognition target range information indicating the recognition target range with three-dimensional positions of a plurality of points. The processing circuitry projects the recognition target range onto each of the plurality of images to specify the recognition target range in each of the plurality of images.