3D Velocity Map Generation via Depth and Optical Flow Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current optical flow methods only capture 2-dimensional motion, failing to effectively represent the 3-dimensional motion of objects in real-world scenarios, which is crucial for computer vision applications.
Innovation Solution
An image device comprising an image capturing group, depth map generator, optical flow generator, and velocity map generator that captures images at multiple times, generates depth maps and optical flow, and calculates velocity maps to obtain 3-dimensional displacements of pixels over time intervals, enabling the creation of 3-dimensional motion representation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If 2-dimensional optical flow is used to represent motion, then the computation is simpler and faster, but the 3-dimensional motion information is lost
Solution Approach 1:
The patent transforms 2-dimensional optical flow into 3-dimensional velocity maps by incorporating depth information. The velocity map generator combines optical flow vectors with depth map data to compute three-dimensional displacement vectors, thereby adding the depth dimension to the motion representation and recovering lost 3-dimensional motion information.
Solution Approach 2:
The patent introduces depth maps as an intermediary element between 2-dimensional optical flow and 3-dimensional motion representation. The depth map generator creates depth maps from images, which then serve as mediators to convert optical flow into velocity maps, enabling the transition from 2D to 3D motion analysis without directly computing complex 3D optical flow.
2Loss of information
If 3-dimensional motion is obtained by combining depth maps and optical flow, then 3-dimensional motion information is recovered, but the device complexity increases
Solution Approach 1:
The patent divides the motion analysis system into separate functional modules: an image capturing group for acquiring images, a depth map generator for computing depth information, an optical flow generator for calculating 2D motion vectors, and a velocity map generator for synthesizing 3D velocity maps. This segmentation allows each module to perform its specific function independently, making the overall complex system more manageable and easier to implement.
Solution Approach 2:
The patent creates a multi-functional image processing pipeline where the same input images are processed by different generators (depth map generator, optical flow generator) to produce multiple useful outputs (depth maps, optical flow vectors, velocity maps). This universal approach allows a single image capturing system to serve multiple analysis purposes without requiring separate dedicated systems for each function.
Data Source
AI summary
An embodiment of the present invention provides an image device for generating velocity maps. The image device includes an image capturing group, a depth map generator, an optical flow generator, and a velocity map generator. The image capturing group includes at least one image capturer, each image capturer of the image capturing group captures a first image at a first time and a second image at a second time. The depth map generator generates a first depth map according to the first image and a second depth map according to the second image. The optical flow generator generates first optical flow according to the first image and the second image. The velocity map generator generates a first velocity map according to the first depth map, the second depth map and the first optical flow, wherein the first velocity map corresponds to the first image.