3D Mesh Encoding Using Motion Tracking Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional 3D modeling technologies require substantial bandwidth and processing power for transmitting and encoding 3D geometric models of objects in motion, as they encode each frame or a large number of frames, leading to inefficiencies in compression and transmission.
Innovation Solution
The method involves segmenting a 3D geometric mesh into multiple meshes based on motion tracking data, encoding each mesh separately using techniques like MPEG-4 AFX, and merging them into a compressed form that reduces bandwidth and processing requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional 3D geometrical content encoding encodes each frame or a large number of frames, then the 3D geometrical models can capture motion of objects, but substantial bandwidth and processing power are required for transmission
Solution Approach 1:
The patent segments the 3D geometric mesh into multiple separate meshes, each representing a different object in the scene. By encoding each mesh separately rather than encoding the entire scene as a single large mesh per frame, the data transmission requirement is reduced while still capturing motion information for all objects.
Solution Approach 2:
The patent performs motion tracking on objects before the encoding process. Motion tracking data is collected and processed in advance to identify object positions and movements, which then guides the segmentation and encoding process. This preliminary action allows the system to focus encoding resources on capturing essential motion information rather than processing all frame data.
2Reliability
If conventional 3D geometrical content encoding encodes each frame or a large number of frames, then the 3D geometrical models can capture motion of objects, but compression efficiency is limited
Solution Approach 1:
The patent divides the scene into multiple independent object meshes and encodes them separately. This segmentation allows for more efficient compression because each individual mesh can be optimized independently, and redundant information between frames can be better exploited for each object rather than across the entire scene.
Solution Approach 2:
The patent applies motion tracking to dynamically adjust the encoding process. By tracking object motion throughout the video sequence, the system can adaptively encode only the regions containing moving objects, reducing the amount of data that needs to be compressed and transmitted while maintaining accurate motion representation.
Data Source
AI summary
An apparatus and method for three-dimensional (3D) geometric data compression, includes storage of a first 3D geometric mesh of a first data size, which includes a 3D representation of a plurality of objects in a 3D space. The apparatus includes circuitry that receives motion tracking data of the plurality of objects from a plurality of position trackers. The motion tracking data includes motion information of each of the plurality of objects from a first position to a second position in the 3D space. The 3D geometric mesh is segmented into a plurality of 3D geometric meshes corresponding to the plurality of objects, based on the motion tracking data. As a result of the segmentation of the 3D geometric mesh before encoding and the use of motion tracking data, the plurality of 3D geometric meshes are efficiently encoded.