3D Digital Twin Tracking for Worksite Object State Monitoring
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In work sites, especially large or heavily industrialized environments, manually tracking and monitoring the state of work products is inefficient and prone to errors, particularly when dealing with large or complex machinery.
Innovation Solution
A method and system for generating digital twin content by obtaining a 3-D model of a space, synchronizing virtual cameras with real cameras, recognizing objects in images, and generating 3-D objects that incorporate the movement of real objects, allowing for accurate tracking and state identification of objects within the space.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If manual recording of processing situation is used to monitor work products, then no additional equipment is needed, but monitoring efficiency is very low and error occurrence is high
Solution Approach 1:
The patent creates a digital twin (virtual copy) of the work product and its processing environment. Cameras capture real-world images which are processed to generate 3D models, creating a virtual replica that mirrors the physical work site. This copying approach enables automated monitoring without manual intervention, improving both efficiency and reliability.
Solution Approach 2:
The patent replaces the manual mechanical recording system with an automated optical and computational system. Cameras, image processing algorithms, and 3D modeling software substitute human workers, eliminating manual errors and significantly improving monitoring efficiency through automated tracking of work products.
2Measurement precision
If digital twin content is generated using multiple cameras and 3D modeling, then object tracking accuracy is improved, but system complexity increases
Solution Approach 1:
The patent creates a multi-functional system where the camera system serves multiple purposes: capturing images for digital twin generation, tracking object movement, identifying object states, and monitoring work site conditions. This universal approach justifies the system complexity by delivering multiple benefits from a single integrated platform.
Solution Approach 2:
The patent introduces an image processing server as an intermediary between cameras and the digital twin generation system. This intermediary component handles image processing, 3D model generation, and coordinate transformation, simplifying the overall system architecture while maintaining high tracking accuracy through specialized processing functions.
3Measurement precision
If virtual cameras are synchronized with real cameras in 3D model, then object state identification is improved, but data processing complexity increases
Solution Approach 1:
The patent transforms 2D camera images into 3D spatial information by creating virtual cameras within a 3D model environment. This dimensionality change enables accurate state identification by providing depth and spatial context, while the synchronization process automatically handles the coordinate transformations needed to maintain accuracy.
Data Source
AI summary
Disclosed is a method of generating digital twin content corresponding to a space including objects, such as a work site including work products. The method of generating digital twin content includes obtaining a three-dimensional (3-D) model of the space, disposing, in the 3-D model, a first virtual camera that is synchronized with a first camera that is disposed in the space and that captures at least some of the space, recognizing a object in a first image that is captured by the first camera, generating a 3 -D object that is disposed in the 3-D model and that corresponds to the first object, based on the first object and the first virtual camera, and generating digital twin content including a 3-D object into which a movement of the first object is incorporated.