Remote Guidance Video Synchronization via Time Difference Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote action guidance systems face hindrance in workability due to time delays in video picture transmission, causing the returned video picture to represent a situation different from the current on-site situation, which can hinder the worker's ability to perform tasks accurately.
Innovation Solution
A remote behavior navigation system that includes a first camera and monitor for the worker, a worker-side computer, a second camera and monitor for the instructor, and an instructor-side computer connected via a bidirectional communication network, which extracts and corrects the work instruction video picture using a time difference correction function to ensure the video picture corresponds to the current on-site situation, reducing data transmission volume and time delay.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the work video picture is transmitted to the instructor and the instruction video picture is superimposed and transmitted back to the worker, then the worker can receive visual guidance, but the time delay causes the video picture to represent a situation different from the current on-site situation, hindering workability
Solution Approach 1:
The patent extracts only the necessary instruction video picture from the instructor's camera feed and transmits it separately from the worker's video feed. This extraction approach reduces the total data transmission volume and allows for more efficient processing, thereby reducing time delay while maintaining guidance effectiveness.
Solution Approach 2:
The system performs preliminary actions by capturing the instruction video picture at time t2 (corresponding to worker's video at t1) before the actual superimposition and transmission to the worker. This preliminary capture and processing allows the system to prepare guidance content in advance, reducing the overall time delay in the feedback loop.
2Ease of operation
If the instruction video picture is superimposed on the work video picture before transmission, then the worker receives integrated guidance information, but the data transmission volume increases and causes longer time delay
Solution Approach 1:
The patent segments the video transmission into two separate streams: the worker's video feed and the instructor's instruction video feed. These are processed and superimposed at different locations (worker-side and instructor-side respectively) rather than being combined into a single large data stream. This segmentation reduces transmission volume and time delay while maintaining integrated guidance functionality.
3Device complexity
If the video picture transmission is performed without time difference correction, then the system is simpler, but the returned video picture represents a situation substantially different from the current situation, reducing productivity
Solution Approach 1:
The patent implements a feedback mechanism where the system calculates the time difference between the worker's video picture timestamp (t1) and the instructor's video picture timestamp (t2), and uses this feedback information to select and apply appropriate time difference correction processing. This feedback loop ensures that the displayed guidance corresponds to the current on-site situation, improving workability without excessive complexity.
4Measurement precision
If the work video picture and instruction video picture are transmitted with full resolution and detail, then the guidance quality is high, but the data transmission volume is large causing significant time delay
Solution Approach 1:
The patent applies partial action by extracting only the necessary portions of the instructor's video feed (the instruction video picture showing hands, tools, or relevant work areas) rather than transmitting the entire high-resolution video stream. This partial transmission maintains sufficient guidance quality while significantly reducing data transmission volume and time delay.
Data Source
AI summary
There are provided a remote behavior navigation system and a method thereof, which allow an instructor at a remote location to perform guidance to a worker while watching a work video picture of the worker. Corresponding to a video picture from a worker-side camera at time t1, an instructor-side computer extracts a work instruction video picture from a video picture of an instructor-side camera at time t2. The instructor-side computer superimposes the work instruction video picture at the time t2 on the video picture from the worker-side camera at the time t1, and displays the superimposed video picture on an instructor-side monitor. A worker-side computer provides the work instruction video picture at the time t2 with a time difference correction, then superimposes the corrected work instruction video picture on a video picture from the worker-side camera at time t3, and displays the superimposed video picture on a worker-side monitor.