Predictive Video Transmission for Delayed Remote Work Instructions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In video transmission systems, a non-zero transmission time of video data from a site to a remote location results in delays, which can lead to inappropriate work instructions being issued by remote workers.
Innovation Solution
A video transmission system that includes video data acquiring circuitry, inference circuitry with learning models, and data transmission and reception circuitry to transmit and receive intermediate data, allowing for the prediction of video frames based on transmission time delays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If video data is transmitted from a site to a remote place, then the worker can check the situation on the site, but the transmission time cannot be zero causing delay in checking and issuing work instructions
Solution Approach 1:
The system performs preliminary action by predicting future video frames in advance of when they will be needed. The prediction unit generates predicted video data that represents future states of the site, allowing the worker to view and issue instructions based on anticipated conditions rather than delayed real-time conditions. This eliminates the effective delay by showing the worker what the site will look like when the instruction needs to be executed.
2Speed
If video data is transmitted in real-time, then the transmission time is minimized, but the worker receives outdated information that does not reflect the current site conditions
Solution Approach 1:
The system creates a copy of the site state as it will exist in the future, rather than transmitting the actual real-time video data. The prediction unit generates predicted video data that is a representation of future site conditions, allowing the worker to receive information about current/relevant site states without the delay inherent in real-time transmission. This copied future state information remains valid and relevant for issuing instructions.
Data Source
AI summary
A video transmission system includes: a video data acquiring unit to acquire first video data indicating a first video photographed by a camera; a first inference unit to give the first video data to a first learning model, and acquire intermediate data that is data different from the first video data from the first learning model; a data transmission unit to transmit the intermediate data; a data reception unit to receive the intermediate data transmitted from the data transmission unit; and a second inference unit to give the intermediate data to a second learning model, and acquire, from the second learning model, second video data indicating a predicted video of a second video of which a photographing time of the camera is advanced from that of the first video by a transmission time of the intermediate data from the data transmission unit to the data reception unit or more.