Remote Camera Control Emulated Image Latency Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Communication latency between a camera and a remote control device makes it difficult to observe and adjust camera functions such as pan, tilt, zoom, brightness, and other settings in real-time, leading to delayed responses and cumbersome adjustments.

Innovation Solution

A control device sends a control signal with a command and an emulated image to the monitor, allowing users to see the effects of adjustments before they are executed by the camera, which is then seamlessly replaced with the actual image once the command is completed, using a time code and camera-specific emulation models to ensure precise control.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the control signal is sent to the camera over a network with high latency, then the camera can be remotely controlled from any location, but the response time of the camera adjustments is delayed

Engineering Contradiction:
Improveremote control capabilityVSAvoidresponse delay
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system applies the control command to the currently displayed image frame before receiving the updated image from the camera, creating a predicted display that shows the effect of the control adjustment immediately. This preliminary action eliminates the perceptible delay caused by network latency.

Inventive Principle:
Principle #10Preliminary action

2Ease of operation

If the control command is applied immediately to the displayed image, then the user sees instant response, but the timing synchronization between control and actual camera state may be lost

Engineering Contradiction:
Improveinstant response perceptionVSAvoidtiming synchronization
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system uses a time code embedded in received image frames to detect when the camera has actually executed the control command. When the time code matches the expected value, the system switches from displaying the predicted image to displaying the actual updated image from the camera, ensuring timing synchronization is maintained.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3550824B1Methods and apparatus for remotely controlling a camera in an environment with communication latency
Publication Date: 2023.07.26 TVU NETWORKS CORP
  • EP3550824B1 patent drawingFigure 1
  • EP3550824B1 patent drawingFigure 2
  • EP3550824B1 patent drawingFigure 3

AI summary

Methods, apparatus, and systems are provided for remotely controlling a camera in an environment where there is a delay. A control device is provided for controlling a remotely located camera via a network. The control device comprises a monitor for viewing an image provided by the camera. A control signal is sent from the control device to the camera with a command for controlling at least one of a function, setting, or parameter of the camera. An image displayed on the monitor of the control device is modified in accordance with the command to provide an emulated image for display prior to execution of the command at the camera.