PTZ Camera Latency Compensation via Pre-fetched Image Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Latencies in network and device operations of pan, tilt, and zoom cameras lead to time delays in image reflection, making precise control of camera movements difficult for operators, especially at increased speeds.
Innovation Solution
A method that displays an image corresponding to a first field of view by using current image data from the camera and accessing data from a larger second field of view, allowing for immediate display of the operator's desired view without lag, and adjusts operation commands based on latency to improve movement synchronization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If the speed of pan/tilt/zoom movement is increased, then productivity is improved, but control precision deteriorates due to latency
Solution Approach 1:
The system performs preliminary actions by sending operation commands to the image capturing device before the operator sees the result. It also pre-processes and stores image data from a larger second field of view, so that when a pan/tilt/zoom command is issued, the system can immediately display the correct portion of the pre-fetched image data without waiting for the camera to physically move and capture new images, thereby maintaining control precision at high speeds.
Solution Approach 2:
The system creates a copy of the image data from the larger second field of view and stores it locally. This copied image data is then used to generate the displayed image immediately when a pan/tilt/zoom command is received, eliminating the need to wait for the camera to physically reposition and capture new images, thus maintaining precise control response even at high movement speeds.
2Loss of time
If electronic zoom processing is performed on the last received image, then the operator can see the zoomed view immediately, but the operator must wait for new image data to arrive
Solution Approach 1:
The system performs preliminary action by pre-fetching and storing image data from a larger second field of view before it is needed. When a zoom command is issued, the system can immediately process and display the zoomed portion of this pre-fetched data without waiting for new image data to arrive from the camera, eliminating both the waiting time and the need for electronic zoom processing on outdated images.
Solution Approach 2:
The system creates a local copy of the image data from the larger second field of view and stores it in memory. This copied data can be immediately processed and displayed when needed, eliminating the delay of waiting for new image data to arrive and removing the need to perform electronic zoom processing on stale images, thus improving both response time and control efficiency.
3Measurement precision
If image data from a larger second field of view is accessed and used, then control precision is improved, but device complexity increases
Solution Approach 1:
The system creates a copy of the image data from the larger second field of view and stores it locally in memory. This copied data is then used to immediately satisfy pan/tilt/zoom display requests without needing to wait for new image data or perform complex real-time processing, thereby improving control accuracy while adding minimal complexity (essentially just memory storage and data copying operations).
Data Source
AI summary
There is provided a method, a system and a device for displaying an image corresponding to a first field of view to an operator of an image capturing device. The method comprises receiving input data relating to a change in at least one of a position, an orientation, or a scaling of the first field of view and determining, based on the input data, at least one of a position, an orientation or a scaling of the first field of view with respect to a second field of view which is larger than the first field of view. Further, the method comprises receiving an image captured by the image capturing device and determining an overlapping portion of the first field of view and the received image. An image to be displayed is then determined by using image data of the received image in the overlapping portion, and using image data of the second field of view in the non-overlapping portion. The invention is advantageous in that it provides an improved operation of the image capturing device.