Client Device for PTZ Camera Image Latency Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

PTZ cameras in monitoring systems face delays in adjusting their field of view to user requests, leading to latency and an unintuitive control experience due to the time required for mechanical adjustments and data reception.

Innovation Solution

A client device with a display, selection, and communication system that quickly adjusts the camera image on the screen by displaying intermediate images, allowing immediate interaction and automatic integration of the actual camera image into the desired visual range without waiting for full data reception, using metadata for precise positioning and scaling.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the PTZ camera is controlled to adjust the field of view to user requests, then the desired visual range is achieved, but mechanical adjustment time causes latency and delays in displaying the desired camera image

Engineering Contradiction:
Improveuser interaction controlVSAvoidlatency in displaying desired camera image
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs preliminary actions by calculating and displaying a second image representation that shows where the camera will point after user input, before the actual mechanical adjustment is complete. This predictive display approach allows the user to see the intended view immediately, reducing perceived latency while the camera physically moves to the new position.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates a copy or representation of the desired camera view through image processing and display calculations, showing the target visual range before the actual camera reaches that position. This virtual copy allows users to interact with and visualize the desired state immediately, decoupling the user interface response time from the mechanical adjustment time.

Inventive Principle:
Principle #26Copying

2Manufacturing precision

If the system waits for the camera to complete mechanical adjustments and receive full data before displaying the desired image, then image accuracy is ensured, but user interaction experience deteriorates due to delays

Engineering Contradiction:
Improveimage position and size accuracyVSAvoiduser interaction responsiveness
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The system performs preliminary calculations of the desired image position, size, and orientation based on user input and camera parameters, displaying this predicted view immediately. This allows the interface to respond instantly to user actions while maintaining accuracy through subsequent updates when actual camera data arrives.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The display system dynamically updates the image representation from an initial predictive state to a final accurate state as camera data becomes available. The system transitions smoothly between displaying estimated positions and actual captured images, maintaining both responsiveness and accuracy throughout the adjustment process.

Inventive Principle:
Principle #15Dynamics

3Speed

If the system displays the desired camera image immediately through image processing, then responsiveness is improved, but the actual camera image integration may be delayed or mismatched

Engineering Contradiction:
Improveresponse time to user inputVSAvoidsynchronization between displayed and actual camera images
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The system uses feedback mechanisms to continuously update the displayed image representation as actual camera data arrives. When the camera completes its mechanical adjustment and transmits the actual image, the system compares it with the predicted display and performs seamless integration, ensuring synchronization between the displayed view and the actual captured image.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

By pre-calculating and displaying the desired image parameters before the camera actually reaches the target position, the system establishes a reference frame that guides the subsequent integration of the actual image. This preliminary action ensures that when the real data arrives, it can be quickly and accurately integrated without disrupting the user experience.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10257467B2Client device for displaying images of a controllable camera, method, computer program and monitoring system comprising said client device
Publication Date: 2019.04.09 ROBERT BOSCH GMBH
  • US10257467B2 patent drawing
  • US10257467B2 patent drawing
  • US10257467B2 patent drawing

AI summary

Embodiments provide to a client device for displaying camera images of a controllable camera. The client device includes a screen and a display device for displaying a first image representation on the screen. The first image representation shows an actual camera image in an actual visual range of the camera. The client device also includes a selection device designed to select a desired visual range of the camera, and has a communications device designed to request and receive a desired camera image in the desired camera visual range. The display device is designed to display, in a second image representation, at least some portion of the actual camera image correctly in terms of position and size in the desired camera visual range and, in an additional image representation, to display the desired camera image correctly in terms of position and size in the desired camera visual range.