Image Pickup Apparatus Object Tracking with Communication Delay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional remote control systems for image pickup apparatuses face challenges in accurately performing autofocus (AF) and auto-exposure (AE) controls on moving objects due to communication delays between the camera and the remote control terminal, leading to incorrect targeting of objects.
Innovation Solution
The system employs a face detection processing circuit to detect and track moving objects, allocating identification information and updating the AF and AE control regions accordingly, ensuring accurate targeting even during communication delays by using object IDs and tracking algorithms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If real-time video image data is transmitted from the camera to the remote control terminal, then the operator can observe and specify the target object, but communication delay occurs causing the displayed image to be outdated
Solution Approach 1:
The camera performs AF and AE processing based on the latest captured image data before the operator's selection is transmitted, ensuring that processing is already prepared or can be quickly adjusted when the operator's selection arrives, reducing the effective processing delay
Solution Approach 2:
The system continuously transmits latest image data and processing results from camera to remote control terminal, allowing the operator to see real-time updates and make informed selections, while the camera uses this feedback to adjust its processing focus
2Ease of operation
If the operator specifies a target based on the displayed image, then AF and AE controls can be performed, but the specified object differs from the intended moving object due to communication delay
Solution Approach 1:
The camera pre-processes multiple candidate objects in the latest image data and prepares AF/AE processing for them before the operator makes a selection, so when the operator's selection arrives, the processing can be quickly applied without significant delay
Solution Approach 2:
The system dynamically updates the target object based on the latest image data received from the camera, allowing the target to move and change as objects in the scene move, ensuring the AF/AE control follows the actual current position rather than a stale position
3Extent of automation
If the camera executes AF and AE controls based on transmitted position information, then remote control is enabled, but the controls are applied to the wrong object when the target has moved
Solution Approach 1:
The camera executes AF and AE processing based on the latest image data and object detection results before or concurrently with receiving the operator's selection, ensuring that processing is prepared in advance and can be reliably applied to the correct current target
Solution Approach 2:
The system continuously provides feedback between the camera's latest image data and the remote control terminal, allowing the camera to adjust its processing targets based on updated information about object positions and movements, ensuring reliable targeting
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach allows for precise AF and AE control on moving objects, maintaining accurate object tracking and control region alignment despite communication delays, ensuring the camera focuses and exposes on the intended subject.
Implementation Method 1
an image pickup device configured to generate an image signal by performing photoelectric conversion on an optical image via an optical system
Data Source
Figure 1
Figure 2A~2D
Figure 3A~3F
AI summary
An image pickup apparatus (101) includes an image pickup device (104) which generates an image signal by performing photoelectric conversion on an optical image via an optical system (103), an object detector (108) which detects a plurality of object images based on the image signal obtained from the image pickup device (104), an identification information generator (109) which allocates identification information to each of the object images, a communicator (112, 113) which sends the image signal and the identification information allocated to each of the object images to an outside of the image pickup apparatus, wherein the communicator (112, 113) is capable of receiving identification information of an object image relating to the sent identification information of the object image, and a controller (109) configured to specify a main object image among the object images detected by the object detector (108) based on the received identification information.