Shift Lens Control Apparatus for Multi-Object Follow Shot

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing follow shot assisting methods fail to accurately control the shift lens in optical systems when multiple objects are present in a captured image, leading to the main object not being stationary or deviating from the image.

Innovation Solution

A control apparatus that calculates and controls the driving amount of an optical element based on motion vectors detected in multiple object areas, ensuring the main object remains stationary by shifting the shift lens unit in the image pickup optical system.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If motion vector detection is performed in the entire captured image to assist follow shot, then the follow shot assisting function can be provided, but the shift lens may be controlled according to the motion vector of an object different from the main object

Engineering Contradiction:
Improvefollow shot assisting functionVSAvoidobject identification accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The captured image is divided into multiple object areas, and motion vectors are detected separately for each object area. This segmentation allows the system to identify and track multiple objects independently, selecting the main object based on specific criteria (such as object size, position, or user selection) rather than treating the entire image as a single detection region.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different object areas are treated with different detection priorities and parameters. The system applies local quality control by focusing motion vector detection and object selection on specific regions of interest within the captured image, ensuring that the main object is accurately identified and tracked while ignoring or giving less weight to other objects in different areas.

Inventive Principle:
Principle #3Local quality

2Stability of the object's composition

If the shift lens is controlled based on motion vector of detected object, then the object can be kept stationary in captured image, but the main object deviates from or is not made stationary in the captured image when multiple objects are present

Engineering Contradiction:
Improveobject stationarity in captured imageVSAvoidmain object tracking reliability
Core Design Contradiction:
Stability of the object's compositionVSReliability

Solution Approach 1:

The system continuously detects motion vectors of the main object and adjusts the shift lens position in real-time based on this feedback. By establishing a feedback loop that monitors the main object's motion and dynamically corrects the lens position, the system maintains reliable tracking of the main object while keeping it stationary in the captured image, even when multiple objects are present.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary identification and selection of the main object from multiple detected objects before initiating the follow shot control. By pre-selecting the main object based on criteria such as object characteristics, position, or user input, the system ensures that subsequent motion compensation actions are applied to the correct target, preventing deviation or loss of the main object in the captured image.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9955069B2Control apparatus, storage medium for storing control program, control method, and optical apparatus
Publication Date: 2018.04.24 CANON KK
  • US9955069B2 patent drawing
  • US9955069B2 patent drawing
  • US9955069B2 patent drawing

AI summary

A control apparatus includes a calculation unit configured to calculate a driving amount of the optical element from a motion vector detected in an object area that contains an image of the object in a motion image generated by capturing, and a control unit configured to control the optical element according to the driving amount. The calculation unit calculates the driving amount for each of a plurality of motion vectors having different magnitudes detected in a plurality of object areas in the motion image. The control unit controls the optical element for each of the plurality of calculated driving amounts and for each capturing of a plurality of still images.