ROI Tracking Stabilization for High-Magnification Zoom Preview

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image stabilization techniques struggle to maintain a stable and smooth framing of objects of interest at high magnification ratios, particularly due to hardware limitations such as gyro noise, OIS sensing noise, and calibration errors, leading to residual motion and challenges in transitioning between different modes.

Innovation Solution

A neural network-based image stabilization method that tracks the region of interest (ROI) using saliency detection and optical flow, combined with gyro and OIS data, to stabilize the image and maintain the ROI at the center of the viewfinder, while overcoming hardware limitations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Length of moving object

If high magnification ratio is used to capture distant objects, then the ability to capture distant objects is improved, but image stability and framing accuracy deteriorate due to hardware limitations

Engineering Contradiction:
Improvemagnification ratioVSAvoidimage stability
Core Design Contradiction:
Length of moving objectVSReliability

Solution Approach 1:

The patent introduces an intermediary stabilization system that includes sensor data acquisition (gyroscopes, accelerometers), neural network-based motion trajectory prediction, and compensation mechanisms. This intermediary system processes sensor data to predict and compensate for camera motion, thereby stabilizing the image at high magnification ratios without sacrificing the ability to capture distant objects.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent implements a feedback loop where sensor data continuously monitors camera motion, the neural network predicts motion trajectories, and the system adjusts the captured image in real-time to compensate for detected movements. This closed-loop feedback mechanism maintains image stability despite high magnification ratios that would otherwise amplify hardware limitations.

Inventive Principle:
Principle #23Feedback

2Reliability

If traditional stabilization methods are used, then some level of stability is achieved, but residual motion and framing difficulty persist due to gyro noise and sensor latency

Engineering Contradiction:
Improvestabilization effectivenessVSAvoidframing accuracy
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent replaces traditional mechanical stabilization systems (which rely on physical gyroscopes and optical image stabilization) with a computational approach using neural networks and sensor fusion. This substitution eliminates the limitations of mechanical systems, including gyro noise and signal latency, by using software-based motion prediction and compensation that achieves superior framing accuracy and stabilization effectiveness.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent changes the parameters of the stabilization system by transitioning from hardware-dependent parameters (gyro sensitivity, OIS response time) to software-controlled parameters (neural network prediction accuracy, sensor fusion algorithms). This parameter transformation allows the system to overcome the fixed limitations of hardware and achieve both high stabilization effectiveness and precise framing accuracy.

Inventive Principle:
Principle #35Parameter changes

3Length of moving object

If zoomed mode is activated for high magnification, then the ability to view distant objects is improved, but object tracking and framing become difficult due to narrow field of view

Engineering Contradiction:
Improvezoom magnificationVSAvoidobject tracking difficulty
Core Design Contradiction:
Length of moving objectVSEase of operation

Solution Approach 1:

The patent applies preliminary action by using the neural network to predict future motion trajectories of both the camera and the region of interest before the actual movement occurs. This predictive capability allows the system to pre-adjust the framing and tracking parameters, making object tracking in zoomed mode as easy as in normal mode, while maintaining high magnification ratios.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20260113529A1Stabilized Object Tracking At High Magnification Ratios
Publication Date: 2026.04.23 GOOGLE LLC
  • US20260113529A1 patent drawing
  • US20260113529A1 patent drawing
  • US20260113529A1 patent drawing

AI summary

An example method includes displaying, by a display screen of an image capturing device, a preview of an image representing a field of view of the image capturing device. The method includes determining a region of interest in the preview. The method includes transitioning the image capturing device from a normal mode of operation to a zoomed mode of operation. The zoomed mode of operation includes: determining, based on sensor data collected by a sensor associated with the image capturing device, a motion trajectory for the region of interest, and based on the determined motion trajectory, generating an adjusted preview representing zoomed portion of the field of view. The adjusted preview displays the region of interest at or near a center of the zoomed portion. The method includes providing the adjusted preview of the portion of the field of view.