Scene Optimization System for Visual Attention Prediction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing visual attention models struggle to accurately predict human attention in dynamic scenes due to variability in visual stimuli and observer factors, leading to inconsistent predictions and reduced robustness.

Innovation Solution

A computer-implemented method and system that optimizes scene properties to achieve specific visual goals by generating multiple scenes based on permissible changes, evaluating them using a visual attention model, and determining the costs associated with these changes to maximize rewards while minimizing costs, with a focus on robustness and multi-perspective analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If visual attention models are used to predict human attention in dynamic scenes, then predictions about object attention can be obtained, but the predictions become inconsistent and less robust due to variability in visual stimuli and observer factors

Engineering Contradiction:
Improveprediction accuracyVSAvoidprediction consistency
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system performs preliminary scene optimization before final presentation by generating multiple candidate scenes with different object properties, evaluating them with visual attention models, and selecting the optimal scene configuration in advance. This preliminary action ensures that the chosen scene is robust to variability and will produce consistent attention predictions across different conditions.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system systematically varies scene parameters such as object color, size, position, and other visual properties to generate multiple candidate scenes. By changing these parameters and evaluating their impact on visual attention predictions, the system identifies parameter configurations that maximize prediction consistency and robustness across different visual stimuli and observer conditions.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If multiple scenes are generated and evaluated to optimize visual goals, then robustness and accuracy of attention prediction improve, but computational complexity and processing time increase

Engineering Contradiction:
ImproverobustnessVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The scene optimization process is segmented into distinct stages: generating candidate scenes with varied object properties, evaluating each candidate with visual attention models, ranking scenes based on optimization criteria, and selecting the final optimal scene. This segmentation allows the complex task to be managed systematically and enables parallel processing of multiple candidate scenes.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system evaluates a finite number of candidate scenes (excessive action) rather than exhaustively searching all possible scene configurations. By generating a sufficient number of diverse candidate scenes and evaluating them, the system achieves robust optimization without requiring complete enumeration of all possibilities, thus balancing computational effort with optimization quality.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If scene properties are modified to achieve visual goals, then attention allocation to target objects improves, but costs associated with changes to the scene increase

Engineering Contradiction:
Improveattention allocation accuracyVSAvoidcost of changes
Core Design Contradiction:
Measurement precisionVSLoss of substance

Solution Approach 1:

The system evaluates the impact of changing various scene parameters (object color, size, position, etc.) on visual attention predictions and selects parameter modifications that achieve the desired attention allocation with minimal change cost. By systematically analyzing parameter effects, the system identifies the most efficient modifications that balance attention improvement with change cost.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system performs preliminary evaluation of multiple candidate scenes with different property configurations before final implementation. This allows comparison of both the attention allocation effectiveness and the cost of changes for each candidate, enabling selection of the optimal balance between achieving visual goals and minimizing modification costs.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9131204B2Systems and methods for optimizing a scene
Publication Date: 2015.09.08 3M INNOVATIVE PROPERTIES CO
  • US9131204B2 patent drawing
  • US9131204B2 patent drawing
  • US9131204B2 patent drawing

AI summary

Systems and methods for optimizing properties of objects within a scene or achieve a visual goal.