Attention Map Generation for Diverse Photo Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The proliferation of digital cameras and social media sharing has led to numerous redundant photos of the same objects, as users often capture images from similar vantage points, resulting in a lack of diverse perspectives and attention to less popular yet interesting subjects.

Innovation Solution

A system that collects and aggregates photos from multiple users using gaze-tracking devices to generate an attention map, guiding users to capture photos of objects based on their attention value, thereby encouraging diverse vantage points and highlighting both popular and lesser-known subjects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If users capture photos of objects using digital cameras, then photos can be easily taken and shared, but numerous redundant photos of the same object are produced with little diversity in perspectives

Engineering Contradiction:
Improvephoto capture efficiencyVSAvoidperspective diversity
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The system implements feedback by collecting gaze information from multiple users, aggregating it into attention maps, and using these maps to guide future photo capture. The attention map serves as feedback that indicates which objects and regions deserve attention, thereby directing users to capture photos from diverse perspectives rather than repeatedly photographing the same objects from similar angles.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary action by pre-computing attention maps from aggregated gaze data before users actually capture photos. This attention map is generated in advance based on historical gaze patterns and is then provided to users as guidance, enabling them to capture photos from optimal vantage points without having to trial and error their positioning.

Inventive Principle:
Principle #10Preliminary action

2Ease of operation

If users photograph popular objects from common locations, then photo capture is straightforward, but less popular yet interesting objects are overlooked

Engineering Contradiction:
Improvephoto capture simplicityVSAvoidinformation about lesser-known objects
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The attention map provides feedback that highlights not only popular objects but also lesser-known objects that have received attention in the aggregated gaze data. This feedback mechanism ensures that users are guided to photograph a diverse set of objects including those that are less popular, thereby preventing loss of information about these interesting but overlooked subjects.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system applies local quality by differentiating the treatment of different objects in the scene. The attention map assigns different weights and visibility to different objects based on their attention values, ensuring that both popular and lesser-known objects are appropriately highlighted. This allows users to easily identify and photograph objects of interest without overlooking less popular yet valuable subjects.

Inventive Principle:
Principle #3Local quality

3Adaptability or versatility

If gaze tracking and attention map generation are implemented, then diverse photo perspectives can be guided, but system complexity increases

Engineering Contradiction:
Improvephoto perspective diversityVSAvoidsystem structure complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system achieves multi-functionality by using a single attention map generation mechanism to serve multiple purposes: guiding users to diverse objects, identifying optimal vantage points, and providing rich metadata for photo organization. This universal approach allows one system component to handle multiple tasks related to photo capture guidance, thereby reducing overall system complexity despite the advanced gaze tracking capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The attention map acts as an intermediary that bridges the complex gaze tracking system and the simple photo capture operation. Instead of directly complex interactions, the attention map translates complex gaze data into user-friendly guidance information, simplifying the interface between the sophisticated tracking system and the user's photo capture action.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9571726B2Generating attention information from photos
Publication Date: 2017.02.14 GOOGLE LLC
  • US9571726B2 patent drawing
  • US9571726B2 patent drawing
  • US9571726B2 patent drawing

AI summary

Implementations generally relate to collecting photos. In some implementations, a method includes collecting photos associated with one or more objects, where the photos are collected from a plurality of users. The method also includes collecting attention information associated with the one or more objects. The method also includes generating an attention map based on the attention information. The method also includes guiding users to capture photos of particular objects based on the attention map.