Photo Album Generation Using Determinantal Point Process

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing automatic photo album generation techniques fail to effectively consider user criteria such as photo quality and similarity, resulting in albums that may not meet typical user standards for representativeness.

Innovation Solution

A computer-implemented technique that extracts quality and similarity features from a collection of photos, generates quality and similarity metrics, and uses a determinantal point process (DPP) with a maximum-a-posteriori (MAP) approximation algorithm to select a subset of photos that maximizes both quality and diversity, thereby creating a representative photo album.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If existing automatic photo album generation techniques are used, then the album generation process is simple and fast, but the representativeness and quality of the generated albums do not meet user standards

Engineering Contradiction:
Improvealbum representativenessVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system segments the photo selection process into multiple independent feature extraction stages: quality features (sharpness, exposure, composition), similarity features (color, content, temporal), and diversity metrics. Each feature is computed separately and then integrated through weighted scoring, allowing precise control over album representativeness without overwhelming system complexity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system changes parameters by introducing multiple photo quality metrics (sharpness, exposure, composition scores) and similarity measures (color distance, content overlap, temporal proximity). These parameter changes enable precise optimization of album representativeness while maintaining computational feasibility through efficient feature extraction algorithms

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If multiple photo quality and similarity features are extracted and optimized, then the album quality and diversity are improved, but the computational complexity and processing time increase

Engineering Contradiction:
Improvephoto selection qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary action by pre-computing and caching photo features (quality metrics, color histograms, content descriptors) before the actual album generation. This preprocessing step stores extracted features in a structured format, so when album generation is requested, the system only needs to retrieve and compare pre-computed features rather than re-extracting them, significantly reducing processing time while maintaining high selection quality

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system applies partial action by selectively computing only the most relevant features for the current album generation task. Instead of computing all possible photo attributes, the system identifies and processes a subset of critical features (e.g., focusing on temporal proximity for event-based albums or color consistency for thematic albums), reducing computational overhead while maintaining sufficient selection quality

Inventive Principle:
Principle #16Partial or excessive action

3Manufacturing precision

If the system maximizes both photo quality and diversity, then the album representativeness is improved, but the selection process becomes more complex

Engineering Contradiction:
Improvealbum representativenessVSAvoidselection algorithm complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system merges the quality optimization and diversity maximization objectives into a single unified selection framework. It combines photo quality scores (sharpness, exposure, composition) with diversity metrics (color variety, content diversity, temporal distribution) into a composite selection criterion. This merging allows the system to simultaneously optimize both quality and diversity through a coordinated selection process rather than treating them as separate, conflicting objectives

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system introduces an intermediary mechanism in the form of a selection algorithm that acts as a mediator between quality and diversity requirements. This intermediary layer receives raw photo data, evaluates both quality and diversity attributes, and makes balanced selection decisions. The intermediary translates the dual objectives into concrete selection rules, managing the complexity of simultaneously optimizing multiple competing criteria

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS8983193B1Techniques for automatic photo album generation
Publication Date: 2015.03.17 GOOGLE LLC
  • US8983193B1 patent drawing
  • US8983193B1 patent drawing
  • US8983193B1 patent drawing

AI summary

A computer-implemented technique can receive, at a computing device including one or more processors, a plurality of photos. The technique can extract quality features and similarity features for each of the plurality of photos and can obtain weights for the various quality features and similarity features based on an analysis of a reference photo collection. The technique can generate a quality metric for each of the plurality of photos and can generate a similarity matrix for the plurality of photos by analyzing the various quality features and similarity features and using the obtained weights. The technique can perform joint global maximization of photo quality and photo diversity using the quality metrics and the similarity matrix in order to select a subset of the plurality of photos having a high degree of representativeness. The technique can then store the subset of the plurality of photos in a memory.