Event Image Curation Using Convolutional Neural Networks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional photo curation techniques are time-consuming and focus mainly on image quality, aesthetics, and visual similarity, failing to account for event-specific importance and human preferences, leading to inefficient selection of representative images from large collections.

Innovation Solution

An event image curation system utilizing a convolutional neural network that determines importance ratings of digital images based on event type, memorability, specificity, popularity, and aesthetics, and generates representative images by considering diversity, duplicates, and coverage, with optional face and physical features detection for enhanced importance scoring.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional photo curation techniques are used to select representative images, then image quality and aesthetics can be evaluated, but the process becomes very time-consuming and cannot account for event-specific importance

Engineering Contradiction:
Improveimage quality evaluationVSAvoidcuration time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system enables automatic photo curation by training a neural network model to independently evaluate and select representative photos based on event type, eliminating the need for manual human review while maintaining high-quality selection standards

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system transforms the curation approach by changing from manual aesthetic evaluation to automated multi-parameter scoring, incorporating event-specific importance, visual quality, diversity, and memorability metrics through machine learning algorithms

Inventive Principle:
Principle #35Parameter changes

2Reliability

If manual photo curation is performed to ensure accurate selection of important moments, then photo importance can be assessed, but the process is inefficient and limits photo selection to individual viewpoints

Engineering Contradiction:
Improvephoto importance assessmentVSAvoidphoto selection efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system automates the photo selection process by training a neural network to independently assess photo importance based on event context, eliminating reliance on individual human viewpoints while maintaining reliable selection accuracy

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system creates a universal photo evaluation framework that can assess images from diverse perspectives simultaneously, incorporating multiple criteria including event-specific importance, visual quality, diversity, and memorability to produce comprehensive photo rankings

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If conventional curation focuses on image quality and visual similarity, then aesthetic photos can be selected, but event-specific context and human preferences are not considered

Engineering Contradiction:
Improveaesthetic evaluationVSAvoidevent-specific adaptability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system expands the evaluation parameters beyond basic aesthetic metrics to include event-specific importance, diversity, and memorability factors, allowing the curation process to adapt to different event types and contexts through machine learning

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system performs preliminary training of the neural network model with event-specific data before actual photo curation, enabling the system to understand and adapt to different event contexts in advance of the selection process

Inventive Principle:
Principle #10Preliminary action

4Quantity of substance

If all photos from multiple cameras are collected, then comprehensive event coverage is achieved, but the photo album becomes oversized with many duplicative photos

Engineering Contradiction:
Improvephoto collection completenessVSAvoidphoto album management
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The system extracts and identifies duplicative photos through visual similarity analysis and removes them from the final curated collection, keeping only the most representative instances of each unique moment while maintaining comprehensive event coverage

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10565472B2Event image curation
Publication Date: 2020.02.18 ADOBE INC
  • US10565472B2 patent drawing
  • US10565472B2 patent drawing
  • US10565472B2 patent drawing

AI summary

In embodiments of event image curation, a computing device includes memory that stores a collection of digital images associated with a type of event, such as a digital photo album of digital photos associated with the event, or a video of image frames and the video is associated with the event. A curation application implements a convolutional neural network, which receives the digital images and a designation of the type of event. The convolutional neural network can then determine an importance rating of each digital image within the collection of the digital images based on the type of the event. The importance rating of a digital image is representative of an importance of the digital image to a person in context of the type of the event. The convolutional neural network generates an output of representative digital images from the collection based on the importance rating of each digital image.