Image Emotion Filter Using Interest Operator

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The proliferation of digital image capturing devices leads to large collections of images with little interest, necessitating effective methods for filtering and selecting images based on emotional content and human appearance characteristics to reduce clutter and redundancy.

Innovation Solution

A computer-implemented method that analyzes images to generate content vectors, applies an interest operator based on desirable characteristics such as facial expressions and human appearance features, and compares these to an interest threshold to determine whether to save or discard images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If all images captured by digital cameras are saved, then no images are lost, but storage space is wasted and clutter increases

Engineering Contradiction:
Improveimage retentionVSAvoidstorage space
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The system performs preliminary analysis of image content characteristics (facial expressions, emotions, scenes) at the moment of capture or shortly after, and makes pre-decisions about which images to retain before they are permanently stored. This preliminary filtering action prevents unnecessary images from occupying storage space while ensuring valuable images are preserved.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The image filtering system automatically analyzes and evaluates image quality metrics without requiring manual user intervention for each image. The system serves itself by autonomously determining which images meet the retention criteria based on emotional content, facial expressions, and scene characteristics, eliminating the need for users to manually review and select images.

Inventive Principle:
Principle #25Self-service

2Manufacturing precision

If multiple high resolution images are captured per second, then capture quality is high, but redundancy increases

Engineering Contradiction:
Improveimage qualityVSAvoiduseful image variety
Core Design Contradiction:
Manufacturing precisionVSLoss of information

Solution Approach 1:

The system captures images at high resolution and rate (excessive action) but then applies selective filtering to retain only the necessary portion that meets quality and diversity criteria. The interest operator evaluates multiple characteristics including facial expressions, emotions, and scene changes to determine which captured images represent unique valuable content versus redundant captures.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system changes evaluation parameters by analyzing multiple dimensions of image content including emotional expressions, facial action units, scene composition, and temporal variations. By evaluating images across these multiple parameters, the system can distinguish between redundant high-resolution captures and truly valuable diverse images.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If manual image selection is performed, then curation accuracy is high, but time consumption increases

Engineering Contradiction:
Improveselection accuracyVSAvoidcuration time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system introduces an intermediary automated analysis layer that processes image characteristics (facial expressions, emotions, scenes) and generates interest scores. This intermediary evaluation system bridges the gap between automatic capture and manual selection, providing objective quality assessment that users can trust, thereby reducing the time users need to spend on manual curation while maintaining high selection accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements feedback mechanisms where user selections and rejections of automatically filtered images are used to refine and improve the interest operator's evaluation criteria over time. This feedback loop allows the system to learn from user preferences and improve its automated selection accuracy, reducing the need for manual intervention in future curation tasks.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10185869B2Filter and shutter based on image emotion content
Publication Date: 2019.01.22 APPLE INC
  • US10185869B2 patent drawing
  • US10185869B2 patent drawing
  • US10185869B2 patent drawing

AI summary

A computer-implemented (including method implemented using laptop, desktop, mobile, and wearable devices) method for image filtering. The method includes analyzing each image to generate a content vector for the image; applying an interest operator to the content vector, the interest operator being based on a plurality of pictures with desirable characteristics, thereby obtaining an interest index for the image; comparing the interest index for the image to an interest threshold; and taking one or more actions or abstaining from one or more actions based on a result of the step of comparing. Also, related systems and articles of manufacture.