Mood-Based Slide Show Generation via Feature Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional slide show apparatuses produce predictable and uninteresting digital image displays with limited variations, lack integration of background music harmonization, and do not support networking for image communication.

Innovation Solution

A still image producing apparatus that extracts feature quantities from image and music data, maps them on a shared N-dimensional space, allowing users to select harmonious music and image combinations based on mood, and produces slide shows with customizable styles and visual effects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional slide show apparatuses use predetermined order tables to display images, then the display process is simple and predictable, but the entertainment value and user interest decrease

Engineering Contradiction:
Improvesimplicity of display processVSAvoidentertainment value
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent transforms the fixed, predetermined display order into a dynamic parameter system where image display order, music selection, and transition effects are adjusted based on extracted features from images (color, brightness, subject) and music (tempo, genre, mood). This allows the slide show to adapt to different moods and preferences while maintaining ease of operation through automatic feature-based matching.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system introduces dynamic adaptability by continuously analyzing image and music features to automatically adjust display parameters. Instead of static predetermined sequences, the slide show dynamically selects and orders images based on their visual characteristics and harmonious pairing with music, creating varied and engaging presentations without requiring complex user input.

Inventive Principle:
Principle #15Dynamics

2Ease of manufacture

If conventional slide show apparatuses follow fixed production rules, then the production process is straightforward, but variations in image production are limited

Engineering Contradiction:
Improvestraightforward production processVSAvoidvariations in image production
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent enables diverse image production variations by extracting multiple parameters from images (color histograms, brightness distribution, subject detection results) and music (tempo, genre, emotional tone). These parameters feed into an automatic composition system that generates varied slide shows with different image selections, ordering sequences, and music pairings, all while maintaining a straightforward automated production process without manual intervention.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The system performs self-service by automatically analyzing image and music features, selecting appropriate combinations, and generating slide shows without user intervention. The automatic composition engine uses extracted features to independently make creative decisions about image ordering, music selection, and transition timing, providing numerous production variations while keeping the production process simple and automated.

Inventive Principle:
Principle #25Self-service

3Device complexity

If conventional slide show apparatuses lack music integration, then the system structure is simple, but the harmonization between visual and auditory elements is absent

Engineering Contradiction:
Improvesystem structureVSAvoidmusic-image harmonization
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent merges image processing and music analysis into a unified slide show composition system. Image feature extraction (color, brightness, subject) and music feature extraction (tempo, genre, mood) are combined through a composition engine that automatically pairs images with harmonious music and determines optimal display timing. This integration creates cohesive visual-auditory presentations while managing complexity through automated feature-based matching algorithms.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system uses parameter-based harmonization by extracting comparable features from both images (color temperature, brightness, emotional tone) and music (tempo, genre, mood) and matching them according to defined relationships. This parameter-driven approach enables automatic music-image pairing that creates harmonious presentations while maintaining a manageable system structure through rule-based feature correlation.

Inventive Principle:
Principle #35Parameter changes

4Device complexity

If conventional slide show apparatuses do not support networking, then the device functionality is simple, but communication using images between apparatuses is not possible

Engineering Contradiction:
Improvedevice functionalityVSAvoidimage communication capability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent extends the slide show apparatus functionality to include networking and communication capabilities. The system can transmit and receive image data, music data, and feature extraction results over networks, enabling image sharing, collaborative slide show creation, and remote control functions. This multi-functionality allows the device to serve both traditional local slide show purposes and networked communication needs without fundamentally redesigning the core image processing architecture.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS7657157B2Still image producing apparatus
Publication Date: 2010.02.02 RAKUTEN GROUP INC
  • US7657157B2 patent drawing
  • US7657157B2 patent drawing
  • US7657157B2 patent drawing

AI summary

A still image producing apparatus in which a user selects one piece of information, and production of still images and music associated with the mood in time of the production is provided. A still image producing apparatus 100 comprises: an image feature extraction unit 102 which analyzes image data, so as to extract feature; a music feature extraction unit 106 which extracts a music feature quantity from music data; and a mapping process unit 109 which uses each feature, so as to respectively map image data and music data on each sensitivity map using two axes. The user selects, from the sensitivity map, via a menu input unit 111, a quadrant for music or images desired in a slide show. Thus, the slide show associated with the mood is automatically produced in a slide show generation unit 110.