Mobile Image Assembly with Contextual Metadata Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional slideshow modes on mobile devices lack enhancement and fail to provide additional information related to photographs, limiting the user experience.

Innovation Solution

A system that retrieves images and associated metadata, including date, time, location, and extracted information like face recognition, smile detection, and posture recognition, to generate a multimedia presentation that includes visual and audio descriptions, enabling users to create and send enhanced MMS messages.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a simple slideshow mode is used for photograph presentation, then the device complexity is reduced and ease of operation is improved, but the information content and user experience are limited

Engineering Contradiction:
Improveease of operationVSAvoidinformation content
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The presentation is segmented into multiple components: the photograph itself, extracted metadata (date, time, location), extracted information (face recognition, smile detection, posture recognition), and generated descriptions (visual and audio). This segmentation allows each component to be processed and presented separately, enriching the overall presentation while maintaining operational simplicity through automated assembly.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary actions by automatically extracting metadata and information from photographs before presentation. Face recognition, smile detection, posture recognition, and location extraction are all performed in advance, so that when the photograph is displayed, all enhancing information is already prepared and integrated, eliminating the need for manual information gathering during operation.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If additional information extraction and processing is performed on photographs, then the information content and presentation quality are improved, but the device complexity increases

Engineering Contradiction:
Improveinformation contentVSAvoiddevice complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The mobile device is designed with multi-functionality, integrating photograph capture, metadata extraction, information processing (face recognition, smile detection, posture recognition), and presentation generation into a single unified system. This universal approach allows the device to perform multiple functions without requiring separate external tools, managing complexity through integration rather than multiplication of components.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system employs self-service mechanisms where the photograph and its associated data automatically enhance each other. The photograph contains embedded metadata that is automatically extracted and processed, and the extracted information (faces, smiles, postures, locations) automatically generates descriptive content that is integrated back into the presentation. This self-enhancing process reduces the need for external intervention or complex manual processing.

Inventive Principle:
Principle #25Self-service

3Loss of information

If metadata and extracted information are integrated into the presentation, then the usefulness and contextual value are improved, but the processing time and energy consumption increase

Engineering Contradiction:
ImproveusefulnessVSAvoidenergy consumption
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

Metadata extraction and information processing are performed as preliminary actions immediately when the photograph is captured or imported, rather than during playback or presentation. This timing allows the system to process data when the device is already active and powered, utilizing existing energy expenditure for capture operations. The extracted information is stored and ready for integration, reducing energy consumption during actual presentation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system maintains continuity of useful action by continuously integrating extracted information with photograph presentation. Rather than treating metadata extraction and presentation as separate discrete operations, the system continuously enriches the presentation with available information, creating a seamless flow where the photograph and its contextual data are presented together as a unified enhanced experience, maximizing the utility of each processing cycle.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS10503777B2Method and device relating to information management
Publication Date: 2019.12.10 SONY GROUP CORP
  • US10503777B2 patent drawing
  • US10503777B2 patent drawing
  • US10503777B2 patent drawing

AI summary

A method and an arrangement for use in a device, such as a communication device, may be configured to generate an assembly based on one or more images. The system may include an image retrieval portion for retrieving the one or more images from an image source, an arrangement for fetching data corresponding to the one or more images, and converting the data to presentable information, and an arrangement for generating the assembly including the one or more images and the presentable information provided with description.