Emotion-Triggered Audio and Image Capture System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current audio and image data capturing devices lack efficient control mechanisms to capture relevant data only when significant emotional events occur, leading to unnecessary data storage and power consumption.

Innovation Solution

A method and system that analyze time-sequential physiological data and voice audio data from multiple individuals to detect simultaneous changes in emotional states, triggering the capture of audio and image data when predetermined characteristics are met, allowing for emotion-triggered capturing of important moments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If audio and image data are continuously captured by permanently installed devices, then complete scene coverage is achieved, but data storage requirements and power consumption increase significantly

Engineering Contradiction:
Improvescene coverage completenessVSAvoiddata storage volume
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The system performs preliminary analysis of physiological data and voice patterns to detect emotional states before triggering data capture. By pre-processing and analyzing biosensor data continuously at low power, the system prepares trigger conditions in advance, activating the capturing device only when predetermined emotional characteristics are met, thus avoiding continuous high-power recording while maintaining scene coverage reliability

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The invention extracts only the essential triggering information from continuous monitoring data by analyzing specific physiological parameters and voice patterns. Instead of capturing all audio and image data continuously, the system extracts emotional state indicators from biosensor data and voice audio data, using only these extracted features to control the capturing device, thereby significantly reducing storage requirements while maintaining reliability

Inventive Principle:
Principle #2Taking out (Extraction)

2Reliability

If audio and image data are continuously captured by permanently installed devices, then no significant moments are missed, but power consumption increases due to continuous operation

Engineering Contradiction:
Improvemoment capture reliabilityVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system implements periodic analysis of physiological data and voice patterns at predetermined intervals rather than continuous processing. The analyzing unit continuously monitors biosensor data and voice audio data in time-sequential sets, evaluating them periodically to detect simultaneous emotional changes. This periodic operation allows the capturing device to remain in low-power state between analysis cycles, significantly reducing overall power consumption while maintaining reliable moment capture through frequent enough sampling

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system uses the persons' own physiological data and voice patterns as self-indicators of significant moments. By analyzing data that naturally occurs during normal interaction (heart rate, skin conductance, voice tone), the system eliminates the need for external triggers or manual activation. The persons themselves serve as the triggering mechanism through their emotional responses, allowing the capturing device to activate automatically only when needed, reducing power consumption while ensuring no significant moments are missed

Inventive Principle:
Principle #25Self-service

3Extent of automation

If physiological data and voice audio data are analyzed in real-time to detect emotional changes, then relevant moments are captured automatically, but system complexity increases

Engineering Contradiction:
Improveautomatic capture capabilityVSAvoiddata processing complexity
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The system segments the data processing task into distinct functional units: a receiving unit that collects biosensor data and voice audio data, an analyzing unit that processes the segmented time-sequential data sets to detect emotional changes, and a control unit that triggers the capturing device. This segmentation allows each unit to perform its specific function efficiently, reducing overall system complexity while achieving high automation. The analyzing unit further segments analysis into evaluating physiological parameters separately from voice patterns, then combining results to detect simultaneous emotional changes

Inventive Principle:
Principle #1Segmentation

4Adaptability or versatility

If data capture is triggered by single person's emotional change, then individual moments are captured, but simultaneous social emotional events are not accurately detected

Engineering Contradiction:
Improveindividual emotion detectionVSAvoidsimultaneous emotional event detection
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system merges the analysis of multiple persons' physiological data and voice patterns to detect simultaneous emotional changes. The analyzing unit evaluates time-sequential sets of data from multiple biosensors and microphones, comparing temporal patterns across different persons. By combining and correlating the emotional state data of multiple individuals, the system accurately detects when simultaneous emotional changes occur across the group, distinguishing true simultaneous events from individual emotional fluctuations, thereby improving measurement precision for social emotional events

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS10481864B2Method and system for emotion-triggered capturing of audio and/or image data
Publication Date: 2019.11.19 STICHTING IMEC NEDERLAND
  • US10481864B2 patent drawing
  • US10481864B2 patent drawing
  • US10481864B2 patent drawing

AI summary

The present disclosure relates to a method for emotion-triggered capturing of audio and/or image data by an audio and/or image capturing device. The method includes receiving and analyzing a time-sequential set of data including first physiological data representing a first physiological parameter corresponding to a first person, a second physiological data representing a second physiological parameter corresponding to a second person, and voice audio data including a voice of at least one of the first and the second person, to determine whether a simultaneous change of emotional state of a first person and a second person occurs and transmitting a trigger signal to the capturing device. The present disclosure also relates to a corresponding apparatus and a system comprising the apparatus.