Context-Sensitive Audio Entity Search on Timeline

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users find it cumbersome and disruptive to manually search for additional information while watching TV or listening to radio, as existing methods require manual intervention and are not context-sensitive.

Innovation Solution

An electronic device with a processor that performs speech recognition, linguistically analyzes audio signals for named-entities, performs Internet or database searches, and displays query results on a timeline, providing context-sensitive information without manual intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If manual search requests are launched to obtain additional information, then information accessibility is improved, but user convenience deteriorates due to cumbersome and disruptive operations

Engineering Contradiction:
Improveaccess to additional informationVSAvoiduser convenience
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system automatically performs speech recognition on audio signals, linguistically analyzes the output for named-entities, and executes search requests without requiring manual user intervention. The electronic device serves itself by autonomously capturing audio, processing speech, identifying entities, and displaying search results on a timeline, thereby eliminating the need for users to manually launch search requests while still providing accessible additional information

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system continuously monitors and processes audio signals in real-time, performing speech recognition and linguistic analysis proactively before user needs arise. By preparing and analyzing information in advance based on ongoing audio content, the system ensures that search results are ready for immediate display when relevant named-entities are detected, improving both information accessibility and user convenience

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If continuous monitoring of audio signals is performed for speech recognition, then information relevance is improved, but energy consumption increases

Engineering Contradiction:
Improvecontext-sensitive informationVSAvoidenergy consumption
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The system performs speech recognition and linguistic analysis at periodic intervals based on detected speech segments rather than continuously monitoring all audio signals. By activating processing only when speech is detected and analyzing audio in discrete segments, the system maintains context-sensitive information retrieval while significantly reducing overall energy consumption compared to uninterrupted continuous monitoring

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system applies partial action by focusing computational resources only on relevant portions of audio signals containing speech and named-entities, rather than processing all audio content equally. This selective processing approach maintains high information relevance for context-sensitive queries while minimizing energy expenditure by avoiding unnecessary analysis of non-speech audio segments

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10394886B2Electronic device, computer-implemented method and computer program
Publication Date: 2019.08.27 SONY GROUP CORP
  • US10394886B2 patent drawing
  • US10394886B2 patent drawing
  • US10394886B2 patent drawing

AI summary

An electronic device comprising a processor which is configured to perform speech recognition on an audio signal, linguistically analyze the output of the speech recognition for named-entities, perform an Internet or database search for the recognized named-entities to obtain query results, and display, on a display of the electronic device, information obtained from the query results on a timeline.