Electronic Device Caption Overlay for Missed Audio Access

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face challenges in accessing caption information for audio content without disrupting the current flow of watching video content, especially when they miss sounds due to environmental noise or carelessness, and rewinding is not feasible for real-time content or when watching with others.

Innovation Solution

An electronic device with a processor that displays caption information corresponding to an audio signal from a preset previous time based on user input, using a display and speaker, and includes features like voice recognition to identify and display text from audio signals, allowing users to view previous dialogue without interrupting the content flow.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the user rewinds the content to hear previous audio or read captions again, then the user can access missed information, but the flow of currently reproduced content is interrupted

Engineering Contradiction:
Improveaccess to missed audio informationVSAvoidflow of content reproduction
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The patent extracts the caption information function from the main video playback flow. When a user requests caption information, the system extracts and displays only the relevant caption text without requiring the user to rewind or pause the video content, thus separating the information retrieval function from the content consumption flow

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs preliminary action by pre-processing audio signals into caption information that can be displayed on demand. The audio signal is analyzed and converted into text captions in advance, so when a user requests previous audio information, the captions are already prepared and can be displayed immediately without interrupting video playback

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If caption information is always displayed, then users can read missed captions, but users may pass specific captions without reading them and still need to rewind

Engineering Contradiction:
Improveaccess to caption informationVSAvoiduser interaction complexity
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system implements self-service by allowing users to request caption information on demand through simple voice commands or button presses. The system automatically retrieves and displays the requested caption information without requiring users to manually rewind or navigate through content, making the operation simple and self-contained

Inventive Principle:
Principle #25Self-service

3Loss of information

If one user rewinds content to hear previous lines, then that user can access missed information, but other users watching simultaneously are disturbed

Engineering Contradiction:
Improveaccess to previous audio informationVSAvoiddisturbance to other users
Core Design Contradiction:
Loss of informationVSObject-generated harmful factors

Solution Approach 1:

The patent segments the audio information access function from the main video playback. Each user can independently request and view caption information for previous audio segments without affecting the main video flow or other users' experience. The caption display is segmented as a separate overlay that can be viewed individually without pausing or rewinding the shared video content

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The caption information acts as an intermediary between the audio signal and the user. Instead of directly rewinding audio playback (which would disturb other users), the system provides caption text as an intermediate representation of the audio information, allowing individual users to access previous audio content without affecting the shared audio playback experience

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11758204B2Electronic device and control method therefor
Publication Date: 2023.09.12 SAMSUNG ELECTRONICS CO LTD
  • US11758204B2 patent drawing
  • US11758204B2 patent drawing
  • US11758204B2 patent drawing

AI summary

An electronic device is disclosed. The present electronic device comprises a display, a speaker, an input unit, and a processor for controlling the display so that an image signal inputted through the input unit is displayed, controlling the speaker so that an audio signal synchronized with the displayed image signal is outputted, and controlling the display so that caption information corresponding to the audio signal outputted during a preset previous time is displayed on the basis of the point of time when a user command is inputted.