Display Timing Determination Using Interval Ratios for Voice Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies struggle to synchronize the output timing of voices with the display timing of character information, such as subtitles, due to changes in voice storage data, making it difficult to maintain an association relationship between them.

Innovation Solution

A system that acquires output timings and display timings using ratios to identify an association relationship between voices and character information, adjusting display timings to minimize deviations using dynamic programming and ratio analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If voice storage data is changed after creation of character information, then the output timing of voice is changed, but the association relationship between voice and character information cannot be maintained

Engineering Contradiction:
Improveadaptability to voice storage data changesVSAvoidreliability of association relationship
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent changes the parameter used for association from absolute timing values to ratio relationships between intervals. By using ratios of intervals between output timings of voices with different place differences, the system becomes adaptable to timing changes while maintaining reliable association, as ratios remain consistent even when overall timing shifts occur.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If simple comparison between output timing and display timing is used, then the process is simple, but the association relationship cannot be accurately identified

Engineering Contradiction:
Improvecomplexity of timing comparison processVSAvoidprecision of association identification
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent segments the timing comparison process into multiple components: calculating intervals between timings, computing ratios of these intervals, and comparing ratio patterns. This segmentation transforms a simple but inaccurate comparison into a more complex multi-step process that achieves precise association identification by analyzing temporal relationships at different levels.

Inventive Principle:
Principle #1Segmentation

3Ease of manufacture

If manual character input is used, then character information can be created, but display timing is delayed relative to voice output

Engineering Contradiction:
Improveease of character information creationVSAvoiddelay time between voice output and character display
Core Design Contradiction:
Ease of manufactureVSLoss of time

Solution Approach 1:

The patent performs preliminary action by automatically creating character information and calculating display timings before voice output occurs. By using ratio-based interval comparisons to predetermined reference ratios, the system pre-determines accurate display timings, eliminating manual input delays and ensuring character information is ready for immediate display when needed.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP3678376B1Display timing determination device, display timing determination method, and program
Publication Date: 2025.07.23 RAKUTEN GROUP INC
  • EP3678376B1 patent drawingFigure 1
  • EP3678376B1 patent drawingFigure 2
  • EP3678376B1 patent drawingFigure 3

AI summary

First ratio acquisition means (102) of a display timing determination device (10, 20) acquires, for each voice, a first ratio of an interval between output timings of voices that are different in output order by a first order difference to an interval between output timings of voices that are different in output order by a second order difference. Second ratio acquisition means (104) acquires, for each piece of character information, a second ratio of an interval between provisional display timings of pieces of character information that are different in display order by the first order difference or a third order difference corresponding to the first order difference to an interval between provisional display timings of pieces of character information that are different in display order by the second order difference or a fourth order difference corresponding to the second order difference. Identification means (105) identifies, based on the first ratio of each voice and the second ratio of each piece of character information, an association relationship between the voice and the piece of character information. Display timing determination means (106) determines a definitive display timing of each piece of character information based on the association relationship.