Live Streaming Translation Synchronization via Sentence Segmentation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current social media platforms for live streaming events lack interactive features, particularly in handling language barriers and enabling user participation, such as real-time translation and gift sending, which hinders the 'meet and greet' experience for international fans.

Innovation Solution

A method and system that partitions audio and visual feeds into uniform blocks, tags time-markers for each sentence, and synchronizes translated content with the visual feed, allowing for continuous and uninterrupted live streaming with subtitles or translated speech, while enabling e-commerce transactions and communication across platforms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If real-time translation is implemented for live streaming events, then language barrier is reduced and international fan participation is improved, but system complexity and processing time increase

Engineering Contradiction:

Improvelanguage compatibilityVSAvoidsystem complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The audio feed is divided into discrete sentence segments, each processed independently for translation. This segmentation allows the system to handle translation requests in manageable units rather than processing entire streams at once, reducing system complexity while maintaining real-time translation capability across multiple languages

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Time-markers are assigned to sentences before translation processing begins. This preliminary action of pre-segmenting and time-stamping audio content enables the translation system to work ahead on upcoming segments while current segments are being displayed, reducing processing delays and system complexity

Inventive Principle:

Principle #10Preliminary action

2Ease of operation

If translated sentences are synchronized with visual feed in real-time, then user engagement is improved, but transmission delay increases

Engineering Contradiction:

Improveuser engagementVSAvoidtransmission delay

Core Design Contradiction:

Ease of operationVSLoss of time

Solution Approach 1:

Time-markers are assigned to sentences in advance during the audio processing stage, before translation and synchronization occur. This preliminary time-stamping allows the system to prepare synchronization data ahead of time, reducing actual transmission delay while maintaining accurate sync between translated subtitles and visual feed for improved user engagement

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system maintains continuous processing of audio segments, translating and synchronizing them as they arrive rather than batching them. This continuous action ensures minimal interruption to the live stream while keeping translation delays to a minimum, preserving the real-time nature of the broadcast

Inventive Principle:

Principle #20Continuity of useful action

3Measurement precision

If audio feed is processed sentence by sentence with time-markers, then translation accuracy is improved, but processing speed decreases

Engineering Contradiction:

Improvetranslation accuracyVSAvoidprocessing speed

Core Design Contradiction:

Measurement precisionVSProductivity

Solution Approach 1:

The audio feed is segmented into sentence-level units with precise time-markers, improving translation accuracy by processing complete linguistic units rather than fragmented audio. Simultaneously, this segmentation enables parallel processing of multiple sentences through the translation system, maintaining productivity by avoiding sequential bottlenecks

Inventive Principle:

Principle #1Segmentation

4Adaptability or versatility

If live streaming includes interactive features like gift sending and cross-platform communication, then user participation is enhanced, but system complexity increases

Engineering Contradiction:

Improveinteractive capabilityVSAvoidsystem complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The live streaming system is designed to handle multiple functions including translation, gift sending, and cross-platform communication through a unified architecture. This multi-functionality approach consolidates what could be separate complex systems into one integrated platform, enhancing user participation while managing overall system complexity efficiently

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS11277674B2Method and system for promoting interaction during live streaming events

Publication Date: 2022.03.15 QUEK SHU CHING

AI summary

A method for promoting interaction during a live streaming event is disclosed. The method comprising the steps of receiving an audio feed and a visual feed of the live streaming event from a source device; partitioning with a uniform block length, the visual feed into visual feed partitions and the audio feed into audio feed partitions; and tagging a time-marker to each sentence in the audio feed. The method further comprises the steps of initiating a conversion of each sentence into a translated sentence while retaining the tagged time-markers, each translated sentence having an association with a visual feed partition and an audio feed partition; and waiting for a time delay to expire between transmitting a first partition, a second audio feed partition and the associated translated sentence with the tagged time-marker to the recipient device.