NAS On-Demand Subtitle Generation via Audio Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data storage systems face inefficiencies in subtitle generation and delivery, as native subtitle streams are limited and require transferring large media content between clients and servers, imposing a resource burden and inefficiency, especially when clients need subtitles in different languages or formats.

Innovation Solution

Implementing on-demand subtitle generation within data storage servers, where the server receives a request, accesses the audio stream, generates subtitles, and sends a transport stream with the media and subtitles, allowing for flexible language support and reducing the need for extensive data transfer.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If native subtitle streams are used in data storage systems, then subtitle functionality is provided, but language flexibility and adaptability are limited

Engineering Contradiction:
Improvelanguage flexibilityVSAvoidsubtitle stream structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent extracts the subtitle generation function from the client device and relocates it to the data storage server. The server generates subtitles on-demand from the media content's audio stream using speech-to-text conversion, eliminating the need for pre-encoded native subtitle streams and providing unlimited language flexibility without increasing client device complexity

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces an intermediary subtitle generation process within the server that converts audio streams to text streams. This intermediary step enables flexible subtitle generation in any language without requiring pre-processing of multiple subtitle tracks, resolving the contradiction between adaptability and structural complexity

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If client-side subtitle generation is implemented, then language flexibility is improved, but resource burden and data transfer requirements increase

Engineering Contradiction:
Improvesubtitle language supportVSAvoidclient device resource consumption
Core Design Contradiction:
Adaptability or versatilityVSLoss of energy

Solution Approach 1:

Instead of having the client device generate subtitles from transferred media content (consuming client resources), the patent inverts the process by having the server generate subtitles from the audio stream before transmission. The client receives only the generated subtitle streams, dramatically reducing client device resource burden while maintaining language flexibility

Inventive Principle:
Principle #13The other way round (Inversion)

Solution Approach 2:

The patent performs subtitle generation as a preliminary action on the server side before data transmission to the client. By generating subtitles in advance based on speech-to-text conversion of the audio stream, the system reduces the computational burden on client devices while providing flexible language support

Inventive Principle:
Principle #10Preliminary action

3Productivity

If extensive data transfer between client and server is performed, then complete media content processing is achieved, but transmission time and resource burden increase

Engineering Contradiction:
Improvesubtitle generation efficiencyVSAvoiddata transfer time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent extracts only the essential audio stream from the complete media content for subtitle generation purposes. By processing only the audio portion on the server to generate subtitles, and transmitting only the generated subtitle streams to the client, the system achieves efficient subtitle generation while minimizing data transfer time and resource burden

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS11818406B2Data storage server with on-demand media subtitles
Publication Date: 2023.11.14 SANDISK TECHNOLOGIES LLC
  • US11818406B2 patent drawing
  • US11818406B2 patent drawing
  • US11818406B2 patent drawing

AI summary

A network-attached storage device (NAS) includes a non-volatile memory module storing a media stream, a network interface, and control circuitry coupled to the non-volatile memory module and to the network interface and configured to connect to a client over a network connection using the network interface, receive a request for the media stream from the client, determine subtitle preferences associated with the request for the media stream, access an audio stream associated with the media stream, generate subtitles based on the audio stream, and send a transport stream to the client over the network connection, the transport stream including the media stream and the subtitles.