MP4 Sample Switching in Streaming Segments
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In streaming reproduction, long segment lengths cause significant switching delays when content is switched, as users must wait for the entire segment to finish playing before switching to a new one.
Innovation Solution
An information processing device that receives segment files and adds attribute information, including reproduction start times, to MP4 samples, allowing for switching in units of MP4 samples rather than segments, thereby reducing the time required for content switching by determining the optimal switching position based on processing times and attribute information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If content switching is executed in units of segments, then the segment structure maintains simplicity and integrity, but the switching time increases due to long segment lengths
Solution Approach 1:
The patent divides a segment into multiple smaller units called MP4 samples. Instead of switching at segment boundaries, the system can now switch at MP4 sample boundaries within a segment. This finer granularity segmentation enables switching to occur much earlier in the segment playback, significantly reducing the switching delay experienced by users while maintaining the overall segment structure for organization and delivery purposes.
Solution Approach 2:
The patent performs preliminary processing by extracting and tagging MP4 samples with their reproduction start times and other attributes before playback. This advance preparation allows the system to quickly identify and switch to the appropriate MP4 sample when a switching operation is requested, eliminating the need to wait for segment boundaries and reducing switching time without adding complex runtime processing.
2Productivity
If segment length is increased, then the number of segments decreases and file structure simplifies, but the switching delay increases
Solution Approach 1:
The patent segments each long segment into multiple MP4 samples with individual timing information. This allows the system to treat each MP4 sample as an independent switchable unit, enabling switching to occur at any MP4 sample boundary rather than waiting for the entire long segment to play out. The result is dramatically improved switching speed while maintaining the efficiency benefits of long segments for delivery and organization.
Solution Approach 2:
The patent introduces dynamic switching capability within segments by allowing the switching position to be determined based on reproduction start time attributes of MP4 samples. This dynamic approach enables the system to adapt the switching point to user requests occurring at any time during segment playback, rather than being constrained by fixed segment boundaries, thus achieving fast switching without requiring short segment lengths.
3Loss of time
If switching position is determined in units of segments, then the switching logic remains simple, but the switching delay is significant
Solution Approach 1:
The patent refines the switching granularity from segment-level to MP4 sample-level within segments. By extracting MP4 samples and tagging them with reproduction start times, the system creates a hierarchy where segments are divided into switchable MP4 sample units. This enables switching to occur at the finest granularity (MP4 sample boundaries) while maintaining manageable complexity through the use of standardized MP4 sample structures and attribute tagging.
Solution Approach 2:
The patent replaces the mechanical segment-boundary switching mechanism with an attribute-based switching system. Instead of relying on fixed segment boundaries, the system uses reproduction start time attributes of MP4 samples to determine switching positions. This substitution enables more flexible and faster switching by leveraging metadata attributes rather than rigid structural boundaries, reducing switching delay without proportionally increasing logic complexity.
Data Source
AI summary
Provided is an information processing device includes a receiving unit that receives a segment file having a plurality of segments and a setting file in which a group to which the segment file belongs is set, and an extraction unit that extracts one or more MP4 samples included in a segment of the segment file and adds attribute information including a reproduction start time of the MP4 sample to the MP4 sample. The information processing device further includes a determination unit that determines a switching position at which the segment file belonging to the group after switching is output in units of the MP4 samples on the basis of an accepted switching operation of the group and the attribute information, and an output unit that outputs an output signal generated from the segment file belonging to the group after the switching from the switching position to an output device.