Effect Rendering Control Unit for Seamless Video Audio Skip Resumption

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing game-information providing systems face difficulties in seamlessly resuming effect rendering for video and audio output after skipping due to rendering delays, particularly during gacha events in game systems.

Innovation Solution

An information processing program and method that includes units for obtaining video and audio data, skip point information, and accepting skip operations, allowing for controlled resumption of effect rendering by skipping to predetermined points, ensuring synchronized output even when skip operations do not coincide with intended timing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If effect rendering is skipped at arbitrary timing due to video rendering delay, then video output can be delayed, but audio output cannot be seamlessly resumed from the skip destination

Engineering Contradiction:
Improvevideo rendering speedVSAvoidaudio output synchronization
Core Design Contradiction:
SpeedVSReliability

Solution Approach 1:

The system pre-acquires skip point information and skip arrival point information before skip operations occur. This allows the audio output to be seamlessly resumed by directly jumping to the pre-identified skip arrival point in the audio data, eliminating the need to process audio from the beginning of the effect rendering sequence.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The invention introduces skip point information and skip arrival point information as intermediary data structures that map between video skip timing and audio resume timing. These intermediaries enable the decoupling of video and audio rendering timelines while maintaining synchronization through predefined correspondence relationships.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If skip operation is accepted at arbitrary timing, then user control over effect rendering is improved, but synchronization between video and audio output deteriorates

Engineering Contradiction:
Improveskip operation flexibilityVSAvoidvideo-audio synchronization precision
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

Skip point information indicating when skips can occur and skip arrival point information indicating where to resume are acquired in advance. This preliminary preparation enables the system to accept user skip operations at arbitrary timings while maintaining precise video-audio synchronization by jumping to pre-calculated resume points.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes the timing parameters of audio output based on the skip operation. When a skip operation is accepted, the audio rendering is adjusted to resume from a specific skip arrival point that corresponds to the skip point, rather than continuing from the current playback position, thus maintaining synchronization despite the skip.

Inventive Principle:
Principle #35Parameter changes

3Productivity

If video data is skipped to a predetermined point, then video rendering efficiency is improved, but audio data must be managed separately to maintain synchronization

Engineering Contradiction:
Improveeffect rendering efficiencyVSAvoidaudio data management complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The invention merges the management of video and audio skip points by establishing correspondence relationships between skip points in video data and skip arrival points in audio data. This unified management approach allows both media types to be skipped efficiently while maintaining synchronization, reducing the overall complexity compared to managing them separately.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11712623B2Information processing program, terminal device, and information processing method
Publication Date: 2023.08.01 CYGAMES INC
  • US11712623B2 patent drawing
  • US11712623B2 patent drawing
  • US11712623B2 patent drawing

AI summary

Provided is an information processing program that is executed at a terminal device that executes effect rendering for outputting video and audio, the information processing program causing the execution of: a second obtaining unit (74) that obtains skip point information indicating skip points for the effect rendering and skip arrival point information indicating a skip arrival point for the effect rendering; and an effect-rendering control unit (77) that controls the effect rendering by skipping the video data to a predetermined point on the basis of an accepted skip operation to resume the output of the video from that point, and in the case where the timing of accepting the skip operation does not coincide with the skip point, by waiting until the skip point after that timing and then skipping to a specific skip arrival point associated with that skip point, on the basis of the skip operation, to resume the output of the audio from that specific skip arrival point. This makes it possible to seamlessly resume effect rendering for outputting video and audio after the effect rendering is skipped at an arbitrary timing.