Interactive Video Timeline Control via Sensor Gestures

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for creating interactive audio-video content on mobile devices are limited, as they only allow basic interactions such as adding digital content or switching between narrative sequences through simple commands, failing to utilize the full potential of sensors and actuators, and require specific computer graphics skills and tools, making it inaccessible to a broader audience.

Innovation Solution

A method for creating interactive audio-video content that allows users to control the timeline and frame-rate of video clips using a variety of sensors and commands, enabling seamless, continuous transitions between video segments without image jumps, and can be executed on everyday devices without additional software costs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If dedicated video editors or online portals are used to add overlays or hyperlinks to video content, then interactivity is improved, but device complexity and operation difficulty increase due to requiring specialized software and skills

Engineering Contradiction:
ImproveinteractivityVSAvoidsoftware complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent enables mobile terminals to perform video editing and interactivity creation functions using built-in sensors and standard applications, eliminating the need for dedicated video editing software. The system makes the mobile device itself universal for both consumption and creation of interactive video content.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system allows users to create interactive video content using the mobile terminal's own sensors and processing capabilities without requiring external specialized tools or software, making the device self-sufficient for content creation.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If simple commands are used for switching between video sequences, then ease of operation is improved, but interactivity is limited as sensors and actuators are not fully utilized

Engineering Contradiction:
Improveoperation simplicityVSAvoidinteractivity
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent changes the parameters of interaction by utilizing multiple sensor types (accelerometer, gyroscope, microphone, camera) and gesture types (swipe, tap, shake, rotate) to control video playback parameters such as timeline position, frame rate, and sequence selection, thereby enhancing interactivity while maintaining ease of operation through natural gestures.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If computer graphics processing is used to create interactive story elements, then adaptability is improved, but ease of manufacture and accessibility worsen due to requiring specialized skills and expensive tools

Engineering Contradiction:
Improveinteractive content creationVSAvoidcontent creation accessibility
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The patent uses the mobile terminal's existing camera to capture real-world video content instead of requiring computer graphics creation tools. This copying approach allows users to create interactive content with everyday objects and environments, making content creation accessible without specialized 3D modeling skills or expensive software.

Inventive Principle:
Principle #26Copying

4Productivity

If instantaneous fixed cuts are used for clip transitions, then productivity is improved, but the quality of video evolution worsens as transitions lack softness and continuity

Engineering Contradiction:
Improveclip switching speedVSAvoidtransition smoothness
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent introduces dynamic transition effects between video clips including fading, blending, and morphing operations that can be controlled by gesture duration and intensity. This allows transitions to be both fast (maintaining productivity) and smooth (improving quality), resolving the contradiction between switching speed and transition smoothness.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11862200B2Method for the creation of interactive audio-video contents of the live-action type for mobile terminals, electronic system for the implementation of the method, and mobile terminal for using the method
Publication Date: 2024.01.02 HYPEX SRL
  • US11862200B2 patent drawing
  • US11862200B2 patent drawing
  • US11862200B2 patent drawing

AI summary

Methods for creating interactive audio-video contents, through visualization on an interactive display include providing a interconnected video segments, adapted to evolve in time, each having an initial video segment and one or more final video segments. Each video segment includes a non-interactive video clip having a given, or even null, duration, and an interactive node. The interactive node acts as an interconnection with one or more other video segments. Each interactive node includes a loop interval subject to continuous cyclical forward and backward time evolution. At least one set of commands determines connection choices among the video segments. The commands can be activated during at least one of the loop intervals. Upon activation of a command during the loop interval, the interval is exited and processing continues in the video segment of the one or more other video segments in which said interactive audio-video content continues.