Automated Haptic Actuator Control via Camera Command Extraction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current haptic enhancements for audiovisual content are manually calculated by operators, lacking automation in the creation of haptic actuator control parameters, which limits the ability to seamlessly integrate immersive experiences into new video content.

Innovation Solution

A method that processes commands applied to a camera during filming to calculate and control haptic actuator parameters, allowing for automated enhancement of video content with haptic feedback, adapting the action of actuators to the video content and cinematographic effects, and optimizing actuator control based on available hardware.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If haptic parameters are manually determined by an operator, then the haptic enhancement can be customized for specific sequences, but the process is time-consuming and cannot be automated

Engineering Contradiction:

Improveautomation of haptic parameter calculationVSAvoidtime for manual determination of haptic parameters

Core Design Contradiction:

Extent of automationVSLoss of time

Solution Approach 1:

The patent replaces the manual mechanical process of operator analysis with an automated computer-based system that processes video signals and camera command data to generate haptic control parameters automatically

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service by allowing the video content itself (through embedded camera command data) to automatically generate the haptic control parameters without requiring external manual intervention

Inventive Principle:

Principle #25Self-service

2Adaptability or versatility

If haptic parameters are added to specific media, then the haptic enhancement is tailored to the content, but the process lacks flexibility for new video content

Engineering Contradiction:

Improveadaptability to different video contentVSAvoidease of integrating haptic enhancement into new content

Core Design Contradiction:

Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The patent creates a universal system that can process any video content with camera command data to generate appropriate haptic control parameters, making the system adaptable to different content types without requiring content-specific manual programming

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses camera command data that was recorded during the original filming process as preliminary information, which is then processed automatically to generate haptic control parameters for new video content

Inventive Principle:

Principle #10Preliminary action

Data Source

PatentUS10536682B2Method for reproducing an item of audiovisual content having haptic actuator control parameters and device implementing the method

Publication Date: 2020.01.14 INTERDIGITAL MADISON PATENT HLDG

AI summary

The present disclosure relates to a method for reproducing an item of video content filmed using a camera. An item of video content composed of sequences is developed and enhanced by commands applied to the camera at the time of filming. With a view to reproduction, the video content is divided into sequences. The commands applied to the camera are extracted for each sequence and make it possible to calculate at least one haptic actuator control parameter associated with this sequence. At the time of the reproduction of a sequence of the video content, at least one control parameter thus calculated controls at least one haptic actuator. In this way, the spectator perceives stimuli making it possible to enhance his perception of the video document during the reproduction. Advantageously, the player able to reproduce the enhanced content determines a cinematographic effect for a set of sequences from commands applied to the camera. Then the haptic metaphor associated with this effect is applied to this set of sequences.