FPV Motion Chair Force Feedback via Image Stabilization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current First-person-view (FPV) systems for remote-controlled vehicles lack immersive experience, as they only provide visual and auditory stimulation, failing to convey the physical sensations of driving or navigating, and integrating full motion force feedback is challenging due to weight and latency issues with motion gyro sensors.

Innovation Solution

A system that uses cameras on the vehicle to record and stabilize images, calculating six degrees of freedom and G-force to generate force feedback signals, which are then simulated in a motion chair, employing image stabilization techniques like Digital Image Stabilization and Vestibule Ocular Reflex to reduce data transfer and latency, while avoiding the need for additional motion gyro sensors on the vehicle.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If motion gyro sensors are integrated into the FPV system to provide force feedback, then the immersive experience is improved, but the weight of the vehicle increases and latency is introduced

Engineering Contradiction:
Improveimmersive experienceVSAvoidvehicle weight
Core Design Contradiction:
ReliabilityVSWeight of moving object

Solution Approach 1:

The patent extracts the motion sensing function from the vehicle by removing motion gyro sensors from the vehicle itself. Instead, it uses the image stabilization module's data (which captures vehicle motion indirectly through camera stabilization) to derive motion information. This separates the sensing function from the vehicle, eliminating the weight penalty while maintaining motion detection capability.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces an intermediary approach by using the image stabilization module as a mediator to capture vehicle motion. Rather than directly measuring acceleration with gyro sensors on the vehicle, the system uses the stabilization data (which reflects vehicle motion to keep the image steady) as an indirect measure of vehicle dynamics, then processes this data to generate force feedback.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If motion gyro sensors are integrated into the FPV system to provide force feedback, then the immersive experience is improved, but data transmission latency increases

Engineering Contradiction:
Improveimmersive experienceVSAvoiddata transmission latency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent extracts motion information from the image stabilization data stream that already exists in the FPV system, rather than adding separate sensor data transmission channels. By reusing the stabilization data (which is already being processed for video output), the system avoids the latency introduced by additional sensor data collection, processing, and transmission pipelines.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent makes the image stabilization module serve multiple functions: it both stabilizes the video feed for the pilot and simultaneously provides motion data for force feedback generation. This multi-functionality eliminates the need for dedicated motion sensors and their associated data transmission paths, thereby reducing latency.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Device complexity

If image stabilization signals are used to calculate vehicle motion, then the system complexity is reduced, but the measurement precision of vehicle motion may be affected

Engineering Contradiction:
Improvesystem complexityVSAvoidvehicle motion measurement
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent replaces direct mechanical motion sensing (with gyro sensors) with an optical/electronic substitution approach. The image stabilization module, which uses optical flow analysis and image processing to maintain a steady view, provides motion data through signal processing rather than direct mechanical measurement. This substitution reduces system complexity while maintaining adequate measurement precision for force feedback applications.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11107364B2Method to enhance first-person-view experience
Publication Date: 2021.08.31 FORMULA SQUARE HLDG LTD
  • US11107364B2 patent drawing
  • US11107364B2 patent drawing
  • US11107364B2 patent drawing

AI summary

A system that simulates force feedback of a remote-control vehicle in a motion chair, which includes a plurality of cameras (110,120) mounted on the vehicle (100), an image stabilization module (430) in the vehicle (100), a video processing module (440) in the vehicle (100), an information splitter (514) in the motion chair (570), a motion processing unit (520) in the motion chair (570), a control unit (550) in the motion chair (570), a G-force calculation unit (560) in the motion chair (570) and a force feedback generation unit (540) in the motion chair (570). The motion processing unit (520) calculates six degrees of freedom of motions of the vehicle based on the image stabilization signals generated from the cameras (110,120). The force feedback generation unit (540) produces force feedback signals based on the six degrees of freedom of motions of the vehicle (100) and the G-force calculated by the G-force calculation unit (560).