Remote Operation Video Overlay for Vehicle Vibration Awareness

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Remote operation systems face challenges in presenting vehicle vibration components to operators, leading to potential sickness and erroneous vehicle state determination due to unprocessed video vibrations, and existing solutions require complex apparatuses that are difficult to install.

Innovation Solution

An information processing system that acquires and processes presentation signals to remove burden components, such as video vibrations, and presents corresponding information to operators using bands overlaid on the video to indicate motion or sound levels, allowing operators to recognize vehicle states accurately.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Object-affected harmful factors

If vibration component is removed from video to prevent operator sickness, then operator comfort is improved, but ability to determine vehicle state is degraded

Engineering Contradiction:
Improveoperator sicknessVSAvoidvehicle state information
Core Design Contradiction:
Object-affected harmful factorsVSLoss of information

Solution Approach 1:

The video signal is segmented into vibration components and non-vibration components through image processing. The vibration components are removed to prevent operator sickness, while the non-vibration components are preserved to maintain vehicle state determination capability. This segmentation allows selective processing of different signal components.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Vibration information is introduced as an intermediary element to mediate between the conflicting requirements. The vibration information is presented to the operator through display or sound output, allowing the operator to perceive vehicle motion states without experiencing the harmful effects of actual video vibration. This intermediary provides the missing information without reproducing the harmful vibration.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Object-affected harmful factors

If vibration information is transmitted and operator seat is moved to match video vibration, then operator comfort is improved, but device complexity and installation difficulty increase

Engineering Contradiction:
Improveoperator discomfortVSAvoidapparatus complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The mechanical system of moving the operator seat to match video vibration is replaced with an information processing system. Instead of physically moving the seat using motors and sensors, the patent uses image processing to remove vibration components from the video and presents vibration information through display or sound. This substitution eliminates complex mechanical apparatus while achieving the same comfort improvement.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Object-affected harmful factors

If vibration component is removed from video, then operator sickness is reduced, but operator fatigue increases due to lack of vibration feedback

Engineering Contradiction:
Improveoperator sicknessVSAvoidoperator energy
Core Design Contradiction:
Object-affected harmful factorsVSLoss of energy

Solution Approach 1:

Vibration information is provided as feedback to the operator through display or sound output. This feedback mechanism allows the operator to perceive vehicle motion states without experiencing the harmful effects of actual video vibration. The feedback maintains the operator's situational awareness and reduces fatigue by providing necessary information in a non-fatiguing form.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS20250209638A1Information processing system, information processing method, and presentation control apparatus
Publication Date: 2025.06.26 SONY GROUP CORP
  • US20250209638A1 patent drawing
  • US20250209638A1 patent drawing
  • US20250209638A1 patent drawing

AI summary

Disclosed herein is an information processing system including circuitry configured to acquire a video signal from which a motion component has been removed, acquire information corresponding to the motion component, and display a video corresponding to the video signal from which the motion component has been removed, the video having the information corresponding to the motion component visually superimposed thereon.