Remote Operation Video Transmission Adaptation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional remote operation systems face issues with video transmission quality due to fixed compression conditions, leading to frame loss, noise, and transmission delay, especially in wireless environments with weak radio waves, and existing adaptive bitrate streaming methods do not adequately consider the type of video content, resulting in unsuitable video quality for users.
Innovation Solution
A remote operation apparatus that acquires video data and state detection data to determine the action scene, selects appropriate video parameters or imaging modes based on the scene, and adjusts the video data or imaging settings accordingly for optimal transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If fixed compression conditions are used for video transmission, then the system is simple to implement, but video transmission quality deteriorates in wireless environments with weak radio waves
Solution Approach 1:
The patent applies dynamics by making the video compression parameters adjustable based on communication environment conditions. The system dynamically changes compression degree, resolution, and other video parameters according to the estimated communication band, transforming a static fixed-compression system into a dynamic adaptive system that responds to changing wireless conditions.
Solution Approach 2:
The patent implements parameter changes by modifying video compression parameters (compression degree, resolution, frame rate) based on the estimated communication band. The system adjusts these parameters to match the available bandwidth, ensuring optimal video quality for the current communication conditions while preventing frame loss and transmission delays.
2Reliability
If Adaptive Bitrate Streaming is used to adjust compression degree, then transmission quality is improved, but video image quality necessary for remote control is not obtained because the method does not consider the type of video image
Solution Approach 1:
The patent applies local quality by determining different video parameters based on the specific action scene being captured. Instead of uniformly applying compression across all video content, the system analyzes the video image type (e.g., remote control operation, sports, entertainment) and applies appropriate compression parameters tailored to each scene type, preserving critical visual information while optimizing transmission.
Solution Approach 2:
The patent implements feedback by using state detection data from sensors to determine the action scene and adjusting video parameters accordingly. The system continuously monitors the robot's state and video content, feeds this information back to the parameter selection process, and adjusts compression settings in real-time to maintain appropriate video quality for the current activity.
3Manufacturing precision
If high-quality video is transmitted to ensure spatial resolution, then video clarity is improved, but transmission delay occurs due to narrow communication band in weak radio wave environments
Solution Approach 1:
The patent applies dynamics by dynamically adjusting the balance between spatial resolution and frame rate based on communication conditions. When the communication band is narrow, the system reduces compression degree and maintains higher spatial resolution while adjusting frame rate, ensuring video clarity is preserved without excessive transmission delay.
4Productivity
If compression processing is performed to reduce data transmission capacity, then transmission efficiency is improved, but frame loss and noise occur leading to discontinuous video images
Solution Approach 1:
The patent implements parameter changes by adjusting the compression degree parameter based on the estimated communication band. When the communication band is wide, higher compression can be applied to improve efficiency. When the band is narrow, the system reduces compression degree to prevent frame loss and maintain video continuity, balancing efficiency and reliability according to current conditions.
Data Source
AI summary
In a robot (3) in a remote location, an action scene of the robot (3) is determined based on a feature amount derived from its position and motion detection data and video data, and a video parameter or an imaging mode corresponding to the determined action scene is selected. Then, a process of adjusting the selected video parameter for the video data or a process of setting the selected imaging mode to the camera is performed, and the processed video data is transmitted to the information processing apparatus (2) on the user side via the network (4) and displayed on the HMD (1).