Mobile Body Image Processing for Transmission Delay Compensation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote operation technologies for mobile bodies suffer from delayed video transmission, which hinders timely obstacle detection and requires high-resolution videos, leading to reduced usability due to low frame rates and transmission constraints.
Innovation Solution
An information processing device that receives images and motion information at different frequencies, generating a second image based on the first image and motion information to compensate for delays and improve usability by invalidating apparent delay times.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If high-resolution video is transmitted to improve image quality for remote operation, then image quality is improved, but transmission delay increases and frame rate decreases
Solution Approach 1:
The system performs preliminary actions by capturing images at high resolution before transmission, then generates lower-resolution preview images for immediate display. This allows the full-resolution images to be processed and transmitted without delaying the initial display, effectively separating the timing of image capture from transmission while maintaining both quality and responsiveness.
Solution Approach 2:
The imaging system is segmented into multiple imaging units with different resolutions. High-resolution imaging units capture detailed images for accurate obstacle detection, while lower-resolution imaging units provide real-time preview feedback. This segmentation allows simultaneous operation at different quality levels without mutual interference, resolving the contradiction between image quality and transmission speed.
2Productivity
If image transmission frequency is increased to improve real-time feedback, then real-time performance is improved, but transmission bandwidth requirements increase
Solution Approach 1:
Different parts of the imaging system provide different quality levels according to their specific functions. High-resolution images are transmitted only when necessary for detailed inspection, while lower-resolution images are transmitted continuously for real-time feedback. This local quality differentiation reduces overall data transmission volume while maintaining real-time performance and image quality where needed.
3Quantity of substance
If frame rate is reduced to decrease data transmission volume, then bandwidth usage is reduced, but usability and obstacle detection timeliness deteriorate
Solution Approach 1:
The system dynamically adjusts transmission parameters based on operational context. When obstacles are detected or during critical maneuvering phases, the frame rate and resolution are automatically increased to improve usability. During stable, low-risk operations, transmission frequency and resolution are reduced to minimize data volume. This dynamic adaptation allows the system to optimize both bandwidth usage and usability according to real-time conditions.
Data Source
AI summary
An information processing device includes a control unit that receives, at a first frequency, a first image generated by an imaging unit mounted on a mobile body and first time information at which the first image is generated; receives, at a second frequency higher than the first frequency, motion information regarding a motion of the mobile body generated by a sensor unit mounted on the mobile body and second time information at which the motion information is generated; and generates a second image based on the first image and the motion information.