Remote Driving Camera Control for Low-Bandwidth Steering Visibility

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing remote driving systems face operability issues due to reduced resolution and frame rate of cameras when trying to suppress video data, leading to increased time for users to grasp necessary information during remote control operations.

Innovation Solution

A remote driving system that dynamically adjusts the resolution and frame rate of cameras based on the steering wheel operation amount and direction, prioritizing the camera capturing the front region when traveling straight and side regions when turning, to maintain image quality while reducing data transmission.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If the resolution and frame rate of cameras are uniformly reduced to suppress video data amount, then the communication data is reduced, but the time required for the user to grasp necessary information increases and operability deteriorates

Engineering Contradiction:
Improvecommunication data amountVSAvoidremote control operability
Core Design Contradiction:
Quantity of substanceVSEase of operation

Solution Approach 1:

The patent applies local quality by setting different resolution and frame rate parameters for different cameras based on their imaging regions. The front camera maintains high resolution and frame rate while side cameras use reduced parameters, optimizing both communication efficiency and operability for each specific region's requirements.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent implements dynamic adjustment of camera parameters based on real-time driving conditions. The control unit changes resolution and frame rate settings according to whether the vehicle is traveling straight or turning, making the system adaptable to different operational contexts and maintaining optimal operability.

Inventive Principle:
Principle #15Dynamics

2Quantity of substance

If the resolution and frame rate are uniformly reduced across all cameras, then the communication bandwidth is reduced, but the image quality for grasping necessary information deteriorates

Engineering Contradiction:
Improvevideo data amountVSAvoidimage quality
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

Different cameras are assigned different quality levels based on their functional importance. The front camera, which provides critical driving information, maintains high resolution and frame rate, while side cameras that capture less critical regions use reduced parameters, achieving local optimization of image quality.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The video data from multiple cameras is segmented and processed differently. Each camera's data stream is independently controlled with specific resolution and frame rate settings, allowing selective quality maintenance for critical regions while reducing data from less critical regions.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If high resolution and frame rate are maintained for all cameras, then the image quality is improved, but the communication data amount increases

Engineering Contradiction:
Improveimage qualityVSAvoidcommunication data amount
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

High image quality is maintained locally only where necessary for safe operation. The front camera operating in the primary driving direction uses high resolution and frame rate, while side cameras use reduced parameters, achieving local quality optimization without excessive overall data transmission.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

Instead of uniformly applying high quality to all cameras, the system applies high quality partially only to the most critical front camera. This partial action approach maintains sufficient image quality for safe remote operation while avoiding the excessive data transmission that would result from uniformly high settings across all cameras.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11838654B2Remote driving system
Publication Date: 2023.12.05 TOYOTA JIDOSHA KK
  • US11838654B2 patent drawing
  • US11838654B2 patent drawing
  • US11838654B2 patent drawing

AI summary

A remote driving system includes: an acquisition unit for acquiring operation information related to an operation of a steering wheel by a user who remotely drives the target vehicle; and a control unit for controlling a resolution and a frame rate of each camera mounted on the target vehicle. When an operation amount of the steering wheel is relatively small, at least one of the resolution and the frame rate of a camera that captures an image of a front region of the target vehicle in a traveling direction is maintained or improved. When the steering wheel has been rotated to one of right and left and the operation amount is relatively large, at least one of the resolution and the frame rate of a camera that captures an image of a region of the one of right and left of the target vehicle is maintained or improved.