Wireless Robot Control via Embedded Commands in Video Streams
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current industrial robot deployments face challenges in controlling robot devices over wireless communication networks due to lack of trustworthy and low-latency wireless links, which is a barrier to implementing cloud robotics, especially with the SaaS paradigm.
Innovation Solution
Utilizing a two-way video streaming architecture over 4G, 5G, or NR mobile communication networks, embedding sensor data and control commands within video streams, leveraging existing video services like ViLTE and H.264 encoding to ensure high QoS and robustness.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If wireless communication networks (4G, 5G, NR) are used to control robot devices over the cloud, then deployment flexibility and mobility are improved, but network latency and reliability are worsened
Solution Approach 1:
The system performs preliminary actions by pre-synchronizing robot status data to the cloud before control commands are needed. This pre-positioning of data reduces latency when control commands must be transmitted, allowing the system to maintain deployment flexibility while improving response reliability
Solution Approach 2:
The patent introduces an intermediary architecture with local edge computing components that mediate between the wireless network and the robot device. This intermediary can buffer and process commands locally, reducing the impact of network reliability issues while maintaining cloud connectivity benefits
2Extent of automation
If sensor data and control commands are transmitted over wireless networks, then cloud robotics capability is improved, but network bandwidth consumption and latency are worsened
Solution Approach 1:
The system extracts and transmits only essential robot status data to the cloud, filtering out redundant information. This selective data extraction enables cloud robotics functionality while minimizing network bandwidth consumption and reducing transmission latency
Solution Approach 2:
The system performs preliminary processing of sensor data at the edge before cloud transmission, preparing and filtering data in advance. This reduces the amount of data requiring network transmission and minimizes latency when control commands are needed
Data Source
AI summary
Methods and arrangements for controlling a robot device (202) by a control device (206) over a radio communication network using a video session are disclosed. Control commands from the control device are embedded (S226) into a down-stream video stream and delivered over the communication network (210) after which the control commands are extracted (S212) from down-stream video stream and provided to the robot device. Sensor data from the robot device, based on the control commands, are embedded (S218) in an up-stream video stream and delivered over the communication network, after which the sensor data is extracted (S220) from the up-stream video stream and provided to the control device. The control device may then determine updated control commands based on the provided sensor data. The quality of service used in the video session over the communication network is herein suitable for controlling the robot device by the control device.