ROV Edge Autonomy Over Sparse Datalinks for Remote Supervision

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Remotely operated vehicles (ROVs) face limitations in range and effectiveness due to the need for close proximity of operators, especially in high-risk environments, as existing solutions compromise data transmission bandwidth and latency, hindering situational awareness and control capabilities.

Innovation Solution

Implementing a local awareness/autonomy node on the ROV that receives remote supervisory commands and maintains situational awareness, allowing the ROV to perform tasks autonomously over sparse datalinks by reducing data transmission requirements and managing bandwidth and latency, enabling effective operation even with low-bandwidth and high-latency connections.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Object-affected harmful factors

If acoustic modems or Internet connections are used to increase separation between operator and ROV, then operator safety is improved, but data transmission bandwidth is reduced and latency increases

Engineering Contradiction:
Improveoperator safetyVSAvoiddata transmission bandwidth
Core Design Contradiction:
Object-affected harmful factorsVSLoss of information

Solution Approach 1:

The patent segments the control system into autonomous functions executed locally on the ROV and supervisory functions executed remotely by the operator. The ROV independently performs task execution, obstacle avoidance, and navigation while the operator provides high-level supervisory commands, eliminating the need for continuous high-bandwidth communication.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The ROV is pre-programmed with autonomous capabilities including task execution algorithms, obstacle detection and avoidance routines, and navigation functions. These preliminary actions enable the ROV to operate independently without real-time operator intervention, compensating for limited bandwidth communication.

Inventive Principle:
Principle #10Preliminary action

2Object-affected harmful factors

If acoustic modems or Internet connections are used to increase separation between operator and ROV, then operator safety is improved, but control effectiveness deteriorates due to latency

Engineering Contradiction:
Improveoperator safetyVSAvoidcontrol latency
Core Design Contradiction:
Object-affected harmful factorsVSLoss of time

Solution Approach 1:

The control system is divided into time-critical autonomous functions handled locally on the ROV and non-time-critical supervisory functions handled remotely. This segmentation eliminates latency for critical responses while maintaining operator safety through remote operation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The ROV serves itself by autonomously detecting obstacles, avoiding collisions, and executing tasks without waiting for operator commands. This self-service capability eliminates control latency for critical functions while the operator provides supervisory oversight.

Inventive Principle:
Principle #25Self-service

3Loss of information

If high-bandwidth connections are used for real-time control, then situational awareness is improved, but operator proximity requirement increases

Engineering Contradiction:
Improvesituational awarenessVSAvoidoperator-ROV distance
Core Design Contradiction:
Loss of informationVSLength of moving object

Solution Approach 1:

The patent extracts the situational awareness processing from the communication channel and places it locally on the ROV. The ROV independently processes sensor data to maintain awareness of its environment and mission status, transmitting only essential status information to the operator, enabling remote operation without sacrificing awareness.

Inventive Principle:
Principle #2Taking out (Extraction)

4Object-affected harmful factors

If remote operation over sparse datalinks is implemented, then operator safety and range are improved, but data transmission capacity is reduced

Engineering Contradiction:
Improveoperator safetyVSAvoiddata transmission capacity
Core Design Contradiction:
Object-affected harmful factorsVSQuantity of substance

Solution Approach 1:

The communication data stream is segmented into high-priority essential information (position, critical status, safety alerts) and low-priority detailed information. Only essential information is transmitted over the sparse datalink, while the ROV maintains detailed local awareness for autonomous operation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The ROV performs preliminary processing of sensor data locally to extract only essential information for transmission. This preliminary action reduces the data volume requiring transmission over the limited-capacity datalink while maintaining operational effectiveness.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20240345586A1Apparatuses, Methods, and Systems for Supervising Remotely Operated Vehicles Over Sparse Datalinks
Publication Date: 2024.10.17 GREENSEA SYSTEMS INC
  • US20240345586A1 patent drawing
  • US20240345586A1 patent drawing
  • US20240345586A1 patent drawing

AI summary

Apparatuses for operating a remotely operated vehicle (ROV) over a communications network that includes at least one sparse datalink that hampers remotely controlling the ROV in real time or near real time. In some embodiments, remote operation of the ROV is enabled by locating a local awareness/autonomy edge-processing node on the ROV side of the sparse datalink(s) and configuring the local awareness/autonomy edge-processing node to provide the ROV with local control based on remote supervisory commands received over the sparse datalink(s). In some embodiments, the local awareness/autonomy edge-processing node maintains situational awareness information regarding the environment local to the ROV that autonomy algorithms on the local awareness/autonomy edge-processing node use in controlling the ROV to perform one or more tasks within the need for real time or near real time remote control. Related methods, software, and systems are also disclosed.