ROV 3D Image Overlay for Spatially Aware Underwater Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current ROV navigation systems lack complete spatial awareness and fail to integrate bathymetric data with real-time navigation, limiting the ability of pilots to navigate effectively in complex underwater environments with limited visibility.

Innovation Solution

A 3D navigation and control system that integrates computing hardware, sonar technology, and software modules for seamless data processing and visualization, allowing for the superimposition of real and virtual camera images, enhanced data sharing, and immersive interfaces for improved mission planning and supervision.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional telemetry information (depth, pitch, roll, camera tilt, heading) is used for navigation, then the system is simple to operate, but complete spatial awareness and integration with positioning systems is not achieved

Engineering Contradiction:
Improvespatial awarenessVSAvoidsystem integration
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges positioning system data with conventional telemetry information (depth, pitch, roll, camera tilt, heading) to create a unified navigation display. This integration combines multiple data sources into a single coherent spatial awareness system, resolving the contradiction between reliability and complexity by showing that integrated systems can be managed through standardized interfaces.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The navigation display serves multiple functions simultaneously: it shows real-time video feed, overlays 3D position data, displays telemetry information, and provides bathymetric context. This multi-functionality achieves complete spatial awareness while managing complexity through a universal display interface that handles diverse data types.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If bathymetric modeling is integrated with real-time navigation, then complete spatial awareness is achieved, but system complexity increases

Engineering Contradiction:
Improvenavigation accuracyVSAvoiddata integration
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system pre-processes and stores bathymetric model data before real-time navigation operations. By having the bathymetric framework ready in advance, the system can quickly overlay this contextual information with real-time positioning data without creating processing bottlenecks, thus improving navigation accuracy while managing data integration complexity.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses an intermediary processing layer that receives both bathymetric model data and real-time positioning data, then synthesizes them into a unified navigation display. This intermediary layer manages the complexity of integrating diverse data sources while providing accurate spatial context for navigation decisions.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If dynamic user interfaces with overlaid quantitative environmental information are implemented, then pilot efficiency is improved, but device complexity increases

Engineering Contradiction:
Improvepilot efficiencyVSAvoidinterface complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The user interface is segmented into distinct overlay elements: video feed, 3D position indicators, telemetry readouts, and bathymetric context. Each element is independently configurable and can be displayed in standardized positions. This segmentation improves pilot efficiency by making information easily scannable while managing interface complexity through modular design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The interface applies different levels of information density to different regions of the display. Critical navigation data is prominently displayed with high visibility, while secondary information is provided in less prominent areas. This local quality approach optimizes pilot efficiency by presenting information in hierarchies of importance while keeping the overall interface manageable.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances pilot efficiency and safety by providing real-time, immersive visualization and communication, reducing operational costs and increasing ROV utilization through improved data transfer and task completion.

Implementation Method 1

Modern multibeam sonar devices with modeling software provide detailed, 3D bathymetric data

Methodology Applied
Scientific EffectSonar: Sonar

Data Source

PatentEP2777024B1System and method of operation for remotely operated vehicles with superimposed 3D imagery
Publication Date: 2021.08.04 ABYSSAL SA
  • EP2777024B1 patent drawingFigure 1A~1B
  • EP2777024B1 patent drawingFigure 2A~2B
  • EP2777024B1 patent drawingFigure 3A

AI summary

The present invention provides a system and method of utilizing superimposed 3D imagery for remotely operated vehicles, namely 3D, reconstructed images of the environment of the ROV. In another aspect, it includes generating a virtual video of 3D elements in the operation environment, synchronizing the angle and position of the camera of a virtual video with the angle and position of a real camera, superimposing the virtual video and the real video from the real camera; superimposing these video feeds such that one is manipulated to show transparencies in areas of less interest, in order to show through the other video. It furthermore may include superimposing information, whether graphic, textual or both on to the hybrid virtual-real 3D imagery. The subject invention is also networked, such that the immersive visual interface described above is accessible to a plurality of users operating from a plurality of locations.