Selective Image Capture on Ocean Floats Using IMU Wave Prediction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems for floating sensors deployed on the open sea face challenges in efficient image capture due to limited power storage and bandwidth, making it difficult to continuously process and transmit image data, especially when focused solely on image capture without utilizing internal sensors to optimize data transmission.

Innovation Solution

A system that employs an inertial measurement unit (IMU) to predict wave motion and trigger image capture based on predetermined criteria, such as height, pitch, and roll, using a Kalman filter to estimate optimal capture times and select relevant images, thereby reducing power consumption and optimizing data transmission.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If continuous image capture and processing is performed, then image data quality and completeness are improved, but power consumption increases beyond the limited power storage capability of the float

Engineering Contradiction:
Improveimage data completenessVSAvoidpower consumption
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary action by using the IMU to predict wave motion and pre-determine optimal image capture moments before actually capturing images. The Kalman filter estimates future wave states, allowing the system to trigger captures only when conditions are favorable, thus avoiding continuous capture and reducing power consumption while maintaining data quality.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of continuous image capture, the system applies partial action by selectively capturing images only during specific wave conditions (e.g., at wave crests or when the float is in optimal position). This partial capture strategy reduces the total number of images taken and processed, thereby lowering power consumption while still obtaining sufficient data for the monitoring objectives.

Inventive Principle:
Principle #16Partial or excessive action

2Loss of information

If all captured images are transmitted via satellite, then data transmission completeness is improved, but bandwidth consumption exceeds the limited transmission resources available

Engineering Contradiction:
Improvedata transmission completenessVSAvoidbandwidth consumption
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The system extracts only the most valuable image data for transmission. By using IMU data to evaluate image quality and relevance (e.g., whether the float is at optimal height and orientation), the system selectively transmits only those images that meet predetermined criteria, leaving less valuable images unst transmitted. This extraction approach maintains data completeness for critical information while reducing overall bandwidth consumption.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system changes the parameter of image selection based on wave conditions and float position. Instead of transmitting all images uniformly, the transmission decision is made dynamic based on parameters such as wave height, float elevation, and image content relevance. This parameter-based selection optimizes bandwidth usage by transmitting only when conditions warrant it.

Inventive Principle:
Principle #35Parameter changes

3Ease of operation

If image capture is performed without considering wave motion, then capture simplicity is maintained, but image quality and relevance to maritime activities decrease

Engineering Contradiction:
Improvecapture operation simplicityVSAvoidmaritime activity detection capability
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The IMU serves as an intermediary between the wave environment and the image capture system. Rather than directly analyzing complex wave patterns to determine capture timing, the system uses the IMU to measure float motion and infer wave conditions. This intermediary approach maintains operational simplicity while significantly improving image quality and relevance by capturing images at optimal moments determined through IMU data analysis.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for selective and efficient image capture on floating devices, prioritizing images with high likelihood of capturing interesting information, such as maritime traffic, while conserving power and bandwidth, enhancing the ability to monitor oceanic activities with limited resources.

Implementation Method 1

integrating accelerometer data of the inertial measurement unit corresponding to measured acceleration in a direction perpendicular to an ocean surface (Z) over the last w measurements to predict the current height (z) of the float or device

Methodology Applied
Scientific EffectIntegration of acceleration:

Implementation Method 2

the predictive routine comprises implementation of a Kalman filter to predict wave behavior

Methodology Applied
Scientific EffectKalman filter prediction:

Data Source

PatentUS11917337B2System and method for selective image capture on sensor floating on the open sea
Publication Date: 2024.02.27 GENESEE VALLEY INNOVATIONS LLC
  • US11917337B2 patent drawing
  • US11917337B2 patent drawing
  • US11917337B2 patent drawing

AI summary

The present specification relates to image capture. More specifically, it relates to selective image capture for sensor carrying devices or floats deployed, for example, on the open sea. In one form, data is generated on the sensor carrying devices or floats by an on-board Inertial Measurement Unit (IMU) and is used to automatically predict the wave motion of the sea. These predictions are then used to determine an acceptable set of motion parameters that are used to trigger the on-board camera(s). The camera(s) then capture images. One consideration is that images captured at or near the peak of a wave crest with minimal pitch and roll will contain fewer obstructions (such as other waves). Such images provide a view further into the horizon to, for example, monitor maritime sea traffic and other phenomenon. Therefore, the likelihood of capturing interesting objects such as ships, boats, garbage, birds, . . . etc. is increased. These images may then be further processed and/or transmitted in a variety of manners.