Marine Vessel Gesture Control With Motion Compensation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional control methods for marine devices on watercrafts are inconvenient, distracting, and non-intuitive, especially when users need to maintain hand control of steering or fishing rods, and are affected by environmental factors like motion and coatings that interfere with touchscreen interactions.

Innovation Solution

The development of systems and methods that enable touchless control using sensor modules to detect gestures and vibrations, allowing users to control marine devices with head movements, hand gestures, and voice commands, minimizing the need for manual interaction with human-computer interfaces.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional touchscreen displays and buttons are used for controlling marine devices, then the interface provides detailed control options, but the user cannot operate the device hands-free when engaged in fishing or steering activities

Engineering Contradiction:

Improvehands-free operation capabilityVSAvoidcontrol interface complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces mechanical touchscreen and button interfaces with acoustic (voice recognition) and optical (gesture recognition via camera) sensing systems. This allows users to control marine devices hands-free through voice commands or hand gestures detected by the camera, eliminating the need for physical contact with the interface while maintaining comprehensive control capabilities.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system introduces an intermediary layer between the user and the control interface - using voice recognition software and camera-based gesture recognition to translate natural human actions into device control commands. This intermediary enables hands-free operation while preserving the full functionality of the control system.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Illumination intensity

If touchscreen displays are mounted at the helm for easy access, then the interface is within reach, but visibility is affected by environmental factors such as sunlight, weather, and lighting conditions

Engineering Contradiction:

Improvedisplay visibilityVSAvoidcontrol accessibility

Core Design Contradiction:

Illumination intensityVSEase of operation

Solution Approach 1:

The system uses voice recognition and camera-based gesture recognition as intermediary control methods that bypass the visual display entirely for input operations. Users can issue commands through voice or gestures without needing to see or touch the display, eliminating the conflict between display visibility and control accessibility.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the visual-mechanical interaction (looking at and touching the display) with acoustic and optical sensing (microphone and camera sensors). This substitution allows control operations to proceed independently of display visibility conditions.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Ease of operation

If users reach for and manipulate the marine display during fishing activities, then control operations can be performed, but the user may lose hooked fish or need to reposition themselves on the boat

Engineering Contradiction:

Improvecontrol operation capabilityVSAvoidfishing activity continuity

Core Design Contradiction:

Ease of operationVSReliability

Solution Approach 1:

The patent replaces mechanical hand-based control with acoustic (voice) and optical (gesture) sensing systems. This allows users to maintain continuous engagement in fishing activities without needing to physically interact with the display, eliminating the risk of losing hooked fish or disrupting fishing operations.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service operation where the marine device responds to natural human actions (speaking, gesturing) without requiring the user to divert attention or physical effort from fishing activities. The control system serves itself by interpreting these natural actions as commands.

Inventive Principle:

Principle #25Self-service

4Measurement precision

If conventional button or touchscreen-based user input is used, then precise control commands can be entered, but materials coating fingers (oils, sunscreen, fish, water, gloves) interfere with touch interactions

Engineering Contradiction:

Improvecontrol input accuracyVSAvoidtouchscreen responsiveness

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces mechanical touchscreen contact with acoustic (microphone) and optical (camera) sensing. This eliminates the interference caused by coatings on fingers, as voice commands and gestures detected by the camera are not affected by oils, sunscreen, fish slime, water, or gloves.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system introduces voice recognition and gesture recognition as intermediary control methods that bypass the need for direct finger contact with the touchscreen. These intermediaries are not affected by coatings on the user's skin or hands.

Inventive Principle:

Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

These systems provide intuitive and hands-free control of marine devices, enhancing user experience by allowing users to focus on boating activities while maintaining control over operations, even in challenging environmental conditions.

Implementation Method 1

the sensor module may include motion sensing to control various operations of the connected marine devices via the controller

Methodology Applied

Scientific EffectMotion sensing:

Implementation Method 2

the sensor module may include a vibration sensor for detecting vibrations of the user

Methodology Applied

Scientific EffectVibration detection:

Implementation Method 3

The user input device may include a three-dimensional orientation sensor that can detect a first orientation of the user input across three dimensional axes

Methodology Applied

Scientific EffectOrientation detection:

Implementation Method 4

the sensor module may include a radar-based motion sensor to detect gestures and/or actions from the user

Methodology Applied

Scientific EffectRadar detection: Radar

Data Source

PatentUS20240359780A1Systems and methods for controlling operations of marine vessels

Publication Date: 2024.10.31 NAVICO INC

AI summary

Systems, assemblies, and methods for conveniently operating marine devices associated with a watercraft are provided herein. An example system includes a controller, a sensor module, and a marine device. The controller is configured to receive a user input indicating a desired action via the sensor module and transmit a signal to the marine device to cause the marine device to operate in a particular manner. The sensor module may include one or more motion sensors, and the controller may be configured to filter unintentional movement from the raw motion data sensed by the sensor module, such as due to movement of the watercraft floating on the surface of the water. Thus, the system may enable convenient and intuitive control over various marine devices associated with the watercraft.