Wearable Cognitive System for Remote Operator Safety and Step Validation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current communication systems for technical intervention missions are cumbersome and inefficient, particularly in hostile environments, as they require multiple sensors and devices that hinder operator mobility and do not effectively validate or record the execution of precise steps, posing safety risks and complicating physiological monitoring.

Innovation Solution

A multimedia system with a communication device, audio and video acquisition and transmission systems, and a centralized control system that sequentially transmits and validates instructions, allowing continuous communication and physiological monitoring while ensuring the operator's safety and traceability of operations, using a battery for autonomy and sensors for environmental and physiological parameter measurement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple sensors and devices are added to monitor physiological parameters and validate operation steps, then monitoring precision and traceability are improved, but device complexity and operator burden increase

Engineering Contradiction:
Improvephysiological monitoring precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple functions (camera, microphone, speaker, physiological sensors, step validation) into a single integrated device worn by the operator. This merging approach maintains comprehensive monitoring capabilities while reducing the number of separate components the operator must manage, thus improving physiological monitoring precision without proportionally increasing device complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The integrated device serves multiple functions simultaneously: it records video and audio, monitors physiological parameters (heart rate, respiration), validates operation steps through image recognition, and communicates with the remote center. This multi-functionality allows the system to achieve comprehensive monitoring and validation without requiring multiple separate devices, thereby improving measurement precision while controlling system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Loss of information

If multiple sensors and communication equipment are worn by the operator, then information transmission to supervisor is improved, but ease of operation deteriorates due to cumbersome equipment

Engineering Contradiction:
Improveinformation transmission completenessVSAvoidoperator mobility
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

By consolidating camera, microphone, speaker, sensors, and communication modules into a single wearable device, the system transmits comprehensive information (video, audio, physiological data) without requiring the operator to wear multiple separate pieces of equipment. This maintains information transmission completeness while significantly improving ease of operation and operator mobility.

Inventive Principle:
Principle #5Merging (Combining)

3Reliability

If preliminary meetings are held to validate and record operation steps, then reliability of operation execution is improved, but loss of time increases

Engineering Contradiction:
Improveoperation execution reliabilityVSAvoidpreparation time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system provides real-time feedback to the operator through the wearable device, confirming whether each operation step has been correctly executed via image recognition and analysis. This immediate feedback mechanism ensures reliable operation execution without requiring time-consuming preliminary meetings, as the system automatically validates each step during the actual operation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs automatic step validation and recording through the wearable device's camera and image recognition algorithms, without requiring human operators to manually review and validate each step in preliminary meetings. This self-service approach maintains high reliability of operation execution while eliminating the time loss associated with manual validation processes.

Inventive Principle:
Principle #25Self-service

4Loss of information

If camera is positioned on glasses or chest, then video acquisition is enabled, but ability to follow operator gaze and maintain ergonomic positioning is reduced

Engineering Contradiction:
Improvevideo acquisition capabilityVSAvoidoperator comfort
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The wearable device is designed to move dynamically with the operator's head and body movements, maintaining optimal positioning for video acquisition and audio recording throughout the operation. This dynamic positioning ensures continuous video capture capability while keeping the device in ergonomic positions that do not restrict operator movement or comfort, unlike fixed positioning on glasses or chest.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP4035592A1Intelligent cognitive system for controlling and assisting remote operators in sensitive technical interventions
Publication Date: 2022.08.03 FINESENSES
  • EP4035592A1 patent drawingFigure 1
  • EP4035592A1 patent drawingFigure 2
  • EP4035592A1 patent drawingFigure 3

AI summary

The invention relates to a support and control system (30) for intervention missions, comprising: a. A multimedia system (31), equipping an operator, comprising: i. A communication device (310), ii. An audio system (311); iii. A video system (312); b. A control system (32) comprising a memory (320) storing a sequence of predetermined instructions and processing means (321); characterized in that the control system (32) is arranged to: i. transmit (42) each of the instructions to the communication device (310), arranged to relay this instruction to the audio (311) and/or video (312) system for transmission to the operator; ii. receive (45) from the communication device (310), an audio (43) and/or video (44) signal acquired by the audio (311) and/or video (312) system; iii. process (46) the signal by the processing means (321) and validate (47), the execution of each instruction (42).