Cockpit Robotic Arm Control Using Imaging and Force Sensing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing flight control systems face challenges such as increased complexity, overreliance on automation, high costs for upgrades, and limited portability across aircraft, which hinder efficient aircraft state monitoring and pilot workload management.

Innovation Solution

An aircrew automation system employing a robotic arm with integrated imaging and force sensing modalities, enabling quick introduction of new capabilities, continuous aircraft state monitoring, and reduced pilot workload through a modular, non-invasive design that can be easily adapted across various aircraft.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If additional functionality is added to flight decks, then automation capabilities are improved, but system complexity increases

Engineering Contradiction:
Improveautomation capabilitiesVSAvoidsystem complexity
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The system is divided into separate functional modules: a robotic arm for physical control operations, imaging sensors for visual perception, force sensors for tactile feedback, and a control system for processing. This modular segmentation allows automation capabilities to be enhanced without proportionally increasing overall system complexity, as each module can be independently developed and maintained.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The robotic arm system is designed to perform multiple functions: it can manipulate flight controls, operate switches, read instrument displays, and interact with various cockpit interfaces. The integrated sensing modalities (imaging and force sensing) enable the same hardware platform to handle diverse tasks across different aircraft types, reducing the need for aircraft-specific automation systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Extent of automation

If flight control systems are upgraded, then automation performance is improved, but certification costs increase

Engineering Contradiction:
Improveautomation performanceVSAvoidcertification costs
Core Design Contradiction:
Extent of automationVSEase of manufacture

Solution Approach 1:

The system employs commercially available, off-the-shelf components for the robotic arm, sensors, and computing hardware rather than custom-designed aerospace-grade components. This approach significantly reduces development and certification costs, allowing rapid prototyping and iteration while maintaining sufficient performance for the intended applications.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The system includes self-calibration and self-verification capabilities where the robotic arm and sensors automatically adjust their parameters and validate their performance without extensive external testing. This self-service approach reduces the burden on certification authorities and accelerates the approval process.

Inventive Principle:
Principle #25Self-service

3Extent of automation

If flight control systems are upgraded, then automation capabilities are improved, but portability across aircraft decreases

Engineering Contradiction:
Improveautomation capabilitiesVSAvoidportability across aircraft
Core Design Contradiction:
Extent of automationVSAdaptability or versatility

Solution Approach 1:

The robotic arm system is designed with universal interfaces and adaptive control algorithms that can operate across different aircraft types. The imaging and force sensing modalities allow the system to visually identify and physically interact with various control interfaces without requiring aircraft-specific hardware modifications, enabling portability while maintaining advanced automation capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system employs dynamic adaptation through machine learning algorithms that learn the specific characteristics of each aircraft type during initial operation. The robotic arm adjusts its motion parameters, force application, and sensor calibration based on real-time feedback, allowing the same hardware platform to effectively operate on multiple aircraft models with varying control systems.

Inventive Principle:
Principle #15Dynamics

4Force

If robotic arm engagement force is increased, then control effectiveness is improved, but risk of damage increases

Engineering Contradiction:
Improvecontrol effectivenessVSAvoidrisk of damage
Core Design Contradiction:
ForceVSObject-affected harmful factors

Solution Approach 1:

Force sensors are integrated into the robotic arm to provide real-time feedback on the contact forces applied to flight controls and switches. The control system continuously monitors these force readings and adjusts the robotic arm's actuation accordingly, ensuring sufficient force for effective control operation while preventing excessive force that could cause damage to sensitive aircraft components.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system effectively reduces pilot workload, enhances safety by alerting and assuming control during critical situations, and provides comprehensive data logging for improved debriefing and maintenance, while minimizing certification burdens and costs.

Implementation Method 1

measuring, via a force sensor operably coupled to the robotic arm, a measured force between the robotic arm and the instrument during engagement

Methodology Applied
Scientific EffectForce sensing: Force

Data Source

PatentUS11378988B2Aircrew automation system and method with integrated imaging and force sensing modalities
Publication Date: 2022.07.05 AURORA FLIGHT SCIENCES CORP
  • US11378988B2 patent drawing
  • US11378988B2 patent drawing
  • US11378988B2 patent drawing

AI summary

An aircrew automation system may comprise an actuation system and a computer system having a processor and one or more interfaces. The computer system can be communicatively coupled with a flight control system of an aircraft and configured to generate control commands based at least in part on flight situation data. The actuation system is operatively coupled with the computer system and comprises a robotic arm, a force sensor, and a controller. The robotic arm can be configured to engage a cockpit instrument among a plurality of cockpit instruments. The force sensor is operably coupled to the robotic arm and configured to measure a force when the robotic arm makes contact with the cockpit instrument. The controller is operably coupled with the robotic arm and the force sensor.