Cockpit Robotic Arm Vision Feedback for CDU Manipulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing in-cockpit robot automation systems face challenges in accurately manipulating complex interfaces such as the control display unit (CDU) of a flight management system (FMS) due to size and vibration issues, making it difficult to engage user-actuable devices effectively.

Innovation Solution

An automation system comprising an actuation controller, a vision system, and a robotic arm assembly housed in a compact unit that can be affixed to a surface adjacent the control interface, allowing the robotic arm to engage user-actuable devices based on data from the vision system, which includes an optical support arm and a camera, and is designed to retract into a cavity for stowage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If existing robotic systems are used to manipulate complex cockpit interfaces, then automation capability is provided, but manipulation accuracy deteriorates due to size and vibration issues

Engineering Contradiction:
Improveautomation capabilityVSAvoidmanipulation accuracy
Core Design Contradiction:
Extent of automationVSMeasurement precision

Solution Approach 1:

The system divides the robotic manipulation task into discrete, precisely controlled movements. The robotic arm is segmented into multiple joints (base joint, elbow joint, wrist joint) that can be independently controlled to achieve fine positioning. The vision system is segmented into camera modules and processing units that work together to provide precise visual feedback for manipulation accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The vision system provides real-time visual feedback to the control system, enabling closed-loop control for precise manipulation. The camera captures images of the CDU and surrounding area, and the control system uses this visual information to adjust the robotic arm's position and orientation, compensating for vibrations and positioning errors to maintain manipulation accuracy.

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If a robotic arm assembly with vision system is added to manipulate CDU, then interface operation capability is improved, but device complexity increases

Engineering Contradiction:
Improveinterface operation capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The robotic arm assembly, vision system, and control electronics are merged into an integrated unit that mounts to the cockpit structure. The housing contains multiple components (robotic arm, camera, lights, electronics) in a compact arrangement, reducing overall system complexity while maintaining interface operation capability.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The robotic arm assembly is designed with universal mounting capabilities that can be adapted to different aircraft types and cockpit configurations. The system can manipulate various control interfaces (CDU, switches, knobs) using the same basic robotic mechanism, reducing the need for multiple specialized systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If robotic arm assembly is mounted adjacent to control interface, then manipulation precision is improved, but installation invasiveness increases

Engineering Contradiction:
Improvemanipulation precisionVSAvoidinstallation invasiveness
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The robotic arm assembly is designed with movable and adjustable components that allow it to adapt to different mounting locations. The arm can extend and reposition itself to reach the CDU from various positions, enabling installation in locations that minimize invasiveness while maintaining manipulation precision.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The vision system acts as an intermediary between the robotic arm and the CDU, enabling precise manipulation without requiring the robotic arm to be in direct contact with or extremely close to the control interface. The camera provides visual guidance that allows the arm to reach and manipulate controls from a slightly greater distance, reducing installation invasiveness.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10850397B2System and method for providing in-cockpit actuation of aircraft controls
Publication Date: 2020.12.01 AURORA FLIGHT SCIENCES CORP
  • US10850397B2 patent drawing
  • US10850397B2 patent drawing
  • US10850397B2 patent drawing

AI summary

An actuation system to manipulate an interface in an aircraft having an actuation controller, a vision system, a robotic arm, and a housing. Each of the vision system and the robotic arm assembly may be operatively coupled to the actuation controller. The vision system may be configured to optically image a display device of the preexisting interface, while the robotic arm assembly may be configured to engage a user-actuable device of the preexisting interface. The housing can be configured to affix to a surface adjacent the preexisting interface, where each of the vision system and the robotic arm assembly are coupled to the housing. In operation, the actuation controller may be configured to instruct the robotic arm assembly based at least in part on data from the vision system.