Robotic End-Effector Lighting for Grasp and Movement Communication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current robotic systems struggle to effectively communicate with human workers in sortation environments, particularly in conveying information about object placement and system state, which is crucial for safety and efficiency, as lighting-based solutions are not well-suited for automated systems and may confuse human workers with preconceived expectations.

Innovation Solution

The implementation of an RGB LED lighting system on shelves and an end effector, allowing for the conveyance of information through color and flashing modes to indicate object placement, system state, and robotic actions, facilitating communication between human workers and automated systems.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If traditional monochromatic lights or display systems are used to indicate target locations, then workers can quickly identify placement locations, but the system cannot effectively communicate system state and robotic actions to human workers

Engineering Contradiction:
Improveinformation communicationVSAvoidlighting system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent applies parameter changes by using RGB LEDs that can vary in color (red, yellow, green, blue, etc.) and illumination patterns (steady, flashing, pulsing) to encode different types of information. This allows a single lighting element to convey multiple states (target location, system status, robotic actions) without adding physical complexity, resolving the contradiction between information completeness and device simplicity

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The lighting system is designed to perform multiple functions: indicating target locations, communicating system states (idle, busy, error), and providing safety warnings. By making the lighting system universal rather than specialized for a single function, the patent eliminates the need for separate communication systems while maintaining clarity

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Loss of information

If lighting is used to indicate target locations in automated systems, then visual cues are provided, but human workers may be confused by preconceived expectations about lighting roles

Engineering Contradiction:
Improvecommunication clarityVSAvoidworker understanding
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent applies local quality by assigning specific meanings to different lighting locations and patterns. For example, lights on the robotic arm indicate its state, lights on shelves indicate target locations, and different colors indicate different statuses. This localized, context-specific communication prevents confusion by making the meaning of each light unambiguous based on its position and pattern

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system uses color changes to convey different types of information: green for successful operations, red for errors or warnings, yellow for intermediate states. This color-coding system leverages human visual perception to create intuitive, easily distinguishable signals that override preconceived expectations about lighting

Inventive Principle:
Principle #32Color changes

3Device complexity

If simple lighting systems are used, then device complexity is reduced, but the system cannot convey detailed information about robotic actions and system state

Engineering Contradiction:
Improvelighting system simplicityVSAvoidsystem state information
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The patent uses periodic action by implementing flashing and pulsing patterns to encode different types of information. For example, a flashing red light may indicate a critical error requiring immediate attention, while a steady green light indicates normal operation. This temporal variation allows the simple lighting system to convey complex state information without adding physical complexity

Inventive Principle:
Principle #19Periodic action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The RGB LED lighting system enhances communication and collaboration between human workers and robots by providing clear and accessible information about robotic actions and system states, improving safety and efficiency in sortation tasks.

Implementation Method 1

The implementation of an RGB LED lighting system on shelves and an end effector, allowing for the conveyance of information through color and flashing modes

Methodology Applied
Scientific EffectLight Emitting Diode: Light Emitting Diode

Data Source

PatentEP3988263B1System and method for providing dynamic communicative lighting in a robotic environment
Publication Date: 2024.01.31 BERKSHIRE GREY OPERATING CO INC
  • EP3988263B1 patent drawingFigure 1
  • EP3988263B1 patent drawingFigure 2
  • EP3988263B1 patent drawingFigure 3

AI summary

A robotic system is disclosed that includes an articulated arm with an end effector. The robotic system comprises: a first plurality of lights provided in a ring proximate the end effector, said first plurality of lights being engageable in a grasp quality mode to indicate a grasp quality of the end effector's grasp on an object, and further being engageable in a movement mode to indicate a planned direction of movement of the end effector by illuminating one or more of the first plurality of lights that are on a side of the ring that is associated with the planned direction of movement of the end effector; and a second plurality of lights provided proximate a plurality of destination bins, each of the second plurality of lights being associated with one of the plurality of destination bins, said second plurality of lights being engageable in a destination bin mode to indicate a destination bin to which the end effector plans to move the object, said destination bin mode of the second plurality of lights being associated with the movement mode of the first plurality of lights, and the second plurality of lights being engageable in a bin complete mode to indicate that a particular destination bin is ready for removal.