Robotic Fleet Visual Handshakes for Precise Relative Positioning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Centralized control systems in robotic fleets often lack precision in navigating robotic devices for collaborative operations, leading to issues like misplaced packages and inefficient use of resources, as they struggle to achieve millimeter-level precision without being bolted to rails or using measured components.

Innovation Solution

Implementing a combination of centralized control systems with local vision capabilities, where robotic devices use visual handshakes and AR tags to establish precise relative positioning, allowing them to perform collaborative operations with higher accuracy and redundancy, even in dynamic environments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If centralized control systems are used to navigate robotic devices, then coordination between multiple robots is improved, but positioning precision deteriorates (cannot achieve millimeter-level precision without rails or measured components)

Engineering Contradiction:
Improvecoordination reliabilityVSAvoidpositioning precision
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The system divides positioning responsibilities into two segments: centralized control handles high-level coordination and path planning, while local vision systems on each robot handle precise relative positioning. This segmentation allows each subsystem to optimize for its specific function without the constraints of the other.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Visual markers (AR tags) serve as intermediaries between robots, enabling precise relative positioning through visual handshake. These markers act as a common reference frame that both robots can detect and use to calculate their relative positions with millimeter-level accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If visual handshakes with AR tags are implemented, then positioning precision is improved, but system complexity increases (requires additional vision hardware and processing)

Engineering Contradiction:
Improverelative positioning precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The vision system serves multiple functions: it detects AR tags for positioning, identifies other robots, and enables visual handshake for collaborative operations. This multi-functionality reduces the need for separate specialized components, offsetting the added complexity with operational efficiency.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

Each robotic device is equipped with its own vision system that autonomously performs positioning and identification tasks. The robots self-calibrate their relative positions through visual handshake without requiring external intervention or complex centralized coordination for each positioning event.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If robots are bolted to rails or use measured components, then positioning precision is improved, but adaptability deteriorates (cannot operate in dynamic environments)

Engineering Contradiction:
Improvepositioning precisionVSAvoidenvironmental adaptability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system replaces mechanical positioning constraints (rails, measured components) with optical/vision-based positioning. AR tags provide a virtual reference frame that robots can detect and use for precise positioning without physical guides, enabling operation in dynamic, unstructured environments.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The vision-based positioning system is inherently dynamic and adaptable. AR tags can be placed anywhere in the environment and dynamically repositioned, allowing the system to adapt to changing operational requirements and environmental conditions without reconfiguring physical infrastructure.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP4099111A1Position-controlled robotic fleet with visual handshakes
Publication Date: 2022.12.07 BOSTON DYNAMICS INC
  • EP4099111A1 patent drawingFigure 1A
  • EP4099111A1 patent drawingFigure 1B
  • EP4099111A1 patent drawingFigure 2A

AI summary

Example methods and systems may provide for a system that includes a control system communicatively coupled to a first robotic device and a second robotic device. The control system may identify a collaborative operation to be performed by a first robotic device and a second robotic device that is based on a relative positioning between the first robotic device and the second robotic device. The control system may also determine respective locations of the first robotic device and the second robotic device. The control system may further initiate a movement of the first robotic device along a path from the determined location of the first robotic device towards the determined location of the second robotic device. The first robotic device and the second robotic device may then establish a visual handshake that indicates the relative positioning between the first robotic device and the second robotic device for the collaborative operation.