Display-Guided Robotic Navigation for Millimeter-Accurate 3D Printing

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Mobile robotic systems face challenges in achieving millimeter-level positioning accuracy for large-scale additive manufacturing without complex and costly camera-based localization systems, and there is a need for a cost-effective and easy-to-deploy localization and control system that minimizes vibration during movement.

Innovation Solution

A display guided robotic navigation and motion control system using a display device to project visual patterns, an optical sensor, and a machine learning-based computing system to calibrate and control the robotic system, enabling millimeter-level precision without manual calibration processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If camera-based precise localization systems (e.g., Vicon) are used to achieve millimeter-level positioning accuracy, then positioning precision is improved, but system cost and setup complexity increase

Engineering Contradiction:

Improvepositioning accuracyVSAvoidsystem complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces expensive, complex camera-based localization systems with a simple projector displaying visual patterns (e.g., AprilTags). These visual markers are computationally generated and displayed on any flat surface, eliminating the need for costly hardware infrastructure while maintaining sufficient positioning accuracy for mobile 3D printing applications.

Inventive Principle:

Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The patent substitutes mechanical/optical measurement systems (camera-based localization) with a computational vision system. The robotic device uses its onboard camera to capture images of projected visual patterns, and computer vision algorithms process these images to determine position and orientation, replacing the need for complex external localization infrastructure.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If manual calibration processes are implemented to ensure printing accuracy, then manufacturing precision is improved, but ease of operation deteriorates

Engineering Contradiction:

Improveprinting accuracyVSAvoiddeployment simplicity

Core Design Contradiction:

Manufacturing precisionVSEase of operation

Solution Approach 1:

The patent implements self-calibration through visual servoing, where the robotic device automatically adjusts its positioning based on real-time feedback from the projected visual patterns. The system performs its own calibration by detecting the position and orientation of AprilTags in the camera feed and computing corrections, eliminating the need for manual calibration procedures.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent employs visual servoing with continuous feedback loops. The onboard camera captures images of the projected visual patterns, the system computes the deviation from the desired position, and adjusts the robotic device's movement accordingly. This closed-loop feedback mechanism ensures printing accuracy without requiring manual intervention for calibration.

Inventive Principle:

Principle #23Feedback

3Productivity

If mobile robotic devices are used to enable large-scale additive manufacturing, then productivity is improved, but positioning accuracy deteriorates

Engineering Contradiction:

Improvemanufacturing scaleVSAvoidpositioning accuracy

Core Design Contradiction:

ProductivityVSMeasurement precision

Solution Approach 1:

The patent introduces visual markers (AprilTags) as intermediaries between the mobile robotic device and the printing surface. These projected patterns serve as reference frames that the onboard camera can detect and use to compute the device's position and orientation with high precision, enabling accurate large-scale printing without requiring expensive external localization systems.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent projects visual patterns onto the 2D printing surface, creating a reference framework that the robotic device can detect from its 3D position. By using computer vision to interpret the 2D image of the projected patterns and compute 3D position and orientation, the system achieves high positioning accuracy for mobile large-scale printing.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system achieves millimeter-level positioning accuracy for mobile 3D printing with reduced setup complexity and cost, allowing for efficient large-scale additive manufacturing and collaborative printing.

Implementation Method 1

an optical sensor attached to the mobile robotic device... recording via the optical sensor an initial image displayed

Methodology Applied

Scientific EffectOptical detection: Photoelectric Effect

Data Source

PatentUS12384115B2Display guided high-accuracy robotic navigation and motion control system and methods

Publication Date: 2025.08.12 NEW YORK UNIV

AI summary

A display guided robotic navigation and control system comprises a display system including a display surface and a display device configured to display an image including a visual pattern onto the display surface, a robotic system including a mobile robotic device and an optical sensor attached to the mobile robotic device, and a computing system communicatively connected to the display system and the robotic system. Related methods are also disclosed.