HMD Augmented Reality Marker Detection for 3D Printing Progress

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current head-mounted displays (HMDs) lack the ability to adaptively update augmented reality images in real-time during the 3D printing process, failing to provide users with an accurate and dynamic visualization of the printing progress and output shape.

Innovation Solution

A head-mounted display (HMD) system that includes a camera unit to detect both the 3D printer and the printed object as markers, allowing it to display an initial augmented reality image before printing and updating it in real-time as the object is produced, seamlessly integrating the virtual and real-world views.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the HMD displays a static augmented reality image before printing, then the user can see the expected output shape, but the image does not update in real-time during the printing process

Engineering Contradiction:
Improveprinting progress informationVSAvoidreal-time detection and update system
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system pre-detects and stores the 3D printer's position and the expected output shape before printing begins. This preliminary detection allows the HMD to display the expected output shape in advance, and then simply update this pre-prepared information in real-time during printing without requiring complex real-time analysis

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates a virtual copy (augmented reality image) of the expected 3D printed object and displays it through the HMD. This virtual copy is then updated in real-time by overlaying it with detection results from the camera unit, allowing users to see both the expected outcome and actual progress without requiring complete system re-detection

Inventive Principle:
Principle #26Copying

2Productivity

If the HMD uses a camera unit to detect the 3D printer and update images in real-time, then printing progress can be visualized dynamically, but the system complexity and processing requirements increase

Engineering Contradiction:
Improvereal-time printing monitoring efficiencyVSAvoidmarker detection and image update system
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system performs preliminary detection of the 3D printer's position and characteristics before the printing process starts. This pre-detection data is stored and used as a reference during printing, allowing the real-time monitoring to focus only on detecting changes from this baseline rather than analyzing the entire system continuously

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The camera unit serves multiple functions: it detects the 3D printer's position, tracks the printing process, and provides real-time feedback for updating the augmented reality image. By making the camera unit multi-functional, the system reduces the need for separate detection devices and simplifies the overall system architecture

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP3063587B1Apparatus and method for head mounted display indicating process of 3D printing
Publication Date: 2019.04.24 LG ELECTRONICS INC
  • EP3063587B1 patent drawingFigure 1
  • EP3063587B1 patent drawingFigure 2
  • EP3063587B1 patent drawingFigure 3

AI summary

A method for controlling a head mount display (HMD) according to one embodiment comprises the steps of detecting a 3D printer as a first marker through a camera unit; displaying a first augmented reality image of a shape of a 3D object on the basis of the detected first marker before the 3D object is output by the 3D printer; detecting the 3D object, which is output from the 3D printer, as a second marker if the 3D printer starts to output the 3D object; updating the first augmented reality image to a second augmented reality image on the basis of the first marker and the second marker; and displaying the second augmented reality image.