AR Simulation Device for Machine Tool Virtual Object Synchronization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality technologies face challenges in performing machining simulation on machine tools due to difficulties in identifying and tracking markers on movable parts, leading to incorrect movement and rotation of virtual objects, and requiring the creation of complex virtual 3D models of entire machine tools.

Innovation Solution

An augmented reality simulation device and program that acquires relation information between virtual objects and control axes, converts movement data from the machine tool's coordinate system to a display coordinate system, and calculates the display position and angle of virtual objects, allowing them to be accurately synchronized with the machine tool's operations without needing to create a full virtual model of the machine tool.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a marker is disposed on a movable part of a machine tool to enable tracking, then the virtual object can be displayed on the real machine tool, but the marker becomes unidentifiable when the movable part moves or rotates, causing the virtual object to fail to follow the movement correctly

Engineering Contradiction:
Improvemarker identification reliabilityVSAvoidviewpoint flexibility
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent introduces a coordinate system conversion mechanism as an intermediary between the marker coordinate system and the display coordinate system. The conversion unit transforms coordinates from the marker-based system to the display system, enabling the virtual object to follow movable parts accurately even when markers become unidentifiable, thus resolving the contradiction between marker reliability and viewpoint flexibility

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a virtual copy of the machine tool's coordinate system and movement characteristics. By replicating the control axis coordinate system settings and relationships in the virtual environment, the system can accurately track and display virtual objects on movable parts without relying solely on continuous marker identification, thereby maintaining both reliability and adaptability

Inventive Principle:
Principle #26Copying

2Ease of manufacture

If the entire machine tool is realized as a virtual 3D object to perform machining simulation, then the simulation can be performed on a personal computer, but it requires creating virtual 3D objects of the entire machine and implementing operation processing features, making it not easy to create

Engineering Contradiction:
Improvevirtual model creation easeVSAvoidvirtual 3D object creation complexity
Core Design Contradiction:
Ease of manufactureVSDevice complexity

Solution Approach 1:

The patent extracts only the essential elements needed for machining simulation - specifically the control axis coordinate systems and their relationships - from the complete machine tool model. By focusing on these critical components rather than creating full virtual 3D models of entire machines, the system achieves simulation capability while significantly reducing model creation complexity

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent creates a universal coordinate system framework that can be applied across different machine tool types. By establishing a standardized approach to representing control axis relationships that works for various machine configurations, the system enables easy creation of virtual models for different machines without requiring complex custom 3D modeling for each specific machine type

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If a camera is fixed to a predetermined direction to capture images for virtual object display, then the virtual object can be displayed on the captured image, but it becomes difficult to change the viewpoint from which the machining simulation state is ascertained

Engineering Contradiction:
Improvevirtual object display accuracyVSAvoidviewpoint changeability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent implements a dynamic coordinate system transformation mechanism that allows the display viewpoint to change flexibly. By converting coordinates from the fixed marker system to a display coordinate system that can be oriented in different directions, the system maintains accurate virtual object placement while enabling viewpoint changes, thus resolving the contradiction between display accuracy and viewpoint adaptability

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS10424122B2Augmented reality simulation device which displays a virtual object on a machine tool and computer-readable medium
Publication Date: 2019.09.24 FANUC LTD
  • US10424122B2 patent drawing
  • US10424122B2 patent drawing
  • US10424122B2 patent drawing

AI summary

An augmented reality simulation device includes: extension information display means for displaying a virtual object; relation information acquisition means for acquiring first relation information which is information that specifies relation between the virtual object and control axes of a numerical controller and second relation information which is information that specifies settings of the control axes and relation between the control axes; conversion means for converting a movement amount in a first coordinate system which is a coordinate system of the control axis to movement information in a second coordinate system which is a coordinate system for allowing the extension information display means to display the virtual object on the basis of the first relation information and the second relation information; and calculation means for calculating a display position and a display angle of the virtual object based on the movement information in the second coordinate system after the conversion.