Automated Coordinate Extraction from Dialogue Data for VR Training

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

The challenge is to automate instruction for tasks, especially when experts are scarce, and traditional methods struggle to efficiently gather and utilize data for training in virtual or mixed reality environments, where manual extraction of relevant coordinates from numerous data points is cumbersome and inefficient.

Innovation Solution

A processing device acquires images, coordinates, and dialog data from head-mounted displays used by task performers and instructors, extracts relevant coordinates based on dialog data, and associates them with tasks, generating training data for automated instruction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual extraction of relevant coordinates from numerous data points is performed, then accuracy of extracting relevant coordinates is improved, but time consumption and labor burden increase

Engineering Contradiction:

Improveaccuracy of extracting relevant coordinatesVSAvoidtime consumption for data preparation

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system automatically extracts relevant coordinates from dialogue data without requiring manual intervention. The processing device autonomously processes the data by extracting coordinates based on dialogue content, eliminating the need for manual data preparation while maintaining extraction accuracy.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical data extraction processes with automated computational processing. The processing device uses algorithms to automatically identify and extract relevant coordinates from dialogue data, substituting human manual labor with automated mechanical processing systems.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If automated instruction is implemented to save manpower, then productivity is improved, but data accumulation requirement increases

Engineering Contradiction:

Improveefficiency of instruction automationVSAvoidamount of training data required

Core Design Contradiction:

ProductivityVSQuantity of substance

Solution Approach 1:

The system extracts only the relevant coordinates from the dialogue data that are necessary for training automation. By selectively extracting relevant information rather than processing all data, the system reduces the quantity of data needed while maintaining the effectiveness of automated instruction.

Inventive Principle:

Principle #2Taking out (Extraction)

Solution Approach 2:

The patent focuses on extracting only the locally relevant coordinates from dialogue data rather than processing entire datasets uniformly. This selective extraction approach ensures that only necessary data is collected for training, reducing overall data accumulation requirements while maintaining training quality.

Inventive Principle:

Principle #3Local quality

3Quantity of substance

If numerous data points are collected from head-mounted displays, then completeness of task data is improved, but difficulty of detecting and measuring relevant information increases

Engineering Contradiction:

Improvecompleteness of task dataVSAvoiddifficulty of extracting relevant coordinates

Core Design Contradiction:

Quantity of substanceVSDifficulty of detecting and measuring

Solution Approach 1:

The system uses dialogue data as feedback to guide the extraction process. By analyzing dialogue content, the system dynamically identifies which coordinates are relevant, making the extraction process more accurate and easier despite the volume of collected data.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS20250094724A1Processing device, training device, processing system, processing method, and storage medium

Publication Date: 2025.03.20 KK TOSHIBA

AI summary

According to one embodiment, a processing device acquires an image, a coordinate, and dialog data communicated between a first device and a second device. The first device is used by a first person performing a task, and the second device is used by a second person. The processing device extracts at least one of a plurality of the coordinates based on the dialog data. The processing device associates the extracted at least one of the plurality of coordinates with the task.