Immersive VR AR Interface for Quality Event Documentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing quality management systems face challenges in efficiently generating quality management events within operational environments, particularly in pharmaceutical research, manufacturing, and distribution processes, due to limitations in interface accessibility and data collection methods.

Innovation Solution

An immersive scene monitoring system that utilizes virtual reality (VR) or augmented reality (AR) to provide an interactive interface for generating quality management events. This system receives immersive scene configuration data, presents a monitoring interface based on real-time image data, and allows users to input quality management events using voice commands or gestures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional quality management interfaces are used, then system complexity is reduced, but ease of operation and accessibility in operational environments deteriorates

Engineering Contradiction:
Improveinterface accessibilityVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent transitions from traditional 2D flat interfaces to immersive 3D virtual reality and augmented reality environments. This dimensional change allows quality management events to be documented directly within the operational context, improving ease of operation by eliminating the need to switch between physical locations and traditional interfaces, while the structured framework maintains acceptable system complexity

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent introduces immersive technology (VR/AR) as an intermediary between operators and quality management systems. This intermediary layer provides intuitive spatial interfaces and automated object recognition that simplify interaction, improving ease of operation without requiring operators to understand underlying system complexity, as the intermediary handles complex processing automatically

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If manual data entry methods are used, then device complexity is reduced, but productivity and time efficiency deteriorates

Engineering Contradiction:
Improveevent generation efficiencyVSAvoiddata collection complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements automated object recognition and data population systems that automatically detect objects in the operational environment and populate quality management event fields without manual intervention. This self-service approach significantly improves productivity by eliminating repetitive manual data entry, while the automated systems handle the complexity of data collection and processing

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical data entry processes with automated optical and computational systems. Object recognition algorithms and automated data extraction replace hand-written forms and keyboard entry, improving productivity while the automated systems manage the complexity of capturing and processing data from the operational environment

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If traditional monitoring interfaces are used, then ease of operation is maintained, but measurement precision and event documentation accuracy deteriorates

Engineering Contradiction:
Improveevent documentation accuracyVSAvoidinterface accessibility
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent captures and stores configuration data from reference scenes before actual monitoring operations. This preliminary action creates a baseline for comparison and enables automated object recognition during event documentation, improving measurement precision by ensuring accurate reference data is available before field operations, while maintaining ease of operation through automated comparisons

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback mechanisms where captured image data is continuously compared against stored configuration data to verify event documentation accuracy. This feedback loop ensures high measurement precision by automatically detecting discrepancies and confirming event details, while the automated nature of the feedback maintains ease of operation without requiring manual verification

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12236579B2Apparatus, method, and computer program product for immersive quality management scene monitoring and event generation
Publication Date: 2025.02.25 HONEYWELL INTERNATIONAL INC
  • US12236579B2 patent drawing
  • US12236579B2 patent drawing
  • US12236579B2 patent drawing

AI summary

An immersive scene monitoring system presents a monitoring interface providing a virtual reality (VR)/augmented reality (AR) view of a scene associated with production operation(s) for a (e.g., pharmaceutical) product. The VR/AR view of the scene may be displayed with interactable graphical elements representing input fields corresponding to attributes of quality management events to be generated. The system generates the quality management events based on input (e.g., voice, gesture) received via the monitoring interface. The VR and/or AR view of the scene may be displayed with indicators of detected anomalies, and the input fields and/or corresponding attributes may be automatically populated by the system based on recognized objects and/or anomalies depicted in captured image data of the VR/AR view of the scene. The system can be configured for different scenes pertaining to different production operations and/or different products via a configuration interface.