Remote Collaboration via 3D Model Visualization and Sensor Data Integration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional remote collaboration systems are limited in real-time interactive capabilities, often restricting communication to audio comments during video conferencing and limited to viewing a single user's location, lacking comprehensive multi-modal interactions.

Innovation Solution

A remote collaboration framework that includes a system framework supporting real-time data capture, management of a database asset model, and multi-modal communications, enabling remote experts to collaborate through a shared virtual workspace with features like 3D visualization, augmented reality, and sensor data integration, allowing for real-time interaction and annotation of physical assets.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional video conferencing systems are used for remote collaboration, then communication between distant parties is enabled, but the interaction scope and level are limited to audio comments and viewing a single user's location

Engineering Contradiction:
Improveinteraction scopeVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines multiple communication modalities (video, audio, 3D visualization, AR overlays, sensor data integration) into a unified remote collaboration platform. This merging enables comprehensive interactions including real-time 3D model visualization, multi-user spatial positioning, and collaborative annotation, thereby expanding interaction scope beyond traditional video conferencing while managing system complexity through integrated architecture.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The remote collaboration system is designed to perform multiple functions simultaneously: video conferencing, 3D model rendering, augmented reality display, sensor data processing, and collaborative annotation. This multi-functionality allows a single system to address diverse collaboration needs, improving adaptability without requiring separate specialized systems for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If real-time multi-modal communications and 3D visualization are implemented, then comprehensive remote collaboration is enabled, but system complexity increases

Engineering Contradiction:
Improvecollaboration capabilityVSAvoidframework complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the complex remote collaboration system into distinct functional modules: a communication module for multi-modal data exchange, a 3D visualization module for rendering models, an AR module for overlay display, and a coordination module for managing multiple users. This segmentation allows each module to be developed and optimized independently, managing overall system complexity while maintaining comprehensive collaboration capabilities.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces intermediary components such as a shared virtual workspace that mediates between multiple users and the system resources. This virtual workspace acts as an intermediary layer that coordinates 3D model visualization, manages user positions, and facilitates collaborative interactions, thereby reducing the complexity burden on individual user devices and simplifying the overall system architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP3631712B1Remote collaboration based on multi-modal communications and 3D model visualization in a shared virtual workspace
Publication Date: 2023.05.31 GENERAL ELECTRIC TECH GMBH
  • EP3631712B1 patent drawingFigure 1
  • EP3631712B1 patent drawingFigure 2
  • EP3631712B1 patent drawingFigure 3

AI summary

A system, computer-readable medium, and a method including receiving, by a processor, sensor data related to a physical asset; obtaining, by the processor, at least a stored model of the physical asset from a data storage device; generating, by the processor, a visualization representation of the physical asset based on an integration of the sensor data related to the physical asset and the stored model of the physical asset; and presenting, by the processor in a shared virtual workspace accessible by a first user entity and at least one second user entity located remotely from the first user entity, the virtualization representation of the physical asset.