3D Visual Programming Interface for Smart Object Networks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional two-dimensional interface environments fail to effectively manage and visualize the spatial relationships and logical connections between smart objects in a networked environment, making it difficult for users with limited programming skills to program, debug, and understand the operations of connected devices.

Innovation Solution

A three-dimensional visual programming interface that displays a virtual environment representing real-world objects, allowing users to create and modify logic nodes and links between them, enabling easy programming and data flow visualization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If conventional two-dimensional interface environments are used, then device complexity is reduced, but the ability to visualize spatial relationships and logical connections between smart objects deteriorates

Engineering Contradiction:
Improveinterface complexityVSAvoidspatial relationship information
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The patent transitions from a two-dimensional interface to a three-dimensional virtual environment that mirrors the physical spatial arrangement of smart objects. This dimensional expansion allows users to visualize both spatial relationships and logical connections simultaneously, resolving the contradiction by adding visual information capacity without increasing operational complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If conventional two-dimensional interface environments are used, then ease of operation is maintained, but the ability to understand and debug logical connections between objects deteriorates

Engineering Contradiction:
Improveprogramming easeVSAvoiddebugging difficulty
Core Design Contradiction:
Ease of operationVSDifficulty of detecting and measuring

Solution Approach 1:

The system creates a virtual copy of the physical smart object network in three-dimensional space, preserving both spatial relationships and logical connections. This virtual replica enables intuitive programming through drag-and-drop operations while simultaneously providing comprehensive debugging capabilities by visually displaying data flow and object interactions without adding operational complexity.

Inventive Principle:
Principle #26Copying

3Device complexity

If conventional two-dimensional interface environments are used, then device complexity is reduced, but the ability to visualize data connections between objects deteriorates

Engineering Contradiction:
Improveinterface complexityVSAvoiddata connection information
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The three-dimensional virtual environment utilizes the additional spatial dimension to simultaneously display both physical object arrangements and logical data connections. Connection lines and data flow visualizations can be rendered in 3D space without obscuring the underlying spatial relationships, enabling comprehensive visualization of the entire smart object network architecture.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11809678B2Three dimensional visual programming interface for a network of devices
Publication Date: 2023.11.07 AUTODESK INC
  • US11809678B2 patent drawing
  • US11809678B2 patent drawing
  • US11809678B2 patent drawing

AI summary

Approaches for generating virtual representations of smart objects in a 3D visual programming interface. The interface displays a 3D virtual environment containing virtual objects that represents a real-world environment containing smart objects. The 3D virtual environment displays virtual objects in a manner that is spatially accurate relative to the physical objects in the real-world environment. For each virtual object representing a physical object, a logic node (port node) is displayed, the port node representing the set of functions associated with the physical object. The interface enables users to create, delete, or modify different types of logic nodes (representing functions) and create, delete, or modify links (representing data connections) between logic nodes within the 3D virtual environment. The authoring of the logic nodes and links produces an executable program. Upon executing the program, data flows between the logic nodes are visually represented as particles moving between the logic nodes.