Augmented Reality Code Execution Workflow Modification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Developers face challenges in dynamically altering code execution workflows during development without physically modifying the source code, especially in visualizing and testing changes to code execution flows.

Innovation Solution

The system uses augmented reality devices to allow users to virtually modify source code by adding or removing code blocks, generating an altered execution workflow, and executing it for testing, with the option to physically alter the source code based on user feedback.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If developers physically modify source code to test execution workflow changes, then the code can be executed with new logic, but the development process becomes time-consuming and requires repeated compilation and testing

Engineering Contradiction:
Improvedevelopment efficiencyVSAvoidtime for code modification and testing
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system performs preliminary actions by allowing developers to virtually modify code execution workflows in the AR environment before physically altering the source code. The execution workflow is generated and tested in virtual space first, so when physical modification is needed, the actual code changes are minimized and more precise.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates a virtual copy of the code execution workflow that can be modified and tested independently from the physical source code. This virtual execution workflow serves as a testbed for exploring different execution paths without affecting the original code, thereby reducing iterative modification cycles.

Inventive Principle:
Principle #26Copying

2Ease of operation

If developers use traditional IDEs to view and modify code execution flows, then code changes can be made, but visualizing the execution workflow becomes complex and less intuitive

Engineering Contradiction:
Improveease of visualizing execution workflowVSAvoidcomplexity of development tools
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system transitions the code execution workflow visualization from a two-dimensional text-based IDE interface to a three-dimensional immersive AR environment. This dimensional change allows developers to spatially navigate and visualize execution flows more intuitively, making complex workflow relationships easier to understand.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The AR system acts as an intermediary layer between the developer and the physical source code. It provides a simplified virtual interface for viewing and modifying execution workflows, translating complex code logic into visual representations that are easier to comprehend and manipulate.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If developers test code changes by physically modifying and recompiling source code, then functional testing can be performed, but the iteration cycle becomes longer

Engineering Contradiction:
Improvetesting accuracyVSAvoiditeration cycle time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary testing in the virtual AR environment by generating and executing the virtual execution workflow before physical code modification. This allows developers to validate logic changes and identify issues early, ensuring that when physical modification occurs, the changes are more likely to be correct on the first attempt.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system provides immediate feedback in the AR environment when the virtual execution workflow is executed, allowing developers to observe the results of their modifications instantly. This rapid feedback loop enables quicker iteration and refinement of code logic without waiting for physical compilation and testing cycles.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11880668B2Dynamically altering a code execution workflow during development using augmented reality
Publication Date: 2024.01.23 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11880668B2 patent drawing
  • US11880668B2 patent drawing
  • US11880668B2 patent drawing

AI summary

A computer-implemented method, a computer program product, and a computer system for dynamically altering a code execution workflow using augmented reality (AR). A computer receives, from an AR device of a user, virtual modification of a source code, where the user virtually alters the source code on the augmented realty device. A computer generates an altered execution workflow, based on a virtually altered source code created in the virtual modification. A computer overlays the altered execution workflow on the AR device. A computer executes the altered execution workflow, in response to receiving from the AR device a user request for testing the virtually altered source code. A computer displays on the augmented realty device a result of executing the altered execution workflow. A computer physically alters the source code according to the virtually altered source code, in response to receiving from the AR device satisfactory user feedback about the result.