Interactive GUI Encapsulation via OS Object Transfer

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for sharing on-screen content from one computer application to another result in static screenshots, where graphical user interface (GUI) elements lose their interactive functionality, limiting collaboration and usability.

Innovation Solution

A system and method that captures and reproduces an on-screen GUI by creating an OS object containing information about the GUI elements, allowing these elements to remain functional when shared between applications, including the creation of sub-objects for each application within the capture area and packaging this information for transfer and reproduction on another computer system.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a screenshot is captured and shared to another application program, then the on-screen content can be shared and viewed, but the graphical user interface elements become static and lose their interactive functionality

Engineering Contradiction:
Improveinteractivity of GUI elementsVSAvoidusability of shared content
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent creates a live copy of the GUI elements rather than a static screenshot. The captured content is replicated as functional objects that maintain their interactive capabilities in the destination application, allowing users to interact with buttons, links, and other UI elements as if they were in the original application.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces an intermediary layer that translates GUI elements from the source application into functional representations in the destination application. This intermediary process preserves the interactive nature of elements by creating executable references rather than static images.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of manufacture

If traditional screenshot methods are used to share content between applications, then the capture process is simple, but the shared content cannot be interacted with in the second application

Engineering Contradiction:
Improvesimplicity of capture processVSAvoidfunctionality of shared content
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent makes the captured content universally functional across different application contexts. The GUI elements are transformed into adaptable objects that can be interacted with regardless of which application receives them, providing multi-functionality that works across different software environments.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

Instead of creating static image copies, the system creates functional copies of GUI elements that retain their interactive properties. This allows the simple capture process to produce content that remains fully operational in the destination application.

Inventive Principle:
Principle #26Copying

3Quantity of substance

If static bitmap images are used to represent captured content, then file size is small and transmission is fast, but user interaction with the content is limited

Engineering Contradiction:
Improvedata size of captured contentVSAvoidfunctional integrity of shared content
Core Design Contradiction:
Quantity of substanceVSReliability

Solution Approach 1:

The patent creates lightweight functional references rather than heavy binary copies of entire applications. The captured GUI elements are represented as compact objects that contain just enough information to restore interactivity, maintaining small data sizes while preserving functional integrity.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11036345B2System and method for on-screen graphical user interface encapsulation and reproduction
Publication Date: 2021.06.15 PRAG YUVAL
  • US11036345B2 patent drawing
  • US11036345B2 patent drawing
  • US11036345B2 patent drawing

AI summary

A system and method for capturing and reproducing an on-screen GUI displayed on a display device of a first computer system are described herein. According to one embodiment, a system call is invoked, and a capture area is selected. Based on the content of the capture area, display information and software information is encapsulated in an OS object. The OS object may be packaged into a file and transferred to a remote computer system for reproduction thereon or for reproduction on a second application program of the first computer system. When the content of the OS object is recreated on the remote computer system, a remote user is able to interact with the components of the reproduced on-screen GUI.