Code Retrieval via Screenshot Trigger Controls

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Developers face low efficiency and high professional requirements when manually locating and obtaining code for UI controls in application software, due to the complexity and variability of code writing habits among developers.

Innovation Solution

A method and apparatus that display a screenshot interface of a target application software with triggerable controls, allowing users to interactively select and view the corresponding code information in a separate display area, improving code location and retrieval efficiency through interface interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If developers manually locate and obtain code for UI controls, then they can access the required code information, but the process requires high professional requirements and results in low efficiency

Engineering Contradiction:

Improvecode retrieval efficiencyVSAvoidprofessional requirements for developers

Core Design Contradiction:

ProductivityVSEase of operation

Solution Approach 1:

The patent introduces an intermediary system that automatically analyzes UI control screenshots and extracts corresponding code information. This intermediary bridges the gap between the visual interface and the underlying code, eliminating the need for developers to manually search through codebases. The system acts as a mediator that translates visual elements into their corresponding code representations, thereby improving efficiency while reducing professional requirements.

Inventive Principle:

Principle #24Intermediary (Mediator)

Solution Approach 2:

The system enables self-service by allowing developers to simply upload or capture UI control screenshots without needing to understand the underlying code structure. The automated analysis and code extraction processes run independently, providing code information without requiring developer intervention in the complex code-searching process. This self-service approach democratizes code access for developers regardless of their expertise level.

Inventive Principle:

Principle #25Self-service

2Loss of time

If developers manually search through code to locate UI control information, then they can obtain the required code, but the process consumes excessive time and reduces工作效率

Engineering Contradiction:

Improvetime for code locationVSAvoiddeveloper工作效率

Core Design Contradiction:

Loss of timeVSProductivity

Solution Approach 1:

The system performs preliminary action by pre-analyzing and indexing UI control screenshots along with their corresponding code information. When a developer needs code for a specific UI control, the system has already prepared the mapping relationships in advance, enabling instant retrieval without time-consuming manual searches. This preliminary preparation significantly reduces the time loss associated with code location.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent replaces the mechanical manual searching process with an automated computer vision and code analysis system. Instead of developers manually navigating through codebases and searching for UI control implementations, the system uses automated algorithms to analyze screenshots, identify controls, and extract corresponding code. This substitution eliminates the time-consuming manual labor while maintaining or improving accuracy.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If the code structure is complex with variable writing habits among developers, then different coding styles exist, but this increases the difficulty of manual code location and obtaining

Engineering Contradiction:

Improvecode writing habit variabilityVSAvoiddifficulty of code location

Core Design Contradiction:

Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The system adapts to different code writing habits by dynamically adjusting its analysis parameters and patterns. Instead of requiring a uniform code structure, the system can modify its search and recognition algorithms to accommodate various coding styles, indentation formats, and naming conventions. This parameter flexibility allows the system to handle diverse codebases without increasing the difficulty of code location.

Inventive Principle:

Principle #35Parameter changes

Solution Approach 2:

The patent creates a universal system that can handle multiple coding styles and conventions simultaneously. The code analysis engine is designed to be multi-functional, recognizing various UI control implementations regardless of the specific coding patterns used. This universality allows the system to adapt to different developer habits and code structures without requiring manual configuration or reducing code location difficulty.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Data Source

PatentUS20240296056A1Method, apparatus, device, computer-readable storage medium and product for displaying code

Publication Date: 2024.09.05 BEIJING ZITIAO NETWORK TECH CO LTD

AI summary

Embodiments of the disclosure provide a method, apparatus, device, computer-readable storage medium and product for displaying code. The method includes: displaying, in a preset first display area, a screenshot interface of current display content of a target application software to be analyzed, and displaying at least one triggerable control in the screenshot interface; and in response to a triggering on a target triggerable control, displaying, in a preset second display area, code information corresponding to the triggered target triggerable control.