Graphical interface control image recognition method and device for interface sketch
A graphic interface and image recognition technology, applied in graphic image conversion, detailed information related to the graphic user interface, image analysis, etc., can solve problems such as complex environment configuration
Active Publication Date: 2020-02-07
NANJING UNIV
View PDF4 Cites 6 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
However, this kind of drag-and-drop graphical interface generation platform often requires complex environment configuration, which is a heavyweight application background, and these behaviors not only have high requirements for the spatial scene of the graphical interface design, but also require users to have domain certain prior knowledge
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0057] The present invention will be described in further detail below in conjunction with the accompanying drawings.
[0058] As shown in Figure 1, the method for the graphical interface control image recognition of the interface sketch of the present embodiment includes two steps: the first step is a sketch preprocessing step, and the second step is a recursive processing step for the preprocessed sketch . The input of this method is the sketch of the graphical interface, and the output is the control layout tree.
[0059] The input GUI sketch is usually an image obtained by scanning the GUI sketch on paper by a scanner, or an image obtained by photographing paper or a whiteboard or blackboard by a camera. Whether it is an image scanned by a scanner or an image captured by a camera, those skilled in the art understand that usually a picture in JPG format contains a large amount of noise information and cannot be directly input to the second step for recursive processing, so...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention discloses a graphical interface control image recognition method and device for an interface sketch. The method comprises the following steps: preprocessing an input image; carrying outrecursive segmentation on a preprocessed image; identifying an edge rectangular frame for each segmented image; identifying a primitive identifier in the edge rectangular frame; recognizing various types of controls according to the control types corresponding to the primitive identifiers, determining the positions of the controls on the interface according to the positions of the edge rectangularframes, forming a control layout tree used for representing hierarchical layout between the controls in combination with the recursive hierarchical relationship, and therefore designers can conveniently conduct interface layout design.
Description
technical field [0001] The invention relates to the field of software graphical interface design, in particular to the conversion of graphical interface sketches into graphical user interfaces that can be applied to computer programs. Background technique [0002] In software development, graphical user interface is very important. A software with a rich and interactive user-friendly graphical interface is more likely to be accepted and favored by users. In the mobile application software or in the desktop desktop application software, the user-friendly graphical interface has stronger market competitiveness in the market. Designing a user-friendly graphical interface for software takes a lot of effort and resources. Although most of the current application software development platforms support the drag-and-drop graphical interface control platform, the WYSIWYG graphical interface generation platform. However, this kind of drag-and-drop graphical interface generation pla...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/11G06T7/181G06T7/90G06T3/40G06K9/62
CPCG06T7/11G06T7/181G06T7/90G06T3/40G06T2200/24G06F18/22Y02D10/00
Inventor 潘敏学张天解温特葛笑非
Owner NANJING UNIV