Patents
Literature
Hiro is an intelligent assistant for R&D personnel, combined with Patent DNA, to facilitate innovative research.
Hiro

36 results about "Sketch recognition" patented technology

Sketch recognition is the automated recognition of hand-drawn diagrams by a computer. Research in sketch recognition lies at the crossroads of Artificial Intelligence and Human Computer Interaction. Recognition algorithms usually are gesture-based, appearance-based, geometry-based, or a combination thereof.

Method and device for identifying and editing freehand sketch

The invention discloses a method for identifying a freehand sketch. The method comprises the steps of acquiring a current processing track inputted by a user, and carrying out preprocessing on the current processing track; detecting valid angular points according to a preprocessing result; segmenting the preprocessing result by utilizing the valid angular points, carrying out curve fitting on each section of track, and identifying a geometric shape of the current track according to all fitting results; storing the processing result of the current processing track as at least one geometry. The invention also discloses a method for editing the freehand sketch as well as a device for identifying and editing the freehand sketch.
Owner:BEIJING SAMSUNG TELECOM R&D CENT +1

Method for creating three-dimensional surface model by using perspective sketch

The invention discloses a method for creating a three-dimensional surface model by using a perspective sketch. The method comprises the following steps of: identifying and processing a hand-drawn sketch into a vertex-edge graph consisting of contour sides and articulation points, and identifying closed areas; identifying the symmetric relation of the three-dimensional surface model, and completing hidden contours for the contours according to symmetry and visibility; establishing an object coordinate system of the surface model according to a symmetrical relation, calculating three-dimensional coordinates of the contour sides and the articulation points of the surface model, and recovering the coordinates of three-dimensional space curves among the articulation points according to curve projection between the three-dimensional coordinates of the articulation points and the articulation points; categorizing the three-dimensional closed areas of the model into different closed area pieces according to the characteristics of a level modeling method and a B-spline surface fitting method; and modeling the closed area pieces into sub-surfaces according to the characteristics of the closed area pieces by the level modeling method or the B-spline surface fitting method and jointing the sub-surfaces into a three-dimensional model through dispersing, blending and splicing.
Owner:NANJING UNIV

Synthetic data generation of time series data

A method of generating synthetic data from time series data, such as from handwritten characters, words, sentences, mathematics, and sketches that are drawn with a stylus on an interactive display or with a finger on a touch device. This computationally efficient method is able to generate realistic variations of a given sample. In a handwriting or sketch recognition context, synthetic data is generated from real data in order to train recognizers and thus improve recognition accuracy when only a limited number of samples are available. Similarly, synthetic data can also be used to test and validate such recognizers. Also discussed is a dynamic time warping based approach for both segmented and continuous data that is designed to be a robust, go-to method for gesture recognition across a variety of modalities using only limited training samples.
Owner:UNIV OF CENT FLORIDA RES FOUND INC

String-kernel-based hand-drawn sketch recognition method

The invention discloses a support-vector-machine-based kernel matrix approximating method. The method comprises the following steps of: firstly, mapping a hand-drawn sketch into a feature string on the basis of a region-filling concept; secondly, training a training sample by using a support vector machine (SVM) on the basis of a string kernel to obtain a classifier; and finally, classifying and recognizing the sketch to be recognized by using the classifier obtained through training, and mapping the blurred and irregular hand-drawn sketch into a precise geometrical shape. Compared with the prior art, the method has the advantages that: the method is unrelated to the position, the size and the drawing way of the sketch and a user is allowed to draw the sketch in an individual habitual way; and by the string-kernel-based hand-drawn sketch recognition method, the recognition accuracy is relatively high and the method is easy to implement.
Owner:TIANJIN UNIV

Sketch recognition and enhancement

A drawing assistance system enhances a sketch drawn by a user in an electrical document on a computer system by collecting stroke data from one or more strokes of a sketch as a user draws the sketch. The stroke data includes time-based information and features of each stroke. The strokes are handled based on the time-based information, and analysed based on the strokes handled based on the time-based information. The sketch is enhanced based on results of the analysis.
Owner:COREL CORP

Sketch completion and recognition method and device based on generative adversarial network

ActiveCN110147797AImprove the effect of completionImprove completionImage enhancementImage analysisTablet computerWhiteboard
The invention discloses a sketch completion and recognition method and device based on a generative adversarial network. The sketch completion and recognition method comprises the following steps: (1)based on a conditional generative adversarial neural network, improving the generative adversarial neural network by utilizing a cascading strategy according to the characteristic that a sketch is sparse relative to semantic information of a color picture; (2) expanding the category universality of the sketch completion network, setting a sketch recognition task as an auxiliary task, and adding asketch recognition auxiliary network in the network structure; (3) applying the sketch completion method to the recognition task of the incomplete sketch, the image retrieval task based on the incomplete sketch and the sketch scene editing task; and (6) integrating the sketch completion method to form a sketch completion application platform, supporting application functions of interactive sketchcompletion, sketch completion and identification, sketch scene segmentation and completion, interactive sketch completion assistance and the like, and being capable of being applied to various devices and terminals such as a PC, a mobile phone, a tablet personal computer and an electronic whiteboard.
Owner:INST OF SOFTWARE - CHINESE ACAD OF SCI

Method and system for identifying representative trends using sketches

A method and system for identifying representative data trends using sketches. A sketch is a lower dimensional vector used to represent higher dimensional data. The properties of sketches include data dimensionality reduction, sketches synthesized from other sketches, and the distance between sketches comparable to the distance between the data the sketches represent. Exemplary embodiments include identifying relaxed periods and average trends.
Owner:AT&T INTPROP II L P

System and Method for Interactive Sketch Recognition Based on Geometric Contraints

The present invention discloses a system and method to recognize the geometric primitives and estimate the intended geometric relationship between the primitives. The system also provides its user an interactive feedback mechanism to better provide the graphic results intended by the user. The areas enclosed by the lines drew by the user is also considered by the system in the graphic result calculation process to improve the graphic results. One main feature of the present system is to provide geometric constraints estimations based on calculation of the constraints' effect on all related primitives and previously existing geometric constraints.
Owner:NG WILLIAM

Clothing sketch input cloth material identification simulation method based on deep learning

The invention relates to a clothes sketch input cloth material identification simulation method based on deep learning, and the method comprises the steps: obtaining a clothes sketch as a training image, and obtaining a preprocessed clothes sketch image and a corresponding cloth material image through data filtering; adopting a hand-drawn sketch identification method fusing a convolutional neuralnetwork and a Fisher vector to train a collected clothing sketch; inputting the obtained preprocessed clothing sketch image serving as training data into a convolutional neural network and Fisher vector hand-drawn sketch recognition method to obtain a clothing sketch image classification result of the cloth material image; after an obtained clothing sketch image classification result is obtained,selecting the closest real cloth according to a cloth matching algorithm to perform simulation; according to the method, the corresponding real cloth material is obtained in a simple sketch mode, andthe dynamic effect of the material cloth matched with the sketch after human body try-on is simulated in a three-dimensional mode.
Owner:CAPITAL NORMAL UNIVERSITY

A sketch recognition method and an application of the method in commodity retrieval

The invention discloses a sketch recognition method, which comprises the following steps of S1, obtaining pictures to be processed; S2, segmenting the collected picture into parts with semantic information to obtain a part diagram of the sketch; S3, obtaining the label of the component through identifying the component diagram by using the depth learning network model; S4, associating the semanticinformation of the component with the semantic information of the object to which the component belongs; S5, outputting the label of the object to which the part belongs obtained through the semantictree. The application of the method in commodity retrieval is characterizd by comprising the following steps of 1) obtaining picture information; 2) using a retrieval system to utilize the sketch recognition method to obtain the label of the article that the user wants to find according to the picture; 3) recommending the corresponding commodity for the user according to the identified label. Themethod and the application of the invention improve the correct rate of the identification of the complete sketch, save the time for the user to select the commodity, and enhance the user experience.
Owner:ANHUI UNIVERSITY

Machine room sketch identification method and device based on legend library

The invention provides a machine room sketch identification method and device based on a legend library, and the method is characterized in that the method comprises the following steps: formulating asketch drawing standard, building a standard legend library, and carrying out the regularization constraint of the drawing of a machine room sketch; obtaining sketch data; performing hierarchical segmentation on the whole image in the machine room sketch to obtain a component diagram of the machine room sketch; performing matching identification by utilizing a standard legend library so as to realize detection and identification of the machine room sketch components; carrying out reasonable position constraint on the machine room sketch component; and performing parameterized output of results. The machine room sketch recognition method and device based on the legend library have the advantages that the standard graph recognition result matched with the input sketch can be output quicklyand accurately in real time, therefore a more visual reference basis is provided for designers to conduct quick design after the designers combine a sketch exploration report.
Owner:山东文多网络科技有限公司

Graphical interface test case generation method based on hand drawing recognition

ActiveCN106095679ASolve the trouble of repeatedly executing "test-return-test"Reduce lossesSoftware testing/debuggingGeneration processPersonal computer
The invention provides a graphical interface test case generation method based on hand drawing recognition. According to the method, for the problems that in existing graphical interface test case generation, the manual test cost and the script test difficulty are too high, the test case generation process is assisted through a hand-drawn sketch recognition technique, and therefore graphical interface interaction tests of mobile equipment software and personal computer software are easier, more convenient and more efficient to operate.
Owner:NANJING UNIV

Road traffic accident field sketch recognizing and drawing method

The invention belongs to the technical field of road traffic accident handling, and particularly relates to a road traffic accident field sketch recognizing and drawing method. The method includes the following steps of A, drawing a field record sketch based on the road surface form and related accident elements of an accident field by bare hand through an electronic sketch obtaining device; B, recognizing a track input by a user each time through a track recognizing module, and completing the recognition of the road contour and the road elements; C, completing the recognition of the traffic accident field record sketch through a road overall form recognizing module and a road recognizing preview module; D, completing the drawing of a road traffic accident field scale drawing according to a recognition result through the combination of a legend system and an auxiliary system. The bottleneck problems that an existing conventional traffic accident field handling method is low in efficiency and precision and poor in standardability can be solved.
Owner:SHENYANG TIANZE INTELLIGENT TRAFFIC ENG CO LTD

System, method and computer-readable medium for providing pattern matching

A system, method and computer-readable medium are disclosed for identifying representative data using sketches. The method embodiment comprises generating a plurality of vectors from a data set, modifying each of the vectors of the plurality of vectors and selecting one of the plurality of generated vectors according to a comparison of a summed distance between a modified vector associated with the selected generated vector and remaining modified vectors. Modifying the generated vectors may involve reduced each generated vector to a lower dimensional vector. The summed distance then represents a summed distance between the lower dimensional vector and remaining lower dimensional vectors.
Owner:AT&T INTPROP II L P

Sketch semantic recognition method and system for on-line capture of design intent

The invention proposes a sketch semantic recognition method and a sketch semantic recognition system for on-line capture of design intent. The method comprises the following steps of: building a relation model between sketch drawing rule and the design intent; drawing a sketch; and performing sketch semantic recognition on the sketch according to the relation model between the sketch drawing rule and the design intent to acquire a design chart matched with the sketch. According to the method, better recognition results can be obtained from the sketches drawn by users of different design thinking and drawing habits, and the method has the advantages of low computation complexity and high recognition rate.
Owner:TSINGHUA UNIV

Freehand sketch recognition method based on attention mechanism

The invention discloses a freehand sketch recognition method based on an attention mechanism, and the method comprises the steps: inputting an original freehand sketch into a deep convolution neural network, and obtaining a feature map outputted by a last convolution layer; inputting the feature map into a channel attention module to obtain a feature map based on channel attention optimization; training a classification network used for predicting the vertical overturn of the freehand sketch, and inputting the original freehand sketch into the trained classification network to obtain a vertical overturn space attention graph; combining the feature map based on the channel attention optimization and the vertical overturning space attention map, and calculating to obtain a feature map basedon the vertical overturning space attention optimization; and finally, outputting an identification result through the full connection layer. The method has the advantages that channel attention and vertical overturn space attention are adopted to optimize the characteristics of the convolutional neural network, so that the network can pay attention to learning of a part with higher discrimination, and therefore, the recognition precision of the freehand sketch can be effectively improved.
Owner:ZHEJIANG LAB

String-kernel-based hand-drawn sketch recognition method

The invention discloses a support-vector-machine-based kernel matrix approximating method. The method comprises the following steps of: firstly, mapping a hand-drawn sketch into a feature string on the basis of a region-filling concept; secondly, training a training sample by using a support vector machine (SVM) on the basis of a string kernel to obtain a classifier; and finally, classifying and recognizing the sketch to be recognized by using the classifier obtained through training, and mapping the blurred and irregular hand-drawn sketch into a precise geometrical shape. Compared with the prior art, the method has the advantages that: the method is unrelated to the position, the size and the drawing way of the sketch and a user is allowed to draw the sketch in an individual habitual way; and by the string-kernel-based hand-drawn sketch recognition method, the recognition accuracy is relatively high and the method is easy to implement.
Owner:TIANJIN UNIV

Synthetic data generation of time series data

A method of generating synthetic data from time series data, such as from handwritten characters, words, sentences, mathematics, and sketches that are drawn with a stylus on an interactive display or with a finger on a touch device. This computationally efficient method is able to generate realistic variations of a given sample. In a handwriting or sketch recognition context, synthetic data is generated from real data in order to train recognizers and thus improve recognition accuracy when only a limited number of samples are available. Similarly, synthetic data can also be used to test and validate such recognizers. Also discussed is a dynamic time warping based approach for both segmented and continuous data that is designed to be a robust, go-to method for gesture recognition across a variety of modalities using only limited training samples.
Owner:UNIV OF CENT FLORIDA RES FOUND INC

Sketch-based webpage generation method and system

The embodiment of the invention provides a sketch-based webpage generation method, which comprises the steps of identifying a sketch to obtain element information of a plurality of elements, each element corresponding to a sketch pattern in the sketch; generating a syntax tree according to the element information of the plurality of elements; generating a webpage code according to the syntax tree;and generating a target webpage corresponding to the sketch according to the webpage code. According to the sketch-based webpage generation method provided by the embodiment of the invention, the webpage layout for webpage generation and the element information of the plurality of elements can be obtained through sketch identification, and the syntax tree is generated based on the information andthen the webpage code is generated, so that the page code and the corresponding target page are automatically generated by a machine, the sketch does not need to be manually converted into a webpagecode, and the webpage development efficiency is improved.
Owner:SHANGHAI BILIBILI TECH CO LTD

Online handwritten formula recognition method and device based on user feedback information

The invention discloses an online handwritten formula recognition method and device based on user feedback information. User participation such as deletion operation, pen refilling operation and / or structural movement operation is introduced into an existing recognition method. By means of the idea of man-machine mixed intelligence, user feedback information is fused in different stages of a character segmentation-character recognition-structure analysis recognition method, and an interaction technology suitable for user writing and error correction is designed. According to the method, an interaction means suitable for sketch recognition is designed, various problems encountered by a formula recognition method mainly based on image processing are avoided, basic guarantee is provided for a user to modify strokes with stroke errors or ambiguity, structural errors of formulas and the like, the effect of the formula recognition rate is improved, and the requirements of the user are met.
Owner:INST OF SOFTWARE - CHINESE ACAD OF SCI +1

Small sample character and freehand sketch recognition method and device

The invention provides a small sample character and freehand sketch recognition method and device, and the method is characterized in that the method comprises the following steps: erasing unlabeled source data in a point sequence format according to a fixed erasing proportion, and obtaining augmented network pre-training data; building a BERT augmented network based on a Gaussian mixture model, and training based on augmented network pre-training data and unlabeled source data in a point sequence format to obtain an augmented device; erasing the labeled small sample data in the point sequence format according to each random erasing ratio to obtain erased small sample data; respectively predicting states and coordinates of the erased small sample data by using an augmenter to obtain prediction points, integrating the prediction points with the erased small sample data, and converting by using a neural renderer to obtain bitmap format augmented data; and training a convolutional neural network classifier based on the augmented data in the bitmap format and the labeled small sample data in the bitmap format to obtain a small sample character and freehand sketch recognition model, thereby recognizing the to-be-recognized image to obtain a classification result.
Owner:FUDAN UNIV

Pen interaction-based primitive topological composition method

The invention discloses a pen interaction-based primitive topological composition method, which relates to the field of computer interaction and comprises the following steps of: drawing a sketch on a touch screen by using a touch pen; selecting the drawn sketch, calling a sketch recognition engine based on a YOLOv5 neural network for recognition, recognizing standard primitive information and irrelevant writing information, wherein the standard primitive information comprises primitive category and position information; removing sketch stroke information corresponding to the standard primitive from stroke data of the sketch, and identifying the remaining sketch strokes as line segments; judging a primitive connection relation according to the identified primitive category, primitive position, line segment and position relation between the line segment and the primitive so as to establish a graph structure expression; according to the graph structure representation, the primitive category and the line segment, converting into a normalized topological structure graph, and displaying on the original drawing position of the touch screen; and storing the topological structure diagram, and editing the standard primitives and the topological structure diagram as required.
Owner:INST OF SOFTWARE - CHINESE ACAD OF SCI +1

A Hand-drawn Sketch Recognition Method Based on Attention Mechanism

The invention discloses a hand-drawn sketch recognition method based on an attention mechanism. The method includes inputting the original hand-drawn sketch into a deep convolutional neural network to obtain a feature map output by the last convolution layer; inputting the feature map into a In the channel attention module, the optimized feature map based on channel attention is obtained; a classification network for predicting the vertical flip of hand-drawn sketches is trained, and the original hand-drawn sketches are input into the trained classification network to obtain a vertical flip spatial attention map; Combine the optimized feature map based on channel attention and the vertical flipped spatial attention map to calculate the feature map optimized by vertical flipped spatial attention; finally, output the recognition result through the fully connected layer. The advantages of the present invention are: channel attention and vertical flip space attention are used to optimize the features of the convolutional neural network, enabling the network to focus on learning more discriminative parts, thereby effectively improving the recognition accuracy of hand-drawn sketches.
Owner:ZHEJIANG LAB

A Sketch Recognition Method and Its Application in Commodity Retrieval

The invention discloses a sketch recognition method, which comprises the following steps: S1. Obtaining a picture to be processed; S2. Carrying out component segmentation with semantic information on the collected picture to obtain a component diagram of the sketch; S3. Using a deep learning network The model obtains the label of the component by identifying the component graph; S4. Associates the semantic information of the component with the semantic information of the object to which the component belongs; S5. Outputs the label of the object to which the component belongs through the semantic tree. And the application of the sketch recognition method in commodity retrieval, which is characterized in that it includes the following steps: 1) obtaining picture information, 2) the retrieval system uses the sketch recognition method to obtain the label of the item that the user wants to find according to the picture, 3) According to the identified tags, the corresponding products are recommended for users. The invention improves the correct rate of recognition of complete sketches, saves time for users to select commodities, and enhances user experience.
Owner:ANHUI UNIVERSITY

An online handwritten formula recognition method and device based on user feedback information

The invention discloses an online handwritten formula recognition method and device based on user feedback information, which introduces user participation such as deletion operation, pen-filling operation and / or structural movement operation into the existing recognition method. With the help of the idea of ​​human-computer hybrid intelligence, user feedback information is integrated in different stages of the "character segmentation-character recognition-structural analysis" recognition method, and an interactive technology suitable for user writing and error correction is designed. The invention designs an interactive means suitable for sketch recognition, which avoids various problems encountered in formula recognition methods based on image processing, and provides basic guarantees for users to modify strokes with clerical errors or ambiguities, and structural errors in formulas, etc. The effect of improving the formula recognition rate meets the needs of users.
Owner:INST OF SOFTWARE - CHINESE ACAD OF SCI +1

A Time-Series Sketch Recognition Method Combining Texture Features and Shape Features

ActiveCN108229501BRich description abilityThe idea of ​​reducing overfittingImage enhancementImage analysisSketch recognitionVisual perception
The invention belongs to the field of computer vision, and discloses a time-series sketch recognition method that combines texture features and shape features. First, an image sequence is acquired according to the stroke order of the sketch; second, the texture features and shape features of each image are extracted to form a feature sequence corresponding to the image sequence; then, the features are input into a network consisting of two stages for learning, The two cyclic neural networks in the first stage accept the texture feature and shape feature of the image respectively. In the second stage, the output of the previous stage is first fused, and then input to the third cyclic neural network, and finally the result is obtained through the classifier. In this way, according to The order in the sequence is learned iteratively. Advantages: The geometric descriptor is used for sketch recognition, and the cyclic neural network is used to effectively learn the timing features of sketches, thereby significantly improving the defect that the original recognition model ignores the shape features and timing features of sketches, and improving the sketch recognition rate. .
Owner:DALIAN UNIV OF TECH

A Method of Generating Test Cases for Graphical Interface Based on Hand-drawn Recognition

The invention provides a graphical interface test case generation method based on hand drawing recognition. According to the method, for the problems that in existing graphical interface test case generation, the manual test cost and the script test difficulty are too high, the test case generation process is assisted through a hand-drawn sketch recognition technique, and therefore graphical interface interaction tests of mobile equipment software and personal computer software are easier, more convenient and more efficient to operate.
Owner:NANJING UNIV

Sequential sketch identification method fusing texture features and shape features

ActiveCN108229501ARich description abilityThe idea of ​​reducing overfittingImage enhancementImage analysisSketch recognitionVisual perception
The invention belongs to the field of computer vision and discloses a sequential sketch identification method fusing texture features and shape features. The method comprises the steps of firstly, according to a stroke sequence of a sketch, obtaining an image sequence; secondly, extracting the texture features and the shape features of images to form a feature sequence corresponding to the image sequence; and thirdly, inputting the features to a network containing two stages for performing learning, wherein in the first stage, two recurrent neural networks receive the texture features and theshape features of the images; and in the second stage, outputs in the previous stage are fused firstly, then a fused output is input to a third recurrent neural network, and finally a result is obtained through a classifier, so that iterative learning is performed according to the sequence in the sequences. The method has the advantages that a geometric descriptor is used for sketch identification, and the recurrent neural networks are adopted for performing effective learning on sequential features, so that the defect that an original identification model ignores the shape features and the sequential features of the sketch is remarkably improved and the sketch identification efficiency is better improved.
Owner:DALIAN UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products