919results about "Digital ink recognition" patented technology

A computer implemented method and system for gesture category recognition and training. Generally, a gesture is a hand or body initiated movement of a cursor directing device to outline a particular pattern in particular directions done in particular periods of time. The present invention allows a computer system to accept input data, originating from a user, in the form gesture data that are made using the cursor directing device. In one embodiment, a mouse device is used, but the present invention is equally well suited for use with other cursor directing devices (e.g., a track ball, a finger pad, an electronic stylus, etc.). In one embodiment, gesture data is accepted by pressing a key on the keyboard and then moving the mouse (with mouse button pressed) to trace out the gesture. Mouse position information and time stamps are recorded. The present invention then determines a multi-dimensional feature vector based on the gesture data. The feature vector is then passed through a gesture category recognition engine that, in one implementation, uses a radial basis function neural network to associate the feature vector to a pre-existing gesture category. Once identified, a set of user commands that are associated with the gesture category are applied to the computer system. The user commands can originate from an automatic process that extracts commands that are associated with the menu items of a particular application program. The present invention also allows user training so that user-defined gestures, and the computer commands associated therewith, can be programmed into the computer system.

A portable computer arranged to rest comfortably in the hand has a small display screen. Accelerometers capable of detecting movement of the pen with respect to gravity provide input to a microcontroller which selects a response from a number of viewing modes. The pen may be held in either hand and the output message to the screen will be oriented according to the location of the pen. Full personal digital assistance functionality may be incorporated in a relatively small plastics casing and functions, such as calendar, contracts the like may be incorporated.

A character input apparatus, includes a detection unit configured to detect coordinate data of handwriting, a handwriting display unit configured to sequentially display styled handwriting obtained by styling the handwriting during handwriting operation in accordance with a designated text style and the coordinate data, a recognition unit configured to recognize a character corresponding to the handwriting, and a character display unit configured to display a styled character obtained by styling the recognized character in accordance with the text style and the coordinate data.

The present invention extends to methods, systems, and computer program products for recognizing input gestures. A neural network is trained using example inputs and backpropagation to recognize specified input patterns. Input gesture data is representative of movements in contact on a multi-touch input display surface relative to one or more axes over time. Example inputs used for training the neural network to recognize a specified input pattern can be created from sampling input gesture data for example input gestures known to represent the specified input pattern. Trained neural networks can subsequently be used to recognize input gestures that are similar to known input gestures as the specified input pattern corresponding to the known input gestures.

A user can enter handwritten electronic ink into a writing guide on an electronic page of an electronic tablet. An ink processing module can display the handwritten electronic ink as it is rendered on the electronic page by the user. Upon the occurrence of a predefined event, the writing guide module can automatically recognize and convert the electronic ink to text without the user's manual intervention. The writing guide module can replace the electronic ink in the writing guide with the converted text.

Aspects of the present invention relate to user interface control of a head-worn computer.

A portable computer arranged to rest comfortably in the hand has a small display screen. Accelerometers capable of detecting movement of the pen with respect to gravity provide input to a microcontroller which selects a response from a number of viewing modes. The pen may be held in either hand and the output message to the screen will be oriented according to the location of the pen. Full personal digital assistance functionality may be incorporated in a relatively small plastics casing and functions, such as calendar, contracts the like may be incorporated.

To provide a small and light-weight writing instrument that can accurately read information written down on a display portion as electronic information. A pen-shaped device which includes a battery capable of being charged wirelessly from the outside, a first sensor which detects whether a pen nib has contact with a surface, a second sensor which detects movement of the pen nib in contact with the surface, a control circuit which is electrically connected to the first sensor and the second sensor, and a memory which is electrically connected to the control circuit, where the first sensor, the second sensor, the control circuit, and the memory operate by supply of electric power from the battery.

A device including a housing, a writing tip connected to the housing, a writing surface position indicator, a processor in the housing, a memory device in the housing connected to the processor, and a sensor in the housing and cooperative with the writing surface position indicator. The device may be used to record writings and drawings applied to a surface by a user, to transmit that data to a remote device, to download data from remote devices, and to otherwise communicate with remote devices.

A small-sized pen-shaped input apparatus precisely detects handwriting input. The apparatus compensates for the effects of the inclination of the pen-shaped input apparatus. An initial inclination angle calculating section calculates the initial value of the inclination angle of a pen shaft in a gravity coordinate system. The inclination angle variation calculating section calculates a variation value of the inclination angle of the pen shaft. A handwriting inclination angle calculating section calculates the inclination angle of the pen shaft when writing. A coordinates conversion calculating section converts the coordinate system of the acceleration from the pen shaft coordinate system to the gravity coordinate system. A movement amount calculating section calculates the movement direction and the movement distance of the pen's tip end. Finally, a handwriting detecting section detects a state of handwriting or non-handwriting.

The present invention leverages spatial relationships to provide a systematic means to recognize text and / or graphics. This allows augmentation of a sketched shape with its symbolic meaning, enabling numerous features including smart editing, beautification, and interactive simulation of visual languages. The spatial recognition method obtains a search-based optimization over a large space of possible groupings from simultaneously grouped and recognized sketched shapes. The optimization utilizes a classifier that assigns a class label to a collection of strokes. The overall grouping optimization assumes the properties of the classifier so that if the classifier is scale and rotation invariant the optimization will be as well. Instances of the present invention employ a variant of AdaBoost to facilitate in recognizing / classifying symbols. Instances of the present invention employ dynamic programming and / or A-star search to perform optimization. The present invention applies to both hand-sketched shapes and printed handwritten text, and even heterogeneous mixtures of the two.

The present invention leverages spatial relationships to provide a systematic means to recognize text and / or graphics. This allows augmentation of a sketched shape with its symbolic meaning, enabling numerous features including smart editing, beautification, and interactive simulation of visual languages. The spatial recognition method obtains a search-based optimization over a large space of possible groupings from simultaneously grouped and recognized sketched shapes. The optimization utilizes a classifier that assigns a class label to a collection of strokes. The overall grouping optimization assumes the properties of the classifier so that if the classifier is scale and rotation invariant the optimization will be as well. Instances of the present invention employ a variant of AdaBoost to facilitate in recognizing / classifying symbols. Instances of the present invention employ dynamic programming and / or A-star search to perform optimization. The present invention applies to both hand-sketched shapes and printed handwritten text, and even heterogeneous mixtures of the two.

In accordance with one aspect of the present invention, disclosed is an image analysis and conversion method and system, where digital ink images are converted to structured object representations of the digital ink images, capable of being edited by a structured text / graphics editor.

A method and system provides intelligent node-link diagram creation and editing, including an electronic display device having a surface on which a writing and / or drawing canvas is provided. An input device permits writing and / or drawing of electronic ink strokes, and a computing device is in operative association with the electronic display and the input device, and has stored therein for operation in connection with actions of the input device, a user interface (UI). The UI includes a graphical user interface (GUI) module, which controls input and display of the ink strokes applied to the canvas by the input device, and a recognition module which interprets the ink strokes by performance of structure recognition operations.

A process and system for using handwritten input in an auto-suggest list input is described. Handwritten input is recognized as text and forwarded to an auto-suggest list provider that provides a list of suggested results based on the recognized.

Certain embodiments of the present invention provide methods and systems for improved clinical workflow using gesture recognition. Certain embodiments include establishing a communication link between an interface and a remote system, and utilizing gesture input to transmit data to, retrieve data from, and / or trigger functionality at the remote system via the communication link. Additionally, the method may include using the gesture input to perform data acquisition, data retrieval, order entry, dictation, data analysis, image review, and / or image annotation, for example. In certain embodiments, a response from the remote system is displayed. In certain embodiments, the gesture input corresponds to a sequence of healthcare application commands for execution at the remote system. In certain embodiments, the interface includes a default translation between gestures and functionality. In certain embodiments, a translation between a gesture input and a functionality may be customized for a user and / or a group of users.

Methods, systems, and computer-readable media related to a technique for providing handwriting input functionality on a user device. A handwriting recognition module is trained to have a repertoire comprising multiple non-overlapping scripts and capable of recognizing tens of thousands of characters using a single handwriting recognition model. The handwriting input module provides real-time, stroke-order and stroke-direction independent handwriting recognition for multi-character handwriting input. In particular, real-time, stroke-order and stroke-direction independent handwriting recognition is provided for multi-character, or sentence level Chinese handwriting recognition. User interfaces for providing the handwriting input functionality are also disclosed.

Embodiments of the present disclosure include a method for extracting symbols from a digitized object. The method includes processing the word block against a dictionary. The method includes comparing the word block against a word in the dictionary, the comparison providing a confidence factor. The method includes outputting a prediction equal to the word when the confidence factor is greater than a predetermined threshold. The method includes evaluating properties of the word block when the confidence factor is less than the predetermined threshold. The method includes predicting a value of the word block based on the properties of the word block. The method further includes determining an error rate for the predicted value of the word block. The method includes outputting a value for the word block, the output equal to a calculated value corresponding to a value of the word block having the lowest error rate.

The invention relates to the field of image recognition, and especially relates to a random sample generation method for the recognition of a complex character. In the recognition of the complex character, a large number of samples, which are generated by a random sample generator and comprise a to-be-recognized image noise model and a distortion characteristic model are employed through the analysis of the reason of the character complexity on the basis of a standard character similar to a to-be-recognized character. A training sample automatically generated by the random sample generator comprises various types of complex noises and distortions, and can meet the recognition demands of various types of complex characters. The above random sample is enabled to serve as a training sample in a depth neural network, thereby solving a problem that a training neural network needs a large amount of manual marking for character recognition, enabling the automatic recognition of complex characters and images to be more simple and easier, and remarkably saving the related labor cost.

An embodiment of the present invention provides a method and electronic device for virtual handwritten input. The method for virtual handwritten input comprises: the electronic device detecting and obtaining, in real time, position coordinates of a handwriting device in a virtual handwriting region, the virtual handwriting region being a region in which a distance-measuring detector in the electronic device can effectively measure distances; obtaining a trace formed by the position coordinates and, when determining that a current handwritten input is complete, obtaining the handwriting trace from the full handwritten input process; recognizing a character corresponding to the handwriting trace obtained, and then displaying the recognized character. The method and electronic device for virtual handwritten input provided by an embodiment of the present invention enables simple, convenient, and low-cost handwritten input.

A handwriting recognition apparatus facilitates user entry of strokes one on top of another. The apparatus, which includes a processor and a display integrated with a touch sensitive screen, receives a series of strokes via the screen. Each stroke is defined by contact, trace, and lift occurrences. Each stroke appears on the display until occurrence of a prescribed event, and then disappears. The apparatus accumulates strokes into a buffer and interprets all accumulated strokes collectively against a character database and optionally a linguistic database, to identify multiple candidate strings that could be represented by the accumulated strokes. The apparatus displays candidate strings for user selection after all strokes have faded, or after receiving a user submitted delimiter, or after a given delay has elapsed following user entry of the latest stroke. Alternatively, candidate strings are displayed after each stroke without waiting for timeout or explicit delimiter.

A handwriting guide including an active and / or inactive writing guide is rendered by displaying a shaded outline object having a line for receiving electronic ink, displaying the active writing guide thereby indicating a location of a current active context, and expanding the active and / or inactive writing guide up to a maximum width of the outline object in response to receiving more electronic ink within a line. The active writing guide can comprise a bracket displayed on each corner of a writing area distinguished on a line and can correspond to an insertion point upon switching to text mode. A drawing guide that includes an active and / or inactive drawing guide is rendered by displaying a shaded drawing guide and the active drawing guide in response to detecting ink strokes within the drawing guide. The active drawing guide can comprise a bounding rectangle encompassing a drawing area that receives ink strokes.

This invention implements a system for automatic recognition of human-assisted drawings, in a plurality of forms, be they hand-drawn on paper, marker board, with a stylus on a computer, made with a mouse, stylus, finger or other instrument on a personal computer, tablet computer, smart telephone or other medium. At the core of the invention is a pattern recognition engine, aimed at recognizing the graphical objects, handwritten text, equations or interconnects in the input image, and interpreting the significance of their relative association. The apparatus offers error correction, vector representation of the input sketch, as intermediate output, along with the recognized patterns, arranged in a hierarchical data structure, ready to be passed on for mining or assessment. The recognized patterns can be associated with mechanical design, electrical circuit design, mathematics, biology, physics, chemistry, computer science, natural sciences, medicine, or any other science- or engineering-based discipline making use of human-assisted drawings.

The invention discloses a Chinese word stock automatic generation method based on writing style modeling, and the method comprises the steps: carrying out the stroke track automatic extraction and wrong result screening operation of inputted handwritten Chinese character image, and obtaining training data; carrying out the learning and modeling of handwritten Chinese character stroke shape and style and stroke inter-frame structure style through a neural network, and obtaining handwriting stroke connection characteristics and stroke end part contour handwriting features through statistical analysis, and then generating a high-quality Chinese character form consistent with the handwriting style of a user. The method just needs a few of commonly-used Chinese characters as the input, does not need any manual intervention, can automatically generate a vector Chinese word stock comprising a large number of Chinese character patterns, can quickly and automatically generates a handwriting Chinese word stock with other handwriting style for a user, can remarkably improves the manufacturing efficiency of the Chinese word stock, and greatly reduces the production cost.

A method for inputting ideograms into a computer system includes receiving phonetic information related to a desired ideogram to be entered and forming a candidate list of possible ideograms as a function of the phonetic information received. Stroke information, comprising one or more strokes in the desired ideogram, is received in order to obtain the desired ideogram from the candidate list.

A method including a process by which a first digital image of the document is obtained. A second digital image of a document is retrieved from a computer, a mobile device, a computer network or by imaging of a second document. The method includes calculating the transformation between the first and second digital images such as geometrical distortion, local ‘brightness and contrast differences and blurring due to the optical imaging process. The method estimates the parameters of these transformations so that the transformations can be applied to one of the images, rendering it as similar as possible to the other image. The method further compares the two images in order to find differences such as addition, deletion or changing of characters or words.The method further displays the differences on a display such as a computer screen or mobile device screen or reports to the user that the two documents are identical.

A method of line extraction in a digital ink sequence of handwritten text data points, the method including the steps of: obtaining a stroke sequence comprised of a sequence of strokes; segmenting the strokes into a sequence of substrokes by applying a stroke segmentation algorithm; calculating angular differences between neighbouring groups of substrokes, in the sequence of substrokes; and, determining the positions of the extrema of the angular differences, thereby identifying the substrokes at line breaks and enabling line extraction. A system for line extraction also disclosed.