2246 results about "Data extraction" patented technology

An intelligent document recognition-based document management system includes modules for image capture, image enhancement, image identification, optical character recognition, data extraction and quality assurance. The system captures data from electronic documents as diverse as facsimile images, scanned images and images from document management systems. It processes these images and presents the data in, for example, a standard XML format. The document management system processes both structured document images (ones which have a standard format) and unstructured document images (ones which do not have a standard format). The system can extract images directly from a facsimile machine, a scanner or a document management system for processing.

Methods, systems and processor-readable media for extracting and classifying location information utilizing social media messages and/or data thereof. The social media messages can be sampled from a social media database and the messages filtered based on a heuristic rule. A geolocation entity from the unstructured social media messages can be extracted utilizing a geolocation entity extracting module. The messages with the geoentities can be uploaded onto a crowd sourcing platform to manually annotate the messages with a label. A text classification model can be built and learned from the label utilizing a machine learning algorithm and the messages can be classified by a location classifier in order to extract the user location. The user location can then be transformed into a geocode so that a spatial search can be enabled and the distance between the locations can be easily calculated.

Provided are systems and methods for Web-based intelligent paperless document management where users can collect, store, and share all document from various locations. Also provided are systems and methods requiring minimal data reentry because of data extraction capabilities. Systems and methods described herein can deliver documents via internet to multiple persons without using barcodes or separator sheets for faxing or sending documents.

The present invention relates to automated document processing and more particularly, to methods and systems for document image capture and processing using mobile devices. In accordance with various embodiments, methods and systems for document image capture on a mobile communication device are provided such that the image is optimized and enhanced for data extraction from the document as depicted. These methods and systems may comprise capturing an image of a document using a mobile communication device; transmitting the image to a server; and processing the image to create a bi-tonal image of the document for data extraction. Additionally, these methods and systems may comprise capturing a first image of a document using the mobile communication device; automatically detecting the document within the image; geometrically correcting the image; binarizing the image; correcting the orientation of the image; correcting the size of the image; and outputting the resulting image of the document.

The present invention relates to automated document processing and more particularly, to methods and systems for document image capture and processing using mobile devices. In accordance with various embodiments, methods and systems for document image capture on a mobile communication device are provided such that the image is optimized and enhanced for data extraction from the document as depicted. These methods and systems may comprise capturing an image of a document using a mobile communication device; transmitting the image to a server; and processing the image to create a bi-tonal image of the document for data extraction. Additionally, these methods and systems may comprise capturing a first image of a document using the mobile communication device; automatically detecting the document within the image; geometrically correcting the image; binarizing the image; correcting the orientation of the image; correcting the size of the image; and outputting the resulting image of the document.

In embodiments of the present invention improved capabilities are described for the steps of identifying, through a monitoring module of a security software component, a data extraction behavior of a software application attempting to extract data from an endpoint computing facility; and in response to a finding that the data extraction behavior is related to extracting sensitive information and that the behavior is a suspicious behavior, causing the endpoint to perform a remedial action. The security software component may be a computer security software program, a sensitive information compliance software program, and the like.

A secure cashless gaming system comprises a plurality of gaming devices which may or may not be connected to a central host network. Each gaming device includes an intelligent data device reader which is uniquely associated with a security module interposed between the intelligent data device reader and the gaming device processor. A portable data device bearing credits is used to allow players to play the various gaming devices. When a portable data device is presented to the gaming device, it is authenticated before a gaming session is allowed to begin. The intelligent data device reader in each gaming device monitors gaming transactions and stores the results for later readout in a secure format by a portable data extraction unit, or else for transfer to a central host network. Gaming transaction data may be aggregated by the portable data extraction unit from a number of different gaming devices, and may be transferred to a central accounting and processing system for tracking the number of remaining gaming credits for each portable data unit and/or player. Individual player habits can be monitored and tracked using the aggregated data. The intelligent data device reader may be programmed to automatically transfer gaming credits from a portable data device the gaming device, and continually refresh the credits each time they drop below a certain minimum level, thus alleviating the need for the player to manually enter an amount of gaming credits to transfer to the gaming device.

The present invention relates to automated document processing and more particularly, to methods and systems for document image capture and processing using mobile devices. In accordance with various embodiments, methods and systems for document image capture on a mobile communication device are provided such that the image is optimized and enhanced for data extraction from the document as depicted. These methods and systems may comprise capturing an image of a document using a mobile communication device; submitting the image to a server; and processing the image to create a bi-tonal image of the document for data extraction. Additionally, these methods and systems may comprise capturing a first image of a document using the mobile communication device; automatically detecting the document within the image; geometrically correcting the image; binarizing the image; correcting the orientation of the image; correcting the size of the image; and outputting the resulting image of the document.

A method of automatically narrowing data search space and improving accuracy of data extraction using known constraints in a layout of extracted data elements for classified documented is provided. The method includes: analyzing each document to classify it within a document category, each category having a corresponding set of expected layouts; analyzing each electronic document to automatically extract images and text features; automatically constructing a data structure including a layout of the extracted features and layout relationships amongst the extracted features, wherein each of the extracted features in the layout maintains a reference to neighboring features and wherein closely related features are merged to form a combined feature; automatically narrowing data search space by detecting and removing parts of the layout that are not associated with any data elements using the data structure; and automatically detecting data using the extracted feature layout and the layout relationships amongst the extracted features.

A method for extracting an attribute occurrence from template generated semi-structured document comprising multi-attribute data records comprises identifying a first set of attribute occurrences in the template generated semi-structured document using an ontology. The method further comprises determining a boundary of each multi-attribute data record in the template generated semi-structured document, learning a pattern for an attribute corresponding to an identified attribute occurrence of the first set in the template generated semi-structured document, and applying the pattern within the boundary of each multi-attribute data record in the template generated semi-structured document to extract a second set of attribute occurrences.

The invention is directed generally to providing methods and systems for trend extraction and analysis. Embodiments include methods and systems for trend extraction and analysis of information extracted from dynamically changing data included in computer systems and/or networks. Various exemplary embodiments are provided that may generate characteristic indicators for trend(s) and/or distribution(s) for one or more data sources by use of, for example, temporal indicators derived through analysis of the difference in contribution separate portions of the data to the whole data set being considered, contribution of individual sources, and/or the interaction of the separate portions of the data with one another. Some exemplary approaches may include the use of singular value decomposition (SVD) and higher-order singular value decomposition (HOSVD) data extraction and analysis techniques. One use of these techniques is in the analysis of the dynamic data contained in Weblogs and the blogosphere.

A Web regional information retrieval apparatus 10 retrieves a Web page which is information in the Worldwide Web (WWW), and includes a collecting unit 11, a regional meta-data extraction unit 12, and a region information retrieval unit 14. The collecting unit 11 collects a Web page from the WWW. The regional meta-data extraction unit 12 extracts regional meta-data indicating the region relating to the collected Web page, and assigns the data to the Web page. The region information retrieval unit 14 receives location information indicating the location of the terminal 20 from the terminal 20, retrieves a Web page assigned the regional meta-data related to the location information from the WWW, and transmits the retrieval result to the terminal 20.

Circuitry for transferring multiple digital data streams, e.g. digital audio data, over a single communications link such as a single wire. A pulse-length-modulator is responsive to a plurality of data streams to generate a series of data pulses with a single data pulse having a rising and falling edge in each of a plurality of transfer periods defined by a first clock signal. The timing of the rising and falling edge of each data pulse is dependent on a combination of the then current data samples from the plurality of data streams. The duration and position of the data pulse in the transfer window in effect defines a data symbol encoding the data. An interface receives the stream of data pulses, and data extraction circuitry samples the data pulse to determine which of the possible data symbols the pulse represents and determines a data value for at least one received data stream.

An apparatus for managing information on at least one part to be used to manufacture a product includes a part-data creating unit configure to create part data that includes information on a part designated by a customer to be used to manufacture a product; a common-function-part data creating unit configured to create common-function-part data that includes at least two common-function-parts that have substantially common functions and priority information of each of the common-function-parts; an acquiring unit configured to acquire replacement-possibility data indicative of whether replacement of designated part with an alternative part is possible; an extracting unit configured to extract an alternative part for the designated part based on the common-function-part data; a determining unit configured to determine whether to replace the designated part with the alternative part based on the common-function-part data and the replacement-possibility data.

The present system can perform machine learning of prototypical descriptions of data elements for extraction from machine-readable documents. Document templates are created from sets of training documents that can be used to extract data from form documents, such as: fill-in forms used for taxes; flex-form documents having many variants, such as bills of lading or insurance notifications; and some context-form documents having a description or graphic indicator in proximity to a data element. In response to training documents, the system performs an inductive reasoning process to generalize a document template so that the location of data elements can be predicted for the training examples. The automatically generated document template can then be used to extract data elements from a wide variety of form documents.

An extraction-rule generation and training system uses information obtained from multiple markup language documents (e.g. web pages) of similar structure to generate an extraction rule for extracting datapoints from markup language documents. By using information extracted from multiple documents of similar structure, including information regarding correlations between such documents, the method produces data extraction rules that provide improved datapoint extraction reliability. Where the structures of two or more documents are not sufficiently similar, the system maintains separate extraction rules for the same datapoint, and applies these separate extraction rules in combination to particular markup language documents to extract the datapoint.

A map update data supply device includes: a request update data extraction unit that based on an update request extracts a request update section, and a latest version of an overwrite update data file for overwrite updating; and a safeguard update data extraction unit that extracts a safeguard update section that safeguards a network between adjacent sections, and up to an update safeguard version of a difference update data file, wherein the extracted data files are supplied to a navigation device.

Remote data collection systems and methods retrieve data including financial, sales, marketing, operational and the like data from a plurality of databases and database types remotely over a network in an automated, platform-agnostic manner. A remote data collection system includes a network interface, a connection to a data source, a processor communicatively coupled to the network interface and the connection, and memory storing instructions for remote data collection that, when executed, cause the processor to: receive a request to extract data from the data source; extract the data in a non-intrusive manner from the data source using a two phase process comprising a reconciliation phase and a collection phase; and transmit one of an entire set and a subset of the extracted data based on the request.

The present method and apparatus provides for automated testing of data integration and business intelligence projects using Extract, Load and Validate (ELV) architecture. The method and computer program product provides a testing framework that automates the querying, extraction and loading of test data into a test result database from plurality of data sources and application interfaces using source specific adaptors. The test data available for extraction using the adaptors include metadata such as the database query generated by the OLAP Tools that are critical to validate the changes in business intelligence systems. A validation module helps define validation rules for verifying the test data loaded into the test result database. The validation module further provides a framework for comparing the test data with previously archived test data as well as benchmark test data.

A portable data reading device, such as a barcode scanner or RFID reader, includes a Web server and a first server-side application to modify one or more settings of the portable data reading device. The settings may include, for example, symbology settings, device settings, and network settings. The Web server may receive formatted data from a client browser representing a requested modification of at least one setting of the portable data reading device. Upon receiving the formatted data, the Web server may automatically invoke the first server-side application to modify the at least one setting responsive to the formatted data.

The invention discloses a health insurance outpatient clinic big data extraction system and method based on a hadoop platform. The system comprises a data acquisition module, a data storage module, a data cleaning module, a data analyzing and processing module, an Hbase distributed database and a data display module. The data acquisition module is connected with the data storage module, the data storage module is connected with the data analyzing and processing module through the data cleaning module, and a data query and analysis module is respectively connected with the Hbase distributed database and the data display module. The system and method have the advantages that a Hadoop cluster can be formed by thousands of cheap servers, a distributed file system cluster is constructed on large-scale cheap machines, data extraction and analysis cost is reduced to a large extent, and parallel processing can be carried out on outpatient clinic big data. Meanwhile, reliability and security of the data are well guaranteed by means of a transcript storage strategy of an HDFS.

The invention discloses a traffic travel characteristic data extraction method based on big data, and belongs to the field of traffic big data analysis application. Mobile phone data act as the core of the big data, and GPS data, coil data and video data act as the auxiliary of the big data. Traffic travel characteristic data include OD data and job-housing ratio data. The main steps are listed as follows: 1) the mobile phone data, the GPS data, the coil data and the video data are acquired and the mobile phone data are preprocessed; 2) traffic cell allocation is performed through combination of the geographic attributes of administrative regions and base stations; 3) traffic travel chain identification is performed through combination of the multi-source data with the mobile phone data acting as the core, and passing points and stop points are identified; 4) inter-cell OD result output is performed through combination of the mobile phone data and demographic data; and 5) all the traffic travel chains within a week are analyzed, residential places and working places are judged through combination of turn-on and turn-off data and conversation data, and job-housing analysis is performed. Wide range of urban traffic travel characteristic data acquisition can be completed in a short period of time by the traffic travel characteristic data extraction method based on the big data.

A vehicle environment monitoring system is provided that is based on a three-dimensional vector model. The three-dimensional vector model of the vehicle's environment is generated on the basis of the image data captured by at least one three-dimensional camera. Out of the image data, particular data are extracted for generating the three-dimensional vector model in order to reduce the data volume. For data extraction, a data extraction algorithm is applied that is determined in accordance with at least one parameter that relates to the situation of the vehicle. Therefore, targeted data extraction is performed for generating a three-dimensional model that is particularly adapted for an application that is desired in the current vehicle situation. The applications of the vector model include driver assistance, external monitoring and vehicle control, as well as recording in an event data recorder. In one implementation, a sequence of three-dimensional vector models, representing a three-dimensional space-and-time model, is generated.

A method, apparatus, system, and computer program product provide the ability to extract level information and reference grid information from point cloud data. Point cloud data is obtained and organized into a three-dimensional structure of voxels. Potential boundary points are filtered from the boundary cells. Level information is extracted from a Z-axis histogram of the voxels positioned along the Z-axis of the three-dimensional voxel structure and further refined. Reference grid information is extracted from an X-axis histogram of the voxels positioned along the X-axis of the three-dimensional voxel structure and a Y-axis histogram of the voxels positioned along the Y-axis of the three-dimensional voxel structure and further refined.

A log file processing system sorts records from large log files and groups them by session without making a complete copy of the log files by capturing a subset of the log files in a sliding memory window and identifying all records in the window that form a complete user session. Records belonging to a complete session are output for analyzing, and the remaining records are output as raw log data for additional processing. Using a ring buffer to implement the sliding memory window, data structures are used to group records by session, to identify completed sessions, and to index into the ring buffer to retrieve records for completed sessions that are to be directly analyzed. Any records remaining in the ring buffer at the end of slide window processing may be output as raw log file data and are processed as incomplete or malformed session records. An embodiment of the log file processing system provides a significant improvement on the speed of data extraction from log files into analyzable session data.

The invention achieves stabilization of the verification performance and augmentation of the verification performance. The fingerprint data synthesis apparatus includes a fingerprint data extraction section for extracting minutiae from each of a plurality of fingerprint images to produce fingerprint data, a fingerprint data storage section for storing the fingerprint data, a common minutia searching section for investigating a correspondence of the minutiae between the plurality of fingerprint data to search for the same minutiae included commonly in two or more of the plurality of fingerprint data as common minutiae, a fingerprint data synthesis section for selecting one of the common minutiae as a minutia representative of the common minutiae to produce one synthetic fingerprint data, and a validation section for validating the synthetic fingerprint data. The apparatus is applied to production of fingerprint data used in a system which identifies an individual.

The present invention provides a dynamic model directed angiography three-dimensional reconstruction method, pertaining to an intersectional field of digital image processing and medicine imaging, for satisfying special requests of auxiliary detection and surgery guidance for cardiovascular disease in clinical medicine. The invention includes steps of angiography image preprocessing, vascellum segmentation, vascellum skeleton and radii extraction, model directed vascellum base element recognition, vascellum matching and vascellum three-dimensional reconstruction. The invention also provides a cardiovascular dynamic model construction method including steps of cardiovascular slice data extraction, cordis static and dynamic model building, and static and dynamic model building. According to the invention, good angiography three-dimensional reconstruction result may be obtained, which effectively assists detection and surgery guidance for cardiovascular disease, thereby satisfying clinical requests.

The invention discloses a high-frequency error detection device and method in the large caliber large relative aperture non-spherical mirror, the device including the five-axis movement adjustment platform with the interferometer focusing platform, the side swing reflecting mirror side swing platform located in front of the interferometer focusing platform, and the measured non-spherical mirror 3D movement adjustment platform located below the side swing reflection mirror side swing platform, and the multiple points supporting machine with the laser wave surface interferometer, the side swing reflection mirrors, and the measured non-spherical mirror installed on the corresponding platforms, and the main control computer with built-in detection data-processing algorithm program connecting with the laser wave surface interferometer. The device uses the main control computer to process the detection data-processing algorithm, which can combine the detected multiple part regions error surface maps into error surface map with medium or high frequency in full caliber, including the initial pose determining method, the overlapping regional data extraction algorithm and the regional data stitching algorithm. The invention is a high-frequency error detection device and method with low-cost, high-precision, high-efficiency in the large caliber large relative aperture non-spherical mirror.

The present invention can enable increasing refinement of role-based permission to access data within a Role Based Access Control (RBAC) controlled computer system by enabling constraints to be written on the role-based permissions. The constraints may utilize each and every type or combination of subject, object, or environment information extracted from sources internal or external to the controlled computer system and may evaluate the content or context of the information extracted to enable refined and dynamic access after the role permission assignment and immediately before every access grant without the reassignment of roles.

The invention discloses a power grid multi-source data fusion method and system based on a multi-element heterogeneous model. The method comprises the following steps of multi-source data access, metadata storage, unified device modeling and data extraction, model matching degree calculation and multi-element data fusion. The system mainly comprises the five modules of multi-source data access, metadata storage, unified device modeling and data extraction, model matching degree calculation and multi-element data fusion. A unified model including multi-source system data is established by deeply analyzing the multi-source system data, automatic association is performed through model traversal comparison and model matching degree calculation according to the matching degree, automatic data integration and fusion of 90% or above is achieved, unfused data details and detailed causes are accurately analyzed, integration and fusion of various service data are achieved, and the overall fusion quality is effective managed and controlled.