20 results about "Iterator" patented technology

Methods are described herein related to extracting tabular data from a transmission server to a remote subscriber computer in a setting wherein the tabular data can only be transferred in a textual representation over an Internet connection, such as a web service, for example. An architecture based on parallel processing may speed up the extraction process by separating iteration from data processing and by introducing forward and reverse iterators for iterating a table from two ends simultaneously.

Various techniques are provided for enabling an iterator (called persistent key-value (KV) iterator) that uses a special key structure embedded with secondary index information for efficient search (or query) of a key-value database (KVDB). In some embodiments, the key structure comprises a plurality of fields categorized into two groups, infrastructure hierarchy fields and object characteristic fields. Keys for the KVDB may be partitioned into one or more levels of hierarchy to generate many smaller key lists for easy search / query of the KVDB. These smaller key lists can be used for concurrent searches / queries.

The present invention discloses a test data generation method, apparatus, test data generation equipment and storage medium, including: creating an iterator, a generator, a field processor and a writer through configuration information, which can realize the description of the scale, type, format, distribution law and constraints between data of the expected test data to be generated through the configuration information, and the corresponding iterator, generator, field processor and writer can be configured through the configuration information to generate test data that meets the expectations, so that after the user configures the information of the generated test data on the client, the test data covering the user's expected scenarios can be generated on the server, and the test data generation efficiency is improved. In addition, by modifying the configuration information, test data for different business needs and usage scenarios can be generated, and the adaptability is strong.

The invention discloses a database offline evaluation method, device and equipment, a medium and a product. The method comprises the following steps: in response to a database offline evaluation request, determining a grammar file used for describing grammar for data to be transferred out of a database, and determining a to-be-evaluated database file and a preset tag configuration file; constructing an abstract syntax tree and a traversal device according to the syntax file, the database file and a preset tag configuration file, and traversing the abstract syntax tree by adopting the traversal device to determine a target function point contained in the database file; and for each target function point contained in the database file, performing a function execution operation or a rewriting operation, and recording a compatibility condition of the target function point to generate an offline evaluation report. According to the technical scheme, the preset tag configuration file independent of the evaluation tool is used for describing the related information of the function points, the adaptation degree of the evaluation scheme can be improved, and efficient and accurate database offline evaluation is achieved.

The invention discloses an analysis processing system for heterogeneous data sources, which comprises a data source abstraction layer, a data processing layer, a standard access interface set, a data source abstraction layer, a data source abstraction layer, a data storage layer, a data processing layer and a data processing layer, and is characterized in that the heterogeneous data sources are uniformly packaged by adopting an iterator design mode, and a standard access interface set is provided; the data processing layer obtains original data from the data source abstraction layer; the flow execution layer packages a heterogeneous execution unit through a uniform WorkerBase base class, and the base class provides an initialization interface, an input / output port acquisition interface, a message notification interface, a working mode setting interface and a type acquisition interface; and the process builder is used for configuring a connection relationship between Workers, distributing tasks to a thread pool, adopting a work stealing mechanism for load balancing, and supporting merging of continuous tasks. A heterogeneous data source is packaged in a unified mode through an iterator interface, structural data rows are output, data zero transformation access is achieved, and meanwhile seamless compatibility and efficiency improvement of a heterogeneous analysis tool are achieved by means of a work stealing and task merging mechanism of a WorkerBase-based packaging multi-mode execution unit and a process builder.

Aspects of the present disclosure include methods, systems, and non-transitory computer-readable storage media for automatically generating reports based on, for example, flow cytometry data. A method for automatically generating a report according to certain embodiments includes: generating a report template based on an input from a user; selecting a source group and an iterator type based on input from the user, where the source group includes a plurality of data sets and the iterator type corresponds to a type of data present in the source group; and iteratively populating the plurality of bulk reports with the plurality of datasets of the source group based on the iterator type, where each bulk report conforms to the report template and populates with a separate dataset of the plurality of datasets of the source group. Aspects of the present disclosure also include methods of automatically generating reports, where such reports include one or more of an image, drawing, chart, table, legend, or text, and populate such reports with data from one or more data sets. Systems for implementing the subject methods are also provided. A non-transitory computer-readable storage medium is also described.

A Loop Pointer (LP) construct is disclosed for identifying terms in a recursive expression operated with an iterator. A Loop Pointer Variable (LPV) is assigned the current value of the recursive expression comprising one or more previous values or prior terms of the LPV. The prior terms or values are identified in source code by a loop pointer construct modifying a reference to the loop pointer variable. A compiler, responsive to encountering a loop pointer construct, generates instructions to access each of the one or more identified variable values for use in computation of the current value of the loop pointer variable at runtime. An access to the iterator construct output can request the terminal value of the loop pointer variable.

Architectures and techniques are described that can save a state of idempotent operations such as directory listing or iteration operations. Thus, these idempotent operations that do not complete can subsequently be continued without rework of the previously completed portions of the operations. The state of the idempotent procedure (e.g., a directory listing) can be saved in a serialized format and can allow the operation or procedure to be continued in a different execution context, including being continued across system, processing, or domain boundaries.

Various techniques are provided for enabling an iterator (called persistent key-value (KV) iterator) that uses a special key structure embedded with secondary index information for efficient search (or query) of a key-value database (KVDB). In some embodiments, the key structure comprises a plurality of fields categorized into two groups, infrastructure hierarchy fields and object characteristic fields. Keys for the KVDB may be partitioned into one or more levels of hierarchy to generate many smaller key lists for easy search / query of the KVDB. These smaller key lists can be used for concurrent searches / queries.

Methods are described herein related to extracting tabular data from a transmission server to a remote subscriber computer in a setting wherein the tabular data can only be transferred in a textual representation over an Internet connection, such as a web service, for example. An architecture based on parallel processing may speed up the extraction process by separating iteration from data processing and by introducing forward and reverse iterators for iterating a table from two ends simultaneously.

The application discloses an analysis processing system of heterogeneous data sources, a data source abstraction layer, a uniform encapsulation of heterogeneous data sources by using an iterator design mode, a provision of a standard access interface set, a data processing layer for obtaining original data from the data source abstraction layer and converting the original data into structured data rows, a process execution layer for encapsulating heterogeneous execution units by using a uniform WorkerBase base class, the base class providing an initialization interface, an input / output port acquisition interface, a message notification interface, a work mode setting interface and a type acquisition interface, a process builder for configuring a connection relationship between workers, distributing tasks to a thread pool, adopting a work stealing mechanism for load balancing, and supporting the merging of continuous tasks. The heterogeneous data sources are uniformly encapsulated through the iterator interface and the structured data rows are output, data zero-reconstruction access is realized, meanwhile, the work stealing and task merging mechanism of the process builder and the encapsulation of the multi-modal execution units by using the WorkerBase base class achieve seamless compatibility and efficiency improvement of the heterogeneous analysis tools.

Aspects of the present disclosure include, for example, methods, systems, and non-transitory computer-readable storage media for automatically generating reports based on flow cytometry data. According to certain embodiments, a method for automatically generating a report includes generating a report template based on input from a user, selecting a source group and an iterator type based on the input from the user, where the source group includes multiple datasets and the iterator type corresponds to a type of data present in the source group, and iteratively populating multiple batch reports using the multiple datasets of the source group based on the iterator type, where each batch report conforms to the report template and is populated with a distinct dataset from the multiple datasets of the source group.

Architectures and instruction sets for non-general matrix multiplication operations are described. An example programmable processor, which implements these architectures and instruction sets, includes multiple processing engines, multiple buffers (with at least one buffer storing a multidimensional array), and multiple iterator tables stored in one of the multiple buffers. The multiple processing engines and multiple buffers are tightly coupled within an area of the programmable processor to enable high-bandwidth data communications between components of the programmable processor. Furthermore, the multiple iterator tables include an iterator table for each of the multiple buffers, and an iterator table enables read or write access to a respective buffer based on using multiple offset-stride tuples stored in the iterator table to derive addresses to access the multidimensional array stored in the respective buffer. Memory elements used by the multiple processing engines to perform operations using the multiple iterator tables consist of the multiple buffers.

The embodiment of the invention discloses a transaction conflict detection method and device, equipment, a storage medium and a product. The method comprises the steps that M to-be-executed transactions are obtained, the types of the M to-be-executed transactions comprise an iterator type and a non-iterator type, a read set of the to-be-executed transactions of the iterator type comprises range indication information and data items, the M to-be-executed transactions are executed in parallel, and a write set of each to-be-executed transaction is obtained, and performing conflict detection on the M to-be-executed transactions through the read sets and the write-in sets of the M to-be-executed transactions to obtain conflict detection results of the M to-be-executed transactions. Therefore, by adding the range indication information of the to-be-executed transactions of the iterator type into the read set, consistency detection can be carried out on the read set and the check set of the to-be-executed transactions of the iterator type, so that conflict detection can be carried out on the to-be-executed transactions of the iterator type and the non-iterator type which are executed in parallel.

A Loop Pointer (LP) construct is disclosed for identifying terms in a recursive expression operated within a branching construct, having a condition, within an iterator construct. A Loop Pointer Variable (LPV) is assigned the current value of the recursive expression comprising one or more previous values or prior terms of the LPV. The prior terms or values are identified in source code by a loop pointer construct modifying a reference to the loop pointer variable. A compiler generates instructions to access each of the one or more identified variable values for use in computation of the current value when the condition of the branching construct is met at runtime. An access to the iterator construct output can request the terminal value of the loop pointer value, a sequence of one or more of a series comprising updates to the value when the condition is met, or a series of the values in each iteration.

Compiler techniques lot inline parallelism and re-targetable parallel runtime execution of logic iterators enables selection thereof from the source code or dynamically during the object code execution.

The application provides a type inference method and device of a programming language, the method comprising: in the development process of program code, obtaining a node to be inferred in an abstract syntax tree, the node to be inferred indicating a field to be inferred in the program code, the field to be inferred comprising one of the following: a variable, a class, a function or a parameter; obtaining a constraint related to the node to be inferred, the constraint being used to indicate a relationship involved by the node to be inferred in the abstract syntax tree; determining a type of the node to be inferred according to the constraint, the type of the node to be inferred being one of the following: a numeric type, a sequence type, a mapping type, a set type, an iterator type, a context manager type, a module type, a metatype, a null type or a callable type. The scheme of the application is beneficial to reducing the memory occupation of type inference.

A method, computer program product, and computing system for sensing a failure within a system within a computing device. The system may include a cache memory system and a vaulted memory comprising a random access memory (RAM) having a plurality of independent persistent areas. A primary node and secondary node may be provided. The primary node may occupy a first independent persistent area of the RAM of the vaulted memory. The secondary node may occupy a second independent persistent area of the RAM of the vaulted memory. Data within the vaulted memory may be written to a persistent media using an iterator. The data may include at least one dirty page. Writing data within the vaulted memory to the persistent media may include flushing the at least one dirty page to the persistent media.

The application provides a performance portable numerical simulation unified acceleration interface method, and relates to the technical field of data processing, and comprises the following steps: a topological matrix of data relations is traversed through an iterator; the iterator calculates position information of data in the topological matrix, and obtains data sequences; and each data sequence element is subjected to operator operation through the iterator. The application takes the iterator as the core, can support any number of arrays and parameters to participate in calculation, supports flexible calculation function definition of a user, supports a structure array to participate in calculation, makes the acceleration interface more intuitive to use, and meets actual requirements of acceleration calculation development and optimization.

The application discloses a key value storage method based on a multi-log structure merge tree, and comprises the following steps: 1, when a read-write request is received by a multi-log structure merge tree (MLSMT), the hash value of a key in the request is used to determine the log structure merge tree (LSMT) to which the key belongs i , and read-write operation is performed on the LSMT i ; 2, when a scanning request is received by the MLSMT structure, a grouping iterator is established for a file in the log structure merge tree, parallel threads are used to perform a key positioning operation (Seek), and a heap sorting is used to find a next key, so that data is read out; 3, a compaction operation is processed by using parallel threads in the background, and data belonging to a current LSMT i is read out from an LSMT i split from the LSMT s and written into an SST file of the LSMT i . The application can realize accelerated writing and merging of data, reduce the number of layers of a single log structure merge tree, and thus improve the read-write performance of a system.