24 results about "Iterator" patented technology

Methods are described herein related to extracting tabular data from a transmission server to a remote subscriber computer in a setting wherein the tabular data can only be transferred in a textual representation over an Internet connection, such as a web service, for example. An architecture based on parallel processing may speed up the extraction process by separating iteration from data processing and by introducing forward and reverse iterators for iterating a table from two ends simultaneously.

Computer-readable media, methods, and systems are disclosed for improving performance when dropping database snapshots by linking converter streams associated with adjacent snapshots in a database system. A request is received to drop a snapshot. The database system iterates a first converter tree associated with a first converter stream to identify a first physical page number to be loaded. A physical page corresponding to the first physical page number is loaded. The database system iterates a second converter tree associated with a second converter stream to identify a second physical page number to be loaded. The second physical page number is queried from an iterator associated with the first converter tree. Responsive to determining that the physical page associated with the second physical page number is not present in main memory, the in-memory database system loads from disk, the physical page associated with the second physical page number.

Various techniques are provided for enabling an iterator (called persistent key-value (KV) iterator) that uses a special key structure embedded with secondary index information for efficient search (or query) of a key-value database (KVDB). In some embodiments, the key structure comprises a plurality of fields categorized into two groups, infrastructure hierarchy fields and object characteristic fields. Keys for the KVDB may be partitioned into one or more levels of hierarchy to generate many smaller key lists for easy search / query of the KVDB. These smaller key lists can be used for concurrent searches / queries.

The present invention discloses a test data generation method, apparatus, test data generation equipment and storage medium, including: creating an iterator, a generator, a field processor and a writer through configuration information, which can realize the description of the scale, type, format, distribution law and constraints between data of the expected test data to be generated through the configuration information, and the corresponding iterator, generator, field processor and writer can be configured through the configuration information to generate test data that meets the expectations, so that after the user configures the information of the generated test data on the client, the test data covering the user's expected scenarios can be generated on the server, and the test data generation efficiency is improved. In addition, by modifying the configuration information, test data for different business needs and usage scenarios can be generated, and the adaptability is strong.

The invention discloses a database offline evaluation method, device and equipment, a medium and a product. The method comprises the following steps: in response to a database offline evaluation request, determining a grammar file used for describing grammar for data to be transferred out of a database, and determining a to-be-evaluated database file and a preset tag configuration file; constructing an abstract syntax tree and a traversal device according to the syntax file, the database file and a preset tag configuration file, and traversing the abstract syntax tree by adopting the traversal device to determine a target function point contained in the database file; and for each target function point contained in the database file, performing a function execution operation or a rewriting operation, and recording a compatibility condition of the target function point to generate an offline evaluation report. According to the technical scheme, the preset tag configuration file independent of the evaluation tool is used for describing the related information of the function points, the adaptation degree of the evaluation scheme can be improved, and efficient and accurate database offline evaluation is achieved.

The invention discloses an analysis processing system for heterogeneous data sources, which comprises a data source abstraction layer, a data processing layer, a standard access interface set, a data source abstraction layer, a data source abstraction layer, a data storage layer, a data processing layer and a data processing layer, and is characterized in that the heterogeneous data sources are uniformly packaged by adopting an iterator design mode, and a standard access interface set is provided; the data processing layer obtains original data from the data source abstraction layer; the flow execution layer packages a heterogeneous execution unit through a uniform WorkerBase base class, and the base class provides an initialization interface, an input / output port acquisition interface, a message notification interface, a working mode setting interface and a type acquisition interface; and the process builder is used for configuring a connection relationship between Workers, distributing tasks to a thread pool, adopting a work stealing mechanism for load balancing, and supporting merging of continuous tasks. A heterogeneous data source is packaged in a unified mode through an iterator interface, structural data rows are output, data zero transformation access is achieved, and meanwhile seamless compatibility and efficiency improvement of a heterogeneous analysis tool are achieved by means of a work stealing and task merging mechanism of a WorkerBase-based packaging multi-mode execution unit and a process builder.

Aspects of the present disclosure include methods, systems, and non-transitory computer-readable storage media for automatically generating reports based on, for example, flow cytometry data. A method for automatically generating a report according to certain embodiments includes: generating a report template based on an input from a user; selecting a source group and an iterator type based on input from the user, where the source group includes a plurality of data sets and the iterator type corresponds to a type of data present in the source group; and iteratively populating the plurality of bulk reports with the plurality of datasets of the source group based on the iterator type, where each bulk report conforms to the report template and populates with a separate dataset of the plurality of datasets of the source group. Aspects of the present disclosure also include methods of automatically generating reports, where such reports include one or more of an image, drawing, chart, table, legend, or text, and populate such reports with data from one or more data sets. Systems for implementing the subject methods are also provided. A non-transitory computer-readable storage medium is also described.

A Loop Pointer (LP) construct is disclosed for identifying terms in a recursive expression operated with an iterator. A Loop Pointer Variable (LPV) is assigned the current value of the recursive expression comprising one or more previous values or prior terms of the LPV. The prior terms or values are identified in source code by a loop pointer construct modifying a reference to the loop pointer variable. A compiler, responsive to encountering a loop pointer construct, generates instructions to access each of the one or more identified variable values for use in computation of the current value of the loop pointer variable at runtime. An access to the iterator construct output can request the terminal value of the loop pointer variable.

Architectures and techniques are described that can save a state of idempotent operations such as directory listing or iteration operations. Thus, these idempotent operations that do not complete can subsequently be continued without rework of the previously completed portions of the operations. The state of the idempotent procedure (e.g., a directory listing) can be saved in a serialized format and can allow the operation or procedure to be continued in a different execution context, including being continued across system, processing, or domain boundaries.

Various techniques are provided for enabling an iterator (called persistent key-value (KV) iterator) that uses a special key structure embedded with secondary index information for efficient search (or query) of a key-value database (KVDB). In some embodiments, the key structure comprises a plurality of fields categorized into two groups, infrastructure hierarchy fields and object characteristic fields. Keys for the KVDB may be partitioned into one or more levels of hierarchy to generate many smaller key lists for easy search / query of the KVDB. These smaller key lists can be used for concurrent searches / queries.

Provided in the present application are a method and apparatus for type inference of a programming language. The method comprises: in the process of developing program codes, acquiring a node to be inferred in an abstract syntax tree, wherein said node indicates a field to be inferred in the program codes, said field comprising one of the following fields: a variable, a class, a function, or a parameter; acquiring a constraint related to said node, wherein the constraint is used for indicating a relationship involved in said node in the abstract syntax tree; and on the basis of the constraint, determining the type of said node, wherein the type of said node is one of the following: a numeric type, a sequence type, a mapping type, a set type, an iterator type, a context manager type, a module type, a meta type, a null value type, or a callable type. The solution of the present application is conducive to reducing the memory usage of type inference.

Methods are described herein related to extracting tabular data from a transmission server to a remote subscriber computer in a setting wherein the tabular data can only be transferred in a textual representation over an Internet connection, such as a web service, for example. An architecture based on parallel processing may speed up the extraction process by separating iteration from data processing and by introducing forward and reverse iterators for iterating a table from two ends simultaneously.

The application discloses an analysis processing system of heterogeneous data sources, a data source abstraction layer, a uniform encapsulation of heterogeneous data sources by using an iterator design mode, a provision of a standard access interface set, a data processing layer for obtaining original data from the data source abstraction layer and converting the original data into structured data rows, a process execution layer for encapsulating heterogeneous execution units by using a uniform WorkerBase base class, the base class providing an initialization interface, an input / output port acquisition interface, a message notification interface, a work mode setting interface and a type acquisition interface, a process builder for configuring a connection relationship between workers, distributing tasks to a thread pool, adopting a work stealing mechanism for load balancing, and supporting the merging of continuous tasks. The heterogeneous data sources are uniformly encapsulated through the iterator interface and the structured data rows are output, data zero-reconstruction access is realized, meanwhile, the work stealing and task merging mechanism of the process builder and the encapsulation of the multi-modal execution units by using the WorkerBase base class achieve seamless compatibility and efficiency improvement of the heterogeneous analysis tools.

Aspects of the present disclosure include, for example, methods, systems, and non-transitory computer-readable storage media for automatically generating reports based on flow cytometry data. According to certain embodiments, a method for automatically generating a report includes generating a report template based on input from a user, selecting a source group and an iterator type based on the input from the user, where the source group includes multiple datasets and the iterator type corresponds to a type of data present in the source group, and iteratively populating multiple batch reports using the multiple datasets of the source group based on the iterator type, where each batch report conforms to the report template and is populated with a distinct dataset from the multiple datasets of the source group.

Architectures and instruction sets for non-general matrix multiplication operations are described. An example programmable processor, which implements these architectures and instruction sets, includes multiple processing engines, multiple buffers (with at least one buffer storing a multidimensional array), and multiple iterator tables stored in one of the multiple buffers. The multiple processing engines and multiple buffers are tightly coupled within an area of the programmable processor to enable high-bandwidth data communications between components of the programmable processor. Furthermore, the multiple iterator tables include an iterator table for each of the multiple buffers, and an iterator table enables read or write access to a respective buffer based on using multiple offset-stride tuples stored in the iterator table to derive addresses to access the multidimensional array stored in the respective buffer. Memory elements used by the multiple processing engines to perform operations using the multiple iterator tables consist of the multiple buffers.

The embodiment of the invention discloses a transaction conflict detection method and device, equipment, a storage medium and a product. The method comprises the steps that M to-be-executed transactions are obtained, the types of the M to-be-executed transactions comprise an iterator type and a non-iterator type, a read set of the to-be-executed transactions of the iterator type comprises range indication information and data items, the M to-be-executed transactions are executed in parallel, and a write set of each to-be-executed transaction is obtained, and performing conflict detection on the M to-be-executed transactions through the read sets and the write-in sets of the M to-be-executed transactions to obtain conflict detection results of the M to-be-executed transactions. Therefore, by adding the range indication information of the to-be-executed transactions of the iterator type into the read set, consistency detection can be carried out on the read set and the check set of the to-be-executed transactions of the iterator type, so that conflict detection can be carried out on the to-be-executed transactions of the iterator type and the non-iterator type which are executed in parallel.

A Loop Pointer (LP) construct is disclosed for identifying terms in a recursive expression operated within a branching construct, having a condition, within an iterator construct. A Loop Pointer Variable (LPV) is assigned the current value of the recursive expression comprising one or more previous values or prior terms of the LPV. The prior terms or values are identified in source code by a loop pointer construct modifying a reference to the loop pointer variable. A compiler generates instructions to access each of the one or more identified variable values for use in computation of the current value when the condition of the branching construct is met at runtime. An access to the iterator construct output can request the terminal value of the loop pointer value, a sequence of one or more of a series comprising updates to the value when the condition is met, or a series of the values in each iteration.

Compiler techniques lot inline parallelism and re-targetable parallel runtime execution of logic iterators enables selection thereof from the source code or dynamically during the object code execution.

The application provides a type inference method and device of a programming language, the method comprising: in the development process of program code, obtaining a node to be inferred in an abstract syntax tree, the node to be inferred indicating a field to be inferred in the program code, the field to be inferred comprising one of the following: a variable, a class, a function or a parameter; obtaining a constraint related to the node to be inferred, the constraint being used to indicate a relationship involved by the node to be inferred in the abstract syntax tree; determining a type of the node to be inferred according to the constraint, the type of the node to be inferred being one of the following: a numeric type, a sequence type, a mapping type, a set type, an iterator type, a context manager type, a module type, a metatype, a null type or a callable type. The scheme of the application is beneficial to reducing the memory occupation of type inference.

Various embodiments of the teachings herein include workflow generation methods. An example includes: receiving a behavior tree construction operation performed by a user on a GUI; generating a behavior tree comprising the first iterator node in response to the behavior tree construction operation; and parsing the behavior tree to generate a workflow, wherein the workflow indicates that each first iterative item executes the first work link based on the respective execution sequence in the first iterative item list. The construction operation comprises an addition operation for a behavior tree node, the behavior tree node comprises a first iterator node, the first iterator node comprises an input end adapted to receiving a first iterative item list, and a first work link, and the first iterative item list comprises a plurality of first iterative items and an execution sequence of each first iterative item.

A method, computer program product, and computing system for sensing a failure within a system within a computing device. The system may include a cache memory system and a vaulted memory comprising a random access memory (RAM) having a plurality of independent persistent areas. A primary node and secondary node may be provided. The primary node may occupy a first independent persistent area of the RAM of the vaulted memory. The secondary node may occupy a second independent persistent area of the RAM of the vaulted memory. Data within the vaulted memory may be written to a persistent media using an iterator. The data may include at least one dirty page. Writing data within the vaulted memory to the persistent media may include flushing the at least one dirty page to the persistent media.

The application provides a performance portable numerical simulation unified acceleration interface method, and relates to the technical field of data processing, and comprises the following steps: a topological matrix of data relations is traversed through an iterator; the iterator calculates position information of data in the topological matrix, and obtains data sequences; and each data sequence element is subjected to operator operation through the iterator. The application takes the iterator as the core, can support any number of arrays and parameters to participate in calculation, supports flexible calculation function definition of a user, supports a structure array to participate in calculation, makes the acceleration interface more intuitive to use, and meets actual requirements of acceleration calculation development and optimization.

The application discloses a key value storage method based on a multi-log structure merge tree, and comprises the following steps: 1, when a read-write request is received by a multi-log structure merge tree (MLSMT), the hash value of a key in the request is used to determine the log structure merge tree (LSMT) to which the key belongs i , and read-write operation is performed on the LSMT i ; 2, when a scanning request is received by the MLSMT structure, a grouping iterator is established for a file in the log structure merge tree, parallel threads are used to perform a key positioning operation (Seek), and a heap sorting is used to find a next key, so that data is read out; 3, a compaction operation is processed by using parallel threads in the background, and data belonging to a current LSMT i is read out from an LSMT i split from the LSMT s and written into an SST file of the LSMT i . The application can realize accelerated writing and merging of data, reduce the number of layers of a single log structure merge tree, and thus improve the read-write performance of a system.

The invention discloses a test data generation method and device, test data generation equipment and a storage medium, and the method comprises the steps: creating an iterator, a generator, a field processor and a writer through configuration information, and describing the scale, the type, the format, the distribution rule, the constraint between data and the like of test data expected to be generated through the configuration information. Through the configuration information, the corresponding iterator, the generator, the field processor and the writer can be configured to generate the test data meeting the expectation, so that after the user configures the information of the generated test data at the client, the test data covering the scene expected by the user can be generated at the server, the generation efficiency of the test data is improved, and the user experience is improved. In addition, the test data of different service requirements and use scenes can be generated by modifying the configuration information, and the adaptability is high.