205results about "Data merging" patented technology

Techniques for performing a scratch space flush of cold tier upsert data into cold tier storage while allowing continued hot tier ingestion are described. Data points to be written into a time series database having a hot tier and a cold tier may be designated to be written directly into the cold tier, bypassing the hot tier that typically stores new data points that eventually are aged out into the cold tier. New data points for insertion directly into the cold tier may be stored to a scratch space storage and moved into the cold tier according to a non-blocking protocol that allows for continued hot tier ingestion without significant service disruptions.

A method for merging data includes: obtaining an existing dataset and a new dataset; grouping the new dataset and the existing dataset based on data types to obtain a plurality of data type groups; performing data type specific processing to generate similarity features; generating a plurality of similarity matrices using the similarity features; performing a comparison between the existing dataset and the new dataset using optimization and the plurality of similarity matrices to identify mappings between the existing dataset and the new dataset; performing data type specific validation to obtain an updated existing dataset, an updated new dataset, matches, partial matches, and new items; obtaining user preferences associated with the mappings, the matches, the partial matches, and the new items; and generating merged data using the updated existing dataset, the updated new dataset, the mappings, the matches, the partial matches, the new items, and the user preferences.

A system for a materialized table (MT) refresh using multiple processing pipelines includes at least one hardware processor coupled to memory storing instructions. The instructions cause the at least one hardware processor to perform operations including determining dependencies among a plurality of intermediate MTs generated from a source MT. The source MT uses a table definition with a query on one or more base tables and a lag duration value. A graph snapshot of dependencies among the plurality of intermediate MTs is generated. Processing pipelines are configured. Each of the processing pipelines corresponds to a subset of the plurality of intermediate MTs indicated by the graph snapshot. Responsive to detecting an instruction for a refresh operation on the source MT, refreshes on corresponding intermediate MTs of the plurality of intermediate MTs in each processing pipeline of the processing pipelines are performed to complete the refresh operation on the source MT.

The present disclosure relates to techniques for inserting imagery from a real environment into a virtual environment. While presenting (e.g., displaying) the virtual environment at an electronic device, a proximity of the electronic device to a physical object located in a real environment is detected. In response to detecting that the proximity of the electronic device to the physical object is less than a first threshold distance, imagery of the physical object is isolated from other imagery of the real environment. The isolated imagery of the physical object is inserted into the virtual environment at a location corresponding to the location of the physical object in the real environment. The imagery of the physical object has a first visibility value associated with the proximity of the electronic device to the physical object.

A method includes generating, by a large language model (LLM), a multitude of search queries from a user input term obtained from a user application. The method further includes, executing, by the LLM, the multitude of search queries to obtain a multitude of verified search results regarding a multitude of candidates. A multitude of web presence schemas corresponding to the multitude of candidates from the multitude of verified search results is generated. The method further includes web-scraping a multitude of websites of a subset of candidates selected from the multitude of candidates to obtain a set of corresponding web-scraping payloads. The method further includes merging the corresponding web-scraping payloads with corresponding web presence schemas of the subset of candidates to obtain a multitude of updated web presence schemas. The method further includes presenting the multitude of updated web presence schemas of the subset of candidates in the user application.

A computer-implemented method includes receiving data generated using at least one sensor of a vehicle; and using a multi-task neural network to simultaneously perform multiple different prediction tasks on the data, wherein the multi-task neural network includes at least one shared parameter inference matrix, the shared parameter inference matrix includes parameters shared between the multiple different prediction tasks, and the at least one shared parameter inference matrix is ​​over-parameterized during training into at least one shared parameter matrix and multiple task-specific parameter matrices, each of the multiple task-specific parameter matrices is associated with a different task in the multiple different tasks.

The embodiments of the disclosure provide a dada shuffling method, apparatus and device, a computer-readable storage medium and product. The method comprises: acquiring a data shuffling request; acquiring a shuffling request parameter linked list associated with the at least one data to be shuffled based on the data shuffling request; performing a merging operation on shuffling request parameters in the shuffling request parameter linked list according to the data amount of the data segment corresponding to the shuffling request parameter and memory buffer information to obtain at least one target request parameter; and caching the data to be shuffled corresponding to the at least one target request parameter to a predetermined remote direct memory access network card; and distributing respectively data segments associated with at least one data to be shuffled cached in the remote direct memory access network card to a target server of the data segment.

The present application relates to a device for selecting top values from a set of raw values, comprising: an output queue, a loop queue, a top value storage module and a control module. The control module is configured to, at a higher priority, merge the intermediate sequence stored in the loop queue with the at most N top values stored in a storage area of the top value storage module, and sort the merged values to generate a merged sequence, until a predetermined number of storage areas in the top value storage module are traversed; wherein the control module is further configured to, when there is no intermediate sequence being stored in the loop queue, merge the output sequence with the at most N top values stored in a storage area of the top value storage module, and sort the merged values to generate a merged sequence; wherein the control module is further configured to provide a first subsequence in the merged sequence which is closer to a top most value of the merged sequence to the top value storage module to update the top value storage module, and provide a second subsequence in the merged sequence which is farther away from the top most value of the merged sequence to the loop queue to generate or update the intermediate sequence.

Computer-readable media, methods, and systems for comparing and migrating multiple online user accounts from multiple online platforms while reducing the probability of false mergers. At least one first online platform comprising a plurality of online accounts associated with the first online platform may be compared with at least one second online platform comprising a plurality of online accounts associated with the second online platform. The comparison further includes comparing the one or more fields of personally identifiable information associated with the first user and the one or more fields of personally identifiable information associated with the second user while excluding known improbable values. Following the comparison between the online accounts, a migration outcome may be determined for creating a new online account, migrating online accounts across online platforms, or consolidating online accounts.

Embodiments of the present application relate to the technical field of artificial intelligence. Disclosed are a method and apparatus for attention calculation in an artificial intelligence model. The method comprises: acquiring a plurality of elements requiring attention calculation; generating a Q matrix, a K matrix, and a V matrix required for attention calculation and corresponding to the plurality of elements; determining a position of valid data in a relation matrix corresponding to the Q matrix and the K matrix; on the basis of the determined position of the valid data in the relation matrix, determining calculation data for matrix multiplication calculation in the Q matrix and the K matrix; performing matrix multiplication calculation on the determined calculation data in the Q matrix and the K matrix to obtain the relation matrix; and performing an operation on the relation matrix and a V matrix to implement attention calculation. By means of the present application, invalid data can be prevented from participating in attention calculation, thereby improving the attention calculation efficiency.

A computer-implemented method and a smart-learning and knowledge retrieval system (SLKRS) are provided for imparting adaptive and personalized e-learning based on continually artificially learned unique characteristics of a knowledge seeker. A chatbot platform with a chatbot interface provides for interaction between the knowledge seeker, a parent, a teacher, or another stakeholder. The chatbot platform allows multiple channels of engagement. The chatbot platform provides translation services comprising text to speech and speech to text service. The chatbot platform integrates third-party services into its responses to the user and queries from the user through the integration module. The chatbot platform performs pattern recognition and checks simplified and rephrased questions against a knowledge base. The chatbot platform uses conversation audits to train artificial intelligence and machine learning algorithms, to generate an appropriate response to the query of the knowledge seeker.

This application provides example data processing methods and systems. One example data processing method includes obtaining a first metadata stream of a first file system, where the first metadata stream is a streaming structure and includes multiple records, and each of the multiple records includes an identifier of a node in the first file system, an identifier of a parent node of the node, and an attribute of the node. A hierarchy of multiple nodes in the first file system is determined based on the first metadata stream.

A method and apparatus for performing single-stage merge sorting of at least two pre-sorted input lists. The method and apparatus can provide a stable merge such that a value in an input list with a higher stable property will precede an equal value in another input list with a lower stable property when mapped into the single sorted output list. The method and apparatus preferably perform the merge sorting in a set of single-stage operations and are most preferably implemented in asynchronous combinatorial logic, which uses no internal clocking—although synchronously clocked operations can be used and will provide desirable results.

Systems and methods for rendering static and dynamic data in tablature are disclosed. A system may include at least one processor configured to output a signal for rendering a table containing a plurality of cells, wherein at least a first cell may be enabled to contain static data and at least a second cell is enabled to contain dynamic data. The processor may provide access to a menu of values for inclusion in at least the second cell, wherein the menu of values identifies dynamic data values associated with selectable animations. The processor may enable selection of a dynamic data value to specify an associated selectable animation for inclusion in the second cell, and may cause the associated selectable animation in the second cell to dynamically display while the first cell displays static data.

Provided is a data compaction method that includes: determining, by an electronic device, a plurality of Sorted String Table (SSTable) files on which a compaction operation is to be performed among SSTable files stored in a storage device connected to the electronic device, the data in the SSTable files stored in the storage device is stored based on a Log Structured Merge Tree (LSM-Tree) mechanism; based on receiving the plurality of SSTable files from the storage device, performing, by the electronic device, merge sorting on data in data blocks of the plurality of SSTable files based on indexes of the data in the data blocks of the plurality of SSTable files, to obtain reconstructed data blocks; and sending, by the electronic device, the reconstructed data blocks to the storage device, the reconstructed data blocks being used by the storage device to obtain reconstructed SSTable files.

A method for data processing is described. The method may include retrieving, from a cloud storage environment accessible to a data management system (DMS), two or more observability data sets associated with a set of time intervals within a selected time range. The observability data sets may contain a set of time-partitioned data blocks that include tracing data associated with operations performed by one or more nodes of a node cluster of the DMS during the selected time range. The method may further include merging the tracing data by selecting a first subset of overlapping time-partitioned data blocks, omitting a second subset of the overlapping time-partitioned data blocks, and retaining one or more non-overlapping time-partitioned data blocks. The method may further include transmitting data corresponding to a visualization of the merged tracing data.

Methods, computer program products, and systems are presented. The methods, computer program products, and systems can include, for example, processing multiple datasets using metadata, wherein the metadata can characterize relationships among datasets. In dependence on such metadata, production datasets can be, e.g., generated, versioned, and / or merged. The resulting production datasets can support subsequent computing uses such as analytics, machine learning, application testing, and / or enterprise processing.

The embodiment of the invention discloses an attention calculation method and device in an artificial intelligence model, and belongs to the technical field of artificial intelligence. The method comprises the following steps: acquiring a plurality of elements which need to be subjected to attention calculation; generating a Q matrix, a K matrix and a V matrix required by attention calculation corresponding to the plurality of elements; and determining the positions of effective data in the relation matrix corresponding to the Q matrix and the K matrix in the relation matrix. And determining calculation data for matrix multiplication calculation in the Q matrix and the K matrix according to the determined position of the effective data in the relation matrix. And performing matrix multiplication calculation on the determined Q matrix and K matrix calculation data to obtain a relation matrix. And carrying out operation on the relation matrix and the V matrix to realize attention calculation. By adopting the data processing method and device, invalid data can be prevented from participating in the attention calculation, and the efficiency of the attention calculation can be improved.

The invention discloses a method for realizing data multi-field sorting based on JavaScript, which comprises the following steps: S1, receiving a single or mixed sorting request aiming at original data including Chinese, English, numbers, version numbers, dates, intervals, '--', null, 'null' and '(null)', the sorting request carrying the original data and a sorting field array; s2, sequencing the fields according to the sequencing sequence of the sequencing field array in the step S1; and S3, sorting the field data according to the sorting sequence of the object arrays in the sorted field array obtained in the step S1 and the field sorting sequence obtained in the step S2. The invention relates to a front end for realizing multi-column sequential mixed sorting of data, and meets the requirement of a user for checking the data by multi-dimensional sorting.

A list sort instruction is provided to perform a sort and / or merge operation. The instruction is an architected machine instruction of an instruction set architecture and is executed by a general-purpose processor of a computing environment. The execution includes sorting a plurality of input lists to obtain one or more sorted output lists as output.

Methods and apparatus to generate and display trends associated with a process control system are disclosed. An example apparatus includes memory, machine readable instructions, and processor circuitry to execute the instructions to generate a first graphical user interface. The first graphical user interface to include a graphical representation of a component in a process control system. The processor circuitry to generate a second graphical user interface. The second graphical user interface to include a chart region with a trend represented therein. The trend indicative of values of a process parameter of the process control system over a period of time. The processor circuitry to automatically generate the trend in the chart region in response to a graphical element being dragged and dropped from the first graphical user interface to the second graphical user interface.

The present disclosure generally relates to methods, systems, apparatuses, and non-transitory computer readable media for managing file generation and retention. These systems may be of used across a wide range of businesses to significantly automate the generation, storage, and eventual deletion of files. In particular, embodiments of the present disclosure may centralize storage of generated files on a first server. A second server may be connected to the first server so as to seamlessly display certain information about these stored files. This displayed information may allow a user of the second server to seamlessly access these stored files while simultaneously avoiding transmitting the files to the second server itself. By doing so, the first server maintains control over the first file and may, according to the retention policy specified at the file's creation, ensure that the file is deleted after the appropriate amount of time.

A processor comprising storage, execution circuitry and a handling unit. The handling unit is configured to obtain operation data indicative of an operation to be executed using the execution circuitry. The execution circuitry is configured to operate over a multi-dimensional nested loop defining an operation space. The handling unit obtains a dimensional combination instruction and, in response, combines a plurality of dimensions of the operation space to obtain a local space dimension in an operation-specific local space as part of a procedure to map each operation block of a plurality of operation blocks in the operation space to a different respective local block in the local space dimension. The handling unit dispatches invocation data for the plurality of operation blocks to the execution circuitry. The invocation data for each respective operation block specifies a local space dimension range of a local block to be operated on for the respective operation block.

A hierarchy is a multi-level linked structure of nodes, wherein the hierarchy represents data relating to a set of one or more items to be processed. Where there are multiple input hierarchies, it may improve the efficiency of the processing of the items to merge the input hierarchies to form a merged hierarchy. The hierarchies are merged by identifying two or more sub-hierarchies within the input hierarchies which are to be merged, and determining one or more nodes of the merged hierarchy which reference nodes of the identified sub-hierarchies. The determined nodes of the merged hierarchy are stored and indications of the references between the determined nodes of the merged hierarchy and the referenced nodes of the identified sub-hierarchies are also stored. In this way, the merged hierarchy is formed for use in processing the items.

The present disclosure generally relates to methods, systems, apparatuses, and non-transitory computer readable media for managing file generation and retention. These systems may be of used across a wide range of businesses to significantly automate the generation and storage of files. By utilizing nested file templates as described below, systems of the present disclosure may increase the ease in which a file template may be generated. Moreover, by using the file retention storage system described below, system of the present disclosure may simplify the process of ensuring files are retained for an appropriate amount of time and further assuring that files are deleted when they no longer need to be retained.

A query processing device comprising: a communication interface for accessing a database and a database directory; the memory is used for storing instructions; and a processor coupled to the memory and the communication interface. The processor executes the instructions to: parse a query to generate first and second execution plans for the query; retrieving, from the database directory, respective previously determined radix values for previously executed logical steps of the first and second execution plans; selecting an execution plan from the first execution plan or the second execution plan, the selected execution plan having a lower cost based on the previously determined cardinal value; and executing the selected execution plan on data accessed from the database. The query processing system stores an actual radix value determined during execution of the logical step in the database directory for use by subsequent queries. Accordingly, the query processing apparatus may reuse a previously determined cardinal value.

The present invention provides a data merging method and apparatus of a physical random access channel, and a storage medium. The method comprises: parsing task parameters of this PRACH data merging; reading PRACH data to be merged of an antenna from a PRACH data cache; carrying out, according to the task parameters, PRACH data merging between a plurality of antennas and / or RACH data merging in a PRACH of this antenna; and outputting the merged data to a shared cache.

A high frequency snapshot technique improves data replication in a disaster recovery (DR) environment. A base snapshot is generated from failover data at a primary site and replicated to a placeholder file at a secondary site. Upon commencement of the base snapshot generation and replication, incremental light weight snapshots (LWSs) of the failover data are captured and replicated to the secondary site. A staging file at the secondary site accumulates the replicated LWSs (“high-frequency snapshots”). The staging file is populated with the LWSs in parallel with the replication of the base snapshot at the placeholder file. At a subsequent predetermined time interval, the accumulated LWSs are synthesized to capture a “checkpoint” snapshot by applying and pruning the accumulated LWSs at the staging file. Once the base snapshot is fully replicated, the pruned LWSs are merged to the base snapshot to synchronize the replicated failover data.

The present disclosure relates to methods for administering access to generated files. The method involves storing a file on a server. The server receives a request from a first client device to generate a uniform resource identifier (URI) associated with the file, an identity, and a dynamic expire time. The server generates the URI, which links to a resource comprising the file, and transmits it to a second client device. The server then receives a request from the second client device using the URI to request the resource. The server validates the identity by checking it against a database of authorized identities. Additionally, the server validates the identity through an identity provider, which prompts the user to login to the identity on an identity hosting platform. Based on the response from the server and the identity provider, access to the resource is granted or denied. Based on that access and retention parameters, viewing is allowed, or may be removed if credentials such as viewing time or count is exceeded or biometric scan fail.

Disclosed are methods, apparatus, and systems for clustering processes used by a cloud platform. Process clustering may include receiving business data transmitted and received between each pair of processes in a process set. A matrix may be generated based on the business data, the matrix including a row and a column for each process in the process set. Hierarchical clustering may be performed on the matrix based on the business data, the hierarchical clustering outputting a plurality of clusters, each cluster including one or more processes in the process set. The plurality of clusters may then be merged into a set of merged process clusters.