17 results about "Fragment identifier" patented technology

The invention provides a right delivery-oriented short link suffix high-strength random generation method and system, and relates to the technical field of data processing and right delivery crossover, the method comprises the following steps: obtaining a true random number sequence through a hardware physical entropy source, and according to a mapping rule of the true random number sequence and a preset character set, obtaining a random number sequence; generating a random character string as a short link suffix; performing Hash calculation on the short link suffix to obtain a corresponding first Hash value; converting the first hash value into an integer value; the method comprises the following steps: acquiring a currently available database fragment identifier set based on a preset fragment configuration strategy, and further respectively calculating a corresponding combined weight value based on an integer value and each database fragment identifier in the database fragment identifier set; according to the method, the security defect of pseudo-random generation of the short-link suffix software can be solved, storage load balance and intelligent resource allocation are realized, and the real-time property of right verification and cancellation is ensured.

The invention relates to an energy storage data transmission method and system and a storage medium. The energy storage data transmission stability and the energy storage data assembly overhead can be balanced. The method comprises the steps that a data sending end obtains first network state information, dynamic fragmentation processing is carried out on energy storage data to be transmitted according to the first network state information, data fragments are obtained, and each data fragment carries a corresponding fragment identifier and a fragment sequence number; the data sending end encapsulates the data fragments to obtain corresponding messages to be transmitted; the data sending end sends the to-be-transmitted message to a message queue in a message queue server for storage according to the first network state information; and the data receiving end obtains the to-be-transmitted message from the message queue of the message queue server, and recombines the data fragments in the to-be-transmitted message according to the fragment identifier and the fragment sequence number carried by the data fragments in the to-be-transmitted message to obtain the to-be-transmitted energy storage data.

This invention discloses a user-generated content sharing system with fine-grained access control, specifically relating to the field of user-generated content sharing and data access control. It includes an end-to-end sharing module for writing published user-generated content into fragment identifiers based on text segments, image objects, and attachment objects, attaching the initial receiving scope and initial re-sharing action to the fragment identifiers, and generating an original shared copy. This invention solves the problem in existing technologies where, when receiving user-generated content, it is impossible to limit the content segments that can be brought out, the receiving object scope, and the re-sharing action based on the current shared copy by splitting user-generated content into fragments and generating an original shared copy.

The invention provides an Internet of Things data storage method and system based on a BCH code, and belongs to the technical field of data processing, and the method comprises the steps: firstly obtaining and coding an original data packet, and generating a BCH coding data block; then, constructing a storage network topology comprising a plurality of relay nodes and aggregation nodes, and pre-defining a logic association relationship for forming an incomplete connection graph structure for each relay node; distributing the data blocks to the selected part of relay nodes for storage; generating verification information fusing the storage content, the fragment identifier and the associated node information for each storage node; generating a verification path passing through at least two relay nodes based on the topology and logic association relationship; and sequentially acquiring verification information or data fragments of each node along the path, and executing chained verification on the BCH coded data block to complete integrity verification. Through the combination of coding fault tolerance, topological distributed storage and relevance chained verification, the reliability and verification efficiency of data storage of the Internet of Things are improved.

The invention relates to the technical field of databases, and particularly provides a data migration method and device and electronic equipment. The method comprises the following steps: in response to a data emigration event, finding metadata corresponding to prefixes associated with a fragment identifier to be emigrated according to a sequence of data layers from high to low, and migrating the found metadata to a target node; in the data migration process, if a metadata transaction which needs to be written into the to-be-migrated fragment corresponding to the to-be-migrated fragment identifier is received, writing the received metadata transaction into a specified storage space in a memory table MemTable of a database; and after metadata migration of the to-be-migrated fragment in the data layer is completed, migrating each metadata transaction recorded in the specified storage space to a target node. Therefore, batch query can be performed through the to-be-migrated fragment identifier, and newly received metadata transactions can be aggregated and cached, so that the data migration efficiency is improved, and consumed resources are reduced.

A method and a secure zero-knowledge storage system managed by a proxy server connected to a plurality of online storage services, the file to be stored being split into a plurality of fragments saved on the plurality of online storage services, each online storage service being capable of verifying the identity of the user requesting a file, the original file identifier and the link between the original file identifier and the fragment identifier without acquiring knowledge of the original file identifier.

The invention discloses an encrypted data fragment storage, retrieval and verification method and system based on a decentralized network, and belongs to the technical field of distributed computing and data security. The method comprises the following steps: encrypting to-be-stored data based on attributes and segmenting the to-be-stored data into a plurality of fragments; embedding a unique hidden watermark associated with a fragment identifier and owner information for each fragment; chaining the fragment hash, the watermark information and the storage strategy as metadata; dynamically scheduling fragmented storage nodes through combination of an intelligent contract and node real-time reputation; a hybrid verification mechanism is adopted, the storage integrity is verified in combination with probabilistic spot check and periodic auditing, and the node reputation is updated in real time according to a verification result; and dynamically adjusting the fragment redundancy and the storage position according to the data access popularity, and realizing differential excitation linked with the data life cycle through the smart contract. The system comprises a client module, a decentralized storage node and a block chain network. According to the method, data security, reliable storage, efficient retrieval and adaptive resource optimization are realized, and the method is suitable for a decentralized storage scene.

The invention discloses a big data distributed storage method and device based on the Internet of Things and a medium, and relates to the technical field of distributed storage, and the method comprises the steps: building a naming rule, carrying out the ordered combination of an object attribute identifier set in an Internet of Things data writing request, and generating an Internet of Things naming identifier, packaging the Internet of Things naming identifier and the data load into a naming write-in request packet; executing naming analysis on the Internet of Things naming identifier in the naming write-in request packet, determining a target fragment identifier, and generating a fragment routing result packet; and according to a fragment node set in the fragment routing result packet, writing the data load into a fragment data segment corresponding to the target fragment identifier, executing index registration on the Internet of Things naming identifier, generating a distributed index entry, and registering the distributed index entry as an available state. According to the method and the device, the fragment routing result packet is generated based on the target fragment identifier by executing naming analysis, so that high efficiency and flexibility of data storage and routing are realized.

The application provides a DPU-based remote direct memory access transmission method, device and program product, relates to the technical field of data transmission, and comprises the following steps: determining the data packet length of a target data packet; in the case that the data packet length is greater than a preset data packet length, splitting a pre-packaging work request element corresponding to the target data packet into a plurality of fragments in the process of submitting the target data packet to a sending queue; setting a fragment identifier for each work request element; in the same fragment, the first fragment identifier corresponding to the last work request element is different from the second fragment identifier corresponding to other work request elements; submitting the plurality of fragments to the sending queue; sending the target data packet to a second terminal through a first PCIe module, so that the second terminal receives the target data packet through a second PCIe module, and determining the generation of a completed queue entry based on the fragment identifier corresponding to each work request element; and the problems of high requirement for hardware performance and poor compatibility can be solved.

Systems and methods of content reuse are disclosed. A user input may be received to include a portion of a source document, from a source system, into a target document. The source document may be associated with a source document identifier. A cache document, including a cache fragment may be generated. The cache fragment may include the portion of the source document. A cache document identifier associated with the cache document may be generated. The cache document identifier may be associated with the source document identifier. A target document including a target fragment may be generated. The target fragment may include the cache fragment from the cache document. A target fragment identifier associated with the target fragment may be generated. The target fragment identifier may be associated with the cache document identifier, the source document identifier, or both the cache document identifier and the source document identifier.

The embodiment of the invention discloses a sorting data processing method and device, electronic equipment, a computer readable medium and a program product. A specific embodiment of the method comprises: in response to a first data write-in request for an original cache key in a target cache received for the first time, segmenting a storage space of the original cache key to obtain a preset number of logic fragments, the first data write-in request comprising a first user identifier and a first sorting metric value corresponding to the first user identifier; constructing a metadata object associated with each logic fragment in the preset number of logic fragments; writing the first user identifier and the first sorting metric value into a first logic fragment in the preset number of logic fragments; and recording a mapping relationship between the first user identifier and the first fragment identifier of the first logic fragment in the dynamic index storage area. The implementation mode is related to big data, the storage capacity of a storage system for a large amount of sorted data can be improved, and meanwhile the requirements of high-concurrency read-write and low-delay ranking query scenes are met.

The application provides a hierarchical knowledge base construction method and system for the field of battery design, which comprises the following steps: obtaining original text data and constructing a unique joint primary key from data sources, data types and original identifiers, storing the original text data in a metadata table, and decomposing the original text data into multiple sentence segments, each sentence segment being configured with a segment identifier and a role label; performing differential processing on the nodes extracted from the sentence segments, writing the processed nodes into a knowledge graph node table after deduplication, and writing the position information of the nodes in the sentence segments, the segment identifiers, the original text data and the character offset into a knowledge graph mention table; constructing entity pairs from the nodes in the sentence segments, generating semantic relationship calculation confidence degrees by a preset large language model, marking primary evidence and auxiliary evidence, and updating the primary evidence corresponding to the semantic relationship when the current semantic relationship confidence degree is higher than the original semantic relationship confidence degree after comparison of the confidence degrees; and the method can realize text data tracing and improve the information integrity of stored data.

The invention discloses a retrieval fragment reference marking method and device based on a streaming big language model and a medium, belongs to the technical field of natural language processing, and aims to solve the problems that reference marks cannot be stably analyzed in a streaming output stage of an existing model, a unified reference format and a reference list required by front-end display are difficult to synchronously output from a streaming text, and the data processing efficiency is low. Therefore, the technical problem of insufficient interpretability of large language model reply is solved. The method comprises the following steps: in a large language model streaming generation process, acquiring a streaming text which is generated step by step and a retrieved reference fragment; constructing a short window buffer pool, identifying a source identifier of the streaming text in real time, and performing alignment processing on the source identifier and a fragment identifier corresponding to the reference fragment; based on the aligned streaming text and reference fragment, generating an incremental text and an effective reference list; and based on the reference fragment and the answer-side context in the effective reference list, positioning a text range directly related to the answer in the reference fragment, and performing highlight labeling.

The invention provides an auxiliary material authentication method and system, and is applied to a first chip, the first chip communicates with a plurality of second chips through a server, the second chips communicate with host equipment, and the second chips are installed on auxiliary materials, and the method comprises the steps: obtaining token tree data from the plurality of second chips, the token tree data comprises a root token identifier and a plurality of first sub-tokens, each first sub-token carries a fragment identifier, and the fragment identifier is used for indicating a second chip corresponding to the first sub-token; an identity authentication request from the second chip is received through the server, the identity authentication request carries a random challenge value, and the identity authentication request is sent to the second chip by the host device; selecting a second sub-token in the validity period from the plurality of first sub-tokens; generating authentication response data according to the second sub-token and the random challenge value, and obtaining a target fragment identifier of the second sub-token; and sending authentication response data to a second chip corresponding to the target fragment identifier through the server.

The invention provides a content distribution method and device, electronic equipment and a storage medium, and the method comprises the steps: segmenting digital content into a plurality of content fragments, storing the content fragments in a distributed storage network, and obtaining a plurality of fragment identifiers corresponding to the content fragments; based on the plurality of fragment identifiers and the copyright information of the digital content, generating a digital copyright voucher bound with the digital content on a distributed trust account book; in response to the content access request, verifying the validity of the digital copyright certificate; and under the condition that the verification is passed, analyzing at least one fragment identifier corresponding to the content access request from metadata associated with the digital copyright certificate, and obtaining a corresponding content fragment from a service node in the peer-to-peer network based on the at least one fragment identifier. Therefore, the problem of out-of-control content propagation caused by lack of an effective copyright protection mechanism in the existing peer-to-peer network scheme is solved.

The invention discloses an enterprise memory-oriented retrieval pre-access control method, which comprises the following steps of: generating a user capability bitmap for each user, and generating a fragment requirement bitmap for each enterprise memory fragment; receiving a user query and generating a query vector, and recalling a candidate fragment identification sequence from the vector index based on approximate nearest neighbor search; for each candidate fragment, reading a fragment requirement bitmap of the candidate fragment, and carrying out bit operation inclusion judgment on the fragment requirement bitmap and the user capability bitmap; and sorting the candidates in the candidate pool according to the similarity, performing secondary permission verification on a sorting result by using the latest user capability bitmap and the fragment requirement bitmap before final output, removing the candidates which do not pass the verification, and recording an audit log. According to the retrieval pre-access control method for enterprise memory, permission judgment is pre-posed before vector loading and actuarial, the non-permission content contact surface is blocked, the computing power waste and delay are reduced, and the output compliance under dynamic permission change is ensured through secondary verification.

The invention provides a log tracking method and device, equipment, a medium and a program product, relates to the technical field of data processing, and aims to solve the problem of relatively low fineness of log tracking in an AI dialogue process. The method comprises the following steps: receiving question information sent by a client; processing the question information by using a preset artificial intelligence model to obtain answer information corresponding to the question information, the answer information comprising at least one fragment, and the fragment being a data fragment obtained by splitting the answer information; generating at least one fragment identifier in one-to-one correspondence with the at least one fragment; the at least one fragment is sent to the client in sequence; log tracking is conducted on the at least one fragment based on the at least one fragment identifier, a fragment log is obtained, and the fragment log comprises time consumption information corresponding to the at least one fragment. According to the invention, the fineness of log tracking in the AI dialogue process can be improved.