197 results about "Data striping" patented technology

The invention relates to the technical field of computer storage, in particular to an encryption method and related equipment. The encryption method comprises the following steps: generating a unique device identifier through a polymorphic ring structure, wherein the unique device identifier is used for generating a unique identifier and a key of the solid-state storage device; based on the generated device identifier, a multi-dimensional dynamic key is generated in combination with a multi-dimensional mixed function and is used for data encryption; and encrypting the segmented data by using a multi-dimensional dynamic key, and embedding a progressive vector check code into each data segment to enhance the security of the data segment level. According to the method, the defects of the existing solid-state storage equipment encryption technology in the aspects of key management, encryption mechanism, key irreversibility, real-time monitoring and the like are overcome, and all-around guarantee is provided for data storage security.

The invention discloses a storage space management method and device, a storage medium, electronic equipment and a program product, and relates to the technical field of distributed storage, and the method comprises the steps: obtaining a plurality of physical addresses of a plurality of physical storage equipment on a server corresponding to different nodes in a distributed storage system; a plurality of physical addresses are connected in series to generate address space pools corresponding to different servers, and linked lists corresponding to the address space pools are determined; under the condition of determining that the target object initiates the logical volume creation request, determining a target number of logical addresses from the address space pool according to the linked list, and recording a mapping relationship among the logical volume, the logical addresses and a target physical address associated with the logical addresses; the storage space associated with the logical volume is managed based on the mapping relation, the storage space at least comprises two physical storage devices, and the problem that when an existing distributed storage system carries out data storage, metadata access delay is caused by data striping is solved.

The invention provides a request processing method and system, and relates to the field of data storage, and the method comprises the steps: in response to a data operation request, determining a target physical memory address applied by target data needing to be accessed by the data operation request in a graphics processor; establishing a transmission path between the distributed file system and the graphics processor based on the target physical memory address; segmenting the target data into a plurality of data segments with different data attributes; selecting a corresponding target transmission protocol for the plurality of data segments, and distributing the plurality of data segments to different transmission sub-paths; determining a target position of the target data in the distributed file system according to the data operation request; and transmitting the plurality of data segments from a target position in the distributed file system to a target physical memory address of the graphics processor in parallel. According to the customized transmission mode, low efficiency and delay of a one-cutting mode are avoided, and the transmission efficiency is improved.

The invention discloses a UWB indoor positioning method suitable for a sparse base station. The method comprises the following steps: acquiring a distance and a time sequence between a UWB label and each known point base station under a sparse deployment condition; segmenting the time sequence ranging data by taking R as a step length, and calculating an average value of each segment of ranging data to obtain ranging data output by the average value; gaussian filtering processing is carried out on the output ranging data; inputting the UWB epoch state in the ranging data and the UWB tag coordinates of the point to be measured as state vectors into a Kalman filtering model, and updating the state vectors by using the ranging data after Gaussian filtering processing; and outputting the UWB tag coordinates of the to-be-detected point obtained by the last update as a positioning result. According to the method, quality control is carried out on signals of the sparsely deployed UWB base stations, and high-precision positioning can still be achieved under the conditions that the indoor environment is closed and the deployment density of the UWB base stations is low.

The invention discloses a centralized heating data analysis system for dispersed users based on the Internet of Things, relates to the technical field of centralized heating, and solves the technical problem that it is difficult to process and analyze sampled data of a heating system for each area and time stage of the heating system; the heating data is divided into different subsets according to the startup stage, stable operation stage and shutdown stage of the heating system through a data segmentation processing module; a normal data recognition model for each stage is established by extracting features from each subset of historical heating data; there may be significant differences in heating characteristics and demands in the startup stage, stable operation stage and shutdown stage, and these differences can be better captured by modeling each stage separately, thereby improving the prediction accuracy of the model; at the same time, in the stable operation stage, the state of the system is relatively stable and the data noise is less, which helps to improve the model's recognition ability for the normal state.

The embodiment of the invention provides a data transmission method and device, and the method is applied to a transmitting end, and comprises the steps: sequentially carrying out the segmentation processing of a to-be-transmitted data block; performing first deterministic processing on the data segments obtained after each segment processing to obtain target data segments; and sending the target data segments to a receiving end. Therefore, the problem that a determinacy guarantee strategy for big data transmission does not exist in the related technology is solved, the determinacy of data segment transmission can be guaranteed, the determinacy of whole data block transmission can also be guaranteed, errors found in the data segment process can be found in time, and remedial measures can be provided.

The invention relates to the technical field of Beidou data transmission, in particular to a Beidou data transmission method and system. Comprising a data acquisition module, a data integration judgment module, a data segmentation transmission module, a data analysis module, a packaging module, a sending module and a receiving output module, the data integration judgment module is connected with the data acquisition module, the data segmentation transmission module is connected with the data integration judgment module, the data analysis module is connected with the data segmentation transmission module, and the packaging module is connected with the sending module. The packaging module is connected with the data analysis module and the data integration judgment module, the sending module is connected with the packaging module, and the receiving output module is connected with the sending module; according to the data transmission method and device, after the data needing to be transmitted are analyzed and judged, the big data with the large transmission risk are correspondingly transmitted in a segmented mode, and the situations that packet loss is caused and the overall transmission quality is affected due to the fact that the transmission data is too large are avoided.

The invention provides a data compression processing method and system, and the method comprises the steps: obtaining a backup data stream corresponding to a current data compression processing task, and carrying out the data segmentation processing of the backup data stream, and obtaining a plurality of data segments; writing the plurality of data segments into a data backup system, and if it is determined that data blocks in the data segments are sequentially distributed in a container in the data backup system according to the container reference rate of the container in the data backup system, performing data deduplication processing on the first data block, the first data block is a data block in which the data blocks in the data segment are sequentially distributed in a container in the data backup system; and local joint deduplication processing is carried out on other data blocks except the first data block in the container in the data backup system to complete the current data compression processing task, and the local joint deduplication processing comprises multi-container data deduplication processing and differential compression processing. When data compression processing is carried out, the performance and the reliability of the data backup system are improved.

An example method includes receiving, by a first application executing on a primary device and from a second application executing on the primary device, an indication of data to be transferred, wherein the primary device and the vehicle head unit are communicatively coupled via a wireless network connection operating in accordance with a wireless networking protocol; determining, by the first application and based on the indication of the data, an amount of data to be transferred; determining, by the first application, whether the amount of data satisfies a maximum packet size for the wireless networking protocol; responsive to determining that the amount of data does not satisfy the maximum packet size: segmenting the data into a plurality of packets, wherein each packet from the plurality of packets includes an amount of data that satisfies the maximum packet size; and sending the plurality of packets using the wireless network connection.

The invention belongs to the technical field of optical precision control, and particularly relates to an automatic calibration system and method for a fast steering mirror sensor, and the calibration method comprises the following steps: S1, carrying out the initialization configuration; s2, generating and sending an instruction sequence; s3, data storage: storing the angle data, fed back by the autocollimator, of the fast steering mirror; s4, dynamic calibration parameters are generated through data segmentation and data fitting; S5, calibration output is carried out; and S6, performing real-time compensation. The calibration system comprises an autocollimator, an upper computer and a fast reflecting mirror controller, a step angle instruction is automatically generated and sent through the upper computer, feedback data of the autocollimator is collected in real time, and first-order or second-order fitting is selected based on data segmentation and model selection to generate dynamic calibration parameters, so that the calibration accuracy of the fast reflecting mirror is improved. Global fitting is replaced by multi-interval independent linear fitting, the characteristic that nonlinearity of the sensor changes along with the angle is adapted, and the compensation precision is improved.

The invention relates to the technical field of battery management, and discloses a battery fault diagnosis method and system for a CCS module, and the method comprises the steps: obtaining a multi-dimensional data sequence of the voltage, current and temperature of a battery pack, carrying out the abnormality detection, and obtaining a potential abnormal time period and a multi-dimensional data subset; performing clustering analysis on the multi-dimensional data subset to obtain an abnormal feature clustering center, and performing dynamic association analysis to obtain an association mode vector set; calculating the similarity of each single data and a fault propagation path, and matching the propagation path with a preset mode to obtain a fault propagation score; fusing the clustering center and the propagation score, positioning a fault monomer through a support vector machine regression model, and determining a fault monomer identifier; and carrying out segmented clustering and logic judgment on the data corresponding to the identifier, and determining a fault type. According to the invention, accurate positioning and type determination of fault monomers can be realized.

The redundant streaming system based on synchronization of the multiple encoders and the time codes comprises the multiple encoders, a time code synchronization module, a redundant node cluster, a self-adaptive switching controller and a distributed storage module. The encoder forms and outputs a data frame containing a unique position code. The time code synchronization module generates a global timestamp based on a precision time protocol, and embeds the global timestamp into a data frame of the encoder to achieve spatio-temporal alignment of the data frame and a global clock. The redundant node cluster configures a dynamic bandwidth adjustment module from the nodes to adaptively match the phase-locked loop bandwidth according to the network delay. The adaptive switching controller monitors node states. The distributed storage module divides the data in a segmented mode based on the global timestamp, and redundant copies are generated for the data in the key time window. According to the redundant streaming system based on synchronization of the multiple encoders and the time codes, the problem that an encoder synchronization mechanism highly depends on physical signals can be solved.

The embodiment of the invention relates to a data processing method, a computing unit, electronic equipment, a storage medium and a program product. The method is executed by a calculation unit and comprises the steps that first data to be processed are obtained, and the first data correspond to a weight matrix; analyzing the first data into a plurality of data segments, the plurality of data segments including a plurality of first data segments and a second data segment, the plurality of first data segments corresponding to the floating point value of the first precision; based on a preset corresponding relation, multiple basic values corresponding to the multiple first data segments and a scaling factor corresponding to the second data segment are determined, the multiple basic values correspond to floating point values of second precision, the second precision is higher than the first precision, and the product of the multiple basic values and the scaling factor corresponds to multiple weight values in a weight matrix; and performing multiplication calculation of the weight matrix and the input matrix based on the plurality of base values and the scaling factor. In this way, the decoding and calculation efficiency of the data can be effectively improved.

The invention relates to an exception recognition method and device, computer equipment, a storage medium and a program product. The method comprises the steps of obtaining monitoring data of a battery system of a target vehicle in a monitoring time period, performing data segmentation on the monitoring data according to a preset SOC classification interval and a preset temperature interval to obtain a plurality of data segments, and determining whether the battery system is abnormal or not according to the plurality of data segments. According to the method, the monitoring data are segmented, so that a more detailed anomaly determination strategy can be made for various vehicles, the anomaly determination accuracy is improved, the monitoring data are segmented according to the temperature and the SOC, and the data classification efficiency and accuracy are improved.

Provided are a data acknowledgement transmission method, network device and storage medium, the method comprising: sending a plurality of data segments comprising segment offset information to a receiving end device, so that the receiving end device determines the receiving integrity of the plurality of data segments according to the segment offset information, the data segments being generated according to data blocks, and the data blocks being generated according to the data blocks; the segment offset information is used for determining the offset of the data segment relative to the head address of the data block. According to the embodiment of the invention, sequential receiving and complete receiving of novel data blocks generated in a future wireless communication system can be ensured.

The invention provides a publishing and subscribing multi-thread parallel transmission device based on data segmentation aiming at the large-bandwidth communication requirement of mass data, high-speed and real-time distribution of data on a standard Ethernet is completed by adopting strategies such as theme data splitting and parallel transmission and receiving end zero copy, and high-throughput radar information processing is supported. According to the method, a data packet of a theme T is split into n sub-themes to be sent at a publishing end according to the parallelism degree n, parallel receiving is carried out at a receiving end according to the parallelism degree n, and original data packet splicing is completed while data fragments are received.

The invention relates to a memory access method and device, computer equipment and a storage medium. The method comprises the following steps: determining a plurality of non-uniform memory access nodes, and allocating resources for the non-uniform memory access nodes; dividing a storage object in the storage system to obtain a plurality of data segments; binding the plurality of data segments with the plurality of non-uniform memory access nodes in sequence; and in response to a received data access request, obtaining a logic block address of the data access request, and determining a target data segment corresponding to the data access request according to the logic block address, so as to perform memory access through a target non-uniform memory access node corresponding to the target data segment. By adopting the method, cross-node access to the memory can be avoided, and meanwhile, the problem that computing resources and memory resources cannot be fully used or a wooden barrel effect exists in the performance of a storage system in an existing scheme is solved.

The invention provides a multi-scale data segmentation MEMS inertial navigation rapid calibration method and system, and relates to the field of MEMS inertial navigation calibration, and the method comprises the steps: carrying out segmentation processing on original data output by an MEMS inertial sensor according to a preset time scale sequence, and generating a plurality of data segments with different time scales, the time lengths of which are sequentially increased; performing weighted fusion on different data segments according to a preset initial weight coefficient, generating a fusion observation vector, performing coarse alignment calculation of navigation positioning, obtaining an initial attitude angle, and calculating a corresponding observation residual error; adjusting the initial weight coefficient according to the observation residual error and performing coarse alignment calculation again until the observation residual error is smaller than a preset threshold value; and determining the corresponding initial attitude angle when the observation residual error is smaller than a preset threshold value as a final MEMS inertial navigation calibration result. By implementing the method, the contradiction between the calibration speed and the calibration precision can be balanced, the time required by the calibration process is shortened on the premise of ensuring the calibration precision as much as possible, and the calibration efficiency is improved.

The invention provides a parallel bit error rate detection method and device, a medium and a product, and belongs to the technical field of communication, and the method comprises the steps: detecting the bit error rate of a parallel signal of each channel, and obtaining the channel bit error rate; summarizing the channel bit error rates of all the channels to obtain a total bit error rate; wherein for each channel, the step of obtaining the channel bit error rate comprises the following steps: dividing a parallel signal of the channel into a plurality of first data segments according to a preset length; comparing the first data segment with a corresponding second data segment in a lookup table to obtain a comparison result of the first data segment; and calculating a channel error rate according to a comparison result of all the first data segments in the channel. According to the method, the bit error rates are independently counted in parallel in the multiple channels, the bit error rates of all the channels are summarized through the bus, data segmentation comparison is carried out on all the channels, the channel bit error rates are obtained, the bit error rate detection efficiency is improved through a double parallel processing mechanism, and the bit error rates of hundreds of parallel signals can be monitored in real time.

A method for learning a person movement model includes obtaining a data stream having time series of measured multi-dimensional movement data of the person from at least one sensor; segmenting the data into time segments, segment corresponding to one movement step; storing each segment into a first storage section with a predetermined memory size, performing clustering of the segments by computing distances between the segments, learning a two-dimensional non-linear topology preserving embedded feature vector based on the computed distances, clustering the vectors, aligning segments of each cluster and averaging the aligned segments of for generating a prototype segment for each cluster; generating and storing a movement model by comparing the determined number of clusters of a current clustering with the determined number of clusters from the previous clustering stored in a second storage section.

The invention discloses a pixel extraction and conversion method of an LEN format image, and belongs to the technical field of digital image processing. In order to solve the technical problems that the LEN format has no public specification and general software cannot read data, binary analysis is carried out through an LEN sample, and the core binary layout of a file is found for the first time: the image width and height are stored in specified offset positions, and a small-end byte order is adopted; pixel data comprises a compressed data segment and a row information segment, and an RLE coding rule is adopted. The method comprises the following steps: acquiring an LEN format file; analyzing the file header to obtain an image size; performing segmented analysis on the image data; synthesizing the analyzed data into image data; and packaging the pixel matrix into a standard TIFF format file. The LEN core binary layout is disclosed for the first time, zero distortion and cross-platform conversion are achieved, reading and storage of screening parameters are not involved at all, existing patents are effectively avoided, and the method can be used for preview, filing and third-party system integration in the flexographic printing process.

This application relates to the field of industrial data processing and intelligent control technology, and discloses a method for dynamic modeling and prediction of industrial big data combined with digital twins. The method includes: acquiring operating status data, process execution data, control command records and prediction results, and constructing a sequence of control action events; segmenting the operating status data according to the sequence of control action events to form natural operating data segments and intervention operating data segments, extracting distribution characteristics, fluctuation characteristics and response characteristics, and generating a segmented behavioral feature set; calculating the control reflexive influence quantity and generating a reflexive drift marker, dividing the natural evolution dataset and the control feedback dataset, and predicting them separately; generating control risk constraint quantity, screening, delaying or limiting the control commands to be executed, and iteratively correcting the dataset according to the execution results; this method can distinguish between control feedback changes and natural evolution changes, reduce drift misjudgments, and suppress multi-round oscillations and parameter fluctuations.

The invention discloses an overlay analysis method and device based on spatial big data, and relates to the technical field of geographic information spatial data analysis. Carrying out data segmentation on the source data table and the superposition data table according to a preset data size to obtain segmented data, setting a starting ID, and carrying out superposition analysis to obtain a spatial range of result data; performing grid division to obtain a spatial range grid, and setting a cell ID for a cell of the spatial range grid; determining a superposition space four-arrival range of superposition intersection data in the space four-arrival range and a cell ID corresponding to the superposition space four-arrival range to construct a superposition association relationship between the superposition space four-arrival range and a space range grid, and integrating the superposition association relationship to form a grid index file; and indexing superposition data in the grid index file, and carrying out superposition calculation on the superposition data and a source data set in a source space range to realize space superposition. According to the method, real-time and accurate overlay analysis results are provided when large-scale complex spatial data are processed.

The application provides a data processing method and device, wherein the data processing method comprises: creating a data segment sequence corresponding to a target task in an execution state; loading a first data segment in the data segment sequence to a first circular array; reading and processing the first data segment in the first circular array according to a loading result, and loading a second data segment adjacent to the first data segment to a second circular array, the second data segment in the second circular array being processed after the first data segment in the first circular array is processed; loading a third data segment adjacent to the second data segment in the data segment sequence to the first circular array when the second data segment in the second circular array is in a processing state; and switching the target task to a completion state until all data segments in the data segment sequence are processed.

The invention discloses a real-time tracking and accurate charging method for cloud printing information, and particularly relates to the technical field of printing tracking charging, which comprises the following steps: in a cloud printing space, a network transmission layer captures original data of a to-be-executed printing task and divides the original data into equal-length data blocks, the data blocks are converted into normalized entropy values by calculating byte probability distribution, and the normalized entropy values are converted into normalized entropy values; and entropy difference is detected, abnormal data blocks are identified, notification signals are generated, and the abnormal data blocks are added into an abnormal printing task processing queue. And the system recombines data streams in a time sequence according to user IDs, calculates a similarity coefficient sequence, performs consistency verification, identifies periodic anomalies and marks related users and data segments. And the printing task priority is adjusted based on the abnormal marking times, the user printing time abnormal occupation weight is calculated, finally, a dynamic penalty coefficient is calculated according to the abnormal marking times and the time weight, and a precise bill is generated in combination with a basic charging rule.

The present invention belongs to the technical field of data storage, and specifically discloses a high-speed storage array data storage method, device and server, which obtains a number of data block pairs with associated corresponding data segment numbers by copying and segmenting the target data set to be stored, and then prioritizes and selects each storage unit based on the basic attribute information and historical status information of each storage unit in the storage array in real time, and then sequentially writes the data block pairs into the two storage units with the highest priority, associates the address pairs with the corresponding data segment numbers and enters them into a data storage table, and repeats this until the data entry is completed to obtain the final data storage table. The present invention can realize high-speed distributed storage and redundant backup of data in the storage array, significantly improve the storage efficiency of data, ensure the reliability and integrity of data storage, and optimize and improve the overall working performance of the storage array.

The present invention relates to the field of drone cluster elastic control technology, and in particular to a method, system, medium, and program product for simulating disturbance impulse injection in a drone network system. The method comprises setting injection rounds, generating an interference parameter matrix, initializing a network model, injecting interference round by round, recording phase point trajectories, determining recovery based on termination conditions, saving standardized trajectory data, and automatically identifying transition zones in the trajectory. The supporting system automates interference injection, trajectory monitoring, recovery determination, and data segmentation processing, and is capable of outputting key indicators such as maximum offset and recovery time. The invention has the advantages of standardized test structure, unified data format, strong adaptability, and high efficiency.

The present disclosure relates to methods and devices for enabling an efficient allocation of uplink resources to a user equipment, UE (20), which comprises a wireless device (25), such as an Ambient-IoT device, by considering an uplink data segmentation capability of the wireless device (25).

An apparatus in an illustrative embodiment comprises at least one processing device configured to identify data units stored on storage nodes of a storage system, wherein different subsets of the data units comprise data sub-units stored utilizing different data striping schemes. The at least one processing device is also configured to maintain a data structure characterizing relationships between the storage nodes, the data structure comprising, for a given data unit, edge weights that are proportional to a given number of data sub-units that are part of the given data unit. The at least one processing device is further configured to receive an additional data unit to be stored, to determine, utilizing the data structure, a subset of the storage nodes on which to store data sub-units of the additional data unit, and to store the data sub-units of the additional data unit on the determined subset of the storage nodes.

The embodiment of the invention provides a data transmission method and device, electronic equipment, a storage medium and a program product. The method comprises the steps that data to be transmitted are acquired, the data to be transmitted comprise a plurality of data segments, if it is detected that the signal strength of a current connection link with a target satellite is lower than a preset signal strength threshold value, wireless resource control link reconstruction is triggered, and a plurality of data segments which are transmitted currently and a plurality of data segments which are not transmitted currently are acquired; and determining a plurality of target data segments to be cached from the plurality of transmitted data segments according to the acquired transmission feature data, caching the target data segments, and if the target connection link is reconstructed, sequentially transmitting the plurality of target data segments and the plurality of untransmitted data segments through the target connection link. According to the invention, the success rate of data transmission in a satellite communication scene is obviously improved.