10 results about "Data limitations" patented technology

The invention discloses an Elasticsearch paging query optimization method, system and device and a storage medium, whether the total amount of data needing to be queried exceeds the query upper limit or not is judged according to the query upper limit of Elasticsearch, the data volume of each page and the current page number, if yes, a data starting point and a data end point are calculated according to the data volume of each page and the current page number, and the data starting point and the data end point are sent to the Elasticsearch. The method comprises the following steps of: calculating elastic scrolling times and elastic scrolling data pieces, sending a scrolling request to Elasticsearch by using scrolling query, calculating an actual data starting point according to the actual size of a data set, assigning the value of the actual size to the actual data ending point if the actual data ending point is larger than the actual size, and extracting a data subset from the data set as a final query result. Depth paging query is decomposed into rolling requests with the minimum necessary number of times through a dynamic elastic rolling algorithm, and in combination with a data positioning and interception technology, the default strip data limitation of Elasticsearch can be broken through under the condition that the performance is ensured as much as possible, and the system resource consumption is reduced.

The invention discloses a micrometeorological device verification method based on meteorological rationality analysis, and the method comprises the following steps: obtaining provincial-level meteorological center data, micrometeorological device collection data, and corresponding region elevation and line tower information, and carrying out the preprocessing of the data into comparable grid point data; comparing and analyzing the variation trend of correlation coefficients, dynamic time warping distances and slope differences on the data of each device and the data of the grid points; basic verification of physical range, zero value continuity and grid point data comparison is carried out; special verification of icing existence conditions, thickness rationality and growth rate is additionally carried out on the device containing the icing device; and integrating the results, labeling data exception types and outputting an exception device list. The method fills the blank in the prior art, solves the problems of meteorological data limitation and lack of systematic verification, improves the data accuracy, and provides support for power grid meteorological data governance; data differences are eliminated through preprocessing, and the verification basis is ensured to be effective.

The invention provides a multi-source data fusion method and a driving decision system. The multi-source data fusion method comprises the following steps: sequentially performing time synchronization calibration and space synchronization calibration on initial visual data and initial sensor data to obtain second visual data and second sensor data; performing multi-source data feature extraction according to the second visual data and the second sensor data, and executing feature association matching according to a feature extraction result; and further correcting the classification probability based on the feature association matching result so as to output a target classification result according to the corrected classification probability and the feature extraction result, and outputting target fusion data based on the feature association matching result. According to the method, the advantages of the visual data in target classification precision and the advantages of the self-vehicle sensing data in motion state measurement are fully played, the problems of data limitation of a single sensor and low precision of simple superposition fusion are solved, and the precision and stability of data mining in a complex scene are improved.

A computer network security method including configuring a web browser to receive a data file via a computer network, determine in accordance with any predefined policy that the data file is subject to predefined data restriction, and provide the data file to a file protection service together with identification of the predefined data restriction, where the file protection service is configured to modify the data file to include the identification of the predefined data restriction, encrypt the data file, and provide the encrypted data file to the web browser, and configuring the web browser to provide the encrypted data file for access by a computer-hosted application that is configured to access a decryption key that is configured to decrypt the data file, decrypt the data file using the decryption key, and enforce the predefined data restriction identified in the data file.

The embodiment of the invention provides a project cost data processing method and device. The processing method comprises the following steps: acquiring first project cost data; cleaning the first project cost data to obtain first standard data; comparing the first standard data with set project cost data to obtain a comparison result; sorting the comparison result to obtain comparison result data; and outputting the comparison result data. According to the embodiment of the invention, through an automatic process, the processing time is shortened, the accuracy is improved, the data limitation is broken through, and full-dimension adaptation is realized.

The application discloses a micro-meteorological device verification method based on meteorological rationality analysis, and steps are as follows: obtaining provincial meteorological center data, micro-meteorological device collection data, corresponding regional elevation and line tower information, and preprocessing into comparable grid point data; comparing and analyzing the change trend of correlation coefficient, dynamic time warping distance and slope difference of each device data and grid point data; performing basic verification of physical range, zero value continuity and grid point data comparison; for the device with icing, additionally performing special verification of icing existing condition, thickness rationality and growth rate; and marking data abnormal type and outputting abnormal device list according to the foregoing results. The method fills the blank of the prior art, solves the problems of meteorological data limitation and lack of systematic verification, improves data accuracy, provides support for power grid meteorological data management, eliminates data difference through preprocessing, and guarantees the effectiveness of verification basis.

The application discloses a kind of multi-source heterogeneous data space target identification method based on mamba module, to solve the precision and generalization low problems caused by the single modality data limitation, multi-task coupling risk and data sample deficiency in existing space object identification.The core steps of the method include:1, data preprocessing and fusion input;2, mamba module feature extraction and prediction: target ID classification and subject / sailboard / load quantity prediction can be independently executed respectively;3, data enhancement processing;4, robust training optimization, high confidence clean data is filtered by DivideMix Gaussian mixture model, and the model is iteratively optimized by combining the greedy pseudo-label generation strategy;5, target identification and out-of-library discrimination, based on the maximum probability principle, output target category and component quantity, and combine entropy enhancement to improve the discrimination accuracy of out-of-library targets.The application effectively avoids the traditional multi-task all or nothing risk, and improves the recognition accuracy and generalization performance of the model in complex scenarios.

A computer network security method including configuring a web browser to receive a data file via a computer network, determine in accordance with any predefined policy that the data file is subject to predefined data restriction, and provide the data file to a file protection service together with identification of the predefined data restriction, where the file protection service is configured to modify the data file to include the identification of the predefined data restriction, encrypt the data file, and provide the encrypted data file to the web browser, and configuring the web browser to provide the encrypted data file for access by a computer-hosted application that is configured to access a decryption key that is configured to decrypt the data file, decrypt the data file using the decryption key, and enforce the predefined data restriction identified in the data file.

A system for data security includes a processor and a computer-readable storage medium having instructions stored thereon that cause the processor to perform operations including: (i) logging data access events initiated by a user; (ii) generating a user profile of the user, the user profile including a size and a type of data accessed by each data access event; (iii) receiving a new data access event initiated by the user including a size and a type of data requested by the new data access event; (iv) comparing the size and the type of the requested data of the new data access event to the user profile; (v) determining that the new data access event initiated by the user does not correspond to the data included in the user profile; (vi) restricting the requested data associated with the new data access event; and (vii) transmitting the restricted data to the user.

The application relates to the technical field of satellites, and provides a method and device for storing ephemeris data and a computer readable storage medium, the method comprising the following steps: obtaining to-be-stored ephemeris data; searching a target sub-storage area corresponding to data attribute information of the to-be-stored ephemeris data in a storage area; when the target sub-storage area corresponding to the data attribute information exists in the storage area, determining a data processing strategy of data in the target sub-storage area according to data limit information of the to-be-stored ephemeris data; and storing the ephemeris data into the target sub-storage area after the latest ephemeris data according to the data processing strategy; the latest ephemeris data is ephemeris data with the latest receiving time in the target sub-storage area. Through the scheme, the order of ephemeris data storage can be improved.