134 results about "Full data" patented technology

The invention provides a self-adaptive data consistency maintenance method for an electric power information system based on incremental updating, and relates to the technical field of big data processing, and the method comprises an initialization step, a detection step and a feedback step. In the initialization step, a network including regional power data nodes and a distributed account book is constructed, and full power data is stored; in the detection step, power data changes are confirmed, key attributes are used for marking data, automatic conflict detection is carried out through a distributed consensus algorithm, solutions for coping with conflicts are dynamically selected, and then an incremental updating mechanism is adopted for synchronously changing the data; in the feedback step, a monitoring system with a closed-loop feedback mechanism is established, the data consistency state is automatically tracked when the electric power data is changed, and abnormity is recognized. Compared with a traditional data synchronization method which needs to synchronize full data, the method provided by the invention only synchronizes the changed data fragments through an incremental updating mechanism, thereby ensuring the consistency of the data, remarkably improving the data processing efficiency and saving the network bandwidth.

The invention provides an automatic process management method and system applied to foreign trade business intellectualization, and relates to the technical field of foreign trade business management.The method comprises the steps that firstly, initial order data, preset document template data, logistics resource configuration data and order change data of foreign trade business are obtained and integrated to form a foreign trade business total data set; then, carrying out change influence definition processing on the order change data, and determining influenced foreign trade business links and associated data; performing linkage adaptation processing on the associated data based on a defining result, and adjusting preset document template data and logistics resource configuration data; according to a linkage adaptation processing result and a foreign trade business process knowledge base, generating operation execution instructions of all links; finally, the instructions are distributed to the corresponding execution main bodies according to the execution sequence, operation execution results are received and integrated to form feedback information, automatic and intelligent management of the foreign trade business process is achieved, and the management efficiency and accuracy are improved.

This invention discloses a tax-electronic loop joint analysis method based on privacy computing, and also discloses an apparatus and storage medium for this method. The method establishes an interactive device between three terminals, enabling encrypted processing of each computational stage. Each terminal is unable to see the original data, only receiving the computational results. This ensures that no single terminal can deduce the original data of any other terminal from the intermediate results. Thus, data security is ensured while achieving full data utilization.

The invention provides a data transmission method and system for a confined space and electronic equipment. According to the data transmission method provided by the invention, a self-adaptive transmission mechanism based on real-time link quality is introduced, so that the problem of unreliable data transmission caused by signal attenuation in a limited space is effectively solved. The method has the beneficial effects that the transmission reliability of the most critical security data is preferentially guaranteed when personnel are in the most dangerous area by intelligently switching from the full-quantity data transmission mode to the simplified core data transmission mode when the link quality is deteriorated, so that the data transmission delay, failure and error code risks are remarkably reduced. Meanwhile, according to the method, the bandwidth is fully utilized to transmit total data when the link is good, the monitoring continuity is maintained with the minimum necessary data volume when the link is poor, and the optimal balance between efficient utilization of communication resources and safety monitoring real-time performance is achieved.

The application provides a method and system for ensuring consistency of data synchronization of a distributed file system. The method comprises the following steps: responding to an update period of acquired business data; performing secondary processing on the data according to an actual update period of the acquired business data; and responding to periodic full data processing to ensure that all data is up-to-date. The method is used in an offline data warehouse based on HDFS storage+HIVE analysis, is applicable to consistency of business data in various industries, and is particularly suitable for a scenario in which the amount of synchronized data is large and the actual update period of data is short. The method ensures data consistency by performing secondary processing on large amounts of business data according to the actual update period of the business data and combining periodic full data processing. Since the amount of data read from a source library is reduced, the read pressure of the source library is reduced.

The application discloses an energetic material processing parameter optimization method and system based on a force-heat coupling model, and relates to the technical field of intelligent simulation optimization based on specific calculation models. In view of the problems that 3D printing and mechanical processing data are disconnected, and common force-heat coupling models are not suitable for energetic materials in the prior art, the method of the application first collects 3D printing operation and initial state data of the grain, then constructs a force-heat two-way coupling intelligent calculation model special for energetic materials, adopts a Bayesian algorithm to multi-objective optimize processing parameters based on the model, and carries out model-driven closed-loop dynamic processing control. The method of the application realizes full data connection and adaptation to material characteristics, takes into account safety, precision and efficiency, and improves the processing stability and consistency of the energetic material.

The application discloses a kind of based on gypsum board production full data acquisition's defect detection avoidance method, comprising the following steps: time series analysis of the adjustment amount of gypsum board production equipment adjustment item is carried out, the associated relationship between gypsum board production equipment adjustment item is extracted, and associated relationship is abstracted as the associated network between gypsum board production equipment adjustment item;And according to the number of gypsum board real-time production equipment adjustment item, the production condition of gypsum board production equipment is set in real time.This application carries out learning training to the characterization data of gypsum board defect item and the adjustment amount of gypsum board production equipment adjustment item to obtain defect adjustment calculation model, and the associated relationship between gypsum board production equipment adjustment item is extracted by time series analysis of the adjustment amount of gypsum board production equipment adjustment item, and associated relationship is abstracted as the associated network between gypsum board production equipment adjustment item, realize the full detection and full avoidance of potential defect of gypsum board, improve the initiative of defect detection and avoidance.

The application discloses a virus searching and killing method and system for distributed energy safety data, relates to the field of virus processing, and comprises the following steps: acquiring a virus original characteristic code, splitting the original characteristic code into N discontinuous but sequentially fixed segments F i , calculating the starting offset S i of each segment F i relative to the first segment F1, and constructing a virus characteristic database; then, the data stream is divided into multiple data blocks B i of fixed size, a fixed-size sliding window is adopted to perform scanning and matching association, and finally, threshold judgment is performed; the original virus characteristic code is subjected to fragmentation processing, the storage requirement of the virus characteristic database is reduced; the sliding window scanning can ensure that any characteristic combination is covered, and a matching event FP i is recorded instead of full data, so that the memory occupation is reduced; through comparison of the absolute offset SB i with an expected position, the correct sequence of the segment in the virus is ensured, a state machine can track the matching progress in real time, and the weight of only the segment with correct sequence is accumulated, so that the detection reliability is improved.

This invention presents a heuristic recovery mechanism for malicious shortcut file parsing and threat detection. It employs a resilience-oriented parsing engine, utilizes a dynamic byte ordering mechanism to adapt to underlying data, leverages a sliding window algorithm to accurately locate variable-length field terminators to extract hidden strings, and employs a recursive parsing strategy to deeply traverse undocumented nested structures and extension blocks. Parsing anomalies are treated as threat features and archived during the parsing process, and an iterative extraction strategy with adaptive parameters ensures full data acquisition. Based on the comprehensive parsing results, a three-dimensional threat model encompassing deception, evasion, and execution is constructed, achieving a deep mapping of malicious shortcut files from binary structure to logical behavior. This invention not only significantly improves the parsing success rate of variant samples but also effectively extracts fingerprint features from automatically generated samples, providing key technical support for modern shortcut-based attack and defense countermeasures.

According to the biological recognition method and device, the storage medium and the computer equipment, the hardware parameters and the sample feature sets of the new equipment and the old equipment are collected, and accurate conversion from the old template features to the new equipment features is achieved. The conversion process not only considers hardware differences, but also combines multiple groups of sample features, and ensures that the converted new template features can fully adapt to the hardware environment of new equipment. Meanwhile, local fine tuning is performed on the feature extraction model in the new equipment by using the feature image set of a small number of users and the corresponding new template features, so that the recognition accuracy of the model on the new equipment is further improved. The local fine tuning mode avoids the problems of large data transmission quantity, privacy leakage risk, high operation and maintenance cost, equipment elimination and the like caused by full data synchronization and unified algorithm framework forced upgrading. In addition, the method is also helpful for promoting the popularization and deepening of a biological recognition technology in more fields and scenes.

The invention discloses a process migration control method and device for flexible assembly task switching, and relates to the technical field of flexible assembly. The method comprises the following steps: acquiring original total data in a first process; taking the minimum sample loss function as an optimization target, and obtaining a distillation candidate subset from the original total data; the sample loss function is used for measuring the retention degree of the distillation candidate subset on the behavior distribution of the original total data; calculating a comprehensive score of each action in the distillation candidate subset through a distribution consistency score and an action border-crossing punishment, filtering out sample data with relatively large comprehensive scores of the actions in combination with a gating mechanism, and storing the sample data meeting the gating mechanism into a small-capacity buffer area; and finally, training the initial strategy network according to the sample data of the small-capacity buffer area and the observation data of the second process to obtain a new strategy network. The method can give consideration to both online speed and stability under the condition of limited resources.

This invention discloses a holiday load prediction method based on ANN and transfer learning, comprising the following steps: performing feature engineering operations on the preprocessed dataset to form a full load dataset; extracting the holiday load dataset and the festival load dataset from the full load dataset; constructing a full data source model using an ANN, and training the full data source model using the full load training dataset; using the full data source model as a pre-trained model to train the festival / holiday load dataset, using the same parameters as the full data source model, to obtain the final festival / holiday load training model; predicting the load values ​​at each time point of the prediction day, obtaining the prediction results for the load at each time point of the prediction day. By using ANN to predict the holiday load data and the festival load data separately for holiday prediction, the characteristics of each holiday can be better learned, thereby improving the prediction accuracy.

The embodiment of the invention discloses a security startup verification method and device, a system on chip, a computer readable storage medium and a computer program product. The method comprises the following steps: acquiring a first verification value of a system component of a system on chip, and acquiring a historical verification value of the system component; wherein the historical verification value is a verification value corresponding to the system component when the system component is historically started, and the first verification value is a verification value obtained by calculation under the conditions that a kernel bootstrap program stored in a memory of the system on chip is determined to be complete and a loading behavior of a kernel in the system component is determined to meet a preset condition; according to the first verification value and the historical verification value, carrying out initial verification on the system component; under the condition that the data block which does not pass the verification exists in the system component, performing full data verification on the data block which does not pass the verification; and starting the system-on-chip based on the system component under the condition that the full data verification is passed.

The application relates to a data management method and device, computer equipment, a storage medium and a computer program product. The method comprises the following steps: receiving quality control rules and a quality control data set submitted by a proxy server; the quality control data set is obtained by the proxy server based on key-value pair data of data in a general data table, and the general data table contains full data in a database; each quality control data in the quality control data set is parsed, and a quality control data table is constructed based on the parsed quality control data with the same domain information; target data meeting the quality control rules is inquired in each quality control data table, a target data set is obtained, and the target data set is fed back to the proxy server; and the target data set is used for determining and repairing abnormal data. The method can improve the data management efficiency.

The invention relates to the technical field of data mining, in particular to a group construction evaluation method and system based on data mining, and the method comprises the following steps: constructing a panoramic data view; classifying each piece of system data in the panoramic data view as a full-amount data set, and correcting abnormal data of the full-amount data set; constructing a plurality of member data subsets corresponding to each group member, preprocessing the member data subsets and a full-amount data set; analyzing a total data set with relevance, and receiving a plurality of member data subsets after duplicate removal; calculating a variable coefficient of the full-amount data set where the abnormal data is located, and analyzing whether the abnormal data is supplemented according to the full-amount data set and the member data subsets or not; key data weights are distributed to the full data set, and member scores are calculated to output group construction evaluation; and when the key data weights are distributed, quantifying the key data weights corresponding to the plurality of full-amount data sets through variable coefficients, and adjusting member scores according to the member data subsets corresponding to each group member in the full-amount data sets.

This invention relates to the field of database migration, and discloses a method, device, and storage medium for migrating a PolarDB-X database. The method includes: receiving a migration instruction; scaling down a Kubernetes container according to the migration instruction; analyzing and processing table indexes to generate a database structure, and writing the database structure into the PolarDB-X database to obtain a structure migration database; extracting and processing historical existing data to obtain full data, and writing the full data into the structure migration database to obtain a full migration database; writing incremental data into the full migration database to obtain an incremental migration database; performing consistency verification processing to obtain the verification result; and modifying the connection address of a single Pod's Kubernetes container to the incremental migration database. In this embodiment of the invention, database switching achieves a smooth switch with zero data loss and bandwidth savings, while minimizing the impact on business operations.

The application provides a STEP model dynamic rendering method and system based on componentization processing, and the method comprises the following steps: when a local update request for a STEP model component is detected, a target component is first determined, then an independent component relationship table obtained by pre-extracting independent components, attributes and topological relationships is used to determine an influence domain in combination with update operation information. Subsequently, the new components in the influence domain are subjected to grid re-triangulation and lightweight processing, and a component-grid mapping table recording the mapping relationship between the component ID and the vertex mapping range and the like is updated according to the processing result. Finally, an incremental update package is generated based on the updated mapping table, and GPU rendering is performed by using the incremental update package. According to the scheme, the influence domain is accurately positioned through componentization processing, the data processing amount is reduced, the grid is lightweighted to reduce the data complexity, the incremental update package avoids full data transmission and rendering update, and the rendering efficiency and performance are effectively improved.

The application discloses a memory storage synchronization method and device based on a distributed cluster, a terminal and a medium. The scheme provided by the application divides a plurality of nodes contained in the distributed cluster into master nodes and slave nodes, and then takes the master nodes as the center. The master nodes broadcast the data of the master nodes to each slave node in a broadcast mode, so that each node of the distributed cluster saves full data, each node in the cluster has the same user request processing capability, and the technical problem of low user request response efficiency of a traditional distributed cluster is solved.

The application relates to a data collection method, device, equipment, medium and program product. The method comprises the following steps: obtaining full cache data and hotspot data of each supercomputing cluster in a data center, and performing synchronous processing on the corresponding full cache data according to the hotspot data to obtain full data of each supercomputing cluster. The full cache data is collected from each supercomputing cluster according to a first preset frequency, and the hotspot data is collected from each supercomputing cluster in real time. The method can balance the collection resource pressure of the system and the consistency of the data of each supercomputing cluster.

The application discloses a message queue processing method, device and equipment, a storage medium and a program product. The method comprises the following steps: in the case that the state of a source agent node is abnormal, determining a logical queue bound to the source agent node; the logical queue is used for encapsulating all operations of message writing into object storage, so that the related operations of the object storage are transparent to the computing layer; rebinding the logical queue to a target agent node; uploading the residual data on the message queue corresponding to the logical queue to the object storage through the target agent node, and pulling the full data corresponding to the message queue from the object storage to rebuild a local cache; the message queue is encapsulated and abstracted as a logical queue, when the state of the agent node is abnormal and message queue migration or dynamic scaling is needed, the corresponding data transfer can be performed by modifying the binding relationship between the logical queue and the agent node, so that the migration process of the message queue can be simplified, and flexible capacity reduction of the message queue is realized.

The application provides a virtual scrolling webpage data extraction method, system, medium and device, which comprises the following steps: after the initialization of a browser environment is completed, a first operation acting on a target webpage is received, a lazy loading mechanism of virtual scrolling is triggered in response to the first operation, full data is preloaded to the page, and the collection of enhanced data is realized by cyclically executing scrolling operations, waiting for data extraction and other operations; then, based on the total data dictionary obtained through the collection, non-continuous index traversal and detailed data collection are performed; finally, the complete data collected is output in a preset format, and the intermediate result is saved to the local. The method can realize complete, efficient and adaptive collection of full, non-continuous and multi-type key-value structured data in a virtual scrolling webpage, and can balance the environment authenticity, data integrity and execution robustness.

This disclosure provides a data processing method based on a cascading selector, relating to the financial field. The method includes: obtaining data to be processed from a user; invoking a query method based on the data to be processed, sending query requests to N data sources, wherein the N data sources include full data with a cascading relationship and are lazy-loaded data sources independent of the cascading selector, and N is greater than or equal to 1; obtaining a first query result returned by the N data sources in response to the query request; and displaying the first query result on the query result interface of the cascading selector. This disclosure also provides a data processing apparatus, device, storage medium, and program product based on a cascading selector.

An apparatus for distributing cards onto carriers comprises a first conveying line for transporting individual carriers from an inlet to an outlet section, and a second conveying line for transporting individual cards. The system enables full data verification on each carrier, including surfaces facing downward. An inlet check station is positioned at the inlet section to inspect data impressed on incoming carriers. A conveying device guides unloaded carriers across this station in a configuration suitable for card matching on an upper exposed surface. A matching station includes a robotized device for picking and placing cards onto target carrier surfaces. The inlet check station features a checking area with a transparent support plane, allowing carriers to slide over it while being driven by side-edge engagement. This configuration ensures accurate data verification and precise card placement, improving reliability in card-to-carrier matching processes.

The invention discloses an AWG waveform compression transmission algorithm for quantum computing, and relates to the technical field of communication, and the method comprises the steps: S1, intercepting a target quantum waveform into a first type of wave band and a second type of wave band, and setting independent compression storage; s2, setting a segmented approximation algorithm to generate a first-order compression wave band; s3, performing similarity judgment on all first-order compression wavebands and screening out the first-order compression wavebands; s4, executing run-length coding compression on the screened first-order compression wave band, generating a second-order compression wave band, and performing unified packaging to complete target quantum waveform compression; wherein the waveform type of the first type of wave band comprises a constant sequence waveform, a linear sequence waveform and a repetitive sequence waveform. According to the method, through a staged processing strategy of segmenting, shunting and merging, the scale of data participating in complex operation is remarkably reduced, execution of high-complexity operation on total data is avoided, and the speed and efficiency of compression and decompression processing can be improved.

The present disclosure provides a data processing method and device, a storage medium and an electronic device; and relates to the technical field of data processing. The method comprises: acquiring current full data of a target service, and constructing a plurality of connected subgraphs according to the current full data, wherein the current full data at least comprises current incremental data; identifying a target field in the current incremental data based on a data record table corresponding to the current incremental data, to determine a data mode of the current incremental data; determining a first connected subgraph corresponding to the current incremental data, and updating the first connected subgraph according to the data mode of the current incremental data, to obtain a second connected subgraph. The present disclosure can reduce the consumption of computing resources and improve the data processing efficiency by calculating the connected graph based on the incremental data.

A metadata-driven enterprise data architecture system for automated data collection, processing, and reporting, consisting of: a centralized metadata control repository configured to store canonical enterprise data models and business semantic definitions, source-destination mapping rules and transformation logic, data quality thresholds and matching parameters, governance policies and compliance controls, data provenance relationships and audit tracking rules, security and access control configurations, planning instructions and reporting specifications; an execution and orchestration engine that is operationally connected to the metadata control repository and configured to dynamically interpret metadata definitions, automatically implements data ingestion pipelines to extract data from legacy systems, cloud platforms, application interfaces, files, and streaming sources, performs transformation operations such as normalization, enrichment, deduplication, aggregation, and format harmonization to align the ingested data with the canonical enterprise data model, applies metadata-driven data quality validation, exception handling, and reconciliation processes to ensure accuracy and consistency, and enforces metadata-defined security policies, including role-based access control, encryption, and data masking.Automatic capture of complete data provenance and audit records across all processing stages and creation of standardized operational, analytical, and regulatory reports based on metadata-defined reporting structures and business metrics; where changes to metadata definitions automatically modify the collection, processing, governance, security, and reporting behavior without requiring manual redesign of data pipelines or application code.

The invention relates to the technical field of storage, and discloses a data patrolling and reading method and system, patrolling and reading configuration information is obtained through an RAID controller, a patrolling and reading instruction is generated based on the patrolling and reading configuration information, the patrolling and reading instruction comprises a patrolling and reading mode, a storage device determines patrolling and reading time based on the patrolling and reading instruction and sends the patrolling and reading time to the RAID controller, and the data are read according to the patrolling and reading mode. And the RAID controller generates the query instruction based on the patrol reading time so as to obtain the patrol reading result based on the query instruction, so that the data integrity of the storage device can be determined based on the patrol reading result, the bandwidth occupied by total data reading is reduced, and the data patrol reading rate between the RAID and the storage device is improved.

The application provides a dynamic data chart statistical method and device, and relates to the technical field of big data. The method comprises the following steps: receiving a data query request of a user; querying full data corresponding to the data query request from a server backend according to the data query request; storing the full data in a data visualization chart library corresponding to a pull-down box selector of a front-end interface; the pull-down box selector provides a plurality of statistical index options of user-specified data in the full data for the user; after the user selects a first statistical index option from the pull-down box selector, extracting the user-specified data from the data visualization chart library, inputting the user-specified data and the first statistical index option into a data statistical analysis model, and outputting a first statistical analysis result; visually rendering the first statistical analysis result to generate a first visualization chart; and showing the first visualization chart to the user.

The application provides an automatic process management method and system applied to foreign trade business intelligence, relates to the technical field of foreign trade business management, and first acquires initial order data, preset document template data, logistics resource configuration data and order change data of foreign trade business, integrates to form a full data set of foreign trade business; then, change influence definition processing is performed on the order change data, and affected foreign trade business links and associated data are determined; then, based on the definition result, linkage adaptation processing is performed on the associated data, and the preset document template data and the logistics resource configuration data are adjusted; then, according to the linkage adaptation processing result and a foreign trade business process knowledge base, operation execution instructions of each link are generated; finally, the instructions are distributed to corresponding execution subjects according to the execution order, operation execution results are received and feedback information is integrated to form, and the automatic and intelligent management of the foreign trade business process is realized, and the management efficiency and accuracy are improved.

The invention belongs to the technical field of medical information, particularly relates to a portable medical image full-data storage and labeling system, and aims to solve the problems of insufficient integrity, portability and traceability of medical image data under a film-free background. The system comprises a full-amount data packaging module, a multi-dimensional label generation module, a localization safety storage module, an intelligent reading analysis module and a cross-platform interaction interface module, safety storage and second-level retrieval are achieved through hardware encryption, biometric authentication and structured labels, offline label updating and multi-protocol compatibility are supported, and diagnosis and treatment efficiency and data sovereignty guarantee are improved.