30 results about "Aggregate data" patented technology

The application discloses a data privacy protection method and a detection method for a privacy-enhanced semi-blind digital fingerprint, combines a differential privacy technology and a digital fingerprint technology, embeds carefully designed noise into specific positions of a numerical aggregate data set, can realize fingerprint embedding and noise interference operation on carrier data in one step, and ensures protection of private information in the carrier data set and tracking function on traitors.

Example implementations relate to deduplication operations in a storage system. An example includes receiving a set of data units to be stored in persistent storage of a deduplication storage system, and recording the arrival order of the set of data units in a manifest. The example also includes, in response to determining that an average unit size of the set of data units is smaller than a minimum size threshold, identifying a first data unit that is smaller than the minimum size threshold. The example also includes generating an aggregated data unit including the first data unit and a second data unit, and, in response to determining that the size of the aggregated data unit is larger than a target size threshold, replacing, in the manifest, the first data unit and the second data unit with the aggregated data unit.

This application relates to the field of data management technology and discloses a data generation method, apparatus, device, and storage medium based on a data warehouse. The method includes: acquiring an original data table from a data warehouse and determining atomic indicators based on the original data table; acquiring target indicators and associated data dimensions of the atomic indicators under target constraints; determining indicator fields and dimension fields based on the target indicators and the data dimensions; summarizing the original data table based on the indicator fields and the dimension fields to obtain a summarized data table; and aggregating the summarized data table based on the dimension fields to generate a target data table. This application can effectively improve data processing efficiency and flexibility, achieve automated and efficient data development, and reduce data development costs.

The application provides an accident cause analysis method, system and device for an automatic driving black box, the method comprising: obtaining an original data segment of a full-link original log from the automatic driving black box, performing anchor processing on the original data segment in a trusted execution environment to obtain each target data segment; calculating each information of each target data segment to obtain each target shard identifier; when a preset boundary condition is detected, generating boundary summary information; storing the obtained ciphertext in multiple off-chain storage nodes to obtain a storage binding record; routing a data transaction package to a target shard; aggregating data transaction packages of each target shard to construct a proof package; and determining a preset judgment feature vector in the data segment based on a preset accident cause prediction rule to obtain an accident cause analysis result for the automatic driving black box. The application can solve the problems of untrustworthy, discontinuous and redundant data collection of the automatic driving black box in a high mobility scenario.

This application discloses a data processing method, apparatus, and storage medium based on dynamic resource adaptation, relating to the field of data processing technology. The method includes: accessing rule execution result data under different rule development modes through a pre-configured unified data service registration interface; obtaining business source fields and establishing a mapping relationship between them and preset physical storage fields in the database using a dynamic field mapping algorithm. This algorithm allocates target physical fields based on the physical field resource pool status, combined with the business field type and length characteristics, while ensuring the continuity of historical data; initiating a rule trial run early warning process, calling the summary data query service, and intercepting anomalies in the summary record data according to monitoring thresholds; and dynamically generating rule execution task packages based on the data volume when no interception is triggered, calling the detailed data query service to obtain, parse, and display the data. This achieves efficient data adaptation and stable system operation in complex environments.

This invention discloses a data writing method, a magnetoelectric disk, a storage system, a program product, and a magnetic tape, relating to the field of storage technology. A storage area in the cache of the magnetoelectric disk is used to aggregate data from the same application. Therefore, data from different applications is not persistently stored according to FCFS (First-Come, First-Served). Instead, data from the same application is aggregated and then written to the disk, allowing data from the same application to be sequentially distributed on the tape. This reduces the unnecessary movement distance of data during the tape writing process, which helps extend the lifespan of the tape. Furthermore, a tape area is used to store data from the same application, and this tape area is arranged horizontally alongside other tape areas and vertically distributed within a finite length of tape. Therefore, during the data writing process, multiple concurrent application data are written to the tape, and the data is sequentially arranged along the length of the tape, which helps reduce the access latency of data reading and writing on the tape, further extending the lifespan of the tape.

This application relates to the field of data management technology and discloses a data storage method, apparatus, device, and storage medium based on a data warehouse. The method includes: responding to input source data, determining a target storage space in the data warehouse according to the data format of the source data; generating corresponding original data tables based on the data table field rules associated with the target storage space and the source data; summarizing data at different aggregation levels based on the original data tables to obtain multiple summarized data tables; and storing the original data tables and each summarized data table to a corresponding storage file in the target storage space. This application can effectively improve the consistency and accuracy of data in a data warehouse and achieve high-efficiency data storage.

An example method for linking phenotypic data with genotypic data, to facilitate plant development, includes combining a phenotypic data structure and a genotypic data structure into a combined data structure and separating the combined data structure into multiple segment data structures, where each segment data structure includes data for a target phenotype and genotypic data for multiple plants. The method also includes, for each of the multiple segment data structures, generating a probability vector including a probability value for each of multiple genetic locations in sequences of the plants and appending each probability vector to the respective segment data structure and then combining the multiple segment data structures into an aggregate data structure, whereby the target phenotype is linked, by the probability vector, to the multiple plants.

The present application belongs to the technical field of garbage classification, and particularly relates to a garbage sorting data intelligent conversion method and device, the method comprising: obtaining garbage sorting data of garbage sorted by a garbage sorting device; generating a sorting label according to the device information; generating an encapsulation array according to the sorting label; sorting parameters in the encapsulation array and generating a label array; and generating an Excel table through POI according to the garbage information and the label array. Through the above steps, the garbage sorting data can be summarized according to user requirements, so as to help users obtain required garbage sorting summary data; meanwhile, the garbage sorting data is summarized into an Excel table by using JAVA and POI technology, automatic data export is realized, and the data processing efficiency is improved. Moreover, the user can set the label mapping relationship between the preset summary label and the sorting label according to actual requirements, so that the flexibility is high and the customizability is better.

The application discloses a product quality sampling information processing method, system, device and computer readable medium, and particularly relates to the technical field of product quality supervision information processing, and is used for solving the problem that the rules cannot be automatically adapted, the task allocation is static, and the information checking lags behind, resulting in that the data is not comparable in the existing cross-regional sampling work; by acquiring general standards, regional rules, resource information and task requirements, extracting clauses and establishing mapping relationships to generate adaptive rules, extracting and disassembling task complexity and resource capability characteristics into a hierarchical structure, calculating the adaptive evaluation value based on the hierarchical structure using the analytic hierarchy process and the fuzzy comprehensive evaluation method, generating a dynamic allocation scheme in combination with the adaptive rules and the resource information, performing consistency pre-checking on the collected information according to the allocation scheme and screening qualified information, and finally standardizing the qualified information according to the clause mapping relationship to form unified summary data, the accuracy and information comparability of the cross-regional sampling work are significantly improved.

This disclosure relates to the field of logistics and transportation technology, and proposes a freight volume prediction method, device, electronic device, and readable storage medium. The method includes: acquiring historical waybill data, and generating a multi-dimensional initial probability transition matrix based on the historical waybill data, the initial probability transition matrix including historical route resource information and route delivery probability information; acquiring real-time waybill barcode scanner operation data, and determining the planned route resource information, real-time vehicle status, and real-time freight volume summary data for the current day based on the real-time waybill barcode scanner operation data; adjusting the route delivery probability information of the initial probability transition matrix based on the planned route resource information for the current day, historical route resource information, and real-time vehicle status to obtain a target probability transition matrix; and determining the expected freight volume allocated to each target route based on the real-time freight volume summary data and the target probability transition matrix. The technical solutions provided by one or more embodiments of this disclosure can accurately predict the allocated freight volume of each route.

This invention belongs to the field of warehouse management technology, specifically relating to an intelligent warehouse monitoring and management method, system, terminal, and storage medium. The intelligent warehouse monitoring and management method includes: generating initial inventory data and constructing a warehouse space model based on the spatial information of the warehouse equipment and the information of the stored items; the warehouse equipment performing temporary inventory operations and temporary environmental data feedback operations within a preset period to generate temporary summary data, which is then transmitted to a back-end monitoring platform; based on the management information of the transferred items, the back-end monitoring platform generating execution operation instructions and transmitting them to the warehouse equipment; based on the execution operation instructions and management information, the warehouse equipment generating a retrieval operation route and collecting view data of the retrieval operation process; verifying the storage information of the transferred items based on the view data; generating monitoring feedback data, which is then transmitted to the back-end monitoring platform. This invention can improve management efficiency.

The application relates to a kind of wisdom water affairs real-time monitoring early warning method and system based on Internet of Things, solve the problem that abnormal identification, mechanism simulation and decision link are disconnected in the prior art, leading to traceability difficulty, early warning delay, its method includes: through edge node real-time collection analysis water quality data and identify abnormality, aggregate data after uploading to cloud and simulate to generate global risk atlas reflecting abnormal distribution and diffusion trend.Accordingly, dynamically enhance the monitoring of key areas, lock the suspected source in combination with topological information, and finally comprehensively evaluate the hazard level and generate a graded early warning push.The application has the following effects: through edge-cloud collaboration and mechanism data fusion, a closed-loop system from abnormal perception, dynamic tracing to intelligent decision-making is constructed, and the ability of water affairs risk from passive alarm to active prediction is upgraded.

Based on demographic information of the area being analyzed, the system estimates the distribution of people with user-specified attributes at a given location within that area. [Solution] The human flow information estimation device 2000' includes a calculation device 2100 that performs human flow information analysis based on predetermined demographic information, which includes the number of people located in each of a plurality of predetermined area meshes and information on the attributes of those people. The human flow information estimation unit 2103 identifies a set of unit sub-regions that cover the area to be analyzed without overlapping each other, and based on demographic information and predetermined lifestyle information, it distributes the number of people from the demographic information to the unit sub-regions at predetermined time intervals, based on the type of place and the size of the place corresponding to the classification of people's behavior in each area mesh, and estimates aggregated data for each unit sub-region. Based on the aggregated data, the human flow information estimation unit 2103 calculates a human absorption capacity value, which is the ratio of the number of people with the analysis target attributes for each unit sub-region to a predetermined value.

The application relates to a robot control system and a humanoid robot, and relates to the technical field of robots, and comprises a central controller and a plurality of domain controllers, a first domain controller arranged in a first region and / or a second domain controller arranged in a second region, each domain controller being connected with an end device arranged in a corresponding region; the first region is a neck region or a region above the neck of the robot, and the second region is a waist region or a region below the waist of the robot; the central controller is arranged between the first region and the second region, the central controller is connected with each domain controller, is used for sending a first control instruction to the domain controller, and receives summary data from the domain controller; the domain controller is used for receiving sensing data collected by the end device connected with the domain controller, uploading the processed sensing data to the central controller as the summary data, generating a second control instruction and issuing the second control instruction to the end device connected with the domain controller. The system can reduce the occupied volume in the narrow body space of the robot.

The present invention discloses an intelligent monitoring method for slope runoff, including: adopting a distributed sensor network deployment strategy to densely arrange sensor nodes in areas with complex terrain and climatic conditions to collect aggregated data; performing preprocessing on the aggregated data using edge computing at the sensor nodes; constructing a distributed data fusion model to fuse the pre-processed aggregated data with multi-source datasets; dynamically predicting the fused slope runoff data using machine learning algorithms to obtain real-time dynamic data of slope runoff; and issuing real-time warnings based on the realtime dynamic data and predefined warning thresholds. The invention enhances the monitoring and warning capabilities of the system, providing an effective solution for slope runoff monitoring and disaster prevention under complex terrain conditions.

This invention provides a method and apparatus for spatializing micro-grid socioeconomic indicators based on multi-source spatial data fusion, comprising: aggregating and mapping preprocessed nighttime light and population raster data of the study area to each grid cell; calculating fusion allocation weights based on the nighttime light intensity and population of each grid cell, thereby constructing a two-factor coupled spatial downscaling model to decompose macro-statistical aggregate data to each grid cell, generating a first type of gridded indicator; performing kernel density estimation on POI data to generate facility density raster aligned with the grid and extracting it as a second type of gridded indicator; performing two-stage standardization on the multidimensional matrix composed of the two types of indicators, and then performing principal component analysis on the standardized matrix to determine the objective fusion weights of each indicator; finally, performing linear weighted synthesis on the standardized indicators based on these weights to generate and output the grid-scale comprehensive spatial index corresponding to each grid cell.

This application discloses a data query method, apparatus, computer equipment, and storage medium. By introducing a rule-template-driven query caliber parsing mechanism and a rule engine-controlled data drill-down method, it achieves unified querying and hierarchical connectivity of enterprise financial data across the ledger layer, near-real-time summary layer, and detailed data layer. Simultaneously, through the rule-based derivation of summary data nodes, summary paths, and penetration links, and compiling them into a multi-level query plan containing multiple types of execution nodes, it achieves efficient data location and precise penetration across systems and levels, enabling group managers to drill directly from summary indicators to journal entry-level accounting records and corresponding financial data vouchers. This application reduces the operational complexity caused by manual reconciliation and switching between multiple systems, significantly improves data query efficiency and accuracy, and is beneficial for the group to implement refined management, strengthen risk control, and meet the data traceability requirements of internal and external audits.

This can improve the collection rate of invoiced amounts and reduce the customer's fee burden. [Solution] The details data creation unit creates account transfer billing contract details data, which are account transfer billing details for each contract ID in the month of account transfer billing, based on account transfer basic data including customer ID, contract ID, product related to the contract, agent code, contract date, customer account SEQ which identifies the customer's bank account, and billing unit number which indicates the billing unit for account transfer, and contract billing data which associates the scheduled transfer date and billing amount with the contract ID. The aggregate data creation unit creates account transfer customer aggregate data, which are account transfer billing details for each billing unit number in the month of account transfer billing, based on the created account transfer billing contract details data, and aggregate the billing amounts associated with each of the multiple contract IDs that contain the same billing unit number among the account transfer billing details for each contract ID. The output control unit outputs the account transfer customer aggregate data to the output device.

This invention relates to the field of data transmission technology, and more particularly to a digital runway information integration and transmission device, comprising several three-dimensional force stages, a data integrator, a PC unit, an industrial switch, and a central PC workstation. Each data integrator is connected to a predetermined number of three-dimensional force stages to receive and aggregate data collected by the corresponding force stages. The PC unit is connected to each data integrator in a one-to-one correspondence. The central PC workstation, industrial switch, PC unit, and data integrator establish a time synchronization link through a communication network, with the central PC workstation as the master clock node, compensating for network transmission delay parameters and data processing delay parameters in the communication network. The data integrator is equipped with a hardware synchronization interface, and outputs a unified hardware synchronization pulse to trigger synchronized data acquisition. This invention can reduce wiring complexity and transmission congestion risks, and improve the stability and time synchronization accuracy of multi-point data transmission.

Systems and methods for interval energy disaggregation utilizing profile-driven non-intrusive load monitoring are provided. An example method includes determining whether a structure utilizes solar energy. If the structure utilizes solar energy, the overall aggregate data is disaggregated to produce a predicted solar production. The predicted solar production is extracted from an overall aggregate data of the structure. Then, the method continues with establishing appliance profiles, selecting a set of the appliance profiles, and disaggregating the non-solar aggregate data, to produce disaggregated data relating to at least one of AC energy consumption and EV (electric vehicle) consumption. The disaggregated data is provided to the customer or utility.

This invention discloses an agricultural optimization method and system that integrates simulation of agricultural producer behavior. The method includes: integrating and unifying the scale of multi-source data to obtain a standardized database; simulating agricultural producer behavior to output aggregated data at the farmer scale; constructing a multi-sectoral equilibrium model; using the data in the standardized database as a basis, combined with the aggregated data at the farmer scale, to output regional equilibrium results; establishing a dual-scale linkage control mechanism between the region and farmers; constructing and solving a multi-objective optimization model, with farmer income increase, water conservation, emission reduction, and stable grain production as objective functions, and using an optimization algorithm to solve the multi-objective optimization model to output a configuration scheme adapted to production practice. Its beneficial effects are: this invention solves the problems of traditional schemes ignoring farmer heterogeneity, insufficient multi-factor coupling, and lack of coordinated adaptation between macro-regions and micro-farmers; and it can obtain an implementable optimal layout scheme at the plot scale.

We provide the system. [Solution] A means of automatically collecting information from various sources, A means of analyzing collected information and classifying emotions, A means of summarizing the analysis results and integrating redundant information, Means of providing summarized data to users, A system that includes this.

A preferred aggregate store for a multidimensional database receives and stores intermediate data generated as part of a larger query for avoiding repetitive or redundant data retrievals incurring costly data paths. Aggregates include intermediate tables and sets of data, often generated from a join of two or more distinct data tables, combined for generating a query result. In the event an aggregate is called for, certain storage locations may be preferable to others due to network distance, fees for storage and processing, as in the case of cloud storage, or write accessibility. Designation of a preferred aggregate store ensures that aggregates called for by the query processing are stored in a beneficial location for cost and efficiency.

This disclosure provides a smart home-based elderly care method, along with a cloud server, computer equipment, and storage medium. The method includes: acquiring aggregated data of various indicators of a target user uploaded by a data acquisition terminal; wherein the data acquisition terminal is connected to multiple health monitoring devices of the target user to collect various indicator data of the target user and aggregate the data indicators; analyzing and processing the aggregated data of the target user's various indicators; and performing corresponding operations based on the processing results. This smart home-based elderly care method can aggregate the various indicator data collected by various health monitoring devices and send it to a cloud server for analysis and processing, thereby simplifying the user's operation process.

This invention discloses an access control policy generation method, device, and medium, relating to the field of computer technology. The method includes: acquiring raw data packets, identifying their corresponding protocols, and distributing them to appropriate parsers based on protocol type, enabling the parsers to parse the data and obtain standardized events; collecting multi-source raw logs from various nodes, parsing and extracting log metadata, combining the metadata with the corresponding log content for rule matching and structuring; collecting hardware health indicators and monitoring service response status, summarizing the data and performing comprehensive indicator analysis to filter and classify status events; and after cleaning, compression, and authentication, associating and fusing the cleaned and compressed data to generate access control policies. This approach constructs a three-dimensional cross-validation system for security events from the network, host, and application perspectives, reducing false positives and false negatives, providing a reliable basis for policy generation, improving policy generation efficiency, and enhancing the accuracy and efficiency of system security protection.

The application relates to a data packet sending method, a data processing unit, a host and a network card, and comprises the following steps that a host writes an aggregated data packet into a cache unit on the host side, a data processing unit receives a packet sending notification sent by the host, and acquires a first cache descriptor and a second cache descriptor; the first cache descriptor comprises the address of the cache unit on the host side and an aggregation identifier, and the second cache descriptor comprises the length of each data packet contained in the aggregated data packet; the aggregated data packet is read from the corresponding cache unit on the host side according to the address of the cache unit; the each data packet is extracted from the aggregated data packet according to the length of the each data packet; and the each extracted data packet is sent to a peer device in sequence. The application can improve the bandwidth utilization rate of PCIe based on the virtio virtualization protocol to send network small packets.

This application provides a data processing method, data processing apparatus, electronic device, medium, and product, which can be applied to the fields of computer and big data technologies. The method includes: responding to a data storage instruction, splitting the data to be stored for each piece of data to be stored to obtain split data corresponding to at least one attribute dimension, wherein the attribute dimension represents the data type to which the split data belongs, and the data to be stored represents a user's resource purchase records over historical time; for any attribute dimension, identifying the attribute parameters of each split data piece under the attribute dimension and the user's resource purchase information; for any attribute parameter, generating attribute aggregate data based on multiple split data pieces related to the attribute parameter and their respective resource purchase information, and storing the attribute aggregate data.

A system and method for providing fleet cyber-security comprising may include collecting, by a plurality of data collection units installed in a respective plurality of vehicles in the fleet, information related to cyber security and including the information in reports to a server. Data in reports may be aggregated, by the server. A cyber-attack may be identified based on aggregated data.

This invention discloses a cross-city federated traffic knowledge transfer method, belonging to the field of federated computing technology. Under a federated learning framework, this method addresses data gaps through a local traffic view interpolation module on the source city client, eliminates cross-city data distribution differences through a traffic domain adapter module, and achieves secure data aggregation with privacy protection through a traffic secret aggregation protocol on the target city server. Finally, the aggregated data is used to train a high-performance global traffic prediction model. This invention innovatively combines spatiotemporal data completion, domain adaptation transformation, and lightweight secure aggregation, effectively overcoming the three major challenges of privacy leakage, distribution differences, and poor data quality in existing technologies. Experiments show that this invention can significantly improve the traffic prediction accuracy of the target city while protecting data privacy.