240 results about "Data products" patented technology

A system for converting a source data feed schema into a canonical data product including a memory for storing computer-executable instructions and a processor for executing the instructions stored on the memory. Execution of the instructions programs the processor to perform operations that include receiving a source data feed having a source schema, identifying a plurality of data fields of the source schema, assigning a data category from a plurality of predefined data categories to each data field of the plurality of data fields, modifying the source schema based on predefined parameters, wherein the source schema is modified to match a target schema, comparing the modified source schema to the target schema, and in response to a determination that the modified source schema matches the target schema, converting the source data feed to a canonical data product having the target schema based on the assigned data categories.

The invention discloses an artificial intelligence auxiliary authentication method and system for data element right confirmation, and relates to the technical field of data element management and credible circulation. Comprising the following steps: data acquisition: acquiring a data product, an ownership statement and contract terms, and calculating an initial digital fingerprint of the data product; and ownership identification: extracting core value elements and features of the data product based on a multi-modal intelligent analysis model, quantifying value contribution weights formed by all links to the data product, and automatically generating a data element circulation graph. According to the method, the multi-modal intelligent analysis model is constructed, and the data product is deeply scanned and analyzed automatically, so that the dependence on predefined rules is reduced, and the intellectualization and automation of ownership identification are realized; by constructing an intelligent compliance verification model, data operation behaviors are monitored and compared in real time, substantive compliance control over the whole data use process is achieved, and a credible use closed loop is established.

The invention discloses a method for aggregating ocean buoy data, which comprises the following steps of: establishing a space-time correlation model according to the spatial distribution density of buoy clusters and the dynamic characteristics of an ocean environment, and adaptively dividing buoy groups with a data compression cooperative relationship; performing a data-related compression operation within the buoy group; constructing a transmission priority dynamic sorting engine, and calculating a dynamic weight coefficient; performing hierarchical packaging processing on the differential coding data, distributing enhanced forward error correction coding resources for high-priority data, and reserving redundant transmission time slots; the method comprises the following steps: receiving a hierarchical data packet through a low-orbit satellite and executing on-satellite preprocessing, reconstructing an original data stream by using a distributed decoder, and meanwhile, fusing multi-dimensional space-time related data to generate an aggregated data product; and finally, the aggregated data product is transmitted to a ground data center through a satellite downlink. According to the invention, uplink data volume is reduced, disaster monitoring timeliness is improved, ground station processing load is reduced, and system environment adaptability is enhanced.

The invention belongs to the technical field of hydrology and water resources, and discloses a cold and dry mountainous area drainage basin runoff simulation method based on an MIKE SHE / MIKE 11 coupling model in combination with GIS / RS data. According to the multi-source data fusion technology, a cold and dry mountainous area distributed input data set is constructed through TRMM satellite rainfall data, an MODIS LAI product and an ASTER DEM, and the rainfall space representation precision is improved by 40%. According to the model coupling mechanism, an MIKE SHE / MIKE 11 collaborative simulation framework is provided, earth surface-groundwater flow data interaction is achieved through river channel linkage, and the complex river network flood routing simulation error is reduced to 10% or below. According to the parameter partition calibration method, a drainage basin is divided into five hydrogeological regions, sensitive parameters such as a Manning coefficient and a hydraulic conduction coefficient are optimized in combination with a genetic algorithm, and the basic flow simulation precision is improved by 25%.

A computer-implemented method and apparatus for managing physical and digital products' customization using container format are disclosed. In some embodiments, the method comprises receiving a container file with serialized objects, deserializing these objects to form a hierarchical object structure, and interacting with a database to obtain real-time configuration data. Custom attributes of the products are defined by binding attribute / value pairs to the hierarchical structure. A visualization of the customized product is generated based on these pairs, and manufacturing instructions are determined considering the attribute / value pairs and manufacturing constraints. The apparatus comprises a memory and a processor to execute instructions for deserializing the container file, retrieving configuration data, organizing objects into a hierarchical tree, negotiating product customizations, and outputting manufacturing data. This system enables efficient and accurate production of customized products by managing data, rendering graphics, and incorporating manufacturing constraints.

The embodiment of the invention provides a method and a system for processing ocean multi-parameter wide-width imaging data of a Beidou interference altimeter, and relates to the technical field of GNSS-R. The method comprises the following steps: constructing a set of complete and strict data processing chain; through precise calculation of a GNSS-R direct signal and reflection signal delay inequality interference geometric model and correction of actual measurement delay inequality errors, systematic errors in the process of converting original signals into geophysical parameters are remarkably reduced, and the precision and reliability of parameters obtained through final inversion are improved. And on the basis of a self-adaptive data collection strategy of parameter space-time transformation characteristics and a spatial interpolation reconstruction process, discrete strip data is intelligently'woven 'into a continuously-covered wide-swath imaging type data product, so that the data format better meets the analysis requirements in the fields of oceanography, climatics and the like, and the intuition and usability of the product are improved.

The invention relates to a part generation method based on atomization disassembly and encapsulation data. The part generation method comprises the following steps: step 1, analyzing a demand scene; step 2, carrying out atomization disassembly; step 3, performing standardization verification; step 4, packaging the function logic layer; step 5, packaging the element part layer; 6, packaging an interface layer; according to the method, the problems of function solidification and difficult splitting of a traditional data product are solved, and efficient circulation and value release of data elements are promoted; and reusability and circulation efficiency of data parts are improved through the element part layer.

A system for event-driven distributed data network analysis, the system includes: a multitude of domain data nodes, each comprising a stream storage, a multitude of transformation pods, and a product API, with each domain data node ingesting heterogeneous event streams, validating schema compliance, performing enrichments, and making data products available under versioned schema contracts; each domain data node further comprises a hardware-based edge intelligence appliance comprising an enclosure, a compute module with heterogeneous processing units selected from CPUs, GPUs, and TPUs, a secure enclave module for confidential execution of transformation code on encrypted data, a protocol-structured stream storage medium supporting multi-level retention, and industrial I / O interfaces configured for direct interaction with sensors, programmable logic controllers, and cloud-native services; an event mesh backbone processor configured to connect the multitude of domain data nodes via a publish-subscribe architecture, with the backbone guaranteeing exactly one-time delivery, partition-level sorting, and geo-replicated durability; a Contextual Intelligence Engine coupled with the Event Mesh Backbone processor, the engine comprising a semantic graph memory and a Streaming Graph Reasoner configured to map raw events into an ontology, perform graph joins in real time, and recognize composite causal patterns across multiple domain data nodes; a governance and policy control unit integrated into both the data and control layers. This layer enforces zero-trust security, role-based access control, real-time provenance tracking, and regulatory compliance; and An actuation interface coupled with the contextual intelligence engine and the governance layer. The actuation interface is configured to generate control commands for operational technology devices and digital workflows, thus closing the loop from data acquisition to autonomous decision-making.

The invention relates to the technical field of big data management, in particular to a big model metadata authority management method and system based on an RBAC-ABAC fusion model, and the method comprises metadata annotation, data product release, big model and user access, semantic perception, dynamic authority adjustment, row-level authority control and authority life cycle management. The method has the beneficial effects that by fusing the advantages of the RBAC model and the ABAC model, the defects of a single authority management model are overcome, the efficient, dynamic and fine-grained authority management of the large model metadata is realized, the security of the large model metadata is improved, and the authority management requirement of the large model for accessing the dynamic business data is met.

The invention provides a data element value measurement and pricing control method, system and device, and belongs to the technical field of data asset value evaluation and management. Pricing information similar to data product fields is collected; analyzing the data element supermarket, and recording data quality, data volume, data timeliness and data application scene information at the same time; constructing a preliminary pricing model, and performing a simulated pricing test on the fields of the known prices by using the preliminary pricing model; determining a final price of the data product; formulating and executing a data directory putting mode; a putting monitoring mechanism is established, and the page view, the click rate and the inquiry amount of the data catalog are tracked in real time to know market response; setting an order quantity monitoring index and a market comparison analysis dimension; and collecting order quantity data, sorting and analyzing to generate a monitoring report. Through a value measurement and pricing management and control method, data products are priced by comprehensively considering various factors, and reasonable flow and configuration of data elements are promoted.

Telecommunications systems, computer devices and systems, and methods are provided. One example method, performed by a data abstraction layer of a telecommunications system for a network, includes accessing data elements associated with a network function of the network, performing abstraction on the data elements to generate one or more data products, receiving a customer request for a service on the network, identifying the data product related the service, and provisioning the identified data product to the customer. The method may further include identifying proprietary data and private data of the data elements based on a predefined policy and removing proprietary data and private data before performing abstraction.

This disclosure relates to methods, devices, and computer-readable media for use in developing data products. One such method comprises receiving an existing build of the data product, identifying a data product version associated with the existing build, receiving a user-specified modification for the data product, in response to a user input, automatically determining a compatibility result for the modification with the identified data product version, based on the existing build of the data product, and in response to the determined compatibility result being a negative compatibility result, triggering a failure event in relation to the identified data product version.

The invention discloses a marine geological environment-oriented multi-source heterogeneous data acquisition quality control method and system, and belongs to the technical field of marine exploration. According to the method, a unified data description model is constructed, and the data structure and the space-time reference of the sensor are standardized; executing an adaptive collaborative acquisition strategy based on a preset task, and dynamically adjusting sensor parameters according to data characteristics to realize multi-source collaboration; and through multi-dimensional verification of integrity, range, time sequence stability, association consistency and the like, real-time evaluation and quality marking are carried out on the acquired data, and the data quality is guaranteed from the source. And the processed data and metadata are packaged into a standardized data product, so that the data usability and the reliability of system operation are ensured. By means of the method, pre-processing of quality control is achieved, the follow-up cleaning workload is reduced, support is provided for efficient data fusion analysis and scientific interpretation, and the automation level and the intelligent level of marine geological survey are improved.

The invention relates to the technical field of data management, and particularly discloses an efficient management method and system for a data directory in a data space, and the method comprises the steps: carrying out the incremental updating of metadata information, data product registration information and cross-node data directory information related to the data directory to a distributed data storage system; constructing a full-text index and a vector index of metadata in the distributed data storage system, and matching a vector generated based on the request content with the full-text index or the vector index to obtain a retrieval response result; marking a semantic equivalence data set based on the semantic vectors of all the data sets, constructing a data set node graph based on all the semantic entity lists, and outputting a semantic equivalence field list based on the semantic equivalence data set and the data set node graph; determining an associated recommendation result of the retrieval response result based on the semantic equivalence field list, and synchronously returning the retrieval response result and the associated recommendation result; data directory management and efficient utilization in a distributed heterogeneous cross-domain data space are supported.

The invention belongs to the technical field of data processing, and discloses an enterprise-oriented AI cross-data integration service architecture design method and system, and the method comprises the steps: building a semantic connection layer of a cross-enterprise data source, penetrating bottom layer heterogeneous metadata in a layering and non-isolation manner to carry out logic unification, combining hotspot perception and a self-evolution mechanism, and carrying out the self-evolution of the semantic connection layer. Forming a cross-source semantic ontology of data weaving; based on the cross-source semantic ontology, generating a virtualized data view by adopting a zero-migration architecture; an optimization mechanism with query delay and a data filtering rate as reward signals is introduced to dynamically adjust a mapping strategy, and a virtual data product is output in combination with semantic mapping; low cost, high efficiency and sustainable evolution of enterprise cross-data integration are realized, and a solid support is provided for deep application of AI in a multi-enterprise cooperation scene.

The invention relates to the technical field of geographic surveying and mapping, and discloses a geographic surveying and mapping method and system based on unmanned aerial vehicle remote sensing, and the geographic surveying and mapping method based on unmanned aerial vehicle remote sensing comprises the following steps: processing source domain topographic data and target domain scarce samples through a feature selective migration network, and obtaining a feature adaptability model parameter set; processing a low-resolution remote sensing image through a physical constraint generative adversarial network to obtain a high-resolution geographic feature enhanced image data set; processing the high-resolution geographic feature enhanced image data set and the feature adaptability model parameter set through a hierarchical attention network to obtain a fine-grained ground feature classification result matrix; through a small sample learning strategy of feature selective migration, a super-resolution reconstruction technology of physical constraint, a fine-grained classification method of hierarchical attention and a standardized geographic data product generation process, the dependency of surveying and mapping data acquisition on the environment is reduced, the surveying and mapping efficiency is improved, and the surveying and mapping precision is improved.

The invention relates to the technical field of enterprise data security exchange, and particularly discloses a data space system and a connector assembly and a data circulation method thereof. The system comprises: a data space platform providing enterprise registration, purchase and registration of a connector assembly, issuing and transaction functions of a data product, and issuing a signed electronic transaction contract; the at least two connector assemblies are deployed in the corresponding enterprise intranet and have public network access addresses, and the zero-trust gateway controls the access permission granularity of a network port of the deployment equipment based on a dynamic strategy; the network agent module receives a data request of a user, performs asymmetric encryption processing on request data, and initiates a validity verification request to the connector service module through the Socket communication interface; the connector service module performs validity verification on the validity verification request based on the transaction evidence and the electronic contract information and returns a result; the method has the advantages of solving the data island phenomenon, improving the safety protection capability and reducing the deployment operation and maintenance complexity.

The invention discloses an ionosphere real-time monitoring method, device and system, and a storage medium, and the method comprises the steps: configuring a multi-frequency GNSS receiver on a low-orbit satellite, obtaining a navigation satellite signal in real time, rapidly calculating the total electron content of an oblique ionosphere through the dual-frequency carrier phase difference, and calculating the observation confidence based on a Kalman filtering model; further, the satellite end carries out anomaly monitoring through a dynamic threshold value, and respectively generates and downloads a compressed observation flow containing a quality index and original carrier phase observation data fragments in a time window before and after the anomaly is triggered; and the ground station performs weighted fusion on the compressed observation flow according to the confidence coefficient to generate high-precision TEC data. According to the technical scheme, high-precision TEC data products for ionosphere research and abnormal original data products for deep diagnosis are finally produced through on-satellite intelligent processing and selective downloading, communication bandwidth occupation can be remarkably reduced, and observation real-time performance and data reliability are improved.

The embodiment of the invention provides a configuration information detection method, equipment, system and device and a storage medium. The method is applied to a detection engine, and comprises the following steps: determining at least one data product instance corresponding to a target user in response to a trigger instruction for detecting configuration information corresponding to a data product of the target user; for any data product instance, calling a plurality of pre-stored detection scripts to respectively read and detect multiple items of configuration information of the data product instance, the configuration information detected between every two of the plurality of detection scripts being different; and if the detection result of any detection script on the corresponding configuration information is that the configuration risk exists, outputting alarm information to a client corresponding to the target user. Therefore, by adopting the technical scheme, not only can the detection of the configuration information of different types of data products be flexibly adapted, but also a plurality of detection scripts correspondingly detect a plurality of types of configuration information, so that the comprehensiveness, accuracy and timeliness of the detection can be improved.

This invention discloses a multi-scale time-frequency analysis method and system for ocean current meter signal processing, relating to the field of marine information processing. The method includes: S1: acquiring raw data and performing physical benchmark correction to obtain three-dimensional current velocity data and basic mass labels; S2: extracting first and second features from the three-dimensional current velocity data through spatiotemporal decoupling; S3: fusing and separating the three-dimensional current velocity data based on the first and second features to obtain an optimized set of flow field parameters, and generating the uncertainty of each parameter by combining the basic mass labels and error source information; S4: performing comprehensive quality assessment and grading based on the first and second features and the uncertainty, outputting a data product with mass labels and uncertainty information. By extracting spatiotemporal dual-dimensional features and using them to guide signal fusion and quality assessment, highly robust processing of ocean current data and end-to-end quality traceability are achieved, significantly improving the reliability of the data product.

The invention provides a data transaction contract updating method and device, electronic equipment and a storage medium, and the method comprises the steps: determining a data transaction scale in a current monitoring time period; under the condition that the data transaction scale is smaller than a preset threshold value, obtaining all transaction information generated from the moment when the currently used data transaction contract takes effect to the current moment; updating a pricing model in the data transaction contract based on the multi-dimensional feature data, the predicted pricing information and the actual pricing information; updating a revenue distribution model in the data transaction contract based on the multi-dimensional feature data, the predicted revenue distribution information and the actual revenue distribution information; and obtaining an updated data transaction contract based on the updated pricing model and the updated income distribution model. Therefore, pricing and benefit distribution of the data product can be automatically adjusted, the dynamic adaptability of the intelligent contract to the data asset market is improved, manual modification and deployment are not needed, and the reliability of the contract is improved.

The invention discloses a dynamic monitoring and accounting system for organic carbon reserves of lake and reservoir sediments, belongs to the technical field of carbon cycle monitoring, and aims to solve the problems of spatial-temporal resolution contradiction and insufficient multi-source data fusion caused by a single data source in a traditional method. A space-time continuous fusion data product is generated in combination with an adaptive fusion algorithm, the system comprises a multi-source data acquisition module, a preprocessing module, an uncertainty quantification module, a fusion processing module and a verification feedback module, deep fusion of space-based remote sensing, foundation in-situ and experimental analysis data is achieved, and through independent actual measurement data verification and parameter feedback optimization, the space-time continuous fusion data product is obtained. And the system forms a precision improvement closed loop, so that the stability and accuracy of long-term operation are ensured.

The application discloses a kind of provincial range rural black and odorous water body satellite remote sensing identification method and system, it is related to environmental remote sensing technical field;A kind of provincial range rural black and odorous water body satellite remote sensing identification method, comprising the following steps: obtaining data, data processing, data image inlaying, obtaining water body distribution data, data cropping, obtaining index data product, obtaining classification grid, preliminary obtaining black and odorous water body distribution, obtaining the final distribution of black and odorous water body;The present application utilizes multi-source satellite remote sensing image data, in combination with water quality parameters, constructs the remote sensing identification model of provincial range rural area water body using NIR, NDWI, SWI index and slope data etc., then uses BOI, NDBWI etc. Index constructs rural area suspected black and odorous water body extraction model, in combination with the relevant data of water body field measurement in monitoring area determines the extraction threshold of water body and black and odorous water body, realizes the automatic identification and extraction of rural area black and odorous water body, and develops relevant software system.

The invention relates to the technical field of data processing, in particular to a spinal disease intelligent confirmation method, device and equipment, and the method comprises the steps: firstly constructing a multi-modal spatio-temporal data set fusing a static structure, a dynamic function and clinical data, and carrying out the standardization processing; the method comprises the steps that firstly, through a pre-trained HMC-VSPF heterogeneous modal collaborative awareness and centrum sequence conduction fusion network, quantitative prediction of symptom severity is achieved, the contribution degree of structural lesions and dysfunction to symptoms is quantified, finally, through unsupervised clustering fused with biomechanical constraints, intelligent typing of pathogenic modes is achieved, and the probability of pathopoiesis is lowered. And an individualized diagnosis and treatment data product is generated through three-level quality control. Through multi-modal data deep fusion, causal mechanism analysis and intelligent typing, the diagnosis and treatment accuracy and interpretability are improved, individualized precise diagnosis and treatment of spinal diseases are achieved, and a quantitative basis is provided for clinical decision making.

The invention discloses a data transaction pricing method and device and a medium, and relates to the technical field of data processing. The method comprises the following steps: constructing a four-dimensional feature vector according to a scarcity feature, a timeliness feature, demand features of both transaction parties and a risk preference feature corresponding to a fusion data product, and obtaining the four-dimensional feature vector; leaf node disturbance pricing inference is conducted on the basis of an intelligent pricing model in combination with the four-dimensional feature vector, a pricing output result is obtained, and the intelligent pricing model is composed of a LightGBM model in combination with a Monte Carlo sampling prediction mechanism. The method has the specific effects that the non-standard pricing mechanism based on the intelligent pricing model comprehensively considers multi-aspect factor characteristics, the real value of a fused data product can be accurately reflected, the fairness of the transaction is improved, and the active development of the data transaction is promoted.

A method for creating interferometric coherence data products for objects imaged by Synthetic Aperture Radar (SAR) having polarization(s). The method includes: for each identifiable object geometry for which there are acquired geocoded interferometric SAR images with flat-earth and topographic phase removed having following pixel values: backscatter intensity (V1) in polarization(s) for master image; backscatter intensity (V2) in polarization(s) for slave image; in-phase component (V3) of geocoded interferogram in polarization(s); and quadratic-phase component (V4) of geocoded interferogram polarization(s), determining which geocoded pixels are within identifiable object geometry considering known geolocation accuracy of identifiable object geometry and geocoded interferometric SAR images; and determining coherence values and statistics of coherence values for objects for polarization(s), based on pixel values V1, V2, V3, and V4 within identifiable object geometry.

The application discloses a data product pricing method and device based on reinforcement learning, and a medium. The method comprises the following steps: obtaining the cumulative total cost and the total number of calls of a target data product, and calculating a break-even bottom price of the target product; determining a value adjustment coefficient through a preset parameter mapping relationship according to multi-dimensional value evaluation parameters, and adjusting the break-even bottom price to obtain a benchmark price; calculating a price deviation value between the benchmark price and a market median price; when the price deviation value exceeds a preset threshold, generating an expected selling price based on the current operating state parameters of the market through a reinforcement learning agent; performing a gray-scale test on the expected selling price to determine a full-amount effective state; and based on the effective expected selling price, performing the verification and cancellation of the number of calls through a blockchain in response to the number of calls paid by a buyer. The cost and value are anchored, the reinforcement learning dynamic pricing and delivery feedback closed loop are linked, and the pricing can be adjusted according to market and quality changes.

This disclosure relates to methods, devices, and computer-readable media for use in developing data products. One such method comprises receiving an existing build of the data product, identifying a data product version associated with the existing build, receiving a user-specified modification for the data product, in response to a user input, automatically determining a compatibility result for the modification with the identified data product version, based on the existing build of the data product, and in response to the determined compatibility result being a negative compatibility result, triggering a failure event in relation to the identified data product version. The user specified modification may comprise one or more of: modification of a schema or addition modification or deletion of one or more tables, columns, service level objectives, service level indicators, constraints. Determination of the compatibility result may comprise determining a negative compatibility result by identifying that a table, column, service level objective, constraint or other object present in the existing build is removed by the modification.

The invention provides a data configuration method which can be applied to the technical field of big data technologies. The data configuration method comprises the steps of obtaining at least one data demand dimension corresponding to a target business scene based on the target business scene; based on the data demand dimension, at least one piece of candidate sub-data is obtained from a data pool, the data pool is constructed based on m pieces of sub-data subjected to data annotation, the m pieces of sub-data are from at least one data product, and m is an integer larger than or equal to 1; combining the candidate sub-data to obtain at least one candidate configuration scheme; based on the value score and the configuration cost of the candidate configuration scheme, the candidate configuration scheme is evaluated to obtain a target configuration scheme, and the value score is obtained at least based on one of the application range, the timeliness and the data precision of the candidate sub-data. The invention further provides a data configuration device, equipment, a storage medium and a program product.

The invention discloses a method and device for fusing, storing and managing massive small files and data records, and the method comprises the steps: building an external metadatabase which is used for managing a hierarchical relation of scientific observation data sources and a mapping relation between an aggregation file and an original file of scientific observation data; according to a preset aggregation rule based on data product categories and timelines, the multiple original files are aggregated and packaged in a target file container in a column storage format, and the content of the original files and structured data records obtained by analyzing the original files are stored in the target file container at the same time; and based on the external metadatabase and the target file container, providing file-level access aiming at the original file content and record-level retrieval service aiming at the structured data record. According to the method, the aspects of system simplification, performance optimization, space saving and service capability are remarkably improved, and a new way with high expandability is provided for efficient storage and multi-level service of space weather scientific data.