Patents
Literature
Hiro is an intelligent assistant for R&D personnel, combined with Patent DNA, to facilitate innovative research.
Hiro

160 results about "Data exploration" patented technology

Data exploration is an approach similar to initial data analysis, whereby a data analyst uses visual exploration to understand what is in a dataset and the characteristics of the data, rather than through traditional data management systems. These characteristics can include size or amount of data, completeness of the data, correctness of the data, possible relationships amongst data elements or files/tables in the data.

System and method for large-scale data visualization

The present invention is directed to a new visualization platform for the interactive exploration of large datasets. The present invention integrates a collection of relevant visualization techniques to provide a new visual metaphor for viewing large datasets. It is capable of providing comprehensive support for data exploration, integrating large-scale data visualization with querying, browsing, and statistical evaluation. A variety of techniques are utilized to minimize processing delays and the use of system resources, including processing pipelines, direct IO, memory mapping, and dynamic linking of “on-the-fly” generated code.
Owner:AMERICAN TELEPHONE & TELEGRAPH CO

Distributed platform for network analysis

The present disclosure describes an apparatus and methods for performing data analysis, in particular network analysis. Specifically it provides a framework and user interface whereby raw data may be imported into a data model with entities, attributes, and relationships between the entities and multiple data analysis algorithms may be pipelined into a larger data analysis model and applied to the data model. Offline and online data visualization and data exploration techniques, may be applied to the results of the data analysis enabling real-time and near real-time interactive online analysis. Extensibility models and market transaction models are also provided.
Owner:CHALKLABS

Basic service system for medical large data application

The invention relates to a basic service system for medical large data application, which is characterized in that the system comprises a large data cloud ETL subsystem, a large data basic kernel subsystem, a medical large data analysis mining subsystem and a system running management monitoring subsystem, wherein the large data cloud ETL subsystem is responsible for extracting, cleaning and converting and loading related datum of a hospital information system; the large data basic kernel subsystem takes the advantage of technologies such as Storm stream calculation, MapReduce batch calculation, Spark, medical large data metadata and HBASE semi-structured data storage used in large data basic capacity to realize storage, calculation and analysis to medical large datum; the medical large data analysis is used to analyze the datum stored in a medical large data basic kernel platform by utilizing data exploration, mining modeling and model evaluation; and the management monitoring subsystem is responsible for providing support, monitoring, configuration and safety service for the whole medical large data application platform.
Owner:HUNAN INTERACTIVE MEDIA

Subtractive clustering for use in analysis of data

A data analysis system and / or method, e.g., a data mining / data exploration method, using subtractive clustering is used to explore the similarities and differences between two or more multi-dimensional data sets, e.g., generated using a flow cytometer, an image analysis system, gene expression, or protein microarrays.
Owner:BOARD OF RGT THE UNIV OF TEXAS SYST

Big data processing method and system

The invention provides a big data processing method and system. The method is applied in a database agent system which includes a database agent module, a data detection module and a data desensitization module; the method includes the steps that the database agent module receives the data access request of the application client, and determines target data in a target source database and the operation type of the target data according to the data access request; the database agent module conducts operation on the target data according to the operation type, and obtained the operation result returned by the target source database; the data detection module detects the sensitive data of the operation result according to a target detection strategy and determines the sensitive data in the operation result; the data desensitization module desensitizes the sensitive data in the operation result according to the preset desensitization strategy and obtains response data after desensitization; the database agent module returns the response data to the application client. The big data processing method and system can enable the database agent system to conduct data transmission, and achieve the data desensitization of transmitted data at the same time.
Owner:北京明朝万达科技股份有限公司

Automated data exploration

A method for automated data exploration including selecting a plurality of analytic flows from an analytic flow pattern, executing a task, wherein the task is tracked by the plurality of analytic flows, receiving feedback for each of the plurality of analytic flows, determining a performance score for each of the plurality of analytic flows, and adjusting the flow according to the performance score.
Owner:IBM CORP

Data governance system and method

The invention discloses a data governance system and method. The system comprises a data access module which is used for reading multi-source heterogeneous data, enabling the multi-source heterogeneous data after data exploration and data definition to be accessed to a big data center, and carrying out the data account checking; the data processing module is used for extracting data, converting the extracted data into a required format, correcting or clearing abnormal data, and distributing the data to a corresponding data warehouse; the data organization module is used for storing the distributed data into a corresponding library in a classified manner to obtain various types of metadata; the data processing module is used for carrying out directory integration and grading classification on the metadata, determining the blood relationship and quality of the metadata, carrying out data operation and maintenance and carrying out use and service on the metadata; and the data service unit is used for providing data for users. The invention solves the technical problems that unified data quality evaluation standards and management specifications do not exist in data quality monitoring, all-around quality monitoring cannot be achieved, and a closed-loop processing mechanism is lacked for data quality.
Owner:广州汇智通信技术有限公司

Data cleaning method and device based on distributed platform

The invention discloses a data cleaning method and device based on a distributed platform. The method is applied to a distributed high-efficiency real-time processing system and used for data cleaningin big data magnitude, the performance and magnitude purposes are achieved by means of distributed processing, and the demands of rapid processing and real-time responses are met; the service demandsare met and the cleaning purpose is achieved through continuous iterative optimization, the process is a process of alternately conducting data exploration and rule optimization, the data quality iscontinuously improved, the problem that existing centralized processing cannot adapt to large-scale data operation is solved, the features of big data are fully utilized to complete big data cleaning,and data preparation is provided for massive data analysis; the service demands is met optimally, and the data cleaning performance and the data processing efficiency can be improved.
Owner:SHENZHEN ZHONGYI TECH CO LTD

Interactive visualization based multi-dimension data analyzing method and system

ActiveCN106874349AExpress relationshipDynamic and effective interactive linkageCharacter and pattern recognitionGeographical information databasesAnalysis dataData exploration
The invention discloses an interactive visualization based multi-dimension data analyzing method. The method comprises the following steps: acquiring data to be analyzed; determining attribute dimension to be analyzed and displayed of the data to be analyzed; performing cluster analysis on the data to be analyzed according to the determined attribute dimension; distributing different color to each cluster according to the cluster analyzing result; displaying an integrated map and a parallel coordinate map of the data to be analyzed according to the determined attribute dimension and the color distributed to each cluster; receiving first interaction operation triggered based on the parallel coordinate map, and updating the displayed parallel coordinate map and the integrated map. The invention also provides an interactive visualization based multi-dimensional data analyzing system. With the adoption of the method and the system, the problems that the interaction linking and analyzing of the multi-dimension attribute properties cannot be dynamically analyzed in existing multi-dimension data exploration and analysis, and the spatial distribution mode of the multi-dimension attribute properties and the incidence relation among the attribute dimension cannot be effectively expressed, can be solved.
Owner:深圳市位和科技有限责任公司

Distributed transient electromagnetic data acquisition system based on wireless sensor network

The invention relates to a distributed transient electromagnetic data acquisition system based on a wireless sensor network. The distributed transient electromagnetic data acquisition system is composed of an industrial personal computer, a coordinator, a plurality of router nodes, a plurality of terminal acquisition nodes and the wireless sensor network serving as a basic network, wherein the router nodes and the terminal acquisition nodes are distributed flexibly. The industrial personal computer is connected with the coordinator through a USB, and the terminal acquisition nodes, the router nodes and all nodes of the coordinator are in wireless connection with one another; the terminal acquisition nodes are used for completing acquisition and uploading of transient electromagnetic data; the router nodes are used for completing the router addressing and data forwarding function; the coordinator is used for completing storage, display and USB communication of the acquired data; the industrial personal computer is used for controlling the acquisition process of each node, displaying the data, and completing calculation of obtained data exploration parameters. The distributed transient electromagnetic data acquisition system has high exploration accuracy, connection wires between the nodes are omitted, field operation is convenient, work efficiency is improved, modular design is adopted for the nodes, and maintenance and replacement are convenient.
Owner:武汉旗云高科工程技术有限公司

Method for predicating COD load of sewage based on vector time sequence model

ActiveCN106872658ASimplify and optimize parametersGood estimateTesting waterReduced modelData dredging
The invention discloses a method for predicating COD load of sewage based on a vector time sequence model. The method comprises the following steps: performing definition of an excavation target in a data mining modeling process; performing data exploration and preprocessing on obtained sewage inlet related data to meet requirements of vector autoregression model modeling; selecting parameters of an maximum likelihood estimation model, selecting information criteria to determine order of the model, and performing model checking through multi-factor blending statics; and further simplifying the model through target parameters, thereby establishing a simple and effective predicating model. The acquired inlet water data determines water inlet amount and inlet water COD, and a sewage COD load attribute is constructed; test data predication is performed through the obtained predicating model, and output of the model is predicated results for a sewage COD load related variable. According to the method disclosed by the invention, the model is simple, multiple variables can be predicated at the same time, predicating precision is relatively high, and needed time is short.
Owner:SOUTH CHINA UNIV OF TECH

Method and article for interactive data exploration

A markup programming technique is described which directs a rendering agent to display at least two charts at the same time and, in response to a cursor operation over one of the charts, to replace the other chart. The cursor operation need not be a mouse click and can simply be the event of moving the cursor into a specified area of the first chart.
Owner:ORACLE INT CORP

Unmanned aerial vehicle path planning system and method for distributed encouraging spatio-temporal data exploration

The invention discloses an unmanned aerial vehicle path planning system for distributed encouraging spatio-temporal data exploration. The unmanned aerial vehicle path planning system comprises a mainupdating node and a plurality of sub-computing nodes, wherein each sub-computing node computes a plurality of unmanned aerial vehicles; the sub-computing nodes are used for computing the state information of multiple unmanned aerial vehicles and the equipment in the inspection area based on a neural network learning algorithm and pushing the gradient of neural network parameters to the main updating node and also acquiring network parameters from the main updating node and performing unmanned aerial vehicle position planning and action planning based on the network parameters and broadcastingthe unmanned aerial vehicle position plans and the action plans to all the unmanned aerial vehicles corresponding to the computing nodes; the main updating node is used for updating the network parameters according to the gradient pushed by all the sub-computing nodes and issuing the network parameters to all the sub-nodes. According to the technical scheme, the calculation efficiency is improvedand the charging problem of the unmanned aerial vehicle is solved.
Owner:BEIJING INSTITUTE OF TECHNOLOGYGY

Interactive volume cutting method based on three-dimensional plane control

The invention provides an interactive volume cutting method based on three-dimensional plane controls, aiming to solve the technical problem that how to carry out interactive volume cutting in a volume rendering scene based on software and image hardware. The invention comprises the following steps: (1) integrative drawing environment of volume data and three-dimensional plane controls is built; (2) the volume data and the three-dimensional plane controls are drawn in a mixed mode; (3) the interactive cutting of the volume data is finished by the control of a mouse. The invention integrates volume data, three-dimensional plane controls, volume drawing, mixing drawing and mouse control into the same environment so as to realize interactive and immersing volume cutting. Meanwhile, the volume drawing can be based on software to realize high-quality drawing of large-scale volume data; in addition, the invention also can adopt volume drawing based on image hardware, and can realize quick drawing of small and medium-sized volume data, so that the invention has important application value in the field of volume data search and visualization.
Owner:INST OF AUTOMATION CHINESE ACAD OF SCI

Methods and apparatus for integration of visual and natural language query interfaces for context-sensitive data exploration

Methods and apparatus are provided for integrating a visual query interface and a natural language interface. The disclosed interface embeds a first of the visual query interface and the natural language interface into a second of the visual query interface and the natural language interface. The disclosed interface can also receives one or more natural language expressions in the natural language interface and one or more visual query expressions in the visual query interface in a same search turn. The disclosed interface can also receive a first query comprised of a first of a natural language query and a visual query; process the first query; and creates a substantially equivalent query to the first query in a second of the natural language query and the visual query The disclosed interface can process a natural language query to determine if a portion of the natural language query is not understood; and convert at least a portion of the natural language query to a visual query.
Owner:IBM CORP

Dimensional data explorer

A dimensional data explorer for an enterprise system is disclosed. Dimensional data exploration includes providing a list of dimensions by which aggregated data in a report can be disaggregated and reaggregated. Aggregated data comprises a set of measures that have been aggregated for each object of a set of objects. Dimensional data exploration further includes providing the aggregated data disaggregated and reaggregated using a dimension from the list of dimensions.
Owner:WORKDAY INC

Computerized data mining system, method and program product

Under the present invention, a data exploration system, a customized model system and an existing model system are provided. The data exploration system analyzes user data to identify statistical information such as data distribution, data relationships, data outliners and invalid or missing data values. The customized model center iteratively generates customized data mining models in parallel based on permutations of the user data, user-provided business parameters and / or a set of model generation algorithms. The existing model system provides users with a library of existing data mining models, assembled based on the business parameters, from which they can choose one or more. In any event, any customized or existing data mining models selected can be run against the user data in parallel.
Owner:SAP AG

Big data asset value delivery management method and system

ActiveCN110807015ASupport creationSupport login user managementRelational databasesSpecial data processing applicationsData acquisitionData preparation
The invention discloses a big data asset value delivery management method and a big data asset value delivery management system. The delivery management method comprises the following steps: step 1, adata acquisition and capitalization step; step 2, a theme story line establishment; step 3, a data preparation / data exploration step; step 4, a service rule and algorithm loading step; step 5, a visual scene delivery management step; and step 6, a forming step of a scene template and a knowledge management system. According to the big data asset value delivery management method and system provided by the invention, a user can directly view and operate big data from data capitalization, so that delivery of a data application scene is customized and developed from a traditional one-way supplierto a scene where the user can autonomously realize data value change; an asset owner is enabled to truly have the ability to quote and govern data assets, and a specification and a standard of a datacenter for data application delivery management are established.
Owner:NSOC INFORMATION TECH CO LTD

Data exploration system and method, device and storage medium

The embodiment of the invention provides a data exploration system and method, an electronic device and a storage medium and relates to the technical field of data safety. The system comprises an exploration module, a supporting engine module and an exploration management module; the exploration module is used for setting configuration information and sending the configuration information to the exploration management module, and the configuration information comprises configuration parameters which are determined according to service requirements; the exploration management module is used for packaging exploration strategy information according to the configuration information, and the exploration strategy information is sent to the supporting engine module; the supporting engine module is used for conducting sensitive data exploration on target data according to the exploration strategy information, and the target data is data which is determined according to the configuration parameters. According to the embodiment, the data exploration system is deployed in the data network in a format of the independent and special data exploration system, the support can be provided for treatment measures of various sensitive data in different data safety management and control systems, and then collaborative defense can be achieved.
Owner:北京明朝万达科技股份有限公司

Automated unit finding for numeric information retrieval

The present invention is related to the task of retrieving numeric information in response to a textual keyword-based query by automatically associating a unit to the type of data being retrieved. An information retrieval system is presented which suggests a unit for data exploration by leveraging the local environment of numeric data across the corpus. This local environment is parsed, including through natural language processing and proximity-based techniques, to determine units relevant to particular keyword phrases. The system also relies on knowledge of semantically and scientifically related units to optimize their binning for suggested unit scoring.
Owner:QUANTIFIND

Method for eliminating imaging error of undulating the earth's surface

The invention is a method for eliminating image error of relief land surface by simple harmonic wave fitting technique, relating to geophysical seismic data exploration, collecting seismic data of an observing system; extracting the seismic data to be processed by wave field extrapolation into a common shot gather or a common detector gather for arranging to obtain a corresponding known wave field; dissecting the region between relief land surface and extrapolation destination curve by extrapolation grid; converting the original wave field data from time domain to frequency domain; using the simple harmonic wave fitting method to calculate extrapolation operator of the dissecting grid; making wave field extrapolation calculation on the seismic data by the extrapolation operator; converting the wave field data extrapolated to the destination curve from frequency domain to time domain and imaging. The invention has small error, low interference and high accuracy.
Owner:BC P INC CHINA NAT PETROLEUM CORP +1

Method for collecting page data in dynamic web page

The invention discloses a method for collecting page data in a dynamic web page, which is specifically realized by that an environment is analyzed by a script and embedded into a distributed network spider, and the data in the dynamic web page is collected through data exploration, indexing and searching of the network spider. In comparison with the prior art, the method for collecting the page data in the dynamic web page collects different kinds of dynamic data in complete forms, and stores the data in a database, so that we can know Internet trends in real time, inaccurate and untimely data collection is avoided, the defect in traditional collection methods that data in the web page is collected for only one time and the collection is not realized according to demands is solved, and accuracy and efficiency of the collection are greatly increased. The method for collecting the page data in the dynamic web page has strong practicability, and is wide in application and easy in popularization.
Owner:INSPUR QILU SOFTWARE IND

WLAN indoor positioning method of TebNet neural network model based on deep learning

The invention discloses a WLAN indoor positioning method of a TebNet neural network model based on deep learning, and relates to the field of indoor positioning. The method comprises the following steps: carrying out EDA data exploration in an offline stage, exploring data rules and distribution by utilizing a matplotlib data analysis tool, and carrying out feature selection and synthesis by feature engineering to generate statistical features; and data training being carried out by using a cross validation method and the like to finally obtain a positioning prediction model. According to the invention, reinforcement learning can be carried out along with data accumulation; and the method has high environment adaptability and positioning precision.
Owner:BEIJING UNIV OF TECH

Block chain data sharing encryption and decryption method and system

The invention relates to the technical field of block chains, and discloses a block chain data sharing encryption and decryption method, which comprises the steps of obtaining to-be-encrypted data, exploring new data in the to-be-encrypted data by utilizing a new data exploration algorithm, and converting the to-be-encrypted data into a to-be-encrypted data vector; constructing a keyword index structure of to-be-encrypted data, and storing the to-be-encrypted data vector in the keyword index structure; encrypting the keyword index structure by using a block chain based on an improved Byzantinefault-tolerant algorithm to obtain encrypted data; sharing the encrypted data and decrypting the encrypted data by using a group signature algorithm; and packaging the transaction proposal of which data decryption is completed by using a transaction sorting-based block packaging algorithm, and submitting a packaging result to a block chain account book. The invention further provides a block chain data sharing encryption and decryption system. According to the invention, encryption and decryption of the blockchain data are realized.
Owner:汪秀英

A bar code area positioning method based on deep learning

The invention provides a bar code area positioning method based on deep learning, which utilizes a deep learning technology to automatically conclude and extract the product positioning characteristics, can greatly improve the accuracy of characteristic extraction of product area positioning, and improves the recognition rate. And under the condition that the product is updated, an algorithm doesnot need to be developed additionally, so that the algorithm development period is greatly shortened, and the capability of being compatible with various products of the detection equipment is improved. The method comprises a training part and a prediction part, wherein the training part is used for collecting a large amount of training data and the label information in advance to form the training sets, at the training phase, firstly the data exploration and processing are performed, and the training module is used for establishing a convolutional neural network through the training set, thenpositioning the network to extract characteristics, then carrying out weight learning, judging whether to converge or not, generating a model file if the characteristics converge, returning to the positioning network to extract the characteristics if the characteristics do not converge, and carrying out model verification after the model file is generated.
Owner:TZTEK TECH

Commodity sales volume prediction method

A commodity sales volume prediction method comprises the following steps: a data acquisition step: acquiring historical sales volume data of commodities; a data processing step of processing the historical sales volume data: performing data exploration processing, replacing abnormal values and missing values, exploring the correlation between each element of the historical sales volume data and the commodity sales volume, and taking the high-correlation element as a feature; carrying out feature engineering processing, and constructing derivative features from the features; data aggregation processing: aggregating the historical sales volume data into training samples according to time granularity; a model construction step: constructing a fusion model to carry out short-period prediction, and adopting a time sequence model to carry out medium-and-long-period prediction; and a sales volume prediction step of inputting the training samples, the features and the derivative features into a fusion model or a time sequence model to obtain a prediction result of the commodity sales volume. According to the invention, the method can meet the prediction requirements of the commodity sales volume of retail places such as stores, warehouses, manufacturers and the like at the same time, can achieve the targeted prediction of different periods, and improves the prediction accuracy.
Owner:HITACHI LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products