Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

173 results about "Data discovery" patented technology

Data discovery is a Business intelligence architecture aimed at interactive reports and explorable data from multiple sources. According to the American information technology research and advisory firm Gartner "Data discovery has become a mainstream architecture in 2012".

Large scale data discovery with near real time data cataloguing and detailed lineage

A data platform for providing large scale data discovery with near real time data cataloguing and detailed lineage. Data is received from one or more sources, and the received data is written to a data storage systems. The received data is processed at the data storage systems using sensors at the data storage systems. Metadata and data definitions associated with the data are sent to a data service in near real-time. A data catalog is generated at the data service based on the metadata and data definitions associated with the data. Data lineage for the data is created at the data service. The data catalog and data lineage are presented at a data discovery interface.
Owner:RAKUTEN SYMPHONY INC

Processing data payloads from external data storage systems in an observability pipeline system

Data payloads from an external data storage system are processed in an observability pipeline system. In some aspects, the observability pipeline system defines a leader role and worker roles. The leader role generates a data discovery task based on configuration information for a data collection task. A worker role executes the data discovery task, which includes communicating with an external data storage system to identify a data payload that is stored on the external data storage system and contains event data that meet event filter criteria. The leader role generates data collection tasks based on the data payload. Worker roles execute the data collection tasks. Executing a data collection task includes: communicating with the external data storage system to obtain a subset of filtered event data from the data payload; and streaming the subset of filtered event data to an observability pipeline process.
Owner:CRIBL INC

Query construction platform for database query generator

A multimodal content management system having a block-based data structure can include a query engine configured to perform automatic data discovery for natural language queries. The system can generate and render, at a computing device, a page comprising a graphical user interface (GUI) with a displayable item from a first block of a block-based data structure. The system can generate and bind, to the page, a schema definition comprising a first reference to the first block and a second reference to a set of blocks, wherein the first block is relationally linked to the set of blocks via the second reference. The system can use at least a portion of a natural language prompt, received at the GUI, to generate an input feature for a large language model, the input feature having a schema-question pair that includes at least a portion of the schema definition. The large language model can generate a query configured to operate on the block-based data structure.
Owner:NOTION LABS INC

Business and financial data governance optimization method for dynamic management of main data

The invention relates to the technical field of data management, and discloses a business and financial data governance optimization method for main data dynamic management, which comprises the following steps: step 1, carrying out multi-source data acquisition, including business system data acquisition, financial system data acquisition and other channel data acquisition, step 2, pre-processing the acquired data, numbering and storing, and step 3, carrying out data management on the acquired data. 3, calculating a data quality index, a data change condition, a data value and a data comprehensive coefficient based on the stored data set, and 4, performing feedback according to the data comprehensive coefficient, so that various data sources inside and outside an enterprise can be comprehensively covered, a data island phenomenon is reduced, and meanwhile, the quality and credibility of data are improved; the data comprehensive coefficient is comprehensively evaluated by combining the data quality index, the data change condition and the data value, the data level is comprehensively reflected, a comprehensive perspective is provided for enterprises to see the data, and the enterprises can better understand and manage the data and find potential problems and opportunities.
Owner:珠海华发金融科技研究院有限公司

Data scan sampling control for data discovery and posture management

The disclosed technology receives a control input identifying a sampling criterion for classifying a data store storing a set of data objects in a computing environment as corresponding to a target data type and deploys one or more scanners configured to select a representative subset of data objects, from the set of data objects, based on the sampling criterion. A scanner result generated by the one or more scanners is received that represents detected instances, in the representative subset of data objects, of one or more pre-defined data patterns of the target data type. A classification result is generated based on a comparison of the number of detected instances of the one or more pre-defined data patterns to a threshold. The classification result represents a classification of the data store as having correspondence to the target data type. A computing action is performed based on the classification result.
Owner:PROOFPOINT INC

Data discovery for data privacy management

Disclosed are some techniques for implementing a data discovery agent in a network associated with a customer organization of a data privacy management system. Some implementations relate to one or more connections with one or more data sources storing private data of the customer organization. The one or more data sources can be scanned to obtain scanned data from the private data. The scanned data can be processed, including anonymizing the scanned data, to obtain preprocessed data for use by one or more classification operations. The preprocessed data can be shared with the data privacy management system. One or more classification promotion operations can be performed on classified data elements.
Owner:DATAGRAIL INC

Remote cooperation data analysis method and device based on large-model multi-agent

The invention discloses a remote cooperation data analysis method and device based on a large model and multiple agents. The device comprises a large model, a coordination agent, a data discovery agent, an analysis agent, a report generation agent and a report review agent. Through the data discovery agent deployed at each remote node, the data resources in the local database are automatically scanned and reported, full automation is realized, and the discovery efficiency and real-time performance of the remote data are greatly improved. And the data discovery agent can screen and integrate useful data in advance, so that the burden of the central processing node is reduced. According to the method, the processing flow of the distributed data is optimized, the data integration speed and quality are improved through remote automatic data discovery and preliminary evaluation, and a complex and dynamic investment and research data environment is effectively supported.
Owner:BEIJING WANGZHI TIANYUAN BIG DATA TECH CO LTD +1

Sensitive data discovery method based on complex semantic analysis

The invention provides a sensitive data discovery method based on complex semantic analysis, which innovatively introduces high-dimensional sparse Fourier transform (HSFT), maps semantic characteristics to a frequency domain space, captures semantic change frequency characteristics (such as high-frequency mutation characteristics of sensitive information) which are difficult to recognize by traditional deep learning, and improves the recognition accuracy of the sensitive data. Sensitive information and non-sensitive information in similar contexts are effectively distinguished, and the problems of high misjudgment rate, lack of dynamic adaptability and unreliable risk assessment in complex contexts in the prior art are solved.
Owner:GUIZHOU UNIVERSITY OF FINANCE AND ECONOMICS +1

Campus safety risk monitoring method and system

The invention discloses a campus safety risk monitoring method and system, relates to the technical field of campus safety, and solves the problem that existing campus safety monitoring cannot be combined with other data to find potential risks. Timely early warning cannot be carried out, and a normative processing flow is prompted; according to the scheme, the method comprises the steps that monitoring data and psychological evaluation data are acquired; determining important attention personnel according to the psychological evaluation data; the risk level of the personnel behavior is identified according to the monitoring data, an early warning signal is generated based on a graded early warning rule, and the graded early warning rule comprises: early warning signals are generated for medium-risk behaviors or all high-risk behaviors of the key concerned personnel; the early warning signal is pushed to the corresponding responsibility management personnel and the nearby patrol personnel; according to the accident type fed back by the nearby patrol personnel, an associated guidance plan is pushed, and the associated guidance plan is used for guiding standard handling of the accident; generating a keyword according to the accident type, and carrying out public opinion monitoring on a website; the problems are solved.
Owner:CHENGDU XUNDAO TECH CO LTD

Intelligent examination and approval auxiliary system and method driven by relation chain analysis

The invention provides an intelligent examination and approval auxiliary system and method driven by relation chain analysis. The system comprises: a data input and processing module supporting a plurality of data input modes and preprocessing input data; the relation chain analysis module performs deep analysis on data in the approval process through a relation chain analysis algorithm to generate a relation chain graph; the intelligent decision support module performs intelligent analysis on data in the approval process through an artificial intelligence algorithm and provides decision auxiliary suggestions; the risk identification and management module monitors data in the approval process in real time through an intelligent algorithm and relation chain analysis, and discovers business exceptions and potential risks; and the data visualization module provides a visual data analysis graph and supports an approver to comprehensively understand business conditions and decision-making backgrounds. The invention provides an intelligent examination and approval auxiliary system and method driven by relation chain analysis, and aims to improve the efficiency and accuracy of an examination and approval process and enhance the capability of identifying and managing enterprise risks.
Owner:SHENZHEN ZHONGXING XINYUN SERVICE CO LTD

Secure distributed document discovery via vector similarity

Secure distributed document discovery via vector similarity is performed by a data discovery service. The service receives a request to perform a search using input data. The service sends the input data and an embedding protocol to different data repositories that comprise vector databases. The service receives a results from the different data repositories; each result identifies documents and corresponding document similarity scores. The service generates an overall ranking of the documents according to the document similarity scores. The service returns a query result that identifies the at least a portion of the documents and indicates the ranking of the identified documents.
Owner:AMAZON TECH INC

Business operation and maintenance big data value mining method based on multiple fields

The invention discloses a business operation and maintenance big data value mining method based on multiple fields, and belongs to the technical field of data analysis, and the method specifically comprises the steps: obtaining enterprise multi-source heterogeneous data streams, carrying out real-time classification and recognition, and automatically dividing business data types and security levels; implementing dynamic security protection processing according to a classification identification result, establishing a hierarchical access control system, and constructing a cross-service association analysis model in a security boundary; the method comprises the following steps: identifying a data combination with a synergistic effect by analyzing service data, and automatically generating a cross-department data sharing request when the synergistic effect reaches a preset standard; a controlled temporary analysis environment is established, and potential operation optimization points and business opportunities are found through combinatorial analysis of data of different business systems; according to the data association features and the use mode identified in the analysis result, an optimization security protection strategy and analysis model parameters are fed back; according to the invention, the depth, breadth and security of enterprise big data value mining are improved.
Owner:王会来

Systems and methods for in-SITU sensing and data analysis for industrial processes

Systems and methods are provided for in-situ sensing and data analysis for industrial processes (such as additive manufacturing processes). An eddy current sensor array may be repeatedly scanned across the part during its fabrication to collect in-situ data to assess the quality of the part. defects discovered by processing the scan data may be eliminated or mitigated by subsequent fabrication steps. A processing technique is described that can identify defects by filtering across the multiple scans. For example, during a laser powder bed fusion (LPBF) process, the sensor is scanned after each build layer; the resultant in-situ data is processed in the build or "z" direction using the disclosed filtering methods. The results are used to assess the quality of the part or adjust the fabrication process. Also disclosed are system configurations illustrating how an industrial process may be instrumented for such data collection.
Owner:JENTEK SENSORS INC

Method and system for software network development

The invention discloses a method and a system for software network development. The system comprises a data acquisition and analysis module, a design cooperation module, a coding development module, an automatic test module, a continuous deployment module and a project management and monitoring module. According to the method and the system for software network development, the whole process of software development is integrated, so that the development efficiency is remarkably improved, and the communication cost and the error rate are reduced; team cooperation and project management capabilities are enhanced, and on-time and quality-based delivery of projects is ensured; through data acquisition and analysis functions, the data processing efficiency is improved, statistical analysis, data mining and real-time analysis functions are performed through the acquired data to help to deeply understand the data and find potential business opportunities and problems, and an efficient data storage scheme and strict data security measures ensure the security and availability of the data. The data visualization function provides a visual analysis result, and supports a user to make a better decision.
Owner:JIANGSU CHUANGDIAN NETWORK TECHNOLOGY CO LTD

Electronic price tag management system and data processing method

The invention discloses an electronic price tag management system and a data processing method, and the system comprises an electronic price tag terminal, a data collection and transmission module, an edge calculation unit, a cloud server, and an intelligent analysis platform. The data processing method of the electronic price tag management system comprises the following steps: S1, data acquisition and preprocessing; S2, behavior feature extraction and analysis; S3, data fusion and deep analysis; and S4, decision support and application. According to the invention, through multi-modal data acquisition, customer demands are accurately captured. The action capture and voice recognition module recognizes actions and voices of customers, and shopping convenience and satisfaction are improved; by analyzing customer behaviors and feedback data, new market opportunities are found, innovative products or services are launched, more customers are attracted, and sales and profit are increased.
Owner:SHANGHAI CARDANG NETWORK TECH CO LTD

Data discovery method, system and device based on weight distribution and entity labeling and medium

The invention provides a data discovery method, system and device based on weight distribution and entity annotation and a medium, and belongs to the technical field of data search processing. Dynamically adjusting the weight of each data item by adopting a machine learning algorithm according to the actual characteristics of the data; a self-adaptive weight distribution model is configured, and actual features in the data are labeled in a multi-layer entity labeling mode; constructing a reverse index retrieval model, extracting features of each data item according to the self-adaptive weight distribution model, distributing corresponding weights, performing score calculation, performing sorting according to scores, and feeding back to users; a closed loop is formed by collecting and analyzing user search data, dynamically adjusting adaptive weight distribution, a search and sorting algorithm and an index performance optimization strategy, iteratively executing evaluation and optimization and combining a user feedback mechanism. The method can accurately reflect the importance of different features to search results. And diversified search requirements of the user can be better met.
Owner:BEIJING BIG DATA CENT +1

Industrial sensitive data security management platform and method

The invention discloses an industrial sensitive data security management platform and method, and relates to the field of industrial data security management.The industrial sensitive data security management platform collects multi-dimensional industrial data source information through a data discovery and classification grading module, and analyzes data sensitive information by fusing AI deep learning and a traditional matching algorithm; obtaining a data sensitivity judgment result and business value evaluation, and constructing a multi-dimensional classification and grading matrix and a visual data asset map; an access control strategy is generated through a differential protection module; global protection measures are deployed based on an access control strategy, and authority control, data encryption, storage and transmission and differential desensitization are implemented; the protection effect is verified through the continuous monitoring and auditing module, abnormal behaviors are monitored and traced, and the response and recovery module carries out response and service recovery on industrial sensitive data security events; the problems that industrial sensitive data is difficult to manage and control in the whole life cycle and the protection pertinence is insufficient are effectively solved, and the efficiency and stability of data security protection are improved.
Owner:TAIRUI (BEIJING) TECH SERVICE CO LTD

Threat data discovery method and device, storage medium and electronic equipment

PendingCN119109607Aimprove accuracyEasy to handle defensivelySecuring communicationData miningData discovery
The invention discloses a threat data discovery method and device, a storage medium and electronic equipment, and the method comprises the steps: carrying out the filtering preprocessing of at least one piece of collected sample data based on a known threat type, and obtaining unknown sample data, performing operation detection processing on the unknown sample data by adopting a virtual environment corresponding to the unknown sample data to obtain an operation detection report of the unknown sample data, and obtaining threat sample data from the unknown sample data by adopting a threat data screening strategy and the operation detection report, and performing alarm processing on the threat sample data. By adopting the method and the device, the known threat data is filtered, and then the unknown threat sample data is screened out from the collected sample data by adopting an operation detection mode, so that the accuracy of obtaining the threat sample data is improved, and targeted defense processing on the threat sample data is facilitated.
Owner:BEIJING HONGTENG INTELLIGENT TECH CO LTD

Personal data discovery

Artificial-intelligence computer-implemented processes and machines predict whether personal data may be present in structured software based on metadata field(s) contained therein. Natural language processing preprocesses input strings corresponding to the metadata field(s) into normalized input sequence(s). Individual characters in the sequence(s) are embedded into fixed-dimension vectors of real numbers. Bidirectional LSTM(s) or other machine-learning algorithm(s) are utilized to generate forward and backward contextualization(s). Neural network output(s) are provided based on element-wise averaging or feed forwarding based on the contextualization(s) in order to predict whether one or more value fields corresponding to the metadata field(s) may contain personal data.
Owner:BANK OF AMERICA CORP

Driving reference information providing method, electronic equipment and computer readable medium

The invention discloses a driving reference information providing method, electronic equipment and a computer readable medium, and relates to the technical field of big data processing and mining. The method comprises the following steps: acquiring the accident occurrence frequency of each road section in a first time period closest to the current time; if the target road section with the accident occurrence frequency larger than or equal to the first frequency threshold value is detected, historical data of one or more adjacent road sections in a second time period closest to the current time are obtained, and driving reference information is sent to vehicles about to drive into the adjacent road sections according to the historical data of the adjacent road sections. According to the embodiment, the road section with large potential danger can be found according to the historical data of the predetermined driving operation and / or the predetermined vehicle state, and the practical driving reference information is effectively provided for the user in time.
Owner:TOYOTA JIDOSHA KK

Systems and methods for generalized structured data discovery utilizing contextual metadata disambiguation via machine learning techniques

Systems and methods for generalized structured data discovery utilizing contextual metadata disambiguation via machine learning are disclosed. A method may include receiving physical application metadata for an attribute, a database object, or a database; receiving reference data including tokens and their associated abbreviations and acronyms; parsing the physical application metadata into application tokens including known application tokens and unknown application tokens; identifying unknown application tokens by comparing the parsed application tokens to a corpus; performing probabilistic parsing on the unknown application tokens using the reference data resulting in token phrases; identifying monosemous tokens in the token phrases using a look-up dictionary; replacing the monosemous tokens with their expansions from the look-up dictionary; and outputting a mapping of the physical application metadata to enhanced physical application metadata that includes an expression for the physical application metadata comprising the expansions for monosemous tokens in a supported language.
Owner:JPMORGAN CHASE BANK NA

Autonomous Multi-Dimension Segmentation User Interface Workflow

A system and method of autonomous multi-dimensional segmentation for a supply chain network. Embodiments include a supply chain network of one or more supply chain entities, a segmentation planner having a computer and memory, the segmentation planner configured to access input data relating to one or more supply chain entities, discover one or more features related to the input data, pre-process the input data and features, perform multi-dimension segmentation on the input data, generate one or more segment output visualizations, assign policy parameters to the multi-dimension segmentation performed on the input data.
Owner:BLUE YONDER GROUP INC

Auto-generated data gathering in managed networks

A method for diagnosing and remediating system anomalies in a managed network using artificial intelligence (AI). The method includes receiving data from managed devices, discovering anomalies indicative of events in the network, and using an AI engine to analyze the anomalies and related data to determine additional relevant information. A data gathering mechanism is generated based on the AI engine to collect this additional information, which is then distributed to managed devices. The collected data is used to determine alterations to the network to resolve the anomalies, and these alterations are implemented in the managed network.
Owner:IVANTI INC

Large scale data discovery with near real time data cataloguing and detailed lineage

A data platform for providing large scale data discovery with near real time data cataloguing and detailed lineage. Data is received from one or more sources, and the received data is written to a data storage systems. The received data is processed at the data storage systems using sensors at the data storage systems. Metadata and data definitions associated with the data are sent to a data service in near real-time. A data catalog is generated at the data service based on the metadata and data definitions associated with the data. Data lineage for the data is created at the data service. The data catalog and data lineage are presented at a data discovery interface.
Owner:RAKUTEN SYMPHONY INC

Ambient IoT Device Data Discovery

Method and system for communicating with user equipment, UE, the method comprising the steps of a reader device receiving a request to interrogate one or more UE. In response to the request, the reader device transmitting an initial message to the one or more UE. The one or more UE responding to the initial message by transmitting a first message. The reader device responding to the first message by sending a second message to the one or more UE unless the request received by the reader device to interrogate the one or more UE comprises data indicating that the second message is not required. When a second message is sent by the reader device to the one or more UE, the one or more UE responding to the second message with a third message unless data is received from the reader device by the one or more UE indicating that a response to a second message is not required.
Owner:VODAFONE GROUP SERVICES LTD

Sensitive data discovery for databases

Techniques for database management are described. A database management system may transmit a request for a data management system of a database to provide a set of metadata attributes for structured data within the database, and may receive a set of metadata attributes for the structured data within the database. The data management system may perform a pattern matching procedure to evaluate the set of metadata attributes for the structured data within the database against one or more patterns associated with a data type to determine one or more locations within the database that include structured data of the data type. Based on the pattern matching procedure, the data management system may output an indication that the one or more locations within the database include structured data of the data type.
Owner:RUBRIK INC

Equipment network distribution method and device, electronic equipment and storage medium

The invention relates to an equipment network distribution method and device, electronic equipment and a storage medium, and the method comprises the steps: determining a target house type template which comprises the layout information of virtual room nodes and equipment configuration data corresponding to the virtual room nodes; equipment in a to-be-distributed network state is found, and physical position information of the equipment is acquired; determining a virtual room node to which the equipment belongs in the target house type template according to the physical position information of the equipment and the equipment configuration data; and performing network distribution processing on the equipment to enable the equipment to access a network control domain corresponding to the virtual room node to which the equipment belongs. Therefore, batch processing and an automatic network distribution process can be realized, and in a large-scale deployment scene of the smart home system, the equipment network distribution efficiency can be greatly improved, manual intervention and operation errors can be reduced, and the labor cost can be reduced.
Owner:GREE ELECTRIC APPLIANCE INC OF ZHUHAI +1

Auto-deploying data security controls via autonomous pentesting after data discovery

An autonomous pentesting agent may execute autonomous pentesting operations during an autonomous pentest on a network. The agent may perform a threat level assessment procedure on data identified during the autonomous pentest. Performing the threat level assessment procedure may include: determining a sensitivity level of the data based on metadata associated with the data and / or a content of the data; and assigning a threat level to the data based on the sensitivity level of the data and on an exploitation complexity associated with the data, where the exploitation complexity corresponds to a level of difficulty associated with exploitation of the data. The agent may deploy, as part of the autonomous pentest and in response to the threat level assessment procedure, data security mechanisms that inhibit unauthorized access to the data, where the data security mechanisms are selected based on the threat level assigned to the data.
Owner:HORIZON 3 AI INC

Sensitive data discovery method based on complex semantic analysis

The application provides a sensitive data discovery method based on complex semantic analysis, which innovatively introduces high-dimensional sparse Fourier transform (HSFT), maps semantic features to a frequency domain space, captures semantic change frequency characteristics (such as high-frequency mutation characteristics of sensitive information) that are difficult to identify by traditional deep learning, effectively distinguishes sensitive and non-sensitive information in similar contexts, and solves the problems of high misjudgment rate, lack of dynamic adaptability and unreliable risk assessment in the prior art in complex contexts.
Owner:GUIZHOU UNIVERSITY OF FINANCE AND ECONOMICS +1

Environmental IoT device data discovery

A method and system for communicating with a user equipment, UE, the method comprising the step of a reader device receiving a request to interrogate one or more UEs. In response to the request, the reader device sends an initial message to the one or more UEs. The one or more UEs respond to the initial message by sending the first message. The reader device responds to the first message by sending a second message to the one or more UEs unless the request received by the reader device to interrogate the one or more UEs includes data indicating that the second message is not required. When a second message is sent by the reader device to the one or more UEs, the one or more UEs respond to the second message with a third message unless the one or more UEs receive data from the reader device indicating that there is no need to respond to the second message.
Owner:VODAFONE GROUP SERVICES LTD