133results about How to "Improve query efficiency" patented technology

The invention relates to the technical field of information retrieval, in particular to a large-scale semantic retrieval optimization method based on deep learning, which comprises the following steps: acquiring to-be-retrieved text data, and converting the to-be-retrieved text data into semantic vector representation through a deep learning model; carrying out topological structure analysis on the semantic vector representation to obtain topological characteristic information of a semantic space; on the basis of the topological characteristic information, a topological perception hierarchical navigable small-world graph index with a multi-layer structure is constructed, and each layer comprises a node set and a connection relation thereof; dynamically optimizing and adjusting the topology-aware hierarchical navigable small-world graph index according to an actual query mode and system performance feedback; and receiving a query request, converting the query request into a query vector, executing multi-layer navigation search in the topology-aware hierarchical navigable small-world graph index, and returning a retrieval result related to the semantics of the query vector.

This disclosure relates to a data query method, apparatus, electronic device, and storage medium, comprising: acquiring a query request, the query request including a first query condition and a query target, wherein the first query condition includes a first vehicle speed and a first torque; determining a second query request based on the query target, the second query request including a second query condition, wherein the second query condition includes a second vehicle speed and a second torque, the second query request being a query request from a previous moment corresponding to the query request; and determining a query result based on the second query condition and the first query condition in the query request, thereby improving the efficiency of data query.

This application discloses a method and system for power grid topology analysis, including the following steps: establishing and storing the relationships between power collection points and gateway tables, gateway tables and devices, and devices in a first database; acquiring real-time power collection information and storing it in a second database according to time; a topology analysis module retrieving the relationships in the first database to construct a topology graph; selecting a device, the first database retrieving the associated devices of that device, the device itself, and the gateway tables corresponding to the associated devices, and outputting this information to the topology analysis module, while outputting the power collection point set information to the second database; the second database matching a set of real-time power collection information containing the power collection point set, and outputting this information to the topology analysis module; and the topology analysis module receiving the real-time power collection information set, analyzing and processing it, and displaying the results. The beneficial effects of this application are: significantly improving the efficiency of storing, querying, and analyzing massive amounts of power grid power data.

The invention discloses a cross-regional data intercommunication method, device, equipment and medium for the electric power Internet of Things, and the method comprises the steps: carrying out the layer-by-layer splitting of a target database table according to a preset multi-level business logic, obtaining a plurality of sub-tables and a sub-table splitting list, and carrying out the layer-by-layer splitting of a plurality of sub-tables according to the sub-table splitting list, sequentially generating a sub-table subordinate hierarchy list and a sub-table dependency list; monitoring the arrival state of each sub-table transmitted to the target safety area so as to calculate the proportion of the sub-tables arriving in the waiting period; if the sub-table proportion is greater than a preset threshold value, judging whether each arrived sub-table meets an independent processing condition or not according to a sub-table dependency list; and according to the subordinate hierarchical list of the sub-tables, merging the sub-tables capable of being processed independently to obtain a plurality of new database tables, and executing business processing of the power internet of things according to the new database tables. According to the invention, the problem of slow service processing response speed for waiting for complete data due to asynchronous arrival of the data in the data intercommunication process can be solved.

The application relates to the field of workpiece defect detection, and discloses a workpiece end face defect detection method and system based on deep learning, which comprises the following steps: acquiring an end face image of a machined workpiece, performing image enhancement and region marking on the end face image to obtain an end face enhanced image and an end face marked region, querying abnormal points corresponding to the end face marked region, calculating an image offset of the workpiece end face image in a preset direction, querying an image difference frame corresponding to the workpiece end face image according to the image offset, extracting pixel values of the image difference frame, calculating an image difference value of the workpiece end face image, performing classification detection on the workpiece end face image by using a preset end face detection model to obtain a classification image, identifying a defect region in the classification image, extracting region features, and performing defect detection on the workpiece end face image to obtain a defect detection result of the machined workpiece. The application can improve the detection efficiency of workpiece end face defects.

The application provides a kind of method, device, equipment and medium for realizing map visual range scattering point, comprising reading the point position data stored in database;With the first preset intercepting bit number, the longitude and latitude of point position data are grouped, and the read point position data is divided into longitude range group data and latitude range group data;Longitude range group data, latitude range group data and point position data are stored in memory according to the set data format;Get the map visual range transmitted from the front end, filter longitude range group data and latitude range group data according to the map visual range, obtain the point position longitude and latitude set meeting the requirements;Point position objects in point position longitude and latitude set are grouped and aggregated using clustering algorithm, and aggregation information is returned to the front end display.The advantages of the present application are: it can effectively reduce the retrieval operation time, improve the query efficiency, reduce the time of front-end map display point, and at the same time, simple map data structure can save storage space.

The application discloses an intelligent agent query method and device based on a dual-mode semantic and a storage medium, relates to the technical field of data query based on artificial intelligence, and comprises the following steps: converting a query question into a question vector; determining a target database from an RDF database and a graph database according to the question vector and a preset question vector library, wherein the RDF database and the graph database are maintained according to the same basic data; determining a target query statement matched with the type of the target database according to the query question, and querying in the target database according to the target query statement to obtain a query result. The application can realize the intercommunication of the RDF database and the graph database, and improve the data query efficiency. The target query statement is generated based on the target database, the user operation can be further simplified, the query statement is automatically generated, the user only needs to describe the query or analysis requirement through the natural language, the user does not need to have the syntax knowledge of the database query statement, and the easy-to-use property is improved.

This application provides a method, apparatus, server, storage medium, and product for querying business data, belonging to the field of Internet technology. The method first parses the query request to obtain multiple query statements. Based on these multiple query statements, multiple data structures are generated. Based on these data structures, multiple query execution tasks are generated. Through the first and second nodes of the multiple query execution tasks, multiple data sources are queried in parallel. The multiple business sub-data obtained from the multiple data sources are summarized to obtain the business data, which is then returned to the terminal. This method can query multiple data sources in parallel based on multiple query fields, thus shortening the query time and improving query efficiency.

The application provides a blockchain data query method and device, electronic equipment and a storage medium. The method comprises the following steps: determining a target block interval in the case that a new block is generated in a blockchain, wherein the target block interval comprises blocks that may cause a fork and rollback; determining initial data in each block in the target block interval; analyzing the initial data according to a preset condition to generate intermediate data; associating the initial data and the intermediate data corresponding to the same block in the target block interval to obtain target data; and importing the target data into an in-memory database to enable a decentralized application to query data in the in-memory database. The application improves the data query efficiency.

The invention is suitable for the technical field of computer application, and provides a vehicle part chart query method and device, electronic equipment and a storage medium, the method comprises the following steps: in response to a chart query instruction triggered by a user, determining first named entity information corresponding to the chart query instruction; performing vector coding processing on the first named entity information to generate a chart query vector corresponding to the first named entity information; according to the chart query vector and a preset chart vector library, determining a target component chart corresponding to the chart query instruction; and sending the target part chart to the user. Therefore, the named entity information in the user chart query instruction is extracted, the image query vector is generated according to the named entity information, and the component chart corresponding to the chart query instruction is queried through the image query vector, so that the component chart query efficiency and accuracy are improved, and the automobile maintenance efficiency and accuracy are improved.

The application relates to the field of data query, in particular to a data query method and system based on a data mapping table. The method comprises the following steps: receiving a data query request initiated by a user; the data query request comprises a target time period; according to the data mapping table, a first target data distribution condition corresponding to the target time period is queried, and a first unit time data amount is determined according to the first target data distribution condition; based on the first unit time data amount, a first task time length required for querying a first preset data amount of data is determined; the first preset data amount is a preset data amount returned first in this query; time slicing is carried out based on the first task time length, a plurality of slicing tasks are obtained and stored in a task queue, the slicing tasks in the task queue are executed, and data query is completed. Therefore, the number of slices is reduced, the number of invalid slices is reduced, the query efficiency is improved, and the user experience is improved.

This application discloses a credit report generation method, system, computer equipment, and storage medium. The method includes: generating a report pre-assembly request via a first server and uploading it to a credit reporting chain; generating a set of keys and a data preparation request based on the report pre-assembly request via a second server, and obtaining a first key, a second key, and the data preparation request from them, and sending them to a third server; enabling the third server to obtain target data, encrypting the target data sequentially using the first key and the second key, and uploading it to the credit reporting chain; enabling the first server to decrypt the encrypted data based on the second key, and generating a pre-assembled report based on the decrypted data and a preset report template; enabling the first server to decrypt the decrypted data based on the first key, and generating a credit report based on the decrypted data and the pre-assembled report. This application can balance the timeliness of credit inquiries with data security.

The embodiment of the application discloses a batch anonymous query method, system and device for multiple data sources, which comprises the following steps: a client synchronizes an original polynomial and a polynomial quotient ring of the original polynomial to each of k servers; an n-order polynomial is calculated according to n query key values to obtain a first polynomial; each of the k servers calculates k second polynomials and k interpolation polynomials according to respective key value databases; the client and each client perform operations to obtain a first calculation result and k second calculation results; the client decomposes the first calculation result according to a preset constraint relationship to obtain a first decomposition result; the k servers determine k third calculation results; the client determines a fourth calculation result according to the k third calculation results and the original polynomial, and obtains a query result by traversing the n query key values. The embodiment of the application can improve the data query efficiency.

The invention discloses an index-based content awareness influence maximization query response method and device. The method comprises the following steps: 1) establishing an index node selection mechanism based on minimum vertex coverage approximation; 2) constructing a space-efficient index table to store content perception reachability information; 3) designing a reachability table estimation method to calculate a reachability probability lower bound between node pairs; and 4) providing pruning accessibility table estimation and an inertia forward greedy algorithm to optimize query efficiency. Verification on Wiki, Twitter and other real network data sets shows that the propagation effect of the method is similar to that of an existing optimal influence maximization method, and the query response speed is increased by 1-2 orders of magnitude.

The application provides a kind of unit and multi-element time series data hybrid processing method, device and computer equipment, the method comprises: obtaining data to be stored;The timestamp column of multi-element time series data and the value column sequence of each component are serialized;The timestamp column after serialization is stored as time column block, and the value column of each component after serialization is stored as value column block;Update the metadata information of all data blocks of multi-element time series data;Generate the corresponding file time sequence metadata information of time column block, generate the file time sequence metadata information of each value column block;All metadata information is stored in the index area of multi-element storage file after serialization;Multi-element time series data is generated as the key of metadata tree of metadata tree of storage file.The application stores time series data in storage file by the way of generating data block and storing in data area and generating metadata tree and storing in index area, improves the storage and query efficiency of multi-element time series data.

This invention discloses a query system and method. The system includes a platform front-end layer, a data storage layer, and an indicator management layer. The indicator management layer includes an indicator parsing unit. The platform front-end layer is used to call a metadata interface service to obtain metadata, assemble the metadata based on query information input by the user terminal, generate query condition data corresponding to the query information, and send the query condition data to the indicator parsing unit. The indicator parsing unit is used to determine the target storage medium for the query result data corresponding to the query condition data based on a pre-established storage mapping relationship between the storage medium and platform data, generate a query instruction based on the target instruction requirements of the target storage medium and the query condition data, and send the query instruction to the data storage layer. The data storage layer is used to obtain the query result data from the target storage medium based on the received query instruction and feed the query result data back to the user terminal.

The application discloses a data distribution optimization method and a distributed database system, comprising: acquiring data distribution, a query plan and temporary data redistribution of each node of the distributed database system; calculating an optimal distribution key by using a preset optimization algorithm; and optimizing query performance based on the query plan and correcting distribution column selection of a related table; acquiring a query request, and optimizing associated queries by using the optimal distribution key and the corrected distribution column selection, so as to schedule related query tasks to appropriate data nodes; and completing data redistribution based on a scheduling result of the query task scheduling and the optimal distribution key, so as to migrate data with affinity to the same data node. By calculating the optimal distribution key and dynamically adjusting the distribution column selection, the application can optimize the query plan and operation, and improve query efficiency.

The embodiment of the invention provides a data query method and device, a storage medium and a program product. In the query processing method, aiming at a target sub-query statement in an original query statement, a plurality of storage nodes can be utilized to execute data reading operation in parallel according to a query condition in the target sub-query statement, and local calculation corresponding to a target aggregation operator in the target sub-query statement is executed on the read data, so that the target sub-query statement in the original query statement is obtained. And obtaining a local calculation result. Furthermore, the local calculation result of the read data instead of the read data is returned to the calculation node by the storage node, so that the data volume of data transmission between the storage node and the calculation node can be reduced, and the consumption of network bandwidth and the calculation time consumption caused by a large amount of data transmission are reduced; in addition, the storage node is used for sharing part of the calculation amount, and the query efficiency can be further improved.

The invention discloses a data query control method and related equipment, and relates to the field of databases, and the method comprises the following steps: obtaining to-be-queried page number information and data size information of each page of a user; based on the to-be-queried page number information and the data size information of each page, determining sorting sequence number information of the to-be-queried data; to-be-queried data is obtained from a cache unit and / or an original storage unit of a target database according to the sorting sequence number information, all data information of the target database is stored in the cache unit and the original storage unit, and the cache unit and the original storage unit do not store data repeatedly; the target database comprises a plurality of storage table units, each storage table unit comprises at least one cache unit and at least one original storage unit, and data stored in the cache units are generated based on data history query information.

The application discloses a kind of service data query method and device, it is related to big data technical field, the method comprises: executing full amount task, full amount task needs to insert intermediate summary table after the service data in service detail table is summarized;According to the execution time of incremental task, incremental task is executed, incremental task needs to insert intermediate summary table after the service data not summarized in service detail table is summarized;After receiving the service data query request initiated by user, parse service data query request, obtain first time interval and second time interval;From service detail table, the service data of first time interval is inquired;From intermediate summary table and / or service detail table, the summary data of second time interval is inquired;The service data found and the summary data found are aggregated, and aggregated data is fed back to user.The application can improve the efficiency of real-time summary query of service of 100 million data.

The invention provides a nuclear power plant isolation information management method, electronic equipment and a storage medium. The method comprises the following steps: initializing an isolation information source of a nuclear power plant to form a first sequence; configuring a target isolation ticket rack name, and constructing a first Hash map according to a mapping relation between the target isolation ticket rack name and the first sequence; forming a second sequence according to all isolation information which is from an isolation information source and is matched with a target isolation ticket rack name, and extracting all system names which are not repeated in the second sequence through field classification statistics to form a system name list; associating the second sequence as a child node to the first hash map; and determining a target system name from the system name list, and constructing a second hash map according to a mapping relationship between the target system name and the second sequence. According to the method and the device, the isolated ticket rack relationship can be constructed and displayed in a more efficient and more intuitive manner, so that the operation efficiency and accuracy of related businesses such as operation management and isolated management are improved.

The invention discloses a data writing method, a data query method, electronic equipment and a storage medium, and the method comprises the steps: generating a target data file based on to-be-written data, and storing the target data file to a target storage system to obtain a first storage path; generating at least one target index file corresponding to the target data file, and storing each target index file to a target storage system to obtain a second storage path; wherein the target data file and the corresponding target index file are separately stored in the target storage system; generating a target metadata file by using the first storage path and the second storage path; and carrying out atomic submission on the target metadata file so as to switch the target metadata file into a current metadata file of the Iceberg table. In this way, the data query efficiency can be improved.

This invention discloses a distributed, block-based, multi-dimensional storage method and apparatus for seismic data volumes. The method includes: separating the header information from the seismic traces in the acquired seismic volume file and storing the header information in a preset storage space; determining multiple dimensions based on the keywords of the seismic traces to construct a multi-dimensional model; dividing the multi-dimensional model into multiple multi-dimensional data cubes and determining the name of each multi-dimensional data cube, as well as the extreme values ​​of operational values, the total number of location numbers, and the total number of multi-dimensional data cubes in each dimension; storing the multi-dimensional data cubes on a distributed storage system using a mapping algorithm; calculating the physical storage location of the target data based on the acquired target data information, and extracting the target data from the distributed storage system and / or the preset storage space. This method improves data storage flexibility and query efficiency by optimizing the seismic data storage structure and index calculation.

The application discloses a kind of multi-source big data acquisition and pre-processing database construction method and system, it is related to database technical field, the present application completes multi-source heterogeneous data acquisition using edge-center two-level distributed architecture, and the security of data transmission is guaranteed by transmission encryption and integrity check mechanism, hierarchical pre-processing is carried out to data to realize heterogeneous data semantic alignment and multidimensional fusion;Distributed hybrid storage architecture is constructed, adaptive database index mechanism is set, and through multidimensional data quality evaluation, the incremental update and full-amount synchronization of database are realized.The present application can realize the unified collection of various source data, standardized processing, effectively break the data island barrier, significantly improve data processing efficiency and storage running performance, and stably guarantee the overall data quality and data consistency of database.

This application relates to the field of communication technology and provides a number processing method, apparatus, device, and storage medium. The method includes: acquiring user number information to be stored that has the function of receiving smart SMS messages, wherein the user number information to be stored includes first number segment information to be stored and second number segment information to be stored, wherein the first number segment information to be stored is general information for each user number to be stored, and the second number segment information to be stored is specific information for each user number to be stored; deleting the first number segment information to be stored; and storing the user number information to be stored sequentially in a preset array according to the numerical order of the second number segment information to be stored. This solution saves memory space and improves query speed in subsequent queries by customizing and storing the user numbers to be stored.

The invention provides an indoor control quality data storage method and device, and belongs to the technical field of air quality monitoring, and the method comprises the steps: obtaining indoor air quality data collected by a sensor assembly in real time; performing hardware code marking processing on the collected air quality data; and packaging the data subjected to the hardware code marking processing into blocks, and carrying out chaining storage on the blocks by utilizing a block chain system. According to the invention, the association degree of data storage can be effectively improved, the security, reliability and traceability of data storage are improved, the query and retrieval speed of data is effectively optimized, the operation consumption of the server is reduced, and the operation rate of the server is improved.

The invention provides an Internet of Vehicles data dynamic management method and system and vehicle-mounted equipment, and relates to the technical field of Internet of Vehicles, and the method comprises the steps: obtaining the current operation data of N different vehicle-mounted terminals; determining the current driving state of the ith vehicle-mounted terminal according to the current operation data of the ith vehicle-mounted terminal; determining the ith target sampling frequency according to the current driving state of the ith vehicle-mounted terminal; obtaining ith time sequence data from the ith vehicle-mounted terminal based on the ith target sampling frequency; determining the ith time sequence data meeting a preset judgment condition as core data, otherwise, determining the ith time sequence data as non-core data; the core data is written into the first storage area according to the first writing mode, the non-core data is written into the second storage area according to the second writing mode, and the query efficiency of the first storage area is higher than that of the second storage area. According to the invention, dynamic downsampling of the vehicle-mounted terminal data and heat distribution of data storage are realized, the utilization rate of storage resources is improved, and the data management cost is reduced.

This invention relates to the field of industrial manufacturing information management and data processing technology, specifically to a method and system for integrating and querying piecework data related to departmental relationships through tree-like node linkage. The method includes: constructing a hash-dependent directed acyclic graph (DAG) corresponding to the topological structure; obtaining the current composite fingerprint of the target root node; retrieving the current composite fingerprint from a cache library; if the retrieval is successful, directly returning the pre-stored aggregation result mapped in the cache library; otherwise, traversing downwards along the hash-dependent DAG, determining if the fingerprint has not changed and directly calling the pre-stored aggregation result; for sub-branches without a composite fingerprint mapping in the cache library, determining if the fingerprint has changed and performing real-time data aggregation calculation to generate a new aggregation result; establishing a mapping relationship and writing it into the cache library for subsequent query calls. This invention ensures millisecond-level real-time response of piecework cost data in scenarios with frequent engineering changes, eliminating data lag between design changes and financial accounting.

The application provides a data query method and device, equipment and a storage medium. The method comprises the following steps: in response to a data query request obtained, obtaining an available label query list from a label management service device; in response to a selected operation on a target available label identifier and a target available label value corresponding to the target available label identifier, obtaining an available index identifier list from the label management service device; in response to a selected operation on any target index identifier, querying target monitoring data according to the target index identifier, the target available label identifier and the target available label value; and displaying the target monitoring data. The application adds a label management service in a monitoring system to provide a user with selectable items of label identifiers and label values, so that the user can use the selectable items of label identifiers and label values to perform a data query operation, thereby reducing the difficulty of data query, simplifying the data query operation and improving the data query efficiency.

This application discloses a data query method, apparatus, storage medium, and electronic device. The method includes: parsing access data obtained through a data interface to obtain field parameters of the access data, wherein the access data includes at least the currently running data of the data query platform and business data from other business systems; converting a first field type corresponding to the field parameters to a second field type according to a preset correspondence, and binding the field parameters and the second field type in the data query platform; responding to a data query request sent by a target object, and if it is determined that a third field type in the data query request matches the second field type, sending the target data corresponding to the field parameters to the target object. This technical solution addresses the problem of improving data query efficiency.