Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

217 results about "Data sorting" patented technology

System for adaptive data blending across heterogeneous BI platforms for real-time decision making

ActiveDE202025103632U1ResourcesMarket data gatheringSchema mappingMetadata management
A system (100) for adaptive data blending across heterogeneous BI platforms for real-time decision making, comprising: (a) a data source abstraction module configured to establish standardised and secure connections with several different Business Intelligence (BI) platforms and convert their native data structures into a unified intermediate schema; (b) a real-time data ingestion and synchronisation module operable to continuously monitor and retrieve data updates from the BI platforms using event-driven mechanisms and configurable synchronisation policies; c) an adaptive data mapping and transformation module designed to intelligently harmonize, adapt, and semantically translate disparate data formats using rule-based logic and AI-assisted schema mapping; (d) a semantic context and metadata management module configured to maintain a unified data dictionary, track data sequence and maintain semantic consistency across platforms; (e) a cross-platform query orchestration engine designed to decompose common user queries, translate them into platform-specific query languages, execute them across the relevant BI platforms, and aggregate the results into a coherent output; (f) a decision intelligence and recommendation module that analyses the mixed data to generate real-time insights, alerts and contextual recommendations for decision support; and (g) a security, governance and compliance module configured to enforce access controls, maintain audit trails and ensure compliance with data protection regulations; h) the system provides seamless, real-time and secure data blending to enable consistent analytics and decision-making across heterogeneous BI environments.
Owner:GORGILLI SHIREESHA IRVING

Cable length measuring method based on coupling inductance and TDC

The invention relates to the technical field of cable measurement, and discloses a cable length measurement method based on coupling inductance and TDC, and the method comprises the following steps: test pulse reset, channel sequential gating, threshold dynamic adjustment, TDC state configuration, channel stable waiting, test pulse generation, time difference precise capture, validity intelligent judgment and data sorting optimization. According to the cable length measurement method based on the coupling inductor and the TDC, the coupling inductor is adopted to replace an FPGA to generate narrow pulses, the TDC is adopted to replace a high-speed ADC, and the hardware cost is reduced by 60%-80%; by optimizing the pulse generation and echo detection circuit, the measurement blind area is reduced to 0.5 m, the short-distance cable measurement requirement is met, and the device has the advantage of being small in measurement blind area.
Owner:ZHONGRUI TEST (SUZHOU) INTELLIGENT TECHNOLOGY CO LTD

Operation index determination method, device and equipment for endoscopic surgery and storage medium

The invention discloses an operation index determination method and device for an endoscopic surgery, equipment and a storage medium, and can be applied to the technical field of surgical operation data processing. The method comprises the following steps: firstly, acquiring a surgical operation data set of a target operation object for an endoscopic surgery; the surgical operation data set comprises a plurality of pieces of surgical operation data sorted according to a time sequence. Each piece of surgical operation data comprises five-dimensional data, namely endoscope action data, endoscope type data, instrument action data, instrument type data and surgical object data. And constructing a hidden Markov model by using the surgical operation data set. In the hidden Markov model, the surgical operation described by the surgical operation data is the observed quantity, and the surgical state is the state quantity, and based on the hidden Markov model, the statistical principle is utilized to carry out quantitative evaluation on the surgical operation indexes, so that the accurate evaluation of the surgical operation when a doctor carries out the endoscopic surgery is realized, and the reference effectiveness of the operation indexes is improved.
Owner:THE FIRST MEDICAL CENT CHINESE PLA GENERAL HOSPITAL

Data sorting method for tensor processor, tensor processor system and medium

The invention provides a data sorting method for a tensor processor, a tensor processor system and a medium, and relates to the technical field of data processing. The method comprises the following steps: acquiring input data and the storage capacity of a single tensor processor TPU register, and distributing core id for marking an initial position for each element; when the data size of the input data is smaller than or equal to the storage capacity of the single TPU register, single register level sorting operation is executed, and a double-tone sequence of the single register is obtained; otherwise, performing double-tone sorting recursion on the input data to divide the input data into a plurality of subsequences, executing single-register-level sorting operation on each subsequence, and merging the sorted subsequences to obtain a double-tone sequence of multiple registers; wherein the core id of the element is transmitted when the single register level sorting operation is executed for each sub-sequence and the sub-sequences are combined; and adjusting the sequence of the equal elements according to the core id after the double-tone sequence is obtained. The stability of the data sorting result can be improved.
Owner:SUZHOU YANGSIPING SEMICON CO LTD

Application method of water conveyance tunnel BIM (Building Information Modeling) engineering management service

The invention relates to the technical field of engineering digitization and information, and discloses a water conveyance tunnel BIM model engineering management business application method, which comprises the following steps: carrying out management business carding, and determining an engineering unit hierarchical structure; uniformly coding the data information related to the management service and the hierarchical structure data of the engineering unit to form a service data coding result and an engineering division coding result; creating a water conveyance tunnel BIM model, and endowing model components with the codes to form BIM data carrying code information; inputting the business data and the BIM data carrying the coding information into a digital construction and management system, and associating the business data and the BIM data by using a common coding identifier; based on the association, business management digital applications of investment, progress, quality, safety and the like are carried out in a digital construction and management system. Through standardized data sorting and coding, fusion of the BIM model and engineering management business is realized, the problem of data splitting is solved, and the refinement and digitization level of water conveyance tunnel engineering management is improved.
Owner:CHINA SOUTH-TO-NORTH WATER DIVERSION GROUP WATER NETWORK SMART TECHNOLOGY CO LTD

Data sorting device and method, chip, electronic equipment and storage medium

The invention discloses a data sorting device and method, a chip, electronic equipment and a storage medium, and the device comprises a controller which is used for obtaining a plurality of first data groups; a parity sorting network for sorting the first data set into a second data set; the data selector is used for acquiring a target data group; the controller is used for comparing the target data set with the ith second data set at an interval of N bits to obtain an (i-1) th third data set; when the TopN is sorted, the double-adjustment merging network is used for sorting the (i-1) th third data group into the (i-1) th fourth data group; when i is equal to the number of the plurality of first data groups, taking the (i-1) th fourth data group as a TopN sorting result; and during full sorting, the double-adjustment merging network is used for carrying out iterative merging on the sorted fourth data group to obtain a full sorting result. The method can be compatible with TopN and a dual-tone full-sorting algorithm, and saves computing resources.
Owner:SHANGHAI ORIENTAL COMPUTER TECHNOLOGY CO LTD

Performance optimization method, device and equipment for multi-mode query of data vault and medium

The invention discloses a performance optimization method, device and equipment for multimode query of a data vault and a medium. The method comprises the following steps: low-density screening of levels: analyzing data storage, and constructing a low-density index according to data features; the data statistics level is used for calculating and counting data source information; block scanning level: evaluating the data size, configuring block scanning parameters according to the data size, and determining the degree of parallelism of parallel scanning; a condition operator push-down level: identifying a push-down query condition, and pushing down the push-down query condition to the data source scanning operator; a cost model calculation level: planning to generate data sorting for a sorting operator through cost model calculation; a memory model calculation level: allocating a memory model according to the size of the memory; according to the cost of each layer, evaluating the performance improvement proportion or multiple brought by optimization of each layer layer by layer; and planning a data processing mode according to a layer-by-layer evaluation result. According to the method, the multi-layer optimization model is adopted, so that the performance of multi-mode query is improved.
Owner:ZHONGDIAN DATA IND CO LTD +1

Genetic disease auxiliary diagnosis system based on biological characteristic information

The invention relates to the technical field of auxiliary diagnosis, and particularly discloses a genetic disease auxiliary diagnosis system based on biological characteristic information, which comprises a data arrangement module, a path analysis module, a characteristic analysis module and a path determination module, the data arrangement module extracts historical diagnosis data of the single-gene hereditary disease, constructs a diagnosis feature table and extracts a diagnosis path; the path analysis module is used for performing specific analysis on the diagnosis path and the single-gene hereditary disease and determining an independent diagnosis path; the feature analysis module performs quantitative analysis on the biological feature information of the diagnosis independent path to obtain a feature time index and construct a feature time sequence; and the path determination module performs quantitative analysis on the instability of each piece of biological characteristic information of the diagnosis independent path, and determines a stable diagnosis path. According to the method, the diagnosis process can be optimized, clinical decision and research can be assisted, the unnecessary detection cost is reduced, and the medical resource utilization efficiency is improved.
Owner:BEIJING CHILDRENS HOSPITAL AFFILIATED TO CAPITAL MEDICAL UNIV

Feature data screening method and device for power grid fault assessment

The invention discloses a feature data screening method and device for power grid fault assessment, and belongs to the field of power systems, and the method comprises the steps: firstly obtaining a local bus set of a power grid and a candidate feature set corresponding to the set; performing a fault simulation experiment on the power grid according to a preset power system simulation platform to obtain characteristic quantity data corresponding to each characteristic quantity and form a characteristic quantity data set; according to a Mahalanobis distance principle and a Spearman level correlation coefficient calculation method, sorting each characteristic quantity data in the characteristic quantity data set to obtain an intermediate candidate characteristic set; screening each intermediate candidate feature in the intermediate candidate feature set by adopting an incremental feature subset strategy to obtain a plurality of final candidate features; and finally, performing fault assessment on the power grid according to each final candidate feature and the local bus set, and outputting a fault assessment result, so that the accuracy of power grid fault assessment can be improved through implementation of the method.
Owner:GUANGDONG POWER GRID CO LTD

Contextual active dynamic learning with a digital twin system

The disclosure includes a digital twin system. The digital twin allows for real time classification and ranking of data received from a distributed learning knowledge acquirer. The digital twin system ranks the data while the distributed learning knowledge acquirer is performing a drift evaluation. The distributed learning knowledge acquirer uses the ranked data as training data for discriminative AI models. The digital twin system offers more flexibility and precision in ranking the data. The digital twin system is a digital twin providing contextual active dynamic learning to the distributed learning knowledge acquirer's physical system. Digital twin system causes a model driven approach to allow for superior predictive capabilities by being able to examine large state spaces.
Owner:DELL PROD LP

Data quantitative query method and system based on spatial grids

The invention discloses a data quantitative query method and system based on spatial grids. According to the method, data of various types and formats are obtained in various modes, and the data are read into formats which can be recognized by a system. And then, analyzing and reconstructing the data, and completing cleaning and screening operations, including data translation and analysis, spatial data processing, JSON data sorting and the like. And performing precision unification and quantitative reconstruction on the processed data, and finally storing the processed data into a database and generating a query index. The method has efficient data processing and query capabilities, and can efficiently store and quickly retrieve large-scale spatial data.
Owner:ZHONGQIAN SI CHUANG (BEIJING) TECH CO LTD

Large-screen data statistics method based on multi-dimensional configuration

The present invention proposes a large-screen data statistics method based on multi-dimensional configuration, which includes: configuring database query statements and determining the configurations corresponding to the input database and the output database; aligning the source data business fact table using a high-frequency value inheritance conflict resolution algorithm; configuring different field accumulation strategies for local organizational statistical data with policy tags, and configuring an accumulation extraction strategy; sorting the data bound to the extraction strategy and the local organizational statistical data with policy tags; generating a path animation sequence based on a secondary pop-up data set and a statistical optimization path scheme, and integrating it into the display large screen to obtain the final large-screen display result. The present invention automatically standardizes heterogeneous fields of different databases through a database-driven semantic alignment algorithm, solves the problem of multi-source data integration, and uses high-frequency value inheritance conflict resolution technology to significantly improve the accuracy of filling empty fields and eliminate statistical deviations.
Owner:JIANGXI TONGRUI INFORMATION TECH CO LTD

Mine underground personnel positioning method and system based on environmental characteristics

The invention belongs to the technical field of positioning technologies, and particularly relates to a mine underground personnel positioning method and system based on environmental characteristics, which are suitable for personnel accurate positioning and dynamic correction in a complex structure and strong interference environment. The method comprises the steps of data classification and standardization processing, mine structure modeling, sensitive area identification and labeling, real-time positioning data acquisition and correction, and dynamic correction of an original positioning result in combination with environmental characteristics such as electromagnetic signal fluctuation, so that the accuracy and stability of underground positioning are improved. The system comprises a data arrangement module, a structure modeling module, a sensitive area identification module, an area fusion module and a positioning correction module, and all the modules cooperate to realize high-precision tracking of personnel positions and sensitive area early warning. The method can effectively overcome the error accumulation problem of a traditional positioning method under the underground strong interference condition, is suitable for underground operation scenes such as coal mines and metal and non-metal mines, and has wide application prospects.
Owner:ANHUI MAGANG ZHANGZHUANG MINING CO LTD

Enterprise data analysis method and device

The invention relates to an enterprise data analysis method and device, and relates to the technical field of data governance, and the method comprises the steps: carrying out the Text2SQL task fine tuning of a large language model through a low-rank adaptation technology, constructing a structured knowledge base containing an enterprise data dictionary, a field calling relation and a national standard, converting the unstructured industry specification into a structured data standard knowledge base, and realizing knowledge vectorization storage by using an M3E-base vector model; sampling representative samples based on to-be-sorted data fields and retrieving related rules, integrating the representative samples into thinking chain cues, inputting the thinking chain cues into a fine tuning model to generate a labeling classification result, and outputting a data sorting result after multi-model evaluation and verification; generating a regular expression through a retrieval data standard to screen non-standard data, sampling to generate an SQL conversion code, iteratively cleaning until the standard is reached, and outputting standardized data; and finally, executing index optimization and anomaly detection based on the fine tuning model, and receiving natural language query to generate an SQL and a visual report.
Owner:SHENZHEN JIUXIN SOFTWARE CO LTD

Efficient document searching method and device, equipment and storage medium

The invention relates to the field of information retrieval, and discloses an efficient document search method and device, equipment and a storage medium. The method comprises the steps that a document set is preprocessed, and an index structure is constructed; analyzing and optimizing a query word input by a user to generate a target retrieval request; retrieving an initial document set containing the target retrieval request based on the index structure; and carrying out correlation scoring on the initial document set by adopting a preset multi-dimensional scoring strategy, sorting according to a scoring result, and screening out a document set most related to the target retrieval request. According to the efficient document searching method provided by the invention, the document set most relevant to the user search query is screened out by analyzing and optimizing the user search query and combining the relevance score and the behavior data sorting result, so that the problems of low retrieval efficiency and poor result relevance of a traditional document searching method are effectively solved; and the document searching efficiency and the result quality are improved.
Owner:SHANGHAI DONGPU INFORMATION TECH CO LTD

Implementation method of improved two-dimensional ordered statistical constant false alarm rate detector based on CPU

The invention discloses an improved two-dimensional ordered statistical constant false alarm rate detector implementation method based on a CPU. The implementation steps are as follows: inputting a two-dimensional data matrix; performing initialization setting; for each detection unit, judging whether the sample value of the detection unit is the maximum value in a nine-block grid taking the detection unit as the center or not before detection; if yes, judging whether the sample value of the detection unit is greater than k arbitrary values of all reference unit sample values multiplied by a threshold factor or not through parallel processing; if yes, the detection unit is judged as a target, and the adjacent undetected unit does not need to be detected subsequently. According to the method, the number of detection units is greatly reduced, the processing time is shortened, meanwhile, in the detection process, a CPU does not need to open up an extra memory space to store all reference units to be sorted, data sorting work which is complex in traditional two-dimensional ordered statistics constant false alarm rate and long in consumed time is ingeniously avoided, the time complexity and the space complexity of an algorithm are reduced, and the detection efficiency is improved. And the real-time performance of target detection is ensured.
Owner:NANJING UNIV OF SCI & TECH

Memory-based data access system

The present invention relates to a memory-based data access system, which belongs to the field of data access technology and solves the problems in the prior art of difficult memory data processing and difficult reuse of processing codes. The system comprises: a memory data source constructor, a query constructor and a memory executor; the memory data source constructor is used to encapsulate the acquired data into a memory table object and then put it into the memory data source; the query constructor is used to construct a query object syntax tree through a chain call method and obtain the query object based on the query object syntax tree; the memory executor is used to obtain the data to be queried according to the memory data source and the incoming query object, and then filter the data to be queried, sort and group the data to be queried to obtain the final query result. The system realizes access to memory data using SQL query thinking.
Owner:YGSOFT INC

Multi-source disaster adaptive fusion space-time rendering method and system

The invention relates to the technical field of space-time visualization, in particular to a space-time rendering method and system for multi-source disaster situation adaptive fusion, and the method comprises the following steps: obtaining multi-source data sorting scheduling, aggregating space coordinates to generate mapping, identifying level change to switch primitives, and constructing a fusion rendering layer. According to the method, a priority path scheduling mechanism is introduced to ensure that an information calling sequence has dynamic adaptability, the accuracy of event expression is improved by synchronously binding a frame sequence number in a primitive expression process with a remarkably changed disaster situation level, and the visual identification degree of disaster situation evolution is enhanced by a dynamic marking strategy of a jump state primitive and a transient expression state; the screening and replacement of rendering primitives realize efficient filtering of differential expression based on significance threshold driving, realize perceptible expression of disaster change rhythm and real-time optimization and updating of expression objects, and avoid the problem of information shielding of traditional layer priority solidification. And the identification efficiency, the space positioning precision and the expression real-time performance of the dynamic disaster information are effectively improved.
Owner:MIN OF CIVIL AFFAIRS NAT DISASTER REDUCTION CENT +1

A circuit and method for long sequence data sorting

The application discloses a circuit and method for long sequence data sorting. The circuit is used for sorting N data in K base, and the maximum element in the data contains m bits in K base. The circuit comprises a radix counting unit, a first address generating unit, a data distribution unit and two sorting buffers. The two sorting buffers are used as a source buffer and a target buffer respectively, and can read data in a given address or write a data into a specified address. The radix counting unit, the first address generating unit and the data distribution unit are connected in sequence. The two sorting buffers are connected with the data distribution unit and the radix counting unit respectively. The data sorting circuit of the application has simple structure, can be flexibly adjusted according to specific requirements, and the data sorting method has linear order time complexity and short sorting time.
Owner:NANJING UNIV

A real-time ordering system for data

The application relates to a real-time data sorting system, which comprises a control unit, an input data preprocessing unit, a sorting module and a data buffer and output unit, the control unit is used for realizing the control of the input data preprocessing unit and the sorting module, the input data preprocessing unit is used for determining whether the sorting module can receive new external data and is used for judging whether sequence data is input into the sorting module, the sorting module is used for sorting the sequence data input into the sorting module, and the data buffer and output unit are used for information buffering and outputting the sorted data. The number of times of reading input data from an external memory is reduced, the data communication amount and data access overhead are reduced, the operation cost of the sorting operation is reduced, the efficiency is improved, and the sorting operation of any scale can be supported with the smallest FPGA resource consumption.
Owner:BEIJING AEROSPACE AUTOMATIC CONTROL RES INST

Method for realizing sorting and screening functions supported by PPT (Power Point Table) table

The invention provides a method for realizing sorting and screening supporting functions of a PPT table, which comprises the following steps of: S1, receiving a PPT file input by a user, and creating a PPT object; s2, circularly traversing a Table table object in the PPT object, and putting the Table table object into a List set with the name of a table List; s3, reading a script in a self-defined format of the Table table object, and generating a data processing instruction object; s4, preparing data to be filtered in the Table table object; s5, filtering the data; s6, sorting the data; s7, replacing the data in the Table table object; s8, deleting redundant table lines in the Table table object; and S9, generating a PPT file by the PPT object, and returning a result. On the basis of the script in the self-defined format, by analyzing the script, executing corresponding data screening and data sorting operation, replacing the screened data into the PPT table and deleting redundant PPT table rows, sorting and screening of the data in the PPT table are completed, and the PPT table supports sorting and screening functions.
Owner:CHINA LIFE INSURANCE CO LTD

Ciphertext data sorting method, system and device, storage medium and program product

The invention relates to a ciphertext data sorting method and system, computer equipment, a computer readable storage medium and a computer program product. The method comprises the following steps: a first server receives a first private key share and ciphertext data distributed by a data holder; through interaction with a second server, based on a preset double-tone sorting strategy, sorting the ciphertext data to obtain a ciphertext sorting result; and feeding back the ciphertext sorting result to the data holder to instruct the data holder to perform threshold decryption on the ciphertext sorting result in combination with the first server and the second server to obtain a sorting result of the original data set. According to the method, the preset double-tone sorting strategy is adopted, and the ciphertext sorting efficiency is improved. It is ensured that the data is always kept in an encrypted state in the calculation and sorting process, and the risk of data leakage is avoided. The method can be widely applied to encrypted database query, privacy protection machine learning, encrypted search and other scenes needing security sorting, and provides a solid foundation for subsequent multi-party calculation expansion.
Owner:ELECTRIC POWER RES INST CHINA SOUTHERN POWER GRID CO LTD +1

Data sorting method, database engine, and storage medium

This application provides a data sorting method, a database engine, and a storage medium. In this application, for scenarios involving multi-column sorting, the data rows to be sorted are first grouped according to the clustering column. Then, the sorting is performed between and within each data group according to the sorting column, using the same sorting order. The sorting result obtained in this way retains the clustering characteristics of the clustered columns while essentially ensuring the global order of the data, which is beneficial for improving the computational performance related to the clustered columns. Especially when querying based on the sorting result, it ensures that the performance of queries by data range is largely unaffected, while significantly improving the performance of queries by data grouping.
Owner:ALIBABA INNOVATION PRIVATE LIMITED

Optimized electrocardiogram (ECG) and activity data visualization

An embodiment includes a system having an ambulatory patient sensor, such as a cardiac sensor, that provides data via a network to remote device configured to prepare and display interactive user interface(s) used for visualizing data, for example in an interactive web application. The interactive user interface(s) are provided with interactive element(s) configured to support data sort or filtering operations for visualizing patient metrics and data activity included in the data visualization. In an embodiment, the interactive user interfaces provide different filtered views of the data responsive to user interaction for easily transitioning between data visualizations in an intuitive manner.
Owner:KONINKLIJKE PHILIPS NV

Data sequencing system and method

The application discloses a data sorting system and method. In the application, the data sorting system comprises an ADC chip, a sorting multiplexing module and a sorting control module. When the current state is a test mode, the ADC chip is used to transmit data clock and LVDS data to the sorting multiplexing module, then the sorting multiplexing module is used to generate parallel output data according to the data clock and the LVDS data, and then the sorting control module is used to respectively perform data sorting processing on each channel data in the parallel output data. When the current state is the test mode, the ADC chip is used to transmit the data clock and the LVDS data to the sorting multiplexing module, and then the sorting control module is used to respectively perform data sorting processing on each channel data in the parallel output data. The delay condition of the parallel output data can be processed by the sorting control module, so that the calibration between the data and the clock can be realized, and the LVDS data can be accurately sorted.
Owner:WUHAN ZHONGQI BIOLOGICAL MEDICAL ELECTRONICS

Compound manufacturing contour grinding allowance detection method and system based on point cloud matching

The application belongs to the technical field of additive manufacturing, and specifically discloses a composite manufacturing contour grinding allowance detection method and system based on point cloud matching. The method comprises the following steps: obtaining external contour data of a printed workpiece; generating a grinding path curve based on the external contour data by using a contour line method; discretizing the grinding path curve to obtain a plurality of discrete points; discretizing a digital model of the printed workpiece into point cloud data, and aligning the point cloud data with the external contour data based on a preset anchor point; sorting the external contour data and generating a triangular mesh model; obtaining the intersection point of the normal extension line of each discrete point and the corresponding triangular sub-face sheet in the triangular mesh model; and taking the Cartesian space distance value between the discrete point and the corresponding intersection point as the grinding allowance value. The application can accurately estimate the grinding allowance value required for completing the in-situ grinding task.
Owner:HUAZHONG UNIV OF SCI & TECH

Data sorting method and device

The present application provides a data sorting method and apparatus. The method includes: for a computable storage device, by receiving a sorting instruction sent by an electronic device, dividing the data to be sorted into the cache spaces of at least two data buckets according to the identifiers of the data to be sorted and the first numerical ranges corresponding to each data bucket established in advance, generating at least two cache blocks, and sending the cache blocks in the cache spaces of each data bucket to the corresponding memory spaces in the electronic device. In this technical solution, the computable storage device classifies and divides the data to be sorted according to at least two data buckets, thereby completing the preprocessing process of the data to be sorted, facilitating subsequent sorting of each divided data to be sorted by the electronic device, improving the efficiency of data sorting, and giving full play to the performance advantages of the CPU of the electronic device.
Owner:RUIZHE (HANGZHOU) TECH CO LTD

Data sorting method, electronic device, storage medium, and computer program product

This invention relates to the field of artificial intelligence technology, providing a data sorting method, electronic device, storage medium, and computer program product. The method includes: performing local sorting of data to be processed in parallel using multiple processing units of a parallel processor; each processing unit acquiring a portion of the data to be processed; sorting the acquired portion of data and selecting a preset number of data points as local target data; and performing one or more merge sort operations on the local target data acquired by each processing unit, based on the amount of data to be processed and the hardware resources of the parallel processor, and selecting a preset number of data points as global target data from the merged and sorted data. This invention avoids the huge computational overhead of globally sorting all data to be processed, significantly improving the efficiency and performance of TopK operations.
Owner:SHANGHAI BIREN TECH CO LTD

Distributed database query processing method and device, storage medium and program product

The embodiment of the invention provides a distributed database query processing method and device, a storage medium and a program product, and relates to the field of distribution. The method comprises the following steps: receiving a query request containing a row number limiting condition and a sorting condition; splitting the line number limiting condition into a plurality of sub-limiting conditions, and generating a plurality of sub-query requests for instructing each storage node to perform data scanning by using the local index based on the sorting condition; distributing the plurality of sub-query requests to corresponding storage nodes for execution; and receiving the intermediate result from each storage node, and processing the intermediate result in a streaming merging mode to obtain a final result. According to the method, the optimization logic of the dynamic splitting row number limiting condition is added, and the response speed of mass data sorting query is increased.
Owner:CETC JINCANG (BEIJING) TECH CO LTD

Learning data sorting device, storage facility, and learning data sorting method

To select an image serving as effective learning data, based on an index, with low load.SOLUTION: A learning data selection apparatus includes: an information addition unit which adds, as meta information of an image, to the image, environment information of a storage region that affects a difficulty level of recognizing an article included in the image obtained by imaging the storage region storing the article, definition information relating to the resolution of the image, and / or inference information based on an output of a model which recognizes the article; and an image selection unit which selects, according to the meta information, an image in a storage unit which stores a plurality of images with the mata information added thereto.SELECTED DRAWING: Figure 3
Owner:HITACHI GLOBAL LIFE SOLUTIONS INC