1223results about How to "Improve data processing efficiency" patented technology

System(s) and method(s) are provided for data management and data processing. For example, various embodiments may include systems and methods relating to relatively larger groups of data being selected with comparable or better performing selection results (e.g., high data redundancy elimination and/or average chunk size). In various embodiments, the system(s) and method(s) may include, for example a data group, block, or chunk combining technique or/and a data group, block, or chunk splitting technique. Various embodiments may include a first standard or typical data grouping, blocking, or chunking technique and/or data group, block, or chunk combining technique or/and a data group, block, or chunk splitting technique. Exemplary system(s) and method(s) may relate to data hashing and/or data elimination. Embodiments may include a look-ahead buffer and determine whether to emit small chunks or large chunks based on characteristics of underlying data and/or particular application of the invention (e.g., for backup).

The invention relates to a transformer substation electrical equipment monitoring, analyzing and processing system and particularly relates to a transformer substation electrical equipment comprehensive physical examination system based on cloud side end collaborative perception. The system is characterized in that multi-node detection and unified perception access are realized through an integrated communication network architecture on the edge side of a station end, an intelligent sensing terminal is comprehensively covered in real time. Meanwhile, local intelligent data processing is realized by utilizing an edge computing technology; an omnibearing intelligent diagnosis and analysis system of the transformer substation is constructed at a cloud end, and multiple functions such as abnormal real-time early warning and intelligent sensing prediction are realized, so that the real-time tracking of the operation state of the power equipment of the transformer substation is realized. Themethod has the advantages that the transformer substation can be covered, monitoring data can be comprehensively utilized, an intelligent processing scheme can be provided, construction of the intelligent transformer substation is promoted, and the intelligent evaluation and safety early warning level of the electrical equipment state of the transformer substation is improved.

The invention discloses an E-bank account fraudulent conduct and risk detecting method and system. The method includes model construction and risk analysis. A mainstream big data processing platform is utilized for extracting an overall index and individual indexes from original data and analyzing the indexes. Risk evaluation models for different accounts are constructed and dynamic adjustment and update of the models are performed according to newly input data. When a to-be-detected-account is being evaluated, corresponding indexes of the account are extracted and risk grades of the indexes are subjected to weighing accumulation, so that the risk evaluation value of the account is obtained. Further, the to-be-evaluated account is graded based on a risk grade model obtained through analysis of distribution of all history risk evaluation values. Finally, accounts with comparatively high risk grades are obtained. According to the invention, by utilizing a method combining the overall index with the individual indexes, features are found in data and different features are employed for different accounts. Therefore, fraudulent conduct detection error rate is reduced. At the same time, data processing efficiency is improved.

A parallel data processing method based on multiple graphic processing units (GPUs) is provided, including: creating, in a central processing unit (CPU), a plurality of worker threads for controlling a plurality of worker groups respectively, the worker groups including one or more GPUs; binding each worker thread to a corresponding GPU; loading a plurality of batches of training data from a nonvolatile memory to GPU video memories in the plurality of worker groups; and controlling the plurality of GPUs to perform data processing in parallel through the worker threads. The method can enhance efficiency of multi-GPU parallel data processing. In addition, a parallel data processing apparatus is further provided.

The invention provides a flow-based abnormal communication behavior detection method and system, and belongs to the field of passive discovery of network security abnormal events. The detection systemcomprises: a configuration management module used for configuring a white list IP, a key target IP and a general target IP, a data acquisition module and a storage module used for acquiring and storing network flow data information, a key target abnormity detection module and a general target abnormity detection module used for detecting key targets and general targets respectively, and an abnormity evaluation module. According to the detection method provided by the invention, different methods are adopted to construct flow models for important network nodes and common network nodes, networkanomaly detection is carried out respectively, network events of important targets and common targets are associated, and network intrusion behaviors and abnormal communication behaviors with certainhazards are mined. The method has good discovery capability for various types of traffic abnormal behaviors, and is low in computation complexity for flow data, and is high in abnormity discovery real-time performance.

The invention discloses a laser vision guided automatic welding track tracking system which comprises an embedded type industrial personal computer with an image processing device, a laser vision sensor, a welding robot, matched welding equipment and a workpiece clamping workbench; the laser vision sensor is installed on a welding gun in an advanced parallel manner in the welding direction through a laser sensor fixing element; the welding gun is installed on a tail end flange disc of the welding robot through a welding gun fixing element; and the embedded type industrial personal computer is connected with the laser vision sensor through a circuit. The invention also discloses a laser vision guided automatic welding track tracking method. With adoption of the laser vision guided automatic welding track tracking system and method, without the process of teaching in advance, the welding production efficiency and the adaptive ability are improved through real-time detection and tracking; and meanwhile, the problem of tracking lag caused by advanced detection is prevented, and the problem that when a sensor is too near the welding gun, large noise of coupling feature images is caused by factors including strong arc light irradiation, high temperature and smoke dusts, thus the real time and the tracking accuracy of the system are restricted is solved.

The invention discloses a wireless security communication method and system for ensuring the security of wireless communication in an intelligent transportation system, improving the data processing efficiency and reducing the complexity of security communication. The method comprises the following steps: at least one first secret key and identification information thereof are respectively stored in an OBU (On-Board Unit) and a CCS (Central Computer System) server; and the OBU is used for generating a second secret key on the basis of a random number and the first secret key after a digital certificate of the CCS server is passed through verification, encrypting information to be transmitted by adopting the second secret key, and then sending the identification information of the first secret key and the random number which generate the second secret key, and the information encrypted by the second secret key to the CCS server. The invention simultaneously discloses a wireless security communication system.

The present invention provides a memory system which contributes to improvement in efficiency of a data process accompanying a memory access. A memory system has a rewritable nonvolatile memory, a buffer memory, and a controller. The controller controls, in response to an access request from an external apparatus, first data transfer between the controller and the external apparatus, second data transfer between the controller and the nonvolatile memory, and third data transfer between the controller and the buffer memory, controls transfer from the controller to the buffer memory in the third data transfer and transfer from the buffer memory to the controller in a time sharing manner, and enables the first data transfer or the second data transfer to be performed in parallel with the transfer carried out in the time sharing manner.

The invention discloses a GPS signal large-scale parallel quick capturing method, which comprises the following steps: configuring a large-scale parallel quick capturing module firmware comprising submodules of multiplier, data block cache, parallel part correlative processing, frequency domain transformation, postprocessing and digital controlled oscillator, code generator and the like in a system CPU; through the calling computation, converting low-medium frequency digital signals into baseband signals in a processing procedure to combine a data block; performing zeroing extension of the length and the data block on each equational data section in the data block; then based on FFT transformation computation, performing parallel part correlative PPC processing on each extended data section and local spreading codes, and performing FFT transformation on each line of a formed PPC matrix to obtain a result matrix; and performing coherent or incoherent integration on a plurality of result matrixes formed by processing a plurality of data blocks to increase the processing gain, improve the capturing sensitivity, roughly determine the code phase and the Doppler frequency of GPS signals, and achieve two-dimensional parallel quick capturing of the GPS signals. The method has high processing efficiency and high capturing speed, and can be applied to various GPS positioning navigation aids.

The embodiment of the invention discloses a method, a device and a system for generating a script of a test case. The method, the device and the system are used for generating a manual test case into an automatic test case script. The method provided by the embodiment of the invention comprises the following steps: generating a case configuration file, a standard control description file and a data and service assembly of the case into case instances; loading the case instances; and generating the automatic test case script according to the loaded case instances.

The data processing apparatus comprises a cache having a plurality of cache lines for storing data values retrieved from a plurality of memory regions, when a data value from a first memory region is stored in the cache and is subsequently updated within the cache by a new data value, the new data value is not transferred to memory until that new data value is removed from the cache. A marker is associated with each cache line and is settable to indicate that the data values stored in the corresponding cache line are from said first memory region. A protection unit for controlling the transfer of data values between the cache and the memory, is arranged, when said data values are to be loaded from the memory into a cache line of the cache, to determine whether said data values are from said first memory region and to cause the marker to be set accordingly. When the processor core outputs a new data value for storage, the cache is arranged to determine if the new data value is to replace a data value stored in a cache line of the cache, and if so to update the corresponding cache line with the new data value, and to apply predetermined criteria to determine whether to set an update identifier, such that when the new data value is subsequently removed from the cache it can be determined whether to transfer that new data value to the memory.

The invention discloses a searching method, a searching device and a searching system. The searching method is applied to a mobile terminal and is realized in a desktop plug-in mode. The searching method comprises the following steps: arranging a communication interface between the mobile terminal and a server; obtaining keyword information inputted by a user through the desktop plug-in; sending the keyword information to the server, so as to be convenient for the server to search for a record matched with the keyword information from an application program list according to the keyword information, and to generate an application program sub-list according to the searched record; and receiving the application program sub-list sent by the server and showing an application program matched with the keyword information to the user according to the application program sub-list. According to the searching method provided by the invention, the occupation for a data processing resource of the mobile terminal is reduced and the data processing efficiency of the mobile terminal is increased.

The invention relates to a disease prediction method based on automatic medical specialist knowledge extraction, and belongs to the technical field of intelligent medical treatment. The method comprises the following steps: firstly, constructing a disease relation network according to historical diagnosis record data, calculating the disease feature vectors on the network through the explicit andimplicit correlations between the disease entities by using the neural network model, and calculating the correlation matrix between the diseases through disease feature vectors to serve as medical specialist knowledge; secondly, designing a disease prediction model based on deep learning, and subjecting the original medical index data of the patient to dimensionality reduction through a noise reduction self-encoder stack model, and predicting the potential disease of the patient by taking the data as the input data of the multi-label disease prediction model; and finally, in the parameter learning part of the model, taking a disease similarity matrix which is automatically extracted in the first step as a medical background constraint condition, making an optimal parameter of the algorithm learning model, and taking a disease with relatively high incidence probability as a prediction result. Compared with the prior art, the disease prediction accuracy is improved.

The present invention discloses a multi-channel memory storage device and control method thereof. The method arranges physical locations for a file's data stored in the storage device. The storage device includes a plurality of memories. The major feature of the method is to decide whether the data is written to a single memory or parallel memories according to the size of the data.

The invention provides a storage method and device for data of databases. The method comprises the steps of acquiring multiple entity objects in business data and the object attribute information of each entity object; determining a data field to which each entity object belongs based on the entity objects and the object attribute information and acquiring the logic relationship between each entity object and the corresponding data field; creating wide tables in a database according to the logic relationships and storing description data of each entity object into a corresponding wide table. The method and the device solve the technical problem of low data storage processing efficiency.

The invention discloses a log processing method and device, computer equipment and a computer readable storage medium. The method comprises: acquiring logs of a target application in real time, and sending the acquired log data to a message queue system in real time; Pulling data from the message queue system through a streaming calculation module, and generating corresponding monitoring data according to the pulled data; And storing the monitoring data in a database. The method can effectively solve the problems that in the prior art, huge pressure can be caused to a database, and meanwhile the calculation speed and the data display speed can be reduced, the data processing efficiency is improved, and consumption of calculation resources of an application server is reduced.

The embodiment of the invention discloses a method and a device for data rasterization and a method and a device for user behavior analysis. The method for the data rasterization comprises the following steps of acquiring corresponding user associated data according to user behavior data produced in a target time period and located in a target area; computing a two-dimension number corresponding to the user associated data according to position information in the user associated data; acquiring a corresponding two-dimension index number from a two-dimension index number set by taking the two-dimension number as a query condition; associating a raster mark with the user associated data so as to obtain corresponding raster data. The efficiency of the data rasterization is increased, and user behavior rule or preference analysis based on mass of diversified real-time raster data is realized.