1224results about How to "Improve data processing efficiency" patented technology

System(s) and method(s) are provided for data management and data processing. For example, various embodiments may include systems and methods relating to relatively larger groups of data being selected with comparable or better performing selection results (e.g., high data redundancy elimination and / or average chunk size). In various embodiments, the system(s) and method(s) may include, for example a data group, block, or chunk combining technique or / and a data group, block, or chunk splitting technique. Various embodiments may include a first standard or typical data grouping, blocking, or chunking technique and / or data group, block, or chunk combining technique or / and a data group, block, or chunk splitting technique. Exemplary system(s) and method(s) may relate to data hashing and / or data elimination. Embodiments may include a look-ahead buffer and determine whether to emit small chunks or large chunks based on characteristics of underlying data and / or particular application of the invention (e.g., for backup).

The invention relates to a transformer substation electrical equipment monitoring, analyzing and processing system and particularly relates to a transformer substation electrical equipment comprehensive physical examination system based on cloud side end collaborative perception. The system is characterized in that multi-node detection and unified perception access are realized through an integrated communication network architecture on the edge side of a station end, an intelligent sensing terminal is comprehensively covered in real time. Meanwhile, local intelligent data processing is realized by utilizing an edge computing technology; an omnibearing intelligent diagnosis and analysis system of the transformer substation is constructed at a cloud end, and multiple functions such as abnormal real-time early warning and intelligent sensing prediction are realized, so that the real-time tracking of the operation state of the power equipment of the transformer substation is realized. Themethod has the advantages that the transformer substation can be covered, monitoring data can be comprehensively utilized, an intelligent processing scheme can be provided, construction of the intelligent transformer substation is promoted, and the intelligent evaluation and safety early warning level of the electrical equipment state of the transformer substation is improved.

The invention discloses an E-bank account fraudulent conduct and risk detecting method and system. The method includes model construction and risk analysis. A mainstream big data processing platform is utilized for extracting an overall index and individual indexes from original data and analyzing the indexes. Risk evaluation models for different accounts are constructed and dynamic adjustment and update of the models are performed according to newly input data. When a to-be-detected-account is being evaluated, corresponding indexes of the account are extracted and risk grades of the indexes are subjected to weighing accumulation, so that the risk evaluation value of the account is obtained. Further, the to-be-evaluated account is graded based on a risk grade model obtained through analysis of distribution of all history risk evaluation values. Finally, accounts with comparatively high risk grades are obtained. According to the invention, by utilizing a method combining the overall index with the individual indexes, features are found in data and different features are employed for different accounts. Therefore, fraudulent conduct detection error rate is reduced. At the same time, data processing efficiency is improved.

A parallel data processing method based on multiple graphic processing units (GPUs) is provided, including: creating, in a central processing unit (CPU), a plurality of worker threads for controlling a plurality of worker groups respectively, the worker groups including one or more GPUs; binding each worker thread to a corresponding GPU; loading a plurality of batches of training data from a nonvolatile memory to GPU video memories in the plurality of worker groups; and controlling the plurality of GPUs to perform data processing in parallel through the worker threads. The method can enhance efficiency of multi-GPU parallel data processing. In addition, a parallel data processing apparatus is further provided.

The invention discloses a form automatic generation method based on form template set, including drawing basic elements in form template to form a form template; identifying and analyzing the basic elements in the form template to form a form template set; acquiring data organization regulations of data source of form to be generated, wherein the data organization regulations are organized in tree-like hierarchy structure; setting graph association rule between form templates in the form template set according to the data source structure; setting text rule between form templates in the form template set according to the data source structure; selecting a template set and acquiring form generation data from the data source according to the graph association rule and text rule in the selected template set; automatically generating a form according to the basic elements of the form template set, graph association rule and text rule in the template set and the form generation data. The invention reduces form template making complexity and improves form generation automation degree and working efficiency.

The invention provides a flow-based abnormal communication behavior detection method and system, and belongs to the field of passive discovery of network security abnormal events. The detection systemcomprises: a configuration management module used for configuring a white list IP, a key target IP and a general target IP, a data acquisition module and a storage module used for acquiring and storing network flow data information, a key target abnormity detection module and a general target abnormity detection module used for detecting key targets and general targets respectively, and an abnormity evaluation module. According to the detection method provided by the invention, different methods are adopted to construct flow models for important network nodes and common network nodes, networkanomaly detection is carried out respectively, network events of important targets and common targets are associated, and network intrusion behaviors and abnormal communication behaviors with certainhazards are mined. The method has good discovery capability for various types of traffic abnormal behaviors, and is low in computation complexity for flow data, and is high in abnormity discovery real-time performance.

The invention discloses a laser vision guided automatic welding track tracking system which comprises an embedded type industrial personal computer with an image processing device, a laser vision sensor, a welding robot, matched welding equipment and a workpiece clamping workbench; the laser vision sensor is installed on a welding gun in an advanced parallel manner in the welding direction through a laser sensor fixing element; the welding gun is installed on a tail end flange disc of the welding robot through a welding gun fixing element; and the embedded type industrial personal computer is connected with the laser vision sensor through a circuit. The invention also discloses a laser vision guided automatic welding track tracking method. With adoption of the laser vision guided automatic welding track tracking system and method, without the process of teaching in advance, the welding production efficiency and the adaptive ability are improved through real-time detection and tracking; and meanwhile, the problem of tracking lag caused by advanced detection is prevented, and the problem that when a sensor is too near the welding gun, large noise of coupling feature images is caused by factors including strong arc light irradiation, high temperature and smoke dusts, thus the real time and the tracking accuracy of the system are restricted is solved.

The present invention provides a configuration that allows for a cursor or other object that has moved outside the display section to be displayed as a virtual object and observed. A cursor or object lying in an area outside the area of the display section of a PC or other device is displayed as a virtual object. For example, the display of goggles worn by the user displays a display device such as a PC and the area outside the display device. The three-dimensional position of the cursor or object that has probably moved in response to user operation is calculated, after which the cursor or object is displayed as a virtual object at the calculated position. Further, object information for the object specified by the cursor is acquired and presented.

The invention discloses a wireless security communication method and system for ensuring the security of wireless communication in an intelligent transportation system, improving the data processing efficiency and reducing the complexity of security communication. The method comprises the following steps: at least one first secret key and identification information thereof are respectively stored in an OBU (On-Board Unit) and a CCS (Central Computer System) server; and the OBU is used for generating a second secret key on the basis of a random number and the first secret key after a digital certificate of the CCS server is passed through verification, encrypting information to be transmitted by adopting the second secret key, and then sending the identification information of the first secret key and the random number which generate the second secret key, and the information encrypted by the second secret key to the CCS server. The invention simultaneously discloses a wireless security communication system.

The present invention provides a memory system which contributes to improvement in efficiency of a data process accompanying a memory access. A memory system has a rewritable nonvolatile memory, a buffer memory, and a controller. The controller controls, in response to an access request from an external apparatus, first data transfer between the controller and the external apparatus, second data transfer between the controller and the nonvolatile memory, and third data transfer between the controller and the buffer memory, controls transfer from the controller to the buffer memory in the third data transfer and transfer from the buffer memory to the controller in a time sharing manner, and enables the first data transfer or the second data transfer to be performed in parallel with the transfer carried out in the time sharing manner.

A method and apparatus for processing data in a Controller Area Network (CAN) are discussed. In an embodiment of this invention, dummy data is added to data to be transmitted via a CAN message, and information indicating that the dummy data is added is transmitted via the CAN message. A length of the dummy data is determined such that data to be transmitted via the CAN message becomes a predetermined length, and data in which five or more successive bits do not have a same value is added as the dummy data. The information is included in a field indicating a length of data to be transmitted via the CAN message, and is indicated by a value within a reserved range of the field. Accordingly, data processing efficiency can be improved, and flexible CAN communication can be performed via the CAN message.

The invention discloses a GPS signal large-scale parallel quick capturing method, which comprises the following steps: configuring a large-scale parallel quick capturing module firmware comprising submodules of multiplier, data block cache, parallel part correlative processing, frequency domain transformation, postprocessing and digital controlled oscillator, code generator and the like in a system CPU; through the calling computation, converting low-medium frequency digital signals into baseband signals in a processing procedure to combine a data block; performing zeroing extension of the length and the data block on each equational data section in the data block; then based on FFT transformation computation, performing parallel part correlative PPC processing on each extended data section and local spreading codes, and performing FFT transformation on each line of a formed PPC matrix to obtain a result matrix; and performing coherent or incoherent integration on a plurality of result matrixes formed by processing a plurality of data blocks to increase the processing gain, improve the capturing sensitivity, roughly determine the code phase and the Doppler frequency of GPS signals, and achieve two-dimensional parallel quick capturing of the GPS signals. The method has high processing efficiency and high capturing speed, and can be applied to various GPS positioning navigation aids.

A parallel data processing method based on multiple graphic processing units (GPUs) is provided, including: creating, in a central processing unit (CPU), a plurality of worker threads for controlling a plurality of worker groups respectively, the worker groups including a plurality of GPUs; binding each worker thread to a corresponding GPU; loading one batch of training data from a nonvolatile memory to a GPU video memory corresponding to one worker group; transmitting, between a plurality of GPUs corresponding to one worker group, data required by data processing performed by the GPUs through peer to peer; and controlling the plurality of GPUs to perform data processing in parallel through the worker threads.

The invention provides a method and device for generating a visualized view. The method includes the steps of enabling the view device to obtain a data set to be revealed, determining element mapping information, such as pixels or graphs, corresponding to the data set, according to the element mapping information, determining drawing parameter information corresponding to data information in the data set, and finally generating the visualized view corresponding to the data set according to the drawing parameter information. Compared with the prior art, the method and device for generating the visualized view have the advantages that visualized view carried out on data sets which comprise the large data volume and are in various types is achieved, particularly, drawing on the large data volume at the web end is achieved, and therefore the resource consumption at the server end is reduced. Data is visually revealed, therefore, the information obtaining efficiency of a user is improved, the user can conveniently carry out data mining and processing, and the use experience of the user is improved.

The invention provides a video data processing method and device and a readable storage medium. Input video data to be processed is processed according to a preset trained deep learning algorithm model, and a label vector, which comprises a confidence score of the video data in each label, of the video data is obtained; according to label vectors of different music data in a music library and a preset recommendation algorithm, recommendation scores of the label vectors of the different music data and video data are determined; and according to the recommendation scores, the music data matchingthe video data serves a technical means of background music. The deep learning algorithm model and the recommendation algorithm are used to determine the music data matching the video data rapidly, the data processing efficiency in finding the background music of the video data in the music library is improved effectively, and the labor cost is reduced.

The embodiment of the invention discloses a method, a device and a system for generating a script of a test case. The method, the device and the system are used for generating a manual test case into an automatic test case script. The method provided by the embodiment of the invention comprises the following steps: generating a case configuration file, a standard control description file and a data and service assembly of the case into case instances; loading the case instances; and generating the automatic test case script according to the loaded case instances.

The data processing apparatus comprises a cache having a plurality of cache lines for storing data values retrieved from a plurality of memory regions, when a data value from a first memory region is stored in the cache and is subsequently updated within the cache by a new data value, the new data value is not transferred to memory until that new data value is removed from the cache. A marker is associated with each cache line and is settable to indicate that the data values stored in the corresponding cache line are from said first memory region. A protection unit for controlling the transfer of data values between the cache and the memory, is arranged, when said data values are to be loaded from the memory into a cache line of the cache, to determine whether said data values are from said first memory region and to cause the marker to be set accordingly. When the processor core outputs a new data value for storage, the cache is arranged to determine if the new data value is to replace a data value stored in a cache line of the cache, and if so to update the corresponding cache line with the new data value, and to apply predetermined criteria to determine whether to set an update identifier, such that when the new data value is subsequently removed from the cache it can be determined whether to transfer that new data value to the memory.

System(s) and method(s) are provided for data management and data processing. For example, various embodiments may include systems and methods relating to relatively larger groups of data being selected with comparable or better performing selection results (e.g., high data redundancy elimination and / or average chunk size). In various embodiments, the system(s) and method(s) may include, for example a data group, block, or chunk combining technique or / and a data group, block, or chunk splitting technique. Various embodiments may include a first standard or typical data grouping, blocking, or chunking technique and / or data group, block, or chunk combining technique or / and a data group, block, or chunk splitting technique. Exemplary system(s) and method(s) may relate to data hashing and / or data elimination. Embodiments may include a look-ahead buffer and determine whether to emit small chunks or large chunks based on characteristics of underlying data and / or particular application of the invention (e.g., for backup).

The invention discloses a data transmission method, a device and a system. The method includes the steps: receiving Bluetooth signals broadcasted by a Bluetooth device; determining the distance between a user terminal and the Bluetooth device according to the Bluetooth signals; connecting the user terminal with the Bluetooth device when the distance between the user terminal and the Bluetooth device reaches a first preset threshold value; transmitting data to the Bluetooth device based on connection. Before the user terminal is connected with the Bluetooth device, the distance between the user terminal and the Bluetooth device is detected, pairing connection operation is automatically performed when the distance reaches the first preset threshold value, a data transmission request is transmitted after pairing, the data are transmitted, transaction is finished, data transmission time is integrally shortened, and data processing efficiency is improved.

The invention provides a data backup method. The data backup method comprises the steps that the size and the total line number of a table not backed up in a database are obtained; the target line number of given structural query language sentences contained in each fragment of the table which is not backed up is calculated according to the total line number and the value of a preset first instruction line option; when the size of the table not backed up is larger than or equal to the value of a preset second instruction line option, the table not backed up is divided into a plurality of fragments according to the total line number and the target line number, and a fragment backup file of each fragment is generated and output. The invention further provides a data recovery method, a data backup device and a data recovery device. The data backup and recovery methods and devices can improve the speed of data recovery and improve the efficiency of data processing.

The invention discloses a searching method, a searching device and a searching system. The searching method is applied to a mobile terminal and is realized in a desktop plug-in mode. The searching method comprises the following steps: arranging a communication interface between the mobile terminal and a server; obtaining keyword information inputted by a user through the desktop plug-in; sending the keyword information to the server, so as to be convenient for the server to search for a record matched with the keyword information from an application program list according to the keyword information, and to generate an application program sub-list according to the searched record; and receiving the application program sub-list sent by the server and showing an application program matched with the keyword information to the user according to the application program sub-list. According to the searching method provided by the invention, the occupation for a data processing resource of the mobile terminal is reduced and the data processing efficiency of the mobile terminal is increased.

A transmitting apparatus includes: a baseband packet generator configured to generate a baseband packet including a header and payload data corresponding to an input stream; a frame generator configured to generate a frame including the baseband packet; a signal processor configured to process the generated frame; and a transmitter configured to transmit the processed frame, wherein the header includes information about whether a number of null packets deleted when generating the baseband packet is more than a predetermined number, information about a number of packets within the baseband packet, and information about a number of the deleted null packets.

The invention relates to a disease prediction method based on automatic medical specialist knowledge extraction, and belongs to the technical field of intelligent medical treatment. The method comprises the following steps: firstly, constructing a disease relation network according to historical diagnosis record data, calculating the disease feature vectors on the network through the explicit andimplicit correlations between the disease entities by using the neural network model, and calculating the correlation matrix between the diseases through disease feature vectors to serve as medical specialist knowledge; secondly, designing a disease prediction model based on deep learning, and subjecting the original medical index data of the patient to dimensionality reduction through a noise reduction self-encoder stack model, and predicting the potential disease of the patient by taking the data as the input data of the multi-label disease prediction model; and finally, in the parameter learning part of the model, taking a disease similarity matrix which is automatically extracted in the first step as a medical background constraint condition, making an optimal parameter of the algorithm learning model, and taking a disease with relatively high incidence probability as a prediction result. Compared with the prior art, the disease prediction accuracy is improved.

The invention provides a storage method and device for data of databases. The method comprises the steps of acquiring multiple entity objects in business data and the object attribute information of each entity object; determining a data field to which each entity object belongs based on the entity objects and the object attribute information and acquiring the logic relationship between each entity object and the corresponding data field; creating wide tables in a database according to the logic relationships and storing description data of each entity object into a corresponding wide table. The method and the device solve the technical problem of low data storage processing efficiency.

The invention provides a large-area insect pest quantization monitoring system. The large-area insect pest quantization monitoring system is characterized by comprising the following steps: acquiring a remote sensing image with a specific wave band by adopting aircraft-mounted or satellite-mounted hyperspectral remote sensing equipment, carrying out the necessary pre-treatment on the remote sensing image, eliminating the interference and measuring errors, then extracting the spectral signature in pixel-level size scale from the remote sensing image, and substituting the spectral signature into a multi-dimensional plant parameter model to invert a plant ecological index, so that an insect pest condition of a remote sensing detection zone is quantitatively determined according to the index.

The invention discloses an online measurement method for welding line characteristic point positions. The method comprises the following steps: a welding gun is positioned in an initial welding position; image information of welding line contours is initialized to obtain welding line initial positions; welding line images are acquired; welding line positions at present are predicted; the modelingof the welding line images in a time sequence direction is finished; characteristics of the welding line images are extracted; the tracking positioning of the welding line characteristics points is finally realized; and a motion trajectory of the welding gun is calculated. Meanwhile, the invention discloses a welding line trajectory automatic measurement system; and the system comprises an embedded development board, a laser visual sensor, a welding robot, a robot controller, mated welding equipment and a workpiece clamping worktable. The method can deal with the noise disturbance under non-structural welding environment, improves the robustness and the stability of a welding line tracking system, realizes automatic identification of welding line characteristic points, and greatly improvesthe automation degree and the production efficiency.

The invention discloses a log processing method and device, computer equipment and a computer readable storage medium. The method comprises: acquiring logs of a target application in real time, and sending the acquired log data to a message queue system in real time; Pulling data from the message queue system through a streaming calculation module, and generating corresponding monitoring data according to the pulled data; And storing the monitoring data in a database. The method can effectively solve the problems that in the prior art, huge pressure can be caused to a database, and meanwhile the calculation speed and the data display speed can be reduced, the data processing efficiency is improved, and consumption of calculation resources of an application server is reduced.

The embodiment of the invention discloses a method and a device for data rasterization and a method and a device for user behavior analysis. The method for the data rasterization comprises the following steps of acquiring corresponding user associated data according to user behavior data produced in a target time period and located in a target area; computing a two-dimension number corresponding to the user associated data according to position information in the user associated data; acquiring a corresponding two-dimension index number from a two-dimension index number set by taking the two-dimension number as a query condition; associating a raster mark with the user associated data so as to obtain corresponding raster data. The efficiency of the data rasterization is increased, and user behavior rule or preference analysis based on mass of diversified real-time raster data is realized.

The invention provides a distributed cache management system, which comprises an index server and a distributed memory object cache server, wherein the index server comprises an index establishment unit for storing corresponding data into the distributed memory object cache server according to a received data cache request and establishing an index for the cached data, and a data acquisition unit for acquiring the corresponding index according to a received data acquisition request and acquiring the corresponding data from the distributed memory object cache server according to the index. The invention also provides a method for implementing distributed cache management. By the technical scheme, the data in the distributed memory object cache server can be effectively managed, and the efficiency for request response and data processing is improved.