214 results about "Data grid" patented technology

A system and method for distributed query processing may compile and optimize query plans for incoming query requests independent of hardware configurations and/or physical locations of data partitions in a distributed storage system (e.g., a data grid). The query plan may be divided into segments, and each segment may be instantiated on a remote query processing node of the distributed system by a query coordinator node according to metadata accessed at runtime by remote sub-query operators in the query plan. The metadata may include an indication of the physical locations of data partitions in the system and may be stored on one or more of the query processing nodes. The remote query processing nodes may execute the query plan segments and return results to the requestor. Cached query plans may be re-executed without recompilation, according to current metadata, even in the event of a node failure or data partition move.

The present invention provides for data to be bilaterally transferred between general applications such as databases and task specific applications. The transfer maps and transports data between applications. The first application includes a data structure with a data structure identifier and a table. The second application includes a data grid. The mapping of data is performed by: associating a column in the grid to a table data field; associating a mapping icon with the column; and associating the table identifier with the column. The transporting of data between the applications include: identifying a transport function; identifying at least one of the mapping; and transporting data according to the selected mapping and the selected transport function.

The invention relates to a management method of a multifile copy of a distributed file system. A copy management mechanism based on a frequency is adopted, the state of a file copy is changed according to the read-write access frequency of the file and the information trend of an access resource, and the position transference is increased/reduced and stored through the trend of the quantity of the file copy. The management method includes copy grading management, copy creating policy, copy selection and orientation, and a copy consistency maintenance method. The creating method of the file copy includes the creating initiated by the user and the creating initiated by a crunodes, and adopts a data gridding method and a policy based on the benefit drive. The orientation of the copy maps a logic file on an appropriate copy, and a copy with minimum cost and highest access efficiency is selected to be provided to the user for using. The invention has the advantages that the provided service carries on the excellent characteristics of the distributed file system, which includes loose coupling, high usability, high reliability and high cost performance.

A method (and system) for using information contained within the scanned image to create, in an automated (or semi-automated) process, an accurate data grid. The process has steps: enhance the image; locate blocks of spots; and find each individual spot in each of the blocks. Preferably, the method makes use of image filtering using a“Principal Frequency Filter” based on a mathematical determination of major periodic elements in the image to eliminate noisy, non-periodic signals, and of smoothed intensity profiles of the filtered image data. Here, the term Principal Frequency Filter is used to indicate an image-enhancing filter based upon a mathematical operation which identifies the major periodic components of the image.

Techniques are described for scaling an in-memory data grid to satisfy the needs of client applications requesting data from the in-memory data grid. The in-memory data grid may monitor a variety of factors, such as data traffic or number of received queries from a particular geographical region, to determine whether to create a proximity grid. A proximity grid is an extension of the in-memory data grid that services queries originating from a defined geographic region. Each proximity grid stores data objects relevant to the proximity grid's assigned geographic region. Queries originating from the client applications within the geographic regions are then routed to the corresponding proximity grid for execution. The proximity grid may be terminated when the need of the client applications within the geographic region has subsided.

A distributed transaction security method for a memory data grid includes the steps that first, a service node is selected when a client sends a transaction request, and the memory data grid selects a corresponding service node for the transaction for the first time; second, the transaction request is created, and a transaction context and transaction ID (identification) are saved with the service node as a transaction coordinator and information of a client's source address, thread ID and the like as identification, so that the transaction is started; then comes data manipulation belonging to the first stage of a two-phase commit protocol of the memory data grid, and transaction commit or rollback belonging to the second stage of the two-phase commit protocol of the memory data grid succeeds. The distributed transaction security method for the memory data grid employs a plurality of transaction coordinators, and thus, bottleneck due to a single node is avoided, remote call of a third-party transaction manager is no need, additional communication costs are avoided, and costs of transaction coordination and maintenance of transaction state are reduced in the meantime.

A system and method to generate an improved layout of a data grid in a database environment is provided. The data grid is a clustered in-memory database cache comprising one or more data fabrics, where each data fabric includes multiple in-memory database cache nodes. A data grid advisor capability can be used by application developers and database administrators to evaluate and design the data grid layout so as to optimize performance based on resource constraints and the needs of particular database applications.

A distributed spatial data query optimization method in a grid computing environment is applicable to the grid computing environment and comprises the following steps: (1) analyzing user queries to form a spatial join operation diagram of two or more spatial data grid services; (2) generating an estimation cost matrix of a spatial join operation which possibly exist among the spatial data grid services according to the spatial join operation diagram; (3) adopting a progressive query optimization method to update the estimation cost matrix orderly, and selecting a more preferable spatial join operation according to a formation rule of a spatial join operation balance tree and the estimation cost matrix; and (4) for the better spatial join operation selected in the step (3), generating a better spatial join operation execution proposal according to an executable parallel strategy of a spatial join computing grid resource situation and spatial subdivision. The method can adapt to the characteristics of dynamic change of the grid computing environment and rich computing resources, and can generate a better query execution proposal based on the characteristics, thus improving the efficiency of executing the distributed spatial data query in the grid environment.

The invention discloses a taxi cruising action analytical method based on global position system (GPS) data grid statistic in the field of traffic action research. Spatial distribution characteristics of cruising points are analyzed based on taxi traveling track GPS data identification cruising points to generate passenger carrying points and background information points representing factors such as land, population and road networks of the previous day, grid analysis technique is adopted to convert spatial point data into point frequency data based on grids, a zero-inflated negative binomial model (ZINB) is constructed to analyze historical passenger carrying point information, background information and influences of spatial autocorrelation of the cruising points on taxi cruising point choice action, and cruising strategies of a taxi are summarized. The taxi cruising action analytical method brings convenience to further taxi traffic behavior simulation and provides an effective way for optimizing taxi cruising action and solving problems of road resource waste, fuel consumption and environmental pollution caused by cruising.

The invention discloses a method used for the document reading/writing operation of multi-copy data grid system, which belongs to the operational field of high speed document writing. The invention is characterized in that the following steps are sequentially included: the user puts forward a writing document request to the copy access client terminal; after the identity is successfully authenticated by a metadata server, a server distance comparison module selects a copy storage server that is nearest to the user in logic distance, and selects the corresponding copy view information, and after confirmed by a view analytical module of the copy access client side as effectiveness, a reading and writing execution module of the copy access client sends data writing request to the copy storage server; after the copy storage server successfully executes writing operation, a copy view updating module of the metadata updates the copy view. The invention leads the user to select the nearest copy storage server to execute writing operation, meanwhile, the normal reading operation of the user is guaranteed.

The invention relates to an optimized transcript distributing method in a data grid, belonging to the field of grid computation, and concretely relates to a grid system, in particular to a transcript distributing method in the data grid system. The invention provides a distributed dynamic self-adaptive transcript distributing method in the data grid, aiming at reducing the access cost of the resource request party, and comprising the following steps of: calculating the transcript amount through the response time of resources; and determining proper transcript place via comprehensive consideration of factors of load factor, node performance, real-time bandwidth, and the like so that the transcript distribution can be dynamically suitable for variation of access request and the network communication state. Compared with the existing method for simply requiring transcript amount to improve the data access performance, the invention evaluates the transcript amount and the optimum transcript place from the overall situation of the system, thereby effectively balancing the relationship between the transcript amount and the transcript maintenance cost. The method is not only suitable for data grid systems of read-only resources and particularly suitable for data grid systems with read-write data resources.

A system and related method for dynamic data modeling for use in a real-time computerized presentation system includes a presentation engine having a visual interface. Computerized numerical models are each importable into the presentation engine. Each includes a data grid having data cells arranged by columns and rows, where numerical data values are stored within the data cells. At least one data input field controls a manipulation of a first numerical data value in a first data cell using a mathematical function applied to a second numerical data value in a second data cell. A numerical model display, displayable on the visual interface, is based on the first numerical data value and is changed in real-time based on the manipulation of the first numerical data value. A numerical model summary, displayable on the visual interface, combines numerical data from the computerized models imported into the presentation engine.

A method for autonomic data partition placement in an in-memory data grid (IMDG) based on usage sampling is provided. The method may include sampling access pattern data, during a configurable window, of a client accessing one or more data objects in the IMDG. Analytics are applied to the sampled access pattern data to determine a replacement partition schema, based on the analyzed sampled access pattern data exceeding at least one performance threshold. The deployed partition schema is altered, based on the replacement partition schema.

Push replication techniques are described for use in an in-memory data grid. When applications on a cluster perform insert, update or delete operations in the cache, a push replication provider asynchronously pushes updates from the source cluster to one or more remote destination clusters. The push replication provider includes a pluggable internal transport to send the updates to the destination cluster. This pluggable transport can be switched to employ a different communication service or protocol. A publishing transformer can chain multiple filters and apply filters on a stream of updates from source cluster to the destination cluster. A batch publisher can be used to receive batches multiple updates and replicate those batch to the destination cluster. XML based configuration can be provided to configure the push replication techniques on a cluster. A number of cluster topologies can be utilized, including active/passive, active/active, multi-site active/passive, multi-site active/active and centralized replication arrangement.

This invention relates to a failure recovery system and method of real-time streaming data processing based on a memory data grid. The system comprises a scheduler, a status server, a task queue and a task operation center. Since records and status information are separately stored, the status information stored in a snapshot is reduced; the delay of data processing is reduced, and simultaneously the snapshot mechanism is easier; the snapshot persistence of micro-batch is achieved by a data window; and the semantic guarantee of "just one time" is ensured through a storage structure of double-buffer; the network delay is reduced to some extent without using a third-party cluster to manage the data.

The invention provides a multi-source data grid fault identification method, and relates to the field of dispatching automation of electric power systems. When an electric system is dispatched, the advantage that diagnosis is conducted by only depending on protecting action information is not beneficial for the judgment and immediate processing of an accident. The multi-source data grid fault identification method includes the following steps of setting up a parameter, collecting grid operation information in real time, sorting out grid fault reports when receiving action information of a relay protection device, organizing action reports according to a protection device when a real fault signal is detected, taking the time scale of the earliest received protection action as the zero-time of the action report, if other protection action signals belong to the same device and the time gap between the action time and the zero-time is less than a threshold value, arranging the protection action signals to be in the same action report, if received scattered wave records belong to the same device and the time gap is less than the threshold value, arranging the received scattered wave records to be in the same report. According to the technical scheme, after a fault occurs in the electrical system, the real grid fault can be quickly and accurately identified, and a clear grid fault report can be organized.

A query explain plan is described for use with a distributed data system in order to help developers and IT experts to detect bottlenecks and to determine which queries are to blame for a slow running system. In accordance with an embodiment, the distributed data grid utilizes a facility to provide a distributed explain plan. This distributed explain plan provides visibility into how a query was answered by each node in the cluster. For example, one node may have applied the filters of the query in one sequence, while another node may have used a different sequence. Additionally, the distributed query explain plan can provide execution tracing, rendering information about the execution time of each step, total execution time and the like.

The invention discloses an intelligent grid prediction correcting method and system. The intelligent grid prediction correcting method includes the steps that meteorological data is imported; a map layer is loaded and displayed in a display area; a display time point is selected, and the meteorological data corresponding to the display time point is distributed into a grid shape to form a data grid layer; the data grid layer overlays the display area and is aligned with the map layer; according to the loaded meteorological data, isolines are generated and combined into an isoline layer; the isoline layer overlays the display area and is aligned with the map layer; a space correction point in the display area is clicked to form a correcting instruction, and according to the correcting instruction, the space correction point and the corresponding meteorological data in a peripheral extensive correction range are increased or decreased on the basis of a preset weight corresponding to space distribution; the corrected meteorological data is exported. The method and system have the advantages that correction of the meteorological data is more convenient and faster, correction of meteorology is more precise, and operation is smooth.

A method, system and computer program product for managing a batch processing job is presented. The method includes partitioning a batch processing job for execution by a cluster of computers. One of the computers from the cluster of computers is designated as a primary command server that oversees and coordinates execution of the batch processing job. Stored in an object data grid structure in the primary command server is an alarm setpoint, boundaries, waiting batch processes and executing batch process states. The object data grid structure is replicated and stored as a replicated object grid structure in a failover command server. If the primary command server fails, the failover command server freezes all of the currently executing batch processes, interrogates processing states of the cluster of computers, and restarts execution of the batch processes in the cluster of computers in accordance with the processing states of the cluster of computers.

Systems and methods for non-disruptive cache startup, shutdown, data partition movement, and node rebalancing for a data fabric within a data grid in a database environment. The data grid is a clustered in-memory database (IMDB) cache comprising one or more data fabrics including multiple IMDB cache nodes. The method takes a time tag and moves data from source to destination nodes while allowing updates to data on the source nodes. The method propagates updates occurring after the time tag to destination nodes from source nodes and switches applications and ownership to the destination nodes. Another method slices data for a partitioned fabric and stores slices on nodes. Another method starts a data fabric by moving data from a grid backend to the nodes. In an embodiment, another method rebalances nodes in a non-disruptive manner. When a fabric is shutdown, the method saves data from the nodes to the grid backend.

A method for three-dimensional display of a two-dimensional earthquake profile is disclosed. The method includes reading earthquake profile data from a disc and converting the earthquake profile data into a coding format used by the system. The method further includes vertex input layout establishment including earthquake data vertex input layout establishment and rendering and texture vertex input layout establishment, palette texture establishing and sampling, inclined texture establishing, i.e. rendering object while rendering texture, establishing earthquake data texture for storing earthquake data, creating effect files including creating a rendering to texture effect file and a rendering output effect file, rendering to texture, rendering numeralized earthquake sampling points to texture in an inclined way and creating a grid, and creating, rendering and outputting the earthquake data grid. Earthquake data are sent to a GPU through a floating point texture means, and accurate coloring of earthquake data vertexes and accurate pixel interpolation between vertexes are realized. A pallet is created in an index progressive way, the display contrast of an earthquake profile is improved, and three-dimensional display of a two-dimensional earthquake profile is realized.

The invention discloses a full distributed copy positioning method used for a data network, wherein, judgment is made at first whether a user command is copy establishment, copy search or copy deletion, and then corresponding operations are respectively performed according to the following steps; judgment is made whether to end after the operations are finished; if continuous operation is required, the user command is accepted after return; if continuous operation is not required, the whole flow is ended; if the user command is copy establishment, physical mapping is registered through a copy catalog manager which is then registered into a local copy manager index; if the user command is copy search, a copy positioning request of a user is received and a mapping table is inquired, and then a physical address set corresponding to a logical file name is returned; if the user command is copy deletion, copy cancel on a routing list is finished through search of the local copy catalog manager index and the copy catalog manager corresponding to a copy. Compared with the prior copy positioning method, the method is characterized in adaptability, support of a copy positioning request of a multiple application domain data network, expansibility, high availability, high security and so on.

The invention discloses a mobile terminal location data caching and real-time updating system and a mobile terminal location data caching and real-time updating method. A server real-time location service saves and manages the latest location data of all mobile terminals by taking a grid container as a unit; a client caches terminal location data obtained from a background server also by taking the grid container as the unit, and attaches the latest updating timestamps to each grid container respectively; and the client transmits a request to a location server to acquire terminal location updating data in each grid in a currently displayed boundary to realize the incremental updating of the terminal location data cached by the client by taking the grid as the unit. By the terminal-location-data-grid-based management and incremental updating technology, the real-time updating of mobile terminal locations in the display range of a map is ensured, data traffic between the client and the location server is effectively reduced, and the needs of a plurality of client users in the simultaneous online browsing of a plurality of mobile terminals are satisfied.

The invention discloses a refrigerator van temperature field actually-measured data visualization processing method and system. The method comprises the steps of firstly, collecting temperature parameters of each layer of layout of various kinds of cargo packaging in different multi-layer stacking modes, obtaining a temperature contour line graphic set of each layer of cargos according to the obtained temperature parameters, and finally, determining the stacking scheme of the next cargo packaging according to the temperature contour line graphic set of each layer of cargos. According to the refrigerator van temperature field actually-measured data visualization processing method and system, the map counter line method is utilized for drawing counter lines, the situation of temperature field changes caused by different stacking modes can be seen clearly, and the data visualization can be achieved; the cargos are stacked in a layering mode no matter what method is adopted, the three-dimensional problem is converted into a two-dimensional problem, and the three-dimensional characteristics are not lost. Due to the fact that the discrete data meshing and the interpolation algorithm are adopted, the estimated temperature value of a non-sampling area can be obtained and basically conform to the practical situation. Actually-measured data are stored by the adoption of the layering thought, the logic stored in a database is more clear, and historical data are conveniently filed, retrieved and used.

The invention relates to a gridding data transcription generation method based on storage alliance subset partition, in particular to a gridding data transcription creating and distributing method on a gridding node and according to the gridding user data access behavioral characteristics; the basic thought of the method is that the data gridding node is divided into a plurality of subsets which have good network transmission speed, by utilizing the characteristic that network delay is less in each subset, the transcription creating number is reduced, so as to reduce the gridding system storage expense; meanwhile, caching strategy is utilized, the transcription can be rapidly generated in each gridding node subset; finally, the optimal client strategy is utilized, the position of the data transcription in the gridding node subset is regulated, so as to form a good data transcription layout.