139 results about "In-memory database" patented technology

The invention discloses a real-time interaction and intelligent management method for a multi-dimensional data space, and relates to the technical field of data interaction management, and the method comprises the following steps: I, collecting multi-source data, including structured data, unstructured data and spatio-temporal data, in real time through a diversified collection terminal, and dynamically adjusting the sampling frequency based on a data entropy value, carrying out cross-device space-time synchronization calibration and edge end lightweight processing on the acquired data; iI, preprocessing the data flow in real time, fusing the multi-modal data, and the like. According to the method, the sampling frequency is dynamically adjusted based on the data entropy value, and in combination with edge end lightweight processing, invalid data transmission is reduced, and the key data acquisition efficiency is improved; hot data is stored in a time sequence database and a memory database, real-time monitoring of an emergency scene and second-level response of emergency command are supported, dynamic capacity expansion and shrinkage of computing resources are matched, edge-cloud end collaboratively distributes tasks, network delay is reduced, and system stability and response speed in a high-concurrency scene are guaranteed.

The invention provides a final consistency processing system and method for transaction messages. The method comprises the following steps: acquiring transaction state metadata and a service message body about a transaction message in a distributed system, storing the service message body into a distributed message queue, and storing the transaction state metadata into a memory database; constructing a transaction state index structure; determining a physical offset based on the business message body, creating a transaction state record in the memory database based on the physical offset, and generating a to-be-rechecked transaction task according to the transaction state record; based on the transaction creation time and the system load factor, determining a rechecking interval, and executing the to-be-rechecked transaction task; when it is detected that the transaction state is changed into a transaction confirmation state from a to-be-confirmed state, pulling a service message body according to the physical offset; and performing double confirmation on the pulled service message body. The problems of performance bottleneck and low recovery efficiency caused by strong coupling of the transaction state and the message body are solved.

The invention relates to the field of financial science and technology, and particularly discloses a cross-platform financial data integration and real-time analysis system and method. The system is characterized in that a distributed heterogeneous data acquisition module accesses multi-source data in parallel through a pluggable protocol adapter; the streaming data cleaning engine realizes field-level normalization based on a dynamic template and semantic mapping; the hybrid storage architecture forms a three-level system by a memory database, a time sequence database and distributed file storage; the stream processing core engine adopts an elastic sliding window to execute CEP complex event processing; and the dynamic analysis decision module integrates online machine learning to generate a real-time transaction signal. The method comprises the steps of multi-source concurrent acquisition and microsecond-level timestamp injection, context sensing data standardization, dual-channel data storage, event time window aggregation, dynamic risk calculation and block chain audit evidence storage. The defects of low data fusion efficiency, high real-time analysis delay and the like in the prior art are overcome, and cross-platform data processing timeliness and decision accuracy are remarkably improved.

The invention relates to the field of data processing, and discloses a cloud computing-based data processing method, which comprises the following steps of: constructing a reference count management micro-service cluster at a cloud end, receiving a reference count request carrying a count type through an API (Application Program Interface) gateway, and analyzing the reference count request into a structured operation instruction; reading a first state identifier of the referenced object and a second state identifier of the reference object from the distributed cache system according to the metadata snapshot; according to the method, through dynamic scheduling of a reference counting management micro-service cluster and a container arrangement engine, efficient allocation and scheduling of computing resources can be realized, maximization of resource utilization is ensured, resource waste is avoided, and high-speed query capability of a distributed cache system and a memory database is utilized; the state identification of the object can be retrieved at a millisecond level, the system response speed is improved, and the performance requirement under a high-concurrency scene is met.

The invention discloses a hand-eye cooperative robot control system and method based on dynamic operator arrangement, an upper computer planning layer operates a master control computer to periodically trigger task scheduling, a joint controller of a lower computer execution layer receives an instruction through a redundant bus to perform servo control, hand-eye camera data triggers a visual assembly line through an interrupt event, and a visual assembly line is controlled through a control interface. According to the method, pressure is calculated through visual processing, motion planning and joint control in a load sharing mode, a double-buffering mechanism is adopted to enable current frame visual processing and previous frame motion control to be executed in an overlapping mode, real-time scheduling and parallel computing of tasks are completed, hot data are cached in a memory database, cold data are archived to an HDFS and migrated through an LRU strategy, and the real-time scheduling and parallel computing of the tasks are completed. Data type conversion is automatically derived and performed based on a feature type registry, and conditional branch execution is triggered according to real-time sensor data. According to the control system, cross-hardware plug and play, algorithm flow configurability and data flow real-time sharing are achieved, and the requirement for improving the efficiency of complex operation tasks is met.

The invention provides a multi-task multi-satellite telemetry data efficient processing method and system and electronic equipment, and relates to the technical field of satellite ground telemetry data processing. Comprising the following steps: dynamically allocating a task plug-in to an optimal computing node based on a resource state evaluation result of each computing node in a server cluster; uploading task registration information to a configuration center, and storing telemetering parameter configuration information contained in the information in a memory database in a key-value pair form; according to the distributed task plug-in, task telemetering data is led from a specified information source, and step-by-step subdivision is carried out on the data based on a data shunt model; and extracting a telemetering source packet based on the obtained telemetering data flow of each frequency band, and distributing a telemetering source packet analysis task through a thread pool. And on the basis of the telemetering parameter configuration information, utilizing the parameter resolving virtual thread to resolve all parameters in the source packet in parallel. The defect that high-code-rate telemetry data cannot be efficiently processed in real time in a multi-task and multi-satellite scene is overcome.

The invention discloses a database system construction method and system based on new energy centralized control, and the method comprises the steps: employing a MySQL / PostgreSQL cluster to construct a historical library, constructing a real-time library through Redis, and achieving the cooperation of historical data storage and real-time data processing; the method comprises the following steps of: dividing data according to applications, and defining a multi-table structure; (2) realizing data hierarchical organization by adopting a multi-level name domain; a historical library and real-time library conversion service is configured, and single-table / multi-table data import is supported; an I / IV region security partition architecture is established, and data security interaction is realized through a bidirectional isolation synchronization mechanism; according to the system, through collaborative design of a relational database and a memory database, mass data storage and real-time response requirements are considered, a structured alias domain is adopted to realize accurate data management, and the requirements of a new energy centralized control system on data processing efficiency and security are met.

The invention provides a ticket query method and device, equipment, a storage medium and a program product, and relates to the technical field of ticket query. The method comprises the following steps: based on a ticket query request, determining query parameters corresponding to a query task; based on the memory database and the query parameters, determining a query quantity corresponding to the query task; wherein the memory database stores telephone traffic key value pairs which are counted based on identification information, service categories and account periods of users; based on the query quantity, determining the number N of query threads, and distributing the query task to the N query threads; querying from a distributed database based on the N query threads, and obtaining a detailed list query result of each query thread; and based on the ticket query request, summarizing the detailed ticket query results of the N query threads through a summarizing thread to obtain a ticket query result corresponding to the ticket query request. According to the invention, the response speed of ticket query can be effectively improved.

The application discloses a hot ticket card blacklist generation method and device and a medium, relates to the technical field of computers, and comprises the following steps: determining a quantity threshold of a hot ticket card blacklist; sorting each initial ticket card according to the time attribute of each initial ticket card to obtain a first sorting result, and screening a first candidate ticket card from the first sorting result; if the first ticket card quantity of the first candidate ticket card is not less than the quantity threshold, determining a target ticket card from the first candidate ticket card according to a priority rule; if the first ticket card quantity is less than the quantity threshold, sorting each initial ticket card according to the balance information in each initial ticket card to obtain a second sorting result, and screening a second candidate ticket card from the second sorting result; screening the target ticket card from the first candidate ticket card and the second candidate ticket card, and taking the target ticket card as the hot ticket card blacklist. The application can accurately obtain a hot ticket card blacklist with higher activity, and can reduce the memory resource demand on the memory database of a gate.

The application relates to the technical field of flexible direct current power transmission, and particularly provides a lightweight real-time memory database transaction concurrent control method and device, which comprises the following steps: S101. Classifying to-be-processed transactions through cluster analysis to determine the cluster to which the to-be-processed transactions belong; S102. Obtaining a transaction lock corresponding to the to-be-processed transaction in the cluster to which the to-be-processed transaction belongs and a data lock called by the to-be-processed transaction, and executing S103 under the condition that the acquisition state is successful; S103. Conflict verification is performed on the to-be-processed transaction, if there is a conflict, the to-be-processed transaction is prevented, otherwise, the to-be-processed transaction is executed. The technical scheme provided by the application meets the demand of high-efficiency access of Internet of Things data and improves the transaction execution performance of the real-time memory database.

In an example embodiment, a data warehousing environment, or a similar architecture, is extended to permit data storage in either an in-memory database or a Lakehouse architecture, which leverages one or more hyperscalers for the underlying storage. More specifically, a single artifact is defined in Datasphere that stores data in either the in-memory database or the Lakehouse architecture, and does so in a storage-agnostic manner.

This invention discloses a method and system for accurate electricity consumption data supplementation, relating to the field of electricity consumption data acquisition technology. It includes: the master station dynamically initializes and records the missing curve data information for each electricity meter based on a memory database; when accurate supplementation is triggered, using a single acquisition terminal as the smallest unit, it extracts only the missing data point information from the memory database to generate the missing data point sequence for each electricity meter; through an extended communication protocol for accurate supplementation, it generates an accurate supplementation notification instruction carrying only the missing data point information and sends it to the acquisition terminal; the acquisition terminal extracts the missing data point sequence, retrieves only the missing data corresponding to the missing data point sequence from its local cache, and reports it in batches to the master station; after receiving the missing data, the master station compares and verifies it based on locally maintained missing data status information; after successful verification, it completes the supplementation and updates the missing data marker. This invention effectively improves the efficiency of electricity consumption data supplementation and reduces the resource consumption across the entire link.

The invention discloses an abnormity monitoring method, system, equipment and medium based on a plant station gateway metering point, and relates to the technical field of gateway metering point abnormity detection, and the method comprises the steps: collecting the real-time data of the plant station gateway metering point through an industrial protocol interface, loading a protocol stack in a collection gateway, carrying out the preprocessing of the preliminarily collected data, and carrying out the detection of the abnormity of the gateway metering point; data transmission is carried out on the preprocessed data through a real-time stream processing layer by utilizing a transmission protocol, the real-time data is stored in a memory database, historical data is stored in a distributed file system, data organization and management are carried out, and multi-mode anomaly detection is carried out on the stored data through an anomaly detection service deployed in a containerization mode. And identifying various abnormities, packaging and outputting a detection result, and dynamically rendering through a responsive front-end interface to display the detection result in real time. According to the invention, the multi-mode intelligent detection and containerized elastic architecture are fused, so that the leap-type improvement of the metering abnormity of the plant station from passive alarm to active early warning and deep diagnosis is realized.

A computer-implemented method for regulating delivery frequency of outbound communications. The method includes receiving message context data comprising one or more of a user identifier, a client identifier, a campaign identifier, a channel identifier, a label identifier, and a trigger identifier. A counter-field identifier is determined that encodes the channel identifier, label identifier, trigger identifier, campaign identifier, and a temporal-interval indicator. A counter field identified by the counter-field identifier is created. A value stored in the counter field is incremented through an atomic operation. The value is compared with a limit stored in a rule set. An allow signal is output when the value does not exceed the limit and a suppress signal is output when the value exceeds the limit. An engagement-counter record is updated to the in-memory database.

The invention discloses a real-time processing method, system and equipment for high-frequency time sequence data and a storage medium, and relates to the technical field of data processing in the steel industry, and the method comprises the steps: collecting the high-frequency time sequence data of equipment in a steel production process, and uploading the high-frequency time sequence data to a target data bus; based on a trigger signal, sequentially acquiring the high-frequency time sequence data from the target data bus; preprocessing the obtained high-frequency time sequence data to obtain a standard data stream; configuring a calculation process based on a zero code editor, and calculating the standard data stream through the calculation process to obtain calculation result data; respectively storing the calculation result data into a memory database and a disk time sequence database according to a time dimension; and outputting the calculation result data through an application program interface.

An electric vehicle charging and discharging operation regulation platform, comprising: a data collection cluster, which is configured to receive and parse collected data sent by an external system, wherein the external system comprises multiple terminals, an Internet-of-Vehicles platform and a power grid dispatching platform; a data processing cluster, which is configured to perform processing analysis and periodic sampling storage on real-time remote signaling / telemetering data; a data storage cluster, which has a distributed memory database constructed therein, and is configured to implement the large-capacity storage of historical data and high-concurrency access to the historical data; and a micro-service cluster, which is configured to implement, on the basis of data stored in the data storage cluster, a service application micro-service and a platform micro-service by means of a micro-service architecture.

The present application relates to data processing technology for the financial field, and discloses a data extraction method, comprising: data encoding of business vector data according to the data format of the business vector data, obtaining a plurality of encoded data and storing into an in-memory database, request type analysis of a data extraction request, obtaining a type analysis result, calling a synchronous connector to connect a sender and the in-memory database when the type analysis result meets a first preset condition, calling an asynchronous connector to connect the sender and the in-memory database when the type analysis result meets a second preset condition, data decoding of the extracted data according to the memory return value of the in-memory database when the reference connector is connected with the in-memory database, and obtaining standard extraction data. The present application also provides a data extraction device, an electronic device and a storage medium. The present application can improve the efficiency of data extraction in the financial field such as insurance transactions.

The invention relates to the technical field of data driving, and particularly provides a hierarchical data driving method, system and device for digital twin archives and a medium, and the method comprises the steps: dividing physical entity data into three processing levels according to real-time requirements, the first level being the highest in real-time performance, and the third level being the lowest in real-time performance; establishing a parallel and resource-isolated data processing pipeline for each level; first-level data is directly written into a memory database, and a digital twin engine actively queries through a high-frequency timer to drive a virtual model to realize millisecond-level synchronization; performing state aggregation on the second-level data through stream calculation, and pushing the second-level data to an engine to realize second-level state updating; and persistently storing the third-level data in various databases, and accessing the third-level data by an engine when receiving a query request to realize post analysis and backtracking. According to the method, the hierarchical parallel processing assembly line is established, so that accurate optimization of data driving is realized.

The invention discloses a bidirectional replication consistency checking and repairing method based on a record source identifier, particularly relates to the technical field of data consistency of a distributed memory database, and is used for solving the problem that a bidirectional replication cluster is difficult to accurately identify a record source, missing and conflicts in a non-stop scene, so that the reliability of the bidirectional replication cluster is improved. Therefore, the problems of difficulty in consistency verification, high possibility of false difference and repeated modification are solved. A deletion mark, a lock mark and a source mark are coded in a record control area in a centralized manner, a primary key field and a source pseudo column are used as anchor points, and an idempotent identifier constructed based on a primary key and a version field, a fragment comparison process divided according to a verification window and a primary key range and an automatic repair decision oriented to missing records and records with inconsistent fields are combined; therefore, the real difference can still be accurately recognized under the condition of bidirectional replication continuous operation, replication loopback and false inconsistency are avoided, and the consistency of the business data of the memory database clusters on the two sides is kept on the premise that business writing is not stopped.

The application provides a report page loading method, a storage medium and an electronic device thereof. A browser end requests a server end to acquire report page elements and receives the same, and simultaneously caches the same into an in-memory database. When the browser end receives the report page element information, it is judged whether to load the content of the element. If not, the rendering mode of the element is registered into a preset rendering function set, and the content of the element is searched from an in-memory cache queue. According to a preset cache evicting mechanism, the report page element information acquired from the shared memory address is written into the in-memory cache queue. The rendering mode of the corresponding report page element is acquired from the rendering function set, and the content of the element searched from the in-memory database is rendered. The access path of the report page element is optimized, the delay of rendering loading is greatly reduced, and the loading time of the report is shortened.

According to some embodiments, a digital core for a cloud computing environment is associated with an enterprise (e.g., the digital core may comprise enterprise resource planning software optimized for an in-memory database). Moreover, an integration inspector framework may establish a checkpoint between an application system (e.g., a source application system to provide information via the digital core and / or a target application system to receive information via the digital core) and the digital core. The integration inspector framework then automatically validates a communication arrangement associated with the application system and performs a data replication test, in connection with the application system and the digital core, using test data. A result of the data replication test is then evaluated and indicated (e.g., to a user via a user interface).

The application discloses a kind of distributed log's memory database parallel recovery method and system, belong to computer database technical field, the method is: the command log generated in memory database is stored by log partitioning and is physically isolated, and the metadata of each log partition is recorded;Based on pre-received recovery instruction and the metadata, the corresponding recovery plan is generated for each log partition;Parallelly start multiple recovery threads, and based on the recovery plan, the snapshot information pre-acquired in each recovery thread is loaded corresponding log partition, and according to the recovery plan and the snapshot information, the log fragment that needs to be replayed is determined, and the log fragment that needs to be replayed is replayed to corresponding log partition, to carry out parallel recovery to memory database.Therefore, by implementing the present application, the problem that the data recovery reliability of prior art distributed log memory data recovery process is complex and dependent on manual intervention can be solved.

This application discloses a method, apparatus, program product, and electronic device for cross-network segment data transmission, relating to the field of network security technology. The method includes: first, transmitting target request information from a first network segment to a target queue, where the target queue is a message queue deployed in the first network segment; then, determining the return data corresponding to the target request information in the target queue through a second network segment, wherein the return data is data stored in the second network segment and needs to be transmitted to the first network segment; and finally, transmitting the return data to a target database, where the target database is a memory database deployed in the first network segment. This application solves the technical problem of low data transmission security caused by the prior art requiring manual export and copying of data from different network segments with network isolation when transmitting data between them.

The invention discloses a multi-scenario operation method based on a single-node memory database and multi-Agent calculation, and belongs to the field of combat simulation, and the method comprises the following steps: 1, starting a scenario editing tool, operating a multi-scenario editing process, and creating a memory database; secondly, the scenario is edited, and scenario entity information is stored in the memory database; thirdly, storing a multi-scenario file; 4, starting a scenario operation monitoring tool, operating a plurality of scenario operation monitoring processes, and creating a memory database; 5, loading the scenario file, and creating a data blackboard by the memory database based on the scenario file; sixthly, advancing each set of simulation time according to the step length, and managing the data blackboard; seventhly, in the step length period, multi-Agent simulation calculation is executed, and a calculation result is updated to the data blackboard; and 8, judging whether the scenario is ended or not, and if not, turning to the step 6. According to the method, single-node multi-scenario parallel operation is realized by adopting a memory database technology and a multi-Agent technology, and the method has the advantages of simplicity and high efficiency.

The invention belongs to the technical field of data query, and particularly discloses an SQL2API (structured query language 2 application program interface) method in a data table and HTTP (hyper text transport protocol) interface mixed mode based on a large model, which comprises the following steps of: automatically mapping metadata of an HTTP interface into a virtual database table, and constructing to obtain a unified SQL Schema view; utilizing the SQL Schema view to convert a user query demand into a logic operation sequence, and generating a query plan capable of realizing cross-source association; and according to the query plan, executing the query of the SQL database and the calling of the HTTP interface in parallel, integrating the obtained query result and the calling result into a two-dimensional table structure in the temporary memory database, and returning the two-dimensional table structure to the user. According to the method, the HTTP interface metadata is automatically mapped into the virtual database table, and the query plan is generated by using the large model, so that efficient, unified and intelligent query of the database and HTTP interface mixed data source is realized.

The application discloses a version query method and device in a database, equipment, a medium and a product, relates to the technical field of data processing, and comprises the following steps: obtaining a target primary key, a query type and query attribute information of a target query transaction; determining a target version index block matched with the target primary key in a first version index block in a cache and / or a second version index block in a main memory according to the target primary key of the target query transaction; obtaining a version chain head memory pointer matched with the target primary key according to an indirect layer pointer in the target version index block, and obtaining a version prefetch queue matched with the target primary key according to a memory pointer of the version prefetch queue in the target version index block; the version prefetch queue comprises memory pointers of at least one version; and querying a version matched with the target query transaction according to the query type and the query attribute information, the version chain head memory pointer and the version prefetch queue. The application improves the query efficiency of the version in the multi-version memory database.

A distributed caching system for multi-tenant retail environments addresses data isolation, synchronization, and performance challenges across cloud and edge devices. The system employs containerized architecture managed by Kubernetes®, ensuring scalability and efficient resource allocation. It implements robust multi-tenancy support, maintaining data isolation at application programming interface (API), code, memory, database, and caching levels. A schema-agnostic synchronization mechanism facilitates efficient data transfer between cloud and edge environments. The system's memory management optimizes performance across diverse devices, from cloud servers to resource-constrained point-of-sale (POS) terminals. This approach enables seamless scalability, maintains data integrity, and enhances system responsiveness, particularly during high-traffic periods. By solving conventional caching issues, the system improves overall performance, data security, and adaptability in complex retail network topologies.

The application relates to a smart rail transit system multi-device association method, system, device and storage medium, the method comprising the following steps: S1, according to whether a device state is affected, an association quantity and association reference information, type classification is performed on a device association relationship, a metadata template under each type is constructed, and the metadata template is stored in a Key-Value in-memory database; S2, based on the metadata template, a device association relationship static model based on a functional requirement is constructed and data storage is performed; S3, device association relationship data is loaded from the Key-Value in-memory database, a device association relationship dynamic model is constructed, and dynamic attribute association is performed; S4, an observer for listening to a device state change event is created on the device, and the device association relationship is updated in real time according to a listening result. Compared with the prior art, the application has the advantages of high reliability, good real-time performance and high flexibility.

This application provides an accounting method, accounting device, computer-readable storage medium, and transaction system. The method includes: acquiring transaction data to be synchronized; sending the transaction data to be synchronized to a business database, causing the business database to update the corresponding transaction data according to the transaction data to be synchronized; if the memory database does not receive a first deletion instruction within a predetermined time, querying the business database to see if the transaction data corresponding to the transaction data to be synchronized has been updated, wherein the first deletion instruction is an instruction sent by the application server when it receives a successful update message from the business database, and is used to control the memory database to delete the transaction number of the target transaction; if the transaction data corresponding to the transaction data to be synchronized has not been updated in the business database, sending a rollback instruction to the memory database, wherein the rollback instruction is used to restore the transaction data to be synchronized to its state before execution, thereby solving the problem of account overdrafts that are prone to occur when recording transactions for hot accounts in the prior art.

The application provides a concurrent memory database splitting method and relates to the technical field of databases. The ART index is improved to obtain an IART index, and an IARTC algorithm is proposed based on the IART index. The IARTC algorithm uses the IART index as a splitting index to drive database splitting. Meanwhile, a new database splitting concurrent algorithm PIARTC is obtained based on the IARTC algorithm. The PIARTC algorithm controls locking and unlocking of nodes on the IART index through an optimistic lock coupling concurrent strategy to realize concurrent splitting and index updating, so that small locking granularity is maintained in the concurrent execution process. Compared with existing algorithms, the two adaptive indexes proposed by the application have good query performance in single-core and multi-core systems in the case of facing dynamic environments and large-scale data set queries, and still maintain the lightweight characteristics of the original database splitting algorithm.