35 results about "Database caching" patented technology

The invention discloses a database access parameter real-time cooperative processing method and device based on multi-level cache, and belongs to the technical field of computer data caching. The method comprises the steps that a version number management table is configured; establishing a four-level cache architecture of a transaction-level cache layer, a process-level cache layer, a distributed cache layer and a database cache layer; receiving a transaction request, creating a transaction level cache layer and loading current version number information; comparing the version number in the transaction level cache layer with the version number in the process level cache layer; according to the version number comparison result, obtaining parameter data from the corresponding cache level according to a preset cache access priority strategy; and when the parameter change is detected, updating the corresponding version number in the version number management table, and updating the cache layer data as required. According to the method, real-time global effectiveness of parameter change is realized, parameter consistency of in-transit transaction is guaranteed, system processing performance and throughput are improved, system reliability and fault-tolerant capability are enhanced, and system resource utilization rate is optimized.

The invention discloses an image transmission system for visual communication display, and relates to the technical field of data management.The image transmission system collects and manages multi-dimensional information data of all credit enterprises through a data management unit, and a behavior analysis unit analyzes behaviors of authorized users; the data management unit generates a reading strategy of each dimension, and the enterprise portrait unit generates portrait analysis of each credit enterprise based on different dimensions. In the process of comparing and generating the reading strategy of each dimension, a plurality of character data are intercepted from the dimension data table corresponding to the dimension with relatively high click frequency and relatively large data capacity; according to the method, the high-frequency access data is stored in the independent table to generate the derivative data table of the corresponding dimension, in this way, the database cache can be more effectively utilized, and more common data can be ensured to be reserved in the cache by separating the high-frequency data, so that the performance is improved, the contention for a large table can be reduced, and the possibility of lock contention is reduced.

The application discloses a data query method and device, electronic equipment and storage medium, and relates to the technical field of databases. The method comprises the following steps: receiving a query request from a platform, determining the data type requested by the query request; determining a query strategy in a data storage library according to the data type; wherein the data storage library comprises a local database, a cache database and an Elasticsearch database; and querying in the data storage library according to the query strategy, and obtaining target statistical data. Through the three-layer storage structure, massive statistical data is finely divided, and is stored in a scattered and summarized manner. In the query process, massive search in a database is not required, and the data query efficiency is improved.

A database management system generates a cache entry system view of a database cache. Also, a new column is generated for the cache entry system view, where the new column is an ENTRY_HASH column to identify each entry of the database cache. In an example, the database management system detects a request to remove a given entry of the database cache, where the request includes a given ENTRY_HASH value to locate the given entry of the database cache. In response to receiving the request, the database management system identifies the given entry of the database cache based on the given ENTRY_HASH value. Then, the database management system removes the given entry of the database cache. Also, the database management system notifies a cache manager that the given entry has been removed.

Techniques for caching data in a database system include one or more non-transitory computer-readable media storing program instructions that, when executed, perform the method of receiving a request to access a database, determining a caching priority specified in the request, processing the request to generate query results, and after generating the query results, caching or not caching data from which the query results are generated based on the determined caching priority.

The application discloses a database cache query method and device, equipment and storage medium, belongs to computer technical field, the technical scheme is: the received query request is parsed, according to the analysis result, the ID identification of each data set to be queried is determined, and the corresponding query condition of each data set is determined according to the query request;The ID identification of data set is matched with the ID identification of data set saved in the cache queue one by one;If the matching degree of the ID identification of data set meets the preset condition, the record mapping information corresponding to the data set ID identification saved in the cache queue is read from the database, the data record mapped by the record mapping information is read, and the data record meeting the corresponding query condition of the current data set is matched from the data record, as the query result and return;Solve the technical problem of improving the hit rate of cache and reducing the query pressure of underlying database under the condition of limited cache space.

The invention provides a data storage method and device based on multi-level cache and intelligent distribution and a medium, and belongs to the technical field of data storage. The data storage method comprises the following steps: constructing a multi-stage cache architecture between a data acquisition end and a persistent storage end of Internet of Things data, wherein the multi-stage cache architecture at least comprises a local memory cache, a distributed cache and a database cache; according to the service priority, the change frequency and the storage cost of the Internet of Things data, dynamically routing the Internet of Things data to a corresponding cache level in a multi-level cache architecture through an intelligent distribution engine; performing data aggregation processing on the Internet of Things data, executing a timing batch writing strategy, and writing the Internet of Things data into a persistent storage end; and by adopting a data fragmentation and read-write separation strategy, dispersing and storing the data to a plurality of database instances or nodes of a persistent storage end so as to realize load balancing. According to the method and the device, the persistence of the mass sensing data with fidelity, load reduction and long period can be realized.

The invention relates to an aircraft component test report analysis system based on an anomaly inference model, and relates to the technical field of component testing, and the aircraft component test report analysis system comprises a data analysis module which is configured with a file format analysis strategy to perform file format feature extraction on a test file, carrying out aircraft part test information analysis on the test file by matching a corresponding analysis step in the format analysis database so as to generate a test report; the file caching module is configured with a multi-stage data caching strategy, reads, writes and pre-caches the test file through a pre-constructed memory, file and database caching architecture, and keeps the data read-write efficiency and the system response speed within a preset good threshold range; and the exception analysis module is configured with an exception report identification model and is used for identifying and analyzing the test report through similar fault identification logic and a fault analysis engine so as to determine exception test information in the test report. The method has the effect of improving the analysis efficiency and accuracy of the test report of the aircraft component.

The application relates to a browser cache device and method for high-precision real-scene three-dimensional layered data, which comprises a server-side preprocessing module and a browser-side cache management module, and communication connection is established between the server-side preprocessing module and the browser-side cache management module through specific data flow and control flow. The two-step process of first searching a secondary local database cache unit and then searching the server-side preprocessing module is a key step for improving the loading speed of high-precision real-scene three-dimensional data; the browser cache strategy is further provided with steps of on-demand loading, predictive preloading and incremental updating mechanism. The application can realize the technical effects of significantly improving the loading speed, greatly reducing the resource occupation, fundamentally improving the user experience and good practicability by organically combining the server-side data layered cutting and the two-level cache architecture designed for the layered data on the browser side.

The invention discloses an intelligent monitoring system and method for power operation life-saving measures based on the Internet of Things. The system comprises a user terminal layer, a communication layer, a service logic layer and a data layer. The user terminal layer is used for completing a user interaction function and a data display function; a communication layer, namely an isolation forwarding layer, is responsible for routing, load balancing, authentication and authorization of forwarding requests; the back-end service layer is used for ensuring that a request reaches a back-end service, interacting with the back-end service layer, receiving and processing the request, calling a back-end service interface data format for conversion and adaptation, and recording and monitoring load balancing authentication between the routing request and the service; the business logic layer comprises a plurality of actual business functions, and data of the functions are mutually communicated; and the data layer is used for storing and querying service data, and is responsible for accessing the relational database and the redis cache database and transferring the data to programs of other layers for calling. The safety is improved, unsafe behaviors are found and corrected in time, and the accident risk is reduced.

The invention discloses a campus teacher-student intelligent agent development and service platform, and the platform comprises an access layer which is used for accessing the platform through a plurality of terminal devices, and supporting an MQTT protocol and an HTTP protocol for communication; the interface layer is used for providing a standardized API interface and realizing front and rear end separation and data exchange service layer, is realized based on a. NET6 micro-service architecture, and comprises an agent management module, an API gateway and a data aggregation module; the data layer is used for storing and managing business data, statistical data and log data; the storage layer comprises a relational database, a cache system and a file storage and is used for persisting business data and course data; the platform integrates campus multi-system data through a middle platform architecture, and supports low-code agent development, containerized deployment and real-time service collaboration. Different using requirements of teachers and students can be better met.

The invention discloses a car purchase subsidy system based on WeChat and Alipay applets, and belongs to the field of car purchase subsidy digital management, the system comprises front-end and back-end technical architecture and core function modules: a front-end applet end supports double-platform operation based on a unit-app, and a Web management end adopts Vue.js 2.6. 11 and an Element UI to construct a responsive interface; and the rear end comprises a RESTful API constructed by the Think PHP 5.1, a MySQL master-slave database, a Redis cache, a JWT authentication component, an OSS file storage and a block chain evidence storage service. In a core module, an application module realizes intelligent form filling through GAN image enhancement and ticket checking (the recognition rate is greater than or equal to 95%), a data management module uniformly stores and generates a report, a statistical analysis module supports trend analysis and time sequence prediction, a multi-platform synchronization module guarantees data consistency through message queue and edge calculation, and a machine learning risk control model is integrated. The system realizes whole-process online, improves risk control and decision-making capabilities, adapts to high-concurrency weak network scenes, and ensures stable operation.

The invention relates to a hanging system service processing method and device and a storage medium, and the method comprises the steps: configuring an asynchronous thread and a cache database; the cache database is used for storing clothes hanger data written by the service main thread after outbound card reading, and the service main thread synchronously triggers issuing of a clothes hanger outbound instruction while writing the clothes hanger data; acquiring a plurality of clothes hanger data from the cache database by using an asynchronous thread, and temporarily storing the clothes hanger data in an asynchronous thread queue; when the number of the clothes hanger data in the asynchronous thread queue exceeds a preset number threshold value or the time from the completion of the last yield calculation task reaches a preset time threshold value, triggering the yield calculation task by using an asynchronous thread, and calculating yield data; and pushing the yield data to the preset terminal board for real-time display by utilizing the asynchronous thread, and through the method and the device, the problem that rapid outbound and real-time data statistics cannot be taken into account in related technologies is solved.

This invention relates to the field of financial trading simulation training technology, and discloses a trading simulation training system based on random historical candlestick charts. The system includes a cloud computing power filtering unit, a local database caching unit, a candlestick chart random extraction unit, and a trading simulation interaction unit. The cloud computing power filtering unit is used to clean and classify the raw historical candlestick chart data. This trading simulation training system based on random historical candlestick charts combines cloud computing power filtering with local database caching, separating candlestick chart data processing from rapid retrieval. This effectively reduces latency and traffic consumption caused by frequent network requests, significantly improving system response speed and operational stability. The local cache supports offline use, eliminating network environment limitations and adapting to more usage scenarios. The overall architecture optimizes computing power allocation, reducing resource waste and allowing the system to operate efficiently with low network overhead, providing users with a smooth and stable candlestick chart trading simulation training experience.

The invention provides a database cache breakdown protection method and system. The method comprises the following steps: acquiring an access request sent to a database by a user; judging whether the access request hits data in the memory space cache or not, and if yes, directly returning the hit data in the memory space cache to the user; otherwise, hard disk space cache is allocated, and the database returns data corresponding to the access request to the user through the hard disk space cache; according to the method, the memory and the hard disk space are dynamically and cooperatively allocated, and the cache allocation rate of the hard disk is automatically adjusted according to the real-time memory utilization rate, so that the sharp increase of database pressure caused by cache breakdown in a high-concurrency scene is effectively avoided, the data access speed is remarkably improved, and meanwhile, the overall stability and the resource utilization efficiency of the system are guaranteed.

Embodiments of the present application provide a wide table generation method, device and equipment and a storage medium. The method comprises: obtaining a database access record table and a database cache table which are the same as a database object; the database access record table comprises executed database statement information; the database cache table comprises inter-table association relationship records; parsing the executed database statement information to obtain a statement segment included in the executed database statement information and an information type of the statement segment; when the information type is a first preset type, determining a target database cache table in which the inter-table association relationship exists from the database cache table according to the statement segment; and updating the inter-table association relationship records according to the target database cache table to obtain a wide table. Embodiments of the present application can solve the problem that the wide table generated by the existing wide table generation method is repetitive, causing waste of database storage resources.

The invention provides a method and system for safely playing materials, a storage medium and a product, and the method comprises the steps: obtaining perfect target video information according to a target video playing template corresponding to a business scene identifier and a material identifier in response to a playing target material signature request; generating a playing signature according to the client identifier and the like, and caching the perfect target video information and the playing signature to a database; returning a playing signature; in response to the play link request carrying the play signature, verifying the play signature; if the verification is passed, target video information corresponding to the playing signature is acquired from the database, and a playing link request is assembled, transmitted and sent; receiving a playing link request, and generating a playing link according to the video playing related parameters; and returning the playing link. According to the method, the playing signature is generated, the playing link is requested, the video information is cached according to the database, and the playing link is generated, so that the playing link is not requested through an original chain any more, and the safety of the original chain is ensured.

The application discloses a kind of power distribution network topological model checking method and system in graph database, the method first stores the original power distribution network topological model data in relational database and graph database as snapshot in server E file, recovers topological model data to in-memory database by snapshot recovery, obtains relational database topological model and graph database topological model;Then by model analysis, compare the quantity of the relational database topological model, original graph model and the target graph model, check the absence or redundancy of the target graph model, complete power distribution network topological model checking in graph database;The application adopts embedded in-memory database cache topological model, realizes the fast checking of power distribution network topological relationship model and graph database model data;E file snapshot and recovery method is used, the speed of topological model checking is improved, so that power distribution network topological analysis result has stronger credibility.

The embodiment of the invention discloses a data processing method, device and equipment, and the method comprises the steps: obtaining a settlement request for a target commercial tenant, and the settlement request comprises the identification of the target commercial tenant; in response to the settlement request, remotely calling a database cache, and querying whether settlement preferential information of the target merchant exists in the database cache based on the identifier of the target merchant through the database cache; under the condition that the query of remotely calling the database cache is abnormal, querying whether settlement preferential information of the target merchant exists in a local first cache or not based on the identifier of the target merchant; and if the settlement preferential information of the target merchant does not exist in the local first cache, obtaining the settlement preferential information of the target merchant from a database corresponding to the database cache, and executing settlement processing corresponding to the settlement request based on the obtained settlement preferential information of the target merchant.

To provide an electronic game operating system (OS) based on Linux.SOLUTION: In the electronic game operating system, the display layer displays data and receives data input by a user, and the business logic layer performs business logic processing on the data from the data interface layer; An electronic game service is provided for the presentation layer through the API, the electronic game service includes a game management service, a device management service, a user management service and an application management service, a multi-task scheduling module, a hardware driving and updating module and a software-hardware combination application module are provided, the data interface layer accesses a database and provides a data service for the business logic layer and the presentation layer, and the database caches data provided by the data interface and persistently stores the data in the cache.SELECTED DRAWING: Figure 1

The invention discloses an integrated software test experiment teaching platform and an implementation method. The platform comprises an account management module, a basic teaching module, an experiment operation module, an experiment report module, an interaction module, a defect management module, a micro-service architecture layer and a data support layer. Wherein the experiment operation module comprises an experiment question bank, an operation record and a tool integration sub-module, and can be used for presetting multiple experiment questions, capturing operation logs in real time and integrating an automatic test tool; a duplicate checking engine and an intelligent scoring unit are arranged in the experiment report module, and automatic duplicate checking and scoring of a report are achieved; the micro-service architecture layer adopts a SpringCloud framework, so that high concurrency and expansibility are guaranteed; and the data support layer realizes efficient data management through a relational database, a cache component and an object storage component. According to the platform, a whole-process closed loop of theoretical learning, experimental operation, report management and interactive feedback is realized.

The invention discloses a database data acquisition and management system, and relates to the technical field of data management, a data management unit is used for acquiring and managing multi-dimensional information data of all credit enterprises, and a behavior analysis unit is used for analyzing behaviors of authorized users; the data management unit generates a reading strategy of each dimension, and the enterprise portrait unit generates portrait analysis of each credit enterprise based on different dimensions. In the process of comparing and generating the reading strategy of each dimension, a plurality of character data are intercepted from the dimension data table corresponding to the dimension with relatively high click frequency and relatively large data capacity; according to the method, the high-frequency access data is stored in the independent table to generate the derivative data table of the corresponding dimension, in this way, the database cache can be more effectively utilized, and more common data can be ensured to be reserved in the cache by separating the high-frequency data, so that the performance is improved, the contention for a large table can be reduced, and the possibility of lock contention is reduced.

This invention relates to the field of database cache management technology, specifically to an LSM engine data cache optimization method, comprising the following steps: based on the cache area data of the LSM storage engine, recording the access frequency of implementation rules, statistically analyzing the distribution density of implementation rules, organizing the data into a priority sequence, and generating a set of implementation rule access distribution information. In this invention, by recording the access frequency and distribution location of implementation rules, the distribution density of implementation rules is accurately grasped, and these are grouped and organized into a priority sequence to improve cache data reading efficiency. By adjusting and optimizing the data storage layout, high-frequency data retrieval latency is reduced. Adjusting the cache area location, calculating capacity differences, and repartitioning solves the problem of uneven storage allocation and improves resource utilization. By comparing high-frequency implementation rules to optimize data distribution, dynamically adjusting the matching of new implementation rules, the hit rate and response speed are enhanced, system load is reduced, and storage performance and resource allocation efficiency are significantly improved.

Aspects of the disclosure are directed to late materialization of attributes in response to queries to a database implementing a database cache. Queried data is materialized in temporary memory before the data is projected as part of generating a result to the query. Instead of materializing all of the attributes referenced in a query before executing the query, a database management system materializes attributes as “late” as possible—when the operation needing the attributes is executed. The operation needing the attributes can be performed sooner, as opposed to materializing all referenced attributes are materialized before executing the query.

The embodiment of the present application relates to the technical field of computer data processing, and discloses a kind of processing methods of high concurrency data request, the method comprises: in response to resource subscription request on target activity page;Target activity page is generated in advance according to the activity configuration information in the first cache;Activity configuration information is synchronized from the second cache into the first cache;First cache includes front-end cache;Second cache includes virtual machine cache;Target user identifier and target activity identifier are included in resource subscription request;Target activity data corresponding to target activity identifier is obtained from the first cache;Target activity data is synchronized from the third cache into the first cache;Third cache includes in-memory database cache;According to target activity data and target user identifier, resource subscription request is verified;When resource subscription request is verified, target activity data is updated. Through the above-mentioned mode, the processing efficiency of high concurrency data request is improved.

The invention relates to the technical field of financial science and technology and can be applied to the field of intelligent operation and maintenance, in particular to a database session memory monitoring method, device and equipment and a storage medium. The method comprises the steps that a memory detail monitoring view and a session activity monitoring view are inquired, and a memory detail monitoring result and a session activity monitoring result are obtained respectively; based on the memory detail monitoring result, the session activity monitoring result and the acquired data query moment, determining a memory monitoring record table; and processing the memory monitoring record table based on a statistical time period and a table style to obtain session memory display information. According to the method, the session occupying more memory space in the database cache and the structured query statement occupying more memory space in the session can be known conveniently.

The invention discloses a domain name management method and device, a storage medium and an electronic device, and the method comprises the steps: determining whether a second domain name consistent with a first domain name exists in a domain name service fingerprint database, and the domain name service fingerprint database is used for storing a plurality of third domain names; under the condition that it is determined that the second domain name does not exist in the domain name service fingerprint database, the relative editing distance between a first field of the first domain name and a second field of a fourth domain name is determined according to the editing distance between the first field of the first domain name and the second field of the fourth domain name, the fourth domain name is stored in a cache database, and the cache database is used for storing a plurality of fifth domain names; the plurality of fifth domain names comprise a plurality of third domain names; determining the comprehensive similarity of the first field relative to the second field according to the relative editing distance and a first weight coefficient corresponding to the first field type; and determining whether to manage a plurality of fifth domain names in the cache database according to the comprehensive similarity.

The application relates to the technical field of property charge management big data platforms, and discloses a charge management platform based on associated data integration, wherein a data acquisition layer is configured with three kinds of heterogeneous data acquisition modes, namely, a message subscription mode, an asynchronous active pulling mode and a CDC active monitoring mode, and respectively interacts with a business system or a business storage database of a third-party business system layer; a heterogeneous data storage layer comprises four storage engines, namely, a MySQL relational database, a Redis cache database, an Elasticsearch search engine and a ClickHouse columnar database; a compass core task set carries out data consumption based on the heterogeneous data storage layer, and writes back calculation results to the heterogeneous data storage layer; a data service layer encapsulates a standardized data interface for calling by a display layer; the purpose of realizing low-cost and efficient management and accurate decision support of charge data is achieved through real-time fusion of multi-source heterogeneous data, separation of heterogeneous layered storage and calculation, and AI intelligent charge urging.

The invention provides a disk refreshing method and system for database cache pages, and relates to the technical field of databases. A plurality of cache pages are arranged in a database cache layer, when a first cache page meets a disk refreshing condition, a second cache page is determined in a memory to serve as a data transfer page, access limitation on the first cache page is released immediately after data of the first cache page is synchronized to the second cache page, and disk refreshing operation is executed asynchronously by the second cache page. By adopting a lock replacement mechanism, the lock holding time of the source data page is shortened from a complete disk refreshing process containing disk IO to a data synchronization process only containing memory replication, and the locking time is remarkably shortened. In addition, one-time disk refreshing is carried out after the data of the multiple cache pages are merged and synchronized to the single cache page, and the IO mode of the disk is effectively optimized. According to the method, direct disk writing is replaced by memory data copying, so that the concurrency performance and throughput of a database system are greatly improved while the data consistency is ensured.

A computer-implemented method is provided for crash recovery for linked databases, the linked databases including a source database and an associated target database, where selected portions of the contents of tables in the source database are synchronized with respective portions of the contents of tables in the target database, whereby selected queries for a database management system including the source database are transferred to a database management system including the target database for processing. Additionally, the method includes synchronizing portions of the contents of selected tables in the target database with portions of the contents of selected tables in the source database by reading entries in a recovery log file relating to the source database and applying the read entries to the target database.