86 results about "Database caching" patented technology

The invention relates to the technical field of database cache management, in particular to an LSM engine data cache optimization method, which comprises the following steps of: based on cache region data of an LSM storage engine, recording access times of implementation detailed rules, counting distribution density of implementation detailed rules, arranging the data into a priority sequence, and generating an implementation detailed rule access distribution information set. According to the method, accurate mastering of the implementation detailed rule distribution density is achieved by recording the implementation detailed rule access times and distribution positions, the implementation detailed rule distribution density is grouped and sorted into the priority sequence, the cache data reading efficiency is improved, and the cache data reading efficiency is improved by adjusting and optimizing the data storage layout and reducing the high-frequency data retrieval delay. The method has the advantages that the problem of uneven storage allocation is solved, the resource utilization rate is increased, data distribution is optimized through high-frequency implementation rule comparison, new implementation rule matching is dynamically adjusted, the hit rate and the response speed are increased, the system load is reduced, and the storage performance and the resource allocation efficiency are remarkably improved.

The invention provides a work plan and task management system, which belongs to the technical field of work plan tasks and comprises a portal layer, an application program interface gateway layer, a business service layer, a public service layer and a data layer. And the application program interface gateway layer realizes intelligent management of the interface through a self-adaptive division module, wherein the intelligent management comprises dependency analysis, granularity calculation, aggregation optimization and recombination execution. The business service layer focuses on work plans and task management, and realizes collaboration through flexible interface interaction. The public service layer provides basic support for user authentication, log recording, message queue, service registration, configuration management and the like. And the data layer adopts a diversified storage strategy, integrates a relational database, a cache database, a time sequence database and distributed file storage, and meets data processing requirements of different scenes. The problem that in the prior art, interface definition and calling relations between micro-services are difficult to manage in a self-adaptive mode is solved.

According to the database cache management method and system based on deep learning provided by the invention, the situation of cache miss is effectively reduced by predicting and loading data which is possibly accessed in the future into the cache in advance. In the model training process, various characteristics of data are fully considered, such as time characteristics, historical access frequency characteristics and relevance characteristics between tables, so that the prediction accuracy is improved. An improved long short-term memory (LSTM) network is adopted, and associated information between database tables is introduced, so that the prediction of a data access mode is more accurate, and the cache hit rate and the system response speed are remarkably improved. Through intelligent analysis and efficient prediction, resource utilization is optimized, access delay is reduced, the overall system performance is improved, and a more intelligent cache management strategy is provided for a complex and changeable database access mode.

The invention discloses a database access parameter real-time cooperative processing method and device based on multi-level cache, and belongs to the technical field of computer data caching. The method comprises the steps that a version number management table is configured; establishing a four-level cache architecture of a transaction-level cache layer, a process-level cache layer, a distributed cache layer and a database cache layer; receiving a transaction request, creating a transaction level cache layer and loading current version number information; comparing the version number in the transaction level cache layer with the version number in the process level cache layer; according to the version number comparison result, obtaining parameter data from the corresponding cache level according to a preset cache access priority strategy; and when the parameter change is detected, updating the corresponding version number in the version number management table, and updating the cache layer data as required. According to the method, real-time global effectiveness of parameter change is realized, parameter consistency of in-transit transaction is guaranteed, system processing performance and throughput are improved, system reliability and fault-tolerant capability are enhanced, and system resource utilization rate is optimized.

The embodiment of the invention provides a rendering data processing method and related equipment / products, and belongs to the field of data processing. The rendering data processing method comprises the steps of obtaining rendering duration of a component corresponding to each page; wherein the components are rendered through rendering data loaded from a preset front-end database or a back-end database, and the rendering data of partial components corresponding to partial pages are cached in the front-end database; determining a target rendering duration according to the plurality of rendering durations; uploading the target rendering duration to a rear end, so that the rear end updates a configuration rule for the front-end database according to the target rendering duration and returns the configuration rule; and executing a corresponding target operation on the front-end database according to the configuration rule. According to the embodiment of the invention, the rendering data in the front-end database is inserted, deleted or updated according to the target rendering duration of the component corresponding to each page, so that the possibility of overload of the front-end database is reduced, the page loading speed is further improved, and the situation of page loading failure is reduced.

The invention provides a configuration information distribution method and system, electronic equipment and a storage medium. The configuration information distribution method comprises the steps that first configuration information is determined, and the first configuration information comprises at least one information identifier; the at least one target database is processed according to subscription information and the first configuration information, a processed database is obtained, the subscription information comprises at least one preset corresponding relation, and the preset corresponding relation is the corresponding relation between the information identifier and the target database; based on starting of a business service client, the configuration information in the processing database is controlled to be cached by a local database of the business service client, and the business service client corresponds to the target database. According to the invention, the configuration center distributes different changed configuration messages to different target databases according to the corresponding relationship, and then the business service reads the configuration information in the corresponding target database, so that the configuration information can be updated in time.

The invention provides a data reconciliation method and device and electronic equipment, and the method comprises the steps: responding to the obtained data provided by database cache equipment, constructing a local Merkle tree, and generating a local signature; pulling the target signature from the database cache device based on the trigger condition, and comparing the target signature with a local signature; in response to inconsistency between the target signature and the local signature, performing hash value comparison on the local Merkle tree and the target Merkle tree, and positioning a difference state; and pulling the difference data matched with the difference state from the database cache device, updating the local data and the local Merkle tree based on the difference data, and updating the local signature. According to the method, the data difference can be rapidly detected through signature comparison, a large amount of redundant calculation is avoided, the difference part can be accurately and rapidly positioned through comparison of the Merkle tree structure, data restoration is carried out, and the verification efficiency is ensured.

The invention discloses an Excel file exporting method and system based on Java language, and relates to the technical field of computer software development, and the implementation of the method comprises the following steps: receiving an exporting request: the system receives the exporting request of a user through a Web interface or a graphical interface; analyzing template configuration: loading and analyzing an Excel export template specified by a user by a system; data binding and style rendering: the system binds a data set obtained from a database, a cache or other data sources with a template, and performs style rendering according to template configuration; an Excel file is generated, specifically, according to the export format selected by the user, the system calls an Apache POI library to create a Workbook object, and rendered data is written into a worksheet; and returning or storing the file. According to the method, the format and the content of the Excel file can be exported in a self-defined mode according to the configuration information of the user, the development efficiency is improved, and the expandability of the system is enhanced.

The invention discloses an image transmission system for visual communication display, and relates to the technical field of data management.The image transmission system collects and manages multi-dimensional information data of all credit enterprises through a data management unit, and a behavior analysis unit analyzes behaviors of authorized users; the data management unit generates a reading strategy of each dimension, and the enterprise portrait unit generates portrait analysis of each credit enterprise based on different dimensions. In the process of comparing and generating the reading strategy of each dimension, a plurality of character data are intercepted from the dimension data table corresponding to the dimension with relatively high click frequency and relatively large data capacity; according to the method, the high-frequency access data is stored in the independent table to generate the derivative data table of the corresponding dimension, in this way, the database cache can be more effectively utilized, and more common data can be ensured to be reserved in the cache by separating the high-frequency data, so that the performance is improved, the contention for a large table can be reduced, and the possibility of lock contention is reduced.

Techniques are disclosed relating to improving the efficiency of geolocation queries via geospatial cells and query parameter caching. In various embodiments, a system receives a request from a user device to access geolocation information of entities and determine a first geographic location of the device. The system identifies that the first location is within a geospatial cell stored in a database cache and determines whether query parameters corresponding to the cell are stored in the cache. The system may retrieve the cached query parameters corresponding to the geospatial cell and execute a geolocation query on a database storing location information for different entities based on the cached query parameters. Results of the geolocation query may be different from query results of one or more other queries executed, based on the cached query parameters, for other user computing devices located within the given geospatial cell based on the cached query parameters.

The application discloses a data query method and device, electronic equipment and storage medium, and relates to the technical field of databases. The method comprises the following steps: receiving a query request from a platform, determining the data type requested by the query request; determining a query strategy in a data storage library according to the data type; wherein the data storage library comprises a local database, a cache database and an Elasticsearch database; and querying in the data storage library according to the query strategy, and obtaining target statistical data. Through the three-layer storage structure, massive statistical data is finely divided, and is stored in a scattered and summarized manner. In the query process, massive search in a database is not required, and the data query efficiency is improved.

The invention relates to the technical field of visual management, in particular to a dynamic visual management method and system for electronic equipment assets, and the system comprises a supporting layer, a data layer, an application layer and a display layer which are connected in sequence. The support layer comprises a management platform database, a cache service module, a message service module, a registration center module and a configuration center module; the data layer comprises an equipment library business data module, a report data module, an interface data module and a user data module; the application layer comprises an equipment life cycle management module, a decision support report module, an alarm management module and a basic function module. According to the invention, dynamic visual management of electronic equipment assets can be well realized.

A database management system generates a cache entry system view of a database cache. Also, a new column is generated for the cache entry system view, where the new column is an ENTRY_HASH column to identify each entry of the database cache. In an example, the database management system detects a request to remove a given entry of the database cache, where the request includes a given ENTRY_HASH value to locate the given entry of the database cache. In response to receiving the request, the database management system identifies the given entry of the database cache based on the given ENTRY_HASH value. Then, the database management system removes the given entry of the database cache. Also, the database management system notifies a cache manager that the given entry has been removed.

Techniques for caching data in a database system include one or more non-transitory computer-readable media storing program instructions that, when executed, perform the method of receiving a request to access a database, determining a caching priority specified in the request, processing the request to generate query results, and after generating the query results, caching or not caching data from which the query results are generated based on the determined caching priority.

The invention relates to the technical field of database management, in particular to a database caching algorithm, device and equipment based on real-time load and a medium. In the application, when the object in the database is accessed, after the cache mode of the corresponding object is determined, whether the access condition in the corresponding cache mode is met is judged, and when the access condition in the corresponding cache mode is met, the data cached in the corresponding cache mode is directly accessed, so that the direct access to the hot object is greatly reduced, and the access efficiency is improved. The problem of lock conflict of hot object access under large concurrent services is solved, and database performance is improved.

The present invention relates to a method for improving the batch processing execution efficiency of spring-batch framework, which is based on file thread database cache interface, creates thread sharding file, then loads and writes the number of paging entries, splits a single large file or a large result set into small files or small result sets according to rules for subsequent processing; developers use business reader interface to write query / read logic according to business needs, loads pending data, and transfers pending data to processor layer; uses file cache entity interface to configure single cache number, reads corresponding row data from thread sharding file at one time, converts it into row data entity, and writes it into redis cache; uses file reading interface to configure basic information of reading file; creates spring-batch framework public class through Reader interface of springframework. Compared with the prior art, the present invention has the advantages of greatly improving batch execution efficiency, reducing business risks of large data volume and high data timeliness, etc.

The invention relates to the technical field of reports, in particular to a data caching method and device, computer equipment and a readable storage medium. The method comprises the steps of obtaining to-be-cached data; determining a matching result between the to-be-cached data and a plurality of data caching layers corresponding to a local report system; wherein the plurality of data cache layers at least comprise a temporary cache layer, a key field cache layer, a database cache layer and a global shared cache layer; selecting a target cache layer corresponding to the to-be-cached data from a plurality of data cache layers according to each matching result; and storing the to-be-cached data in the target cache layer according to the cache strategy corresponding to the target cache layer.

The invention belongs to the technical field of information application, and particularly discloses a file management method and device based on Redis, and the method comprises the steps that a file is published, a subsystem uploads the file and stores the file in a Redis database in a slicing mode, and file information is published to a channel; message subscription and index maintenance: receiving file information by a sub-system subscription channel, and updating a local file index table; and file asking and checking: asking the file blocks by the subsystem according to the file index table, and integrating and checking the file integrity. A publishing and subscribing mechanism of the Redis database serves as a core, service nodes do not need to be newly added, use of resources is reduced, the method is a lightweight file management mode, file consistency of subsystems under a distributed architecture is guaranteed, file blocks are cached through the Redis database, a plurality of systems are allowed to acquire and upload a plurality of files at the same time, and the file management efficiency is improved. The file transmission efficiency is guaranteed, and the file exclusive problem is solved.

The present invention provides a database cache strategy adjustment method, device, and equipment, which can be applied to the fields of database management technology and data cache strategy optimization technology. The database cache strategy adjustment method includes: based on the data access information of the database system in the historical time period, predicting the data access situation of the database system in the target time period, and obtaining the data access information of the target time period; based on the data access information of the target time period, the data access information of the historical time period, and the system load information of the historical time period, generating the environment state vector of the target time period; inputting the environment state vector into the reinforcement learning model, outputting the cache strategy adjustment information of the target time period; and adjusting the cache strategy of the database cache space based on the cache strategy adjustment information of the target time period.

The application discloses a database cache query method and device, equipment and storage medium, belongs to computer technical field, the technical scheme is: the received query request is parsed, according to the analysis result, the ID identification of each data set to be queried is determined, and the corresponding query condition of each data set is determined according to the query request;The ID identification of data set is matched with the ID identification of data set saved in the cache queue one by one;If the matching degree of the ID identification of data set meets the preset condition, the record mapping information corresponding to the data set ID identification saved in the cache queue is read from the database, the data record mapped by the record mapping information is read, and the data record meeting the corresponding query condition of the current data set is matched from the data record, as the query result and return;Solve the technical problem of improving the hit rate of cache and reducing the query pressure of underlying database under the condition of limited cache space.

The embodiment of the invention provides a method and system for customizing a configuration table, and the method comprises the steps: determining a table identifier of a target table requested to be displayed and a user identifier of a target user initiating the table display request according to a table display request; according to the table identifier and the user identifier, determining table data of a target table cached in a local database and user-defined attribute information of a target user on the target table, and determining code attribute information of the target table in codes; the table data is rendered and displayed through the custom attribute information and the coding attribute information, a table configuration component is rendered in the display page, and the table configuration component is a custom component for displaying the displayed table by the user. The invention aims to improve the working efficiency and user experience of a user.

Techniques are disclosed relating to implementing a cache layer for a distributed database system. In some embodiments, a distributed computing system that includes a plurality of physical nodes implementing a hosting service deploys, to a first of the plurality of physical nodes, a container that implements a cache for a distributed database system hosted by the hosting service. The container is executable to store the cache in a memory internal to the first physical node. The container receives, from the database system, a data request for data maintained in a persistent storage external to the first physical node. In response to determining that the requested data resides in the cache, the container services the data request from the internal memory of the first physical node.

A service server according to an embodiment may comprise: a communication circuit; a memory storing instructions; and at least one processor, wherein the instructions, when executed by the at least one processor, cause the service server to: identify a data request received from a client terminal through the communication circuit; in response to the data request, request data, cached from a database, from a primary cache including multiple cache clusters in which the data is distributed and stored; on the basis of identifying that the requested data does not exist in the primary cache, request the data from a secondary cache including at least one cache cluster; and on the basis of identifying that the requested data does not exist in the secondary cache, request the data from the database.

The invention provides a data storage method and device based on multi-level cache and intelligent distribution and a medium, and belongs to the technical field of data storage. The data storage method comprises the following steps: constructing a multi-stage cache architecture between a data acquisition end and a persistent storage end of Internet of Things data, wherein the multi-stage cache architecture at least comprises a local memory cache, a distributed cache and a database cache; according to the service priority, the change frequency and the storage cost of the Internet of Things data, dynamically routing the Internet of Things data to a corresponding cache level in a multi-level cache architecture through an intelligent distribution engine; performing data aggregation processing on the Internet of Things data, executing a timing batch writing strategy, and writing the Internet of Things data into a persistent storage end; and by adopting a data fragmentation and read-write separation strategy, dispersing and storing the data to a plurality of database instances or nodes of a persistent storage end so as to realize load balancing. According to the method and the device, the persistence of the mass sensing data with fidelity, load reduction and long period can be realized.

The invention relates to a management method for efficiently realizing cache based on an LRU flash memory database, which comprises the following steps of: (1) classifying LRU linked lists according to dry and dirty attributes and cold and hot attributes of cache pages, and classifying the corresponding cache pages into the corresponding LRU linked lists according to access times and whether modification is performed or not; and (2) judging whether the page to be accessed currently is in the cache or not, and executing cache processing of the corresponding attribute linked list according to a judgment result. The invention also relates to a corresponding device, a processor and a computer readable storage medium. By the adoption of the management method and device for efficiently achieving cache based on the LRU flash memory database, the processor and the computer readable storage medium, a four-linked-table management mode is designed, a high cache access hit rate can be obtained while write operation is not increased, and the cache access efficiency is improved. The invention provides an efficient cache management method for a flash database, which is applicable to most scenes.

The invention relates to an aircraft component test report analysis system based on an anomaly inference model, and relates to the technical field of component testing, and the aircraft component test report analysis system comprises a data analysis module which is configured with a file format analysis strategy to perform file format feature extraction on a test file, carrying out aircraft part test information analysis on the test file by matching a corresponding analysis step in the format analysis database so as to generate a test report; the file caching module is configured with a multi-stage data caching strategy, reads, writes and pre-caches the test file through a pre-constructed memory, file and database caching architecture, and keeps the data read-write efficiency and the system response speed within a preset good threshold range; and the exception analysis module is configured with an exception report identification model and is used for identifying and analyzing the test report through similar fault identification logic and a fault analysis engine so as to determine exception test information in the test report. The method has the effect of improving the analysis efficiency and accuracy of the test report of the aircraft component.

The application relates to a browser cache device and method for high-precision real-scene three-dimensional layered data, which comprises a server-side preprocessing module and a browser-side cache management module, and communication connection is established between the server-side preprocessing module and the browser-side cache management module through specific data flow and control flow. The two-step process of first searching a secondary local database cache unit and then searching the server-side preprocessing module is a key step for improving the loading speed of high-precision real-scene three-dimensional data; the browser cache strategy is further provided with steps of on-demand loading, predictive preloading and incremental updating mechanism. The application can realize the technical effects of significantly improving the loading speed, greatly reducing the resource occupation, fundamentally improving the user experience and good practicability by organically combining the server-side data layered cutting and the two-level cache architecture designed for the layered data on the browser side.

The embodiment of the invention discloses a method, a system and equipment for improving data access performance and a storage medium, which effectively alleviates the performance bottleneck problem of MDS in a distributed file system by optimizing the file reading and writing processes of an application layer and a client, improves the overall performance and expandability of the system, and improves the data access performance. In the file writing operation, after the file is written successfully, the application layer needs to store inode information of the file into a database cache; in the file reading operation, the application layer transmits the cached file inode information to the file system client, the file system client does not communicate with the MDS to obtain the file inode information any more, the load of the MDS is effectively reduced, the response time is shorter, under the condition that IO requests are dense, the client request delay can be reduced, the service failure caused by accumulation of a large number of services is avoided, and the user experience is improved. The stability is improved, meanwhile, the service requirement for high response time requirement degree can be met, the number of arranged MDS servers is reduced, and hardware investment and maintenance cost are reduced.

The invention provides a test method and system based on flow control. The method comprises the following steps: S1, a user access system performs UserldHash calculation; s2, designing a flow monitoring system which is used for monitoring the distribution condition of flow in real time and recording a test result; s3, establishing a test environment, and ensuring that deployment and operation environments of all test versions or functions are consistent, including a database, a cache and a network; s4, designing a set of data analysis and result display system for performing data analysis and result display on the test result; through the design and optimization of a flow control algorithm, the test flow is ensured to be reasonably distributed to different test versions, and the accuracy and reliability of data acquisition and analysis are improved, so that accurate comparison of data of different versions and establishment and optimization of a stability guarantee mechanism are supported, the system can stably and reliably operate under flow control, and the test efficiency is improved. And the user experience is considered and optimized, so that the adverse effect of flow control on the user experience is reduced.

The invention discloses an intelligent monitoring system and method for power operation life-saving measures based on the Internet of Things. The system comprises a user terminal layer, a communication layer, a service logic layer and a data layer. The user terminal layer is used for completing a user interaction function and a data display function; a communication layer, namely an isolation forwarding layer, is responsible for routing, load balancing, authentication and authorization of forwarding requests; the back-end service layer is used for ensuring that a request reaches a back-end service, interacting with the back-end service layer, receiving and processing the request, calling a back-end service interface data format for conversion and adaptation, and recording and monitoring load balancing authentication between the routing request and the service; the business logic layer comprises a plurality of actual business functions, and data of the functions are mutually communicated; and the data layer is used for storing and querying service data, and is responsible for accessing the relational database and the redis cache database and transferring the data to programs of other layers for calling. The safety is improved, unsafe behaviors are found and corrected in time, and the accident risk is reduced.