73 results about "Page cache" patented technology

The invention discloses a memory management method for dynamically recovering page caches, which comprises the following steps of: monitoring the memory utilization rate of a system, when the memory utilization rate of the system is relatively high, firstly cleaning the page caches corresponding to cold files in a preset time period in the system, and not completely releasing the page caches at one time to influence certain I / O (Input / Output) performance. After the system cleans the page cache corresponding to the cold file and the memory pressure of the system is relieved, the page cache space of the system is dynamically cleaned according to the memory pressure index and the memory saturation of the system, so that the page cache is cleaned in advance before the idle memory is insufficient, and the page cache cleaning efficiency is improved. The page cache cleaning speed is dynamically adjusted, the page cache is slowly and mildly cleaned when the memory demand quantity in the business process is small, and the influence on I / O is reduced; on the contrary, when the business process needs a large amount of memory, the page cache is rapidly and intensely cleaned, and the demand of the business process for the memory is guaranteed.

The embodiment of the invention discloses a front-end page compiling conversion method and device based on AST and a medium, belongs to the technical field of data processing, and solves the problems that existing front-end page conversion efficiency is low, cross-frame adaptation is difficult, and response type layout is insufficient. Comprising the following steps: generating an AST node tree, performing traversal analysis on the AST node tree, and constructing an AST analysis engine; extracting front-end page information in the AST node tree, and constructing information association based on the extracted front-end page information; based on an AST node matching algorithm, a replacement instruction, a conversion event binding grammar and a module conversion scheme, performing target framework grammar conversion on the Vue template grammar; according to node nesting information and node hierarchies in the AST node tree, path optimization is carried out, a response type page structure is generated, and a front-end page is rendered and optimized through on-demand loading, lazy loading and a page caching mechanism; and module packaging is carried out to realize compiling conversion of a front-end page.

The embodiment of the invention provides a page caching method and device, and the method comprises the steps: building a double-cache structure according to a current page stack and a historical page pool, building a five-layer data collection matrix, carrying out the user access behavior capture, obtaining a multi-dimensional access behavior feature, inputting the multi-dimensional feature into a three-level connection integration model, and carrying out the page access probability prediction. A predicted access page list is obtained, and predicted access pages in the predicted access page list are sorted according to the probability from high to low; extracting a complete label of a high-probability access page from a historical page pool, extracting a key resource label of a medium-probability access page from the historical page pool, extracting a cache resource label of a low-probability access page from the historical page pool, determining corresponding pre-loaded page data according to the complete label, the key resource label and the cache resource label, and storing the pre-loaded page data in a database; when the user accesses the preloaded page, page display is performed on the user based on the preloaded page data, and the user experience and the use efficiency of the webpage page can be improved.

The invention relates to the technical field of front-end Web development, and particularly provides a multi-label page component cache management method and system, a terminal and a medium, and the method comprises the steps: setting a cache level mark for each routing node in routing configuration, and generating a unique component identifier by intercepting a routing event; recursively screening target components based on the depth of the cache hierarchy, and constructing a precise cache list; and in response to the change of the global state, directionally updating the field of the influenced component by adopting a difference comparison mechanism. According to the method, efficient management of multi-label page cache is realized, and the memory utilization rate and the page rendering performance are improved.

The invention relates to the technical field of Internet of Things cards, in particular to an Internet of Things card and a method for processing a read / write command and submitting cache data of a multi-page cache system in the Internet of Things card, and the method comprises the following steps: carrying out hash operation on a physical page address to be accessed by a write command to obtain a serial number of a table item of an address hash table; according to the serial number of the table item of the address hash table, the content of the table item of the address hash table is obtained from the address hash table, the content of the table item of the address hash table comprises the physical address of the cache page and the serial number of the table item of the cache mapping table, and whether the physical address of the cache page is consistent with the address of the physical page accessed by the write command or not is compared; if yes, cache mapping table item content is obtained from the cache mapping table according to the serial number of the cache mapping table item, the cache mapping table item content comprises a mapping physical address, a mapping state and cache data, the cache data is updated through data to be written in by the write command, and the mapping state is updated. According to the invention, the operation efficiency of the MCU system can be improved, so that the use experience of a user is improved.

In various embodiments, a method for page cache management is described. The method can include: identifying a storage device fault associated with a fault-resilient storage device; determining that a first region associated with the fault-resilient storage device comprises an inaccessible space and that a second region associated with the fault-resilient storage device comprises an accessible space; identifying a read command at the second storage device for the data and determine, based on the read command, first data requested by a read operation from a local memory of the second storage device; determining, based on the read command, second data requested by the read operation from the second region; retrieving the second data from the second region; and scheduling a transmission of the second data from the fault-resilient storage device to the second storage device.

The invention discloses a distributed file system metadata full-memory management method and system.The distributed file system metadata full-memory management method comprises the steps that distributed file system metadata are stored in a memory and a storage layer through the same layout, and the same layout means that memory pages in the memory and storage blocks in the storage layer are the same in size; and taking the memory page in the memory as a page cache of a corresponding storage block in the storage layer, responding to a read request and a write request of a client through the distributed file system metadata stored in the memory, and directly writing the memory page written by the write request into the storage layer when the write request is received so as to realize persistent storage of the distributed file system metadata. The distributed file system metadata full-memory management method aims at achieving distributed file system metadata full-memory management, read operation completely gets rid of the I / O bottleneck, all storage bandwidths are dedicated to write operation, memory bandwidths are fully utilized for distributed file system metadata management, and persistence overhead is reduced.

The invention relates to the technical field of resource cache management, and discloses a page cache-based page loading method and device, electronic equipment and system.The method comprises the steps that after it is detected that a network agent tool meets a preset operation condition, a network request is intercepted through a capture event monitor of the network agent tool, and the network request is loaded to the electronic equipment; if the network request does not meet the special processing condition, judging whether the network request contains a target resource request, and if so, executing a resource response operation according to a resource loading strategy corresponding to the target resource request contained in the network request to obtain a first resource; otherwise, loading a second resource required by the network request through the network based on a preset network loading instruction; and displaying the target resource obtained by loading on the current page. Therefore, by implementing the method and the device, different resource loading and caching strategies can be adopted for different types of page resources, adaptive page caching is realized, the loading efficiency and stability of the page resources are improved, and the page browsing experience is improved.

The present invention relates to the field of Internet application technology, and specifically discloses a page update data processing method, system and device based on RN and H5, the method comprising: obtaining page update data, the page update data comprising page history access data and page loading data; processing the page history access data to obtain an access frequency index of each page, processing the page loading data to obtain a data generation complexity index of each page, and comprehensively analyzing to obtain a cache demand evaluation value of each page; caching each content module of each page to be cached according to the content update cycle of each content module of each page to be cached. The present invention can improve the overall response speed of the system and the response time of data access by evaluating the page cache demand evaluation value, and can reasonably allocate cache resources according to actual needs to avoid resource waste, thereby helping to improve the competitiveness of the page and achieve sustainable development.

The application discloses a data page recovery method and device, electronic equipment and a storage medium. The data page recovery method comprises the following steps: determining a data page cache of a first data page to which a target waiting event is directed, the target waiting event is a waiting event waiting for a target node in a database cluster to respond, and the target node comprises a fault node and / or an active node; releasing other data page caches in the active node except the data page cache of the first data page; and recovering a data page cache of a second data page according to a first redo log of the second data page, the second data page being a data page taking the active node as a recovery node, and the first redo log being recorded in a first log file in a disk. According to the method, other data page caches except the data page cache of the first data page are released, and then data page recovery is performed according to the first redo log of the second data page, so that the recovery efficiency of the data page in the shared storage database cluster is improved.

Methods for local page writes via pre-staging buffers for resilient buffer pool extensions are performed by computing systems. Compute nodes in database systems insert, update, and query data pages maintained in storage nodes. Data pages cached locally by compute node buffer pools are provided to buffer pool extensions on local disks as pre-copies via staging buffers that store data pages prior to local disk storage. Encryption of data pages occurs at the staging buffers, which allows a less restrictive update latching during the copy process, with page metadata being updated in buffer pool extensions page tables with in-progress states indicating it is not yet written to local disk. When stage buffers are filled, data pages are written to buffer pool extensions and metadata is updated in page tables to indicate available / valid states. Data pages in staging buffers can be read and updated prior to writing to the local disk.

The application provides a NUMA system page cache copy management method and system. The application first generates a read-only copy page in the local memory of an access node through the linkage of target file page cache identification, access subject NUMA node information acquisition and policy copy judgment, thereby avoiding cross-node remote memory access. Then, in combination with local copy priority mapping and page fault triggered by unmapping when process node scheduling is changed, the dynamic adaptation of process scheduling behavior and page mapping relationship is realized. Finally, in the read page fault interrupt process, the page mapping update is completed based on the copy strategy, and the association relationship between the node and the access task is recorded. Without damaging the file page cache semantics, the remote access overhead of the multi-NUMA node system file page cache can be greatly reduced, the problem of continuous remote access caused by process node drift can be solved, and the overall file access performance and running stability in the concurrent scenario can be significantly improved.

This application provides a page buffer circuit and storage device. The page buffer includes: multiple registers and a page buffer; the multiple registers are respectively connected to peripheral interfaces to sequentially receive input data through the peripheral interfaces; the input data is sequentially converted into at least one data segment; the page buffer is connected to the multiple registers to write the current data segment stored in the multiple registers into the page buffer, thereby writing the input data into the page buffer in the manner of converting it into the at least one data segment. The write speed of the page buffer in this page buffer circuit is not limited by the write speed specified by the peripheral interface protocol of the peripheral interface, and the multiple registers can write the stored data into the page buffer as needed, which reduces the performance requirements for the write speed of the page buffer.

The invention relates to a distributed file system, a method thereof and a non-transitory machine readable medium. The plurality of computing devices are communicatively coupled to each other via a network, and each of the plurality of computing devices is operably coupled to one or more of the plurality of storage devices. The plurality of faulty resilient strips are distributed over the plurality of storage devices such that each of the plurality of faulty resilient strips spans the plurality of storage devices. The graphics processing unit is operable to access the data file from the faulty resilient stripe while bypassing the kernel page cache. In addition, these data files may be accessed in parallel by a graphics processing unit.

The present invention discloses a method and device for data management optimization, which includes: initializing the acceleration card storage, host cache page information, the host page cache and the acceleration card page management information according to the page attribute data structure, the capacity of the acceleration card storage and the capacity of the host page cache; receiving and sending an operation instruction to the accelerator, the accelerator processing the data page according to the type of the operation instruction and the page attribute data structure, marking the data page as a dirty page, forming dirty page data, and returning the processing result to the host; and simultaneously returning dirty page modification information corresponding to the operation instruction, caching the dirty page data in the host page cache, and directly reading the dirty page data from the host page cache when the dirty page data is written back, thereby reducing the communication overhead of data interaction and improving the data processing performance and reliability of the database system.

The present disclosure provides a method, apparatus, and device for accessing a file system disk, which is applied to the kernel layer. The method includes: when a VFS module performs a disk data write operation through a first interface, a page cache management module obtains a first buffer block in the storage medium of the hardware layer disk, where the first buffer block is a free block. The page cache management module detects whether the physical address on the first buffer block has completed spatial address mapping; if not, a page cache expansion module is used to allocate a virtual address to it and establish a spatial mapping relationship between the virtual address and the physical address; the first buffer block is converted into a first page cache, and the spatial mapping relationship and virtual address are sent to the VFS module through the page cache expansion module. The VFS module adds the first page cache to an internal data structure and copies the data to the first page cache. This method reduces one data copy, thereby improving the efficiency of the entire transmission process and reducing the consumption of the host-side CPU and RAM.

The application discloses a kind of intelligent cache management methods and devices of page data, the method includes: according to the target page management component of pre-set target management field is generated, and then according to target management field, determine all target management pages of the target management field management;The page state corresponding to each target management page is detected, and page state includes the update state or no update state needing to execute page cache management operation;When detecting that there is update page, according to target management field, according to the modification data corresponding to update page, update page is executed page cache management operation, and the management result corresponding to update page is obtained, and update page is updated according to management result, and update page is the page of the page data of some target management page, and there is data update record and / or page access record.

The embodiment of the invention provides a cache updating method and device for an HTML page and electronic equipment, and relates to the technical field of application development. The method comprises the following steps: in response to display of a first page, determining a page identifier of a first HTML page belonging to the first page as a target page identifier; searching HTML (Hypertext Markup Language) page data corresponding to the target page identifier in the cache pool, and taking the HTML page data as first HTML page data; determining whether the first HTML page data meets a preset updating condition or not; and if the target page identifier meets the target page identifier, obtaining target HTML page data corresponding to the target page identifier from a server side, and updating the first HTML page data in the cache pool into the target HTML page data. By applying the method and the device, the display rate of the HTML page can be improved while the real-time requirement of the HTML page is met.

A plurality of computing devices are communicatively coupled to each other via a network, and each of the plurality of computing devices is operably coupled to one or more of a plurality of storage devices. A plurality of failure resilient stripes is distributed across the plurality of storage devices such that each of the plurality of failure resilient stripes spans a plurality of the storage devices. A graphics processing unit is operable to access data files from the failure resilient stripes, while bypassing a kernel page cache. Furthermore, these data files may be accessed in parallel by the graphics processing unit.

The application provides a file management method of an embedded device, comprising the following steps: based on a page space of a Flash storage space, a plurality of block spaces are pre-configured in a high address space of the Flash storage space according to a storage requirement of a current file, one block space comprises at least one page space, and one block space is used for storing one file; in the block space, a Flash file system is configured based on an end mark, the end mark is used for marking the end of the current file; and the current file is read and written by the Flash file system and a page cache space. The application can configure the Flash file management based on the end mark, provide a lightweight file system function in a very limited Flash space of a wearable embedded device, comprise a page cache space, a file read and write complete function, and meet the needs of an application layer for file reading and writing.

The application provides a page skipping query method and device, a storage medium and a processor, and relates to the technical field of computers. The method comprises the following steps: acquiring a query target page; determining a node where the target page is located based on the query target page, a preset size of data per page and a node size; and querying cache data of a front-end page based on the node where the target page is located to obtain a query result, wherein the cache data of the front-end page is obtained by loading corresponding block data in back-end data to a front-end page cache based on a current query condition, and the cache data of the front-end page comprises a plurality of nodes, and each node is used for storing different block data in the back-end data. Random access can also be realized for experienced pages, and the query rate is improved.

The application provides a Lustre file system write processing method and device, the method comprising: in response to a write data request initiated by an application layer for a target file, detecting whether an accelerated write condition is met; if the detection result is yes, copying to-be-written data to a preset cache area in a kernel state of a Lustre client and returning write success to the application layer, applying a distributed write lock corresponding to a file offset range of the to-be-written data to a metadata service by using a background thread, and after holding the lock, writing the to-be-written data in batches into a page cache; if the detection result is no, writing the to-be-written data into the page cache page by page, including applying a distributed write lock corresponding to a file offset range of the page data to the metadata service by using a background thread, and after holding the lock, writing the page data into the page cache; and persistently storing data in the page cache to an object storage server. Compared with related technologies, the application avoids multiple lock applications and improves data write efficiency.

The application relates to the technical field of hard disks, in particular to a garbage collection method and system of a solid state disk controller based on a network on chip. The method comprises the following steps: selecting a garbage collection target block from a plurality of NAND flash memory blocks, identifying valid pages and reading the valid pages to a flash memory storage controller buffer; keeping valid page cache data and obtaining error analysis results; judging whether the valid pages need error correction according to the error analysis results and determining available target pages in a migration target block; directly writing the buffer valid pages into the available target pages when error correction is not needed, executing error correction by an error correction processing unit and writing the available target pages through network on chip interconnection when error correction is needed; cyclically executing the above steps for each valid page of the target block, and erasing the target block after migration is completed to recover storage space, so that the internal data transmission path of valid page migration is shortened, garbage collection latency is reduced, and the influence on host request processing performance is reduced.

Embodiments of the present application provide a page data caching method and related device, which are used to reduce the loading time of a page and improve user experience. The method of the embodiments of the present application comprises the following steps: when an application program of a client is started, obtaining target cache configuration information from a cache interface of a server corresponding to the application program, the target cache configuration information comprising target page parameter information of a page and target page identifier information matched with the target page parameter information; when a first page is accessed, obtaining first page parameter information of the first page and first page identifier information matched with the first page parameter information; checking whether the first page identifier information is the same as any page identifier information in the target page identifier information and whether the first page identifier information is not saved in the client; and if the first page identifier information is the same as any page identifier information in the target page identifier information and the first page identifier information is not saved in the client, sending a data caching instruction to the cache interface according to the target page parameter information to obtain target page cache information.

The application provides a file granularity data reading method and device, electronic equipment and medium. The method comprises: obtaining a reading request, the reading request being used to indicate reading N data blocks in a file; wherein the file comprises M data blocks, N is less than M, M and N are positive integers; for each data block in the N data blocks, it is judged whether there is a page cache of the data block, if there is, after obtaining a measurement mark of the page cache as an update mark, it is determined that the page cache meets the integrity measurement; wherein the update mark is used to indicate that the page cache passes the integrity measurement; after it is determined that the page caches corresponding to the N data blocks all meet the integrity measurement, a reading result is fed back based on the page cache. The method provided by the application improves the security of file reading and the efficiency of integrity checking during reading, thereby being beneficial to improving user experience.

A system and method for caching in a storage device. In some embodiments, the method includes opening, by a first thread, a first file; reading a first page of data from the first file into a page cache in a host memory of a host; adding a first pointer to a first data structure, the first pointer pointing to the first page of data; opening, by a second thread, a second file; reading a second page of data from the second file into the page cache; and adding a second pointer to the first data structure, the second pointer pointing to the second page of data.

The present invention discloses a method, product, device and storage medium for multi-host shared file systems, relating to the field of computer technologies. It includes configuring a shared memory device as a character device, directly mapping it to the user-mode virtual address space, bypassing the kernel page cache, and directly reading and writing the physical address of the shared memory, fundamentally avoiding multi-host cache conflicts. When formatting, the shared memory is divided into a superblock area, a metadata area, a log area, and a data area, and all hosts uniformly operate through the shared metadata area to avoid single-machine cache interference. When mounting, a hidden metadata file is created to map the non-data area, and the log entries are scanned to reconstruct the directory file structure, enabling all hosts to generate a directory file structure that is exactly the same as the shared memory through log replay, solving the data consistency problem of traditional multi-host file systems caused by cache policies, achieving the effect of multi-host sharing a unified memory view, real-time synchronization of operations, and reducing data access latency.

The invention provides a file write-back method and electronic equipment. The method comprises the steps that according to the sequence that index nodes are added into a first queue, verification operation is executed on the index nodes in the first queue in sequence; the verification operation comprises: determining whether the resident duration of the index node is equal to or greater than an expected resident duration, wherein the expected resident duration is configured according to file information of a file corresponding to the index node; under the condition that the resident duration is equal to or greater than the expected resident duration, writing the file corresponding to the index node back into the hard disk; when the resident duration is smaller than the expected resident duration, the index node is added to the tail of the first queue again, the expected resident duration of the index node is updated, the electronic equipment can control the resident duration of the index node of part of the files in the first queue, and therefore the cache duration of the part of the files in the page cache is prolonged, and the user experience is improved. Therefore, the purpose that the files do not fall into disks or have less disks is achieved, hard disk power consumption is saved, and hard disk service life is prolonged.

The present disclosure relates to a page data acquisition method and apparatus, a communication device, a storage medium, and a program product. The method comprises: receiving a geographic cache pre-request sent by a client, the geographic cache pre-request being used for requesting page cache data of a target page of a target application; in response to the geographic cache pre-request, on the basis of a target query strategy, determining, from geographic cache data, a target cache location matching the location of the client, and target page cache data corresponding to the target cache location, wherein the target query strategy comprises a target query radius, the distance between the target cache location and the location of the client is less than or equal to the target query radius, the geographic cache data comprises a plurality of cache locations and a plurality of pieces of page cache data respectively corresponding to the plurality of cache locations, and the page cache data is real page data of the target page displayed by the client at the corresponding cache locations before the geographic cache pre-request; and returning the target page cache data to the client.

The present application provides a paging cache method and related devices, which relate to the field of software technology, and configure the same cache paging size for multiple interface types under a target data list. Receive a query request for a target data list, the query request contains a query paging size and a query page number corresponding to the target interface type; calculate the cache page number based on the query paging size, the query page number, and the cache paging size; obtain the cache data list corresponding to the cache page number, and determine the first data subscript range corresponding to the cache data list; calculate the second data subscript range using the query paging size and the query page number, obtain the paging data list of the target interface type from the cache data list according to the intersection of the first data subscript range and the second data subscript range, and output the paging data list. The present application can realize that various interfaces share a cache, convert interface requests into cache internal operations, and save storage space to the greatest extent.