270 results about "Data page" patented technology

The invention belongs to the technical field of storage media, and particularly relates to a storage medium abrasion balancing system based on cold and hot data perception, which comprises a cold and hot data perception module used for monitoring the access frequency and the update time of data in real time so as to judge the cold and hot degree of the data, and establishing a heat table, recording a heat value of each data block or data page; and the data feature prediction module is used for predicting features of a future heat change trend and a data volume increase trend of the data by utilizing a machine learning algorithm according to historical data access and update records. According to the method, the hot and cold data sensing module is used for monitoring data access and updating conditions in real time to calculate a hot value, and the storage medium management module is combined to preferentially store hot data into blocks with less erasing times and store cold data into blocks with more erasing times. Therefore, the erasing times of the blocks of the storage medium tend to be balanced, and excessive abrasion of individual blocks is avoided.

The invention discloses a row-level data recovery method and device for a damaged file of a GoldenDB database, and the method comprises the following steps: S1, scanning a to-be-recovered GoldenDB data file, and recognizing and caching all data pages; s2, on the basis of metadata of the data pages, cluster index leaf node pages containing user data are screened out from the cached data pages; s3, for each screened leaf node page, analyzing an internal record organization structure of the leaf node page, and performing row-level data recovery; the row-level data recovery comprises the steps of traversing user records according to a virtual record pointer, and performing cross check and recovery on a traversal path in combination with a page directory slot so as to extract and mark the user records one by one; and S4, outputting all the recovered row-level data.

The embodiment of the invention provides a data migration method, an access processing method, a data migration system and electronic equipment. The data migration method is applied to a switch, the switch communicates with a plurality of memory devices in a memory pool based on an interconnection protocol, and each memory device is provided with a plurality of memory areas. When data migration needs to be carried out on a first memory area in a memory pool, a switch sequentially migrates a plurality of data pages obtained by dividing data in the first memory area into available second memory areas according to pages, and in the migration process, a page bitmap determined for the first memory region is utilized to record migration states of the plurality of data pages. By adopting the scheme, the problem of large-area fault of the server caused by the memory problem can be effectively solved, the page-level granularity is adopted to migrate the data in the first memory region page by page in the migration process, the access of the server to the first memory region is continuously processed in the migration process, and the influence on the performance of the server is reduced.

The invention provides a data synchronization method and device, equipment and a storage medium, and relates to the technical field of data processing, in particular to the technical field of databases, distributed storage technologies and data synchronization. According to the specific implementation scheme, the method comprises the steps that according to the sequence number sequence of a to-be-applied first physical log, log stream continuity verification is conducted on each log record contained in the first physical log in sequence; under the condition that the log stream continuity verification is passed, performing modification chain integrity verification according to a first identifier of the log record and a current version identifier of a target data page to be modified of the log record; wherein the first identifier is used for indicating a second physical log which finally modifies the target data page; and under the condition that the integrity verification of the modification chain is passed, modifying a target data page according to the log record.

A method and associated memory system for randomizing memory storage data. The method and system receive at a data inverter user data and meta data sequence having an inversion seed bit, determine a value for the inversion seed bit from a look up table specifying inversion seeds for different pages of data to be stored in a memory, depending on the value of the inversion seed bit, bit-flip the user data and meta data sequence except for the inversion seed bit; and regardless of bit-flipping, exclusive OR (XOR) the user data and meta data sequence with a random sequence to produce an XORed sequence for storage in the memory as randomized data.

The invention provides a UI automatic test system and method, computer equipment and a storage medium, a manual case structuring module receives a manual case and converts the manual case into structured data in a preset format; the page element obtaining module calls a browser driving engine according to the target URL to obtain full page elements; the AI element matching module is used for scoring full elements of a page through a pre-matching algorithm based on operation types and interface element descriptions in the structured data, screening out first K elements, and carrying out secondary screening through a large model to determine target elements; and the automatic use case execution module generates an automatic test use case according to the target element and the operation data in the structured data, executes the automatic test use case and verifies whether an execution result conforms to expectation or not to realize UI automatic testing. By the adoption of the scheme, the labor cost of UI testing is reduced, the efficiency and adaptability of UI testing are improved, and then the automation level and the large-scale capacity of UI testing are improved.

The invention relates to a data page recovery method and device, equipment, a medium and a product. The method comprises the steps that when it is detected that a current data page is a faulty data page, a corresponding relation associated with a data page identifier is searched for according to the data page identifier of the current data page; reading the address information and the log serial number of the historical version data page from the corresponding relation; and reading the historical version data page according to the address information, and recovering the current data page according to the historical version data page and the log serial number to obtain a target data page. By adopting the method, the recovery efficiency of the data page in a high-concurrency writing scene can be improved.

A memory device includes a memory cell array configured to store data, a page buffer circuit configured to store data in the memory cell array or read data stored in the memory cell array, and a scan register circuit configured to receive a pass / fail result of data from the page buffer circuit and store the pass / fail result in a plurality of scan registers. The scan register circuit obtains information about the scan register where the fail result is stored through a scan operation, and uses the information about the scan register where the fail result is stored to determine the number of fail bits and / or a position index indicating the position of the fail bits according to the operation mode.

The embodiment of the invention provides a core dump file generation method and device, electronic equipment and a medium, and relates to the technical field of data processing.The method comprises the steps that in response to abnormity of a target process, a thread causing the abnormity of the target process is determined as a target thread from threads of the target process; retrieving a virtual memory address from a register occupied by the target thread and a stack memory area of the target thread; determining a target address of a data page which belongs to a heap memory area and has mapping from the retrieved virtual memory address; and generating a core dump file containing the data page mapped by the target address. By applying the scheme provided by the embodiment of the invention, the validity of the core dump file can be improved while the size of the core dump file is reduced.

The invention relates to an exit-entry certificate authenticity identification method and system based on two-dimensional code identification, and a medium. The method comprises the following steps: constructing a cross verification rule base comprising logical relationship information between two-dimensional code information of the entry-exit certificate and signing and issuing information of the entry-exit certificate; acquiring a data page image of an entry-exit certificate to be detected; identifying a two-dimensional code in the preprocessed data page image by using a two-dimensional code identification engine; identifying signing and issuing information in the preprocessed data page image; according to the dynamic two-dimensional code verification library, the dynamic blacklist library and the identified signing and issuing information, uniqueness verification and legality verification are carried out on the identified two-dimensional code information; comparing the corresponding relationship between the identified two-dimensional code information and the identified signing and issuing information according to a cross verification rule base; and judging the authenticity of the entry-exit certificate and generating a report. According to the invention, true and false identification is carried out through three dimensions, the identification accuracy is high, and high-risk false and false situations such as same codes, different certificates and tampering fields can be accurately identified.

Techniques can include: recording, in a log, log entries for write operations writing data pages to logical addresses; and flushing the log entries from the log, wherein flushing includes performing deduplication of the data pages. Flushing can include: partitioning the data pages into i) a first portion of the data pages that are determined to be duplicates of existing data pages, and ii) a second portion of the data pages determined to be unique data pages; atomically incrementing reference counts each corresponding to one of the existing data pages determined as identical to a data page of the first portion; and atomically binding the logical addresses to the data pages, including: binding the first portion of data pages to a corresponding third portion of the logical addresses; and binding the second portion of data pages to a corresponding fourth portion of the logical addresses.

The invention relates to a solid state disk dynamic wear balancing method and system based on data popularity, and the method comprises the steps: tracking the access characteristics of each data page in a solid state disk through a page-level counter, and enabling the access characteristics to comprise the write operation frequency, the modification period and the survival time; the data pages are dynamically divided into high-heat data, medium-heat data or cold data based on a preset threshold value, and corresponding heat layering labels are marked; collecting accumulated writing times and I / O request queue length of each channel of the solid state disk in real time, and calculating wear imbalance degree and load imbalance degree; performing data exchange according to a preset exchange mode priority based on the popularity hierarchical label, the wear imbalance degree and the load imbalance degree; and updating the logic mapping table and the channel state parameters, carrying out statistics on the balance income and the system overhead, and dynamically correcting the tolerance coefficient based on the current load type according to the income-overhead ratio.

Embodiments of the present disclosure provide a data migration method, an access processing method, a data migration system, and an electronic device. The data migration method is applied to a switch, wherein the switch communicates with a plurality of memory devices in a memory pool on the basis of an interconnection protocol, and each memory device has a plurality of memory areas. When data migration needs to be performed on a first memory area in the memory pool, the switch sequentially migrates a plurality of data pages, which are obtained by dividing data in the first memory area according to pages, into an available second memory area, and one page bitmap determined for the first memory area can further be used during migration to record the migration states of the plurality of data pages. By using the present solution, the problem of widespread server failures caused by a memory problem can be effectively solved, page-level granularity is used during migration to migrate the data in the first memory area page by page, enabling continuous processing of server accesses to the first memory area throughout the migration process, thus reducing the performance impact on the server.

The invention relates to a time sequence database query method, system and equipment based on direct calculation of compressed data and a medium. The time sequence database query system comprises a client, a query layer and a storage layer, the client is used for sending an SQL query request input by a user to the query layer and receiving a query result returned by the query layer; the query layer is used for reading a target data block from the storage layer according to an SQL query request, constructing the target data block into a compressed state data memory representation by adopting a delay decompression mechanism and a dynamic auxiliary structure management mechanism, and directly executing homomorphic calculation on the generated compressed state data memory representation by utilizing a homomorphic operator; the obtained query result is returned to the client in an uncompressed format; the storage layer is used for storing compressed data blocks, each compressed data block comprises a plurality of compressed data pages, and each compressed data page comprises compressed time sequence data. The method can be widely applied to the technical field of big data processing.

The invention relates to a database fault recovery method and device, a storage medium and electronic equipment. The method comprises the steps that when a database normally runs, a WAL log is written into a disk, and meanwhile, a log record is pre-analyzed through a background asynchronous thread to extract core semantic information of the log record; constructing a cache structure sorted according to table space identifiers and data page numbers in the shared memory, and storing the core semantic information in the cache structure in a recovery-oriented compact format; when the check point is executed, the memory dirty page is flashed to a disk, and the cache initial position corresponding to the check point in the cache structure serves as metadata to be written into a control file; and after the database crashes and is restarted, acquiring a cache initial position from the control file, loading all core semantic information entries behind the cache initial position in the cache structure according to the cache initial position, positioning a target data page, and modifying the target data page. The technical problem that an existing database collapse recovery technology is low in recovery speed is solved.

Methods, systems, and devices for a parity scheme for read distress protection in a memory system are described. The parity scheme described herein may protect data against read distress errors. A set of consecutive word lines in a memory system may include one or more word line groups and one or more sub-block groups. The memory system may store, in a word line group of the set of consecutive word lines, parity information for the set of consecutive word lines. Each parity page may be a combination of one page of data per sub-block group and per word line group of the set of consecutive word lines. For example, each sub-block group and each word line group may contain N pages, where each of the N pages may correspond to a unique parity page to provide for recovery from errors caused by both read and program distresses.

To provide an image processing apparatus that can reduce the load on processing on scanned data required for discriminating a background color, even if the scanned data is obtained by scanning a document in which whether a background color is the same is unknown.SOLUTION: An image processing apparatus according to an aspect of the present disclosure comprises a first discrimination unit, a second discrimination unit, and a background color determination unit. The first discrimination unit discriminates a background color for a discrimination target page of scanned data obtained by converting a plurality of scanned pages into the JPEG format, by using a DC component and without using an AC component, and the second discrimination unit discriminates the background color for the discrimination target page, by using the DC component and the AC component. The background color determination unit, for a predetermined page of the scanned data, when a first background color that is a discrimination result from the first discrimination unit is not similar to a second background color determined for the previous page of the predetermined page, causes the second discrimination unit to execute discrimination, and determines the result of the discrimination as the background color of the predetermined page. When the first background color and the second background color are similar to each other, the background determination unit does not cause the second discrimination unit to execute discrimination and determines the second background color as the background color of the predetermined page.SELECTED DRAWING: Figure 1

The application discloses a data page recovery method and device, electronic equipment and a storage medium. The data page recovery method comprises the following steps: determining a data page cache of a first data page to which a target waiting event is directed, the target waiting event is a waiting event waiting for a target node in a database cluster to respond, and the target node comprises a fault node and / or an active node; releasing other data page caches in the active node except the data page cache of the first data page; and recovering a data page cache of a second data page according to a first redo log of the second data page, the second data page being a data page taking the active node as a recovery node, and the first redo log being recorded in a first log file in a disk. According to the method, other data page caches except the data page cache of the first data page are released, and then data page recovery is performed according to the first redo log of the second data page, so that the recovery efficiency of the data page in the shared storage database cluster is improved.

The application discloses a page display method and device, a storage medium, equipment and a program product, which are applied to a client, the client is in communication connection with a server, and the method comprises the following steps: sending an access request for a target page to the server, and receiving page public data of the target page returned by the server; loading the page public data, and synchronously judging whether the client has access authority of a gray version page to obtain an access authority judgment result; loading default page difference data or gray page difference data according to the access authority judgment result; and rendering and displaying a default version page or a gray version page according to the loaded page public data, the loaded gray page difference data or the loaded default page difference data. In this way, the page loading data is split into public data and difference data, the page public data loading and the gray access authority judgment are synchronously performed, and the time consumption from the request to the display of the page is effectively shortened.

A data compression method and a related device, used for reducing I / O overhead. The data compression method comprises: acquiring attribute information of a logic block, wherein the logic block comprises a plurality of data pages, and the attribute information indicates data sizes of data contained in the plurality of data pages across a plurality of time periods; if the attribute information indicates that the total data size of the data contained in the plurality of data pages during a target time period is greater than or equal to a first threshold, compressing the data contained in the logic block, and storing the result obtained by compression, wherein the target time period includes at least time period among the plurality of time periods, and the time interval between the target time period and the current moment is greater than or equal to a time threshold; and if the attribute information indicates that the total data size of the data contained in the plurality of data pages during the target time period is less than the first threshold, determining not to compress the data contained in the logic block.

The present disclosure relates in various aspects to a prelam body of a smart card, an associated smart card, an associated prelam sheet body, a method of forming a prelam body of a smart card, a method of forming a smart card for a data page of an identity document, and a method of forming an identity document. In illustrative embodiments, the prelam body comprises a base substrate formed of at least one layer, wherein the base substrate has a base substrate recess completely extending through the base substrate, a first overlay sheet layer formed over a first side of the base substrate, wherein the first overlay sheet layer has a first recess completely extending through the first overlay sheet layer and being in alignment with the base substrate recess, and an elastic plug completely filling the base substrate recess and the first recess.

The invention provides a cloud database data processing method and device, electronic equipment and a storage medium, and relates to the technical field of databases, the method comprises the following steps: a storage engine obtains an eliminated data page from a first buffer pool in a managed memory, and stores the eliminated data page in a local SSD storage; if an access request of target data is received and the target data is not queried in the first buffer pool, reading the target data from an eliminated data page in the local SSD storage; and if the target data is not read in the local SSD storage, reading the target data from the cloud storage. In the embodiment, the eliminated data page in the first buffer pool in the storage engine is stored in the local SSD storage, and the data is read in the cloud storage when the data cannot be read in the local SSD storage, so that the situation that the data is directly read in the cloud when the data cannot be queried in the first buffer pool is avoided, the cloud access frequency is reduced, the IO delay is reduced, and the user experience is improved. The performance of the database system is improved.

The application provides a data re-reading method, device and equipment, applied to the technical field of data storage, which comprises the following steps: when data is read from a flash memory, if the error code rate exceeds the error correction range value, a first offset voltage parameter group is obtained from a preset re-reading table, and the target data page is re-read by using the first offset voltage parameter group. If the re-reading fails, the target data page is subjected to voltage threshold distribution scanning processing, and a second offset parameter set of the target data page is obtained. The second offset parameter set is compared with the first offset parameter set to determine the voltage offset direction. According to the voltage offset direction, the target re-reading offset voltage item is searched for in the optional offset voltage items, the second offset voltage parameter group is determined, the target data page is re-read by using the re-reading offset voltage item, and the re-reading table parameter is updated, so that the problems of flash memory performance decline, high dependence on historical experience and relatively limited calculation of optimal voltage threshold in the current data re-reading process are solved.

Embodiments of the present application provide a database backup method and device, electronic equipment and storage medium, the method comprising: in the case of reaching a preset time node, triggering the database to refresh the data page in the shared cache area to the disk, and locking the file operation of the database switching pre-write log; after creating the basic snapshot data of the database and storing the basic snapshot data, unlocking the file operation, and listening to a plurality of pre-write logs output by the database after the file operation recovers, generating incremental log data based on the plurality of pre-write logs and storing the incremental log data; determining the starting file identifier corresponding to the earliest pre-write log in the incremental log data, and sequentially marking other pre-write logs in the incremental log data based on the starting file identifier; creating metadata information corresponding to the basic snapshot data. The present scheme realizes the non-interrupted backup of the database, guarantees the data consistency and integrity, reduces the backup data volume, and improves the backup efficiency.

A memory device includes an array of memory cells columns and rows, word lines respectively coupled to rows of the memory cells, bit lines respectively coupled to the columns of the memory cells, and a peripheral circuit coupled to the array of memory cells through the bit and word lines and including page buffer circuits respectively coupled to the bit lines. Each page buffer circuit includes one cache storage unit configured to, in programming a select row based on a current data page, sequentially store each of N bits of the current data page and each of the N bits of a next data page, N−1 data storage units each configured to, in programming the select row based on the current data page, store a respective one of the N bits of the current data page and a respective one of the N bits of the next data page in a time division manner, and a multipurpose storage unit configured to, in programming the select row based on the current data page, store at least one of the N bits of the current data page.

This invention discloses a method, system, electronic device, and storage medium for identifying counterfeit documents, comprising: acquiring an image of the data page of a target document and various business data associated with the target document; recognizing the data page image to obtain corresponding text data; fusing the text data with various business data to construct a standardized text dataset; extracting text features from the text dataset and image features from the data page image, fusing and enhancing the text features and image features to obtain joint features; performing anomaly detection based on the joint features to identify abnormal data items in the text dataset that do not conform to a preset issuance rule; mining hidden association rules between multiple data items in the text dataset, and outputting the authenticity identification result of the target document based on the abnormal data items and the hidden association rules.

Techniques for implementing metadata streams that provide increased performance and resiliency. The techniques include writing raw delta updates of metadata pages to a metadata delta log, and generating a metadata stream for a metadata page containing bulk updates. The techniques include passing the metadata stream to a tiered storage array, and storing the metadata page in a physical block on a metadata page tier. The techniques include, in response to storing the metadata page in the physical block, updating, in local memory, parity data for a RAID stripe including the metadata page. The techniques include, once the physical block is filled with metadata pages, storing the parity data from the local memory to a parity page of the stripe. The techniques include, in response to a storage drive failure when the physical block is partially filled with metadata pages, rebuilding the stripe data using the parity data in local memory.

The invention discloses a memory device, a flash memory controller and a control method of the flash memory controller. The method comprises the following steps of: receiving a plurality of data from a main device; encoding the plurality of data to respectively generate a plurality of code words, wherein each code word comprises corresponding data and a check code; writing the plurality of code words into a data page of a block of a flash memory module; receiving a read command from the master device, wherein the read command requires to read the plurality of codewords stored in the data page; reading the plurality of code words from the data page; sequentially decoding the plurality of code words to generate a decoding result; and if the decoding result indicates that at least one of the code words cannot be successfully decoded, decoding the code words which are not successfully decoded by using the information of the code words which are successfully decoded.