Processing system for efficient computation using cached mirror data

Abstract

The present application discloses a processing system for high efficiency operation by using cache mirror data, which comprises a fetcher, at least one management processor and a cache memory. The fetcher fetches a plurality of data to make the cache memory copy at least one mirror data. When at least one data reading device outputs at least one reading request, the management processor analyzes the data position corresponding to the request and transmits the corresponding mirror data. When the data reading device outputs an editing request, the management processor analyzes the data position corresponding to the request and outputs a key and the corresponding mirror data to the data reading device for editing, and the management processor outputs a change signal to the cache memory to update the change content of the remaining corresponding mirror data to ensure the correctness of subsequent data processing and high operation rate.

Description

Technical Field

[0001] This invention relates to database systems, and in particular to a processing system that utilizes cached mirrored data to achieve efficient computation. It uses Object Relational Mapping (ORM) data caching technology to load tables as objects and store them in memory, thereby accelerating access. Background Technology

[0002] In databases, a transaction refers to a complete logical process consisting of a series of database operations, such as select, update, and insert. To ensure a transaction is correct and reliable, it must possess four properties: Atomicity, Consistency, Isolation, and Durability—the so-called ACID properties. However, traditional databases often experience slow access speeds when dealing with large increases in data volume, and scaling up becomes increasingly difficult when distributed systems require significant expansion due to the surge in data volume.

[0003] Therefore, in existing technologies, databases maintain the scalability of distributed database architectures by ensuring that the final data will be consistent. However, during the period before data synchronization, issues such as data conflicts or loss on data servers or hosts must be handled manually by system administrators. This makes them unsuitable for handling highly accurate financial data or archives. In light of this, the present invention aims to address the shortcomings of existing technologies by pre-copying data to create mirrored data, which can then be quickly and synchronously provided to various servers or hosts while allowing system administrators to directly edit the data without additional translation procedures to resolve data conflicts. Summary of the Invention

[0004] In view of the above problems, the purpose of this invention is to provide a database processing system that meets the requirements of high-efficiency computing. It utilizes the technology of caching mirrored data to provide a database system architecture that supports both top-to-many and bottom-to-many relationships. Furthermore, data processing between the upper and lower server or host devices can be directly processed without additional translation programs, thereby significantly improving data access efficiency.

[0005] To achieve the above objectives, the present invention discloses a processing system for high-efficiency computation using cached mirrored data, executed in at least one electrically connected electronic device and at least one data reading device, so that the data reading device can directly read a plurality of data from the electronic device to improve data processing efficiency. The processing system for high-efficiency computation using cached mirrored data includes a fetcher, at least one management processor, and at least one cache memory. The management processor is electrically connected to the fetcher and the cache memory, and the fetcher is electrically connected to the cache memory. The fetcher fetches the plurality of data, causing the cache memory to copy each data to form at least one mirrored data. When the data reading device outputs at least one read request to the electronic device, the management processor analyzes and determines the location of the data in the corresponding request, and drives the cache to transmit the corresponding mirrored data to the data reading device. When the data reading device outputs an edit request to the electronic device, the management processor analyzes and determines the location of the data in the corresponding request and outputs a token to the data reading device. At the same time, it drives the cache to transmit the corresponding mirrored data to the data reading device for editing, and the management processor outputs an anomaly signal to the cache to synchronously update the anomaly content of the remaining corresponding mirrored data.

[0006] The cache memory includes a digital generation element. When the cache memory receives multiple data points, the digital generation element analyzes the data and encodes them into at least one summary table. The cache memory then copies the mirrored data according to the summary table, allowing the data reading device to directly read or edit each mirrored data point without additional code transcoding or compilation. The management processor includes a synchronization transmission element, and can operate in multiple configurations within the electronic device and the data reading device. When one management processor outputs an anomaly signal, the synchronization transmission element transmits the anomaly signal to the synchronization transmission element of the other management processor to synchronously update the anomaly content of the mirrored data. When the read request is a multiple reception type, the management processor aggregates requests for the same data location to obtain a quantity, driving the cache memory to copy an equal number of mirrored data points and transmit them to the data reading device. When the edit request is received in multiple ways, the management processor aggregates requests for the same data location to obtain a sort, and outputs the key and the mirrored data according to the sort, allowing only the data reading device with the key to perform editing. When the edit request is received in multiple ways and the management processor analyzes and finds that the corresponding data locations of the requests are all different, it outputs the key and the corresponding mirrored data to each data reading device respectively, so that each data reading device can perform editing simultaneously.

[0007] Furthermore, the management processor controls the memory duration of each mirrored data in the cache, and if the memory duration exceeds a certain threshold and the data has not been accessed during that period, the management processor drives the cache to delete the mirrored data. When the management processor analyzes the read request or the edit request and determines that the cache has deleted the mirrored data, it drives the cache to retrieve the corresponding data again and copy it to form the mirrored data. The management processor is equipped with a tracking element to record and form a data track (Audit Log) for disaster recovery in the event of a system outage. The electronic device is a database, server, or application host; the data reading device is a database, server, application host, hard disk, or flash drive.

[0008] In summary, this invention utilizes the extractor and cache memory to extract and copy multiple data from various databases or hosts to form multiple mirrored data. Simultaneously, it generates a summary table, making the multiple mirrored data usable across various types of application hosts or servers. This allows each data reading device to directly edit and process required data without needing to build additional jumper programs or translation programs. This facilitates intuitive addition, modification, or deletion of single data entries or entire files by application hosts within the overall database system network, thereby achieving high data processing performance and a highly scalable database system. Furthermore, the management processor manages the total storage capacity of the cache memory, limiting the total amount of multiple mirrored data to a predetermined value to avoid affecting the overall processing performance of the electronic device or data reading device, thus ensuring the operational performance of the overall database system architecture. Attached Figure Description

[0009] Figure 1 This is an architectural diagram of the first preferred embodiment of the present invention.

[0010] Figure 2 This is a schematic diagram of the architecture of the second preferred embodiment of the present invention.

[0011] Figure 3 This is a flowchart illustrating the second preferred embodiment of the present invention.

[0012] Figure 4 This is a schematic diagram of the architecture of the third preferred embodiment of the present invention.

[0013] Figure 5 This is a schematic diagram of the architecture of the fourth preferred embodiment of the present invention.

[0014] Explanation of reference numerals in the attached figures: 1-Processing system; 10-Retriever; 11-Management processor; 110-Synchronization transmission element; 12-Cache memory; 120-Mirrored data; 121-Digital generation element; 1210-Summary table; 2-Electronic device; 20-Data; 3-Data reading device; 30-Actuation request. Detailed Implementation

[0015] To enable those skilled in the art to clearly understand the content of this invention, please refer to the following description and accompanying drawings.

[0016] Please see Figure 1 This is an architecture diagram of a first preferred embodiment of the present invention. As shown, the processing system 1, which utilizes cached mirrored data to achieve efficient computation, is executed in at least one electronic device 2 and at least one data reading device 3, which are electrically connected. It includes a data retriever 10, at least one management processor 11, and at least one cache memory 12, allowing the data reading device 3 to directly read a plurality of data 20 from the electronic device 2, thereby improving data processing efficiency. The management processor 11 is electrically connected to the data retriever 10 and the cache memory 12, and the data retriever 10 is electrically connected to the cache memory 12. The data retriever 10 retrieves the plurality of data 20, causing the cache memory 12 to copy them to form at least one mirrored data 120. When the data reading device 3 outputs at least one read request to the electronic device 2, the management processor 11 analyzes and determines the location of the requested data, and drives the cache memory 12 to transmit the corresponding mirrored data 120 to the data reading device 3. When the data reading device 3 outputs an editing request to the electronic device 2, the management processor 11 analyzes and obtains the corresponding data location and outputs a key to the data reading device 3. At the same time, it drives the cache memory 12 to transmit the corresponding mirrored data 120 to the data reading device 3 for editing, and the management processor 11 outputs an anomaly signal to the cache memory 12 to synchronously update the anomaly content of the other corresponding mirrored data 120.

[0017] Please see Figures 2-5The figures show schematic diagrams of other preferred embodiments of the present invention. As shown, the processing system 1, which utilizes cached mirrored data to achieve efficient computation, is executed in at least one electronic device 2 and at least one data reading device 3 electrically connected to each other. It includes a data retriever 10, at least one management processor 11, and at least one cache memory 12, allowing the data reading device 3 to directly read multiple data sets 20 from the electronic device 2, thereby improving data processing efficiency. The electronic device 2 can be a database, server, or application host, and the data reading device 3 can be a database, server, application host, hard disk, or USB flash drive. Both the electronic device 2 and the data reading device 3 can be configured in multiple ways and support various types, such as Oracle, MSSQL, MySQL, MariaDB, and DBMaker. This allows the multiple data sets 20 to come from multiple databases of various types, facilitating the reading and editing of data or files from multiple hosts or access media of various types. The management processor 11 is electrically connected to the imager 10 and the cache memory 12. The imager 10 is electrically connected to the cache memory 12. The management processor 11 is provided with a synchronization transmission element 110. The cache memory 12 is provided with a digital generation element 121. The operation flow of the processing system 1 may include the following steps.

[0018] In step S1, when the extractor 10 extracts the plurality of data 20 and transmits them to the cache memory 12, in step S10, the digital generation element 121 analyzes the plurality of data 20 and encodes them to form at least one summary table 1210, and the cache memory 12 copies each of the summary table 1210 to form at least one mirrored data 120, so that the data reading device 3 can directly read or edit each of the mirrored data 120 using the summary table 1210 without additional program transcoding and compilation; wherein, the summary table 1210 can be loaded as an object and stored in the cache memory 12 to achieve the effect of accelerating access, and for example, the digital generation element 121 can automatically generate the summary table 1210 and its subsequent mirrored data 120 according to XML syntax or be manually generated by the administrator, such as SQL Command. In step S2, when the data reading device 3 outputs at least one operation request 30 to the electronic device, in step S20, the management processor 11 analyzes and determines the type of the operation request 30. If the operation request 30 is a read request, in step S3, the management processor 11 analyzes and determines the data location corresponding to the request, and drives the cache memory 12 to transmit the corresponding mirrored data 120 to the data reading device 3. It is worth noting that when the read request 30 is a multiple receive type, the management processor 11 aggregates requests requesting the same data location to obtain a quantity, and drives the cache memory 12 to copy and form an equal quantity of the multiple mirrored data 120 and transmit it to the data reading device 3.

[0019] Furthermore, if the action request 30 is an editing request, in step S4, the management processor 11 analyzes and obtains the data location corresponding to the request and outputs a key to the data reading device 3. At the same time, it drives the cache memory 12 to transmit the corresponding mirrored data 120 to the data reading device 3 for editing. In step S40, the management processor 11 outputs an anomaly signal to the cache memory 12 to synchronously update the anomaly content of the other corresponding mirrored data 120, so as to ensure the data correctness when other data reading devices 3 read or edit in the future, thereby improving the overall data processing performance. When the editing request is received in multiple ways, the management processor 11 aggregates requests for the same data location to obtain a sorting order, and outputs the key and the mirrored data 120 in sequence according to the sorting order, allowing only the data reading device 3 with the key to perform editing; conversely, when the editing request is received in multiple ways and the management processor 11 analyzes and finds that the corresponding data locations of the requests are all different, it outputs the key and each corresponding mirrored data 120 to each data reading device 3, so that each data reading device 3 can perform editing simultaneously. For example, if one and the other two data reading devices 3 want to edit the mirrored data 120 at data location three, the management processor 11 will output the key while simultaneously locking the mirrored data 120 at location three, so that the first data reading device 3 can complete the editing and the corresponding remaining mirrored data 120 in the cache memory 12 can be synchronized before the key is output for the second data reading device 3 to edit. If the first data reading device 3 wants to edit the mirrored data 120 at data locations two and three, and the second data reading device 3 wants to edit the mirrored data 120 at data locations four and five, the management processor 11 will output the key to the multiple data reading devices 3 respectively, so that the multiple data reading devices 3 can edit the data simultaneously.

[0020] In step S5, the management processor 11 controls the memory time of each piece of mirrored data 120 in the cache memory 12. When the management processor 11 determines that the memory time exceeds a certain threshold and the data has not been accessed during that period, it drives the cache memory 12 to delete a specific percentage, such as the first one hundred pieces of mirrored data. When the management processor 11 analyzes the read request or the edit request and determines that the cache memory 12 has deleted the mirrored data 120, it drives the retrieval device 10 to retrieve the corresponding data 20 again and causes the cache memory 12 to copy and form the mirrored data 120. Incidentally, since both the electronic device 2 and the data reading device 3 can... Figure 4 , 5The diagram shows a database system architecture constructed in multiple configurations, forming both top-to-many and bottom-to-many relationships. Therefore, the management processor 11 and the cache memory 12 can also be configured in multiple ways, operating separately in the electronic device 2 and the data reading device 3. When one management processor 11 outputs an anomaly signal, the synchronization transmission element 110 transmits the anomaly signal to the synchronization transmission element 110 of the other management processor 11, synchronously updating the anomaly content of the mirrored data 120 in the electrically connected cache memory 12. Furthermore, the management processor 11 may be equipped with a tracking element to record a data trajectory for disaster recovery in the event of a system outage, ensuring the availability of data or files and the overall system's interruption tolerance. The management processor 11 can encapsulate database syntax-related behaviors as methods, and the processing system 1 can provide an API (Application Programming Interface) for administrators to access data and objects, ensuring consistency and integrity of access.

[0021] The above description is merely a preferred embodiment of the present invention and is not intended to limit the scope of the present invention; therefore, all equivalent changes and modifications made without departing from the spirit and scope of the present invention should be covered within the scope of the present invention.

Claims

1. A processing system for achieving high-efficiency computation by utilizing cached mirrored data, executed in at least one electrically connected electronic device and at least one data reading device, wherein the data reading device directly reads a plurality of data from the electronic device to improve data processing efficiency, characterized in that: The processing system for efficient computation using cached mirrored data includes a data acquisition unit, at least one management processor, and at least one cache memory. The management processor is electrically connected to the data acquisition unit and the cache memory, and the data acquisition unit is electrically connected to the cache memory. The data acquisition unit acquires a plurality of data items, causing the cache memory to copy each item to form at least one mirrored data item. The cache memory includes a digit generation element. When the cache memory receives the plurality of data items, the digit generation element analyzes the data items and encodes them to form at least one summary table. The cache memory then copies each item to form the mirrored data item based on the summary table, allowing the data reading device to directly read or edit the data using the summary table. Each mirrored data is processed without additional program transcoding or compilation. When the data reading device outputs at least one read request to the electronic device, the management processor analyzes and determines the location of the data in the corresponding request, and drives the cache to transmit the corresponding mirrored data to the data reading device. When the data reading device outputs an edit request to the electronic device, the management processor analyzes and determines the location of the data in the corresponding request and outputs a key to the data reading device. At the same time, it drives the cache to transmit the corresponding mirrored data to the data reading device for editing, and the management processor outputs an anomaly signal to the cache to synchronously update the anomaly content of the remaining corresponding mirrored data.

2. The processing system for implementing high efficient operation with cache mirror data according to claim 1, wherein, The management processor is equipped with a synchronization transmission element, and the management processor is configured in multiple ways and operates in the electronic device and the data reading device respectively. When one of the management processors outputs the abnormal signal, the synchronization transmission element transmits the abnormal signal to the synchronization transmission element of the other management processor to synchronously update the abnormal content of the mirrored data.

3. The processing system for implementing high efficient operation with cache mirror data according to claim 2, wherein, When the read request is a multiple receive type, the management processor aggregates requests for the same data location to obtain a quantity, and drives the cache to copy and form an equal quantity of the multiple mirrored data and transmit it to the data reading device.

4. The processing system for achieving efficient computation using cached mirrored data as described in claim 3, characterized in that, When the edit request is received in multiple ways, the management processor aggregates requests for the same data location to obtain a sort, and outputs the key and the mirrored data according to the sort, so that only the data reading device with the key is allowed to perform the edit.

5. The processing system for achieving efficient computation using cached mirrored data as described in claim 4, characterized in that, When the editing request is received in multiple ways and the management processor analyzes and finds that the data locations of the corresponding requests are all different, it outputs the key and the corresponding mirrored data to each data reading device so that each data reading device can perform editing simultaneously.

6. The processing system for achieving efficient computation using cached mirrored data as described in claim 5, characterized in that, The management processor controls the memory time of each piece of mirrored data in the cache, and when the management processor determines that the memory time exceeds a certain limit and the data has not been accessed during the period, it drives the cache to delete the mirrored data.

7. The processing system for achieving efficient computation using cached mirrored data as described in claim 6, characterized in that, When the management processor analyzes the read request or the edit request and learns that the cache has deleted the mirrored data, it drives the fetcher to fetch the corresponding data again and makes the cache copy the mirrored data.

8. The processing system for achieving efficient computation using cached mirrored data as described in claim 7, characterized in that, The management processor is equipped with a tracking element to record a data trajectory for disaster recovery in the event of a system outage.

9. The processing system for achieving efficient computation using cached mirrored data as described in claim 8, characterized in that, The electronic device is a database, server, or application host; the data reading device is a database, server, application host, hard disk, or USB flash drive.

Images