Processing system, processing method, and program
The processing system addresses the challenge of efficiently storing data by dividing and uploading only updated objects, enhancing storage efficiency and reducing redundant data transfer.
Patent Information
- Application Number
- JP2024064653
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-04-12
- Publication Date
- 2025-10-24
AI Technical Summary
Existing technologies face challenges in efficiently storing data consisting of multiple objects in a storage destination.
A processing system that divides data into multiple objects, discriminates updated objects, and uploads only those determined to be updated, utilizing a control unit to manage and upload these objects efficiently.
Enables efficient storage of data by uploading only updated objects, optimizing storage efficiency and reducing unnecessary data transfer.
Smart Images

Figure 2025161458000001_ABST
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to a processing system, a processing method, and a program. [Background technology]
[0002] A variety of services are provided from servers to clients. Patent Document 1 discloses a related technology for uploading divided files. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Publication No. 2018-032116 Summary of the Invention [Problem to be solved by the invention]
[0004] In the technology relating to uploading related to Patent Document 1, there is a demand for a technology that can efficiently store data consisting of multiple objects in a storage destination.
[0005] An object of each aspect of the present disclosure is to provide a processing system, a processing method, and a program that can solve the above-mentioned problems. [Means for solving the problem]
[0006] According to one aspect of the present disclosure, a processing system includes a division unit that divides data into multiple objects when uploading the data, a discrimination unit that discriminates updated objects from among the multiple objects after division by the division unit, and an update unit that uploads only objects that are determined to be updated objects by the discrimination unit.
[0007] According to another aspect of the present disclosure, a processing method includes, when uploading data, dividing the data into a plurality of objects, determining updated objects from among the plurality of divided objects, and uploading only the objects determined to be updated objects.
[0008] According to another aspect of the present disclosure, a program causes a computer to, when uploading data, divide the data into a plurality of objects, determine updated objects from among the plurality of objects after division, and upload only the objects determined to be updated objects. [Effects of the Invention]
[0009] According to each aspect of the present disclosure, data consisting of multiple objects can also be efficiently stored in a storage destination. [Brief explanation of the drawings]
[0010] [Figure 1] FIG. 1 illustrates an example of a configuration of a processing system according to some embodiments of the present disclosure. [Figure 2] FIG. 10 illustrates an example of a division rule according to some embodiments of the present disclosure. [Figure 3] 10 illustrates an example of a processing flow for cloud registration performed by a processing system according to some embodiments of the present disclosure. [Figure 4] 10 is an example of a processing flow for user registration performed by a processing system according to some embodiments of the present disclosure. [Figure 5] 10 is an example of a processing flow of data upload performed by a processing system according to some embodiments of the present disclosure. [Figure 6] 10 is an example of a processing flow of data access performed by a processing system according to some embodiments of the present disclosure. [Figure 7]1 is a diagram illustrating an example of a configuration of a processing system 1 that processes text data according to some embodiments of the present disclosure. [Figure 8] 10 is an example of a processing flow of data division performed by a processing system according to some embodiments of the present disclosure. [Figure 9] FIG. 10 is a diagram illustrating an example of an object storage destination list according to some embodiments of the present disclosure. [Figure 10] 10 is an example of a processing flow of data combination performed by a processing system according to some embodiments of the present disclosure. [Figure 11] FIG. 10 is a diagram illustrating an example of a configuration of a processing system according to another embodiment of the present disclosure. [Figure 12] FIG. 10 is a diagram illustrating an example of a processing flow of a processing system according to another embodiment of the present disclosure. [Figure 13] FIG. 1 is a schematic block diagram illustrating the configuration of a computer according to at least one embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0011] Hereinafter, the embodiments will be described in detail with reference to the drawings. <Embodiment> (Processing system configuration) A processing system 1 according to an embodiment of the present disclosure will be described with reference to the drawings. The processing system 1 is a system including a client that can efficiently upload objects.
[0012] 1 is a diagram illustrating an example of a configuration of a processing system 1 according to some embodiments of the present disclosure. As illustrated in FIG. 1, the processing system 1 includes a client 10 and an object storage 20.
[0013] The client 10 uploads a partially updated object to the object storage 20. As shown in FIG.
[0014] The client main body 101 performs various processes performed by the client 10. The various processes performed by the client 10 include updating the object processed by the object processing unit 102 to the object storage 20. In other words, the client 10 uploads to the object storage 20 an object that has been partially updated from the data divided by the dividing / combining unit.
[0015] 1, the object processing unit 102 includes a control unit 1021 and a division and combination unit 1022. For example, the control unit 1021 and the division and combination unit 1022 are installed in the form of plug-ins in the client 10 that uses the object storage 20.
[0016] The control unit 1021 controls and manages objects and performs exclusive control in updating objects. For example, the control unit 1021 registers (stores) an ID (IDentification) and a password for accessing each cloud in response to an operation by an administrator (an example of a user) of the processing system 1 to register the ID and password. Also, for example, the control unit 1021 registers (stores) a username in response to an operation by the administrator of the processing system 1 to register a username for uploading data (i.e., a virtual file made up of multiple objects including a partially updated object) to the object storage 20.
[0017] The splitting / combining unit 1022 splits data into multiple objects according to splitting rules defined according to the type of data (i.e., the type of virtual file, for example, text, video, etc.). FIG. 2 is a diagram illustrating an example of splitting rules according to some embodiments of the present disclosure. As shown in FIG. 2, the splitting rules define a splitting method for each type of data. In the example of the splitting rules shown in FIG. 2, it is defined that if the data type is text, the data should be split by the number of lines, and if the data type is video, the data should be split by MB (megabyte) size.
[0018] The object storage 20 stores data (for example, a virtual file made up of multiple objects). The object storage 20 exists, for example, on a cloud. Note that the object storage 20 can also be accessed by devices other than the client 10.
[0019] The above-described processing performed by the processing system 1 according to the embodiment of the present disclosure is merely an example, and the processing system 1 is not limited to the above-described processing. For example, the processing system 1 may perform the processing described below.
[0020] Next, the processing performed by the processing system 1 will be described with reference to the drawings. (Overview of upload process) An overview of the process performed by the processing system 1 to upload data (that is, a virtual file consisting of multiple objects) will be described.
[0021] When the client 10 uploads data (an example of a virtual file) to the object storage 20, the splitting and combining unit 1022 splits the data into multiple objects according to a splitting rule defined according to the type of data (i.e., the type of virtual file, in this case, a partially updated object is included in the virtual file). The client main body 101 uploads the partially updated object from the data (i.e., multiple objects) split by the splitting and combining unit to the object storage 20.
[0022] At this time, the splitting / combining unit 1022 issues a unique identification ID linked to the data splitting / combining information. Examples of data splitting / combining information include splitting based on tag-based information in XML / HTML, splitting of audio sources such as MIDI / MP3, splitting of videos such as MP4 (by MB, second, or chapter), splitting based on cell-level information in Excel, and splitting based on figure and text box-level information that make up PPT or Word. When the client 10 uses the ID to access the updated data (i.e., multiple objects) split by the splitting / combining unit 1022, the splitting / combining unit 1022 references the data splitting / combining information from the ID. The splitting / combining unit 1022 then bundles the split objects based on the referenced splitting / combining information to construct a single virtual file (data). The splitting / combining unit 1022 then presents the virtual file to the client main body 101. When the client 10 updates the virtual file, the control unit 1021 determines which of the multiple objects constituting the virtual file have been updated (i.e., which objects have been partially updated).The client main body 101 then uploads only the partially updated objects determined by the control unit 1021 by transmitting them to the object storage 20.
[0023] Next, the operation of the object processing unit 102 when the user performs an operation to upload data to the client 10, and the operation of the object processing unit 102 when the client 10 accesses the data will be described with reference to the drawings.
[0024] (Cloud registration process) The following describes the cloud registration process performed by the processing system 1. Fig. 3 shows an example of a processing flow for cloud registration performed by the processing system 1 according to some embodiments of the present disclosure. An administrator of the processing system 1 performs an operation on the processing system 1 to register an ID (IDentification) and a password for accessing each cloud. The control unit 1021 registers (stores) the ID and password in response to the operation by the administrator (step S1).
[0025] (User registration processing) The following describes the user registration process performed by the processing system 1. Fig. 4 shows an example of a process flow for user registration performed by the processing system 1 according to some embodiments of the present disclosure. An administrator of the processing system 1 performs an operation on the processing system 1 to register a username for uploading data (i.e., a partially updated object) to the object storage 20. In response to the operation by the administrator, the control unit 1021 registers (stores) the username (step S11).
[0026] (Data upload processing) The data upload process performed by the processing system 1 will be described. Fig. 5 shows an example of a processing flow of data upload performed by the processing system 1 according to some embodiments of the present disclosure. A user performs an operation to input a username and password into the client 10, and performs an operation to upload data. In response to the user's operation, the control unit 1021 determines whether the username and password are registered (i.e., whether the accessing user is registered) (step S21).
[0027] If the control unit 1021 determines that the user name and password have been registered (YES in step S21), the dividing / combining unit 1022 divides the data input to the client 10 when the user performs an operation to upload data into multiple objects based on the division rule (step S22). For example, if the division rule is the division rule shown in FIG. 2 and the data input to the client 10 is text, the dividing / combining unit 1022 divides the data by the number of lines. Also, for example, if the division rule is the division rule shown in FIG. 2 and the data input to the client 10 is video, the dividing / combining unit 1022 divides the data by MB size.
[0028] The client main body 101 uploads the objects divided by the dividing / combining unit 1022 to the object storage 20 (step S23). The client main body 101 uploads all data the first time, and uploads only updated data from the second time onwards. At this time, the client main body 101 issues an identification ID and presents it to the object storage 20 (step S24). In this case, the object storage 20 stores the identification ID in association with the uploaded object. The client main body 101 then terminates the process.
[0029] Furthermore, if it is determined in the process of step S21 that the user name and password are not registered (NO in step S21), control unit 1021 ends the process.
[0030] (Data access processing) The data access processing performed by the processing system 1 will be described. In the data access processing, the control unit 1021 synchronizes the identification ID. FIG. 6 shows an example of a processing flow of data access performed by the processing system 1 according to some embodiments of the present disclosure. A user performs an operation to input a user name and password into the client 10, as well as an operation to input an identification ID for accessing data in the object storage 20. The control unit 1021 determines whether the user name and password are registered (i.e., whether the accessing user is registered) in accordance with the user's operation (step S31).
[0031] If the control unit 1021 determines that the user name and password are registered (YES in step S31), the client main body 101 transmits the identification ID entered by the user to the object storage 20, thereby accessing multiple objects (i.e., divided objects) stored in the object storage 20 in association with the identification ID. Then, the client main body 101 downloads multiple objects from a division list that lists the divided objects (step S32). The division / combination unit 1022 combines the multiple objects downloaded by the client main body 101 (step S33). The control unit 1021 uploads only objects that have been updated based on the information in the division list. The control unit 1021 presents the combined object (i.e., data) to the object storage 20 based on the division list (step S34). Then, the control unit 1021 ends the processing. On the other hand, if the control unit 1021 determines in the processing of step S31 that the user name and password are not registered (NO in step S31), it ends the processing.
[0032] Next, specific processing when the data is text will be described. Fig. 7 is a diagram showing an example of the configuration of a processing system 1 that processes text data according to some embodiments of the present disclosure. The UID in Fig. 7 is an example of an identification ID.
[0033] (Data division processing) The data division process performed by the processing system 1 will be described. FIG. 8 shows an example of a flow of the data division process performed by the processing system 1 according to some embodiments of the present disclosure. The dividing / combining unit 1022 defines division rules according to the type of data and creates a divided object storage destination list for multiple objects (step S41). For example, the dividing / combining unit 1022 divides data according to the data type and creates a list indicating the storage destinations. FIG. 9 shows an example of the object storage destination list according to some embodiments of the present disclosure. The object storage destination list is composed of a list as shown in part (a) of FIG. 9, which associates data types, division methods, and storage destinations, and a list as shown in part (b) of FIG. 9, which associates IDs, objects, and storage destinations. The dividing / combining unit 1022 divides data into objects according to the contents of the object storage destination list (step S42). The client main body 101 uploads the objects to specified storage destinations according to the contents of the list (step S43). For example, the client main body 101 compares the information (e.g., hash tag) of the object written in the division list with the information (e.g., hash tag) of the divided object before the update to determine whether an update has been made. This determination makes it possible to identify only the updated objects, and only the updated objects are uploaded. The client main body 101 issues an identification ID to the storage destination.
[0034] (Data binding process) The data merging process performed by the processing system 1 will be described. FIG. 10 shows an example of the processing flow of data merging performed by the processing system 1 according to some embodiments of the present disclosure. The client main body 101 references the identification ID and acquires an object storage destination list from the information of the division list linked to the identification ID (step S51). The client main body 101 downloads multiple objects that make up the data from a specified storage destination in accordance with the contents of the object storage destination list (step S52). Note that the control unit 1021 executes this designation. The splitting / merging unit 1022 merges the multiple objects downloaded by the client main body 101 in accordance with the contents of the object storage destination list (step S53).
[0035] (advantage) The processing system 1 according to an embodiment of the present disclosure has been described above. In the processing system 1, the splitting / combining unit 1022 (an example of a splitting unit) splits data into multiple objects when uploading the data. The control unit 1021 (an example of a determination unit) determines updated objects from among the multiple objects after splitting by the splitting / combining unit 1022. The client main body 101 uploads only those objects determined by the control unit 1021 to be updated objects. This processing system 1 makes it possible to upload only updated objects from among the multiple objects to a storage destination when uploading data consisting of multiple objects. As a result, the processing system 1 can efficiently store data consisting of multiple objects in a storage destination.
[0036] The division of data to be processed by the processing system 1 is not limited to text or video. For example, the division of data to be processed by the processing system 1 may be division based on XML / HTML tags, division of audio sources such as MIDI / MP3, division of video such as MP4 (by MB, second, or chapter), division by Excel cell, or division by figure / text box that make up PPT or Word.
[0037] 11 is a diagram illustrating an example of the configuration of a processing system 1 according to another embodiment of the present disclosure. As illustrated in FIG. 11, the processing system 1 includes a dividing unit 301, a determining unit 302, and an updating unit 303.
[0038] When uploading data, division unit 301 divides the data into a plurality of objects. Determination unit 302 determines updated objects from among the plurality of objects obtained after division by division unit 301. Update unit 303 uploads only the objects determined by determination unit 302 to be updated objects.
[0039] The dividing unit 301 can be realized, for example, by using the function of the dividing / combining unit 1022 illustrated in Fig. 1. The determining unit 302 can be realized, for example, by using the function of the control unit 1021 illustrated in Fig. 1. The updating unit 303 can be realized, for example, by using the function of the client main body 101 illustrated in Fig. 1.
[0040] 12 is a diagram showing an example of a processing flow of the processing system 1 according to another embodiment of the present disclosure. Next, processing of the processing system 1 according to another embodiment of the present disclosure will be described with reference to FIG.
[0041] When uploading data, the dividing unit 301 divides the data into a plurality of objects (step S101). The determining unit 302 determines updated objects from among the plurality of objects obtained by the dividing unit 301 (step S102). The updating unit 303 uploads only the objects determined by the determining unit 302 to be updated objects (step S103).
[0042] The processing system 1 according to another embodiment of the present disclosure has been described above. This processing system 1 can efficiently store data made up of multiple objects in a storage destination.
[0043] The order of the processes in the embodiments of the present disclosure may be changed as long as the processes are performed appropriately.
[0044] Although the embodiments of the present disclosure have been described, the above-mentioned processing system 1 and other control devices may have a computer system built therein. The above-mentioned processing steps are stored in the form of a program on a computer-readable recording medium, and the above processing is performed by reading and executing this program by a computer. Specific examples of computers are shown below.
[0045] 13 is a schematic block diagram showing the configuration of a computer according to at least one embodiment. As shown in FIG. 13, the computer 5 includes a CPU (Central Processing Unit) 6, a main memory 7, a storage 8, and an interface 9.
[0046] For example, the above-described processing system 1 and each of the other control devices are implemented in a computer 5. The operation of each of the above-described processing units is stored in the form of a program in a storage 8. The CPU 6 reads the program from the storage 8, loads it into the main memory 7, and executes the above-described processing in accordance with the program. The CPU 6 also allocates storage areas in the main memory 7 corresponding to each of the above-described storage units in accordance with the program. Note that the CPU 6 of the present disclosure may be a controller.
[0047] Examples of storage 8 include a hard disk drive (HDD), a solid state drive (SSD), a magnetic disk, a magneto-optical disk, a compact disc read-only memory (CD-ROM), a digital versatile disc read-only memory (DVD-ROM), and a semiconductor memory. Storage 8 may be an internal medium directly connected to the bus of computer 5, or an external medium connected to computer 5 via interface 9 or a communication line. In addition, when this program is distributed to computer 5 via a communication line, computer 5 that receives the program may load the program into main memory 7 and execute the above-mentioned processing. In at least one embodiment, storage 8 is a non-transitory tangible storage medium.
[0048] The program may also implement some of the functions described above. Furthermore, the program may be a file that can implement the functions described above in combination with a program already recorded in the computer system, a so-called differential file (differential program).
[0049] Although several embodiments of the present disclosure have been described, these embodiments are merely examples and do not limit the scope of the disclosure. Various additions, omissions, substitutions, and modifications may be made to these embodiments without departing from the spirit of the disclosure.
[0050] Note that part or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.
[0051] (Appendix 1) a division unit that divides data into a plurality of objects when uploading the data; a determination unit that determines an updated object from among the plurality of objects after division by the division processing unit; an update unit that uploads only the object that is determined by the determination unit to be an updated object; A processing system comprising:
[0052] (Appendix 2) The determination unit determining an updated object based on the information of the object; 10. The processing system of claim 1.
[0053] (Appendix 3) The object information is a hashtag. 10. The processing system of claim 1 or 2.
[0054] (Appendix 4) The determination unit determining the updated objects based on a partition list indicating the updated objects; 4. The processing system of any one of claims 1 to 3.
[0055] (Appendix 5) When uploading data, splitting the data into multiple objects; Identifying an updated object from among the plurality of objects after division; Uploading only those objects that are determined to be updated objects; A processing method comprising:
[0056] (Appendix 6) determining an updated object based on the information of the object; Attachment 5, a processing method comprising:
[0057] (Appendix 7) The object information is a hashtag. A processing method as described in Appendix 5 or Appendix 6.
[0058] (Appendix 8) determining the updated objects based on a partition list indicating the updated objects; 8. The processing method according to any one of appendices 5 to 7,
[0059] (Appendix 9) When uploading data, splitting the data into multiple objects; Identifying an updated object from among the plurality of objects after division; Uploading only those objects that are determined to be updated objects; A program that causes a computer to execute the following.
[0060] (Appendix 10) determining an updated object based on the information of the object; 10. The program according to claim 9, which causes the computer to execute the above steps.
[0061] (Appendix 11) The object information is a hashtag. 10. A program according to claim 9 or 10.
[0062] (Appendix 12) determining the updated objects based on a partition list indicating the updated objects; 12. The program according to any one of claims 9 to 11, which causes the computer to execute the above. [Explanation of symbols]
[0063] 1. Processing System 5. Computer 6 CPU 7. Main memory 8. Storage 9. Interface 10. Client 20. Object Storage 101...Client main body 102 Object processing unit 301...Divided part 302...Discrimination section 303...Update section 1021 Control unit 1022...Split / join part
Claims
1. a division unit that divides data into a plurality of objects when uploading the data; a determination unit that determines an updated object from among the plurality of objects after division by the division unit; an update unit that uploads only the object that is determined by the determination unit to be an updated object; A processing system comprising:
2. The determination unit determining an updated object based on the information of the object; The processing system of claim 1 .
3. The object information is a hashtag. The processing system of claim 1 .
4. The determination unit determining the updated objects based on a partition list indicating the updated objects; The processing system according to any one of claims 1 to 3.
5. When uploading data, splitting the data into multiple objects; Identifying an updated object from among the plurality of objects after division; Uploading only those objects that are determined to be updated objects; A processing method comprising:
6. When uploading data, splitting the data into multiple objects; Identifying an updated object from among the plurality of objects after division; Uploading only those objects that are determined to be updated objects; A program that causes a computer to execute the following.
Citation Information
Patent Citations
High speed upload system, method and program
JP2018032116A