Information processing device, information processing system, and information processing method

Abstract

To use a cloud service cooperated with an edge device to reflect writing in a sheet on original electronic data managed by the cloud service.SOLUTION: An information processing system comprises: a communication unit that communicates with an edge device 200; a conversion unit that executes OCR conversion on data input from the edge device; a device management unit that manages the edge device; an authentication unit that authenticates a user; a job receiving unit that receives data to be output to the edge device from the authenticated user; a storage unit that stores the output data; a setting receiving unit that receives settings of data update rules; a calculation unit that calculates a change portion from the data on which the OCR conversion is executed according to the update rules; a data history management unit that manages a history of input and output data; and an update unit that, based on the data history, determines, from among the pieces of data to be stored, target electronic data that is the original data input from the edge device, and updates the target electronic data based on the change portion.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing system, and an information processing method. [Background technology]

[0002] By using edge devices connected to cloud services, technology has been developed that allows electronic data to be written onto printed paper or other media, and then the contents can be read to change and update the data.

[0003] For example, if a printer and scanner are connected to a cloud service, a registered user of the cloud service can set rules for writing on paper when printing out electronic data via the cloud service. This allows the written information to be easily reflected in the original electronic data by scanning the paper with a scanner.

[0004] In addition, because edge devices can be linked together via cloud services, even if the printer and scanner are separate devices, the electronic data of the print content can be viewed on the cloud service, and updates to the original electronic data can be made.

[0005] For example, Patent Document 1 discloses a technique for reading out notes added to a paper sheet and correcting the original electronic data based on the read-out notes in accordance with the touch-up pattern. Summary of the Invention [Problem to be solved by the invention]

[0006] However, with the technology described in Patent Document 1, it may not be possible to reflect the revised content in the original electronic data, or if the original electronic data is changed, the revised content may not be reflected as intended by the user.

[0007] The present invention has been made in consideration of the above, and aims to provide an information processing device, an information processing system, and an information processing method that allow a user to reflect writing on paper in the original electronic data managed by the cloud service by utilizing a cloud service that works in conjunction with an edge device. [Means for solving the problem]

[0008] In order to solve the above-mentioned problems and achieve the object, the present invention provides an information processing apparatus capable of communicating with an edge device, comprising: a job receiving unit that receives output data to be output to the edge device; a first communication unit that transmits the output data to the edge device; a storage unit that saves the output data transmitted to the edge device; a setting receiving unit that receives settings for update rules for the output data; a data history management unit that manages a data history that is a usage history of input and output data; and a second communication unit that receives input data from the edge device that is data written in the output data. a conversion unit that performs OCR conversion on the input data; According to the update rules, The conversion unit performed OCR conversion. The data processing system includes a calculation unit that calculates the changes from the input data, and an update unit that determines, based on the data history, target electronic data from the output data stored in the storage unit, which is the original output data of the input data received from the edge device, and updates the target electronic data based on the changes. [Effects of the Invention]

[0009] According to the present invention, by using a cloud service that cooperates with an edge device, it is possible for a user to reflect writing on a form in the original electronic data managed by the cloud service. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram showing an example of a functional configuration of an information processing system according to the present embodiment. [Figure 2]FIG. 2 is a flowchart showing an example of the flow of user operation processing in the information processing system according to this embodiment. [Figure 3] FIG. 3 is a flowchart showing an example of the flow of processing for determining target electronic data in the information processing system according to this embodiment. [Figure 4] FIG. 4 is a flowchart showing an example of the flow of the target electronic data update process in the information processing system according to this embodiment. [Figure 5] FIG. 5 is a diagram showing an example of an operation screen during printing in the information processing system according to the present embodiment. [Figure 6] FIG. 6 is a diagram showing an example of an operation screen during printing in the information processing system according to the present embodiment. [Figure 7] FIG. 7 is a diagram showing an example of an operation screen during scanning in the information processing system according to the present embodiment. [Figure 8] FIG. 8 is a diagram showing an example of an operation screen during scanning in the information processing system according to the present embodiment. [Figure 9] FIG. 9 is a diagram showing an example of an operation screen displayed when writing is reflected in the information processing system according to the present embodiment. [Figure 10] FIG. 10 is a diagram showing an example of an operation screen displayed when writing is reflected in the information processing system according to the present embodiment. [Figure 11] FIG. 11 is a diagram showing an example of an operation screen displayed when writing is reflected in the information processing system according to the present embodiment. [Figure 12] FIG. 12 is a diagram showing an example of an operation screen displayed when writing is reflected in the information processing system according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of an information processing device, an information processing system, and an information processing method will be described in detail with reference to the accompanying drawings.

[0012] 1 is a block diagram showing an example of the functional configuration of an information processing system according to this embodiment. First, an example of the functional configuration of the information processing system according to this embodiment will be described with reference to FIG.

[0013] 1, the information processing system according to this embodiment includes a cloud 100 and an edge device 200. In this embodiment, the cloud 100 may include a cloud gateway. Also, in this embodiment, the edge device 200 may be, for example, a PC (Personal Computer), a smartphone, a digital camera, a printer, a scanner, or an MFP (Multi-Function Peripheral).

[0014] First, a description will be given of an example of the functional configuration of the edge device 200. The edge device 200 includes a communication unit 201 and a job execution unit 202.

[0015] The communication unit 201 communicates with external devices such as the cloud 100. The job execution unit 202 interprets and executes jobs received from the cloud 100 by the communication unit 201. The jobs executed by the job execution unit 202 differ for each edge device 200.

[0016] Next, an example of the functional configuration of the cloud 100 (an example of an information processing device) will be described. The cloud 100 includes a communication unit 101, an OCR execution unit 102, a UI unit 103, a write conversion rule registration unit 111, a write conversion unit 112, a data editing unit 113, a data storage unit 114, a data history management unit 115, a user authentication unit 121, an edge device management unit 122, a job reception unit 123, and a job management unit 124.

[0017] The communication unit 101 is an example of a communication unit that communicates with an external device such as the edge device 200. The OCR execution unit 102 executes OCR processing of a document. Specifically, the OCR execution unit 102 is an example of a conversion unit that executes OCR conversion on data input from the edge device 200 via the communication unit 101. The UI unit 103 displays UIs related to various services provided by the cloud 100.

[0018] The write conversion rule registration unit 111 is an example of a setting reception unit that receives the setting of a write conversion rule (an example of an update rule) for data. The write conversion rule registration unit 111 also manages the received setting of the write conversion rule by linking it to the user or edge device 200 that set the write conversion rule. The write conversion unit 112 is an example of a calculation unit that calculates the change location and conversion method, etc. from data that has undergone OCR conversion in accordance with the write conversion rule registered by the write conversion rule registration unit 111. The write conversion unit 112 can also calculate the change location based on the data history managed by the data history management unit 115, which will be described later. This makes it possible to more easily calculate the change location of data.

[0019] The data editing unit 113 reflects the changes and the conversion method in the target electronic data, which is the original data (source data) grasped from the data history managed by the data history management unit 115 (described later) and the user input, among the data stored in the data storage unit 114 (described later). Specifically, the data editing unit 113 determines the target electronic data, which is the source data of the data input from the edge device 200, among the data stored in the data storage unit 114 (described later), based on the data history managed by the data history management unit 115 (described later). Then, the data editing unit 113 is an example of an update unit that updates the determined target electronic data based on the changes and the conversion method calculated by the write conversion unit 112.

[0020] In this way, by using the data history, it is possible to link data input from the edge device 200, such as a printed paper sheet, with the target electronic data stored in the data storage unit 114. As a result, by using the cloud 100 linked to the edge device 200, the user can reflect the writing on the paper sheet in the original data managed by the cloud 100.

[0021] For example, the data editing unit 113 can use RPA or the like as a method for updating data. In this case, the data editing unit 113 generates a document correction command based on the calculated changes and the target electronic data, and executes the document generation command with RPA, thereby enabling the target electronic data to be updated.

[0022] The data storage unit 114 is an example of a storage unit that stores data output to the edge device 200 and data (target electronic data) updated by the data editing unit 113. The data history management unit 115 manages a data history, which is a usage history of data input and output to and from the cloud 100. In this embodiment, the data history management unit 115 manages the data history by linking it with the user who used the data, the edge device 200, etc.

[0023] The user authentication unit 121 is an example of an authentication unit that authenticates a user before sending a job to the edge device 200. The edge device management unit 122 is an example of a device management unit that manages the edge devices 200 that can communicate via the communication unit 101.

[0024] The job receiving unit 123 receives data to be output to the edge device 200 from a user authenticated by the user authentication unit 121. In this embodiment, the job receiving unit 123 receives a job including a user ID, data to be output to the edge device 200, a security level selected by the user, etc. The job management unit 124 manages the jobs received by the job receiving unit 123.

[0025] 2 is a flowchart showing an example of the flow of a user operation process of the information processing system according to the present embodiment. Next, an example of the flow of a user operation process of the information processing system according to the present embodiment will be described with reference to FIG.

[0026] First, the user authentication unit 121 of the cloud 100 executes a login process including authentication of a user of the cloud 100 (step S211). Next, the job acceptance unit 123 of the cloud 100 accepts a selection of print data to be output to an edge device 200 (e.g., a printer) (step S212). The user may select the print data from a cloud folder linked to the cloud 100, or may upload the print data to the cloud 100.

[0027] Next, the write conversion rule registration unit 111 of the cloud 100 accepts the setting of a write conversion rule for the print data (step S213). Furthermore, the UI unit 103 accepts the selection of a printer from the edge devices 200 that will print the print data (step S214). In this embodiment, any of the edge devices 200 that cooperate with the cloud 100 can be selected. The UI unit 103 can also accept the user's selection of an edge device 200 or automatically select an edge device 200 that is close to the cloud 100. Thereafter, the communication unit 101 transmits a job including the print data to the printer whose selection has been accepted.

[0028] The job execution unit 202 of the edge device 200 (printer) prints the print data in accordance with the job received from the cloud 100 (step S215). After that, the user writes on a recording medium such as paper on which the print data has been printed, and when an edge device 200 (e.g., a scanner) for reading the paper or the like is selected, the selected edge device 200 scans the paper or the like on which the writing has been performed (step S216). Furthermore, the communication unit 201 of the edge device 200 (scanner) transmits the scanned data to the cloud 100.

[0029] When data is input from the edge device 200 by the communication unit 101 of the cloud 100, the data editing unit 113 determines whether or not to update the original data (target electronic data) stored in the data storage unit 114 (step S217). If the original data is not to be updated (step S217: No), the data editing unit 113 assigns a storage name specified by the UI unit 103 to the received data and stores it in the data storage unit 114 (step S218).

[0030] On the other hand, if the original data is to be updated (step S217: Yes), the data editing unit 113 selects (determines) the original data (target electronic data) from the data stored in the data storage unit 114 (step S219). After updating the selected original data, the data editing unit 113 assigns a storage name specified by the UI unit 103 to the updated original data and stores it in the data storage unit 114 (step S218).

[0031] 3 is a flowchart showing an example of a process flow for determining target electronic data in the information processing system according to the present embodiment. Next, an example of a process flow for determining target electronic data in the information processing system according to the present embodiment will be described with reference to FIG.

[0032] First, the data editing unit 113 determines whether or not the data history management unit 115 has a data history linked to the user or the edge device 200 (step S301). If there is no data history (step S301: No), the data editing unit 113 waits for the user to specify target electronic data (step S302). Thereafter, the data editing unit 113 determines the data specified by the user as the target electronic data (data printed by the edge device 200) (step S303).

[0033] On the other hand, if there is a data history (step S301: Yes), the data editing unit 113 determines whether there are multiple data histories (step S304). If there are not multiple data histories (step S304: No), the data editing unit 113 determines the target electronic data from the data stored in the data storage unit 114 based on the data history (step S303).

[0034] On the other hand, if there are multiple data histories (step S304: Yes), the data editing unit 113 displays candidates for original data (target electronic data) from among the data stored in the data storage unit 114 based on the multiple data histories (step S305).Then, the data editing unit 113 waits for the user to specify target electronic data from the original data candidates (step S306).After that, the data editing unit 113 determines the original data candidate specified by the user as the target electronic data (step S303).

[0035] 4 is a flowchart showing an example of the flow of the process of updating target electronic data in the information processing system according to the present embodiment. Next, an example of the flow of the process of updating target electronic data in the information processing system according to the present embodiment will be described with reference to FIG.

[0036] The OCR execution unit 102 receives data (write data) input from the edge device 200 via the communication unit 101 (step S401) and performs OCR conversion on the received write data. Next, the write conversion unit 112 extracts a write from the write data that has undergone OCR conversion (step S402). Furthermore, the write conversion unit 112 calculates the change location and conversion method (data correction method) from the extracted write in accordance with the write conversion rule (step S403).

[0037] Next, the data editing unit 113 determines whether or not there is a change in the target electronic data based on the calculated change parts and conversion method (step S404). If there is no change in the target electronic data (step S404: No), the data editing unit 113 reflects the calculated change parts and conversion method in the target electronic data (step S405).

[0038] On the other hand, if there is a change in the target electronic data (step S404: Yes), that is, if there is a conflict in which the target electronic data has been modified since it was printed, the data editing unit 113 determines whether there is a change in the target electronic data (the object of modification) at the same position as the calculated change (step S406). If there is a change in the target electronic data at the same position as the calculated change (step S406: Yes), the data editing unit 113 displays the difference between the calculated change and the change in the target electronic data on the UI unit 103 (step S407) and waits for instructions from the user (step S408). In other words, the UI unit 130 is an example of a notification unit that requests instructions on how to modify the target electronic data when there is a difference between the calculated change and the target electronic data.

[0039] Thereafter, the data editing unit 113 reflects the calculated changes and conversion method in the target electronic data in accordance with instructions from the user (step S405). That is, if there is a difference between the calculated changes and the target electronic data, the data editing unit 113 updates the target electronic data in accordance with instructions from the user. This allows the data to be updated as intended by the user.

[0040] Furthermore, if there is no change in the target electronic data at the same position as the calculated change (step S406: No), the data editing unit 113 determines whether there is a difference (correction target) between the calculated change and the target electronic data (step S409). If there is a correction target in the target electronic data (step S409: Yes), the data editing unit 113 displays the correction target in the target electronic data on the UI unit 103 (step S410) and waits for instructions from the user (step S411). Thereafter, the data editing unit 113 reflects the calculated change and conversion method in the target electronic data in accordance with the user's instructions (step S405).

[0041] If there is no correction target in the target electronic data (step S409: No), the data editing unit 113 leaves the calculated change location and conversion method in the log as an unreflected entry (step S412).

[0042] 5 and 6 are diagrams showing an example of an operation screen displayed when printing in the information processing system according to the present embodiment. Next, an example of an operation screen displayed when printing in the information processing system according to the present embodiment will be described with reference to FIGS. 5 and 6.

[0043] In this embodiment, an operation screen can be used on a browser or in an application on an external device such as a smartphone or PC. For example, when printing data on the edge device 200, the write conversion rule registration unit 111 displays an operation screen on the external device, as shown in Fig. 5, on which a device to be used for printing the data (e.g., printer A) and a write conversion rule (e.g., deletion, addition) can be set. Then, the write conversion rule registration unit 111 accepts the write conversion rule set on the operation screen.

[0044] Here, the comment conversion rule may be selectable from comment conversion rules provided in advance by the service, or the user may set the comment conversion rule by drawing a shape or the like on the operation screen. The comment conversion rule may include not only deletion, addition, and modification, but also various other comment conversion rules such as copy, paste, font size change, and commands for operating on data. A comment conversion rule set in advance by the user may also be applied. As shown in FIG. 6, one user may set multiple comment conversion rules, and each comment conversion rule may be assigned an arbitrary name (e.g., User X) and made available for use.

[0045] 7 and 8 are diagrams showing an example of an operation screen displayed when scanning in the information processing system according to the present embodiment. Next, an example of an operation screen displayed when scanning in the information processing system according to the present embodiment will be described with reference to FIGS. 7 and 8.

[0046] When scanning a written page (recording medium) in the edge device 200, the data editing unit 113 displays an operation screen on the external device that allows the user to select the device to be used to scan the written page (e.g., scanner B) and whether or not to update the target electronic data in accordance with the writing on the page. Furthermore, when updating the target electronic data in accordance with the writing is selected, the data editing unit 113 may display an operation screen on the external device that allows the user to set a method for saving the target electronic data updated in accordance with the writing. When the target electronic data is determined based on the user's data history and the target electronic data updated in accordance with the writing is to be saved as a new file, the data editing unit 113 displays an operation screen that allows the user to specify a save file name (e.g., ZZ_after.txt), as shown in FIG. 7.

[0047] Incidentally, while it is possible for the cloud service to ascertain the target electronic data before updating based on the user information, there are cases in which the cloud 100 does not save the usage history of the output data from the viewpoint of security, etc. In this case, the data editing unit 113 may display on the external device an operation screen on which the target electronic data corresponding to the data to be scanned by the edge device 200 can be specified from the data stored in the data storage unit 114, as shown in Fig. 8. In this case, the writing is reflected by overwriting the specified target electronic data, so it is not necessary to specify a save file name.

[0048] 9 to 12 are diagrams showing an example of an operation screen displayed when writing is reflected in the information processing system according to the present embodiment. Next, an example of an operation screen displayed when writing is reflected in the information processing system according to the present embodiment will be described with reference to FIGS.

[0049] After calculating the parts and methods of change to be made to the data (scanned data) input from the edge device 200, if a conflict state occurs in which the target electronic data is modified after the target electronic data is printed, the data editing unit 113 displays the operation screen shown in Fig. 9 on the external device. Specifically, as shown in Fig. 9, the data editing unit 113 notifies the user that a conflict state has occurred in the target electronic data, and displays an operation screen that allows the user to select whether or not to reflect the changes in the target electronic data.

[0050] When the user selects to reflect the changes in the target electronic data, the data editing unit 113 displays a preview that allows the user to identify the positions of the changes in the target electronic data, as shown in Fig. 10. Alternatively, the data editing unit 113 may display a preview that allows the user to compare the target electronic data with the scanned data. In this case, the changes in the target electronic data may be highlighted to make them identifiable. Furthermore, the data editing unit 113 may include a button on the operation screen that allows the user to select whether or not to change the target electronic data, as shown in Fig. 10.

[0051] Here, if it is selected not to change the target electronic data and there are no other changes to the target electronic data, the data editing unit 113 displays an operation screen on the external device indicating that the updating of the target electronic data has been completed, as shown in Figure 12.

[0052] On the other hand, if the user selects to change the target electronic data, the data editing unit 113 updates the target electronic data in accordance with the calculated changes and conversion method. Furthermore, if the user selects manual correction, the data editing unit 113 displays an operation screen on the external device, as shown in Fig. 11, on which the user can input the changes and conversion method for the target electronic data. The data editing unit 113 then updates the target electronic data in accordance with the changes and conversion method input on the operation screen. Thereafter, the data editing unit 113 displays an operation screen on the external device, as shown in Fig. 12, indicating that the updating of the target electronic data has been completed.

[0053] In this way, according to the information processing system of the present embodiment, by using the data history, it is possible to link data input from the edge device 200, such as a printed paper sheet, with the target electronic data stored in the data storage unit 114. As a result, by using the cloud 100 linked to the edge device 200, the user can reflect the writing on the paper sheet in the original electronic data managed by the cloud 100.

[0054] Each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in this specification includes a processor programmed to perform each function by software, such as a processor implemented by an electronic circuit, as well as devices such as an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), and conventional circuit modules designed to perform each of the above-described functions.

[0055] The illustrated example devices are merely one of several computing environments for implementing the embodiments disclosed herein. In one embodiment, cloud 100 includes multiple computing devices, such as a server cluster, configured to communicate with each other via any type of communication link, including a network, shared memory, etc., to perform the processes disclosed herein. Similarly, edge device 200 may include multiple computing devices configured to communicate with each other. [Explanation of symbols]

[0056] 100 Cloud 101,201 Communications Department 102 OCR execution unit 103 UI section 111 Write conversion rule registration section 112 Write conversion unit 113 Data Editorial Department 114 Data Storage Unit 115 Data History Management Department 121 User authentication unit 122 Edge Device Management Department 123 Job Reception Department 124 Job Management Department 200 edge devices 202 Job Execution Unit [Prior art documents] [Patent documents]

[0057] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-097624

Claims

1. An information processing device capable of communicating with an edge device, a job receiving unit that receives output data to be output to the edge device; a first communication unit that transmits the output data to the edge device; a storage unit for storing the output data transmitted to the edge device; a setting receiving unit that receives a setting of an update rule for the output data; a data history management unit that manages a data history that is a usage history of input and output data; a second communication unit that receives input data, which is data written in the output data, from the edge device; a conversion unit that performs OCR conversion on the input data; a calculation unit that calculates a change portion from the input data that has been OCR converted by the conversion unit in accordance with the update rule; an updating unit that determines, from the output data stored in the storage unit based on the data history, target electronic data that is the output data that is the original of the input data received from the edge device, and updates the target electronic data based on the changes; An information processing device comprising:

2. The information processing apparatus according to claim 1 , further comprising a notification unit that requests a user to instruct how to correct the change if there is a difference between the change and the target electronic data.

3. The information processing apparatus according to claim 1 , wherein the updating unit updates the target electronic data in response to an instruction from a user when there is a difference between the change and the target electronic data.

4. The information processing device according to claim 1 , wherein the calculation unit further calculates the changed portion based on the data history.

5. The update unit determining whether or not there is a correction in the target electronic data at the same position as the calculated change after printing of the output data; If there is a correction at the same position as the calculated change, an operation screen is displayed on which the user can select whether or not to reflect the change in the target electronic data; The information processing apparatus according to claim 1 , wherein when a selection is made on the operation screen to reflect the changes in the target electronic data, the target electronic data is updated based on the changes.

6. An information processing system having an edge device and an information processing device, The edge device a communication unit that communicates with the information processing device; Equipped with The information processing device includes: a job receiving unit that receives output data to be output to the edge device; a first communication unit that transmits the output data to the edge device; a storage unit for storing the output data transmitted to the edge device; a setting receiving unit that receives a setting of an update rule for the output data; a data history management unit that manages a data history that is a usage history of input and output data; a second communication unit that receives input data, which is data written in the output data, from the edge device; a conversion unit that performs OCR conversion on the input data; a calculation unit that calculates a change portion from the input data that has been OCR converted by the conversion unit in accordance with the update rule; an updating unit that determines, from the output data stored in the storage unit based on the data history, target electronic data that is the output data that is the original of the input data received from the edge device, and updates the target electronic data based on the changes; An information processing system comprising:

7. An information processing method executed by an information processing device capable of communicating with an edge device, a job receiving unit receiving output data to be output to the edge device; a first communication unit transmitting the output data to the edge device; a storage unit storing the output data transmitted to the edge device; a setting receiving unit receiving a setting of an update rule for the output data; a step in which a data history management unit manages a data history, which is a usage history of input / output data; a step of receiving, by a second communication unit, input data that is data written in the output data from the edge device; a conversion unit performing OCR conversion on the input data; a calculation unit calculating, in accordance with the update rule, changes from the input data that has been OCR converted by the conversion unit; an updating unit determining, based on the data history, target electronic data that is the output data that is the original of the input data received from the edge device, from the output data stored in the storage unit, and updating the target electronic data based on the changed portion; An information processing method including:

Images