Information processing system, information processing program, and information processing method

Abstract

To store an operation log of an information processing apparatus by means other than characters.SOLUTION: An information processing system 80 comprises at least one processor, and the processor stores, in a storage unit 13, generated data generated on the basis of input made by a user on an input screen of an information processing apparatus (image forming apparatus 20), and input screen data that is moving images or a plurality of still images in which procedures for input made by the user on the input screen are recorded, in linkage with each other.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing program, and an information processing method. [Background technology]

[0002] The following Patent Document 1 describes a technology for recording an operation log based on operations related to work performed on an image forming device in a database. With this technology, a process specified in a job received by a receiving unit is executed based on the work performed on the image forming device. Then, an operation log corresponding to the job processing is identified and managed in association with the job. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2010-212862 Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure aims to store an operation log of an information processing device in a form other than text. [Means for solving the problem]

[0005] The information processing system of the first aspect includes at least one processor, and the processor links generated data generated based on user input to an input screen of an information processing device and input screen data, which is a video or multiple still images recording the user's input procedures to the input screen, and stores them in a memory unit.

[0006] In a second aspect of the information processing system, in the information processing system of the first aspect, the information processing device is an image forming device, the generated data is print image data of a printed matter, and when the processor receives a request to send the input screen data and the print image data from a predetermined terminal, it sends the acquired input screen data and the print image data.

[0007] In a third aspect of the information processing system, in the information processing system of the second aspect, the input screen data is a video, and when the processor receives the send request, it combines the acquired video with the print image data and sends it out.

[0008] In a fourth aspect of the information processing system, in the information processing system of the second aspect, the input screen data includes a plurality of still images, and when the input screen is scrolled in response to a print instruction, the processor further stores information indicating that the input screen has been scrolled as part of the input screen data in the memory unit.

[0009] In a fifth aspect of the information processing system, in addition to the second aspect, the processor further acquires personal identification information of the instructing user who executed the print instruction.

[0010] In an information processing system of a sixth aspect, in addition to the information processing system of the third aspect, the processor executes protection processing to make the protection information included in the print image data invisible.

[0011] In an information processing system of a seventh aspect, in the information processing system of the sixth aspect, the processor replaces original data included in the print image data with alternative image data as the protection process.

[0012] In an eighth aspect of the information processing system, in the sixth aspect of the information processing system, the processor, as the protection processing, identifies the part of the original data that contains the protection information as a protection area, and replaces the protection area included in the print image data with alternative image data.

[0013] In an information processing system of a ninth aspect, in addition to the information processing system of the second aspect, the processor limits the recording amount of a data group that includes the print image data and the input screen data.

[0014] In the information processing system of the tenth aspect, in the information processing system of the second aspect, when multiple print jobs are input to the image forming device, the processor associates and stores the print image data and the input screen data for each print job.

[0015] An information processing system of an eleventh aspect is the information processing system of the third aspect, wherein the processor stores original data of the print image data in association with the print image data, and sends the original data in response to the sending request.

[0016] The information processing program of the twelfth aspect causes a computer to link generated data generated based on input by a user to an input screen of an information processing device with input screen data, which is a video or multiple still images recording the user's input procedures to the input screen, and store them in a memory unit.

[0017] An information processing method of a thirteenth aspect generates generated data based on input by a user to an input screen of an information processing device, and stores the generated data in a memory unit in association with input screen data, which is a video or a plurality of still images that record the user's input procedures on the input screen. [Effects of the Invention]

[0018] According to the information processing system of the first aspect, the information processing program of the twelfth aspect, and the information processing method of the thirteenth aspect, the operation log of the information processing device can be stored in a form other than text.

[0019] According to the information processing system of the second aspect, the operation log of the image forming apparatus can be stored in a form other than text.

[0020] According to the information processing system of the third aspect, the amount of data can be reduced compared to when print image data is not combined with a moving image.

[0021] According to the information processing system of the fourth aspect, it is easier to understand the operation details compared to when only the operation is recorded using still images.

[0022] According to the information processing system of the fifth aspect, the operation records can be classified for each user.

[0023] According to the information processing system of the sixth aspect, users other than the designated user cannot view the protected information.

[0024] According to the information processing system of the seventh aspect, the protection process can be simplified compared to when a portion including protection information is specified as a protection area.

[0025] According to the information processing system of the eighth aspect, the area other than the protected area in the print image data can be reproduced in the same manner as the original data.

[0026] According to the information processing system of the ninth aspect, the load of data recording can be reduced compared to when the recording amount is not limited.

[0027] According to the information processing system of the tenth aspect, it is easier to understand the relationship between input operations and print results compared to when input screen data recorded collectively from multiple print jobs is linked to the print image data of each job.

[0028] According to the information processing system of the eleventh aspect, the sender of the sending request can compare the original data with the print image data. [Brief explanation of the drawings]

[0029] [Figure 1] FIG. 2 is a block diagram illustrating an example of an electrical configuration of the information processing system according to the embodiment. [Figure 2]FIG. 1 is a block diagram illustrating an example of a functional configuration of an information processing system according to an embodiment. [Figure 3A] 1A and 1B are schematic diagrams illustrating an example of print image data and its original data generated in an information processing system according to an embodiment. [Figure 3B] 10 is a schematic diagram showing a state in which original data and print image data are combined with input screen data in the information processing system according to the embodiment; [Figure 4A] FIG. 1 is a schematic diagram illustrating an example of a protection process in an information processing system according to an embodiment. [Figure 4B] FIG. 10 is a schematic diagram showing another example of protection processing in the information processing system according to the embodiment. [Figure 5] 10 is a flowchart illustrating an example of a data generation process in the image forming apparatus. [Figure 6] 10 is a flowchart illustrating an example of a data storage process in the information processing system according to the embodiment. [Figure 7] 10 is a flowchart showing an example of data processing and sending processing in the information processing system according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0030] Hereinafter, an information processing system, an information processing program, and an information processing method according to embodiments of the present disclosure will be described with reference to the drawings. Components indicated by the same reference numerals in the drawings are the same components. However, unless otherwise specified in the specification, each component is not limited to one, and multiple components may exist.

[0031] Furthermore, descriptions of overlapping configurations and symbols in each drawing may be omitted. Note that the present disclosure is not limited to the following embodiments, and may be implemented by making appropriate modifications, such as omitting configurations, replacing them with different configurations, or combining one embodiment with various modified examples, within the scope of the purpose of the present disclosure.

[0032] <Information Processing System> 1 is a system built on a server 40 that can communicate with at least one image forming apparatus 20 via a network. In this disclosure, the term "system" includes a system built on a single apparatus, a system built on multiple apparatuses, and a system built on a higher-level apparatus or system.

[0033] That is, the information processing system of the present disclosure may be constructed across multiple devices other than the server 40. For example, the information processing system 80 of the present embodiment may be constructed to include the image forming device 20.

[0034] In addition, the various processes executed by the information processing system 80 can also be executed on the cloud, an on-premise server, an edge server, an end point, or the like.

[0035] As will be described in detail later, the information processing system 80 is a system that records the operation log of the image forming apparatus 20 in a form other than text and can link and manage the print image data of the printout generated based on the operation with the operation log. Note that the print image data is an example of generated data in the present disclosure.

[0036] Furthermore, the information processing system 80 can send print image data and an operation log to the terminal 50 connected via the network in a state that can be viewed by the user of the terminal 50.

[0037] The terminal 50 is, for example, a personal terminal used by an operator who can be contacted by the user of the image forming apparatus 20 via a network, telephone, etc. The terminals 50 that can communicate with the information processing system 80 are determined in advance.

[0038] <Image forming device> The image forming apparatus 20 according to the present embodiment is an example of an information processing apparatus in the present disclosure, and accepts jobs input by a user and executes the specified jobs. One example of a job executed by the image forming apparatus 20 is a print job that forms an original image generated from a scanned original or the like on a recording medium such as paper.

[0039] The document to be read by the image forming apparatus 20 may be a document set in an image reading unit 26 (to be described later), or may be a document obtained from a network via a communication unit 32 (to be described later).

[0040] The image forming device 20 is formed with an image forming unit 22, an input unit 24, an image reading unit 26, an output unit 28, a recognition unit 30, and a communication unit 32. The image forming device 20 also has a CPU (Central Processing Unit: processor), and various processes executed by the image forming device 20 are performed by this CPU.

[0041] (Image forming section) The image forming unit 22 forms an original image generated by an image reading unit 26 (not shown) on a recording medium such as paper using, for example, an electrophotographic method or an inkjet recording method.

[0042] (Input section) The input unit 24 is an interface that allows a user to input a job to be executed by the image forming apparatus 20, and includes a display unit 24A and an operation unit 24B.

[0043] The display unit 24A is a display screen configured by combining, for example, a touch panel with a liquid crystal display or an organic EL display, etc. Images, etc. are displayed on the display unit 24A in response to touch operations by the user and processing of the image forming device 20, etc. The operation unit 24B is an operation key, operation button, power button, etc. provided on the image forming device 20.

[0044] A user can specify job details and input instructions to execute a job to image forming apparatus 20 by touching display unit 24A. Note that some of the user's input operations may be performed via operation unit 24B. Information input via input unit 24 may be collectively referred to as "input information" in the following description.

[0045] (Image reading unit) The image reading unit 26 includes a CCD (Charge-Coupled Device) image sensor and the like that reads a document set on a paper tray (not shown) of the image forming apparatus 20 and generates a document image.

[0046] The paper tray is, for example, a paper tray provided in a duplexing auto document feeder (DADF) installed at the upper end of the image forming apparatus 20. The paper tray may also be a manual paper tray provided on the side of the image forming apparatus 20.

[0047] (output section) Output unit 28 is configured to include a paper output tray provided on the side of image forming apparatus 20. An output object on which an original image has been formed in image forming unit 22 is output to the paper output tray. Output unit 28 may be provided with only one paper output tray or multiple paper output trays.

[0048] (Identification section) The identification unit 30 is a reading device that reads a user ID. The user ID is personal identification information that is uniquely assigned to each user as an identifier for identifying the user who uses the image forming apparatus 20.

[0049] The user ID may be read from a card on which the user ID is stored, or may be input by operating the input unit 24. After logging in to the image forming apparatus 20 by reading the user ID, the user can instruct the image forming apparatus 20 to execute a desired job and then log out via the input unit 24, for example.

[0050] (Communications Department) The communication unit 32 is an interface for connecting the image forming apparatus 20 to a server 40 provided outside the image forming apparatus 20 and various terminals used by users so that they can communicate with each other via a network.

[0051] The communication unit 32 sends information acquired by and generated by the image forming device 20 to the server 40. The communication unit 32 may also acquire, from the network, "original data" that will become the manuscript of the printed matter. The original data acquired from the network is stored in the memory of the image forming device 20.

[0052] <Server> The server 40 has the same configuration as a general computer, and is configured with a control device 10.

[0053] (Control device) As will be described in more detail later, the control device 10 records the operation log of at least one image forming device 20 connected via the network in a form other than text, and manages the operation log in association with the print image data of the printed matter generated based on the operation.

[0054] (Electrical configuration of the control device) The control device 10 includes a CPU 11, a memory 12 as a temporary storage area, a non-volatile storage unit 13, an input unit 14, a display unit 15 such as a liquid crystal display, a medium read / write device (R / W) 16, a communication interface (I / F) unit 18, and an external I / F unit 19. The CPU 11, memory 12, storage unit 13, input unit 14, display unit 15, medium read / write device 16, communication I / F unit 18, and external I / F unit 19 are connected to one another via a bus B1.

[0055] The CPU 11 controls the overall operation of the control device 10. The medium reading / writing device 16 reads information written in the recording medium 17 and writes information to the recording medium 17. The communication I / F unit 18 is an interface for communicatively connecting the control device to, for example, a server provided outside the control device 10 or various terminals used by users. The communication I / F unit 18 uses communication standards such as Wi-Fi (registered trademark), Bluetooth (registered trademark), and LAN (Local Area Network).

[0056] (Storage part) The storage unit 13 is realized by an HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, or the like. An information processing program 13A is stored in the storage unit 13 as a storage medium. The information processing program 13A is stored in the storage unit 13 by setting a recording medium 17 on which the information processing program 13A is written in the medium reading and writing device 16 and having the medium reading and writing device 16 read the information processing program 13A from the recording medium 17. The CPU 11 reads the information processing program 13A from the storage unit 13, expands it in the memory 12, and sequentially executes the processes of the information processing program 13A. A job information database 13B, which will be described later, is stored in the storage unit 13.

[0057] (Input section) The input unit 14 is used to input various types of information. As an example, the input unit 14 is used by an administrator of the information processing system to execute operations for starting and ending the information processing program 13A.

[0058] (Display) The display unit 15 is used to display various types of information. For example, the display unit 15 displays information for starting and ending the information processing program 13A.

[0059] (Functional configuration of the control device) Next, the functional configuration of the control device 10 according to this embodiment will be described with reference to Fig. 2. As shown in Fig. 2, the control device 10 includes an acquisition unit 11A, an execution unit 11B, and a transmission unit 11C. The CPU 11 of the control device 10 executes an information processing program 13A to function as the acquisition unit 11A, the execution unit 11B, and the transmission unit 11C.

[0060] (Acquisition Department) Acquisition of image data The acquiring unit 11A acquires from the image forming device 20 “print image data” of a printout generated based on a user's input to the input unit 24 of the image forming device 20 (specifically, the display unit 24A, which is an input screen).

[0061] The acquisition unit 11A also acquires from the image forming apparatus 20 image data that is the “original data” of the print image data.

[0062] The "original data" refers to manuscript data of print image data, and is generated by the image reading unit 26 of the image forming device 20 in response to a user's instruction to execute a print job via the input unit 24 of the image forming device 20. An example of such original data is manuscript data generated during copying.

[0063] The "original data" may also be manuscript data that is generated by a user using a personal terminal and acquired from a network by the communication unit 32. An example of such original data is manuscript data for printing.

[0064] On the other hand, "print image data" is product data that indicates the appearance of a print created from "original data."

[0065] 3A, the user issues an instruction to execute "4-up printing" for original document data P1 in which images A and B are arranged vertically, via input unit 24. In this case, the print image data P2 is data in which four sets of reduced original data P1 are laid out on paper.

[0066] · Acquisition of input screen data The acquiring unit 11A acquires an operation log from the image forming apparatus 20. Specifically, the acquiring unit 11A acquires, from the image forming apparatus 20, "input screen data," which is a moving image or a plurality of still images recording an input procedure by a user to the input unit 24 of the image forming apparatus 20, as an operation log.

[0067] The "input screen data" records the input procedure when the user issues an instruction to execute, for example, the above-mentioned "4-up printing."

[0068] The "video" input screen data is data that records the transition of the display screen of the input unit 24 as a video. This input screen data may be processed so that the part touched by the user can be visually recognized. Examples of processing include a process that changes the color of the touched part over the duration of the touch.

[0069] On the other hand, the input screen data of "plurality of still images" is data in which the transition of the display screen of the input unit 24 is recorded as plural still images. The plural still images are stored for each screen on which the user has performed a touch operation. This input screen data may be processed so that the part on which the user has performed a touch operation can be visually recognized.

[0070] When input screen data is generated from multiple still images, if the input screen is scrolled in response to a print instruction via the input unit 24, information indicating that the input screen has been scrolled is obtained as part of the input screen data.

[0071] As an example, "information indicating that the input screen has been scrolled" is information that includes still images of the input screen before and after scrolling, and tagging information indicating "before scrolling" and "after scrolling" that is assigned to each still image.

[0072] Generation of input screen data by the image forming device 20 starts when information is input to the input unit 24 after the recognition unit 30 reads the user ID, and ends when the user logs out. The memory unit 13 of the control device 10 in the server 40 stores these "print image data," "original data," and "input screen data" in association with each job.

[0073] When a user inputs multiple jobs, input screen data may be generated for each job. Specifically, the first input screen data starts when the recognition unit 30 reads the user ID and ends when the execution of the first job is completed.

[0074] The second input screen data is started in response to a new input operation other than logout, and ends when the execution of the second job is completed. If you log out before entering a new operation, new input screen data will not be generated.

[0075] When multiple jobs are input to the image forming apparatus 20, the acquisition unit 11A acquires the "print image data," "original data," and "input screen data" for each job. The storage unit 13 stores the "print image data," "original data," and "input screen data" in association with each job.

[0076] Acquisition of personally identifiable information The acquisition unit 11A acquires the user ID, which is personal identification information, in response to reading of the user ID by the identification unit 30 of the image forming device 20. In addition to the "print image data," "original data," and "input screen data," the storage unit 13 stores the "user ID" in association with each job.

[0077] In addition to the user ID, the acquisition unit 11A acquires “login information” indicating that the user has logged in to the image forming apparatus 20. Furthermore, the acquisition unit 11A acquires “logout information” indicating that the user has logged out of the image forming apparatus 20.

[0078] ·Getting a sending request The acquisition unit 11A acquires from a predetermined terminal 50 a "send request" for the "print image data," "original data," and "input screen data."

[0079] (Executive Department) ·Perform image synthesis When the acquisition unit 11A acquires the above-mentioned sending request, the execution unit 11B combines the original data and print image data with the input screen data of the "moving image" acquired by the acquisition unit 11A.

[0080] As an example of the combining method, the execution unit 11B combines the original data P1 with the portion of the input screen data Q1 immediately after the document has been scanned in response to a user's print execution instruction, as shown in Fig. 3B. The execution unit 11B also combines the print image data P2 with the portion of the input screen data Q1 immediately after the document has been printed.

[0081] The execution unit 11B may combine the print image data with the input screen data of the “moving image” acquired by the acquisition unit 11A, without combining the original data. In this case, the acquisition unit 11A does not necessarily need to acquire the original data.

[0082] Furthermore, the execution unit 11B may not combine either the original data or the print image data with the input screen data of the "moving image" acquired by the acquisition unit 11A.

[0083] Furthermore, for a job in which the acquisition unit 11A acquires input screen data of "still image" but does not acquire input screen data of "moving image," the execution unit 11B does not combine the original data and print image data with the input screen data.

[0084] - Executing protection actions The execution unit 11B executes a "protection process" to make the protected information included in the print image data invisible. "Protected information" is information that should not be known to users other than the user who instructed the execution of the print job, such as personal information of the user.

[0085] For example, if image B in the original data P1 shown in Fig. 3A contains protection information, the execution unit 11B generates protected image data P3 shown in Fig. 4A as an example of protection processing. The protected image data P3 is image data in which the "original data portion" included in the print image data P2 is replaced with a substitute image C.

[0086] Alternatively, as another example of protection processing, the execution unit 11B may generate protected image data P4 shown in Fig. 4B. The protected image data P4 is image data in which "image B, which is the protected area" in the print image data P2 has been replaced with alternative image C. In other words, the execution unit 11B replaces only the protected area of ​​the original data with alternative image C.

[0087] At this time, the execution unit 11B identifies a portion of the original data that includes protection information (image B) as a protected area. The execution unit 11B executes OCR (Optical Character Recognition) processing and a determination program on the original data to identify the protected area.

[0088] The determination program is a program that determines whether or not protected information is included in text information and identifies the part that includes protected information, and is stored in the storage unit 13.

[0089] As another example of the protection process, in addition to the above protection process, the execution unit 11B does not send the original data to the terminal 50. Alternatively, when sending the original data to the terminal 50, the execution unit 11B replaces the original data to be sent with the substitute image C, or replaces the protected area with the substitute image C.

[0090] The protection process can be instructed to be executed by the user via the input unit 24 of the image forming apparatus 20. The instruction to execute the protection process does not have to be given at the same time as the instruction to execute the job. After instructing to execute a job, the user can subsequently specify the job for which the protection process is to be executed via the input unit 24 (hereinafter, this may be referred to as a "protection process request").

[0091] In this case, the protection processing request is acquired by the acquisition unit 11A, and is further linked to a data group that includes the linked "print image data," "original data," "input screen data," and "user ID," and is stored in the job information database 13B.

[0092] - Implementing memory capacity limits The execution unit 11B executes a "storage amount limit" that limits the recording amount of a data group including print image data, original data, and input screen data.

[0093] As an example of limiting the storage capacity, the execution unit 11B deletes the data group of the job after a predetermined storage period has elapsed since the job was input. The administrator can set any period as the storage period.

[0094] As another example of limiting the storage capacity, the execution unit 11B deletes the data group of the oldest job after the total data volume of the data group exceeds a predetermined capacity, which can be set by the administrator to any value.

[0095] -Perform image synthesis When the acquisition unit 11A acquires the above-mentioned sending request, the execution unit 11B combines the original data and print image data with the input screen data of the "moving image" acquired by the acquisition unit 11A.

[0096] As an example of the combining method, the execution unit 11B combines the original data P1 with the portion of the input screen data Q1 immediately after the document has been scanned in response to a user's print execution instruction, as shown in Fig. 3B. The execution unit 11B also combines the print image data P2 with the portion of the input screen data Q1 immediately after the document has been printed.

[0097] The execution unit 11B may combine the print image data with the input screen data of the “moving image” acquired by the acquisition unit 11A, without combining the original data. In this case, the acquisition unit 11A does not necessarily need to acquire the original data.

[0098] Furthermore, the execution unit 11B may not combine either the original data or the print image data with the input screen data of the "moving image" acquired by the acquisition unit 11A.

[0099] Furthermore, for a job in which the acquisition unit 11A acquires input screen data of "still image" but does not acquire input screen data of "moving image," the execution unit 11B does not combine the original data and print image data with the input screen data.

[0100] (Transmission section) The sending unit 11C sends to the terminal 50 the input screen data of the "moving image" generated by the execution unit 11B and in which the original data and the print image data are combined.

[0101] Alternatively, the sending unit 11C can send input screen data of the "moving image" combined with the print image data, which is generated by the execution unit 11B, to the terminal 50. In this case, the sending unit 11C may send the original data as data separate from the input screen data, or may not send the original data.

[0102] Alternatively, the sending unit 11C can send the input screen data of the “moving image” acquired by the acquisition unit 11A and print image data separate from the input screen data to the terminal 50. In this case, the sending unit 11C may or may not send the original data.

[0103] Alternatively, the sending unit 11C can send the input screen data and print image data of the "still image" acquired by the acquisition unit 11A to the terminal 50. At this time, the sending unit 11C may or may not send the original data.

[0104] <Data generation process> When the identification unit 30 of the image forming apparatus 20 reads the user ID, which is personal identification information, the CPU of the image forming apparatus 20 executes the "data generation process" shown in FIG.

[0105] When the data generation process is executed, in step S102, the CPU of the image forming apparatus 20 (hereinafter referred to as "CPU") waits for input information to be acquired. If the CPU acquires the input information, the process proceeds to step S104. If the CPU does not acquire execution instruction information, the process proceeds to step S114.

[0106] In step S104, the CPU starts generating input screen data. Specifically, it starts recording a moving image or a plurality of still images on the display unit 24A of the input unit 24. After step S104, the process proceeds to step S106.

[0107] In step S106, the CPU waits for the document to be scanned by the image reading unit 26. When the scan is completed, the process proceeds to step S108, where the original data (document data of print image data) generated from the scanned image is stored. After step S108, the process proceeds to step S110.

[0108] In step S110, the CPU waits for completion of the print job by the output unit 28. When the print job is completed, the process proceeds to step S112.

[0109] In step S112, the CPU acquires the print image data. The CPU also stops generating the input screen data. The CPU then sends the original data, the print image data, and the input screen data to the server 40. After step S112, the process proceeds to step S114.

[0110] In step S114, the CPU determines whether or not logout information has been acquired. If the determination in step S114 is affirmative, the data generation process ends. On the other hand, if the determination in step S114 is negative, the process returns to step S102.

[0111] <Data storage processing> In response to acquiring the user's login information from the image forming apparatus 20, the CPU 11 of the control device 10 in the server 40 starts the "data storage process" shown in FIG.

[0112] When the data storage process is executed, in step S202, the CPU 11 determines whether or not the original data, print image data, and input screen data have been acquired from the image forming apparatus 20. If the determination in step S202 is affirmative, the process proceeds to step S204. On the other hand, if the determination in step S202 is negative, the process proceeds to step S206.

[0113] In step S204, the CPU 11 associates and stores the original data, print image data, input screen data, and user ID acquired from the image forming apparatus 20. After step S204, the process proceeds to step S206.

[0114] In step S206, the CPU 11 determines whether or not logout information has been acquired from the image forming apparatus 20. If the determination in step S206 is affirmative, the data storage process ends. On the other hand, if the determination in step S206 is negative, the process returns to step S202.

[0115] <Data storage processing> In response to receiving a sending request from the terminal 50, the CPU 11 of the control device 10 in the server 40 starts the "data processing and sending process" shown in FIG.

[0116] When the data processing and sending process is executed, in step S302, the CPU 11 reads the data group (original data, print image data, input screen data, and user ID) of the job for which sending has been requested from the storage unit 13. After step S302, the process proceeds to step S304.

[0117] In step S304, the CPU 11 determines whether a protection processing request is associated with the data group of the job requested to be sent. If the determination in step S304 is affirmative, the process proceeds to step S306. On the other hand, if the determination in step S304 is negative, the process proceeds to step S308.

[0118] In step S306, the CPU 11 performs protection processing on the acquired print image data to generate protected image data. After step S306, the process proceeds to step S308.

[0119] In step S308, CPU 11 determines whether the acquired input screen data is a moving image. If the determination in step S308 is affirmative, the process proceeds to step S310. On the other hand, if the determination in step S308 is negative, that is, if the input screen data is a still image, the process proceeds to step S312.

[0120] In step S310, the CPU 11 combines the original data and print image data with the input screen data. If the determination in step S304 is affirmative, the protected image data is combined with the input screen data instead of the print image data, and the original data is not combined with the input screen data. After step S310, the process proceeds to step S312.

[0121] In step S312, the CPU 11 sends the data to the terminal 50. At this time, if the determination is affirmative in step S304 and a positive determination in step S308, input screen data of the moving image combined with the protected image data is sent to the terminal 50. Alternatively, if the determination is affirmative in step S304 and a negative determination in step S308, input screen data of the protected image data and the still image is sent to the terminal 50. Alternatively, if the determination is negative in step S304 and a positive determination in step S308, input screen data of the moving image combined with the original data and print image data is sent to the terminal 50. Alternatively, if the determination is negative in step S304 and a negative determination in step S308, input screen data of the original data, print image data, and still image data is sent to the terminal 50. After the data is sent, the data processing and sending process ends.

[0122] <Interrelationships between each process> When a user of the image forming apparatus 20 instructs execution of a print job, a "data generation process" shown in Fig. 5 is executed by the image forming apparatus 20. In conjunction with this data generation process, a "data storage process" shown in Fig. 6 is executed by the control device 10 of the server 40.

[0123] If the output printout is different from the intended printout, for example, if 4-up printing is produced despite the intended 2-up printing, the user of the image forming device 20 can inquire of the operator.

[0124] If the printout contains protection information, the user can issue a protection processing instruction via the image forming apparatus 20 before contacting the operator.

[0125] When an operator receives an inquiry, he or she operates the terminal 50 to request that the data of the job for which the inquiry is made be sent to the server 40. This causes the "data processing and sending process" shown in FIG.

[0126] By checking the input screen data of the video or still image acquired by the terminal 50, the operator can understand the details of the input process made by the user of the image forming device 20 to the input unit 24. This allows the operator to inform the user of the image forming device 20 of the reason why the output printout is different from the intended printout.

[0127] <Action and effect> In the information processing system 80 of the present disclosure, print image data of a printed matter generated based on input by a user to the input unit 24 (display unit 24A) of the image forming device 20 and input screen data, which is a video or multiple still images recording the input procedures by the user to the input unit 24, are linked to each other and stored in the memory unit 13.

[0128] In this way, the information processing system 80 can record the operation log of the image forming apparatus in a format other than text (that is, a video or a plurality of still images).

[0129] Furthermore, in the information processing system 80 of the present disclosure, when the input screen data acquired from the image forming device 20 is a moving image, the print image data is composited with the acquired moving image. This reduces the load of data recording and the memory consumption of the storage unit 13 compared to when the print image data is not composited with the moving image. Furthermore, the amount of data sent to the terminal 50 can be reduced.

[0130] Furthermore, in the information processing system 80 of the present disclosure, when the input screen data acquired from the image forming device 20 consists of a plurality of still images and the display unit 24A is scrolled in response to a print instruction, information indicating that the input screen has been scrolled is stored as part of the input screen data in the storage unit 13. This makes it easier for the operator to understand the operation details compared to when only operation records are made using still images.

[0131] Furthermore, the information processing system 80 of the present disclosure further acquires and stores personal identification information of the user who issued the print instruction, thereby enabling the operation records to be classified by user.

[0132] Furthermore, the information processing system 80 of the present disclosure executes a protection process that makes the protected information included in the print image data invisible, thereby preventing users other than the user who issued the print instruction, such as the operator of the terminal 50, from viewing the protected information.

[0133] As shown in Fig. 4A, the information processing system 80 can replace the original data included in the print image data with substitute image data as a protection process, which simplifies the protection process compared to when a portion including protection information is specified as a protection area, as shown in Fig. 4B.

[0134] On the other hand, the information processing system 80 can also identify the portion containing the protection information as a protection area and replace the protection area with substitute image data, as shown in Fig. 4B. In this case, the area other than the protection area can be reproduced in the print image data in the same manner as the original data.

[0135] Furthermore, the information processing system 80 of the present disclosure limits the amount of data recorded for a data group that includes original data, print image data, and input screen data. This reduces the data recording load compared to when the amount of data recorded is not limited.

[0136] Furthermore, in the information processing system 80 of the present disclosure, when multiple print jobs are input to the image forming apparatus 20, the original data, print image data, and input screen data are linked and stored for each print job. This makes it easier to understand the relationship between input operations and print results compared to when input screen data for multiple print jobs is recorded together and linked to the print image data of each job.

[0137] Furthermore, in the information processing system 80 of the present disclosure, the original data of the print image data is stored in association with the print image data, and the original data is sent in response to a sending request from the terminal 50. This allows the operator of the terminal 50, who is the sender of the sending request, to compare the original data with the print image data.

[0138] <Other embodiments> In the above embodiment, the image forming device 20 is used as the information processing device, and the print image data of the printed matter is used as the generated data, but the embodiment of the present disclosure is not limited to this. For example, a smartphone or tablet terminal carried by a user may also be used as the information processing device.

[0139] In this case, examples of generated data generated based on user input to the input screen of the information processing device include various setting data for a smartphone and various data generated using applications installed on the smartphone.

[0140] The information processing device may be an image forming device 20 or a home appliance that uses a smartphone or the like as an input screen. That is, the information processing device of the present disclosure may be a smartphone itself or various devices operated by a smartphone.

[0141] In the above embodiment, the acquiring unit 11A acquires information indicating that the input screen has been scrolled when the input screen data includes multiple still images, but the embodiment of the present disclosure is not limited to this. Such information does not necessarily have to be generated or acquired.

[0142] In the above embodiment, the acquisition unit 11A acquires the personal identification information of the user who issued the print instruction, but the embodiment of the present disclosure is not limited to this. Even if the personal identification information is not acquired, the user can inquire of the operator using a job ID or the like assigned to each print job.

[0143] In addition, in the above embodiment, the execution unit 11B executes a protection process that makes the protection information included in the print image data invisible, but the embodiment of the present disclosure is not limited to this. Such a protection process does not necessarily have to be executed.

[0144] In addition, in the above embodiment, the execution unit 11B limits the recording amount of the data group including the print image data and the input screen data, but the embodiment of the present disclosure is not limited to this. Such a limit does not necessarily have to be implemented.

[0145] In the above embodiment, when multiple print jobs are input to the image forming apparatus 20, input screen data is generated for each print job, and the print image data and the input screen data are linked and stored, but the embodiment of the present disclosure is not limited to this. For example, input screen data for multiple print jobs may be generated collectively.

[0146] In the various embodiments described above, if the operation log of the image forming apparatus 20 by the user is recorded in a form other than text, it is easier for the operator of the terminal 50 to understand the operation content compared to when the operation log is recorded in text.

[0147] Furthermore, in the above embodiment, the sending unit 11C sends the input screen data and print image data to the terminal 50, but the embodiment of the present disclosure is not limited to this. Each piece of data stored in the storage unit 13 can be read into a recording medium and extracted, even if it is not sent by the sending unit 11C.

[0148] Furthermore, in the above embodiment, for example, the following various processors can be used as the hardware structure of the processing unit that executes the processes of the acquisition unit 11A, the execution unit 11B, and the transmission unit 11C. As described above, the various processors include a CPU, which is a general-purpose processor that executes software (programs) and functions as a processing unit, as well as dedicated electrical circuits that are processors having a circuit configuration specifically designed to execute specific processes, such as a programmable logic device (PLD), which is a processor whose circuit configuration can be changed after manufacture, such as an FPGA (Field-Programmable Gate Array), and an ASIC (Application Specific Integrated Circuit).

[0149] The processing unit may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). The processing unit may also be configured with a single processor. Some or all of these processors may be configured on the cloud. At least each of the processes described in the above embodiments may be executed by a processor on the cloud.

[0150] Examples of configuring a processing unit with a single processor include, first, a form in which one processor is configured with a combination of one or more CPUs and software, and this processor functions as the processing unit, as typified by computers such as client and server. Second, a form in which a processor is used to realize the functions of the entire system, including the processing unit, on a single IC (Integrated Circuit) chip, as typified by systems on chips (SoCs). In this way, the processing unit is configured using one or more of the above-mentioned various processors as a hardware structure.

[0151] Furthermore, the hardware structure of these various processors may be, more specifically, an electric circuit that combines circuit elements such as semiconductor elements. As such, the present disclosure may be implemented in various ways.

[0152] <Additional Notes> (((1))) at least one processor; The processor: generated data generated based on an input by a user to an input screen of the information processing device; input screen data, which is a moving image or a plurality of still images recording an input procedure by a user on the input screen; are linked to each other and stored in the memory unit, Information processing system.

[0153] (((2))) the information processing device is an image forming device, the generated data is print image data of a printed matter, and when a request to send the input screen data and the print image data is received from a predetermined terminal, the processor sends the acquired input screen data and the print image data. The information processing system according to (((1))).

[0154] (((3))) the input screen data is a video; The processor: When the sending request is received, the print image data is synthesized with the acquired moving image and sent. The information processing system according to (((2))).

[0155] (((4))) the input screen data includes a plurality of still images, The processor: When the input screen is scrolled during print instruction, further storing information indicating that the input screen has been scrolled as part of the input screen data in the storage unit; The information processing system according to (((2))).

[0156] (((5))) The processor: Further, personal identification information of the user who issued the print instruction is acquired. The information processing system according to any one of (((2))) to (((4))).

[0157] (((6))) The processor: performing a protection process to make the protection information included in the print image data invisible; The information processing system according to any one of (((2))) to (((5))).

[0158] (((7))) The processor: As the protection treatment, replacing original data included in the print image data with substitute image data; The information processing system according to (((6))).

[0159] (((8))) The processor: As the protection treatment, Identifying a portion of the original data that includes the protection information as a protection area; replacing the protected area included in the print image data with alternative image data; The information processing system according to (((6))).

[0160] (((9))) The processor: limiting the recording amount of a data group including the print image data and the input screen data; An information processing system according to any one of (((2))) to (((8))).

[0161] (((10))) The processor: When a plurality of print jobs are input to the image forming apparatus, the print image data and the input screen data are stored in association with each other for each print job; The information processing system according to any one of (((2))) to (((8))).

[0162] (((11))) The processor: The original data of the print image data is stored in association with the print image data; Sending the original data in response to the sending request. The information processing system according to (((3))).

[0163] (((12))) generated data generated based on an input by a user to an input screen of the information processing device; input screen data, which is a moving image or a plurality of still images recording an input procedure by a user on the input screen; are linked to each other and stored in the memory. An information processing program executed by a computer.

[0164] (((13))) generating generated data based on an input by a user to an input screen of the information processing device; The information processing method includes storing the generated data and input screen data, which is a video or a plurality of still images recording an input procedure by a user on the input screen, in association with each other in a storage unit.

[0165] According to the information processing system (((1))), the information processing program (((12)) and the information processing method (((13))), the operation log of the information processing device can be stored in a form other than text.

[0166] According to the information processing system of (((2))), the operation log of the image forming apparatus can be stored in a form other than text.

[0167] According to the information processing system (((3))), the amount of data can be reduced compared to when print image data is not combined with a moving image.

[0168] According to the information processing system (((4))), it is easier to understand the operation details compared to when the operation is recorded only using still images.

[0169] According to the information processing system of (((5))), operation records can be classified by user.

[0170] According to the information processing system (((6))), users other than the designated user cannot view the protected information.

[0171] According to the information processing system (((7))), the protection process can be simplified compared to when a portion including protection information is specified as a protection area.

[0172] According to the information processing system (((8))), the area other than the protected area in the print image data can be reproduced in the same manner as the original data.

[0173] According to the information processing system (((9))), the load of data recording can be reduced compared to when the recording amount is not limited.

[0174] According to the information processing system (((10))), it is easier to understand the relationship between input operations and print results compared to when input screen data recorded collectively from multiple print jobs is linked to the print image data of each job.

[0175] According to the information processing system (((11))), the sender of the sending request can compare the original data with the print image data. [Explanation of symbols]

[0176] 11 CPU (processor) 13 Storage section 20 Image forming device (information processing device) 24 Input section (input screen) 24A Display (input screen) 50 devices 80 Information Processing Systems C. Alternative image (alternative image data) P1 Original data P2 print image data P3 Protected image data P4 Protected image data Q1 Input screen data

Claims

1. at least one processor; The processor: generated data generated based on an input by a user to an input screen of the information processing device; input screen data, which is a moving image or a plurality of still images recording an input procedure by a user on the input screen; are linked to each other and stored in the memory unit, Information processing system.

2. the information processing device is an image forming device, the generated data is print image data of a printed matter, The processor: When a request to send the input screen data and the print image data is received from a predetermined terminal, the acquired input screen data and the print image data are sent. The information processing system according to claim 1 .

3. the input screen data is a video; The processor: When the sending request is received, the print image data is synthesized with the acquired moving image and sent. The information processing system according to claim 2 .

4. the input screen data includes a plurality of still images, The processor: When the input screen is scrolled during print instruction, further storing information indicating that the input screen has been scrolled as part of the input screen data in the storage unit; The information processing system according to claim 2 .

5. The processor: Further, personal identification information of the user who issued the print instruction is acquired. The information processing system according to claim 2 .

6. The processor: performing a protection process to make the protection information included in the print image data invisible; The information processing system according to claim 2 .

7. The processor: As the protection treatment, replacing original data included in the print image data with substitute image data; The information processing system according to claim 6.

8. The processor: As the protection treatment, Identifying a portion of the original data that includes the protection information as a protection area; replacing the protected area included in the print image data with alternative image data; The information processing system according to claim 6.

9. The processor: limiting the recording amount of a data group including the print image data and the input screen data; The information processing system according to claim 2 .

10. The processor: When a plurality of print jobs are input to the image forming apparatus, the print image data and the input screen data are stored in association with each other for each print job; The information processing system according to claim 2 .

11. The processor: The original data of the print image data is stored in association with the print image data; Sending the original data in response to the sending request. The information processing system according to claim 3 .

12. generated data generated based on an input by a user to an input screen of the information processing device; input screen data, which is a moving image or a plurality of still images recording an input procedure by a user on the input screen; are linked to each other and stored in the memory. An information processing program executed by a computer.

13. generating generated data based on an input by a user to an input screen of the information processing device; The information processing method includes storing the generated data and input screen data, which is a video or a plurality of still images recording an input procedure by a user on the input screen, in association with each other in a storage unit.

Images