Information processing system, information processing device, and program

Abstract

Provided is an information processing system that collects work logs of a worker at an optimal frequency corresponding to information pertaining to an operation performed by the worker on a work object so as to compress storage size and that makes it possible to view the work logs in a variety of display formats, said information processing system comprising: a collection function of collecting screen images showing the display content on a screen of a worker terminal during a process in which the worker operates the worker terminal so as to affect an object; a determination function of determining, on the basis of information pertaining to an operation performed by the worker on the object during the process, the frequency with which the screen images are collected; and a storage function of providing a storage place for storing the collected screen images. In accordance with the content of work performed by the worker on the object, a change in input amount, and a change in properties of input, a determination means changes the frequency with which the screen images are collected.

Description

Information processing system, information processing device and program

[0001] The present invention relates to an information processing system, an information processing device, and a program.

[0002] An information processing device is known that is configured to execute an acquisition step, an identification step, an extraction step, and a display control step, in which the acquisition step acquires operation information from each of multiple user terminals, the identification step identifies the content of the task and the task execution means for each task based on the operation information and pre-stored reference information, the extraction step extracts the different task execution means as a recommendation target when different task execution means are executed for the same task, and the display control step controls to display notification information including the recommendation target (Patent Document 1).

[0003] A work management system for managing work on a computer is also known, which includes a log collection unit that records a worker's keyboard and mouse operations as log data along with the time and information identifying the worker, a screen collection unit that records the display screen at times including before and after the operation as screen data, and an efficiency calculation unit that calculates the required time for a specified work task from at least one of the log data and the screen data (Patent Document 2).

[0004] JP 2022-177827 A JP 2020-24529 A

[0005] The present invention collects the work logs of the workers at an optimum frequency according to the operation information of the workers on the work objects, compresses the storage capacity, and makes them viewable in a variety of display formats.

[0006] In order to solve the above problem, the information processing system described in claim 1 is characterized by comprising: a collection function that collects screen images representing the display contents of the screen of a worker terminal during a process in which a worker operates the worker terminal to interact with an object; a determination function that determines the frequency of collecting the screen images based on operation information of the worker regarding the object during the process; and a storage function that provides a storage location for storing the collected screen images.

[0007] The invention described in claim 2 is characterized in that, in the information processing system described in claim 1, the decision function changes the frequency of collecting the screen images depending on the work content of the worker on the object.

[0008] The invention of claim 3 is the information processing system of claim 2, characterized in that, when the work content is an operation for exerting a function of the target, the frequency is increased.

[0009] The invention of claim 4 is the information processing system of claim 1, wherein the decision function changes the frequency in accordance with a change in the amount of input by the worker to the target.

[0010] The invention described in claim 5 is characterized in that, in the information processing system described in claim 1, the amount of input is the number of inputs per unit time by the worker to the target, and when the number of inputs increases, the frequency is increased.

[0011] The invention described in claim 6 is the information processing system described in claim 1, characterized in that the decision function changes the frequency in accordance with a change in the nature of the input by the worker to the target.

[0012] The invention described in claim 7 is characterized in that, in the information processing system described in claim 6, the nature of the input includes mouse cursor movement on the screen, and when there is input excluding the mouse cursor movement, the screen image is collected, and when the input stops, the collection of the screen image is stopped.

[0013] The invention described in claim 8 is characterized in that, in the information processing system described in claim 1, the operation information includes the amount of input by operating the keyboard and the amount of movement of the mouse cursor, and further includes a display control function that displays the amount of input, the amount of movement, and the degenerated screen image in a list format for each of the targets.

[0014] The invention of claim 9 is the information processing system of claim 8, wherein the screen image is reproduced by temporal changes of a plurality of frame images collected at the frequency.

[0015] The invention described in claim 10 is characterized in that, in the information processing system described in claim 1, the collection of the screen images is performed by storing the screen images in the storage location, and the storage function determines the frequency of storing the screen images based on operation information of the worker with respect to the object during the process.

[0016] In order to solve the above problem, the information processing device described in claim 11 has a processor, and the processor is characterized in that it determines the frequency of collecting screen images representing the display content of the screen of the worker terminal based on operation information of the worker regarding the object while the worker is operating the worker terminal and interacting with the object.

[0017] In order to solve the above problem, the program described in claim 12 is characterized in that it causes a computer to realize a function of determining the frequency of collecting screen images representing the display contents of the screen of the worker terminal based on operation information of the worker regarding the target while the worker is operating the worker terminal and interacting with the target.

[0018] According to the inventions described in claims 1 and 12, the worker's work log can be collected at an optimal frequency according to the worker's operation information for the work object, thereby compressing the storage capacity and making it possible to view it in a variety of display formats.

[0019] According to the second aspect of the present invention, the frequency of collecting screen images can be optimized depending on the type of work.

[0020] According to the third aspect of the present invention, it is possible to record a screen image of the state in which an operation for exerting the target function is being performed.

[0021] According to the fourth aspect of the present invention, the frequency of collecting screen images can be optimized according to changes in the amount of input.

[0022] According to the fifth aspect of the present invention, it is possible to record screen images when typing activity increases.

[0023] According to the sixth aspect of the present invention, the frequency of collecting screen images can be optimized depending on changes in the nature of the input.

[0024] According to the seventh aspect of the present invention, it is possible to record the screen image only at the moment when a click input is made.

[0025] According to the eighth aspect of the present invention, the work content of the worker can be grasped at a glance.

[0026] According to the ninth aspect of the present invention, the collected screen images can be confirmed as moving images or sequential still images.

[0027] According to the tenth aspect of the present invention, the work log of the worker can be stored at an optimum frequency according to the operation information of the worker on the work object, thereby compressing the storage capacity.

[0028] According to the eleventh aspect of the present invention, the work log of the worker can be collected at an optimum frequency according to the operation information of the worker on the work object.

[0029] FIG. 1 is a diagram illustrating an example of the hardware configuration of an information processing system to which the present embodiment is applied. FIG. 2 is a diagram illustrating an example of the hardware configuration of a worker terminal and a manager terminal according to the present embodiment. FIG. 3 is a diagram illustrating an example of the hardware configuration of a server device according to the present embodiment. FIG. 4 is a diagram illustrating an example of the functional configuration of each device included in an information processing system to which the present embodiment is applied. FIG. 5 is an activity diagram illustrating a flow of collection of screen images by a worker terminal. FIG. 6 is an activity diagram illustrating a flow of storage and transmission of screen images performed in a server device. FIG. 7 is a diagram illustrating an example of the display form of a work log. FIG. 8 is a diagram illustrating an example of the display form of a work log.

[0030] Next, the present invention will be described in more detail below with reference to the drawings, showing embodiments and specific examples, but the present invention is not limited to these embodiments and specific examples. Furthermore, in the following description using the drawings, it should be noted that the drawings are schematic and the ratios of dimensions, etc., are different from those of the actual objects, and for ease of understanding, illustrations other than those necessary for the description are omitted as appropriate.

[0031] (1) Overall configuration of the information processing system The information processing system 1 according to this embodiment includes a screen collection unit 224 that performs a collection function of collecting screen images G that represent the display content on the screen of the worker terminal 20 during the process in which the worker operates the worker terminal 20 to interact with the target, a collection control unit 225 that performs a determination function of determining the frequency at which to collect screen images G based on operation information of the worker on the target during the process, and a server device 30 that performs a storage function of providing a storage location for storing the collected screen images G. By changing the frequency at which screen images G are collected depending on the work content of the worker on the target, changes in the amount of input, and changes in the nature of the input, the screen images G as a work log are collected at an optimal frequency, thereby compressing the storage capacity of the screen images G.

[0032] Here, "target" refers to various programs including application programs (hereinafter sometimes referred to simply as "application"), such as applications for drawing, document creation, spreadsheets, internet searches, etc. Furthermore, "in process" refers to a state in which a worker operates the "target" via an input device such as a keyboard, mouse, or touch panel, such as keystrokes, mouse cursor movements, clicks, flicks, touches, etc.

[0033] Recent applications have been equipped with a graphical user interface (GUI), and when using such applications, a worker checks the displayed GUI and operates the GUI elements, such as windows, labels, buttons, and text boxes. The GUI changes as a result of these operations, so the worker must repeatedly check the changed GUI and operate the GUI elements. To improve the efficiency of operations on such applications, it is considered effective to visualize a log of past operations. A work log is obtained by recording the "screen image" displayed when the worker operates the application.

[0034] (1.1) Hardware Configuration Fig. 1 is a diagram showing an example of the hardware configuration of an information processing system 1 to which this embodiment is applied. The information processing system 1 is configured by connecting multiple worker terminals 20 operated by workers, a server device 30 that stores collected screen images G, and an administrator terminal 40 that is operated by an administrator to view the screen images G stored in the server device 30 via a communication line 50. The communication line 50 is, for example, a line such as the Internet, and is used for information communication between the worker terminals 20, the administrator terminal 40, and the server device 30.

[0035] (1.1.1) Hardware Configuration of Worker Terminal 20 Fig. 2 is a diagram showing an example of the hardware configuration of the worker terminal 20 and the administrator terminal 40 according to this embodiment. The worker terminal 20 is operated by a worker and is composed of a control unit 21 that executes a target application, a display unit 22 that displays a GUI screen that can be operated by the worker, an input unit 23 that accepts operation inputs made by the worker, a communication unit 24 that communicates with the outside world via a wired or wireless connection, and a storage unit 25 that stores programs and the like executed by the control unit 21 and temporary information and the like related to the calculations of the programs and the like, and examples of the worker terminal 20 include a personal computer, a tablet terminal, a smartphone, etc.

[0036] (Control Unit 21) The control unit 21 is composed of a CPU (Central Processing Unit) 21a as an example of a processor that controls the entire device, a ROM (Read Only Memory) 21b in which a BIOS (Basic Input / Output System) and an operating system (OS) executed by the CPU 21a are stored, and a RAM (Random Access Memory) 21c used as a working memory for the CPU 21a. The control unit 21 also executes processes such as acquiring, saving, displaying, and transmitting information through the execution of programs. In this embodiment, the control unit 21 also functions as a screen collection unit 224 that collects screen images G representing the display content of the display unit 22 and a collection control unit 225 that determines the frequency (fps: frames per second) at which the screen images G are collected.

[0037] (Display Unit 22) The display unit 22 is configured, for example, with a liquid crystal display or an OLED (Organic Light Emitting Diode) display, and displays a GUI screen and image data. Specifically, it displays a cursor that indicates a position or image on the screen, and a work screen on which the worker performs work-related processing. The display unit 22 may be included as an integral part of the worker terminal 20, or may be attached externally to the worker terminal 20. Furthermore, the display unit 22 may be formed integrally with the input unit 23 (described later) as a touch panel.

[0038] (Input Unit 23) The input unit 23 is a device operated by an operator, and is, for example, a keyboard, a pointing device, a button, a microphone, a web camera, a switch, etc. Examples of pointing devices include a mouse, a trackball, a touch panel, a pen tablet, etc.

[0039] (Communication Unit 24) The communication unit 24 is configured with a communication interface for communicating with external devices, etc. The worker terminal 20 transmits and receives various information to and from the server device 30 and the manager terminal 40 via the communication unit 24. In particular, the communication unit 24 transmits the screen image G collected by the screen collection unit 224 to the server device 30.

[0040] (Storage Unit 25) The storage unit 25 stores various information including, for example, operation information based on operation inputs made by an operator. This can be implemented as, for example, a storage device such as an SSD (Solid State Drive) that stores various programs related to the operator terminal 20 executed by the control unit 21 as the screen collection unit 224, or a memory such as RAM that stores temporarily required information related to program calculations. The storage unit 25 also has a secondary storage unit 251 realized by, for example, an HDD that temporarily records collected screen image data.

[0041] (1.1.2) Hardware Configuration of Server Device 30 FIG. 3 is a diagram illustrating an example of the hardware configuration of the server device 30 according to this embodiment. The server device 30 includes an arithmetic processing unit 31 that executes arithmetic processing according to a predetermined processing program when storing a screen image G or other processing, a secondary storage unit 32 implemented by a hard disk drive or the like on which screen image data to be stored is recorded, and a communication unit 33 that transmits and receives information via a communication line 50. The arithmetic processing unit 31 includes a CPU 31a that controls the entire device as an example of a processor, a RAM 31b that is used as a working memory for the CPU 31a, and a ROM 31c that stores programs executed by the CPU 31a. The secondary storage unit 32 stores information related to the storage of screen image data, as well as programs executed by the arithmetic processing unit 31. The arithmetic processing unit 31 reads the programs stored in the secondary storage unit 32, thereby executing various processes in the server device 30 according to this embodiment.

[0042] Here, the programs executed by the CPUs 21a and 31a, which are examples of processors, are provided to the control unit 21 and the arithmetic processing unit 31 in a state where they are stored in a computer-readable recording medium such as a magnetic recording medium (magnetic tape, magnetic disk, etc.), an optical recording medium (optical disk, etc.), a magneto-optical recording medium, or a semiconductor memory. The programs executed by the CPUs 21a and 31a may also be downloaded using a communication means such as the Internet. Furthermore, the operations of the processors may not only be performed by a single processor, but may also be performed by multiple processors located in physically separate locations working together.

[0043] (1.1.3) Hardware Configuration of Administrator Terminal 40 The administrator terminal 40 according to this embodiment has the same hardware configuration as the worker terminal 20. The administrator terminal 40 has a control unit 41 that executes processes such as acquiring, saving, displaying, and transmitting information through the execution of a program, a display unit 42 that displays images, text information, and the like to the administrator as a user, an input unit 43 that accepts input operations from the administrator, a communication unit 44 that transmits and receives information via a communication line 50, and a storage unit 45 realized by an HDD or the like in which images, text information, and the like are recorded.

[0044] (1.2) Functional Configuration Fig. 4 is a diagram showing an example of the functional configuration of each device included in the information processing system 1 to which this embodiment is applied. The worker terminal 20 has a display control unit 221 that controls the content to be displayed on the display unit 22, a log collection unit 222 that acquires operation information for an application by the worker, an operation identification unit 223 that identifies the operation of the worker, a screen collection unit 224 that collects screen images G displayed on the display unit 22, a collection control unit 225 that determines the frequency of collecting the screen images G, and a communication control unit 226 that transmits and receives information, and functions as an information processing device that determines the frequency of collecting screen images G that represent the display content on the screen of the worker terminal 20, based on operation information for an application by the worker while the worker is operating the worker terminal 20 and participating in the application.

[0045] (Display control unit) The display control unit 221 controls the content to be displayed on the display unit 22 based on the operation of the worker identified by the operation identification unit 223, the information received via the communication control unit 226, and the content of the program execution performed by the control unit 21.

[0046] (Log Collection Unit) The log collection unit 222 detects operations of the input unit 23 of the worker terminal 20 and records the operations as operation information. Specifically, the log collection unit 222 records the operation information including the work content, input amount, changes in the nature of the input, etc. for each application software that is the object of operation on the worker terminal 20 as log data.

[0047] (Operation Identification Unit) The operation identification unit 223 identifies what kind of operator operation has been performed on the operation screen via the input unit 23. Here, the operator operation refers to, for example, an operation such as clicking to specify an image, various icons, or a position on the operation screen, a scrolling operation, a key input operation, etc.

[0048] (Screen Collection Unit) The screen collection unit 224 captures the screen image G displayed on the display unit 22 of the worker terminal 20 in response to an operation by the worker, and records it as screen image data.

[0049] (Collection Control Unit) The collection control unit 225 determines the frequency of capturing screen images G based on the operation information of the worker identified by the operation identification unit 223. Examples of the operation information of the worker include the work content for the application, changes in the amount of input, and changes in the nature of the input. Specifically, if the work content is an operation that exercises the function of the application, the frequency of capturing screen images G is increased. Furthermore, the amount of input refers to the number of inputs per unit time made by the worker for the application, and if the number of inputs increases, the frequency of capturing screen images G is increased. Furthermore, the nature of the input includes mouse cursor movement on the screen, and a screen image is captured when there is input excluding mouse cursor movement, and capturing of screen images is stopped when the input stops.

[0050] (Communication Control Unit) The communication control unit 226 performs processing related to sending and receiving information via the communication unit 24. For example, the communication control unit 226 sends the screen image G stored in the storage unit 25 to the server device 30. Also, for example, the communication control unit 226 receives information sent from the server device 30 and stores it in the storage unit 25.

[0051] The server device 30 includes a communication control unit 311 for transmitting and receiving information, a screen image management unit 312 for managing received screen images, and a folder 313 as a storage location for the screen images G.

[0052] (Communication Control Unit) The communication control unit 311 performs processing related to sending and receiving information via the communication unit 33. For example, the communication control unit 311 receives a screen image from the worker terminal 20. The communication control unit 311 also transmits the stored screen image to the manager terminal 40 based on an instruction from the manager terminal 40.

[0053] (Screen Image Management) The screen image management unit 312 can display the screen image G and operation information stored in the secondary storage unit 32 in various display formats as the worker's work log. Furthermore, when a request to view the work log is received from the manager terminal 40, the screen image management unit 312 retrieves the specified screen image G and operation information from the secondary storage unit 32. Then, the screen image management unit 312 instructs the communication control unit 311 to transmit the screen image G and operation information to the manager terminal 40.

[0054] (2) Operation of the Information Processing System Fig. 5 is an activity diagram showing the flow of collection of screen images G by the worker terminal 20. The activity diagram describes the system from the perspective of activities (processing) and the control flow between activities. The collection of screen images G executed by the worker terminal 20 as an information processing device will be described below with reference to the activity diagram.

[0055] (A101) The log collection unit 222 operates continuously and acquires operation information related to the worker terminal 20 (A101). Specifically, the log collection unit 222 acquires information such as the worker's work content, input amount, and input nature for an application operated on the worker terminal 20. Examples of the worker's work content include a software developer writing software code, an illustrator creating a drawing using an application, browsing a web page, and checking sent emails. Examples of the input amount include the number of typings, inputs, or actions per unit time. The unit time may be, for example, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 30, or 60 minutes, or may be within a range between any two of the values ​​exemplified here. Examples of the input nature include mouse cursor movement on the screen, clicks after moving the mouse cursor, switching files or applications, etc.

[0056] (A102) The operation identification unit 223 identifies the content of the work, the amount of input for each work, and the nature of the input based on the operation information acquired by the log collection unit 222 and the pre-stored reference information (A102). The operation identification unit 223 also identifies the name of an application related to the identified content of the work.

[0057] (A103) Next, the collection control unit 225 determines the frequency of capturing screen images based on the operation information of the worker identified by the operation identification unit 223 (A103). Examples of the worker's operation information include the work content for the application, changes in the amount of input, and changes in the nature of the input. For example, when the work content is a software developer writing software code, the frequency of screen capture (frames per second (fps)) is controlled to be reduced. When the work content is an illustrator drawing using an application, the frequency of screen capture (fps) is controlled to be increased. The frequency of screen capture (fps) is also determined according to changes in the amount of input by the worker. For example, when the number of typings, inputs, or actions per unit time of the worker increases, the frequency of screen capture (fps) is controlled to be increased. Furthermore, the input nature includes mouse cursor movement on the screen, and the screen image is captured when there is input excluding mouse cursor movement, and the screen image capture is stopped when the input stops.

[0058] (A104) The screen collection unit 224 captures screen images G displayed in response to the worker's operations based on the collection frequency determined by the collection control unit 225 (A104). For example, if the work involves an operation that activates an application function, the frequency (fps) at which screen images G are captured is increased. Furthermore, if the number of inputs per unit time made by the worker to the application increases, the frequency (fps) at which screen images G are captured is increased. Furthermore, if there is a change in the nature of the input, specifically, if there is input excluding mouse cursor movement, the screen image capture is stopped when the input stops. This allows the worker's work log to be collected at an optimal frequency (fps) according to the worker's application operation information, thereby reducing the storage capacity of the work log.

[0059] (A105) The communication control unit 226 transmits the screen image G captured by the screen collection unit 224 to the server device 30 together with the operation information collected by the log collection unit 222 and identified by the operation identification unit 223 (A105).

[0060] 6 is an activity diagram showing the flow of storage and transmission of the screen image G performed in the server device 30. The storage and transmission of the screen image G performed by the server device 30 as an information processing device will be described below with reference to the activity diagram.

[0061] (A201) The communication control unit 311 receives the screen image G and operation information transmitted from the worker terminal 20 and stores them in the folder 313 (A201). If there are multiple worker terminals 20, the screen image G and operation information are stored in a distinguishable manner for each worker terminal 20.

[0062] (A202) The screen image management unit 312 associates the stored screen image G with the operation information, making it possible to display the worker's work log in various display formats (A202). Figures 7, 8, and 9 are diagrams showing examples of display formats for the work log. For example, as shown in Fig. 7, a bar graph P1 showing the number of keyboard operations for each type of key (Backspace, Back, Shortcut, Copy & Paste, etc.) over time is displayed, a line graph P2 showing the amount of mouse cursor movement over time is displayed, the content of the work (work using a specific application, web conference, checking email, internet search, etc.) is displayed with a predetermined icon P3, each captured screen image G is edited to be reproduced as a plurality of frame images over time and displayed as a thumbnail P4, and as shown in Fig. 8, a pie chart P5 shows the total work time of the worker, a pie chart P6 shows the breakdown of the work time (work using a specific application, web conference, checking email, internet search, etc.), the number of shortcut key operations P7 among keyboard operations compared to the previous day, and the number of left clicks P8 and the amount of mouse cursor movement P9 compared to the previous day are displayed. Furthermore, as shown in Fig. 9, the stored screen images G are edited so that they can be displayed as frame images over time.

[0063] (A203) The communication control unit 311 accepts a request to send a work log from the administrator terminal 40 and sends the screen image G and operation information to the administrator terminal 40 in various display formats (A203). Specifically, for example, the input amount per unit time as shown in Figures 7 and 8 can be viewed on a web browser. Also, as shown in Figure 9, the screen image G is displayed as a frame image over time and can be viewed on the administrator terminal 40.

[0064] "Variation" In the above-described embodiment, the worker terminal 20 has a collection control unit 225 that determines the frequency of collecting screen images G that represent the display content on the screen of the worker terminal 20, and a communication control unit 226 that sends and receives information, and is configured to determine the frequency of collecting screen images G based on operation information of the worker with respect to an application while the worker is operating the worker terminal 20 and participating in the application. However, when the server device 30 receives a designation of a screen image G and storage conditions from the worker terminal 20, it may also be configured to store the screen image G and operation information based on the designated storage conditions.

[0065] In this case, the storage conditions are the same as the frequency of capturing screen images G determined by the collection control unit 225 of the worker terminal 20 based on the operation information of the worker, and the screen images G are stored based on the work content of the worker for the application, changes in the amount of input, changes in the nature of the input, etc. In other words, the storage of screen images G performed by the screen image management unit 312 of the server device 30 is performed by the server device 30, with the determination of the frequency of capturing screen images G performed by the collection control unit 225 of the worker terminal 20 being executed by the server device 30.

[0066] In this way, by changing the frequency of collecting screen images G in accordance with the work content of the worker in the application, changes in the amount of input, and changes in the nature of the input, it is possible to collect screen images G as a work log at an optimal frequency and compress the storage capacity of the screen images G. Furthermore, by linking the screen images G collected at the optimal frequency with operation information, the worker's work log can be displayed in a variety of display formats, and when a transmission request for the work log is received from the manager terminal 40, the screen images G and operation information can be viewed in a variety of display formats on the manager terminal 40.

[0067] The processes performed by the worker terminal 20 according to this embodiment and the processes performed by the server device 30 are each prepared as programs such as application software. These programs can be provided not only via communication means but also by being stored on a recording medium such as a CD-ROM or USB.

[0068] In this embodiment, the term "system" includes both a system configured with multiple devices and a system configured with a single device. The configuration of the information processing system 1 described above is an example, and it is sufficient that the information processing system 1 as a whole has the functions to realize the above-mentioned processing. Some or all of the functions of the server device 30 may be functions of the worker terminal 20 or the administrator terminal 40, and some or all of the functions of the administrator terminal 40 may be functions of the worker terminal 20 or the server device 30.

[0069] DESCRIPTION OF SYMBOLS 1... Information processing system 20... Worker terminal 221... Display control unit, 222... Log collection unit, 223... Operation identification unit, 224... Screen collection unit, 225... Collection control unit, 226... Communication control unit 30... Server device 311... Communication control unit, 312... Screen image management unit, 313... Folder 40... Administrator terminal 50... Communication line G... Screen image

Claims

1. An information processing system comprising: a collection function that collects screen images representing the contents displayed on the screen of a worker terminal during a process in which a worker operates the worker terminal to interact with an object; a determination function that determines the frequency at which the screen images are to be collected based on operation information of the worker regarding the object during the process; and a storage function that provides a storage location for storing the collected screen images.

2. The information processing system according to claim 1, wherein the determination function changes the frequency of collecting the screen images depending on the work content of the worker on the object.

3. The information processing system according to claim 2, wherein the frequency is increased when the work content is an operation that causes the target function to be exercised.

4. The information processing system according to claim 1, wherein the determination function changes the frequency in accordance with a change in the amount of input by the worker to the target.

5. The information processing system according to claim 4, wherein the amount of input is the number of inputs per unit time by the worker to the target, and when the number of inputs increases, the frequency is increased.

6. The information processing system according to claim 1, wherein the determination function changes the frequency in response to a change in the nature of the input by the worker to the target.

7. The information processing system according to claim 6, characterized in that the nature of the input includes mouse cursor movement on the screen, and when there is input excluding the mouse cursor movement, the screen image is collected, and when the input stops, the collection of the screen image is stopped.

8. The information processing system according to claim 1, characterized in that the operation information includes the amount of input by operating the keyboard and the amount of movement of the mouse cursor, and further comprises a display control means for displaying the amount of input, the amount of movement, and the degenerated screen image in a list format for each of the objects.

9. The information processing system according to claim 8, wherein the screen image is reproduced by temporally changing a plurality of frame images collected at the frequency.

10. The information processing system of claim 1, characterized in that the collection of the screen images is performed by storing the screen images in the storage location, and the storage function determines the frequency of storing the screen images based on operation information of the worker on the object during the process.

11. An information processing device having a processor, which determines the frequency of collecting screen images representing the display contents of the screen of the worker terminal based on operation information of the worker regarding the object while the worker is operating the worker terminal and interacting with the object.

12. A program that causes a computer to realize a function of determining the frequency of collecting screen images representing the display contents of the screen of a worker terminal based on operation information of a worker regarding an object while the worker is operating the worker terminal and interacting with the object.

Images