Information processing system, information processing device and program

Abstract

To collect a work log of a worker at an optimal frequency according to operation information of the worker with respect to a work target, reduce a storage capacity, and enable browsing in various display formats.SOLUTION: An information processing system comprises a collection function which collects screen images representing display content of a screen of a worker terminal during a process in which a worker engages with a target by operating the worker terminal, a determination function which determines a frequency of collecting the screen images on the basis of operation information of the worker with respect to the target during the process, and a storage function which provides a storage location for storing the collected screen images. The determination means varies the frequency of collecting the screen images according to a work content of the worker with respect to the target, a change in an amount of input, and a change in a nature of input.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing device, and a program. [Background technology]

[0002] An information processing device is known that is configured to execute an acquisition step, a specification step, an extraction step, and a display control step, in which the acquisition step acquires operation information from each of a plurality of user terminals, the specification step specifies the content of the task and the task execution means for each task based on the operation information and pre-stored reference information, the extraction step extracts the different task execution means as a recommendation target when different task execution means are executed for the same task, and the display control step controls to display notification information including the recommendation target (Patent Document 1).

[0003] A work management system for managing work on a computer is also known, which includes a log collection unit that records the keyboard and mouse operations of a worker as log data along with the time and information identifying the worker, a screen collection unit that records the display screen at times including before and after the operation as screen data, and an efficiency calculation unit that calculates the time required for a specified work task from at least one of the log data and the screen data (Patent Document 2). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2022-177827 [Patent Document 2] Japanese Patent Publication No. 2020-24529 Summary of the Invention [Problem to be solved by the invention]

[0005] The present invention collects the work logs of the workers at an optimum frequency according to the operation information of the workers on the work objects, compresses the storage capacity, and makes them viewable in a variety of display formats. [Means for solving the problem]

[0006] In order to solve the above problem, the information processing system according to claim 1 comprises: a collection function of collecting screen images representing the display contents of the screen of the worker terminal while the worker is involved in the process of operating the worker terminal; The operator's operation on the object during the process is an operation for exerting the function of the target, The frequency of collecting the screen images Increase R collection Decision function; The operation includes inputting from a keyboard and moving a mouse cursor, and for each of the objects, By keyboard Input amount, Mouse cursor a display control function for displaying the amount of movement and the reduced screen image in a listable manner; a storage function that provides a storage location for storing the collected screen images; It is characterized by:

[0007] In order to solve the above problem, The information processing system according to claim 2 teeth , worker represents the display content of the screen of the worker terminal during the process of operating the worker terminal and participating in the target. Collect screen images Collection function and a collection decision function for increasing the frequency of collecting the screen images when the number of inputs per unit time of the worker to the object during the process increases; the operation includes keyboard input and mouse cursor movement, and a display control function for displaying, for each of the targets, the amount of keyboard input, the amount of mouse cursor movement, and the reduced screen image in a listable manner; a storage function that provides a storage location for storing the collected screen images; It is characterized by:

[0008] In order to solve the above problem, The information processing system according to claim 3 teeth , work a collection function of collecting screen images representing the display contents of the screen of the worker terminal while the worker is operating the worker terminal and participating in the target; a collection decision function that collects the screen image when the operator's operation on the object during the process includes movement of a mouse cursor on the screen and there is an input on the object excluding the movement of the mouse cursor, and stops collecting the screen image when the input on the object stops; a display control function for displaying, in a list form, the amount of input from the keyboard, the amount of movement of the mouse cursor, and the reduced screen image for each of the targets, the operation including input from a keyboard; a storage function that provides a storage location for storing the collected screen images; , It is characterized by:

[0009] The invention described in claim 4 is or 3. In the information processing system described in The aforementioned The screen image is a time-domain image of multiple frame images collected. change Play on difference Re Ru, It is characterized by:

[0010] In order to solve the above problem, The information processing according to claim 5 The device , a processor; The processor: During the process of the worker operating the worker terminal and interacting with the target The worker's response to the target Collecting screen images representing display contents on the screen of the worker terminal based on operation information, and increasing the frequency of collecting the screen images when the worker's operation on the object during the process is an operation for performing a function of the object; The aforementioned The operation includes input by operating the keyboard and movement of the mouse cursor, and for each of the targets, the amount of input by the keyboard, the amount of movement of the mouse cursor, and the amount of degenerated The aforementioned Display screen images at a glance to make, It is characterized by:

[0011] In order to solve the above problem, The information processing method according to claim 6 The device , a processor; The aforementioned The processor Collecting screen images representing the display contents of the screen of the worker terminal during the process in which the worker operates the worker terminal and is involved in the target, The worker's response to the target per unit time input If the number increases, increasing the frequency of collecting the screen images; The operation includes keyboard input and mouse cursor movement, and the amount of keyboard input, the amount of mouse cursor movement, and the reduced screen image are displayed in a list format for each target. to make,

[0012] In order to solve the above problem, The information processing method according to claim 7 The device , a processor; The aforementioned The processor A screen image is collected that represents the display content of the screen of the worker terminal during a process in which a worker operates the worker terminal and is involved in an object, and the operation of the worker on the object during the process includes movement of a mouse cursor on the screen, and the operation of the worker on the object excluding the movement of the mouse cursor is collected. When an input is received, the screen image is collected. For the subject Stops collecting screen images when input stops death, The operation includes input from a keyboard, and the amount of input from the keyboard, the amount of movement of the mouse cursor, and the reduced screen image are displayed in a list form for each of the targets. Ru, It is characterized by:

[0013] In order to solve the above problem, The method according to claim 8 The program is , On the computer, a collection function of collecting screen images representing display contents on a screen of the worker terminal based on operation information of the worker with respect to the object while the worker is operating the worker terminal and interacting with the object; a collection decision function for increasing the frequency of collecting the screen images when the operator's operation on the object during the process is an operation that causes the function of the object to be performed; The operation includes an input amount by operating a keyboard and a movement amount of a mouse cursor, and the input amount, the movement amount, and the degenerated The screen image The function to display the list of difference height Ru, It is characterized by:

[0014] In order to solve the above problem, The method according to claim 9 program teeth, This shows the display content on the screen of the worker terminal while the worker is operating the worker terminal and interacting with the target. Screen Image of collection collection function, The worker's response to the object during the process a collection determination function that increases the frequency of collecting the screen images when the number of inputs per unit time increases; The operation includes keyboard input and mouse cursor movement, and the amount of keyboard input, the amount of mouse cursor movement, and the amount of degenerated The screen image It also provides a display control function that allows you to view the list. Ru, It is characterized by:

[0016] In order to solve the above problem, claim 1 0 The program described in On the computer, Collecting screen images representing the contents displayed on the screen of the worker terminal while the worker is involved in the target by operating the worker terminal. collection Function and a collection decision function that collects the screen image when the operator's operation on the object during the process includes movement of a mouse cursor on the screen and there is an input on the object excluding the movement of the mouse cursor, and stops collecting the screen image when the input on the object stops; The operation includes inputting from a keyboard, and for each of the targets, By keyboard Input amount, Mouse cursor a display control function for displaying the amount of movement and the reduced screen image in a listable manner; It is characterized by: [Effects of the Invention]

[0017] Claim 1, 2、3、5,6、7、8、9、 According to the invention described in 10, the worker's work log can be collected at an optimal frequency according to the operation information of the worker on the work object, thereby compressing the storage capacity and making it possible to view it in a variety of display formats.

[0024] Claim 4According to the invention described in the above, the collected screen images can be confirmed as a video or as still images of consecutive numbers. [Brief explanation of the drawings]

[0026] [Figure 1] FIG. 1 is a diagram illustrating an example of a hardware configuration of an information processing system to which the present embodiment is applied. [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of a worker terminal and a manager terminal according to the present embodiment. [Figure 3] FIG. 2 is a diagram illustrating an example of a hardware configuration of a server device according to the present embodiment. [Figure 4] FIG. 2 is a diagram illustrating an example of the functional configuration of each device included in the information processing system to which the present embodiment is applied. [Figure 5] FIG. 10 is an activity diagram showing the flow of collecting screen images by a worker terminal. [Figure 6] FIG. 10 is an activity diagram showing the flow of storing and transmitting a screen image performed in the server device. [Figure 7] FIG. 10 is a diagram illustrating an example of a display form of a work log. [Figure 8] FIG. 10 is a diagram illustrating an example of a display form of a work log. [Figure 9] FIG. 10 is a diagram illustrating an example of a display form of a work log. DETAILED DESCRIPTION OF THE INVENTION

[0027] Next, the present invention will be described in more detail below with reference to the drawings, showing embodiments and specific examples, but the present invention is not limited to these embodiments and specific examples. Furthermore, in the following explanation using the drawings, it should be noted that the drawings are schematic and the ratios of the dimensions, etc. may differ from those of the actual product, and in order to facilitate understanding, illustrations of components other than those necessary for the explanation have been omitted as appropriate.

[0028] (1) Overall configuration of the information processing system The information processing system 1 according to this embodiment includes a screen collection unit 224 that performs a collection function of collecting screen images G that represent the display content on the screen of the worker terminal 20 during the process in which the worker operates the worker terminal 20 to interact with the target, a collection control unit 225 that performs a determination function of determining the frequency at which to collect screen images G based on the operation information of the worker on the target during the process, and a server device 30 that performs a storage function of providing a storage location for storing the collected screen images G. By changing the frequency at which screen images G are collected depending on the work content of the worker on the target, changes in the amount of input, and changes in the nature of the input, the screen images G as a work log are collected at an optimal frequency, thereby compressing the storage capacity of the screen images G.

[0029] Here, the "target" refers to various programs including application programs (hereinafter, sometimes simply referred to as applications), such as applications for drawing, document creation, spreadsheets, and internet searches. Furthermore, "in process" refers to a state in which a worker is performing operations on an "object" via an input device such as a keyboard, mouse, or touch panel, including, for example, keystrokes, mouse cursor movements, clicks, flicks, touches, etc.

[0030] Recent applications have a graphical user interface (GUI), and when using such applications, the operator checks the displayed GUI and operates the GUI elements, such as windows, labels, buttons, and text boxes. These operations change the GUI, and the operator must then check the changed GUI again and operate the GUI elements, repeating the process. In order to improve the efficiency of operating such applications, it is thought that visualizing the logs of past work performed is effective. Work logs are obtained by recording the ``screen images'' that are displayed when a worker operates an application.

[0031] (1.1) Hardware Configuration 1 is a diagram showing an example of the hardware configuration of an information processing system 1 to which this embodiment is applied. The information processing system 1 is configured by connecting a plurality of worker terminals 20 operated by workers, a server device 30 that stores collected screen images G, and an administrator terminal 40 that is operated by an administrator to view the screen images G stored in the server device 30 via a communication line 50. The communication line 50 is, for example, a line such as the Internet, and is used for information communication between the worker terminals 20, the administrator terminal 40, and the server device 30.

[0032] (1.1.1) Hardware Configuration of the Worker Terminal 20 FIG. 2 is a diagram showing an example of the hardware configuration of the worker terminal 20 and the manager terminal 40 according to this embodiment. The worker terminal 20 is operated by the worker and is composed of a control unit 21 that executes the target application, a display unit 22 that displays a GUI screen that can be operated by the worker, an input unit 23 that accepts operation inputs made by the worker, a communication unit 24 that communicates with the outside world via wired or wireless communication, and a memory unit 25 that stores programs, etc. executed by the control unit 21 and temporary information related to the calculations of the programs, etc. Examples of such devices include a personal computer, a tablet terminal, a smartphone, etc.

[0033] (Control unit 21) The control unit 21 is composed of a CPU (Central Processing Unit) 21a as an example of a processor that controls the entire device, a ROM (Read Only Memory) 21b that stores a BIOS (Basic Input / Output System) and an operating system (OS) executed by the CPU 21a, and a RAM (Random Access Memory) 21c that is used as a working memory for the CPU 21a. The control unit 21 also executes processes such as acquiring, saving, displaying, and transmitting information through the execution of programs. In this embodiment, the control unit 21 also functions as a screen collection unit 224 that collects screen images G that represent the display content of the display unit 22 and a collection control unit 225 that determines the frequency (frames per second: fps) at which the screen images G are collected.

[0034] (Display section 22) The display unit 22 is configured, for example, with a liquid crystal display or an OLED (Organic Light Emitting Diode) display, and displays a GUI screen and image data. Specifically, it displays a cursor that indicates a position or image on the screen, and a work screen on which the worker performs work-related processing. The display unit 22 may be included integrally in the worker terminal 20, or may be attached externally to the worker terminal 20. Furthermore, the display unit 22 may be formed integrally with the input unit 23, which will be described later, as a touch panel.

[0035] (input unit 23) The input unit 23 is a device operated by an operator, and is, for example, a keyboard, a pointing device, a button, a microphone, a web camera, a switch, etc. Examples of pointing devices include a mouse, a trackball, a touch panel, a pen tablet, etc.

[0036] (Communications Department 24) The communication unit 24 is configured with a communication interface for communicating with external devices, etc. The worker terminal 20 transmits and receives various information to and from the server device 30 and the manager terminal 40 via the communication unit 24. In particular, the worker terminal 20 transmits the screen image G collected by the screen collection unit 224 to the server device 30.

[0037] (Storage unit 25) The storage unit 25 stores various information including, for example, operation information based on operation inputs made by an operator. This can be implemented as a storage device such as an SSD (Solid State Drive) that stores various programs related to the operator terminal 20 executed by the control unit 21 as the screen collection unit 224, or as a memory such as RAM that stores temporarily required information related to program calculations. The storage unit 25 also has a secondary storage unit 251 realized by an HDD or the like that temporarily records collected screen image data.

[0038] (1.1.2) Hardware Configuration of Server Device 30 FIG. 3 is a diagram showing an example of the hardware configuration of the server device 30 according to this embodiment. The server device 30 has an arithmetic processing unit 31 that executes arithmetic processing according to a predetermined processing program when processing such as storing a screen image G, a secondary memory unit 32 realized by an HDD or the like on which screen image data to be stored, etc. is recorded, and a communication unit 33 that sends and receives information via a communication line 50. The arithmetic processing unit 31 includes a CPU 31a as an example of a processor that controls the entire device, a RAM 31b used as a working memory for the CPU 31a, and a ROM 31c that stores programs executed by the CPU 31a. The secondary storage unit 32 stores information related to the storage of screen image data, as well as programs executed by the arithmetic processing unit 31. The arithmetic processing unit 31 reads out the programs stored in the secondary storage unit 32, thereby executing various processes in the server device 30 according to this embodiment.

[0039] Here, the programs executed by the CPUs 21a and 31a, which are examples of processors, are provided to the control unit 21 and the arithmetic processing unit 31 in a state where they are stored in a computer-readable recording medium such as a magnetic recording medium (magnetic tape, magnetic disk, etc.), an optical recording medium (optical disk, etc.), a magneto-optical recording medium, or a semiconductor memory. The programs executed by the CPUs 21a and 31a may also be downloaded using a communication means such as the Internet. Furthermore, the operations of the processors may not only be performed by a single processor, but may also be performed by a plurality of processors located at physically separate locations working together.

[0040] (1.1.3) Hardware configuration of the administrator terminal 40 The manager terminal 40 according to this embodiment has the same hardware configuration as the worker terminal 20. The manager terminal 40 has a control unit 41 that executes processes such as acquiring, saving, displaying, and transmitting information through the execution of a program, a display unit 42 that displays images, text information, and the like to the manager as a user, an input unit 43 that accepts input operations from the manager, a communication unit 44 that transmits and receives information via a communication line 50, and a storage unit 45 realized by an HDD or the like in which images, text information, and the like are recorded.

[0041] (1.2) Functional configuration FIG. 4 is a diagram showing an example of the functional configuration of each device included in the information processing system 1 to which this embodiment is applied. The worker terminal 20 has a display control unit 221 that controls the content to be displayed on the display unit 22, a log collection unit 222 that acquires operation information for the worker's application, an operation identification unit 223 that identifies the worker's operation, a screen collection unit 224 that collects screen images G to be displayed on the display unit 22, a collection control unit 225 that determines the frequency of collecting screen images G, and a communication control unit 226 that sends and receives information, and functions as an information processing device that determines the frequency of collecting screen images G that represent the display content on the screen of the worker terminal 20 based on operation information for the worker's application while the worker is operating the worker terminal 20 and interacting with the application.

[0042] (Display control unit) The display control unit 221 controls the content to be displayed on the display unit 22 based on the operation of the worker identified by the operation identification unit 223, the information received via the communication control unit 226, and the content of the program execution performed by the control unit 21.

[0043] (Log collection section) The log collection unit 222 detects operations of the input unit 23 of the worker terminal 20 and records the detected operations as operation information. Specifically, the log collection unit 222 records the operation information, including the work content, input amount, changes in the nature of the input, etc., for each application software that is the object of operation on the worker terminal 20, as log data.

[0044] (Operation specific part) The operation identification unit 223 identifies what kind of operation the worker has performed on the operation screen via the input unit 23. Here, the worker operation is, for example, an operation such as clicking to specify an image, various icons, or position on the operation screen, a scrolling operation, a key input operation, etc.

[0045] (Screen Collection Department) The screen collection unit 224 captures the screen image G displayed on the display unit 22 of the worker terminal 20 in response to the worker's operation, and records it as screen image data.

[0046] (Collection Control Unit) The collection control unit 225 determines the frequency of capturing the screen image G based on the operation information of the worker identified by the operation identification unit 223. Examples of the worker's operation information include the work content for the application, changes in the amount of input, and changes in the nature of the input. Specifically, if the work content is an operation that exercises the function of the application, the frequency of capturing screen images G is increased. The amount of input is the number of inputs per unit time made by the worker for the application, and if the number of inputs increases, the frequency of capturing screen images G is increased. The nature of the input includes mouse cursor movement on the screen, and a screen image is captured when there is input excluding mouse cursor movement, and capturing of screen images is stopped when the input stops.

[0047] (Communication control unit) The communication control unit 226 performs processing related to sending and receiving information via the communication unit 24. For example, the communication control unit 226 transmits a screen image G stored in the storage unit 25 to the server device 30. Also, for example, the communication control unit 226 receives information transmitted from the server device 30 and stores it in the storage unit 25.

[0048] The server device 30 includes a communication control unit 311 for transmitting and receiving information, a screen image management unit 312 for managing received screen images, and a folder 313 as a storage location for the screen images G.

[0049] (Communication control unit) The communication control unit 311 performs processing related to sending and receiving information via the communication unit 33. For example, it receives a screen image from the worker terminal 20. It also transmits the stored screen image to the manager terminal 40 based on an instruction from the manager terminal 40.

[0050] (Screen image management) The screen image management unit 312 enables the screen image G and operation information stored in the secondary storage unit 32 to be displayed in a variety of display formats as the worker's work log. Furthermore, when a request to view the work log is received from the manager terminal 40, the screen image management unit 312 retrieves the specified screen image G and operation information from the secondary storage unit 32. Then, the screen image management unit 312 instructs the communication control unit 311 to transmit the screen image G and operation information to the manager terminal 40.

[0051] (2) Operation of the information processing system 5 is an activity diagram showing the flow of collection of screen images G by the worker terminal 20. The activity diagram describes a system from the perspective of activities (processing) and the control flow between activities. The collection of the screen image G executed by the worker terminal 20 as an information processing device will be described below with reference to an activity diagram.

[0052] (A101) The log collection unit 222 operates continuously and acquires operation information related to the worker terminal 20 (A101). Specifically, the log collection unit 222 acquires the details of the worker's work, the amount of input, the nature of the input, etc., for the application that is the operation target of the worker terminal 20. Examples of the work of a worker include a software developer writing software code, an illustrator creating a drawing using an application, browsing a web page, and checking sent emails. The amount of input may be the number of typings, inputs, or actions per unit time, and the unit time may be, for example, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 30, or 60 minutes, or may be within a range between any two of the numbers exemplified here. The nature of the input includes the movement of the mouse cursor on the screen, a click after the mouse cursor is moved, and switching of files or applications.

[0053] (A102) The operation identification unit 223 identifies the content of the work, the amount of input for each work, and the nature of the input based on the operation information acquired by the log collection unit 222 and pre-stored reference information (A102). Furthermore, the operation identification unit 223 identifies the name of the application related to the identified work content.

[0054] (A103) Next, the collection control unit 225 determines the frequency of capturing screen images based on the operation information of the worker identified by the operation identification unit 223 (A103). The information about the worker's operation includes the work content for the application, changes in the amount of input, changes in the nature of the input, etc. For example, when the work content is a software developer writing software code, the frequency of screen capture (fps: frames per second) is controlled to decrease, and when the work content is an illustrator drawing using an application, the frequency of screen capture (fps) is controlled to increase. The system also determines the frequency of screen capture (fps) according to changes in the amount of input by the worker. For example, if the number of times a worker types, inputs, or performs actions per unit time increases, the system controls the frequency of screen capture (fps) to increase. Furthermore, the input characteristics include mouse cursor movement on the screen, and when there is input excluding mouse cursor movement, the screen image is captured, and when the input stops, the capture of the screen image is stopped.

[0055] (A104) The screen collection unit 224 captures screen images G displayed in accordance with the worker's operations based on the collection frequency determined by the collection control unit 225 (A104). For example, if the work content is an operation that activates an application function, the frequency (fps) at which screen images G are captured is increased. Also, if the number of inputs per unit time made by the worker to the application increases, the frequency (fps) at which screen images G are captured is increased. Also, if there is a change in the nature of the input, specifically, if there is an input excluding mouse cursor movement, the screen image capture is captured, and if the input stops, the screen image capture is stopped. This allows the worker's work log to be collected at an optimal frequency (fps) according to the worker's application operation information, thereby reducing the storage capacity of the work log.

[0056] (A105) The communication control unit 226 transmits the screen image G captured by the screen collection unit 224 to the server device 30 together with the operation information collected by the log collection unit 222 and identified by the operation identification unit 223 (A105).

[0057] FIG. 6 is an activity diagram showing the flow of storage and transmission of the screen image G performed in the server device 30. As shown in FIG. The storage and transmission of the screen image G performed by the server device 30 as an information processing device will be described below with reference to an activity diagram.

[0058] (A201) The communication control unit 311 receives the screen image G and operation information transmitted from the worker terminal 20 and stores them in the folder 313 (A201). If there are multiple worker terminals 20, the information is stored in a distinguishable manner for each worker terminal 20.

[0059] (A202) The screen image management unit 312 associates the stored screen image G with the operation information, and enables the worker's work log to be displayed in a variety of display formats (A202). 7, 8, and 9 are diagrams showing examples of work log display formats. For example, as shown in FIG. 7, a bar graph P1 showing the number of keyboard operations by type of key (Backspace, Back, Shortcut, Copy & Paste, etc.) is displayed over time; a line graph P2 showing the amount of mouse cursor movement over time; a predetermined icon P3 showing the content of the work (e.g., work using a specific application, web conference, checking email, internet search, etc.); each captured screen image G edited to display multiple frame images over time and displayed as thumbnails P4; and as shown in FIG. 8, a pie chart P5 showing the worker's total work time; a pie chart P6 showing the breakdown of work time (e.g., work using a specific application, web conference, checking email, internet search, etc.); a comparison of the number of shortcut key operations P7 among keyboard operations with the previous day; and a comparison of the number of left clicks P8 and the amount of mouse cursor movement P9 among mouse operations with the previous day. Furthermore, as shown in FIG. 9, the stored screen image G is edited so that it can be displayed as a frame image over time.

[0060] (A203) The communication control unit 311 receives a request to send a work log from the administrator terminal 40 and sends the screen image G and operation information to the administrator terminal 40 in various display formats (A203). Specifically, for example, the input amount per unit time as shown in Fig. 7 and Fig. 8 can be viewed on a web browser. Also, as shown in Fig. 9, the screen image G is displayed as a frame image over time and can be viewed on the administrator terminal 40 side.

[0061] "Variations" In the above-described embodiment, the worker terminal 20 has a collection control unit 225 that determines the frequency of collecting screen images G that represent the display contents on the screen of the worker terminal 20, and a communication control unit 226 that sends and receives information, and is configured to determine the frequency of collecting screen images G based on operation information of the worker regarding the application while the worker is operating the worker terminal 20 and participating in the application. However, the server device 30 may also be configured to store the screen images G and operation information based on the specified storage conditions when it receives a designation of the screen images G and storage conditions from the worker terminal 20.

[0062] In this case, the storage conditions are the same as the frequency of capturing screen images G determined by the collection control unit 225 of the worker terminal 20 based on the worker's operation information, and the screen images G are stored based on the details of the worker's work for the application, changes in the amount of input, changes in the nature of the input, etc. In other words, the storage of screen images G performed by the screen image management unit 312 of the server device 30 is performed by the server device 30, with the determination of the frequency of capturing screen images G performed by the collection control unit 225 of the worker terminal 20 being executed by the server device 30.

[0063] In this way, by changing the frequency at which screen images G are collected according to the work content of the worker's application, changes in the amount of input, and changes in the nature of the input, it is possible to collect screen images G as work logs at an optimal frequency and compress the storage capacity of screen images G. In addition, the screen image G collected at an optimal frequency is linked to operation information, making it possible to display the worker's work log in a variety of display formats, and when a request to send the work log is received from the administrator terminal 40, the screen image G and operation information can be viewed in a variety of display formats on the administrator terminal 40.

[0064] The processes performed by the worker terminal 20 according to this embodiment and the processes performed by the server device 30 are each prepared as a program such as application software. These programs can be provided not only by communication means but also by being stored on a recording medium such as a CD-ROM or USB.

[0065] In this embodiment, the term "system" includes both a system made up of multiple devices and a system made up of a single device. The configuration of the information processing system 1 described above is an example, and it is sufficient that the information processing system 1 as a whole has the functionality to realize the above-mentioned processing, and some or all of the functions of the server device 30 may be functions of the worker terminal 20 or the administrator terminal 40, and some or all of the functions of the administrator terminal 40 may be functions of the worker terminal 20 or the server device 30. [Explanation of symbols]

[0066] 1. Information Processing System 20. Operator terminal 221: Display control unit, 222: Log collection unit, 223: Operation identification unit, 224: Screen collection unit, 225: Collection unit, 226: Communication control unit 30. Server device 311: Communication control unit, 312: Screen image management unit, 313: Folder 40 Administrator terminal 50. Communication line G···Screen Image

Claims

1. a collection function of collecting screen images representing the display contents of the screen of the worker terminal while the worker is involved in the process of operating the worker terminal; a collection decision function for increasing the frequency of collecting the screen images when the operator's operation on the object during the process is an operation that causes the function of the object to be performed; the operation includes keyboard input and mouse cursor movement, and a display control function for displaying, for each of the targets, the amount of keyboard input, the amount of mouse cursor movement, and the reduced screen image in a listable manner; a storage function that provides a storage location for storing the collected screen images; An information processing system comprising:

2. A collection function for collecting screen images representing the display contents of the screen of the worker terminal while the worker is operating the worker terminal and participating in the target; a collection decision function for increasing the frequency of collecting the screen images when the number of inputs per unit time of the worker to the object during the process increases; the operation includes keyboard input and mouse cursor movement, and a display control function for displaying, for each of the targets, the amount of keyboard input, the amount of mouse cursor movement, and the reduced screen image in a listable manner; a storage function that provides a storage location for storing the collected screen images; An information processing system comprising:

3. A collection function that collects screen images representing the display contents of the screen of the worker terminal while the worker is operating the worker terminal and participating in the target; a collection decision function that collects the screen image when the operator's operation on the object during the process includes movement of a mouse cursor on the screen and there is an input on the object excluding the movement of the mouse cursor, and stops collecting the screen image when the input on the object stops; a display control function for displaying, in a list form, the amount of input from the keyboard, the amount of movement of the mouse cursor, and the reduced screen image for each of the targets, the operation including input from a keyboard; a storage function that provides a storage location for storing the collected screen images; An information processing system comprising:

4. The screen image is reproduced by temporally changing a plurality of collected frame images.

4. The information processing system according to claim 1, wherein the information processing system is a data processing system.

5. a processor; The processor: Collecting screen images representing display contents on a screen of the worker terminal based on operation information of the worker on the object during a process in which the worker operates the worker terminal to interact with the object, and increasing the frequency of collecting the screen images when the operation of the worker on the object during the process is an operation that causes a function of the object to be exercised; the operation includes input by operating a keyboard and movement of a mouse cursor, and for each of the targets, the amount of input by the keyboard, the amount of movement of the mouse cursor, and the degenerated screen image are displayed in a listable manner; 1. An information processing device comprising:

6. A processor, The processor: Collecting screen images representing display contents on a screen of a worker terminal during a process in which a worker operates the worker terminal and is involved in an object, and increasing the frequency of collecting the screen images when the number of inputs per unit time by the worker to the object during the process increases; the operation includes keyboard input and mouse cursor movement, and the amount of keyboard input, the amount of mouse cursor movement, and the reduced screen image are displayed in a list form for each of the targets; 1. An information processing device comprising:

7. A processor, The processor: Collecting screen images representing the display contents of the screen of the worker terminal during a process in which a worker operates the worker terminal and is involved in an object, wherein the operation of the worker on the object during the process includes movement of a mouse cursor on the screen, collecting the screen images when there is an input to the object excluding the movement of the mouse cursor, and stopping the collection of the screen images when the input to the object stops; the operation includes input via a keyboard, and for each of the targets, the amount of input via the keyboard, the amount of movement of the mouse cursor, and the degenerated screen image are displayed in a listable manner; 1. An information processing device comprising:

8. On the computer, a collection function of collecting screen images representing display contents on a screen of the worker terminal based on operation information of the worker with respect to the object while the worker is operating the worker terminal and interacting with the object; a collection decision function for increasing the frequency of collecting the screen images when the operator's operation on the object during the process is an operation that causes the function of the object to be performed; The operation includes an input amount by operating a keyboard and a movement amount of a mouse cursor, and a function of displaying the input amount, the movement amount, and the degenerated screen image in a list form for each of the targets is realized. A program characterized by:

9. A computer, a collection function of collecting screen images representing the display contents of the screen of the worker terminal while the worker is involved in the process of operating the worker terminal; a collection decision function for increasing the frequency of collecting the screen images when the number of inputs per unit time of the worker to the object during the process increases; The operation includes keyboard input and mouse cursor movement, and a display control function is provided to display, for each of the targets, the amount of keyboard input, the amount of mouse cursor movement, and the reduced screen image in a list format. A program characterized by:

10. A computer comprising: a collection function of collecting screen images representing the display contents of the screen of the worker terminal while the worker is involved in the process of operating the worker terminal; a collection decision function that collects the screen image when the operator's operation on the object during the process includes movement of a mouse cursor on the screen and there is an input on the object excluding the movement of the mouse cursor, and stops collecting the screen image when the input on the object stops; the operation includes input via a keyboard, and a display control function is realized that displays, for each of the targets, the amount of input via the keyboard, the amount of movement of the mouse cursor, and the degenerated screen image in a listable manner; A program characterized by:

Images