Information providing device, information providing method, and information providing program

Abstract

To connect information of devices with each other in order to connect each device to a network, without physically altering the device.SOLUTION: A server device 10 acquires operation data for specifying an operation conducted in a control device 30 by an operator W according to a work instruction of a predetermined work process related to the control device 30 operated by the operator W, analyzes the operation data, determines a notification content to the operator W, and notifies the operator W of the determined notification content.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information providing device, an information providing method, and an information providing program. [Background technology]

[0002] In production plants, control devices incorporating PLCs (Programmable Logic Controllers) and the like are often operated using touch monitor operation panels, and many of these devices are independent and not connected to a network. Workers who operate these control devices that are not connected to a network must operate the touch monitor operation panels on each control device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2002-041124 [Patent Document 2] Japanese Patent Application Laid-Open No. 2014-071683 Summary of the Invention [Problem to be solved by the invention]

[0004] However, with conventional technology, it is difficult to connect information between devices without physically modifying them in order to connect them to a network. For example, with conventional technology, workers operating control devices that are not connected to a network in a production factory must check the standard operating procedure (SOP) for each product in advance before performing manual operations.

[0005] The present invention has been made in view of the above, and has an object to connect information between devices without making physical modifications to the devices in order to connect the devices to a network. [Means for solving the problem]

[0006] An information providing device according to one embodiment of the present invention includes an acquisition unit that acquires operation data that identifies operations performed by a worker on an operating device in accordance with work instructions for a predetermined work process related to the operating device operated by the worker, an analysis unit that analyzes the operation data and determines the content of a notification to be sent to the worker, and a notification unit that notifies the worker of the determined notification content.

[0007] In an information provision method according to one embodiment of the present invention, a computer executes a process in which it acquires operation data that identifies an operation performed by a worker on an operating device in accordance with a work instruction for a predetermined work process related to the operating device operated by the worker, analyzes the operation data, determines the content of a notification to be sent to the worker, and notifies the worker of the determined notification content.

[0008] An information provision program according to one embodiment of the present invention causes a computer to execute the following process: acquire operation data that identifies operations performed by a worker on an operating device in accordance with work instructions for a specified work process related to the operating device operated by the worker; analyze the operation data; determine the content of a notification to be sent to the worker; and notify the worker of the determined notification content. [Effects of the Invention]

[0009] According to the present invention, it is possible to connect information between devices without making any physical modifications to the devices in order to connect the devices to a network. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a diagram illustrating a configuration example and a processing example of a work management system according to an embodiment; [Figure 2] 1 is a block diagram illustrating an example of the configuration of each device in a work management system according to an embodiment. [Figure 3] FIG. 4 is a diagram illustrating an example of an instruction data storage unit of the server device according to the embodiment. [Figure 4]FIG. 2 is a diagram illustrating an example of an operation data storage unit of the server device according to the embodiment. [Figure 5] FIG. 10 is a diagram illustrating an example of an analysis result storage unit of the server device according to the embodiment. [Figure 6] FIG. 2 is a diagram illustrating an example of a work report storage unit of the server device according to the embodiment. [Figure 7] FIG. 10 is a diagram illustrating a specific example of a display screen of a worker terminal according to the embodiment. [Figure 8] FIG. 4 is a diagram showing a specific example of a display screen of the control device according to the embodiment. [Figure 9] 1 is a flowchart illustrating an example of the overall flow of a work management system according to an embodiment. [Figure 10] 10 is a flowchart illustrating an example of the flow of a work instruction notification process in the work management system according to the embodiment. [Figure 11] 10 is a flowchart illustrating an example of the flow of an operation data acquisition process in the work management system according to the embodiment. [Figure 12] 10 is a flowchart illustrating an example of the flow of an operation data analysis process in the work management system according to the embodiment. [Figure 13] 10 is a flowchart illustrating an example of the flow of a work report generation process in the work management system according to the embodiment. [Figure 14] 10A and 10B are diagrams illustrating an example of the configuration and processing of a work management system according to a first modified example of an embodiment. [Figure 15] FIG. 10 is a diagram showing a specific example of a display screen of smart glasses according to the first modified example of the embodiment. [Figure 16] 10A and 10B are diagrams illustrating an example of the configuration and processing of a work management system according to a second modified example of the embodiment. [Figure 17] 10 is a diagram illustrating an example of the configuration and processing of a work management system according to a third modified example of the embodiment. FIG. [Figure 18] FIG. 10 is a diagram illustrating an example of the configuration of a work management system according to a fourth modified example of the embodiment. [Figure 19] FIG. 2 is a diagram illustrating an example of a hardware configuration according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] An information providing device, an information providing method, and an information providing program according to embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Note that the present invention is not limited to the embodiments described below.

[0012] The following describes the configuration and processing of the work management system 100 according to the embodiment, the configuration and processing of each device in the work management system 100, the processing flow of the work management system 100, modified examples and application examples of the embodiment, and the effects of the embodiment. Note that the embodiment will be described using a work site in a production factory as an example, but the field of use is not limited thereto. For example, the embodiment can be applied to any environment where there is a device operated by a worker W that is not connected to a network.

[0013] 1. Configuration and Processing of Work Management System 100 The configuration and processing of the work management system 100 according to the embodiment will be described in detail using Figure 1. Figure 1 is a diagram showing an example of the configuration and processing of the work management system 100 according to the embodiment. Below, an example of the overall configuration of the work management system 100, an example of the processing of the work management system 100, and the effects of the work management system 100 will be described.

[0014] (1-1. Example of overall configuration of work management system 100) The work management system 100 includes a server device 10, a worker terminal 20, and a control device 30. The server device 10 and the worker terminal 20 are connected to each other via a predetermined communication network (not shown) so that they can communicate with each other via wired or wireless means. The predetermined communication network can be any of various communication networks, such as the Internet or a dedicated line.

[0015] (1-1-1. Server device 10) The server device 10 is an information providing device that notifies the worker W of work instructions and generates a work report. For example, the server device 10 may be realized in a cloud environment, an on-premise environment, an edge environment, or the like. Note that the work management system 100 shown in FIG. 1 may include multiple server devices 10.

[0016] (1-1-2. Worker terminal 20) The worker terminal 20 is a device operated by a worker W and is an example of a device connected to a network. In the example of FIG. 1, the worker terminal 20 is a terminal carried by a worker W at a work site in a production factory, and is realized as a tablet terminal, smartphone, or the like, and has a monitor M that displays work instructions. Note that the work management system 100 shown in FIG. 1 may include multiple worker terminals 20.

[0017] (1-1-3. Control device 30) The control device 30 is an example of a device (operation device) that is operated by a worker W and is not connected to a network. In the example of FIG. 1, the control device 30 is a device that is operated by a worker W at a work site in a production factory, and is a device that controls controlled devices (e.g., tanks, pumps, conveyors) in the production factory. The control device 30 has an operation panel P that accepts operations from the worker W.

[0018] (1-1-4. Camera C) Camera C is an imaging device that captures an image of operation panel P of control device 30, and is installed in the vicinity of control device 30 so as to be able to capture an image of operation panel P. Here, server device 10 and camera C are connected to each other via a predetermined communication network (not shown) so as to be able to communicate with each other by wire or wirelessly.

[0019] (1-1-5. Line of Sight Sensor) The gaze sensor S is a sensor device that detects the gaze of the worker W, and is installed in the vicinity of the control device 30 that can detect the gaze of the worker W. Here, the server device 10 and the gaze sensor S are connected to each other via a predetermined communication network (not shown) so as to be able to communicate with each other by wire or wirelessly.

[0020] (1-2. Example of overall processing by the work management system 100) The following describes the overall processing of the work management system 100. Note that the processing of steps S1 to S5 below may be executed in a different order. Also, some of the processing of steps S1 to S5 below may be omitted.

[0021] (1-2-1. Device operation processing) First, the worker W operates the control device 30 (step S1). For example, the worker W operates the operation panel P based on the SOP. The worker W also performs manual tasks such as adding raw materials, recording data, and checking data during automatic control of the control device 30.

[0022] (1-2-2. Operation data acquisition process) Second, the server device 10 acquires operation data (step S2). For example, the server device 10 acquires, as the operation data, image data of the operation panel P captured by the camera C, gaze data of the worker W detected by the gaze sensor S, position data of the worker W detected by the worker terminal 20, etc.

[0023] (1-2-3. Operation data analysis processing) Third, the server device 10 analyzes the operation data (step S3). For example, if the work process is an operation on the operation panel P, the server device 10 analyzes the image data of the operation panel P and determines whether the worker W correctly operated the operation panel P. At this time, the server device 10 determines whether the operation by the worker W is appropriate based on information such as layout information of the operation screen of the operation panel P, responses and transitions when a button on the operation panel P is pressed, etc.

[0024] Furthermore, when the work process is data recording, the server device 10 analyzes the gaze data of the worker W and records the characters on the operation panel P that the worker W gazes at. At this time, the server device 10 identifies the area of ​​the operation panel P that is in the line of sight of the worker W, and performs OCR (Optical Character Recognition) processing on the image data of the operation panel P included in the identified area, thereby identifying the characters on the operation panel P that the worker W gazes at. Alternatively, the server device 10 may directly perform OCR processing on the image data of the operation panel P, thereby identifying the characters on the operation panel P without using the gaze data of the worker W detected by the gaze sensor S.

[0025] The server device 10 can also analyze the position data of the worker W and determine whether the worker W is operating the correct control device 30.

[0026] The server device 10 then determines the content of the notification based on the analysis result of the operation data. For example, if the server device 10 determines that the worker W performed a correct operation, it determines that the second work instruction is the content of the notification. On the other hand, if the server device 10 determines that the worker W performed an incorrect operation, it determines that an error message is the content of the notification. Furthermore, if the server device 10 determines that the worker W performed an incorrect operation, it can also determine that the changed work instruction is the content of the notification.

[0027] (1-2-4. Work instruction notification processing) Fourth, the server device 10 notifies the worker W of the second work instruction (step S4). For example, if the server device 10 determines in step S3 above that the worker W has performed the correct operation, it transmits the next work instruction in the work process created based on the SOP to the worker terminal 20 and displays it on the monitor M of the worker terminal 20.

[0028] At this time, the server device 10 notifies the worker W of work instructions, such as instructions to operate the operation panel P, which is the operation of the control device 30, instructions for manual work such as inputting raw materials, instructions for data recording, etc. The worker terminal 20 may also display a flowchart showing the work instructions for each work process, and highlight work instructions that are currently being carried out. The worker terminal 20 may also display a list of work instructions for each work process, and highlight work instructions that are currently being carried out.

[0029] On the other hand, if the server device 10 determines in step S3 that the worker W has performed an incorrect operation, it notifies the worker W of an error message, changed work instructions, and the like.

[0030] The processing of steps S1 to S4 above is repeated until all work processes to be performed by the control device 30 are completed. Note that in the processing of steps S1 to S4 above, the work instructions for the next work process are notified to the worker W after the operation data processing of step S3, but the work instructions for the work process to be performed now may be notified to the worker W before the equipment operation processing of step S1. Also, in the work instruction notification processing of step S4 above, if it is determined that the worker W has performed the correct operation, no work instructions may be notified, and if it is determined that the worker W has performed the incorrect operation, an error message, changed work instructions, etc. may be notified.

[0031] (1-2-5. Work report generation process) Fifth, server device 10 generates a work report (step S5). For example, when all work processes performed by control device 30 are completed, server device 10 generates a work report including the identification number of control device 30, the name of worker W, work content, recorded data, etc.

[0032] (1-3. Effects of the work management system 100) Below, an overview and problems of the work management system 100P according to the reference technology will be explained, and then the effects of the work management system 100 will be explained.

[0033] (1-3-1. Overview of the Work Management System 100P) An overview of a work management system 100P according to the reference technology will be described below. In the work management system 100P, in a production factory, control devices 30 incorporating PLCs or the like are operated using touch monitor-type operation panels P installed therein, and are independent and not connected to a network. Therefore, in the work management system 100P, in a production factory having control devices 30 that are not connected to a network, a worker W who operates the control devices 30 must operate the operation panels P on each control device 30.

[0034] (1-3-2. Problems with the Work Management System 100P) The problems of the work management system 100P according to the reference technology will be explained below. The work management system 100P has the following problems 1 to 4.

[0035] (1-3-2-1.Problem 1) In the work management system 100P, for example, in the case of a batch process in a production factory, it is necessary to manufacture a variety of products, so the manufacturing procedures for each product are different and it is not routine work. Therefore, in the work management system 100P, the worker W needs to check the SOP for each product in advance before performing manual operations.

[0036] (1-3-2-2. Problem 2) In the Work Management System 100P, work records and measurement value records are manually recorded on paper. As a result, the data is not digitized in the Work Management System 100P, and data utilization is not progressing.

[0037] (1-3-2-3.Problem 3) In order to collect digital data in the work management system 100P, the system must be modified to connect each control device 30 to a network. However, to perform such modifications to existing equipment in the work management system 100P, PLC information must be obtained from the PLC vendor that engineered the PLC and control device 30. Even products from the same PLC vendor have different specifications depending on the series. Therefore, such modifications to the work management system 100P not only require a long time and cost, but also impose a burden on the work site, making them difficult to implement, especially for small-scale equipment manufacturers and customers.

[0038] (1-3-2-4.Problem 4) In the work management system 100P, some control devices 30 are black boxes containing the know-how of the equipment manufacturers. Therefore, modifying the system to connect each control device 30 in the work management system 100P to a network would mean establishing an electronic interface with the outside world, which raises concerns about confidentiality.

[0039] (1-3-3. Overview of the Work Management System 100) An overview of the work management system 100 according to the embodiment will be described. The following processes are executed in the work management system 100. Below, an overview of the equipment operation process, operation data acquisition process, operation data analysis process, work instruction notification process, and work report generation process will be described.

[0040] (1-3-3-1. Device operation processing) First, the worker W operates the control device 30. At this time, the worker W performs tasks such as operating the operation panel P, manual work, data recording, and data confirmation of the control device 30.

[0041] (1-3-3-2. Operation data acquisition process) Second, the server device 10 acquires operation data. At this time, the server device 10 acquires, for example, image data of the operation panel P captured by the camera C, gaze data of the worker W detected by the gaze sensor S, position data of the worker W detected by the worker terminal 20, etc. as the operation data.

[0042] (1-3-3-3. Operation data analysis processing) Third, server device 10 analyzes the operation data. At this time, server device 10 analyzes, for example, image data of operation panel P and determines whether worker W has correctly operated operation panel P. Server device 10 also analyzes, for example, line-of-sight data of worker W and records data on the operation panel P in the line of sight of worker W. Server device 10 can also analyze, for example, position data of worker W and determine whether worker W is operating the correct control device 30. Then, server device 10 determines the content of the notification based on the analysis result of the operation data.

[0043] (1-3-3-4. Work instruction notification processing) Fourth, the server device 10 notifies the worker W of the work instruction. At this time, if the server device 10 determines that the worker W has performed the correct operation, it transmits, for example, the next work instruction in the work process created based on the SOP to the worker terminal 20 and displays it on the monitor M of the worker terminal 20. On the other hand, if the server device 10 determines that the worker W has performed an incorrect operation, it notifies, for example, an error message, changed work instructions, etc.

[0044] (1-3-3-5. Work report generation process) Fifth, the server device 10 generates a work report. At this time, for example, when all work processes to be performed on the control device 30 have been completed, the server device 10 generates a work report indicating the work status.

[0045] (1-3-4. Effects of the work management system 100) The following describes the effects of the work management system 100 according to the embodiment. As will be described in Effects 1 to 4 below, the work management system 100 can connect information between devices (for example, data linkage, centralized data management, data integration, and data translation) without making any physical modifications to the devices in order to connect the devices to a network.

[0046] (1-3-4-1. Effect 1) In the work management system 100, the server device 10 can notify the worker W of work instructions created based on the SOP even in an environment where the control device 30 is not connected to a network. Also, in the work management system 100, the server device 10 can notify an error message if the worker W performs an incorrect operation.

[0047] (1-3-4-2. Effect 2) In the work management system 100, even in an environment where the control device 30 is not connected to a network, data such as work records and measurement data records can be digitized, so that the data can be expected to be utilized.

[0048] (1-3-4-3. Effect 3) With the work management system 100, even in an environment where the control devices 30 are not connected to a network, there is no need to modify the system to connect each control device 30 to the network, so there is no need for modification time, modification costs, burden on the work site, etc.

[0049] (1-3-4-4. Effect 4) With the work management system 100, even if a black-boxed control device 30 is present in a production factory or the like, there is no need to connect it to a network, so reliability can be maintained from the standpoint of confidentiality.

[0050] 2. Configuration and Processing of Each Device in the Work Management System 100 The configuration and processing of each device included in the work management system 100 shown in Fig. 1 will be described using Fig. 2 to Fig. 8. Below, an example of the configuration and processing of the entire work management system 100 according to the embodiment will be described, followed by a detailed description of an example of the configuration and processing of the server device 10, the worker terminal 20, and the control device 30.

[0051] (2-1. Example of overall configuration of work management system 100) An example of the overall configuration of the work management system 100 shown in Fig. 1 will be described using Fig. 2. Fig. 2 is a block diagram showing an example of the configuration of each device of the work management system 100 according to the embodiment. As shown in Fig. 2, the work management system 100 has a server device 10, a worker terminal 20, and a control device 30. The server device 10 and the worker terminal 20 are connected to each other so as to be able to communicate with each other via a communication network N realized by the Internet, a dedicated line, or the like.

[0052] The server device 10 is installed in a cloud environment, an on-premise environment, an edge environment, etc. The worker terminal 20 is carried by a worker W. The control device 30 is installed at a work site such as a production factory.

[0053] (2-2. Configuration Example and Processing Example of Server Device 10) An example of the configuration and processing of the server device 10 will be described with reference to Fig. 2. The server device 10 is an information providing device, and includes an input unit 11, an output unit 12, a communication unit 13, a storage unit 14, and a control unit 15.

[0054] (2-2-1. Input section 11) The input unit 11 controls input of various information to the server device 10. For example, the input unit 11 is realized by a mouse, a keyboard, etc., and accepts input of various information to the server device 10.

[0055] (2-2-2. Output section 12) The output unit 12 controls the output of various information from the server device 10. For example, the output unit 12 is realized by a display or the like, and displays various information stored in the server device 10.

[0056] (2-2-3. Communications Department 13) The communication unit 13 controls data communication with other devices. For example, the communication unit 13 performs data communication with each communication device via a router, etc. The communication unit 13 can also perform data communication with a terminal, etc. (not shown).

[0057] (2-2-4. Storage section 14) The storage unit 14 stores various pieces of information referenced by the control unit 15 when it operates, and various pieces of information acquired when the control unit 15 operates. The storage unit 14 includes an instruction data storage unit 14a, an operation data storage unit 14b, an analysis result storage unit 14c, and a work report storage unit 14d. Here, the storage unit 14 may be realized by, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a storage device such as a hard disk or an optical disk. Note that, in the example of FIG. 2, the storage unit 14 is installed inside the server device 10, but it may also be installed outside the server device 10, or multiple storage units may be installed.

[0058] (2-2-4-1. Instruction data storage unit 14a) The instruction data storage unit 14a stores instruction data. For example, the instruction data storage unit 14a stores instruction data including a work instruction transmitted by a notification unit 15a of the control unit 15, which will be described later. Here, an example of data stored in the instruction data storage unit 14a will be described with reference to FIG. 3. FIG. 3 is a diagram showing an example of the instruction data storage unit 14a of the server device 10 according to the embodiment. In the example of FIG. 3, the instruction data storage unit 14a has items such as "operation device," "work process," and "work instruction."

[0059] The "operation device" is a device operated by the worker W, and indicates identification information for identifying the operation device that is not connected to a network, such as the identification number or identification symbol of the control device 30. Here, the "operation device" is not particularly limited, and may be the control device 30, or a mobile object such as a robot having an operation panel P, an automobile, or a bicycle. The "work process" is each stage of a work including a single or series of operations performed by the worker W on the operation device, such as each stage of a work performed by the worker W on the control device 30. A "work instruction" is an instruction to a worker W for a task including a single or series of operations performed by the worker W regarding an operating device, such as a "manual work instruction" such as loading raw materials into a tank controlled by the control device 30, a "screen operation instruction" such as operating the operation panel P of the control device 30, an "automatic control display" such as monitoring data during automatic control of the control device 30, a "data recording instruction" such as recording measurement data on the operation panel P of the control device 30, a "control start instruction" such as starting operation of the control device 30, a "control interrupt instruction" such as interrupting operation of the control device 30, and a "control end instruction" such as ending operation of the control device 30.

[0060] That is, Figure 3 shows an example in which, for a control device 30 identified by "control device #1", data such as {Work process: "Work process #1", work instruction: "Work instruction #1"}, {Work process: "Work process #2", work instruction: "Work instruction #2"}, {Work process: "Work process #3", work instruction: "Work instruction #3"}, etc. are stored in the instruction data storage unit 14a.

[0061] The instruction data storage unit 14a may store operation permissions (access rights) for each control device 30 and work instructions.

[0062] (2-2-4-2. Operation data storage unit 14b) The operation data storage unit 14b stores operation data. For example, the operation data storage unit 14b stores operation data acquired by an acquisition unit 15b of the control unit 15 (described later) and analyzed by an analysis unit 15c. Here, an example of data stored in the operation data storage unit 14b will be described with reference to FIG. 4. FIG. 4 is a diagram showing an example of the operation data storage unit 14b of the server device 10 according to the embodiment. In the example of FIG. 4, the operation data storage unit 14b has items such as "operation device," "work process," "image data," "gaze data," and "position data."

[0063] The "operation device" indicates identification information for identifying an operation device operated by the operator W that is not connected to a network, such as the identification number or identification symbol of the control device 30. The "work process" indicates each stage of a work including a single or series of operations performed by the operator W on the operation device, such as each stage of a work performed by the operator W on the control device 30. The "image data" indicates data that identifies the state of the operation screen of the operation device, such as still image data or video image data of the operation panel P captured by a camera C installed in the control device 30. The "gaze data" indicates data that identifies the operator W's gaze toward the operation screen of the operation device, such as coordinate data indicating an area on the operation panel P detected by a gaze sensor installed in the control device 30. The "position data" indicates the position of the operator W operating the operation device, such as coordinate data indicating the position of the operator W within the production factory detected by a GPS (Global Positioning System) sensor, which is a position sensor built into the operator terminal 20.

[0064] 4 shows an example in which data such as {Work process: "Work process #1", image data: "Image data #1", gaze data: "Gaze data #1"}, {Work process: "Work process #2", image data: "Image data #2", gaze data: "Gaze data #2"}, {Work process: "Work process #3", image data: "Image data #3", gaze data: "Gaze data #3"}, etc. are stored in the operation data storage unit 14b for the control device 30 identified by "control device #1." Also shown is an example in which data such as {Work process: "Work process #1", position data: "Position data #1"}, {Work process: "Work process #2", position data: "Position data #2"}, {Work process: "Work process #3", position data: "Position data #3"}, etc. are stored in the operation data storage unit 14b for the worker W who operates the control device 30 identified by "control device #1."

[0065] (2-2-4-3. Analysis result storage unit 14c) The analysis result storage unit 14c stores the analysis results. For example, the analysis result storage unit 14c stores the analysis results output by the analysis unit 15c of the control unit 15, which will be described later. Here, an example of data stored in the analysis result storage unit 14c will be described with reference to FIG. 5. FIG. 5 is a diagram showing an example of the analysis result storage unit 14c of the server device 10 according to the embodiment. In the example of FIG. 5, the analysis result storage unit 14c has items such as "operation device," "work process," "analysis data," and "notification data."

[0066] The "operation device" indicates identification information for identifying an operation device operated by the worker W that is not connected to a network, such as the identification number or identification symbol of the control device 30. The "work process" is each stage of a work including a single or series of operations performed by the worker W on the operation device, such as each stage of a work performed by the worker W on the control device 30. The "analysis data" is the operation or result of the operation performed on the operation device by the worker W identified from the operation data, such as the input operation to the operation panel P of the control device 30 performed by the worker W in accordance with the work instruction and the appropriateness of the input operation, the visual action to the operation panel P of the control device 30 performed by the worker W in accordance with the work instruction and the character data within the visually viewed area of ​​the operation panel P, the movement action to the control device 30 performed by the worker W in accordance with the work instruction and the appropriateness of the movement action, etc. The "notification data" is text data indicating the content of the notification to the worker W determined using the "analysis data," such as a normal work message indicating that the worker W performed the correct operation, an abnormal work message (error message) indicating that the worker W performed an incorrect operation or an incorrect operation of the control device 30, or a work change message indicating that the work being performed by the worker W will be changed.

[0067] That is, Figure 5 shows an example in which, for a control device 30 identified by "control device #1", data such as {Work process: "Work process #1", analysis data: "Analysis data #1", notification data: "Notification data #1"}, {Work process: "Work process #2", analysis data: "Analysis data #2", notification data: "Notification data #2"}, {Work process: "Work process #3", analysis data: "Analysis data #3", notification data: "Notification data #3"}, etc. are stored in the analysis result storage unit 14c.

[0068] (2-2-4-4. Work report storage section 14d) The work report storage unit 14d stores work reports. For example, the work report storage unit 14d stores work reports generated by a generation unit 15d of the control unit 15, which will be described later. Here, an example of data stored in the work report storage unit 14d will be described with reference to FIG. 6. FIG. 6 is a diagram showing an example of the work report storage unit 14d of the server device 10 according to the embodiment. In the example of FIG. 6, the work report storage unit 14d has items such as "operation equipment," "schedule," and "work report."

[0069] "Operation device" indicates identification information for identifying an operation device that is operated by worker W and is not connected to a network, such as the identification number or identification symbol of the control device 30. "Schedule" indicates the period of work related to the operation device performed by worker W, such as the date on which a series of work processes related to the control device 30 was performed. "Work report" is a report that records the work content related to the operation device performed by worker W, and is data including, for example, the identification number of the control device 30, the name of worker W, the work performed, text data such as recorded data, image data, etc.

[0070] That is, FIG. 6 shows an example in which data such as {Schedule: "Schedule #1", work report: "Work report #1"}, {Schedule: "Schedule #2", work report: "Work report #2"}, etc. are stored in the work report memory unit 14d for the control device 30 identified by "control device #1".

[0071] (2-2-5. Control unit 15) The control unit 15 controls the entire server device 10. The control unit 15 has a notification unit 15a, an acquisition unit 15b, an analysis unit 15c, and a generation unit 15d. Here, the control unit 15 can be realized by, for example, an electronic circuit such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), or an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0072] (2-2-5-1.Notification section 15a) The notification unit 15a notifies various types of information. Note that the notification unit 15a may refer to various types of information stored in the storage unit 14.

[0073] The notification unit 15a notifies the worker W of a work instruction for a predetermined work process related to an operation device operated by the worker W. The notification unit 15a also notifies the worker W of the notification content determined by the analysis unit 15c. The notification unit 15a also notifies the worker W of the work instruction via the worker terminal 20 carried by the worker W. The notification unit 15a also notifies the worker W of the operation for performing each work process created from the SOP as a work instruction. For example, the notification unit 15a transmits instruction data including the first work instruction among instruction data including work instructions for each work process created by an operator based on the SOP to the worker terminal 20, which is a tablet terminal carried by the worker W, and displays the instruction data on the monitor M of the worker terminal 20.

[0074] To explain a specific example, the notification unit 15a identifies "work process #1," which is the first work process of worker W operating the control device 30 identified by "control device #1," references {work process: "work process #1," work instruction: "work instruction #1"} from the instruction data storage unit 14a as instruction data including "work instruction #1," which is the first work instruction to be notified to worker W, transmits the instruction data to the worker terminal 20 identified as the destination, and displays "work instruction #1" on the monitor M of the worker terminal 20 together with a flowchart showing the work instructions for each work process.

[0075] Furthermore, the notification unit 15a refers to "analysis data #1" from the analysis result storage unit 14c as analysis data that is the analysis result for "work instruction #1", and if it is determined that the worker W performed the correct operation, it identifies "work process #2", which is the second work process of the worker W who operates the control device 30 identified by "control device #1", and refers to {work process: "work process #2", work instruction: "work instruction #2"} from the instruction data storage unit 14a as instruction data including "work instruction #2", which is the second work instruction to be notified to the worker W, and transmits the instruction data to the worker terminal 20 identified as the destination, and displays "work instruction #2" on the monitor M of the worker terminal 20 together with a flowchart showing the work instructions for each work process. At this time, "notification data #1" is referenced from the analysis result memory unit 14c as notification data that is the analysis result for "work instruction #1", and the notification data is sent to the worker terminal 20, and a successful operation message indicating that the worker W performed the correct operation, such as "The controller operated normally as a result of the first operation", or "The data reading was completed normally as a result of the first operation", is displayed on the monitor M of the worker terminal 20.

[0076] Furthermore, the notification unit 15a refers to "analysis data #1" from the analysis result storage unit 14c as analysis data that is the analysis result for "work instruction #1," and if it is determined that the worker W performed an incorrect operation, it refers to "notification data #1" from the analysis result storage unit 14c as notification data that is the analysis result for "work instruction #1," transmits the notification data to the worker terminal 20, and causes the monitor M of the worker terminal 20 to display an abnormal work message indicating that the worker W performed an incorrect operation, such as "The first work prevented the controller from operating normally," or "The first work prevented data from being read normally." At this time, the notification unit 15a not only displays the abnormal work message on the worker terminal 20, but can also cause the worker terminal 20 to generate an alarm or the like.

[0077] Furthermore, the notification unit 15a refers to "analysis data #1" from the analysis result storage unit 14c as analysis data that is the analysis result for "work instruction #1", and if it is determined that the worker W performed an incorrect operation, it refers to {work process: "work process #1", work instruction: "work instruction #1-2"} from the instruction data storage unit 14a as instruction data that includes "work instruction #1-2", which is a modified version of the first work instruction to be notified to the worker W, transmits the instruction data to the worker terminal 20 identified as the destination, and displays "work instruction #1-2" on the monitor M of the worker terminal 20 together with a flowchart showing the work instructions for each work process. At this time, the notification unit 15a refers to "notification data #1" from the analysis result memory unit 14c as notification data that is the analysis result for "work instruction #1", transmits the notification data to the worker terminal 20, and displays a work change message indicating that the work to be performed by the worker W will be changed, such as "The first work has prevented the controller from operating normally. Please press the operation button again," or "The first work has prevented data from being read normally. Please enter the data directly into the tablet terminal," on the monitor M of the worker terminal 20.

[0078] As will be described later in Modification 1 of the embodiment, notification unit 15a can also notify the worker W of the work instruction via a wearable terminal such as smart glasses G worn by the worker W. Furthermore, as will be described later in Modifications 3 and 4 of the embodiment, notification unit 15a can also notify the worker W of the work instruction transmitted by upper server device 40, which is a management device that manages multiple operation devices. Furthermore, as will be described later in Application Example 1 of the embodiment, notification unit 15a can also notify the worker W of the history of an operation selected as the best operation from among past operations performed on operation devices such as control device 30.

[0079] (2-2-5-2. Acquisition part 15b) The acquisition unit 15b acquires various types of information. The acquisition unit 15b may store the acquired various types of information in the storage unit 14. The acquisition unit 15b may also refer to the various types of information stored in the storage unit 14. The operation data acquisition process (image data acquisition process, gaze data acquisition process, and position data acquisition process) will be described below.

[0080] (Operation data acquisition process) The acquisition unit 15b acquires operation data that identifies an operation performed on an operation device by the worker W in response to a work instruction. For example, the acquisition unit 15b acquires image data, gaze data, position data, etc. as the operation data, as will be described later.

[0081] (Image data acquisition process) The acquiring unit 15b acquires, as operation data, image data that specifies the state of the operation screen of the operation device. For example, the acquiring unit 15b acquires image data captured by a camera C, which is an imaging device installed in a position where it can capture an image of the operation screen of the operation device. That is, the acquiring unit 15b acquires image data captured by a camera C installed in the vicinity of the control device 30 where it can capture an image of the operation panel P of the control device 30.

[0082] To explain a specific example of the image data acquisition process, the acquisition unit 15b acquires image data captured by a camera C installed in the vicinity of the control device 30 identified by "control device #1", such as {Work process: "Work process #1", image data: "Image data #1"}, {Work process: "Work process #2", image data: "Image data #2"}, {Work process: "Work process #3", image data: "Image data #3"}, and stores the data in the operation data storage unit 14b.

[0083] (Gaze data acquisition processing) The acquiring unit 15b acquires, as operation data, gaze data that specifies the gaze of the worker W toward the operation screen of the operation device. For example, the acquiring unit 15b acquires gaze data detected by a gaze sensor S, which is a sensor device installed in a position where it can detect the gaze of the worker W operating the operation device. That is, the acquiring unit 15b acquires gaze data detected by a gaze sensor S installed in the vicinity of the control device 30 that can detect the gaze of the worker W operating the control device 30.

[0084] To explain a specific example of the gaze data acquisition process, the acquisition unit 15b acquires gaze data detected by the gaze sensor S installed in the vicinity of the control device 30 identified as "control device #1", such as {Work process: "Work process #1", gaze data: "Gaze data #1"}, {Work process: "Work process #2", gaze data: "Gaze data #2"}, {Work process: "Work process #3", gaze data: "Gaze data #3"}, etc., and stores them in the operation data storage unit 14b.

[0085] (Location data acquisition process) The acquiring unit 15b acquires, as the operation data, position data that identifies the position of the worker W operating the operation device. For example, the acquiring unit 15b acquires position data detected by a position sensor, which is a sensor device built into the worker terminal 20.

[0086] To explain a specific example of the position data acquisition process, the acquisition unit 15b acquires position data detected by a GPS sensor built into the worker terminal 20 carried by the worker W who operates the control device 30 identified by "control device #1," such as {Work process: "Work process #1," position data: "Position data #1"}, {Work process: "Work process #2," position data: "Position data #2"}, {Work process: "Work process #3," position data: "Position data #3"}, and stores the data in the operation data storage unit 14b.

[0087] The acquiring unit 15b can also acquire image data captured by a wearable device such as smart glasses G worn by the worker W, as will be described later in a first modified example of the embodiment. Similarly, the acquiring unit 15b can also acquire gaze data detected by a wearable device such as smart glasses G worn by the worker W. Similarly, the acquiring unit 15b can also acquire position data detected by a wearable device such as smart glasses G worn by the worker W. Similarly, the acquiring unit 15b can also acquire image data captured by a worker terminal 20 such as a smartphone carried by the worker W, as will be described later in a second modified example of the embodiment. Similarly, the acquiring unit 15b can also acquire device identification information for identifying an operating device, as will be described later in a third and fourth modified examples of the embodiment.

[0088] (2-2-5-3. Analysis section 15c) The analysis unit 15c analyzes various pieces of information. The analysis unit 15c may store the analysis results in the storage unit 14. The analysis unit 15c may also refer to the various pieces of information stored in the storage unit 14.

[0089] The analysis unit 15c analyzes the operation data and determines the content of the notification to the worker W. For example, the analysis unit 15c determines, as the content of the notification, a work instruction for the next work process after the predetermined work process, an error message for the operation performed by the worker W, or a change in the work instruction for the predetermined work process.

[0090] Furthermore, the analysis unit 15c determines whether the operation performed by the worker W on the operation device is appropriate by using at least one of the image data and the line of sight data. At this time, the analysis unit 15c may further use the position data to determine whether the operation performed by the worker W on the operation device is appropriate. Furthermore, the analysis unit 15c uses at least one of the image data and the line of sight data to record the characters on the operation screen viewed by the worker W. At this time, the analysis unit 15c may further use the position data to record the characters on the operation screen viewed by the worker W.

[0091] Here, the analysis unit 15c can generate analysis data that indicates, for example, how much time it took for a numerical value displayed on the operation panel P to change from one value to another. Furthermore, the analysis unit 15c can also execute a process of calculating an average value when the measurement data is varied (unstable), for example.

[0092] To explain a specific example, the analysis unit 15c refers to {work process: "work process #1", image data: "image data #1", gaze data: "gaze data #1", position data: "position data #1"} from the operation data storage unit 14b as operation data corresponding to "work instruction #1," which is the first work instruction notified to the worker W who operates the control device 30 identified by "control device #1." The analysis unit 15c also analyzes "image data #1" by referring to layout information (e.g., the arrangement of buttons on the operation panel P) and information on screen responses and transitions (e.g., pressing the "operation" button turns on the "operation lamp") stored in the storage unit 14, and determines whether the operation of the worker W is correct or incorrect, thereby identifying the operation of the worker W or the result of the operation. The analysis unit 15c also generates "analysis data #1" as analysis data including the identification result. Furthermore, the analysis unit 15c stores "analysis data #1" as the generated analysis data in the analysis result storage unit 14c.

[0093] Furthermore, the analysis unit 15c references {work process: "work process #1", image data: "image data #1", gaze data: "gaze data #1", position data: "position data #1"} from the operation data storage unit 14b as operation data corresponding to "work instruction #1," which is the first work instruction notified to the worker W who operates the control device 30 identified by "control device #1." The analysis unit 15c also analyzes, by OCR processing, "image data #1" corresponding to coordinate data indicating the area on the operation panel P indicated by the "gaze data #1," and acquires character data within the area of ​​the operation panel P that the worker W gazed at, thereby identifying the operation or the result of the operation by the worker W. The analysis unit 15c also generates "analysis data #1" as analysis data including the identification result. The analysis unit 15c also stores the "analysis data #1" as the generated analysis data in the analysis result storage unit 14c.

[0094] Furthermore, the analysis unit 15c references {work process: "work process #1", image data: "image data #1", gaze data: "gaze data #1", position data: "position data #1"} from the operation data storage unit 14b as operation data corresponding to "work instruction #1," which is the first work instruction notified to the worker W operating the control device 30 identified by "control device #1." The analysis unit 15c analyzes the "position data #1" by referencing the coordinate data within the production factory of the control device 30 stored in the storage unit 14, and determines whether the control device 30 operated by the worker W and the work location are correct or whether the control device 30 operated by the worker W and the work location are incorrect, thereby identifying the operation or the result of the operation by the worker W. The analysis unit 15c generates "analysis data #1" as analysis data including the identification result. The analysis unit 15c stores the generated "analysis data #1" in the analysis result storage unit 14c.

[0095] Furthermore, the analysis unit 15c refers to "analysis data #1" as analysis data from the analysis result storage unit 14c, and generates "notification data #1" as notification data including a normal operation message indicating that the operator W performed the correct operation, such as "The controller operated normally as a result of the first operation," "The data reading was completed normally as a result of the first operation," etc. The analysis unit 15c also stores "notification data #1" as the generated notification data in the analysis result storage unit 14c.

[0096] Furthermore, the analysis unit 15c refers to "analysis data #1" as analysis data from the analysis result storage unit 14c, and generates "notification data #1" as notification data including an abnormal operation message indicating that the worker W performed an incorrect operation, such as "The first operation prevented the controller from operating normally," "The first operation prevented data from being read normally," etc. The analysis unit 15c also stores "notification data #1" as the generated notification data in the analysis result storage unit 14c.

[0097] Furthermore, the analysis unit 15c refers to "analysis data #1" as analysis data from the analysis result storage unit 14c, and generates "notification data #1-2" as notification data including a task change message indicating a change in the task to be performed by the worker W, such as "The first task prevented the controller from operating normally. Please press the operation button again," "The first task prevented data from being read normally. Please enter the data directly into the tablet terminal," etc. The analysis unit 15c also stores "notification data #1-2" as the generated notification data in the analysis result storage unit 14c.

[0098] The analysis unit 15c generates a model that enables the translation of data related to the operation device identified using the acquired device identification information, as will be described later in Modifications 3 and 4. Here, data translation refers to processing that enables smooth data exchange between a higher-level device and a lower-level device, for example, by processing such as data analysis, data conversion, and data unification.

[0099] (2-2-5-4. Generation section 15d) The generating unit 15d generates various types of information. The generating unit 15d may store the generated various types of information in the storage unit 14. The generating unit 15d may also refer to the various types of information stored in the storage unit 14.

[0100] When all work processes performed by the worker W are completed, the generation unit 15d generates a work report that records the work status of the worker W regarding the operation device. For example, when all work processes performed on the control device 30 are completed, the generation unit 15d generates a work report that includes the identification number of the control device 30, the name of the worker W, the performed work, recorded data, etc.

[0101] To explain a specific example, the generation unit 15d refers to "analysis data #N" from the analysis result storage unit 14c as analysis data corresponding to "work instruction #N," which is the last work instruction notified to the worker W who operates the control device 30 identified by "control device #1." Furthermore, if the identification result includes an indication that "work instruction #N" has been completed successfully, the generation unit 15d refers to "analysis data #1," "analysis data #2," "analysis data #3," ..., "analysis data #N" from the analysis result storage unit 14c as analysis data corresponding to the entire work process, and extracts the operation of the worker W or the result of the operation as work content (such as the identification number of the control device 30, the name of the worker W, the work performed, and recorded data) as the identification result. Furthermore, the generation unit 15d stores {schedule: "schedule #1," work report: "work report #1"} in the work report storage unit 14d as a work report including the extracted work content.

[0102] (2-3. Configuration Example and Processing Example of Worker Terminal 20) 2 again, a description will be given of an example of the configuration and processing of worker terminal 20. Worker terminal 20 is a device operated by worker W and is an example of a device connected to a network. Worker terminal 20 has a control unit 21, a communication unit 22, and a monitor M.

[0103] (2-3-1. Control unit 21) The control unit 21 transmits various types of information. For example, the control unit 21 transmits position data detected by a position sensor to the server device 10. The control unit 21 also transmits input data, such as a request to complete execution of a work instruction received from the worker W, a request to skip a work instruction, and measurement data, to the server device 10.

[0104] The control unit 21 receives various types of information. For example, the control unit 21 receives instruction data transmitted from the server device 10. The control unit 21 also receives notification data transmitted from the server device 10.

[0105] (2-3-2. Communications Department 22) The communication unit 22 controls data communication with other devices. For example, the communication unit 22 performs data communication with each communication device via a router, etc. The communication unit 22 can also perform data communication with a terminal, etc. (not shown).

[0106] (2-3-3. Monitor M) The monitor M controls the input of various information to the worker terminal 20. For example, the monitor M is realized by a touch panel or the like, and accepts the input of various information to the worker terminal 20. The monitor M also controls the display of various information from the worker terminal 20. For example, the monitor M is realized by a touch panel or the like, and displays various information stored in the worker terminal 20.

[0107] Furthermore, the monitor M displays instruction data transmitted from the server device 10, which is an information providing device, as a work instruction screen. Details of the work instruction screen will be described later in (2-3-4. Specific examples of display screens of the worker terminal 20).

[0108] (2-3-4. Specific Examples of Display Screens on the Worker Terminal 20) Here, a work instruction screen will be described as a specific example of a display screen output by the monitor M of the worker terminal 20, using Fig. 7. Fig. 7 is a diagram showing a specific example of a display screen of the worker terminal 20 according to the embodiment. Below, the display mode of the work instruction, the type of the work instruction, etc. will be described.

[0109] (2-3-4-1. Display of work instructions) The worker terminal 20 displays a flowchart showing work instructions for each work process on the monitor M on the work instruction screen. In the example of FIG. 7, the worker terminal 20 notifies the worker W of work instructions in the order of "Manual Work Instruction 1," "Screen Operation Instruction 1," and "Automatic Control 1 Display." The worker terminal 20 can also display work instructions that are currently being performed in the flowchart in color or enlarged, and can display work instructions that have been performed or work instructions that have not yet been performed in grayed out or reduced in size. In the example of FIG. 7, the worker terminal 20 displays "Manual Work Instruction 1," which has been performed, and "Automatic Control 1 Display," which has not yet been performed, in grayed out, and displays "Screen Operation 1 Instruction," which is currently being performed, in an enlarged manner. The worker terminal 20 can also display a list of work instructions for each work process, highlighting work instructions that are currently being performed.

[0110] (2-3-4-2. Types of work instructions) On the work instruction screen, the worker terminal 20 displays "manual work instructions" such as inputting raw materials in a production factory, "screen operation instructions" such as operating the operation panel P of the control device 30, "automatic control display" such as monitoring data during automatic control of the control device 30, "data recording instructions" such as recording measurement data on the operation panel P of the control device 30, "control start instructions" such as starting operation of the control device 30, "control interrupt instructions" such as interrupting operation of the control device 30, "control end instructions" such as ending operation of the control device 30, etc., but the types of work instructions are not particularly limited.

[0111] (2-3-4-3. Other) The worker terminal 20 can display a flowchart showing the work instructions for each work process on the monitor M on the work instruction screen, and can also output the work instructions being performed by voice. Furthermore, when the worker W taps on the monitor M on a work instruction shown in the flowchart on the work instruction screen, the worker terminal 20 can also display a display screen showing details of the work instruction. Furthermore, the worker terminal 20 can also accept input on the work instruction screen by the worker W on the monitor M to indicate that the execution of the work instruction has been completed or to indicate that the work instruction has been skipped.

[0112] (2-4. Configuration and Processing Examples of Control Device 30) 2 again, a configuration example and a processing example of the control device 30 will be described. The control device 30 is an example of an operation device that is operated by the worker W and is not connected to a network. The control device 30 is an apparatus that controls a plurality of control target devices, and has a control unit 31 and an operation panel P.

[0113] (2-4-1. Control unit 31) The control unit 31 executes various controls. For example, the control unit 31 transmits control signals to the control target devices. The control unit 31 also collects measurement data from the control target devices.

[0114] (2-4-2. Operation Panel P) The operation panel P controls the input of various information to the control device 30. For example, the operation panel P is realized by a touch panel or the like, and accepts input by tapping the control device 30 by the operator W. The operation panel P also controls the display of various information from the control device 30. For example, the operation panel P is realized by a touch panel or the like, and displays an operation screen including operation buttons and measurement data stored in the control device 30. Details of the operation screen of the operation panel P will be described later in (2-4-3. Specific examples of display screens of the control device 30).

[0115] (2-4-3. Specific Examples of Display Screens of Control Device 30) Here, an operation screen will be described as a specific example of a display screen output by operation panel P of control device 30, using Fig. 8. Fig. 8 is a diagram showing a specific example of a display screen of control device 30 according to an embodiment. Below, the basic display, data display, status display, etc. of the operation screen will be described.

[0116] (2-4-3-1. Basic display of the operation screen) As shown in FIG. 8(1), the control device 30 displays an operation screen including icons for operation buttons, status displays, data displays, etc. on the operation panel P. In the example of FIG. 8(1), the control device 30 displays, as operation buttons, an "operation" icon that accepts an input to start operation of the control device 30 and a "stop" icon that accepts an input to end or suspend operation of the control device 30. Furthermore, as a status display, the control device 30 displays an "operation lamp" icon that lights up when the control device 30 is operating. Furthermore, as a data display, the control device 30 displays a "data" icon that includes the numerical values ​​of the measurement data measured by the control device 30. Here, the worker W can start operation of the control device 30 by tapping the "operation" operation button.

[0117] (2-4-3-2. Data display) As shown in Fig. 8(2), the control device 30 displays an operation screen including icons for displaying data, etc., on the operation panel P. Here, when the worker W visually looks at the numerical value of the measurement data included in the "data" icon for a certain period of time or more, the server device 10 can determine that the measurement data is "0000" (see the dashed ellipse in Fig. 8(2)) based on the image data generated by the camera C and the gaze data generated by the gaze sensor S.

[0118] (2-4-3-3. Status display) As shown in Fig. 8(3), the control device 30 displays an operation screen including icons for displaying status, etc., on the operation panel P. Here, when the worker W taps the "operation" operation button, the server device 10 can identify whether the "operation lamp" is lit (see the dashed circle in Fig. 8(3)) based on the image data generated by the camera C, and determine that the worker W has performed an appropriate operation.

[0119] (2-5. Camera C) 2 again, an example of the configuration and processing of camera C will be described. Camera C is an imaging device installed in a position where it can capture an image of the operation screen of an operating device. For example, camera C is installed in the vicinity of control device 30 where it can capture an image of operation panel P of control device 30. Camera C also captures an image of the operation screen of operation panel P and generates image data that identifies the state of the operation screen of operation panel P.

[0120] The camera C may be installed in the smart glasses G, as will be described later in a first modified example of the embodiment. The camera C may also be mounted on the worker terminal 20, as will be described later in a second modified example of the embodiment.

[0121] (2-6. Eye Sensor S) 2 again, a configuration example and a processing example of the gaze sensor S will be described. The gaze sensor S is a sensor device installed in a position where it can detect the gaze of a worker W who operates an operation device. For example, the gaze sensor S is installed in the vicinity of the control device 30 where it can detect the gaze of the worker W who operates the control device 30. Furthermore, the gaze sensor S detects the gaze of the worker W who operates the operation panel P, and generates gaze data that identifies the gaze of the worker W toward the operation screen of the operation panel P.

[0122] The line-of-sight sensor S may be mounted on smart glasses G, as will be described later in a first modified example of the embodiment.

[0123] 3. Flow of each process in the work management system 100 9 to 13, the process flow of the work management system 100 according to the embodiment will be described. Below, the overall process flow of the work management system 100 will be described, and then each process, work instruction notification process, operation data acquisition process, operation data analysis process, and work report generation process, will be described.

[0124] (3-1. Overall processing of the work management system 100) The overall processing flow of the work management system 100 according to the embodiment will be described using Figure 9. Figure 9 is a flowchart showing an example of the overall processing flow of the work management system 100 according to the embodiment. Note that the processing of steps S101 to S105 below can also be executed in a different order. Also, some of the processing of steps S101 to S105 below may be omitted.

[0125] (3-1-1. Operation data acquisition process) First, server device 10 executes operation data acquisition processing (step S101). For example, server device 10 executes the processing of steps S201 to S205 described below to acquire operation data that specifies an operation related to control device 30.

[0126] (3-1-2. Operation data analysis processing) Second, the server device 10 executes an operation data analysis process (step S102). For example, the server device 10 executes the processes of steps S301 to S306 described below to identify the operation or the result of the operation by the operator W regarding the control device 30, and determines the content of the notification to the operator W.

[0127] (3-1-3. Work instruction notification processing) Third, the server device 10 executes a work instruction notification process (step S103). For example, the server device 10 executes the processes of steps S401 to S404 described below to notify the worker W who operates the control device 30 of a work instruction for a predetermined work process.

[0128] If the server device 10 has completed the notification of work instructions for all work processes (step S104: Yes), the server device 10 proceeds to the process of step S105. On the other hand, if the server device 10 has not completed the notification of work instructions for all work processes (step S104: No), the server device 10 returns to the process of step S101.

[0129] (3-1-4. Work report generation process) Fourth, the server device 10 executes an operation data analysis process (step S105) and terminates the overall processing of the work management system 100. For example, the server device 10 executes the processes of steps S501 to S503 described below to generate a work report that records the work content of the worker W related to the control device 30.

[0130] (3-2. Operation data acquisition process) The flow of operation data acquisition processing in the work management system 100 according to the embodiment will be described with reference to Fig. 10. Fig. 10 is a flowchart showing an example of the flow of operation data acquisition processing in the work management system 100 according to the embodiment. Note that the processing in the following steps S201 to S205 can also be executed in a different order. Furthermore, some of the processing in the following steps S201 to S205 may be omitted.

[0131] (3-2-1. Device operation processing) First, the worker W executes a device operation process (step S201). For example, the worker W performs operations related to the control device 30, such as charging raw materials into a tank controlled by the control device 30, inputting data into the operation panel P of the control device 30, and visually checking measurement data measured by the control device 30.

[0132] (3-2-2. Image data acquisition process) Second, the server device 10 executes an image data acquisition process (step S202). For example, the server device 10 acquires image data of the operation screen of the operation panel P captured by a camera C installed in a position where the camera C can capture an image of the operation panel P of the control device 30.

[0133] (3-2-3. Gaze data acquisition process) Third, the server device 10 executes a gaze data acquisition process (step S203). For example, the server device 10 acquires gaze data of the operator W on the operation screen of the operation panel P, which is detected by an eye-gaze sensor S installed at a position where the gaze of the operator W operating the control device 30 on the operation panel P can be detected.

[0134] (3-2-4. Location data acquisition process) Fourth, the server device 10 executes a position data acquisition process (step S204). For example, the server device 10 acquires the position data of the worker W detected by a position sensor built into the worker terminal 20.

[0135] (3-2-5. Operation data storage process) Fifth, the server device 10 executes an operation data storage process (step S205), and ends the operation data acquisition process. For example, the server device 10 stores the operation data acquired in the processes of steps S202 to S204 in the operation data storage unit 14b.

[0136] (3-3. Operation data analysis processing) The flow of the operation data analysis process of the work management system 100 according to the embodiment will be described with reference to Fig. 11. Fig. 11 is a flowchart showing an example of the flow of the operation data analysis process of the work management system 100 according to the embodiment. Note that the processes of steps S301 to S306 below can also be executed in a different order. Also, some of the processes of steps S301 to S306 below may be omitted.

[0137] (3-3-1. Operation data reference process) First, the server device 10 executes an operation data reference process (step S301). The server device 10 references the latest operation data among the operation data stored in the operation data storage unit 14b.

[0138] (3-3-2. Device operation specific processing) Second, the server device 10 executes a device operation identification process (step S302). For example, the server device 10 analyzes the operation data referred to in the process of step S301, and identifies the operation performed by the worker W or the result of the operation.

[0139] (3-3-3. Analysis data generation process) Third, the server device 10 executes an analysis data generation process (step S303). For example, the server device 10 generates analysis data including the operation or the result of the operation performed by the worker W identified in the process of step S302.

[0140] (3-3-4. Notification data generation process) Fourth, the server device 10 executes a notification data generation process (step S304). For example, the server device 10 determines the content of the notification to the worker W based on the analysis data generated in the process of step S303, and generates notification data including a message indicating the content of the notification.

[0141] (3-3-5. Notification data transmission process) Fifth, the server device 10 executes a notification data transmission process (step S305). For example, the server device 10 transmits the notification data generated in the process of step S304 to the worker terminal 20.

[0142] (3-3-6. Analysis result storage process) Sixth, the server device 10 executes an analysis result storage process (step S306) and ends the operation data analysis process. For example, the server device 10 stores the analysis data generated in the process of step S303 and the notification data generated in the process of step S304 in the analysis result storage unit 14c.

[0143] (3-4. Work instruction notification processing) The flow of work instruction notification processing in the work management system 100 according to the embodiment will be described with reference to Fig. 12. Fig. 12 is a flowchart showing an example of the flow of work instruction notification processing in the work management system 100 according to the embodiment. Note that the processing in steps S401 to S404 below can also be executed in a different order. Furthermore, some of the processing in steps S401 to S404 below may be omitted.

[0144] (3-4-1. Work process identification processing) First, the server device 10 executes a work process identification process (step S401). For example, the server device 10 identifies a work process for which a work instruction is to be notified to the worker W among the work processes for which the control device 30 performs work.

[0145] (3-4-2. Instruction data reference processing) Second, the server device 10 executes an instruction data reference process (step S402). The server device 10 refers to instruction data including the work instruction for the work process identified in the process of step S401, among the work instructions stored in the instruction data storage unit 14a.

[0146] (3-4-3. Instruction data transmission process) Third, the server device 10 executes an instruction data transmission process (step S403). For example, the server device 10 transmits to the worker terminal 20 instruction data including the work instruction referred to in the process of step S402.

[0147] (3-4-4. Work instruction display processing) Fourth, the worker terminal 20 executes a work instruction display process (step S404) and ends the work instruction notification process. For example, the worker terminal 20 receives the instruction data including the work instructions transmitted in the process of step S403, highlights the work instructions to be notified to the worker W, and then displays a flowchart or list showing the work instructions for each work process on the monitor M.

[0148] (3-5. Work report generation process) The flow of work report generation processing in the work management system 100 according to the embodiment will be described with reference to Fig. 13. Fig. 13 is a flowchart showing an example of the flow of operation data analysis processing in the work management system 100 according to the embodiment. Note that the processing in steps S501 to S503 below can also be executed in a different order. Furthermore, some of the processing in steps S501 to S503 below may be omitted.

[0149] (3-5-1. Analysis result reference processing) First, the server device 10 executes an analysis result reference process (step S501). For example, when all work processes performed by the worker W are completed, the server device 10 refers to the analysis data for the target period among the analysis data stored in the analysis result storage unit 14c.

[0150] (3-5-2. Work content extraction process) Second, the server device 10 executes a work content extraction process (step S502). For example, the server device 10 extracts work content from the analysis data referenced in the process of step S501, and outputs a work report including the extracted work content.

[0151] (3-5-3. Work report storage process) Third, the server device 10 executes a work report storage process (step S503), and ends the work report generation process. For example, the server device 10 stores the work report output in the process of step S502 in the work report storage unit 14d.

[0152] 4. Modifications and Applications of the Embodiments Modifications and application examples of the embodiment will be described with reference to Figures 14 to 18. Modifications 1 to 4 and application examples 1 to 7 of the embodiment will be described below.

[0153] (4-1. First Modification of the Embodiment) The configuration and processing of a work management system 100M-1 according to Modification 1 of the embodiment will be described with reference to Fig. 14 and Fig. 15. Fig. 14 is a diagram showing an example of the configuration and processing of the work management system 100M-1 according to Modification 1 of the embodiment. Fig. 15 is a diagram showing a specific example of the display screen of smart glasses G according to Modification 1 of the embodiment. Note that descriptions of configurations and processing common to the embodiment will be omitted.

[0154] (4-1-1. Example of the configuration of the work management system 100M-1) The work management system 100M-1 includes a server device 10, smart glasses G, and a control device 30. The server device 10 and the smart glasses G are connected to each other via a predetermined communication network (not shown) so as to be able to communicate with each other via a wired or wireless connection. The work management system 100M-1 may include a repeater (not shown) for connecting the server device 10 and the smart glasses G to the predetermined communication network.

[0155] The smart glasses G are wearable devices worn by workers W at the work site of a production factory. The smart glasses G are equipped with a camera C that can capture the operation screen of the operation panel P. The smart glasses G also have a monitor function that can display work instructions and an eye-gaze sensor function that can detect the line of sight of the worker W.

[0156] The server device 10 is the same as the work management system 100 according to the embodiment, and therefore a description thereof will be omitted. The control device 30 is the same as the work management system 100 according to the embodiment, except that the camera C and the line-of-sight sensor S are not installed in the vicinity, and therefore a description thereof will be omitted.

[0157] (4-1-2. Processing example of the work management system 100M-1) The work management system 100M-1 executes the following processes. First, the worker W operates the control device 30 (step S11). Second, the server device 10 acquires operation data via the smart glasses G (step S12). Third, the server device 10 analyzes the operation data (step S13). Fourth, the server device 10 notifies the worker W of a work instruction via the smart glasses G (step S14). Fifth, the server device 10 generates a work report (step S15).

[0158] (4-1-3. Example of the display screen of Smart Glasses G) Here, a work instruction screen will be described as a specific example of a display screen output by the smart glasses G with reference to FIG.

[0159] As shown in Fig. 15(1), the smart glasses G display a flowchart showing work instructions for each work process on a work instruction screen. Furthermore, the worker W can recognize the operations being performed on the operation panel P of the control device 30 in an area where the work instruction screen is not displayed. In other words, when wearing the smart glasses G, the worker W can view the work display screen of the smart glasses G and simultaneously perform operations related to the control device 30.

[0160] As shown in Figure 15(2), when worker W visually examines the numerical value of the measurement data included in the "Data" icon through smart glasses G for a certain period of time or more, the server device 10 can determine that the measurement data is "0000" (see dashed ellipse in Figure 15(2)) based on the image data generated by the camera C installed in the smart glasses G and the gaze data generated by the smart glasses G.

[0161] As shown in Figure 15(3), when a worker W wearing smart glasses G taps the "driving" operation button, the server device 10 can identify whether the "driving lamp" is lit (see dashed circle in Figure 15(3)) based on image data generated by a camera C installed in the smart glasses G, and determine that the worker W has performed the appropriate operation.

[0162] (4-1-4. Effects of the Work Management System 100M-1) As described above, in the work management system 100M-1 according to the first modified embodiment, there is no need to install a camera C and a line-of-sight sensor S in the control device 30 in the work management system 100 according to the embodiment, and there is also no need to always carry a worker terminal 20 such as a tablet terminal. Therefore, in the work management system 100M-1, it is possible to more effectively connect information between devices than in the work management system 100, without making any changes to existing equipment and without making any physical modifications to the devices in order to connect the devices to a network.

[0163] (4-2. Modification 2 of the embodiment) The configuration and processing of a work management system 100M-2 according to Modification 2 of the embodiment will be described with reference to Fig. 16. Fig. 16 is a diagram showing an example of the configuration and processing of a work management system 100M-2 according to Modification 2 of the embodiment. Note that a description of the configuration and processing common to the embodiment will be omitted.

[0164] (4-2-1. Example of the configuration of the work management system 100M-2) The work management system 100M-2 includes a server device 10, a worker terminal 20, and a control device 30. The server device 10 and the worker terminal 20 are connected to each other via a predetermined communication network (not shown) so as to be able to communicate with each other via wired or wireless communication.

[0165] The worker terminal 20 is a terminal carried by a worker W at a work site in a production factory. The worker terminal 20 is realized by a smartphone or the like, and has a monitor M that displays work instructions. The worker terminal 20 is equipped with a camera C that can capture an image of the operation screen of the operation panel P. The work management system 100M-2 may also have a gaze sensor S installed in the vicinity of the control device 30 that can detect the line of sight of the worker W operating the control device 30.

[0166] 16, when worker W operates operation panel P, worker W stores worker terminal 20 in worker W's breast pocket or the like so that the camera lens of camera C protrudes so that the operation screen of operation panel P can be photographed. On the other hand, when worker W views the work instruction screen, worker W takes worker terminal 20 out of worker W's breast pocket or the like and uses it. In this case, worker W may receive work instructions by voice guidance output by worker terminal 20 without taking worker terminal 20 out of worker W's breast pocket or the like.

[0167] The server device 10 is the same as the work management system 100 according to the embodiment, and therefore a description thereof will be omitted. The control device 30 is the same as the work management system 100 according to the embodiment, except that a camera C is not installed in the vicinity, and therefore a description thereof will be omitted. The control device 30 may also have a line-of-sight sensor S installed in the vicinity.

[0168] (4-2-2. Processing example of the work management system 100M-2) The work management system 100M-2 executes the following processes. First, the worker W operates the control device 30 (step S21). Second, the server device 10 acquires operation data via the worker terminal 20 (step S22). Third, the server device 10 analyzes the operation data (step S23). Fourth, the server device 10 notifies the worker W of the work instruction via the worker terminal 20 (step S24). Fifth, the server device 10 generates a work report (step S25).

[0169] (4-2-3. Effects of the Work Management System 100M-2) As described above, in the work management system 100M-2 according to the second modification of the embodiment, there is no need to install a camera C or the like near the control device 30 in the work management system 100 according to the embodiment, and it is only necessary for the worker to have the worker terminal 20 equipped with the camera C. Therefore, in the work management system 100M-2, it is possible to more effectively connect information between devices without making any changes to existing equipment than in the work management system 100, without requiring more terminals than in the work management system 100M-1, and without making any physical modifications to the devices in order to connect the devices to a network.

[0170] (4-3. Modification 3 of the embodiment) The configuration and processing of a work management system 100M-3 according to Modification 3 of the embodiment will be described with reference to Fig. 17. Fig. 17 is a diagram showing an example of the configuration and processing of a work management system 100M-3 according to Modification 3 of the embodiment. Note that a description of the configuration and processing common to the embodiment will be omitted.

[0171] (4-3-1. Example of the configuration of the work management system 100M-3) The work management system 100M-3 includes a server device 10, a worker terminal 20M, a control device 30, and a host server device 40. The server device 10, the worker terminal 20M, and the host server device 40 are connected to each other via a predetermined communication network (not shown) so as to be able to communicate with each other via wired or wireless means.

[0172] The worker terminal 20M is a terminal carried by a worker W at a work site in a production factory. The worker terminal 20M is realized by a smartphone or the like and has a monitor M that displays work instructions. The worker terminal 20M acquires device identification information that identifies the control device 30. At this time, the worker terminal 20M acquires identification information of the control device 30, such as a barcode, displayed on the operation panel P of the control device 30 by operation by the worker W. The worker terminal 20M can also acquire position data of the worker W via a position sensor built into the worker terminal 20M and identify the control device 30 from the acquired position data. The worker terminal 20M can also acquire device identification information directly input by the worker W. In other words, when operating the control device 30, the worker terminal 20M can confirm before operation whether the control device 30 is correct as the device to be operated.

[0173] Furthermore, the worker terminal 20M uses the acquired device identification information to generate a model that enables the translation of data related to the identified control device. For example, the worker terminal 20M uses the acquired device identification information to generate an information model that enables the translation of parameters set in the identified control device 30, and performs data communication via the generated information model. Here, the information model is a model for translating multiple control devices 30 that receive different expressions or instructions so that the instructions or expressions appear to the upper server device 40 as similar. For example, even if control devices 30 with similar functions use different units of numerical value due to differences in vendors, the information model has a function for normalizing the units so that the units appear to the upper server device 40 as the same. Therefore, by using the information model, connection setting and the like can be easily performed when multiple control devices 30 are linked together, as described later in Modification 4 of the embodiment, or when multiple linkage server devices 50 are connected to a higher level. Note that the process of acquiring device identification information, the process of generating the information model, and the process of data communication via the information model may be performed by the server device 10.

[0174] The upper server device 40 is a management device that manages the server device 10. The upper server device 40 can notify the worker W of work instructions via the information model generated by the worker terminal 20M. In other words, the upper server device 40 can not only create work instructions created from the SOP, but also work instructions specialized for a specific control device 30, work instructions for dealing with an emergency, and the like, and notify the worker W of these.

[0175] The server device 10 is common to the work management system 100 according to the embodiment, except for the processes that are or are not executed in the work management system 100M-3, and therefore a description thereof will be omitted. The control device 30 is common to the work management system 100 according to the embodiment or the work management system 100M-2 according to the second modified example of the embodiment, and therefore a description thereof will be omitted.

[0176] (4-3-2. Processing example of the work management system 100M-3) The work management system 100M-3 executes the following processes. First, the worker terminal 20M identifies the control device 30, which is the target device, using the device identification information (step S31). Second, the worker terminal 20M generates an information model that translates various data of the identified control device 30 (step S32). Here, the information model converts various data, such as various parameters, measurement data displayed on the control device 30, and the unit system used to operate the control device 30. Specifically, the information model can also convert data other than the unit system, such as expressing higher-level data as "High" or "Low" and lower-level data as "1" or "0." Third, the worker W operates the operation panel P of the control device 30 (step S33). Fourth, the worker terminal 20M acquires operation data (step S34). Fifth, the worker terminal 20M analyzes the operation data (step S35). Sixth, the worker terminal 20M transmits the analysis results to the server device 10 and the upper server device 40 via the information model (step S36). Seventh, the upper server device 40 transmits instruction data to the server device 10 (step S37). Eighth, the server device 10 notifies the worker W of the work instruction via the information model of the worker terminal 20 (step S38). Ninth, the server device 10 generates a work report (step S39).

[0177] (4-3-3. Effects of the Work Management System 100M-3) As described above, the work management system 100M-3 according to the third modification of the embodiment can output analysis results based on an information model that enables translation of various data of the identified control device 30. Furthermore, the work management system 100M-3 can notify the worker W of not only work instructions created from the SOP, but also work instructions created by the upper server device 40. Therefore, the work management system 100M-3 allows for more flexible creation of work instructions in emergencies, etc. than the work management system 100, and can more effectively connect information between devices without making physical modifications to the devices in order to connect them to a network.

[0178] (4-4. Fourth Modification of the Embodiment) The configuration and processing of a work management system 100M-4 according to Modification 4 of the embodiment will be described with reference to Fig. 18. Fig. 18 is a diagram showing an example of the configuration and processing of a work management system 100M-4 according to Modification 4 of the embodiment. Note that a description of the configuration and processing common to the embodiment will be omitted.

[0179] (4-4-1. Example of the configuration of the work management system 100M-4) The work management system 100M-4 includes a server device 10M, a worker terminal 20M, a control device 30, a host server device 40, and a linking server device 50. Here, the server device 10M, the worker terminal 20M, the host server device 40, and the linking server device 50 are connected to each other via a predetermined communication network (not shown) so as to be able to communicate with each other via wired or wireless means.

[0180] The work management system 100M-4 makes it possible to collectively manage multiple control devices 30 (30A, 30B, . . . , 30X). Furthermore, the work management system 100M-4 can utilize, in addition to the host server device 40 constituting the work management system 100M-3 described above, a linkage server device 50 that provides various applications. Specifically, the work management system 100M-4 can utilize, as the linkage server device 50, an engineering application server device 50A that changes the relationships between the control devices 30 and changes the system screen of the host server device 40, an equipment maintenance application server device 50B that can grasp the deterioration and replacement timing of the control devices 30 from image data of the control devices 30, and a control application server device 50C that enables alarm monitoring, etc. Furthermore, in the work management system 100M-4, the server device 10M can generate or convert an information model of each control device 30 based on the collected device identification information.

[0181] (4-4-2. Effects of the Work Management System 100M-4) As described above, the work management system 100M-4 according to the fourth variation of the embodiment can manage the work performed by multiple workers W (W-1, W-2, ..., Wn) and the collaboration among the multiple workers W. That is, the work management system 100M-4 can notify the work instructions from the host server device 40 and the collaboration server device 50, allowing the multiple workers W to collaborate with each other by each performing the work according to the work instructions. For example, the work management system 100M-4 allows the multiple worker terminals 20M (20M-1, 20M-2, ..., 20M-n) to directly exchange data with each other, enabling collaboration to adjust the priority and timing of operations. Therefore, the work management system 100M-4 can manage even more control devices 30 than the work management system 100, and can more effectively connect information between devices without physically modifying the devices to connect them to a network.

[0182] (4-5. Application Examples of the Embodiments) Application examples of the embodiment will be described. Application examples 1 to 7 of the embodiment will be described below. Application examples 1 to 7 of the embodiment can be applied not only to the embodiment but also to the above-mentioned modified examples 1 to 4 of the embodiment.

[0183] (4-5-1. Application example 1) As a first application example of the embodiment, the work instruction screen of the worker terminal 20 or the like can display not only work instructions but also information on excellent data (golden batches, etc.) from past production runs and trends superimposed thereon.

[0184] (4-5-2. Application example 2) As an application example 2 of the embodiment, when the worker terminal 20 or the like acquires the position data of the worker W, it is possible to record the movement of the worker W between different control devices 30, and by utilizing this data, it is possible to schedule the movement routes to be optimized when multiple workers W are working together.

[0185] (4-5-3. Application example 3) As a third application example of the embodiment, when the worker terminal 20 or the like acquires the position data of the worker W, it is possible to suggest a movement line of the worker W in order to prioritize health rather than time as the purpose of optimization. For example, it is possible to suggest a movement line that allows a person who has been told that they are not getting enough exercise for health reasons to get an appropriate amount of physical activity.

[0186] (4-5-4. Application example 4) As a fourth application example of the embodiment, the worker W can be a robot other than a human.

[0187] (4-5-5. Application example 5) As an application example 5 of the embodiment, the worker W and the worker terminal 20 are linked by access rights, etc., and when an operation panel P is photographed, if the photographed operation panel P is not in the hands of the worker W who owns the worker terminal 20, a warning message can be output on the worker terminal 20.

[0188] (4-5-6. Application Example 6) As an application example 6 of the embodiment, when multiple workers W work simultaneously in parallel on one production line and there is a sequence of tasks, it is possible to display the timing of each task on the worker terminal 20.

[0189] (4-5-7. Application example 7) As an application example 7 of the embodiment, a camera C can be installed on an automatically moving robot or the like to automatically photograph the operation screen of the operation panel P of each control device 30, and a nearby worker W can be called only when action is required.

[0190] 5. Effects of the embodiment Effects of the embodiment will be described. Effects 1 to 14 corresponding to the processing according to the embodiment will be described below.

[0191] (5-1. Effect 1) First, in the process according to the embodiment described above, server device 10 acquires operation data specifying the operation performed by worker W on control device 30 in accordance with a work instruction for a predetermined work process related to the operation device operated by the worker, analyzes the operation data, determines the content of the notification to be given to worker W, and notifies worker W of the determined notification content. Therefore, in this process, the notification content can be notified to worker W in accordance with the operation performed on control device 30 that is not connected to the network, so that information between devices can be more effectively connected without making any physical modifications to the devices in order to connect them to the network.

[0192] (5-2. Effect 2) Secondly, in the process according to the embodiment described above, server device 10 acquires, as operation data, image data specifying the state of the operation screen of control device 30, and uses the acquired image data to determine whether the operation performed by worker W on control device 30 is appropriate. Therefore, in this process, it is possible to determine the appropriateness of the work performed by worker W using the image data without modifying control device 30 that is not connected to the network, and therefore it is possible to more effectively connect information between devices without making physical modifications to the devices in order to connect them to the network.

[0193] (5-3. Effect 3) Thirdly, in the processing according to the above-described embodiment, server device 10 further acquires, as operation data, gaze data that identifies the line of sight of worker W toward the operation screen of control device 30, and uses the acquired image data and gaze data to determine whether the operation performed by worker W on control device 30 is appropriate. Therefore, in this processing, it is possible to determine the appropriateness of the work performed by worker W using image data and gaze data without modifying control device 30 that is not connected to a network, and therefore it is possible to more effectively connect information between devices without making physical modifications to the devices in order to connect them to a network.

[0194] (5-4. Effect 4) Fourth, in the process according to the embodiment described above, the server device 10 acquires, as operation data, image data that specifies the state of the operation screen of the control device 30, and uses the acquired image data to record the characters on the operation screen viewed by the worker W. Therefore, in this process, it is possible to digitize the data of the work performed by the worker W using the image data without modifying the control device 30 that is not connected to the network, and it is therefore possible to more effectively connect information between devices without making any physical modifications to the devices in order to connect them to the network.

[0195] (5-5. Effect 5) Fifth, in the process according to the embodiment described above, server device 10 further acquires, as operation data, gaze data that identifies the line of sight of worker W on the operation screen of control device 30, and uses the acquired image data and gaze data to record the characters on the operation screen that worker W viewed. Therefore, in this process, it is possible to digitize the data of the work performed by worker W using image data and gaze data without modifying control device 30 that is not connected to a network, and it is therefore possible to more effectively connect information between devices without making physical modifications to the devices in order to connect them to a network.

[0196] (5-6. Effect 6) Sixth, in the process according to the embodiment described above, the server device 10 notifies the worker W of the operations for performing each work process created from the SOP as work instructions. Therefore, in this process, it is possible to notify the worker W of work instructions to be performed by the worker W based on the SOP in a production facility or the like where the work content, such as batches, changes frequently, for example. Therefore, by more effectively connecting information between devices without making physical modifications to the devices in order to connect them to a network, it is possible to notify the worker of accurate work content and prevent operational errors.

[0197] (5-7. Effect 7) Seventh, in the process according to the embodiment described above, the server device 10 determines the notification content as work instructions for the next work step of a predetermined work step, an error message for the operation performed by the worker W, or a change in the work instructions for the predetermined work step. Therefore, in this process, it is possible to notify the work instructions to be performed by the worker W in each work step, and by more effectively connecting information between devices without making physical modifications to the devices in order to connect them to a network, it is possible to instruct the worker W at the work site to perform the correct operation.

[0198] (5-8. Effect 8) Eighth, in the process according to the embodiment described above, when all work processes performed by worker W are completed, server device 10 generates a work report that records the work details of worker W related to control device 30. Therefore, in this process, it is possible to automatically create a work report every time a series of work is completed, and by more effectively connecting information between devices without making physical modifications to the devices in order to connect them to a network, content that was previously recorded by hand, such as memos and work reports, can be automatically recorded in server device 10 without bothering worker W, and mistakes due to clerical errors, etc. can also be prevented.

[0199] (5-9. Effect 9) Ninth, in the process according to the embodiment described above, the server device 10 notifies the worker W of a work instruction via the worker terminal 20 carried by the worker W, and acquires image data captured by a camera C installed in a position capable of capturing an image of the operation screen of the control device 30, and gaze data detected by a gaze sensor S installed in a position capable of detecting the gaze of the worker W operating the control device 30. Therefore, in this process, the operation performed by the worker W can be analyzed based on the operation data acquired from the camera C and gaze sensor S installed in the control device 30, and therefore, information between devices can be more effectively connected without making any physical modifications to the devices in order to connect them to a network.

[0200] (5-10. Effect 10) Tenth, in the process according to the first modification of the above-described embodiment, the server device 10 notifies the worker W of a work instruction via the smart glasses G worn by the worker W, and acquires image data captured by the smart glasses G and gaze data detected by the smart glasses G. Therefore, in this process, the operation performed by the worker W can be analyzed based on the operation data acquired from the smart glasses G, and information between devices can be more effectively connected without making any physical modifications to the devices in order to connect them to a network.

[0201] (5-11. Effect 11) Eleventh, in the process according to the second modification of the above-described embodiment, the server device 10 notifies the worker W of a work instruction via the worker terminal 20 held by the worker W, and acquires image data captured by the worker terminal 20. Therefore, in this process, the operation performed by the worker W can be analyzed based on the operation data acquired from the worker terminal 20 held by the worker W, and information between devices can be more effectively connected without making any physical modifications to the devices in order to connect them to a network.

[0202] (5-12. Effect 12) Twelfth, in the process according to the third modification of the above-described embodiment, server device 10 acquires device identification information that identifies control device 30, and generates a model that enables the translation of data related to control device 30 identified using the device identification information. Therefore, in this process, by using an information model, information can be exchanged between multiple devices or servers that use different expressions without being aware of the other party, and information between devices can be connected more effectively without making any physical modifications to the devices in order to connect them to a network.

[0203] (5-13. Effect 13) Thirteenth, in the process according to the fourth modification of the above-described embodiment, the server device 10 notifies the worker W of a work instruction sent by the upper server device 40 that manages the multiple control devices 30. Therefore, in this process, it becomes possible to analyze the cooperation between the multiple workers W, and it is possible to more effectively connect information between the devices without making any physical modifications to the devices in order to connect them to the network.

[0204] (5-14. Effect 14) Fourteenth, in the process according to Application Example 1 of the above-described embodiment, server device 10 notifies operator W of the history of the operation selected as the best operation from among the past operations performed on control device 30. This process therefore makes it possible to refer to information such as golden batches and change the state to a more appropriate state at the operator W's discretion, thereby enabling information between devices to be linked more effectively without making any physical modifications to the devices in order to connect them to a network.

[0205] 〔system〕 The information including the processing procedures, control procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified.

[0206] Furthermore, the components of each device shown in the figure are functional concepts and do not necessarily have to be physically configured as shown. In other words, the specific form of distribution and integration of each device is not limited to that shown. In other words, all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0207] Furthermore, all or any part of the processing functions performed by each device may be realized by a CPU and a program analyzed and executed by the CPU, or may be realized as hardware using wired logic.

[0208] [Hardware] Next, an example of the hardware configuration of the server device 10, which is an information providing device, will be described. Note that other devices may also have a similar hardware configuration. FIG. 19 is a diagram illustrating an example of the hardware configuration according to an embodiment. As shown in FIG. 19, the server device 10 includes a communication device 10a, an HDD (Hard Disk Drive) 10b, a memory 10c, and a processor 10d. The components shown in FIG. 19 are connected to each other via a bus or the like.

[0209] The communication device 10a is a network interface card or the like, and communicates with other servers. The HDD 10b stores programs and databases that operate the functions shown in FIG.

[0210] The processor 10d reads out from the HDD 10b or the like a program that executes the same processes as the respective processing units shown in Fig. 2 and loads it into the memory 10c, thereby operating a process that executes each function described in Fig. 2 or the like. For example, this process executes the same functions as the respective processing units of the server device 10. Specifically, the processor 10d reads out from the HDD 10b or the like a program that has the same functions as the notification unit 15a, the acquisition unit 15b, the analysis unit 15c, the generation unit 15d, and the like. Then, the processor 10d executes a process that executes the same processes as the notification unit 15a, the acquisition unit 15b, the analysis unit 15c, the generation unit 15d, and the like.

[0211] In this way, the server device 10 operates as a device that executes various processing methods by reading and executing a program. The server device 10 can also realize functions similar to those of the above-described embodiment by reading the program from a recording medium using a media reader and executing the read program. Note that the program in these other embodiments is not limited to being executed by the server device 10. For example, the present invention can also be applied in the same way to cases where another computer or server executes the program, or where these execute the program in cooperation with each other.

[0212] This program can be distributed via a network such as the Internet. This program can also be recorded on a computer-readable recording medium such as a hard disk, a flexible disk (FD), a CD-ROM, a magneto-optical disk (MO), a solid-state drive (SSD), or a digital versatile disc (DVD), and can be executed by being read from the recording medium by a computer. This program can also be downloaded to a storage area of ​​the worker terminal 20.

[0213] 〔others〕 Some examples of combinations of the disclosed technical features are set out below.

[0214] (1) An information providing device including: an acquisition unit that acquires operation data that identifies operations performed by a worker on an operating device in accordance with work instructions for a predetermined work process related to the operating device operated by the worker; an analysis unit that analyzes the operation data and determines the content of a notification to the worker; and a notification unit that notifies the worker of the determined content of the notification.

[0215] (2) The information providing device described in (1), wherein the acquisition unit acquires image data that identifies the state of the operation screen of the operation device as the operation data, and the analysis unit uses the image data to determine whether the operation performed by the worker on the operation device is appropriate.

[0216] (3) The information providing device described in (2), wherein the acquisition unit further acquires gaze data that identifies the worker's gaze toward the operation screen as the operation data, and the analysis unit uses the image data and the gaze data to determine whether the operation performed by the worker on the operation device is appropriate.

[0217] (4) An information providing device described in any one of (1) to (3), wherein the acquisition unit acquires image data that identifies the state of the operation screen of the operation device as the operation data, and the analysis unit uses the image data to record the characters on the operation screen that the worker visually recognizes.

[0218] (5) The information providing device described in (4), wherein the acquisition unit acquires gaze data that identifies the worker's gaze toward the operation screen as the operation data, and the analysis unit uses the image data and the gaze data to record the characters on the operation screen that the worker views.

[0219] (6) The information providing device according to any one of (1) to (5), wherein the notification unit notifies the worker of the operation for carrying out each work process created from a standard operating procedure as the work instruction.

[0220] (7) An information providing device described in any one of (1) to (6), wherein the analysis unit determines, as the notification content, work instructions for the next work process after the specified work process, an error message for the operation performed by the worker, or a change to the work instructions for the specified work process.

[0221] (8) An information providing device described in any one of (1) to (7), wherein when all work processes performed by the worker are completed, a generation unit generates a work report that records the work content of the worker regarding the operating equipment.

[0222] (9) An information providing device as described in (3) or (5), wherein the notification unit notifies the work instructions via a worker terminal carried by the worker, and the acquisition unit acquires the image data captured by a photographing device installed in a position capable of photographing the operation screen of the operating device, and the gaze data detected by a sensor device installed in a position capable of detecting the gaze of the worker operating the operating device.

[0223] (10) An information providing device described in (3) or (5), wherein the notification unit notifies the work instructions via a wearable terminal worn by the worker, and the acquisition unit acquires the image data captured by the wearable terminal and the gaze data detected by the wearable terminal.

[0224] (11) An information providing device described in (2) or (4), wherein the notification unit notifies the work instruction via a worker terminal carried by the worker, and the acquisition unit acquires the image data captured by the worker terminal.

[0225] (12) An information providing device according to any one of (1) to (11), wherein the acquisition unit acquires device identification information that identifies the operating device, and the analysis unit generates a model that enables translation of data related to the operating device identified using the device identification information.

[0226] (13) The information providing device according to any one of (1) to (11), wherein the notification unit notifies the worker of the work instruction transmitted by a management device that manages a plurality of operation devices.

[0227] (14) The information providing device described in any one of (1) to (12), wherein the notification unit notifies the worker of the history of an operation selected as the best operation from among past operations performed on the operating device.

[0228] (15) An information provision method in which a computer acquires operation data that identifies an operation performed by a worker on an operating device in accordance with a work instruction for a predetermined work process related to the operating device operated by the worker, analyzes the operation data, determines the content of a notification to the worker, and notifies the worker of the determined notification content.

[0229] (16) An information provision program that causes a computer to execute the following processes: acquire operation data that identifies the operation performed by a worker on an operating device in accordance with a work instruction for a predetermined work process related to the operating device operated by the worker; analyze the operation data; determine the content of a notification to the worker; and notify the worker of the determined notification content. [Explanation of symbols]

[0230] 10 Server device 10a Communication equipment 10b HDD 10c memory 10d processor 11 Input section 12 Output section 13 Communications Department 14 Storage section 14a Instruction data storage unit 14b Operation data storage unit 14c Analysis result storage unit 14d Work report storage section 15 Control Unit 15a Notification section 15b Acquisition part 15c Analysis Department 15d Generator 20 Worker terminal 21 Control section 22 Communications Department 30 Control Equipment 31 Control Unit 40 Upper server device 50 Collaboration server device 50A Engineering application server device 50B Equipment maintenance application server device 50C Control application server device 100 Work Management System

Claims

1. an acquisition unit that acquires operation data that identifies an operation performed by a worker on an operation device in accordance with a work instruction for a predetermined work process related to the operation device operated by the worker; an analysis unit that analyzes the operation data and determines the content of a notification to be sent to the worker; a notification unit that notifies the worker of the determined notification content; An information providing device comprising:

2. The acquisition unit As the operation data, image data specifying a state of an operation screen of the operation device is acquired; The analysis unit Using the image data, determine whether the operation performed by the worker on the operation device is appropriate. The information providing device according to claim 1 .

3. The acquisition unit gaze data that identifies the line of sight of the worker on the operation screen is further acquired as the operation data; The analysis unit using the image data and the line of sight data to determine whether the operation performed by the worker on the operation device is appropriate; The information providing device according to claim 2 .

4. The acquisition unit As the operation data, image data specifying a state of an operation screen of the operation device is acquired; The analysis unit Using the image data, the characters on the operation screen visually recognized by the worker are recorded. The information providing device according to claim 1 .

5. The acquisition unit gaze data that identifies the line of sight of the worker on the operation screen is further acquired as the operation data; The analysis unit Using the image data and the line-of-sight data, characters on the operation screen that are visually recognized by the worker are recorded.

5. The information providing device according to claim 4.

6. The notification unit notifying the worker of the operations for carrying out each work process created from the standard operating procedure as the work instructions; The information providing device according to any one of claims 1 to 5.

7. The analysis unit determining, as the content of the notification, a work instruction for a work process next to the predetermined work process, an error message for an operation performed by the worker, or a change in the work instruction for the predetermined work process; The information providing device according to any one of claims 1 to 5.

8. a generation unit that generates a work report recording the work details of the worker related to the operation device when all work processes performed by the worker are completed; The information providing device according to claim 1 , further comprising:

9. The notification unit notifying the worker of the work instruction via a worker terminal carried by the worker; The acquisition unit acquiring the image data captured by a photographing device installed at a position capable of photographing an operation screen of the operation device, and the line-of-sight data detected by a sensor device installed at a position capable of detecting the line of sight of an operator operating the operation device; 6. The information providing device according to claim 3 or 5.

10. The notification unit notifying the worker of the work instruction via a wearable device worn by the worker; The acquisition unit acquiring the image data captured by the wearable device and the gaze data detected by the wearable device; 6. The information providing device according to claim 3 or 5.

11. The notification unit notifying the worker of the work instruction via a worker terminal carried by the worker; The acquisition unit The image data captured by the worker terminal is acquired.

5. The information providing device according to claim 2 or 4.

12. The acquisition unit acquiring device identification information that identifies the operating device; The analysis unit generating a model that enables translation of data related to the operation device identified using the device identification information; The information providing device according to any one of claims 1 to 5.

13. The notification unit notifying the worker of the work instruction transmitted by a management device that manages a plurality of operation devices; The information providing device according to any one of claims 1 to 5.

14. The notification unit notifying the operator of a history of an operation selected as the best operation from among past operations performed on the operation device; The information providing device according to any one of claims 1 to 5.

15. The computer acquiring operation data identifying an operation performed by a worker on an operation device in accordance with a work instruction for a predetermined work process related to the operation device operated by the worker; Analyzing the operation data and determining the content of a notification to be sent to the worker; notifying the worker of the determined notification content; How information is provided to perform the process.

16. On the computer, acquiring operation data identifying an operation performed by a worker on an operation device in accordance with a work instruction for a predetermined work process related to the operation device operated by the worker; Analyzing the operation data and determining the content of a notification to be sent to the worker; notifying the worker of the determined notification content; An information providing program that executes processing.

Images