Information processing device, information processing method, program, and information processing system
The information processing device enhances work quality by judging worker gaze and screen focus to ensure reading and concentration on instructions, addressing the inadequacies of existing methods in improving work performance.
Patent Information
- Application Number
- JP2024009903
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-01-26
- Publication Date
- 2025-08-07
AI Technical Summary
Existing methods of determining whether a worker has read work instructions do not sufficiently improve the quality of work performance, as workers often memorize procedures and skip reading instructions, leading to potential errors and reduced product quality.
An information processing device that includes a first judgment unit to determine if a worker is gazing upon a predetermined range of information on a screen and a second judgment unit to assess if the worker is looking within the screen, with controls for outputting warnings and managing task transitions based on these determinations.
Improves the quality of work by ensuring workers read and focus on instructions, reducing errors and enhancing productivity through targeted feedback and task progression.
Smart Images

Figure 2025115447000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an information processing device, an information processing method, a program, and an information processing system. [Background technology]
[0002] In recent years, a technique has been known that presents information about a task to a worker in order to reduce work errors. The information about the task can be instructions about the task (hereinafter, simply referred to as "task instructions"). Also, a technique has been known that determines whether a worker has read the task instructions in a predetermined manner.
[0003] For example, Patent Document 1 discloses a technology that determines whether a worker has read a predetermined range of a work instruction manual, and if it is determined that the worker has not read that range, highlights that range. Also, Patent Document 2 discloses a technology that determines whether a worker has read multiple sections that make up the work instruction manual in a predetermined order. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Publication No. 2022-182083 [Patent Document 2] Japanese Patent Application Laid-Open No. 2015-32116 Summary of the Invention [Problem to be solved by the invention]
[0005] However, simply determining whether or not a worker has read the work instructions in a predetermined manner does not sufficiently improve the quality of the work performed by the worker.
[0006] Therefore, it is desirable to provide a technique that can improve the quality of work performed by workers. [Means for solving the problem]
[0007] In order to solve the above problem, according to one aspect of the present invention, an information processing device is provided, comprising: a first judgment unit that judges whether a predetermined range in information relating to a first task displayed on a screen is gazed upon by a worker; and a second judgment unit that judges whether the worker is looking within the screen based on the judgment that the predetermined range is gazed upon by the worker.
[0008] The information processing device may include an output control unit that controls output of a predetermined warning based on the determination that the worker is viewing the screen.
[0009] The information processing device may include a time measurement unit that obtains the measured time as the time that has elapsed since it was determined that the specified range was gazed upon by the worker, and the second determination unit may determine whether the measured time has reached a specified working time, and based on determining that the measured time has not reached the working time, determine whether the worker is looking at the screen.
[0010] The task time may be calculated based on a standard task time for the first task.
[0011] The task time may be calculated based on the worker's level of proficiency in the first task.
[0012] The first task may be a task required for the production of a product, and the task time may be calculated based on the number of units of the product to be produced.
[0013] The second determination unit may determine whether the worker is gazing at an object for attention based on the determination that the measured time has reached the task time.
[0014] The information processing device may also include an output control unit that controls the display of information regarding a second task that follows the first task based on the determination that the worker is looking within the gaze object.
[0015] The information relating to the first task may include one or both of a procedure for the first task and matters to be noted when performing the first task.
[0016] The first determination unit may determine whether the specified range is being gazed at by the worker based on whether the worker's line of sight is present within the specified range, or whether the time that the line of sight is continuously present within the specified range reaches a predetermined first time.
[0017] The second determination unit may determine whether the screen is viewed by the worker based on whether the worker's line of sight or facial direction is present within the screen, or whether the time during which the line of sight or the facial direction is continuously present within the screen reaches a predetermined second time.
[0018] In addition, according to another aspect of the present invention, in order to solve the above problem, an information processing method executed by a computer is provided, which includes determining whether a predetermined range in information regarding a first task displayed on a screen is gazed upon by a worker, and determining whether the worker is viewing the screen based on the determination that the predetermined range is gazed upon by the worker.
[0019] In addition, according to another aspect of the present invention, in order to solve the above problem, a program is provided that causes a computer to function as a first judgment unit that judges whether a predetermined range in information related to a first task displayed on a screen is gazed upon by a worker, and a second judgment unit that judges whether the worker is looking within the screen based on the judgment that the predetermined range is gazed upon by the worker.
[0020] In addition, according to another aspect of the present invention, in order to solve the above problem, there is provided an information processing system having an information processing device including: a first judgment unit that judges whether a predetermined range in information regarding a first task displayed on a screen is gazed upon by a worker; and a second judgment unit that judges whether the worker is looking within the screen based on the judgment that the predetermined range is gazed upon by the worker; and a display device that displays information regarding the first task on the screen. [Effects of the Invention]
[0021] As described above, the present invention provides a technique that can improve the quality of work performed by a worker. [Brief explanation of the drawings]
[0022] [Figure 1] 1 is a diagram illustrating a schematic configuration example of an information processing system according to a first embodiment of the present invention. [Figure 2] 1 is a diagram illustrating an example of a functional configuration of an information processing system 1 according to a first embodiment of the present invention. [Figure 3] FIG. 2 is a diagram illustrating an example of the configuration of a work instruction DB 102. [Figure 4] FIG. 10 is a diagram showing an example of the configuration of a gaze range DB 115. [Figure 5] FIG. 10 is a diagram showing an example of a work explanation page P1. [Figure 6] FIG. 10 is a diagram showing an example of the relationship between a work explanation page P1 and gaze ranges R1 to R4. [Figure 7] FIG. 10 is a diagram illustrating an example of a warning output. [Figure 8] FIG. 10 is a diagram illustrating an example of the configuration of a product production quantity DB 109. [Figure 9] FIG. 2 is a diagram illustrating an example of the configuration of a skill level DB 110. [Figure 10] FIG. 10 is a diagram illustrating an example of the configuration of a standard work time DB 113. [Figure 11] FIG. 10 is a diagram illustrating an example of the configuration of a work time DB 114. [Figure 12]4 is a flowchart showing the first half of an example of operation of the information processing system 1 according to the first embodiment of the present invention. [Figure 13] 10 is a flowchart showing the second half of the exemplary operation of the information processing system 1 according to the first embodiment of the present invention. [Figure 14] FIG. 10 is a diagram illustrating a schematic configuration example of an information processing system according to a second embodiment of the present invention. [Figure 15] FIG. 10 is a diagram illustrating an example of a functional configuration of an information processing system 1 according to a second embodiment of the present invention. [Figure 16] FIG. 10 is a diagram illustrating an example of calculating a face direction range. [Figure 17] FIG. 10 is a diagram illustrating an example of the configuration of a face direction DB 203. [Figure 18] 10 is a flowchart showing the first half of an example of operation of the information processing system 2 according to the second embodiment of the present invention. [Figure 19] 10 is a flowchart showing the second half of the exemplary operation of the information processing system 2 according to the second embodiment of the present invention. [Figure 20] 1 is a diagram showing a hardware configuration of an information processing device 900 as an example of the information processing device 100 according to the first embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION
[0023] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant explanations will be omitted.
[0024] In addition, in this specification and drawings, multiple components having substantially the same functional configuration may be distinguished by adding different numbers after the same reference numeral. However, when there is no particular need to distinguish between multiple components having substantially the same functional configuration, only the same reference numeral will be used.
[0025] (0. Overview) First, an outline of an embodiment of the present invention will be described. In recent years, a technique for presenting a work instruction manual to a worker in order to reduce work errors has become known.
[0026] In the following explanation, it is mainly assumed that the work performed by the worker is assembly work using parts that make up the product. However, the type of work performed by the worker does not need to be limited. Furthermore, the work instructions may include one or both of the work procedure and points to note when performing the work (hereinafter, points to note when performing the work will also be simply referred to as "points to note").
[0027] In the following explanation, it is mainly assumed that a worker performs work corresponding to each of a plurality of work processes. In such a case, the work instruction manual is also divided into pages corresponding to each of the plurality of work processes (hereinafter also referred to as "work explanation pages"). In this case, the worker repeats the process of checking the work procedures and points of note while reading the work explanation page corresponding to the work process, and then performing the work corresponding to the work process after checking the work procedures and points of note. However, there may be only one work process.
[0028] Here, workers often memorize most of the work procedures while performing the same work for a long time, and so they often perform the work without reading the work explanation page. However, there are cases where workers do not remember the work procedures accurately. Furthermore, there are also cases where workers do not remember the important points. In such cases, there is a possibility that workers will make mistakes in their work, and the quality of the work will not improve. And if the quality of the work does not improve, there is a possibility that the quality of the product will decline.
[0029] Therefore, there is known a technique for determining whether a worker has read a work instruction page in a predetermined manner. However, once a worker has become familiar with the work procedure to a certain extent, the worker may decide to perform the work and then read the work instruction page, and may end up performing the work before reading the work instruction page. In such a case, simply determining whether the worker has read the work instruction page in a predetermined manner does not sufficiently improve the quality of the worker's work.
[0030] Therefore, this specification mainly proposes a technology that can improve the quality of work performed by workers. Specifically, this specification first determines whether or not the worker has read the work explanation page displayed on the screen, and then determines whether or not the worker is concentrating on the work without looking at the screen based on the determination that the worker has read the work explanation page. This is expected to improve the quality of work performed by workers.
[0031] The outline of the embodiment of the present invention has been described above.
[0032] (1. First embodiment) Next, a first embodiment of the present invention will be described.
[0033] (1-1. Information Processing System Configuration) An example of the configuration of an information processing system according to a first embodiment of the present invention will be described with reference to FIGS.
[0034] (Schematic configuration of information processing system 1) Fig. 1 is a diagram showing a schematic configuration example of an information processing system according to a first embodiment of the present invention. As shown in Fig. 1, the information processing system 1 according to the first embodiment of the present invention includes an information processing device 100, an input unit 105, a screen display unit 106, a gaze detection unit 107, and a server 108.
[0035] The information processing device 100 and the server 108 are each connected to a network, and are configured to be able to communicate with each other via the network. The information processing device 100 and the network may be connected by wire or wirelessly. Similarly, the server 108 and the network may be connected by wire or wirelessly.
[0036] 1 shows a worker U1 performing assembly work. For example, parts are stored on a shelf 121, and the worker U1 takes out parts stored on the shelf 121 and performs assembly work using the taken-out parts. Note that the specific configuration of the shelf 121 that stores the parts is not particularly limited.
[0037] (Information processing device 100) The information processing device 100 is realized by a computer and controls the screen display unit 106 to display a work instruction manual to be read by the worker U1. For example, based on an operation to select a product input from the worker U1 to the input unit 105, the information processing device 100 controls the screen display unit 106 to display a work instruction manual corresponding to the selected product on the screen.
[0038] Furthermore, based on the operation of selecting worker U1 being input to the input unit 105 by worker U1, the information processing device 100 acquires from the server 108 the work time corresponding to the selected worker U1, the product, and the current work process, and performs various controls according to the acquired work time. Furthermore, based on the line of sight of worker U1 being detected by the line of sight detection unit 107, the information processing device 100 performs various controls according to the line of sight of worker U1. The various controls performed by the information processing device 100 will be described in detail later.
[0039] 1, the information processing device 100, the input unit 105, and the screen display unit 106 may be configured as an integrated unit. In this case, the information processing device 100, the input unit 105, and the screen display unit 106 may be a tablet terminal, a smartphone, or a laptop PC (Personal Computer).
[0040] Alternatively, the information processing device 100, the input unit 105, and the screen display unit 106 may be configured as separate entities. In this case, the information processing device 100 may be a desktop PC. Furthermore, the input unit 105 may be an input device that exists outside the information processing device 100, and the screen display unit 106 may be a display that exists outside the information processing device 100.
[0041] (input unit 105) The input unit 105 is realized by an input device and receives operation input from the worker U1. In this specification, it is mainly assumed that the input unit 105 is configured by a touch panel. However, the input unit 105 may also be configured by a keyboard and a mouse. Alternatively, the input unit 105 may also be configured by an input device other than a keyboard and a mouse (for example, a microphone, etc.).
[0042] (Screen display section 106) The screen display unit 106 is realized by a display and has a screen for displaying various types of information. The screen display unit 106 displays various types of information on the screen in accordance with the control of the information processing device 100. For example, the screen display unit 106 displays an operation manual on the screen in accordance with the control of the information processing device 100. The display can also be referred to as a display device.
[0043] (Gaze detection unit 107) The gaze detection unit 107 detects the gaze of the worker U1. In the example shown in Fig. 1, the gaze detection unit 107 is located at the top of the information processing device 100. However, the position of the gaze detection unit 107 is not limited to the top of the information processing device 100. In the first embodiment of the present invention, it is mainly assumed that the gaze detection unit 107 is configured to include an infrared LED (Light-Emitting Diode) and an infrared sensor.
[0044] In such a case, the gaze detection unit 107 may detect the center position of the pupil and the position of the Purkinje image based on the detection result by the infrared sensor of infrared light emitted by the infrared LED and reflected by the eye of the operator U1.The gaze detection unit 107 may then detect the gaze of the operator U1 based on the relative positional relationship between the center position of the pupil and the position of the Purkinje image.The gaze detected by the gaze detection unit 107 may be a three-dimensional gaze direction.The gaze direction may include the position of the eye and the direction of the gaze.
[0045] (Server 108) The server 108 is realized by a computer, and provides the information processing device 100 with information required for processing by the information processing device 100. For example, the server 108 calculates the work time of the worker U1 for the product based on the worker U1 and the product selected by the worker U1. The server 108 then provides the calculated work time to the information processing device 100. The calculation of the work time performed by the server 108 will be described in detail later.
[0046] (Functional configuration of information processing system 1) 2 is a diagram showing an example of the functional configuration of the information processing system 1 according to the first embodiment of the present invention. As shown in Fig. 2, the information processing device 100 includes a gaze position identification unit 101, an operation instruction DB (database) 102, a determination unit 103, a time measurement unit 104, a gaze range DB 115, and an output control unit 116.
[0047] For example, the information processing device 100 may include a control unit (not shown) and a storage unit (not shown), and the gaze position identification unit 101, the determination unit 103, the time measurement unit 104, and the output control unit 116 may be realized by the control unit (not shown). Also, the work instruction DB 102 and the gaze range DB 115 may be stored in the storage unit (not shown).
[0048] The control unit (not shown) of the information processing device 100 includes an arithmetic unit such as a CPU (Central Processing Unit), and its functions can be realized by the arithmetic unit expanding a program stored in a ROM (Read Only Memory) into a RAM and executing it. A computer-readable recording medium on which the program is recorded may also be provided. Alternatively, these blocks may be configured with dedicated hardware or a combination of multiple pieces of hardware.
[0049] The storage unit (not shown) included in the information processing device 100 is a memory capable of storing programs and data for operating a control unit (not shown) included in the information processing device 100. The storage unit (not shown) included in the information processing device 100 can also temporarily store various data required in the course of operation of the control unit (not shown) included in the information processing device 100. For example, the memory may be a non-volatile memory.
[0050] As shown in FIG. 2, the server 108 includes a product production quantity DB 109, a skill level DB 110, a work time calculation unit 112, a standard work time DB 113, and a work time DB 114.
[0051] For example, the server 108 may include a control unit (not shown) and a storage unit (not shown), and the operation time calculation unit 112 may be realized by the control unit (not shown). The product production quantity DB 109, the proficiency level DB 110, the standard operation time DB 113, and the operation time DB 114 may be stored in a storage unit (not shown).
[0052] The control unit (not shown) of server 108 includes an arithmetic unit such as a CPU (Central Processing Unit), and its functions can be realized by the arithmetic unit expanding a program stored in a ROM (Read Only Memory) into a RAM and executing it. In this case, a computer-readable recording medium on which the program is recorded can also be provided. Alternatively, these blocks may be configured with dedicated hardware or a combination of multiple pieces of hardware.
[0053] The storage unit (not shown) included in server 108 is a memory capable of storing programs and data for operating a control unit (not shown) included in server 108. The storage unit (not shown) included in server 108 can also temporarily store various data required in the course of operation of a control unit (not shown) included in server 108. For example, the memory may be a non-volatile memory.
[0054] (Work Instructions DB102) Fig. 3 is a diagram showing an example of the configuration of the work instruction DB 102. As shown in Fig. 3, the work instruction DB 102 stores in advance work instruction data in which product IDs are associated with work instruction pages P1 to PN.
[0055] Here, the product ID is an ID for identifying the product. Furthermore, each of the work explanation pages P1 to PN (N is an integer equal to or greater than 1) is a page for each work process that constitutes the work instruction manual, and is composed of image data. Note that in the example shown in FIG. 3, the format of each of the work explanation pages P1 to PN is jpg format, but the format of each of the work explanation pages P1 to PN does not have to be limited to jpg format.
[0056] (Gaze range DB115) Fig. 4 is a diagram showing an example of the configuration of the gaze range DB 115. As shown in Fig. 4, the gaze range DB 115 stores in advance gaze range data in which a product ID, a work process number, and gaze ranges R1 to R4 are associated with each other.
[0057] Here, the product ID is an ID for identifying a product. The work process number is a number for identifying a work process. Each of the gaze ranges R1 to R4 is a range that the worker U1 should gaze at on the work explanation page corresponding to the work process, and is a predetermined range (predetermined range).
[0058] In this specification, the work explanation page is two-dimensional image data. Therefore, each of the gaze ranges R1 to R4 is expressed by a range of two-dimensional coordinates on the screen. In the following description, the two-dimensional coordinates on the screen are expressed as (x, y).
[0059] 4, the range that the worker U1 should gaze at is divided into four (gaze ranges R1 to R4). However, the number of divided ranges that the worker U1 should gaze at does not need to be limited. Alternatively, the range that the worker U1 should gaze at may not be divided, but may be one.
[0060] 4, each of the gaze ranges R1 to R4 may be defined by a reference coordinate and an increase or decrease in each coordinate relative to the reference coordinate. For example, the gaze range R1 "(70,40)±20" corresponding to product ID "1" and work process number "1" may be a rectangular range with the line segment connecting the coordinates (90,60) and (50,20) as its diagonal, obtained by increasing or decreasing each coordinate of the reference coordinate (70,40) by 20.
[0061] (Gaze position identification unit 101) The gaze position identifying unit 101 identifies the gaze position on the screen based on the gaze of the worker U1 detected by the gaze detection unit 107. For example, if the three-dimensional position of the screen in the real space where the worker U1 exists is measured in advance, the gaze position identifying unit 101 identifies the two-dimensional gaze position on the screen based on the three-dimensional position of the screen in the real space and the three-dimensional gaze direction detected by the gaze detection unit 107.
[0062] (Time measurement unit 104) The time measurement unit 104 has a timing function and measures the time that has elapsed since a predetermined reference time using the timing function. For example, based on the output of a timer start instruction from the determination unit 103, the time measurement unit 104 measures the time that has elapsed since the reference time, taking the time at which the timer start instruction was output as the measurement time.
[0063] (output control unit 116) The output control unit 116 controls the display of various information on the screen of the screen display unit 106. For example, based on an operation to select a product input by the worker U1 to the input unit 105, the output control unit 116 acquires a work explanation page P1 corresponding to the product ID for identifying the selected product and the work process number "1" from the work instruction manual DB 102, and controls the screen display unit 106 to display the acquired work explanation page P1 on the screen.
[0064] The work explanation page P1 may be a work explanation page for the first work among the works corresponding to the product selected by the worker U1. For example, the first work corresponds to the first work example, which corresponds to the work process identified by the work process number "1."
[0065] FIG. 5 is a diagram showing an example of a work instruction page P1. As shown in FIG. 5, the work instruction page P1 includes an explanatory text B10, which is text data showing the correct work procedure. The work instruction page P1 also includes an explanatory diagram B20, which is image data showing the work being done in accordance with the correct work procedure. Here, it is assumed that a wrench is used to tighten a hexagon bolt B21 into a plate B22, and the explanatory diagram B20 shows the plate B22 and the hexagon bolt B21 fixed in the correct position relative to the plate B22.
[0066] 5, the work explanation page P1 may include a work step number "1." Furthermore, as shown in FIG. 5, the work explanation page P1 may include a note B30 indicating that a circle will be displayed when the explanation is finished reading. The circle is an example of an object that the worker U1 should focus on after completing the work corresponding to the work explanation page P1. Therefore, an object having a shape other than a circle may be used instead of a circle. In the following description, the object that the worker U1 should focus on is also referred to as a "focus object."
[0067] Fig. 6 is a diagram showing an example of the relationship between the work explanation page P1 and the gaze ranges R1 to R4. Referring to Fig. 6, the gaze ranges R1 to R4 are set so as to surround the entire explanatory text B10 included in the work explanation page P1. Note that in the example shown in Fig. 6, for the sake of convenience, the outline of each of the gaze ranges R1 to R4 is shown by a two-dot chain line, but the outline of each of the gaze ranges R1 to R4 does not have to be displayed.
[0068] Furthermore, the gaze ranges R1 to R4 may be appropriately set to ranges that the worker U1 should gaze at before starting work. For example, the gaze ranges R1 to R4 may be set to surround a portion of the explanatory text B10. Alternatively, the gaze ranges R1 to R4 may be set to surround a portion or all of the explanatory diagram B20.
[0069] Assume that the determination unit 103 determines that the worker U1 is gazing within the gaze ranges R1 to R4. In such a case, it is considered that the worker U1 will make fewer errors in his / her work. Therefore, it is desirable that the worker U1 concentrate on his / her work without looking at the screen.
[0070] Therefore, the output control unit 116 may control the screen display unit 106 so that the circle C1, which the worker U1 should look at after completing the work corresponding to the work explanation page P1, is displayed at the position of the hexagon bolt B21. In the example shown in Fig. 6, the position of the circle C1 and the hexagon bolt B21 is an example of a work location. Therefore, the position where the circle C1 is displayed does not have to be limited to the position of the hexagon bolt B21, and may be determined in advance to be another work location, etc.
[0071] The gaze ranges R1 to R4 being gazed upon by the worker U1 may mean that the gaze ranges R1 to R4 are gazed upon by the worker U1 in a predetermined order (for example, in the order of gaze ranges R1, R2, R3, and R4). Alternatively, the gaze ranges R1 to R4 being gazed upon by the worker U1 may mean that the gaze ranges R1 to R4 are gazed upon by the worker U1 at least once each, regardless of the order in which they are gazed upon.
[0072] Furthermore, in this specification, "gazing within the gaze range" may mean that the gaze of the worker U1 is momentarily within the gaze range, or that the gaze of the worker U1 remains within the gaze range. The gaze of the worker U1 remaining within the gaze range may mean that the gaze of the worker U1 remains within the gaze range for a predetermined time (first time).
[0073] Next, assume that the determination unit 103 determines that the worker U1 is looking at the screen. In such a case, it is considered that the worker U1 is not concentrating on the work. Therefore, when the determination unit 103 determines that the worker U1 is looking at the screen, the output control unit 116 controls the output of a predetermined warning.
[0074] In this specification, "viewing the screen" may mean that the line of sight of the worker U1 is momentarily within the screen, or that the line of sight of the worker U1 remains within the screen. The line of sight of the worker U1 remaining within the screen may mean that the time during which the line of sight of the worker U1 remains within the screen continuously reaches a preset time (second time).
[0075] FIG. 7 is a diagram showing an example of an output of a warning. Referring to FIG. 7, an example is shown in which the output control unit 116 controls the display of warning A1 when it is determined that worker U1 is looking at the screen. In the example shown in FIG. 7, warning A1 is text data encouraging the worker U1 to concentrate on the work, but warning A1 is not limited to text data and may be predetermined audio data (for example, a predetermined warning sound). Alternatively, warning A1 may be light emitted by a predetermined light-emitting device (for example, turning on a lighting device that emits red light).
[0076] When the determination unit 103 determines that the worker U1 is gazing at the area inside the circle C1, the output control unit 116 obtains the next work instruction page P2 from the work instruction DB 102 and controls the screen display unit 106 so that the work instruction page P2 is displayed on the screen.
[0077] The work explanation page P2 may be a work explanation page for the second work among the works corresponding to the product selected by the worker U1. For example, the second work corresponds to an example of the second work, and corresponds to the work corresponding to the work process identified by the work process number "2."
[0078] The output control unit 116 performs the same process for work explanation page P2 as for work explanation page P1. The output control unit 116 also performs the same process for work explanation pages P3 to P1 that follow work explanation page P2.
[0079] In this specification, "gazing at the inside of the circle C1" may mean that the line of sight of the worker U1 is momentarily within the circle C1, or that the line of sight of the worker U1 stays within the circle C1. The line of sight of the worker U1 staying within the circle C1 may mean that the time that the line of sight of the worker U1 has continuously stayed within the circle C1 reaches a preset time (third time).
[0080] (Judgment unit 103) The determination unit 103 functions as a first determination unit that acquires the gaze ranges R1 to R4 corresponding to the product ID and the work process number from the gaze range DB 115 and determines whether or not the gaze ranges R1 to R4 are gazed upon by the worker U1. For example, the determination unit 103 may determine whether or not the gaze position is within the gaze ranges R1 to R4 based on the gaze position identified by the gaze position identification unit 101, depending on whether or not the gaze position is within the gaze ranges R1 to R4.
[0081] Based on the determination that the gaze ranges R1 to R4 are gazed upon by the worker U1, the determination unit 103 outputs a timer start instruction to the time measurement unit 104. As a result, the time measurement unit 104 starts measuring the elapsed time since the determination unit 103 output the timer start instruction.
[0082] The determination unit 103 functions as a second determination unit that determines whether the worker U1 is gazing at the screen, based on the determination that the gaze ranges R1 to R4 are gazed at by the worker U1. For example, the determination unit 103 may determine whether the worker U1 is gazing at the screen, based on the gaze position identified by the gaze position identification unit 101, depending on whether the gaze position exists within the screen.
[0083] At this time, the determination unit 103 may first determine whether the measured time obtained by the time measurement unit 104 has reached a predetermined task time, and then determine whether the worker U1 is viewing the screen based on the determination that the measured time has not reached the task time. The determination unit 103 may also acquire the task time corresponding to the worker U1, the product, and the current task process from the server 108. The calculation of the task time by the server 108 will be described in detail later.
[0084] The determination unit 103 may determine whether the worker U1 is gazing inside the circle C1 based on the determination that the measured time has reached the work time. This means that the worker U1 must concentrate on the work without being determined whether or not the worker U1 is gazing inside the circle C1 until it is determined that the measured time has reached the work time, which is expected to reduce work errors by the worker U1.
[0085] (Production volume DB109) Fig. 8 is a diagram showing an example of the configuration of the product production quantity DB 109. As shown in Fig. 8, the product production quantity DB 109 stores in advance product production quantity data in which product IDs and product production quantities are associated with each other.
[0086] Here, the product ID is an ID for identifying a product. The number of units produced of a product is the number of units produced of each product. For example, the number of units produced of a product may be the number of units planned to be produced of each product in a predetermined period. The predetermined period may be one day, but is not particularly limited to this period. Note that there is a causal relationship between the number of units produced of a product and the work time required to produce that product, in that the greater the number of units produced of a product, the longer the work time is likely to be.
[0087] (Proficiency level DB110) Fig. 9 is a diagram showing an example of the configuration of the proficiency DB 110. As shown in Fig. 9, the proficiency DB 110 stores proficiency data in advance, in which worker IDs, product IDs, work process numbers, and proficiencies are associated with each other.
[0088] Here, the worker ID is an ID for identifying the worker. The product ID is an ID for identifying the product. The work process number is a number for identifying the work process. The proficiency level indicates the worker's level of proficiency in the work. Here, we mainly assume that for each combination of worker, product, and work process, the result of dividing the standard work time by the measured work time is registered as the proficiency level. Note that if the division result is less than 1, "0" may be used as the proficiency level.
[0089] Here, it is assumed that the proficiency level is an integer equal to or greater than 1, and the higher the numerical value indicating the proficiency level, the higher the proficiency level. However, the lower the numerical value indicating the proficiency level, the higher the proficiency level. Note that there is a causal relationship between the proficiency level of a worker and the work time performed by that worker, in that the higher the proficiency level, the shorter the work time tends to be.
[0090] (Standard work time DB113) Fig. 10 is a diagram showing an example of the configuration of the standard work time DB 113. As shown in Fig. 10, the standard work time DB 113 stores standard work time data in which a product ID, a work process number, and a standard work time are associated with each other.
[0091] Here, the product ID is an ID for identifying the product. The work process number is a number for identifying the work process. The standard work time is the standard time required for work. Here, we mainly assume that the average time required for multiple workers to complete a work is registered as the standard work time. Note that there is a causal relationship between the standard work time and the work time of a worker, in that the longer the standard work time, the longer the work time of the worker is likely to be.
[0092] (Work time calculation unit 112) The work time calculation unit 112 acquires the product ID and the number of products produced from the product production number DB 109, acquires the worker ID, product ID, work process number, and proficiency from the proficiency DB 110, and acquires the product ID, work process number, and standard work time from the standard work time DB 113. Then, it calculates the work time for each combination of worker ID, product ID, and work process number.
[0093] For example, the work time calculation unit 112 may calculate the work time based on the number of products produced. For example, as described above, there is a causal relationship in which the greater the number of products produced, the longer the work time is likely to be. Therefore, the work time calculation unit 112 may calculate the work time such that the greater the number of products produced, the longer the work time is.
[0094] Furthermore, the operation time calculation unit 112 may calculate the operation time based on the proficiency level. For example, as described above, there is a causal relationship in which the higher the proficiency level, the shorter the operation time is likely to be. Therefore, the operation time calculation unit 112 may calculate the operation time so that the higher the proficiency level, the shorter the operation time is.
[0095] Furthermore, the work time calculation unit 112 may calculate the work time based on the standard work time. For example, as described above, there is a causal relationship in which the longer the standard work time, the longer the work time is likely to be. Therefore, the work time calculation unit 112 may calculate the work time so that the longer the standard work time, the longer the work time is.
[0096] As an example, a case will be described in which a work time corresponding to worker ID "001," product ID "1," and work process number "1" is calculated. If the number of produced products is En, in the example shown in FIG. 8, the number of produced products En corresponding to product ID "1" is "90." Furthermore, if the largest number of produced products registered in product production number DB 109 is En_max, in the example shown in FIG. 8, the largest number of produced products En_max is "100."
[0097] Furthermore, if the proficiency level is α, then in the example shown in Figure 9, the proficiency level α corresponding to worker ID "001," product ID "1," and work process number "1" is "2." Furthermore, if the standard work time is Ts, then in the example shown in Figure 10, the standard work time Ts corresponding to product ID "1" and work process number "1" is "30 (seconds)."
[0098] The operation time calculation unit 112 calculates the ratio β of the number of product production units by dividing the number of product production units En by the largest number of product production units En_max registered in the product production number DB 109. In the example shown in Fig. 8, the largest number of product production units is "100". Therefore, the operation time calculation unit 112 can calculate the ratio β of the number of product production units by the following formula (1).
[0099] β=En / En_max (1)
[0100] Then, the operation time calculation unit 112 can calculate the operation time T based on the proficiency level α, the ratio β of the number of products produced, and the standard operation time Ts, using the following formulas (2) and (3).
[0101] If α ≠ 0, T = Ts × (1 / α) × β (2) When α=0, T=Ts×β (3)
[0102] The operation time calculation unit 112 can calculate the operation time T as shown in the following equation (4) using the above equations (1) and (2) and specific values of Ts, α, and β.
[0103] T=30×(1 / 2)×(90 / 100)=13.5(seconds) ···(4)
[0104] The work time calculation unit 112 registers the calculated work time for each combination of worker ID, product ID, and work process number in the work time DB 114. Furthermore, when a combination of worker U1, product ID, and work process number is input from the information processing device 100, the work time calculation unit 112 obtains the work time corresponding to worker U1, product ID, and work process number from the work time DB 114 and provides it to the information processing device 100.
[0105] (Working time DB114) Fig. 11 is a diagram showing an example of the configuration of the work time DB 114. As shown in Fig. 11, work time data in which a worker ID, a product ID, a work process number, and a work time T are associated with each other is registered in advance in the work time DB 114.
[0106] Here, the worker ID is an ID for identifying the worker. The product ID is an ID for identifying the product. The work process number is a number for identifying the work process. The work time T is the estimated time required for the worker to perform the work.
[0107] The configuration example of the information processing system 1 according to the first embodiment of the present invention has been described above.
[0108] (1-2. Operation of information processing system) An example of the operation of the information processing system 1 according to the first embodiment of the present invention will be described with reference to FIGS. 12 and 13 (and also with reference to FIGS. 1 to 11 as appropriate).
[0109] Fig. 12 is a flowchart showing the first half of an example of operation of the information processing system 1 according to the first embodiment of the present invention, and Fig. 13 is a flowchart showing the second half of the example of operation of the information processing system 1 according to the first embodiment of the present invention.
[0110] First, in server 108, operation time calculation unit 112 acquires the product ID and the number of products produced from product production number DB 109, acquires the worker ID, product ID, operation process number, and proficiency from proficiency DB 110, and acquires the product ID, operation process number, and standard operation time from standard operation time DB 113. Then, it calculates the operation time for each combination of worker ID, product ID, and operation process number.
[0111] The work time calculation unit 112 registers the calculated work time in the work time DB 114 for each combination of worker ID, product ID, and work process number.
[0112] In the information processing device 100, the output control unit 116, based on an operation to select a product input by the worker U1 to the input unit 105, acquires the first work instruction page P1 corresponding to the product ID for identifying the selected product and the work process number "1" from the work instruction DB 102. Then, the output control unit 116 controls the screen display unit 106 to display the acquired work instruction page P1 on the screen (S110).
[0113] Furthermore, based on the operation to select worker U1 being input into the input unit 105 by worker U1, the information processing device 100 outputs to the server 108 a combination of worker ID, product ID, and work process number "1" to identify the selected worker U1.
[0114] In the server 108, when a combination of worker U1, product ID, and work process number is input from the information processing device 100, the work time calculation unit 112 obtains the work time corresponding to the worker U1, product ID, and work process number from the work time DB 114. Then, the work time calculation unit 112 provides the obtained work time to the information processing device 100. In the information processing device 100, the determination unit 103 obtains the work time provided from the server 108.
[0115] The gaze detection unit 107 detects the gaze of the worker U1 (S121). Subsequently, the gaze position identification unit 101 identifies the gaze position on the screen based on the gaze of the worker U1 detected by the gaze detection unit 107 (S122). The determination unit 103 acquires gaze ranges R1 to R4 corresponding to the product ID and the work process number from the gaze range DB 115 (S123), and determines whether the worker U1 gazed within all of the gaze ranges R1 to R4 based on the gaze position identified by the gaze position identification unit 101 (S124).
[0116] If there is any gaze range within the gaze ranges R1 to R4 that is not being gazed at by the worker U1 ("NO" in S124), the operation proceeds to S121. On the other hand, if there is no gaze range within the gaze ranges R1 to R4 that is not being gazed at by the worker U1 ("YES" in S124), the output control unit 116 controls the screen display unit 106 to display a circle C1 as an example of a gaze object at the position of a hexagonal bolt B21 as an example of a work location (S125).
[0117] Next, the determination unit 103 outputs a timer start instruction to the time measurement unit 104. The time measurement unit 104 starts the timer based on the output of the timer start instruction from the determination unit 103 (S126), and measures the time that has elapsed since the reference time, which is the time when the timer start instruction is output, as the measurement time.
[0118] Next, the determination unit 103 determines whether or not the operator U1 has looked at the screen based on the gaze position identified by the gaze position identification unit 101 (S127). If it is determined that the operator U1 has looked at the screen ("YES" in S127), the output control unit 116 controls the screen display unit 106 to display a warning A1 (S128). Then, the operation proceeds to S127.
[0119] On the other hand, if it is determined that the worker U1 is not viewing the screen ("NO" in S127), the determination unit 103 determines whether or not the measured time obtained by the time measurement unit 104 has reached the task time acquired from the server 108 (S129). If it is determined that the measured time obtained by the time measurement unit 104 has not reached the task time acquired from the server 108 ("NO" in S129), the operation proceeds to S127.
[0120] On the other hand, when the determination unit 103 determines that the measured time obtained by the time measurement unit 104 has reached the task time acquired from the server 108 ("YES" in S129), it determines whether or not the worker U1 has gazed at the inside of the circle C1 as an example of an object to be gazed at, based on the gaze position identified by the gaze position identification unit 101 (S140). When it is determined that the worker U1 has not gazed at the inside of the circle C1 as an example of an object to be gazed at, the operation proceeds to S140.
[0121] On the other hand, if it is determined that the inside of the circle C1, which is an example of the gaze object, is gazed upon by the worker U1 ("YES" in S140), the determination unit 103 determines whether or not the warning A1 is displayed (S141). If the determination unit 103 determines that the warning A1 is displayed ("YES" in S141), the output control unit 116 hides the warning A1 (S142). Then, the process proceeds to S143. On the other hand, if the determination unit 103 determines that the warning A1 is not displayed ("NO" in S141), the process proceeds to S143.
[0122] The determination unit 103 determines whether all work processes corresponding to the selected product have been completed (S143). If there are any work processes that have not been completed ("NO" in S143), the determination unit 103 acquires the next work explanation page corresponding to the product ID and work process number, and controls the screen display unit 106 so that the acquired next work explanation page is displayed on the screen (S144). Then, the operation proceeds to S121.
[0123] On the other hand, if all work processes have been completed (YES in S143), the operation ends.
[0124] An example of the operation of the information processing system 1 according to the first embodiment of the present invention has been described above.
[0125] (1-3. Effects of the First Embodiment) According to the first embodiment of the present invention, the work explanation page is not switched unless the determination unit 103 determines that the worker U1 is gazing within the gaze range on the work explanation page displayed on the screen. This reduces the possibility that the worker U1 will fail to read the work explanation page, and can reduce the possibility that the worker U1 will make an error in the work.
[0126] Furthermore, according to the first embodiment of the present invention, whether the worker U1 is looking at the screen is determined based on whether the worker U1 is gazing at the gaze range. If the worker U1 is looking at the screen, a warning is displayed. This allows the worker U1 to concentrate on the work without looking at the screen after reading the work explanation page, further reducing the possibility of the worker U1 making an error in the work.
[0127] The first embodiment of the present invention has been described above.
[0128] (2. Second Embodiment) Next, a second embodiment of the present invention will be described. In the following, a description of common parts between the second embodiment of the present invention and the first embodiment of the present invention will be omitted, and only parts of the second embodiment of the present invention that are different from the first embodiment of the present invention will be described.
[0129] (2-1. Information Processing System Configuration) An example of the configuration of an information processing system according to the second embodiment of the present invention will be described with reference to FIGS.
[0130] (Schematic configuration of information processing system 1) Fig. 14 is a diagram showing a schematic configuration example of an information processing system according to the second embodiment of the present invention. As shown in Fig. 14, the information processing system 2 according to the second embodiment of the present invention is similar to the information processing system 1 according to the first embodiment of the present invention in that the information processing device 100 is replaced with an information processing device 200 and the gaze detection unit 107 is replaced with a camera unit 201.
[0131] Therefore, in the following description, the information processing device 200 and the camera unit 201 will be mainly described, and detailed description of other components included in the information processing system 2 according to the second embodiment of the present invention will be omitted.
[0132] The camera unit 201 can be realized by a visible light camera. For example, the visible light camera may be a web camera. A visible light camera is less expensive than a combination of an infrared LED and an infrared sensor. Therefore, according to the second embodiment of the present invention, the information processing system 2 can be configured at a lower cost than the first embodiment of the present invention in which the gaze detection unit 107 includes an infrared LED and an infrared sensor.
[0133] The camera unit 201 can detect the line of sight of the worker U1. In the example shown in Fig. 14, the position of the camera unit 201 is at the top of the information processing device 100. However, the position of the camera unit 201 does not have to be limited to the top of the information processing device 100. The line of sight detected by the camera unit 201 may be a three-dimensional line of sight direction.
[0134] It should be noted that known techniques may be adopted as the gaze detection technique by the camera unit 201. For example, gaze detection by the camera unit 201 may be realized by extracting features around the eyes based on image data, and detecting a relative gaze angle based on the feature around the eyes, with the direction from the eyes of the worker U1 to the camera unit 201 as the reference.
[0135] (Functional configuration of information processing system 2) Fig. 15 is a diagram showing an example of the functional configuration of an information processing system 1 according to the second embodiment of the present invention. As shown in Fig. 15, as compared with the information processing device 100 according to the first embodiment of the present invention, the information processing device 200 according to the second embodiment of the present invention includes a face direction DB 203 and a face direction estimation unit 202, but is otherwise common to both.
[0136] Therefore, in the following description, the face direction DB 203 and the face direction estimation unit 202 will be mainly described, and detailed description of other components included in the information processing device 200 according to the second embodiment of the present invention will be omitted.
[0137] (Face direction estimation unit 202) The face direction estimation unit 202 estimates the face direction of the worker U1 based on the image data obtained by the camera unit 201. The face direction estimated by the face direction estimation unit 202 may be a three-dimensional face direction. A known technique may be adopted as the technique for estimating the face direction by the face direction estimation unit 202.
[0138] For example, the face direction estimation unit 202 may acquire a trained estimation model created in advance by supervised machine learning, and acquire the face direction output from the trained estimation model by inputting image data into the acquired trained estimation model. Alternatively, the face direction estimation unit 202 may estimate the face direction by other methods. Note that the face direction may include the face position and the face orientation.
[0139] Before worker U1 starts work, the face direction estimation unit 202 estimates the face direction of worker U1 based on image data obtained by the camera unit 201 while worker U1 is viewing the screen. Based on the estimated face direction, the face direction estimation unit 202 calculates a face direction range for determining whether worker U1 is viewing the screen, and registers face direction data in which the worker ID and the face direction range are associated in the face direction DB 203.
[0140] Fig. 16 is a diagram for explaining an example of calculating a face direction range. Referring to Fig. 16, a worker U1 is present in front of a shelf 121. The direction from the camera unit 201 to the eyes of the worker U1 is shown as a face direction θ, with the front direction of the camera unit 201 used as a reference. The face direction estimation unit 202 estimates the face direction θ based on image data obtained by the camera unit 201, and calculates a face direction range based on the face direction θ.
[0141] For example, the face direction range may be defined by an estimated face direction θ and an increase or decrease in angle based on the face direction θ. For example, the face direction range "10±5" corresponding to the worker ID "001" shown in Fig. 17 may be an angle range (=5 to 15) obtained by increasing or decreasing the reference face direction θ (=10) by 5.
[0142] When an operation to select the worker U1 is input to the input unit 105 by the worker U1, the face direction estimation unit 202 estimates the face direction of the worker U1 based on the image data obtained by the camera unit 201. At this time, the determination unit 103 may acquire a face direction range corresponding to the worker ID from the face direction DB 203 and determine whether the face direction belongs to the face direction range, thereby determining whether the inside of the screen is viewed by the worker U1.
[0143] (Face direction DB203) Fig. 17 is a diagram showing an example of the configuration of the face direction DB 203. As shown in Fig. 17, face direction data in which a worker ID and a face direction range are associated with each other is registered in advance in the face direction DB 203. Here, the worker ID is an ID for identifying the worker. The face direction range is a range of face directions θ within which it is determined that the worker is viewing the screen.
[0144] The configuration example of the information processing system 2 according to the second embodiment of the present invention has been described above.
[0145] (2-2. Operation of the information processing system) An example of the operation of the information processing system 2 according to the second embodiment of the present invention will be described with reference to FIGS. 18 and 19 (and also with reference to FIGS. 3 to 11 and 14 to 17 as appropriate).
[0146] Fig. 18 is a flowchart showing the first half of an example of operation of the information processing system 2 according to the second embodiment of the present invention, and Fig. 19 is a flowchart showing the second half of the example of operation of the information processing system 2 according to the second embodiment of the present invention.
[0147] Note that the operation of the information processing system 2 according to the second embodiment of the present invention is the same as the operation of the information processing system 1 according to the first embodiment of the present invention, except that S121 is replaced by S300, S122 is replaced by S301, and S127 is replaced by S303. Therefore, the following description will mainly focus on S300, S302, and S303.
[0148] Before worker U1 starts work, the face direction estimation unit 202 estimates the face direction of worker U1 based on image data obtained by the camera unit 201 while worker U1 is viewing the screen. Based on the estimated face direction, the face direction estimation unit 202 calculates a face direction range for determining whether worker U1 is viewing the screen, and registers face direction data in which the worker ID and the face direction range are associated in the face direction DB 203.
[0149] After the first work explanation page is displayed, the camera unit 201 captures an image of the face of the worker U1 to obtain image data (S300). The camera unit 201 detects the line of sight of the worker U1 based on the image data. Next, the gaze position identification unit 101 identifies the gaze position on the screen based on the line of sight of the worker U1 detected by the camera unit 201, and the facial direction estimation unit 202 estimates the facial direction of the worker U1 based on the image data (S301).
[0150] After the timer is started by the time measurement unit 104, the determination unit 103 acquires a face direction range corresponding to the worker ID from the face direction DB 203, and determines whether the face direction belongs to the face direction range, thereby determining whether the screen is viewed by the worker U1 (S303). If the face direction belongs to the face direction range ("YES" in S303), the operation proceeds to S128. On the other hand, if the face direction does not belong to the face direction range ("NO" in S303), the operation proceeds to S129.
[0151] An example of the operation of the information processing system 2 according to the second embodiment of the present invention has been described above.
[0152] (2-3. Effects of the Second Embodiment) According to the second embodiment of the present invention, it is possible to achieve the same effects as those achieved by the first embodiment of the present invention. Furthermore, according to the second embodiment of the present invention, the line of sight can be detected by a visible light camera, which is less expensive than a combination of an infrared LED and an infrared sensor. Therefore, according to the second embodiment of the present invention, it is also possible to achieve the effect that the information processing system 2 can be constructed more inexpensively.
[0153] Furthermore, according to the second embodiment of the present invention, when it is determined that the gaze range is gazed upon by the worker U1, the face direction of the worker U1 is estimated based on the image data obtained by the camera unit 201, and whether or not the worker U1 is looking at the screen is determined based on the face direction. Then, when the worker U1 is looking at the screen, a warning is displayed. Therefore, according to the second embodiment of the present invention, similar to the first embodiment of the present invention, the possibility of an error occurring in the work by the worker U1 can be reduced.
[0154] The second embodiment of the present invention has been described above.
[0155] (3. Hardware configuration example) Next, an example of the hardware configuration of the information processing device 100 according to the first embodiment of the present invention will be described. Note that the hardware configurations of the server 108 according to the first embodiment of the present invention and the information processing device 200 according to the second embodiment of the present invention may be realized in the same manner as the hardware configuration of the information processing device 100 according to the first embodiment of the present invention.
[0156] Hereinafter, an example of the hardware configuration of the information processing device 900 will be described as an example of the hardware configuration of the information processing device 100 according to the first embodiment of the present invention. Note that the example of the hardware configuration of the information processing device 900 described below is merely one example of the hardware configuration of the information processing device 100. Therefore, with regard to the hardware configuration of the information processing device 100, unnecessary components may be deleted from the hardware configuration of the information processing device 900 described below, or new components may be added.
[0157] 20 is a diagram showing the hardware configuration of an information processing device 900 as an example of the information processing device 100 according to the first embodiment of the present invention. The information processing device 900 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, a RAM (Random Access Memory) 903, a host bus 904, a bridge 905, an external bus 906, an interface 907, an input device 908, an output device 909, a storage device 910, and a communication device 911.
[0158] The CPU 901 functions as an arithmetic processing unit and control unit, and controls the overall operation of the information processing device 900 in accordance with various programs. The CPU 901 may also be a microprocessor. The ROM 902 stores programs used by the CPU 901, calculation parameters, etc. The RAM 903 temporarily stores programs used in the execution of the CPU 901, parameters that change as appropriate during the execution, etc. These are interconnected by a host bus 904 that is composed of a CPU bus, etc.
[0159] The host bus 904 is connected to an external bus 906, such as a PCI (Peripheral Component Interconnect / Interface) bus, via a bridge 905. It is not necessary to configure the host bus 904, bridge 905, and external bus 906 separately, and these functions may be implemented on a single bus.
[0160] The input device 908 is composed of input means such as a mouse, keyboard, touch panel, buttons, microphone, switches, and levers that allow the user to input information, and an input control circuit that generates an input signal based on the user's input and outputs it to the CPU 901. By operating this input device 908, the user operating the information processing device 900 can input various data to the information processing device 900 and instruct the information processing device 900 to perform processing operations.
[0161] The output device 909 includes, for example, a display device such as a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, or a lamp, and an audio output device such as a speaker.
[0162] The storage device 910 is a device for storing data. The storage device 910 may include a storage medium, a recording device for recording data on the storage medium, a reading device for reading data from the storage medium, and a deletion device for deleting data recorded on the storage medium. The storage device 910 is configured, for example, with an HDD (Hard Disk Drive). This storage device 910 drives a hard disk and stores programs executed by the CPU 901 and various data.
[0163] The communication device 911 is, for example, a communication interface configured with a communication device for connecting to a network, etc. The communication device 911 may be compatible with either wireless communication or wired communication.
[0164] An example of the hardware configuration of the information processing device 100 according to the first embodiment of the present invention has been described above.
[0165] (4. Supplementary Information) Although the preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, the present invention is not limited to these examples. It is clear that a person skilled in the art to which the present invention pertains can conceive of various modifications and alterations within the scope of the technical ideas set forth in the claims, and it is understood that these also naturally fall within the technical scope of the present invention. [Explanation of symbols]
[0166] 1,2 Information Processing Systems 100 Information processing device 101 Gaze position identification part 102 Work Instructions DB 103 Judgment section 104 Time measurement section 105 Input section 106 Screen display section 107 Gaze detection unit 108 servers 109 Product Production Volume DB 110 Proficiency DB 112 Work time calculation unit 113 Standard work time DB 114 Working Time DB 115 gaze range DB 116 Output control section 200 Information processing device 201 Camera Club 202 Face direction estimation unit 203 Face Orientation DB
Claims
1. a first determination unit that determines whether a predetermined range in the information related to the first task displayed on the screen is gazed upon by the worker; a second determination unit that determines whether the worker is viewing the screen based on the determination that the predetermined range is gazed upon by the worker; and An information processing device comprising:
2. the information processing device includes an output control unit that controls output of a predetermined warning based on the determination that the worker is viewing the screen. The information processing device according to claim 1 .
3. the information processing device includes a time measurement unit that obtains, as a measured time, a time that has elapsed since it was determined that the predetermined range was gazed upon by the worker; the second determination unit determines whether the measured time has reached a predetermined work time, and determines whether the worker is viewing the screen based on the determination that the measured time has not reached the work time. The information processing device according to claim 1 .
4. The work time is calculated based on a standard work time of the first work. The information processing device according to claim 3 .
5. The work time is calculated based on the worker's proficiency in the first work. The information processing device according to claim 3 .
6. the first operation is an operation necessary for producing a product, The work time is calculated based on the number of units of the product produced. The information processing device according to claim 3 .
7. the second determination unit determines whether the worker is gazing at a gaze object based on the determination that the measured time has reached the task time. The information processing device according to claim 3 .
8. the information processing device includes an output control unit that controls display of information about a second task that follows the first task based on the determination that the worker is viewing the inside of the attention object. The information processing device according to claim 7 .
9. The information regarding the first work includes one or both of a procedure for the first work and matters to be noted when performing the first work. The information processing device according to claim 1 .
10. the first determination unit determines whether the predetermined range is gazed upon by the worker based on whether the line of sight of the worker is present within the predetermined range or whether the time during which the line of sight is continuously present within the predetermined range reaches a preset first time. The information processing device according to claim 1 .
11. the second determination unit determines whether the inside of the screen is viewed by the worker based on whether the line of sight or the face direction of the worker is present within the screen, or whether the time during which the line of sight or the face direction is continuously present within the screen reaches a preset second time. The information processing device according to claim 1 .
12. determining whether a predetermined range in the information relating to the first task displayed on the screen is gazed upon by the worker; determining whether the worker is viewing the screen based on the determination that the predetermined range is gazed upon by the worker; 2. A computer-implemented information processing method, comprising:
13. Computer, a first determination unit that determines whether a predetermined range in the information related to the first task displayed on the screen is gazed upon by the worker; a second determination unit that determines whether the worker is viewing the screen based on the determination that the predetermined range is gazed upon by the worker; and A program that functions as a
14. a first determination unit that determines whether a predetermined range in the information related to the first task displayed on the screen is gazed upon by the worker; a second determination unit that determines whether the worker is viewing the screen based on the determination that the predetermined range is gazed upon by the worker; and an information processing device comprising: a display device that displays information about the first task on the screen; An information processing system having:
Citation Information
Patent Citations
Reading order confirmation device, reading order confirmation method, and reading order confirmation program
JP2015032116A
Information processing program, highlighting method, and information processing apparatus
JP2022182083A