Work analysis system and work analysis method

Abstract

To provide a work analysis system capable of notifying of the results of work analysis in an easy-to-understand manner, and a work analysis method.SOLUTION: A work analysis system 1 is a system that analyzes the work of an operator and notifies of the analysis results to a user. The system includes: an imaging unit 2 for picking up images of a work site; an analysis server 3 that performs analysis based on the imaging results by the imaging unit; a terminal 5 that displays the analysis results acquired by the analysis server to the user; and a relay server 4 that translates analysis results by the analysis server into a natural language.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The present disclosure relates to a work analysis system and a work analysis method for analyzing information related to a work and notifying an analysis result to a worker who performs a predetermined work or a manager who manages the work performed by the worker.

Background Art

[0002] Conventionally, in the manufacturing industry that manufactures articles, in order to contribute to the improvement of work efficiency, technologies for calculating the operating status and manufacturing efficiency of a production line have been developed.

[0003] For example, primary information acquisition means for acquiring primary information including work time information regarding the work time of a worker in a manufacturing process and image information regarding the manufacturing process, and image information analysis means for analyzing whether or not a worker is involved in the work of the manufacturing process based on the image information, actual working time calculation means for calculating the actual working time corresponding to each manufacturing process by the worker from the results of the analysis by the work time information and the image information analysis means, and cost information generation means for generating cost information regarding the cost of an article from the calculated actual working time are known (see Patent Document 1).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] In the conventional information processing apparatus disclosed in Patent Document 1 above, an analysis result based on the actual working time is output. However, in order to improve work efficiency, it may be necessary to consider a plurality of data, not only the actual working time but also the work efficiency for each time zone or each day of the week.

[0006] However, it is not easy for users to understand a plurality of data. Therefore, there is a need for a work analysis system and a work analysis method that can easily notify users of the results of work analysis.

[0007] Therefore, the main object of the present disclosure is to provide a work analysis system and a work analysis method that can easily notify the results of work analysis.

Means for Solving the Problem

[0008] The work analysis system of the present disclosure is a work analysis system that analyzes the work of a worker and notifies the user of the analysis result, and includes an imaging device that images the work site, an analysis server that performs analysis based on the imaging result of the imaging device, a terminal that displays the analysis result obtained by the analysis server to the user, and a relay server that naturalizes the analysis result of the analysis server and causes the terminal to display the naturalized analysis result.

[0009] The work analysis method of the present disclosure is a work analysis method that analyzes the work of a worker and notifies the user of the analysis result, and is executed by a work analysis system including an imaging device that images the worker, an analysis server that performs analysis based on the imaging result of the imaging device, a terminal that displays the analysis result obtained by the analysis server to the user, and a relay server connected to the terminal and the analysis server, and the relay server naturalizes the analysis result of the analysis server and causes the terminal to display the naturalized analysis result.

Effects of the Invention

[0010] According to the present disclosure, it is possible to provide a work analysis system and a work analysis method that can easily notify the results of work analysis.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Mode for Carrying Out the Invention

[0012] The first invention made to solve the above problems is a work analysis system that analyzes the work of a worker and notifies the user of the analysis result, including an imaging device that images the work site, an analysis server that performs analysis based on the imaging result of the imaging device, a terminal that displays the analysis result obtained by the analysis server to the user, and a relay server that naturalizes the analysis result of the analysis server and causes the terminal to display the naturalized analysis result.

[0013] According to this, the analysis result by the analysis server is naturalized and displayed on the terminal. Therefore, it is possible to notify the user of the work analysis result in an easy-to-understand manner.

[0014] Further, the second invention relates to the first invention, and the relay server generates a prompt including the analysis result, and inputs the prompt to a text generation server that naturalizes the prompt based on the prompt and outputs it as text, so as to naturalize the analysis result of the analysis server.

[0015] According to this, the analysis result can be easily naturalized.

[0016] Further, the third invention relates to the first invention, and the analysis server calculates an evaluation value indicating the work efficiency of the worker based on the imaging result from the imaging device, and when the evaluation value becomes equal to or less than a predetermined threshold value, outputs a reporting notice to the relay server. When the relay server acquires the reporting notice, the relay server naturalizes the analysis result of the analysis server and causes the terminal to display the decrease in work efficiency naturalized.

[0017] According to this, the decrease in work efficiency can be notified to the user in an easy-to-understand manner.

[0018] Further, the fourth invention relates to the first invention, and further has a work history database in which the work history of the worker is recorded. The relay server acquires a request notice for requesting the analysis server to analyze the work history from the terminal, and based on the acquired request notice, acquires the analysis result of the work history corresponding to the request notice based on the work history database from the analysis server, naturalizes the analysis result acquired from the analysis server, and causes the terminal to display the analysis result of the work history naturalized.

[0019] According to this, based on the work history, the analysis result can be notified to the user in an easy-to-understand manner.

[0020] Further, a fifth invention relates to the fourth invention, wherein the relay server causes the terminal to notify the user of the analysis result of the work history, causes the terminal to obtain a quality evaluation value input by the user for the analysis result, and stores the request notification, the natural language analysis result, and the quality evaluation value together as a response history.

[0021] According to this, it is possible to obtain a quality evaluation value of the user for the analysis result and hold it together with the analysis request and the natural language analysis result.

[0022] Further, a sixth invention relates to the fifth invention, wherein the relay server is configured to cause the terminal to present candidates for the analysis request based on the response history when obtaining the request notification from the terminal.

[0023] According to this, it becomes possible to propose to the user candidates that are highly likely to obtain a high-quality response.

[0024] Further, a seventh invention relates to the sixth invention, wherein the relay server displays a setting screen for receiving a setting input including the attributes of the user on the terminal, and selects the candidate for the analysis request to be displayed on the terminal based on the setting input received on the setting screen and the response history.

[0025] According to this, it is possible to select candidates according to the attributes of the user.

[0026] Further, an eighth invention is a work analysis method for analyzing the work of a worker and notifying the user of the analysis result, which is executed by a work analysis system including an imaging device for imaging the worker, an analysis server for performing analysis based on the imaging result of the imaging device, a terminal for displaying the analysis result obtained by the analysis server to the user, and a relay server connected to the terminal and the analysis server, and the relay server naturalizes the analysis result of the analysis server and causes the terminal to display the naturalized analysis result.

[0027] According to this, the analysis result by the analysis server is naturalized into natural language and displayed on the terminal. Therefore, it becomes possible to notify the worker of the result of the work analysis in an easy-to-understand manner.

[0028] Hereinafter, the work analysis system of the present disclosure corresponds to an example in which a system (hereinafter, analysis system) that naturalizes the analysis result of a video captured by an imaging device such as a camera and notifies the user is used to perform the work analysis of the worker and notify the user of the analysis result.

[0029] FIG. 1 is an overall configuration diagram of a work analysis system 1 according to an embodiment of the present disclosure. The work analysis system 1 is a system for analyzing the operation efficiency and the like of the work performed by a worker at a work site S (also referred to as a production site) such as a warehouse or a factory, and notifying the user of the analysis result. The work analysis system 1 can be used to improve the work efficiency at the work site S such as a warehouse or a factory, or to identify safety violations and dangerous actions at an early stage and prevent accidents.

[0030] Note that, as an example, a case where the work performed by the worker includes three types of work, namely, a previous work, a main work, and a subsequent work, will be described. However, the present invention is not limited to the type of work or the number of works included.

[0031] In the present embodiment, the work analysis system 1 performs a work analysis method of analyzing the work of the worker and notifying the user of the analysis result by executing a reporting notification process and an analysis notification process. In the reporting notification process, the work analysis system 1 images the work site S of the worker, detects a decrease in work efficiency, etc., and notifies the user. In the analysis notification process, the work analysis system 1 performs an analysis based on an analysis request from the user and notifies the user. Note that the work analysis system 1 may acquire the work efficiency of each worker and notify the user when the work efficiency of any one of them decreases, or may notify the user when the work efficiency of all the work performed by the worker at the work site S decreases.

[0032] The work analysis system 1 includes an imaging device 2, an analysis server 3, and a relay server 4. The imaging device 2, the analysis server 3, and the relay server 4 can be operated by an operator who provides the work site S. Further, the work analysis system 1 includes a terminal 5 used by a user. The user of the work analysis system 1 may be an administrator who manages and supervises the work site S, or may be a worker who works at the work site S such as a warehouse or a factory.

[0033] The imaging device 2, the analysis server 3, the relay server 4, and the terminal 5 can communicate with each other via a known communication network 6 such as the Internet or an intranet.

[0034] The relay server 4 can communicate with a text generation server 7 via a known communication network 6 such as the Internet.

[0035] Fig. 2 shows a block diagram of the imaging device 2, the analysis server 3, the relay server 4, the terminal 5, and the text generation server 7.

[0036] As shown in Fig. 2, the text generation server 7 can be configured by a computer including known hardware such as a processor 7A (CPU, MPU, etc.), a memory 7B (RAM, ROM, etc.), a display, an input device, a network interface 7C, and a storage device 7D (HDD, SSD).

[0037] When the article generation server 7 (processor 7A) receives a prompt (instruction text) via the communication network 6 (when the prompt is input), it has the function of generating text in natural language according to the prompt and returning the generated text. That is, the article generation server 7 has the function as a so-called generative AI that automatically generates text when a prompt is sent. Here, the prompt corresponds to an instruction or command text that gives an instruction to generate text to a generative AI such as the article generation server 7. The article generation server 7 may be composed of, for example, an artificial intelligence chatbot such as ChatGPT (registered trademark) that sends an answer based on the sent prompt.

[0038] The article generation server 7 may be operated by the operator who provides the work site S, or may be operated by an operator different from the operator who provides the work site S. The article generation server 7 may be configured so that it cannot be directly connected to the analysis server 3 via the communication network 6. For example, the terminal 5, the analysis server 3, and the relay server 4 may be connected by an intranet in a warehouse or a factory, and only the relay server 4 may be configured to be connectable to the article generation server 7 via the Internet.

[0039] In addition, in FIG. 1, for convenience of explanation, one terminal 5 is shown, but the work analysis system 1 may include a plurality of terminals 5. The work analysis system 1 may include the article generation server 7, or the function of the article generation server 7 may be installed in the relay server 4. Here, the terminal 5 is connected only to the relay server 4, and the relay server 4 is connected to the analysis server 3 and the article generation server 7 for explanation.

[0040] As shown in FIG. 1, the imaging device 2 images the work site S and outputs the work video to the analysis server 3. As shown in FIG. 2, the imaging device 2 may be composed of one or more cameras 2A arranged at the work site S. Here, only the imaging device 2 is provided as the sensor, but various sensors (such as radar, lidar, touch sensors, etc.) can be used in combination. The imaging device 2 may also be composed of one or more various devices that can acquire (i.e., image) a video capable of grasping the progress of the work. In addition to (or instead of) the imaging device 2, the work analysis system 1 may include one or more other sensors for detecting the situation of the work site S.

[0041] The terminal 5 includes a computer that executes the processing necessary to display the analysis result to the user. The terminal 5 includes an information device having a communication function such as a smartphone, a tablet terminal, or a notebook PC used by the user. As shown in FIG. 2, the terminal 5 may include known hardware such as a processor 5A (CPU, MPU, etc.), a memory 5B (RAM, ROM, etc.), a display, an input device, a network interface 5C, and a storage device 5D (HDD, SSD, etc.).

[0042] In this embodiment, the terminal 5 is composed of a tablet-type computer (tablet terminal).

[0043] As shown in FIG. 3, the terminal 5 has, as functional units, a communication unit 11, an operation input unit 12, a display unit 13, a storage unit 14, and a control unit 15.

[0044] The communication unit 11 includes the network interface 5C. The communication unit 11 performs wireless communication or wired communication with other devices (here, the relay server 4, etc.) via the communication network 6 according to a known communication protocol.

[0045] The operation input unit 12 receives an input from the user. The operation input unit 12 includes a known input device such as a touch panel display 5E that enables an input operation by the user.

[0046] The display unit 13 notifies the user by performing a screen display. The display unit 13 includes a known display device such as a liquid crystal display. However, the touch panel display 5E used as an input device may also function as a display device.

[0047] The storage unit 14 can be constituted by a memory 5B and a storage device 5D. The storage unit 14 stores various types of information necessary for processing in the terminal 5, such as information required for performing the display in the display unit 13 and information related to the input received in the operation input unit 12.

[0048] The control unit 15 can be realized by the processor 5A performing processing according to a program stored in the storage unit 14. The control unit 15 includes a transmission execution unit 21, an analysis request reception unit 22, a result notification unit 23, a response history transmission unit 24, an input assist unit 25, and a setting reception unit 26.

[0049] When the transmission execution unit 21 receives a transmission request from the relay server 4, it causes the display unit 13 to display a transmission screen 27 (see FIG. 4) notifying of a decrease in work efficiency, and notifies the user of the decrease in work efficiency. The transmission request transmitted from the relay server 4 may include text for notifying the user of details of the transmission content, such as "The amount of work per hour has decreased by 30%". The text 27A included in the transmission request is displayed on the transmission screen 27. Note that the symbol of AI in FIG. 4 means a notification or response output by the work analysis system 1.

[0050] The analysis request reception unit 22 receives an input requesting analysis of the work history, that is, receives an analysis request. The analysis request reception unit 22 receives the analysis request by displaying an input field 28 on the transmission screen 27 (see FIGS. 4 and 5), or by causing the display unit 13 to display a chat screen 29 (see FIG. 6) including the input field 28. Note that the symbol of AI in FIGS. 5 and 6 means a notification or response output by the work analysis system 1 as in FIG. 4. Also, the symbol of U in FIGS. 5 and 6 means an input by the user.

[0051] When the analysis request reception unit 22 receives an analysis request (i.e., accepts an analysis request), it transmits a signal including the analysis request (hereinafter referred to as an analysis request notification) to the relay server 4. When the relay server 4 receives the analysis request signal, it transmits a signal including the corresponding natural language analysis result (hereinafter referred to as an analysis result notification) to the terminal 5 (result notification unit 23). The analysis result notification may include various data such as text, images, and graphs for notifying the analysis result.

[0052] When the result notification unit 23 acquires the analysis result notification, it displays the corresponding natural language analysis result from the relay server 4 on the reporting screen 27 or the chat screen 29 in text 30. In addition to the text 30, the result notification unit 23 may display the analysis result by means of an image, a graph 31, etc.

[0053] Thereafter, the analysis request reception unit 22 accepts the input of the analysis request again, and when there is an input of the analysis request, the analysis request reception unit 22 transmits the corresponding analysis request signal to the relay server 4.

[0054] When the analysis request reception unit 22 displays the analysis result on the display unit 13, the response history transmission unit 24 displays an input field 32 for the quality evaluation value for the analysis result on the display unit 13. When the quality evaluation value is input, the analysis request received by the analysis request reception unit 22, the natural language analysis result obtained from the relay server 4, and the corresponding quality evaluation value are transmitted to the relay server 4 as the response history.

[0055] The input assist unit 25 presents an input example 33 of the analysis request to be accepted by the analysis request reception unit 22 on the reporting screen 27 or the chat screen 29 to assist the user in inputting the analysis request. When the analysis request candidate is included in the analysis result notification transmitted from the relay server 4, the input assist unit 25 may display the analysis request candidate on the display unit 13 as the input example 33.

[0056] The setting reception unit 26 receives setting inputs for setting the text displayed on the display unit 13 and the input example 33 presented by the input assist unit 25. FIG. 7 shows an example of a setting reception screen 34 that the setting reception unit 26 displays on the display unit 13 of the terminal 5. Note that when there is an input to the setting button 27B at the upper right of the transmission screen 27 or the chat screen 29, the setting reception unit 26 may display the setting reception screen 34 on the display unit 13 of the terminal 5.

[0057] The setting reception screen 34 may include various input fields 35 for setting the text that the result notification unit 23 displays on the display unit 13.

[0058] In the example shown in FIG. 7, the setting reception screen 34 may include an input field 35A for the formality degree of the response text that the terminal 5 displays in the chat, and an input field 35B related to the attributes of the user. The attributes of the user may be various positions such as, for example, an operator, a line manager, a factory manager, etc. The setting reception screen 34 may further include an input field 35C for the number of input examples 33 (question texts) proposed by the input assist unit 25, an input field 35D related to the quality threshold of the input example 33, and a setting save button 36. When the setting save button 36 is touched, the setting reception unit 26 stores the setting inputs received in the input fields 35 as setting information 14A in the storage unit 14 of the terminal 5.

[0059] When the setting information 14A is recorded in the storage unit 14, when the transmission execution unit 21, the analysis request reception unit 22, and the response history transmission unit 24 each transmit various data to the relay server 4, they may transmit the setting information 14A together.

[0060] Next, the analysis server 3 includes a computer that executes processes necessary for performing work analysis based on the video (imaging result) imaged by the imaging device 2. As shown in FIG. 2, the analysis server 3 may include known hardware such as a processor 3A (CPU, MPU, etc.), a memory 3B (RAM, ROM, etc.), a display, an input device, a network interface 3C, and a storage device 3D (HDD, SSD, etc.).

[0061] As shown in FIG. 8, the analysis server 3 includes, as functional units, a communication unit 41, a storage unit 42, and a control unit 43.

[0062] The communication unit 41 has the same functions and configuration as the communication unit 11 of the terminal 5 and includes a network interface 3C. The communication unit 41 performs wireless communication or wired communication with other devices (here, the relay server 4) via the communication network 6 according to a known communication protocol.

[0063] The storage unit 42 can be configured by a memory 3B and a storage device 3D. The storage unit 42 stores various programs necessary for performing work analysis, a learned learning model 42A, a video captured by the imaging device 2 (hereinafter, work video 42B), a work history database 42C, and the like.

[0064] The learning model 42A stored in the storage unit 42 may include, for example, a time acquisition model for acquiring the work time and work time distribution (pre-work, main work, and post-work) required to produce one article. In addition, the learning model 42A may include various learning models such as an efficiency calculation model for calculating work efficiency from the video captured by the imaging device 2, a stress calculation model for calculating the stress level of the worker, a work amount calculation model for calculating the work amount of the worker, and an organization degree calculation model for calculating the degree of organization of the work site S.

[0065] The work history database 42C records the work history of the worker. The work history database 42C may include, for example, a table (hereinafter, production table) in which the work time per produced item and the work time distribution required for each production are recorded, and a table of time-series data such as work efficiency, stress level, and work amount (hereinafter, time-series table). The time-series table records various time-series data including, for example, the work efficiency of the worker for each month and each time zone, the stress level of the worker for each month and each time zone, and the work amount of the worker for each month and each time zone.

[0066] The control unit 43 can be realized by the processor 3A performing processing according to the program stored in the storage unit 42. The control unit 43 includes a work analysis unit 46, a work history update unit 47, a notification evaluation unit 48, and a response acquisition unit 49.

[0067] The work analysis unit 46 performs a work analysis process of performing work analysis on the video captured by the imaging device 2 using various learning models 42A stored in the storage unit 42.

[0068] The work analysis performed by the work analysis unit 46 may include, for example, obtaining the work time and work time distribution required to produce one article. In addition, the work analysis may also include obtaining the work efficiency for each month and time period, the stress level of the workers for each month and time period, and the work volume for each month and time period. In addition, the work analysis performed by the work analysis unit 46 may include a numerical value indicating the degree of tidiness of the workbench placed in the workplace for each month and time period.

[0069] The work history update unit 47 acquires the video captured by the imaging device 2 in real time and stores it in the storage unit 42 as a work video 42B. Further, the work history update unit 47 causes the work analysis unit 46 to perform work analysis at a predetermined time or at predetermined time intervals, acquires the analysis results, and records them in the work history database 42C. Note that the work history update unit 47 may be configured to delete the work video 42B that is earlier than a predetermined time (for example, several months or more earlier) from the storage unit 42 when storing it in the storage unit 42 as the work video 42B.

[0070] Based on the analysis results obtained by the work analysis unit 46, the notification evaluation unit 48 performs a real-time evaluation of whether to notify the user of a decrease in work efficiency.

[0071] In this embodiment, the reporting evaluation unit 48 calculates a reporting evaluation value indicating the degree of reporting based on the analysis result obtained by the work analysis unit 46. The reporting evaluation value is defined to increase as the degree of reporting increases. The reporting evaluation value may be a numerical value based on the work efficiency of the worker, or may be a numerical value calculated based on the stress level of the worker or the amount of work of the worker.

[0072] In addition, the reporting evaluation unit 48 may calculate the reporting evaluation value by averaging three indicators: the current stress level of the worker, the increase rate of the worker's stress per hour, and the decrease rate of the amount of work (e.g., production quantity) of the worker per hour.

[0073] When the reporting evaluation value becomes equal to or greater than a predetermined threshold value, the reporting evaluation unit 48 transmits (i.e., outputs) a notification indicating that reporting should be performed (hereinafter referred to as a reporting notification) to the relay server 4. At this time, the reporting evaluation unit 48 may include the reporting evaluation value and the analysis result obtained by the work analysis unit 46 in the reporting notification and transmit it to the relay server 4. The analysis result included in the reporting notification may include text (e.g., numerical value of work efficiency) indicating the factors and evidence for the reporting evaluation value becoming equal to or greater than the threshold value.

[0074] Based on an analysis request from the relay server 4, the response acquisition unit 49 acquires (collects) the corresponding analysis result using the work history database 42C and outputs it to the relay server 4.

[0075] When the response acquisition unit 49 receives an analysis request from the relay server 4 to obtain the amount of work for a predetermined period, it acquires the amount of work (such as production quantity) for the corresponding period using the work history database 42C and transmits it to the relay server 4 as an analysis result. At this time, the response acquisition unit 49 may create a graph showing the analysis result, image the graph, and transmit it to the relay server 4.

[0076] When the response acquisition unit 49 receives the analysis result for obtaining the analysis of the work time distribution from the relay server 4, it uses the work history database 42C to acquire the work time of the corresponding work and the work time distribution, and transmits them to the relay server 4 as the analysis result. Note that the response acquisition unit 49 may transmit the analysis result to the relay server 4 by setting the work type (pre-work, main work, post-work) of the work and the corresponding work time.

[0077] The relay server 4 includes a computer that, as necessary, naturalizes the analysis result of the analysis server 3 via the text generation server 7 and executes the processing necessary to display the naturalized analysis result on the terminal 5. As shown in FIG. 2, the computer constituting the relay server 4 may include known hardware such as a processor 4A (CPU, MPU, etc.), a memory 4B (RAM, ROM, etc.), a display, an input device, a network interface 4C, and a storage device 4D (HDD, SSD, etc.).

[0078] As shown in FIG. 9, the relay server 4 includes, as functional units, a communication unit 51, a storage unit 52, and a control unit 53.

[0079] The communication unit 51 is constituted by the network interface 4C. The communication unit 51 performs wireless communication or wired communication with other devices (here, the terminal 5 and the text generation server 7) via the communication network 6 according to a known communication protocol.

[0080] The storage unit 52 may be constituted by the memory 4B or the storage device 4D. The storage unit 52 stores various information necessary for the processing performed by the relay server 4. The information stored in the storage unit 52 may include a response history database 52A in which the response history transmitted from the response history transmission unit 24 of the terminal 5 is recorded.

[0081] In the response history database 52A, the analysis request received and naturalized at the terminal 5, the analysis result of the analysis server 3 naturalized and displayed on the terminal 5, and the corresponding user quality evaluation value are recorded in association with each other.

[0082] Note that in the response history database 52A, the attributes of the user whose setting input has been received by the terminal 5 (setting reception unit 26) may be recorded in association with the analysis request, analysis result, and quality evaluation value.

[0083] The control unit 53 includes a transmission processing unit 61, an analysis processing unit 62, and an assist processing unit 63.

[0084] When the transmission processing unit 61 receives a transmission notification from the analysis server 3, it acquires the transmission evaluation value included in the transmission notification and the analysis result obtained by the work analysis unit 46. Then, the transmission processing unit 61 generates a prompt required to naturalize the transmission evaluation value and analysis result included in the transmission notification in the text generation server 7.

[0085] Next, the transmission processing unit 61 transmits (inputs) the generated prompt to the text generation server 7, and acquires the text in which the transmission evaluation value and analysis result are naturalized from the text generation server 7.

[0086] After that, when the transmission processing unit 61 acquires the text in which the transmission evaluation value and analysis result are naturalized from the text generation server 7, it transmits the transmission request including the text to the terminal 5, and causes the terminal 5 (transmission execution unit 21) to display a transmission screen 27 including the text 27A in which the transmission evaluation value and analysis result are naturalized (see FIG. 4).

[0087] When the analysis processing unit 62 receives an analysis request notification from the terminal 5, it generates an analysis request that specifies the content of the data to be acquired from the analysis server 3 from the analysis request notification. Then, the analysis processing unit 62 transmits the analysis request to the analysis server 3, and acquires the analysis result of the work history corresponding to the analysis request based on the work history database 42C from the analysis server 3 (response acquisition unit 49).

[0088] Furthermore, the analysis processing unit 62 acquires the analysis result of the work history from the analysis server 3, and generates a prompt required to naturalize the analysis result.

[0089] Next, the analysis processing unit 62 transmits (inputs) the generated prompt to the text generation server 7, and acquires from the text generation server 7 a text in which the analysis result corresponding to the analysis request is natural languageized.

[0090] After that, when the analysis processing unit 62 acquires a text in which the analysis result is natural languageized by the text generation server 7, the analysis processing unit 62 transmits an analysis result notification including the text to the terminal 5. As a result, the terminal 5 displays, on the display unit 13, a chat screen 29 (see FIG. 5) including the text 30 in which the analysis result is natural languageized by the result notification unit 23.

[0091] In this way, the analysis processing unit 62 generates a prompt based on the analysis result of the analysis server 3, inputs the prompt to the text generation server 7, and acquires a text natural languageized based on the prompt. By using the text generation server 7 in this way, the analysis processing unit 62 can easily natural languageize the analysis result. Also, in terms of information security, even when the text generation server 7 cannot directly access the analysis server 3 or when it is desired to prohibit the text generation server 7 from directly accessing the analysis server 3, the analysis result can be easily natural languageized.

[0092] Note that the analysis processing unit 62 may be configured to natural languageize the analysis result of the analysis server 3, or may be configured to natural languageize a prompt generated from the analysis result by itself. As a result, the analysis processing unit 62 does not need to provide the text generation server 7, and may transmit an analysis result notification including a text acquired by natural languageizing the analysis result by itself to the terminal 5.

[0093] Also, when the information related to the setting input is included in the analysis request notification transmitted from the terminal 5, the analysis processing unit 62 may transmit (input) the generated prompt to the text generation server 7 together with the information related to the setting input, and acquire a text from the text generation server 7.

[0094] Specifically, the analysis processing unit 62 requests the text generation server 7 to answer based on the user attributes included in the setting information 14A, and acquires the text indicating the analysis result along with the user attributes. Further, the analysis processing unit 62 requests the text generation server 7 to answer in consideration of the formality degree of the set answer sentence, and acquires the text indicating the analysis result conforming to the set formality degree.

[0095] Based on the analysis result acquired by the analysis processing unit 62, the assist processing unit 63 refers to the answer history database 52A, and acquires, as analysis request candidates, one or more analysis requests to be proposed based on the information set in the setting information 14A.

[0096] The assist processing unit 63 may refer to the answer history database 52A, preferentially select (also referred to as extract) the frequently requested (highly requested) analysis requests, and acquire the selected analysis requests as analysis request candidates. Further, when the information related to the setting input is included in the analysis request notification transmitted from the terminal 5, the assist processing unit 63 may determine the number of analysis requests to be extracted based on the setting information 14A. In addition, the assist processing unit 63 may select the analysis results similar to the immediately previous analysis results from the answer history database 52A, and select a plurality of the next analysis requests and acquire them as analysis request candidates. Further, the assist processing unit 63 may refer to the answer history database 52A and acquire analysis request candidates based on the quality threshold of the input example 33 included in the setting information 14A, the quality evaluation value, etc.

[0097] Next, the flow until the reporting screen 27 is displayed on the terminal 5 in the work analysis system 1 will be described. FIG. 10 is a sequence diagram showing the flow of the reporting notification process in the work analysis system 1.

[0098] As shown in FIG. 10, the analysis server 3 acquires the imaging result (that is, the imaging video) from the imaging device 2 in real time (S101), and stores it in the storage unit 52 as the work video 42B (S102).

[0099] Next, the analysis server 3 calculates a reporting evaluation value indicating the work efficiency based on the work video 42B (imaging result) of the imaging device 2, and determines whether it is equal to or greater than a threshold value (S103). When it is determined that the reporting evaluation value is equal to or greater than the threshold value, the analysis server 3 sends a reporting notification to the relay server 4 (S104). When it is determined that the reporting evaluation value is less than the threshold value, the analysis server 3 acquires the imaging result from the imaging device 2 again, stores it as the work video 42B in the storage unit 52, calculates the reporting evaluation value, and compares it with the threshold value.

[0100] When the relay server 4 receives the reporting notification from the analysis server 3, it acquires various analysis data as the reporting evaluation value included in the reporting notification and the analysis result obtained by the analysis server 3. Then, the reporting processing unit 61 generates a prompt required to naturalize the reporting evaluation value and the analysis result in the text generation server 7 (S105).

[0101] When the generation of the prompt is completed in the relay server 4, the relay server 4 sends the prompt to the text generation server 7 (S106). When the text generation server 7 acquires the prompt from the relay server 4, it generates a text in which the reporting evaluation value and the analysis result are naturalized (S107), and sends the generated text to the relay server 4 (S108).

[0102] When the relay server 4 receives (acquires) the text in which the reporting evaluation value and the analysis result are naturalized from the text generation server 7, it sends a reporting request to the terminal 5 (S109). When the terminal 5 acquires the reporting request, it displays a reporting screen 27 including the reporting evaluation value and the analysis result naturalized in the display unit 13 (S110).

[0103] When the work efficiency of the operator decreases, based on the reporting notice from the analysis server 3, the relay server 4 generates a prompt (see Fig. 10) that clearly explains the analysis results, such as "Operator A, working time: 15 minutes, degree of tidiness: 40%", and sends it to the text generation server 7. Based on the sent prompt, the text generation server 7 generates text such as "The work efficiency of Operator A is decreasing. Currently, it takes 15 minutes for Operator A to produce one item. The degree of tidiness of the work desk is 40%." (see Fig. 4), and the terminal 5 displays the generated text.

[0104] In this way, through the reporting process performed by the relay server 4, the reporting notice from the analysis server 3 is natural languageized, and the natural languageized analysis results are displayed on the terminal 5. Therefore, it becomes possible to notify the user of the work analysis results in an easy-to-understand manner.

[0105] Next, the process from when an input is received in the input field 28 of the reporting screen 27 or the chat screen 29 on the terminal 5 to when the analysis results are displayed in the work analysis system 1 will be described. Fig. 11 is a sequence diagram showing the flow of the analysis process in the work analysis system 1.

[0106] When an input is made in the input field 28 of the reporting screen 27 or the chat screen 29 by the user and an analysis request is received, the terminal 5 sends an analysis request notice to the relay server 4 (S201).

[0107] When the relay server 4 receives (acquires) the analysis request notice from the terminal 5, it performs text analysis, etc., and acquires an analysis request (a request regarding the collection range of analysis data, etc.) for querying the analysis server 3 (S202). After that, when the relay server 4 acquires the analysis request, it sends the analysis request to the analysis server 3 (S203).

[0108] When the analysis server 3 receives (acquires) the analysis request, it refers to the work history database 42C, performs the corresponding analysis (S204), and sends the analysis results of the work history to the relay server 4 (S205).

[0109] When the relay server 4 obtains the analysis result, it generates a prompt required to naturalize the analysis result (S206). When the generation of the prompt is completed, the relay server 4 transmits (inputs) the prompt to the text generation server 7 as necessary (S207).

[0110] When the text generation server 7 receives the prompt corresponding to the analysis result from the relay server 4, it generates a text obtained by naturalizing the corresponding analysis result (S208) and transmits it to the relay server 4 (S209).

[0111] The relay server 4 generates an analysis result notification including the text transmitted from the relay server 4 (S210). When the generation of the analysis result notification is completed, the relay server 4 transmits the generated analysis result notification to the terminal 5 (S211). When the terminal 5 obtains the analysis result notification, it displays a reporting screen 27 (see FIG. 5) or a chat screen 29 (see FIG. 6) including the text 30 in which the analysis result is naturalized (S212).

[0112] When "Tell me the time distribution when it takes the most time to produce one piece" is input (the analysis request is received) in the input field 28, the relay server 4 obtains the corresponding time distribution from the analysis server 3, generates a prompt to clearly explain the analysis result such as "Previous work: 8 minutes, main work: 10 minutes, subsequent work: 4 minutes" (see FIG. 10), and transmits it to the text generation server 7. The text generation server 7 generates a text such as "It takes 8 minutes for the previous work, 10 minutes for the main work, and 4 minutes for the subsequent work" based on the transmitted prompt, and the terminal 5 displays the generated text (see FIGS. 5 and 6).

[0113] At this time, the analysis server 3 may obtain other analysis results and improvement methods and transmit them to the relay server 4. As a result, in addition to the allocated time for each task, the terminal 5 may display messages such as "The main working time of worker A is getting longer. Workplace organization is effective." For example, when an input such as "Is the production quantity this month increasing?" is made in the input field 28, the analysis server 3 performs corresponding predictions and analyses, and the terminal 5 may display messages such as "The production quantity in August is increasing and shows an upward trend. It is predicted that the production quantity in August will exceed the production quantity in July by more than 120 pieces."

[0114] In this way, through the analysis notification process performed by the relay server 4, the analysis results of the work history by the analysis server 3 for the analysis request are naturalized, and the naturalized analysis results are displayed on the terminal 5. Therefore, it becomes possible to notify the user of the work analysis results in an easy-to-understand manner.

[0115] When the relay server 4 notifies the terminal 5 of the analysis results of the work history, at the same time, it causes the terminal 5 to display the input field 32 for the quality evaluation value for the analysis results and obtain the quality evaluation value. When the quality evaluation value is input on the terminal 5, it is transmitted to the relay server 4 (S213). The relay server 4 records the received quality evaluation value, together with the analysis request and the analysis results, as a response history in the response history database 52A and stores it in the storage unit 52 (S214).

[0116] In addition, when the relay server 4 receives an analysis request on the terminal 5, it appropriately obtains, as analysis request candidates, the analysis requests to be proposed based on the response history recorded in the response history database 52A (S215). At this time, when the relay server 4 receives a setting input including the user's attributes, etc. on the terminal 5, it obtains them as analysis request candidates based on the setting input and the response history. When the acquisition of the analysis request candidates is completed, the relay server 4 transmits the acquired analysis request candidates to the terminal 5 (S216).

[0117] When the terminal 5 acquires analysis request candidates, it displays the analysis request candidates on the display unit 13. In this way, by displaying the analysis request candidates, the terminal 5 proposes the analysis requests to be input and assists the input related to the user's analysis requests (S217).

[0118] At this time, as shown in FIG. 6, the terminal 5 obtains the average value of the quality evaluation values given in the past similar analysis requests for the analysis request candidates, and displays the average quality evaluation value 32A (the number of stars, numerical values, etc.). Note that when acquiring the analysis request candidates, the relay server 4 may display the analysis request candidates and the average quality evaluation value 32A according to the setting of the quality of the question sentence to be proposed (the input field 35D related to the quality threshold in FIG. 7).

[0119] In this way, by causing the terminal 5 to display the analysis requests to be proposed based on the answer history as analysis request candidates, the possibility of obtaining high-quality answers is increased. In addition, it becomes possible to propose candidates to the user. Further, since the relay server 4 acquires them as analysis request candidates based on the setting input including the user's attributes, it can propose analysis request candidates according to the user's attributes (for example, the user's position). In addition, since the answer history recorded in the answer history database 52A includes quality evaluation values, the quality of the work analysis performed by the analysis server 3 and the quality of the analysis requested from the relay server 4 to the analysis server 3 can be improved using these quality evaluation values.

[0120] In the above embodiment, an example in which the terminal 5 is configured by a tablet terminal has been described. However, the terminal 5 is not limited to a tablet terminal, and the terminal 5 may be any information device having a communication function such as a smartphone or a notebook PC. FIG. 11(A) shows an example of the chat screen 29 when the terminal 5 is configured by a smartphone. FIG. 11(B) shows the setting reception screen 34 when the terminal 5 is configured by a smartphone. In FIG. 11(A), when it is necessary to illustrate data as a graph or the like as an answer, a link to an image in which the graph is illustrated is attached to the answer.

[0121] As described above, embodiments have been described as examples of the technology disclosed in the present application. However, the technology in the present disclosure is not limited to this, and can also be applied to embodiments with changes, replacements, additions, omissions, etc. Further, it is also possible to form a new embodiment by combining the respective components described in the above embodiments.

[0122] So far, an example of applying a work analysis system that can use image recognition and speech recognition technologies and notify with text in which the recognition result is natural languageized to a work analysis system for performing work analysis at a work site has been described. However, the application range of the analysis system is not limited to the work analysis system.

[0123] The analysis system can also be applied to, for example, an abnormality detection system that analyzes a captured image of a monitoring area on the road and detects and notifies an abnormality such as a traffic accident.

[0124] In addition, the analysis system can be applied to a police work support system, a monitoring system for stations, airports, commercial facilities, public facilities, construction sites, etc., and a highway management system. The analysis system can further be applied to an education support system that analyzes the behavior of students and supports the improvement of classes, etc., a medical support system that analyzes the behavior of doctors, nurses, etc. and supports the improvement of medical work, a care support system that analyzes the behavior of the elderly and supports the improvement of care work, a skill improvement support system that analyzes the behavior of athletes and supports skill improvement, and the like.

Industrial Applicability

[0125] The work analysis system and work analysis method according to the present disclosure enable easy notification of the result of work analysis, and are useful as a work analysis system and work analysis method for analyzing the work of workers and notifying the analysis result to users.

Explanation of Signs

[0126] 1: Work analysis system 2: Imaging device 2A: Camera 3: Analysis Server 3A: Processor 3B: Memory 3C: Network Interface 3D: Storage Device 4: Relay Server 4A: Processor 4B: Memory 4C: Network Interface 4D: Storage Device 5: Terminal 5A: Processor 5B: Memory 5C: Network Interface 5D: Storage Device 5E: Touch Panel Display 6: Communication Network 7: Article Generation Server 7A: Processor 7B: Memory 7C: Network Interface 7D: Storage Device 11: Communication Unit 12: Operation Input Unit 13: Display Unit 14: Memory Unit 14A: Setting Information 15: Control Unit 21: Transmission Execution Unit 22: Analysis Request Reception Unit 23: Result Notification Unit 24: Answer History Transmission Unit 25: Input Assist Unit 26: Setting Reception Unit 27: Transmission Screen 27A: Text 27B: Setting Button 28: Input Field 29: Chat Screen 30: Text 31: Graph 32: Input Field 33: Input Example 34: Setting Reception Screen 35: Input field 35A: Input field 35B: Input field 35C: Input field 35D: Input field 36: Setting save button 41: Communication unit 42: Memory unit 42A: Learning model 42B: Working video 42C: Work history database 43: Control unit 46: Work analysis unit 47: Work history update unit 48: Transmission evaluation unit 49: Answer acquisition unit 51: Communication unit 52: Memory unit 52A: Answer history database 53: Control unit 61: Transmission processing unit 62: Analysis processing unit 63: Assist processing unit S: Work site

Claims

1. A work analysis system that analyzes the work of an operator and notifies the user of the analysis results, comprising: An imaging device that images the work site; An analysis server that performs analysis based on the imaging results of the imaging device; A terminal that displays the analysis results obtained by the analysis server to the user; A relay server that naturalizes the analysis results of the analysis server and causes the terminal to display the naturalized analysis results, and a work analysis system comprising the relay server.

2. The work analysis system according to claim 1, wherein the relay server generates a prompt including the analysis results, inputs the prompt to a text generation server that naturalizes the prompt based on the prompt and outputs the result as text, thereby naturalizing the analysis results of the analysis server.

3. The analysis server calculates an evaluation value indicating the work efficiency of the operator based on the imaging results from the imaging device, and when the evaluation value is equal to or less than a predetermined threshold value, outputs a reporting notification to the relay server. The work analysis system according to claim 1, wherein when the relay server acquires the reporting notification, the relay server naturalizes the analysis results of the analysis server and causes the terminal to display the naturalized decrease in work efficiency.

4. The work analysis system further includes a work history database in which the work history of the operator is recorded. The relay server: Acquires a request notification for making an analysis request for the work history from the terminal to the analysis server; Based on the acquired request notification, acquires the analysis results of the work history corresponding to the request notification based on the work history database from the analysis server, naturalizes the analysis results acquired from the analysis server, and causes the terminal to display the naturalized analysis results of the work history. The work analysis system according to claim 1.

5. The work analysis system according to claim 4, wherein the relay server causes the terminal to notify the user of the analysis results of the work history, causes the terminal to acquire a quality evaluation value input by the user for the analysis results, and stores the request notification, the naturalized analysis results, and the quality evaluation value together as a response history.

6. The work analysis system according to claim 5, wherein when the relay server acquires the request notification from the terminal, the relay server causes the terminal to present candidates for the analysis request based on the response history.

7. The relay server: Cause a setting screen for receiving a setting input including the attributes of the user to be displayed on the terminal. The work analysis system according to claim 6, wherein the candidate for the analysis request to be displayed on the terminal is selected based on the setting input received on the setting screen and the answer history. **Claim 8** A work analysis method for analyzing the work of a worker and notifying the user of the analysis result, comprising: An imaging device that images the worker; An analysis server that performs analysis based on the imaging result of the imaging device; A terminal that displays the analysis result obtained by the analysis server to the user; A relay server connected to the terminal and the analysis server, and is executed by a work analysis system including the relay server. A work analysis method in which the relay server naturalizes the analysis result of the analysis server and causes the terminal to display the naturalized analysis result.

Images