Process management system, device and method

Abstract

The embodiment of the invention provides a process management system, device and method, and the method comprises an input module which is configured to input identification information matched with an operator; the acquisition module is configured to acquire process information of the operator in executing the target operation, and the process information is configured to reflect the completion condition of the operator on the target operation; the storage module is configured to match the process information with the identification information and store the process information and the identification information; and the supervision module is configured to generate evaluation information of the target operation executed by the operator corresponding to the identification information based on the process information.

Description

Technical Field

[0001] This specification relates to the field of engineering intelligent management, and particularly to a process management system, device, and method. Background Art

[0002] During the progress of various projects, it is often the workers themselves or relevant management personnel who record the work situation. However, due to reasons such as high supervision costs and great supervision difficulties, there are often situations of missing records, false records, or chaotic records when recording the work situation, which do not match the actual work situation of the workers, resulting in the enterprise being unable to carry out orderly production and processing, extending the construction period, and incurring costs.

[0003] Therefore, it is hoped to provide a process management system, device, and method that can automatically supervise the situation of workers during work, reduce supervision costs, improve supervision efficiency, and prevent bad behaviors in project production on the basis of ensuring the supervision intensity. Summary of the Invention

[0004] One or more embodiments of this specification provide a process management system. The process management system includes: an input module configured to input identification information matching the operator; a collection module configured to obtain process information of the operator during the execution of a target operation, where the process information is configured to reflect the completion situation of the operator for the target operation; a storage module configured to match and store the process information with the identification information; and a supervision module configured to generate evaluation information of the target operation executed by the operator corresponding to the identification information based on the process information.

[0005] One embodiment of this specification provides a process management device, which includes an input device, a recording device, a storage device, and a processor; the input device is configured to input identification information matching the operator; the recording device is configured to obtain process information of the operator during the execution of a target operation; the storage device is configured to match and store the process information with the identification information; and the processor is configured to generate evaluation information of the target operation executed by the operator corresponding to the identification information based on the process information.

[0006] One or more embodiments of this specification provide a process management method, which includes: inputting identification information matching the operator; obtaining process information of the operator during the execution of a target operation; matching and storing the process information with the identification information; and generating evaluation information of the target operation executed by the operator corresponding to the identification information based on the process information. Brief Description of the Drawings

[0007] This specification will be further described by way of exemplary embodiments, which will be described in detail with reference to the accompanying drawings. These embodiments are not restrictive. In these embodiments, the same reference numerals represent the same structures, where:

[0008] Figure 1 is a schematic diagram of an application scenario of a process management system according to some embodiments of this specification;

[0009] Figure 2 is an exemplary module diagram of a process management system according to some embodiments of this specification;

[0010] Figure 3 is an exemplary flowchart of a process management method according to some embodiments of this specification;

[0011] Figure 4 is an exemplary flowchart of determining an efficiency evaluation result according to some embodiments of this specification;

[0012] Figure 5 is an exemplary flowchart of generating and displaying guiding information according to some embodiments of this specification. Detailed Implementation Manner

[0013] To more clearly illustrate the technical solutions of the embodiments of this specification, the accompanying drawings required for the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some examples or embodiments of this specification. For those of ordinary skill in the art, without creative efforts, this specification can also be applied to other similar scenarios based on these drawings. Unless obvious from the language context or otherwise stated, the same reference numerals in the figures represent the same structures or operations.

[0014] It should be understood that the "system", "device", "unit" and / or "module" used herein is a way to distinguish different components, elements, parts, portions or assemblies at different levels. However, if other words can achieve the same purpose, the said words can be replaced by other expressions.

[0015] As shown in this specification and the claims, unless the context clearly indicates an exception, words such as "a", "an", "one" and / or "the" are not specifically singular and may also include the plural. Generally speaking, the terms "comprising" and "including" only indicate the inclusion of the clearly identified steps and elements, and these steps and elements do not constitute an exclusive list. The method or device may also include other steps or elements.

[0016] In this specification, flowcharts are used to illustrate the operations performed by the system according to the embodiments of this specification. It should be understood that the preceding or subsequent operations do not necessarily have to be executed precisely in sequence. On the contrary, the steps can be processed in reverse order or simultaneously. At the same time, other operations can also be added to these processes, or one or more steps can be removed from these processes.

[0017] Figure 1 It is a schematic diagram of the application scenario of the process management system shown in some embodiments of this specification.

[0018] As Figure 1 shown, the application scenario 100 of the process management system may include an operator 110, an input device 120, a recording device 130, a storage device 140, and a processor 150. Before and after performing the target operation, the operator 110 can enter the identification information matching the operator on the input device 120. The recording device 130 can record the process of the operator 110 performing the target operation to obtain process information. The storage device 140 can match and store the process information with the identification information. The processor 150 can generate evaluation information of the target operation performed by the operator corresponding to the identification information based on the process information. For more descriptions of the above content, reference can be made to the following text of this specification. Data transmission between the various components in the foregoing process management system can be achieved through the network 170.

[0019] The operator 110 is the person to be supervised. For example, the operator 110 can be workers at various links on the production line, workers responsible for inspection and assembly in the factory, etc. For more content about the operator, reference can be made to Figure 2 and its related descriptions.

[0020] The input device 120 is a device for entering identification information matching the operator 110. The input device 120 can be one or more of a tablet computer, virtual reality glasses, a smart watch, a recorder, etc. The operator 110 can enter the identification information through the input device 120. For example, the operator 110 can enter the identification information through the input device 120 before and after performing the target operation. The identification information can be iconic information corresponding one-to-one to the operator. For example, the identification information can include one or more of the operator's fingerprint, face information, work number, iris, etc. Correspondingly, the input device 120 is a device that can enter one or more of the operator's fingerprint, face information, work number, iris, etc.

[0021] The recording device 130 is a device for recording relevant information during the operator 110's execution of the target operation. The recording device 130 can obtain the process information of the operator during the execution of the target operation. The process information can be one or more of video information, image information, and audio information. Correspondingly, the recording device 130 can be one or more of an image acquisition device (e.g., a camera, a video camera, etc.) and a sound acquisition device.

[0022] In some embodiments, the input device 120 and the recording device 130 can be provided on different devices. For example, the input device 120 can be a fingerprint clock-in machine, and the recording device 130 can be a recorder. In some embodiments, the input device 120 and the recording device 130 can also be integrated into the same device. Exemplarily, a virtual reality glasses capable of fingerprint recognition can include the input device 120 and the recording device 130. Before performing the target operation, the operator 110 can first enter the identification information (e.g., iris) in the virtual reality glasses, then wear the virtual reality glasses to capture the process information during the execution of the target operation. After the operator 110 completes the target operation, the virtual reality glasses can be removed and operated to complete the recording.

[0023] The storage device 140 can store relevant data and / or instructions of the process management system or other data sources outside the process management system. For example, the storage device 140 can store the identification information from the input device 120 and the process information from the recording device 130, and store them after matching the two. For another example, the storage device 140 can also store the evaluation results from the processor 150. The storage device 140 can include one or more storage components, and each storage component can be an independent device or a part of other devices. In some embodiments, the storage device 120 can include a random access memory (RAM), a read-only memory (ROM), a mass storage device, a removable storage device, a volatile read-write memory, etc., or any combination thereof. Exemplarily, the mass storage device can include a magnetic disk, an optical disk, a solid-state disk, etc. In some embodiments, the storage device 140 can also store the data and / or instructions used or executed by the processor 150 to complete the exemplary methods described in this specification.

[0024] The processor 150 processes data and / or information obtained from other data sources or other components of the process management system. The processor 150 may execute program instructions based on such data, information, and / or processing results to perform one or more functions described in this specification. For example, the processor 150 may generate evaluation information identifying the target operations performed by the operator corresponding to the identification information based on the process information. In some embodiments, the processor 150 may include one or more sub-processing devices (e.g., a single-core processing device or a multi-core multi-chip processing device).

[0025] The terminal 160 refers to one or more terminal devices or software used by the user. The aforementioned user may be the manager of the process management system. For example, it may be the manager of the corresponding project. The terminal 160 may be one or any combination of other devices with input and / or output functions such as mobile devices, tablet computers, laptop computers, desktop computers, etc. The user may view relevant data in the process management system through the terminal, such as evaluation information, identification information, and process information, etc.

[0026] The network 170 may connect the components of the process management system and / or connect the process management system with other data sources. The network 170 enables communication between the components of the process management system and between the process management system and other parts outside the system, facilitating the exchange of data and / or information. In some embodiments, the network 170 may be any one or more of a wired network or a wireless network. For example, the network 170 may include, but is not limited to, cable networks, fiber optic networks, telecommunication networks, the Internet, local area networks, wide area networks, wireless local area networks, in-device buses, in-device lines, cable connections, etc., or any combination thereof. The network connections between various parts may be in one of the above ways or in multiple ways. In some embodiments, the network may be of various topological structures such as point-to-point, shared, centralized, etc., or a combination of multiple topological structures.

[0027] It should be noted that the application scenario 100 of the process management system is provided for illustrative purposes only and is not intended to limit the scope of this specification. For those of ordinary skill in the art, various modifications or changes can be made according to the description of this specification. For example, the application scenario 100 of the process management system may also include databases, information sources, etc. Again, for example, one or more components in the application scenario 100 of the process management system may be set in the same device. Also, for example, the application scenario 100 of the process management system may be implemented on other devices to achieve similar or different functions. However, the changes and modifications will not deviate from the scope of this specification.

[0028] Figure 2 is an exemplary module diagram of a process management system shown according to some embodiments of this specification.

[0029] The process management system 200 can be used to monitor the operator 110, record relevant information when the operator 110 performs the target operation, and evaluate it.

[0030] As Figure 2 shown, the process management system 200 may include an input module 210, a collection module 220, a storage module 230, and a supervision module 240. By way of example only, the input module 210 may be implemented by the input device 120, the collection module 220 may be implemented by the recording device 130, the storage module 230 may be implemented by the storage device 140, and the supervision module 240 may be implemented by the processor 150.

[0031] The input module 210 may be configured to input identification information matching the operator. In some embodiments, the input module 210 may further be configured to receive first input information input by the operator corresponding to the identification information when starting to perform the target operation and second input information input by the operator when ending the execution of the target operation.

[0032] The collection module 220 is configured to obtain the process information of the operator during the execution of the target operation, and the process information is configured to reflect the completion of the target operation by the operator.

[0033] The storage module 230 is configured to match and store the process information with the identification information. In some embodiments, the storage module 230 is further configured to respectively match time stamps for the process information, the first input information, and the second input information, and store them in the blockchain. In some embodiments, the storage module 230 is further configured to: based on the time stamp of the process information and the time stamps of the first input information and the second input information, determine the start time difference and the end time difference; determine whether both the start time difference and the end time difference are within a preset difference range, and if so, determine that the records are consistent, and store the time-stamped process information, the time-stamped first input information, and the time-stamped second input information in the blockchain; if not, determine that the records are inconsistent and send a reminder message to the terminal.

[0034] The supervision module 240 is configured to generate evaluation information of the target operation performed by the operator corresponding to the identification information based on the process information. In some embodiments, the evaluation information includes an efficiency evaluation result when the operator performs the target operation. The supervision module 240 is further configured to determine an effective operation duration when the operator performs the target operation based on the process information; determine a total operation duration of the target operation based on the first input information and the second input information; and determine the efficiency evaluation result based on the total operation duration and the effective operation duration. In some embodiments, the process information includes video information. The supervision module 240 is further configured to determine a plurality of operation frames when the operator performs the target operation based on the video information; determine a plurality of effective operation frames among the plurality of operation frames; determine at least one effective operation time period when the operator performs the target operation based on the plurality of effective operation frames; and determine the effective operation duration based on the at least one effective operation time period. In some embodiments, the evaluation information includes an operation score, and the target operation includes a plurality of target sub-operations. The supervision module 240 is further configured to determine a sub-operation score of each target sub-operation in the target operation based on the process information; and determine the operation score based on the sub-operation scores of the respective target sub-operations. In some embodiments, the evaluation information includes a completion evaluation result of the operator performing the target operation, and the target operation includes a plurality of target sub-operations. The supervision module 240 is further configured to: determine at least one target sub-operation in the target operation and the completion status of each target sub-operation based on the process information, where the completion status includes a completed operation and an uncompleted operation; and determine the completion evaluation result based on the number of completed operations and uncompleted operations in the target operation.

[0035] In some embodiments, the process management system 200 may further include a guidance module and a display module (not shown in the figure). The guidance module may be implemented by a processor (e.g., Figure 1 the processor 150 shown). The display module may be implemented by a display device disposed in front of the operator when performing the target operation. The guidance module is configured to continuously obtain the sub-process information collected by the acquisition unit when the operator performs the target operation; determine the type of the current target sub-operation based on the sub-process information; determine the target operation proficiency of the operation object for the target sub-operation of this type based on the type of the current target sub-operation; generate guidance information for the current target sub-operation when the target operation proficiency meets a preset guidance condition; and the display module is configured to display the guidance information to the operator.

[0036] It should be understood,Figure 2 The system and its modules shown can be implemented in various ways. It should be noted that the above description of the process management system 200 and its modules is only for convenience of description and does not limit this specification to the scope of the examples given. It can be understood that for those skilled in the art, after understanding the principle of the system, they may, without departing from this principle, make any combination of the modules, or form a subsystem and connect it with other modules. In some embodiments, Figure 2 the input module 210, the acquisition module 220, the storage module 230, and the supervision module 240 disclosed in can be different modules in a system, or a module can implement the functions of two or more of the above modules. For example, each module can share a storage module, or each module can have its own storage module respectively. Such variations are all within the protection scope of this specification.

[0037] Figure 3 is an exemplary flowchart of a process management method according to some embodiments of this specification. In some embodiments, the process 300 can be executed by the process management system 200. As Figure 3 shown, the process 300 includes the following steps.

[0038] Step 310, enter the identification information of the operator. In some embodiments, step 310 can be executed by the input module 210.

[0039] Before performing the target operation, the operator can enter the matching identification information through the input module 210 (for example, the input device 120 as Figure 1 shown). For more information about the identification information and the input device, reference can be made to Figure 3 and its related descriptions.

[0040] The target operation can refer to the work tasks that the operator needs to perform. The target operations performed by different operators may be the same or different. For example, one operator is an assembler, and the target operation performed by him is to assemble the product, and another operator is an inspector, and the target operation performed by him can be to inspect the product. In some embodiments, the target operation can include multiple target sub-operations. The foregoing multiple target sub-operations can be the same. For example, the target operation can include inspecting multiple identical products, where each target sub-operation is to inspect one product. The multiple target sub-operations in the target operation can also be different. For example, the target operation can include assembling one product, where each target sub-operation is to assemble one component.

[0041] In some embodiments, the input module 210 may further receive first input information related to the start of the target operation by the operator and second input information related to the end of the target operation.

[0042] The first input information and the second input information may respectively refer to the data information when the operator starts and ends the target operation. The first input information at least includes the time when the operator starts the target operation, and the second input information at least includes the time when the operator ends the target operation. The input module 210 can be generated in various ways. For example, when the operator enters identification information at the start and end of the target operation, the input module 210 can obtain the input time and correspondingly generate the first input information and the second input information. For another example, before starting the operation, the operator can also enter the target operation to be performed on the input device and click "Start Operation" on the input device, and click "End Operation" on the input device after the operation ends. The first input information and the second input information are generated based on the time when the operator clicks the corresponding option.

[0043] Step 320: Obtain the process information of the operator during the execution of the target operation. In some embodiments, step 320 may be executed by the acquisition module 220.

[0044] The process information refers to the information recording the operator's execution of the target operation. The process information is one or more of video information, image information, and audio information. For example, the acquisition module 220 can continuously take pictures to obtain the video information of the operator during the execution of the target operation. For another example, the acquisition module 220 can also continuously record audio to obtain the audio information of the operator during the execution of the target operation. For yet another example, the acquisition module 220 can also take pictures at a preset first acquisition frequency to obtain the image information of the operator during the execution of the target operation.

[0045] In some embodiments, the acquisition module 220 may include an acquisition unit. The aforementioned acquisition unit can be used to acquire the process information of the operator during the execution of the target operation.

[0046] In some embodiments, the operator can control the recording device for acquisition. For example, the operator can click "Start Acquisition" on the recording device to start acquisition and click "End Acquisition" on the recording device after the operation ends to complete the acquisition.

[0047] In some embodiments, the acquisition module 220 can also automatically control the acquisition. In some embodiments, the acquisition module 220 can obtain scene images at a preset second acquisition frequency, analyze and process the scene images, and start the acquisition when a first preset object appears in the scene images. The aforementioned scene images are images obtained by the acquisition module 220 taking pictures of the current scene. The first preset object can be a preset image related to the target operation. When the first preset object appears, it can indicate that the operator starts to perform the target operation. For example, the first preset object can be a tool or component required for a certain target operation. The acquisition module 220 can input the scene image and the three-dimensional model of the first preset object into the first image analysis model. The output of the first image analysis model can be a judgment result on whether the first preset object is included. The first image analysis model can be a convolutional neural network model, a deep learning model, or any other machine learning model that can achieve its function. The first image analysis model can be trained by a first training sample with a first training label. The first training sample can include a sample scene image and the three-dimensional model of the sample object. The first training label can include a judgment result on whether the sample object is included in the sample scene image. The aforementioned sample scene image can be obtained by taking pictures, the three-dimensional model of the sample object can be obtained by modeling the sample object, and the first training label can be obtained by manual annotation. Some embodiments of this specification process the scene image and the three-dimensional model of the first preset object through the first image analysis model, so that the first preset object can be recognized from the scene image regardless of its angle, ensuring that the acquisition module 220 can perform the acquisition automatically and avoiding omission. In some embodiments, when the acquisition module 220 acquires process information, it can continue to obtain scene images at the second acquisition frequency, analyze and process the scene images, and end the acquisition when the disappearance time of the first preset object in the scene image exceeds the first preset duration.

[0048] Some embodiments of this specification analyze and process the scene images, ensuring that the acquisition module 220 can perform the acquisition automatically, simplifying the operations of the operator, and improving the accuracy of the content acquired by the acquisition module 220.

[0049] In some embodiments, the acquisition module 220 may further include a positioning unit, and the foregoing positioning unit may acquire the current position of the recording device 130. The acquisition module 220 may position the recording device 130 at a preset frequency through the positioning unit to determine the position information of the recording device 130; when the foregoing position information is within the preset range, the acquisition unit continues to record the operator's execution of the target operation, and when the foregoing position information is outside the preset range, the acquisition unit pauses the recording of the operator's execution of the target operation. The foregoing preset range is the position range where the operator who has pre-set the device executes the target operation. For example, a range with a certain point as the center and a radius of 5 m.

[0050] Some embodiments of this specification simplify the control of the recording device 130 by the operator while avoiding the recording device 130 capturing content that involves the privacy of the operator and leaks secrets by positioning the recording device 130 to determine whether the recording device 130 needs to record.

[0051] Step 330, match the process information with the identification information and store it. In some embodiments, step 330 may be executed by the storage module 230.

[0052] In some embodiments, the storage module 230 may receive the process information obtained by the acquisition module 220 and the identification information obtained by the input module 210, and match and store the process information with the identification information. Exemplarily, when the input module 210 and the recording module 220 are provided in the same device (for example, a recorder), the storage module 230 may determine the data sources and acquisition times of the process information and the identification information, and match and store the process information and the identification information with the same data source and an acquisition time less than the second preset duration.

[0053] In some embodiments, the storage module 230 may further receive the first input information input by the operator corresponding to the identification information when starting to execute the target operation and the second input information input by the operator when ending the execution of the target operation, and match timestamps for the process information, the first input information, and the second input information that match the identification information. When the process information is image information, the storage module 230 may match a timestamp for the shooting time of the image information. When the process information is video information and / or audio information, the storage module 230 may match timestamps for the start and end of recording of the video information and / or audio information. The storage module 230 may match timestamps for the generation times of the first input information and the second input information.

[0054] In some embodiments, the storage module 230 may store the process information, the first input information, and the second input information that match the identification information in the blockchain to prevent them from being tampered with. Exemplarily, the storage module 230 is connected to a database to store at least the process information, the first input information, and the second input information with timestamps in the database, and the aforementioned database may be a distributed database of the blockchain. In some embodiments, the storage module 230 may directly store the process information, the first input information, and the second input information that match the identification information in the blockchain.

[0055] In some embodiments, the storage module 230 may also directly analyze and process the process information, the first input information, and the second input information that match the identification information, determine whether the records are consistent, and then determine whether to store them in the blockchain.

[0056] In some embodiments, the storage module 230 may determine a start time difference based on the timestamp of the process information and the timestamp of the first input information. The start time difference is the difference between the time when the operator starts to perform the target operation in the process information and the time when the operator starts to perform the target operation in the first input information. For example, when the process information is audio information or video information, the storage module 230 may determine the time difference between the timestamp of the first image information obtained by the acquisition module 220 and the timestamp of the first input information based on the timestamp of the start of recording and the timestamp of the first image audio information or video information, and determine the start time difference. Correspondingly, the storage module 230 may also determine an end time difference based on the timestamp of the process information and the timestamp of the second input information. The end time difference is the difference between the time when the operator ends the target operation in the process information and the time when the operator ends the target operation in the second input information.

[0057] In some embodiments, the storage module 230 may determine whether both the start time difference and the end time difference are within a preset difference range (for example, 10 minutes). If so, it is determined that the records are consistent, and the process information with timestamp, the first input information with timestamp, and the second input information with timestamp are stored in the blockchain; if not, it is determined that the records are inconsistent, and a reminder message is sent to the terminal (for example, Figure 1 the terminal 160 shown). The reminder message is an information reminding the operator that there is a difference in the time of performing the target operation recorded by the process information. The aforementioned reminder message may be at least one of a text message and an image message. For example, the reminder message may be "The work record of an employee is abnormal, please handle it".

[0058] It can be understood that when both the start time difference and the end time difference are within the preset difference range, it indicates that the times recorded by the operator and the acquisition module 220 for performing the target operation are basically the same, so storage can be performed; when at least one of the start time difference and the end time difference is not within the preset difference range, it indicates that there is a difference in the times recorded by the operator and the acquisition module 220 for performing the target operation. Therefore, the supervisor can be reminded through a reminder message to handle it. For example, manual discrimination can be performed, and further operations can be carried out based on the discrimination result.

[0059] Some embodiments of this specification can determine whether there is false or disorderly recording in the work records of the operator by judging the start time difference and the end time difference, strengthen the supervision of the operator, and ensure the orderly progress of the project.

[0060] Step 340: Generate evaluation information corresponding to the target operation performed by the operator based on the process information. In some embodiments, step 340 can be executed by the supervision module 240.

[0061] The evaluation information can be the result of evaluating various aspects of the performed target operation.

[0062] In some embodiments, the evaluation information can include the efficiency evaluation result when the operator performs the target operation. The supervision module 240 can determine the effective operation duration when the operator performs the target operation based on the process information; determine the total operation duration of the target operation based on the first input information and the second input information; and determine the efficiency evaluation result based on the total operation duration and the effective operation duration. For more content about the above embodiments, reference can be made to Figure 4 and its related descriptions.

[0063] In some embodiments, the evaluation information can also include the completion degree evaluation result of the operator performing the target operation. The supervision module 240 can also determine at least one target sub - operation in the target operation and the completion status of each target sub - operation based on the process information. The completion status includes completed operations and uncompleted operations. The completion degree evaluation result is evaluation information characterizing the completion status of the target operation (such as quantity and completion status), and the completion degree evaluation result can be characterized by scores, grades, or analysis information, etc.

[0064] It can be understood that when the operator performs the target operation, it can include performing each target sub - operation. However, due to materials, capabilities, or other reasons, some target sub - operations may start to be executed but not completed. Therefore, the supervision module 240 can analyze the completion status of each target sub - operation in the target operation to determine the completion degree evaluation result of the operator performing the target operation.

[0065] When the process information includes video information and / or image information, the supervision module 240 may process the process information based on an operation analysis model. The output of the operation analysis model may be the types and quantities of the completed operations and the types and quantities of the uncompleted operations. For example, the operation analysis model may analyze the image information based on an image recognition algorithm to determine that the type of a certain target sub-operation is to perform quality inspection on a certain product. The operation analysis model may, based on the type of the target sub-operation, determine that three parts need to be inspected when performing quality inspection on the product. Further, the operation analysis model may analyze the image information to determine whether the operator has completed the inspection of the foregoing three parts. When the inspection of all three parts is completed, it may be determined that the target sub-operation is a completed operation. For another example, the operation analysis model may analyze the video information based on an image recognition algorithm to determine that the type of a certain target sub-operation is to assemble a certain product. The operation analysis model may, based on the type of the target sub-operation, determine that five parts need to be installed in sequence when performing quality inspection on the product. Further, the operation analysis model may analyze the video information to determine whether the operator has installed the five parts in sequence. When the five parts are installed in sequence, it may be determined that the target sub-operation is a completed operation; when the five parts are not installed in sequence or there are un-installed parts, it may be determined that the target sub-operation is an uncompleted operation.

[0066] The operation analysis model may be one or a combination of a convolutional neural network model, a deep learning model, or any other machine learning model that can implement this function. It can be obtained through training with a second training sample with a second training label. The second training sample may be sample video information and / or sample image information. The second training label is the types and quantities of the sample completed operations and the types and quantities of the sample uncompleted operations in the foregoing sample video information and / or sample image information. The second training sample may be obtained by shooting, and the second training label may be obtained by manual annotation.

[0067] When the process information includes audio information, the supervision module 240 may analyze and process the foregoing audio information to determine the quantities of the completed operations and the uncompleted operations. The supervision module 240 may obtain the start audio feature and the end audio feature of the target sub-operation. The foregoing start audio feature and end audio feature respectively symbolize that the operator starts to execute the corresponding target sub-operation and completes the execution of the target sub-operation. The supervision module 240 may, by analyzing and processing the audio information, identify the start audio feature and the end audio feature, so as to determine the quantities of the completed operations and the uncompleted operations.

[0068] For example, when a torque wrench starts operating, it emits a specific sound, and when it reaches the set torque, i.e., completes the operation, it emits another specific sound. The supervision module 240 can set the aforementioned two specific sounds as the start audio feature and the end audio feature respectively, and detect the audio information through a sound recognition algorithm to collect information on whether the corresponding construction tool has reached the construction standard, thereby determining the number of completed operations and uncompleted operations.

[0069] In some embodiments, the supervision module 240 can determine the completion degree evaluation result based on the number of completed operations and uncompleted operations in the execution of the target operation. For example, the supervision module 240 can directly generate the completion degree evaluation result based on the number of completed operations and uncompleted operations. Exemplarily, the completion degree evaluation result can be "Employee XX: m pieces of XX operations have been completed, and n pieces of XX operations are in progress".

[0070] In some embodiments, the supervision module 240 can analyze the number of completed operations and uncompleted operations to determine the completion degree evaluation result. The supervision module 240 can determine the completion degree evaluation result based on the number of completed operations and uncompleted operations according to a preset rule. For example, the preset rule can be the sum of the product of the number of completed operations and the corresponding score and the product of the number of uncompleted operations and the corresponding score. For example, when the number of completed operations is 8, the score corresponding to the completed operations is 10 points, the number of uncompleted operations is 2, and the score corresponding to the completed operations is -2 points, the completion degree evaluation result can be determined to be 76. The scores corresponding to the completed operations and uncompleted operations can be related to the types of the completed operations and uncompleted operations. By setting different scores for different types of completed operations and uncompleted operations, the different importance of target sub-operations with different difficulties can be reflected, making the finally determined completion degree evaluation result more accurate.

[0071] In some embodiments, for each target sub-operation in the target operation, the supervision module 240 can also set a label for the target sub-operation based on the completion status of the target sub-operation and send it to the storage module 230 for storage. For example, if a target sub-operation is a completed operation, the label of the target sub-operation is "completed". Another example is that if a target sub-operation is an uncompleted operation, the label of the target sub-operation is "uncompleted".

[0072] In some embodiments, the evaluation information may further include an operation score, which may refer to comprehensive evaluation information on the operation quality and efficiency of a target operation. In some embodiments, the supervision module 240 may determine a sub-operation score for each target sub-operation in the target operation based on the process information. The sub-operation score may refer to comprehensive evaluation information on the operation quality and efficiency of the target sub-operation. The supervision module 240 may process the process information based on a scoring model to determine the score of each target sub-operation in the target operation. The scoring model may include a type analysis layer, an efficiency evaluation layer, a quality evaluation layer, and a comprehensive evaluation layer. The supervision module 240 may input the process information into the type analysis layer to determine the types of the respective target sub-operations in the target operation; for each target sub-operation, the supervision module 240 may input its type and the process information into the efficiency evaluation layer, and the efficiency evaluation layer may determine the preset required duration for this type of target sub-operation and the duration used by the operator to perform this target sub-operation, so as to determine the efficiency score of this target sub-operation; for each target sub-operation, the supervision module 240 may also input its type and the process information into the quality evaluation layer, and the quality evaluation layer may determine the preset reference operation result for this type of target sub-operation (for example, a preset assembly sequence and an image of the product after assembly) and the operation result of the operator performing this target sub-operation, so as to determine the quality score of this target sub-operation; the supervision module 240 may analyze the efficiency score and the quality score of this target sub-operation based on the comprehensive evaluation layer to determine the sub-operation score of this target sub-operation. The aforementioned type analysis layer, efficiency evaluation layer, quality evaluation layer, and comprehensive evaluation layer may be a convolutional neural network model, a deep learning model, a random forest model, or any other machine learning model that can implement its functions. The required duration and reference operation result corresponding to each type in the scoring model may be preset in the scoring model. Each layer in the scoring model may be obtained by jointly training third training samples with third training labels, and the third training samples may include sample process information, and the third training labels may include the types and sub-score results of the respective sample sub-operations in the sample process information. The third training samples may be obtained by shooting or recording, and the third training labels may be obtained by manual annotation.

[0073] In some embodiments, the supervision module 240 may determine an operation score based on the sub-operation scores of the respective target sub-operations. For example, the supervision module 240 may determine the sum of the sub-operation scores of the respective target sub-operations and determine it as the operation score. For another example, the supervision module 240 may determine the weights of the respective target sub-operations based on the types of the respective target sub-operations, then perform a weighted sum of the sub-operation scores of the respective target sub-operations, and determine the value of the weighted sum as the operation score.

[0074] Some embodiments of this specification generate evaluation information of the target operation performed by the operator corresponding to the identification information through process information, which facilitates the automatic supervision of the records and work conditions of the operator, improves the supervision efficiency, and reduces the labor cost.

[0075] In some embodiments, the supervision module 240 may send the evaluation information to a terminal (for example, Figure 1 the terminal 160 shown), so that the user can supervise the work conditions of the operator. For example, the supervision module 240 may send one or more of the efficiency evaluation result, the completion evaluation result, and the operation score to the user's terminal, so that the user can understand the evaluation information of the operator performing the target operation from different aspects.

[0076] Figure 4 is an exemplary flowchart for determining the efficiency evaluation result according to some embodiments of this specification. As Figure 4 shown, the process 400 includes the following steps. In some embodiments, the process 400 may be executed by the supervision module 240.

[0077] Step 410, based on the process information, determine the effective operation duration when the operator performs the target operation.

[0078] The effective operation duration refers to the duration related to the target operation in the process information. It can be understood that the duration for the operator to perform the target operation may be relatively long (for example, 3 hours). During this process, the operator may also perform other tasks (for example, attending a meeting, taking a break, etc.). Therefore, not all the time is spent on performing the target operation. Therefore, the supervision module 240 can determine the effective operation duration to evaluate the work efficiency of the operator.

[0079] When the process information includes video information, the supervision module 240 may determine multiple operation frames when the operator performs the target operation based on the video information. The operation frames may be video frames in the aforementioned video information. The supervision module 240 may extract the video based on a preset frequency (for example, extract one frame every 20 frames) to obtain multiple operation frames when the operator performs the target operation. The operation frames may include effective operation frames and invalid operation frames. The effective operation frames may refer to the operation frames related to the target operation in the operation frames, and the effective operation frames may represent that the operator is performing the target operation. Correspondingly, the invalid operation frames may refer to the operation frames unrelated to the target operation in the operation frames, and the invalid operation frames may represent that the operator is performing other operations other than the target operation.

[0080] In some embodiments, the supervision module 240 may determine multiple valid operation frames among the multiple operation frames. The supervision module 240 may process the multiple operation frames based on a second image analysis model to determine the multiple valid operation frames. The second image analysis model may analyze and process the operation frames, identify the content in the operation frames, and determine whether there is a preset second preset object (for example, the tool and / or the hand of the operator necessary for performing the corresponding target operation), so as to determine whether the operation frame is a valid operation frame. The second image analysis model may be a convolutional neural network model, a deep learning model, or any other machine learning model that can implement its functions. The second image analysis model may be trained by a third training sample with a third training label. The third training sample may include multiple sample video frames, the third training label may include the sample valid video frames in the multiple sample video frames, the third training sample may be obtained by shooting, and the third training label may be determined by manual annotation.

[0081] Based on the multiple valid operation frames, the supervision module 240 may determine at least one valid operation time period during which the operator performs the target operation, and based on the at least one valid operation time period, determine the valid operation duration. The valid operation time period is the time period during which the operator is performing the target operation. The supervision module 240 may determine the time periods in the multiple operation frames that are all composed of consecutive valid operation frames, and determine them as valid operation time periods, and based on the time corresponding to the first valid operation frame and the last valid operation frame in the valid operation time period, determine the duration of the valid operation time period. The supervision module 240 sums up the durations of each valid operation time period to determine the valid operation duration.

[0082] Step 420, based on the first input information and the second input information, determine the total operation duration of the target operation.

[0083] The total operation duration refers to the duration recorded by the operator for performing the target operation.

[0084] The supervision module 240 may use the first input information and the second input information to determine the time when the operator starts and ends performing the target operation, so as to determine the total operation duration.

[0085] Step 430, based on the total operation duration and the valid operation duration, determine the efficiency evaluation result.

[0086] The efficiency evaluation result may refer to the efficiency of the operator performing the target operation. The supervision module 240 may determine the ratio of the valid operation duration to the total operation duration and determine it as the efficiency evaluation result.

[0087] Some embodiments of this specification can supervise the efficiency evaluation results of operators performing target differential operations, improve the supervision of operators, and reduce the supervision labor cost.

[0088] Figure 5 It is an exemplary flowchart for generating and displaying guiding information shown in some embodiments of this specification. In some embodiments, process 500 can be executed by a guiding module and a display module. As Figure 5 shown, process 500 includes the following steps.

[0089] Step 510, continuously obtain the process information currently collected by the collection unit.

[0090] The guiding module can continuously obtain the process information currently collected by the collection unit at the third collection frequency. For example, the guiding module can obtain the process information of the collection unit from the previous 1 minute to the current time at a frequency of once per minute.

[0091] Step 520, based on the currently collected process information, determine the type of the current target sub-operation.

[0092] The current target sub-operation can be the target sub-operation that the operator is currently performing.

[0093] The guiding module can analyze and process the currently collected process information to determine the type of the current target sub-operation. For example, the guiding module can process the currently collected process information based on the type analysis layer to determine the type of the current target sub-operation. For more content about the type analysis layer, see Figure 3 and its related descriptions.

[0094] Step 530, based on the type of the current target sub-operation, determine the reference sub-operation score of the operation object for the target sub-operation of this type.

[0095] The reference sub-operation score can refer to the comprehensive evaluation information of the operation quality and efficiency of the operation object for the target sub-operation of this type for reference. The guiding information can determine the sub-operation score of the operation object for performing the target sub-operation of this type through the storage module 230, and determine the sub-operation score of the most recent target sub-operation of this type as the reference sub-operation score.

[0096] Step 540, when the reference sub-operation score meets the preset guiding condition, generate the guiding information for the current target sub-operation.

[0097] The preset guiding condition can be the condition that needs to guide the target sub-operation set in advance. For example, the preset guiding condition can be that the reference sub-operation score is less than the preset score threshold.

[0098] The guiding information can be information for guiding the target sub-operation of this type. The guiding method of the guiding information can be one or more of text guiding, image guiding, and video guiding.

[0099] When the reference sub-operation score meets the preset guiding condition, the guiding module does not need to generate the guiding information for the current target sub-operation. When the reference sub-operation score meets the preset guiding condition, the guiding module can generate the guiding information for the current target sub-operation in various ways. For example, the guiding information for the current target sub-operation can be determined through a preset. For another example, the guiding module can also determine the highest sub-operation score corresponding to the target sub-operation of this type, determine the process information corresponding to the foregoing highest sub-operation score, and extract the fragment corresponding to the target sub-operation of this type in the process information as the guiding information corresponding to the target sub-operation of this type.

[0100] In some embodiments, when the reference sub-operation score meets the preset guiding condition, the guiding module can also determine the efficiency score and quality score corresponding to the reference sub-operation score, determine the absolute value of the difference between the two. When the absolute value of the foregoing difference is greater than or equal to the preset difference threshold, the guiding module can determine the type with the lower score among the efficiency score and quality score, and generate the guiding information for the current target sub-operation; when the absolute value of the foregoing difference is less than the preset difference threshold, the guiding module can generate the guiding information for the current target sub-operation. For example, when the absolute value of the foregoing difference is less than the preset difference threshold, the guiding module can determine the guiding information through a preset or the process information corresponding to the highest sub-operation score of the target sub-operation of this type. For another example, when the absolute value of the foregoing difference is greater than or equal to the preset difference threshold, the guiding module can determine the type with the lower score among the efficiency score and quality score. Taking the quality score being lower than the efficiency score as an example, the guiding module can determine the highest efficiency score among the sub-operation scores corresponding to the target sub-operation of this type, determine the corresponding process information, and extract the fragment corresponding to the target sub-operation of this type in the process information as the guiding information corresponding to the target sub-operation of this type. Through further analysis of the efficiency score and quality score corresponding to the reference sub-operation score in some embodiments of this specification, the specific deficiencies of the operator in performing the current target sub-operation can be determined, so as to achieve precise guidance for the operator.

[0101] In some embodiments, the guiding module can further analyze the guiding information through an image analysis algorithm to determine the step guiding for multiple steps of the target sub-operation. The guiding module can determine the current step of the target sub-operation through the currently collected process information, through an image analysis algorithm or a voice recognition algorithm, and generate the step guiding for the current step, so as to achieve refined guidance for the operator.

[0102] Step 550, display the guiding information for the operator.

[0103] The display module can receive the guidance information of the current target sub - operation generated by the guidance module and display the guidance information for the operator, facilitating the operator to learn the relevant operations and improve their operation ability.

[0104] In some embodiments of this specification, by judging whether the reference sub - operation score meets the preset guidance conditions, it is possible to automatically evaluate whether the operator currently needs guidance, generate and display the guidance information only when needed, avoiding the influence of external information on the operator while specifically improving the operator's ability.

[0105] It should be noted that the above descriptions of each process are only for illustration and explanation, and do not limit the scope of application of this specification. For those skilled in the art, various corrections and changes can be made to each process under the guidance of this specification. However, these corrections and changes are still within the scope of this specification.

[0106] This specification also provides a process management device, including an input device, a recording device, a storage device, and a processor; the input device is configured to input the identification information matching the operator; the recording device is configured to obtain the process information of the operator during the execution of the target operation; the storage device is configured to match and store the process information with the identification information; the processor is configured to generate the evaluation information of the operator corresponding to the identification information for executing the target operation based on the process information.

[0107] The basic concepts have been described above. Obviously, for those skilled in the art, the above detailed disclosure is only an example and does not constitute a limitation of this specification. Although not explicitly stated here, those skilled in the art may make various modifications, improvements, and corrections to this specification. Such modifications, improvements, and corrections are proposed in this specification, so such modifications, improvements, and corrections still belong to the spirit and scope of the exemplary embodiments of this specification.

[0108] Meanwhile, this specification uses specific terms to describe the embodiments of this specification. Such as "one embodiment", "an embodiment", and / or "some embodiments" mean a certain feature, structure, or characteristic related to at least one embodiment of this specification. Therefore, it should be emphasized and noted that "an embodiment" or "one embodiment" or "an alternative embodiment" mentioned twice or more at different positions in this specification does not necessarily refer to the same embodiment. In addition, certain features, structures, or characteristics in one or more embodiments of this specification can be appropriately combined.

[0109] In addition, unless otherwise specified in the claims, the order of the processing elements and sequences, the use of numerical and alphabetical characters, or the use of other names described in this specification are not used to limit the order of the processes and methods in this specification. Although some currently useful embodiments of the invention are discussed through various examples in the above disclosure, it should be understood that such details are for illustrative purposes only. The appended claims are not limited to the disclosed embodiments. On the contrary, the claims are intended to cover all modifications and equivalent combinations that conform to the essence and scope of the embodiments of this specification. For example, although the system components described above can be implemented by hardware devices, they can also be implemented only through software solutions, such as installing the described system on existing servers or mobile devices.

[0110] Similarly, it should be noted that, in order to simplify the presentation of the disclosure in this specification and thus help the understanding of one or more embodiments of the invention, in the foregoing description of the embodiments of this specification, multiple features are sometimes grouped into one embodiment, drawing, or description thereof. However, this method of disclosure does not mean that the features required by the subject matter of this specification are more than those mentioned in the claims. In fact, the features of the embodiments are fewer than all the features of the individual embodiments disclosed above.

[0111] In some embodiments, numbers are used to describe components and attribute quantities. It should be understood that such numbers used in the description of the embodiments are modified by the modifiers "about", "approximate" or "substantially" in some examples. Unless otherwise stated, "about", "approximate" or "substantially" indicate that the stated number allows a variation of ±20%. Accordingly, in some embodiments, the numerical parameters used in the specification and claims are approximate values, and these approximate values may change according to the characteristics required by individual embodiments. In some embodiments, the numerical parameters should consider the specified significant digits and adopt the method of retaining the general number of digits. Although the numerical ranges and parameters used in some embodiments of this specification to confirm the breadth of their scope are approximate values, in specific embodiments, such numerical settings are as precise as possible within the feasible range.

[0112] For each patent, patent application, patent application publication, and other materials cited in this specification, such as articles, books, specifications, publications, documents, etc., their entire contents are hereby incorporated into this specification by reference. This excludes the application history files that are inconsistent with or conflict with the content of this specification, as well as the files that limit the broadest scope of the claims of this specification (currently or subsequently appended to this specification). It should be noted that if there are inconsistencies or conflicts between the descriptions, definitions, and / or uses of terms in the supplementary materials of this specification and the content described in this specification, the descriptions, definitions, and / or uses of terms in this specification shall prevail.

[0113] Finally, it should be understood that the embodiments described in this specification are only used to illustrate the principles of the embodiments of this specification. Other variations may also fall within the scope of this specification. Therefore, by way of example and not limitation, alternative configurations of the embodiments of this specification may be regarded as consistent with the teachings of this specification. Accordingly, the embodiments of this specification are not limited to the embodiments explicitly presented and described in this specification.

Claims

1. A process management system, characterized in that, Including: An input module, configured to input identification information matching the operator; A collection module, configured to obtain the process information of the operator during the execution of the target operation, and the process information is configured to reflect the completion of the target operation by the operator; A storage module, configured to match and store the process information with the identification information; A supervision module, configured to generate evaluation information of the target operation performed by the operator corresponding to the identification information based on the process information.

2. The system according to claim 1, wherein The evaluation information includes an efficiency evaluation result when the operator performs the target operation, The input module is further configured to: Receive first input information input by the operator corresponding to the identification information when starting to execute the target operation and second input information input when ending the execution of the target operation; The supervision module is further configured to: Based on the process information, determine the effective operation duration when the operator performs the target operation; Based on the first input information and the second input information, determine the total operation duration of the target operation; Based on the total operation duration and the effective operation duration, determine the efficiency evaluation result.

3. The system according to claim 2, wherein The process information includes video information, The supervision module is further configured to: Based on the video information, determine multiple operation frames during the operator's execution of the target operation; Determine multiple effective operation frames among the multiple operation frames; Based on the multiple effective operation frames, determine at least one effective operation time period during the operator's execution of the target operation, and based on the at least one effective operation time period, determine the effective operation duration.

4. The system according to claim 1, wherein The input module is further configured to: Receive first input information input by the operator corresponding to the identification information when starting to execute the target operation and second input information input when ending the execution of the target operation; The storage module is further configured to: Match time stamps for the process information, the first input information, and the second input information respectively matching the identification information, and store them in the blockchain.

5. The system according to claim 4, wherein The storage module is further configured to: Based on the time stamp of the process information and the time stamp of the first input information, determine the start time difference; Based on the time stamp of the process information and the time stamp of the second input information, determine the end time difference; Judge whether both the start time difference and the end time difference are within a preset difference range, If so, it is determined that the records are consistent, and the process information with time stamp, the first input information with time stamp, and the second input information with time stamp are stored in the blockchain; If not, it is determined that the records are inconsistent, and a reminder information is sent to the terminal.

6. The system according to claim 1, wherein The evaluation information includes a completion degree evaluation result of the operator's execution of the target operation, and the target operation includes multiple target sub-operations, The supervision module is further configured to: Based on the process information, determine at least one target sub-operation in the execution of the target operation and the completion status of each target sub-operation, where the completion status includes completed operations and uncompleted operations; Based on the number of completed operations and uncompleted operations in the execution of the target operation, determine the completion degree evaluation result.

7. The system according to claim 1, wherein The evaluation information includes an operation score, and the target operation includes multiple target sub-operations. The supervision module is further configured to: Based on the process information, determine the sub-operation score of each target sub-operation in the target operation; Based on the sub-operation scores of each target sub-operation, determine the operation score.

8. The system according to claim 1, wherein The system further includes: A guidance module, configured to: Continuously obtain the process information currently collected by the collection unit; Based on the currently collected process information, determine the type of the current target sub-operation; Based on the type of the current target sub-operation, determine the reference sub-operation score of the operation object for the target sub-operation of this type; When the reference sub-operation score meets the preset guidance condition, generate the guidance information for the current target sub-operation; A display module, configured to: Display the guidance information for the operator.

9. A process management device, characterized in that Includes an input device, a recording device, a storage device, and a processor; The input device is configured to input identification information matching the operator; The recording device is configured to obtain the process information of the operator in the execution of the target operation; The storage device is configured to match and store the process information with the identification information; The processor is configured to generate evaluation information of the operator corresponding to the identification information for the execution of the target operation based on the process information.

10. A process management method, characterized in that, Includes: Input identification information matching the operator; Obtain the process information of the operator in the execution of the target operation; Match and store the process information with the identification information; Based on the process information, generate evaluation information of the operator corresponding to the identification information for the execution of the target operation.

Images