Quality inspection action flow compliance detection method, device, system and storage medium

Abstract

The application provides a quality inspection action flow compliance detection method, device, system and storage medium, the method comprises the following steps: acquiring image data of any model dishwasher quality inspection action on the production line; using a pre-trained detection model to detect the image data, identifying the dishwasher model of the dishwasher and a plurality of quality inspection action key frames of the dishwasher; acquiring the preset quality inspection action key frame corresponding to the dishwasher model, comparing the plurality of quality inspection action key frames of the dishwasher with the preset quality inspection action key frame, and obtaining the matching successful quality inspection action key frame; after the dishwasher reaches the set position, recording the quality inspection action of the dishwasher and its detection sequence according to the record of the matching successful quality inspection action key frame, and judging whether the quality inspection action flow of the dishwasher is compliant according to the record result; if the quality inspection action flow is not compliant, outputting the alarm information of the non-compliant quality inspection action flow to the display device. The accuracy of the quality inspection action is improved, and the production qualification rate of the dishwasher is improved.

Description

Technical Field

[0001] This application relates to the field of computer technology, and in particular to a method, apparatus, system and storage medium for quality inspection process compliance testing. Background Technology

[0002] In the production process of dishwashers, quality inspection workers are very important in inspecting the dishwashers. The quality inspection process is a repetitive action, and it is inevitable that quality inspectors will make mistakes or omissions during the inspection.

[0003] Currently, the common practice is to assign dedicated inspectors to monitor quality control workers' inspection videos in real time to identify any instances where workers have missed inspections.

[0004] However, the inventors have found that the existing technology has at least the following technical problems: it is easy for inspectors to fail to detect omissions by quality control workers due to negligence or other reasons, which leads to a low pass rate for dishwashers. Summary of the Invention

[0005] This application provides a method, apparatus, system, and storage medium for quality inspection process compliance testing to overcome the problem of missed detections during dishwasher quality inspection.

[0006] In the first aspect, this application provides a method for detecting compliance of quality inspection procedures, including: acquiring image data of quality inspection procedures for any model of dishwasher on the production line;

[0007] A pre-trained detection model is used to detect image data, identify the dishwasher model, and identify key frames of multiple quality inspection actions of the dishwasher.

[0008] Obtain the preset quality inspection action keyframes corresponding to the dishwasher model, compare the multiple quality inspection action keyframes of the dishwasher with the preset quality inspection action keyframes, and obtain the quality inspection action keyframes that are successfully matched.

[0009] After the dishwasher reaches the set position, the dishwasher's quality inspection actions and their inspection sequence are recorded based on the matched quality inspection action keyframes to obtain the recording results;

[0010] Determine whether the dishwasher's quality inspection process is compliant based on the recorded results;

[0011] If the dishwasher's quality inspection process is non-compliant, an alarm message indicating that the dishwasher's quality inspection process is non-compliant will be output to the display device.

[0012] In one possible design, the process involves obtaining preset quality inspection action keyframes corresponding to the dishwasher model, comparing multiple quality inspection action keyframes of the dishwasher with the preset quality inspection action keyframes, and obtaining a successfully matched quality inspection action keyframe. This includes: querying the preset quality inspection action keyframes corresponding to the dishwasher model; comparing the dishwasher quality inspection action keyframes with the preset quality inspection action keyframes to obtain an initially successfully matched quality inspection action keyframe; and determining whether the duration of the initially successfully matched quality inspection action keyframe is greater than or equal to the duration of the preset quality inspection action keyframe. If the duration of the initially successfully matched quality inspection action keyframe is greater than or equal to the duration of the preset quality inspection action keyframe, then the initially successfully matched quality inspection action keyframe is considered a successfully matched quality inspection action keyframe.

[0013] In one possible design, the quality inspection process of the dishwasher is judged to be compliant based on the recorded results, including: comparing each quality inspection action in the recorded results with the quality inspection actions in the preset process specifications according to the inspection sequence; if there are any missed actions, the quality inspection process of the dishwasher is judged to be non-compliant; if there are no missed actions, the quality inspection process of the dishwasher is judged to be compliant.

[0014] In one possible design, before using a pre-trained detection model to detect image data and identify the dishwasher model and multiple quality inspection action keyframes of the dishwasher, the process includes: acquiring pre-collected image data of dishwasher quality inspection actions for all models produced on the production line as training sample data; labeling the dishwasher model and quality inspection action keyframes in the training sample data to obtain labeled data; and training the initial detection model based on the training sample data and labeled data to obtain a pre-trained detection model.

[0015] In one possible design, if the dishwasher's quality inspection process is non-compliant, after outputting an alarm message indicating non-compliance to the display device, the design also includes: controlling the production line to automatically trigger a stop; and after identifying a missed inspection frame, sending a manual re-line notification to the display device or automatically triggering the re-line.

[0016] Secondly, this application provides a quality inspection process compliance testing device, comprising:

[0017] The acquisition module is used to acquire image data of the quality inspection actions of any model of dishwasher on the production line;

[0018] The recognition module is used to detect image data using a pre-trained detection model, identify the dishwasher model, and the key frames of multiple quality inspection actions of the dishwasher.

[0019] The matching module is used to obtain the preset quality inspection action key frames corresponding to the dishwasher model, compare the multiple quality inspection action key frames of the dishwasher with the preset quality inspection action key frames, and obtain the quality inspection action key frames that are successfully matched.

[0020] The recording module is used to record the dishwasher's quality inspection actions and their inspection sequence based on the successfully matched quality inspection action keyframes after the dishwasher reaches the set position, and obtain the recording results.

[0021] The judgment module is used to determine whether the quality inspection process of the dishwasher is compliant based on the recorded results.

[0022] The output module is used to output an alarm message indicating that the dishwasher's quality inspection process is non-compliant to the display device if the dishwasher's quality inspection process is non-compliant.

[0023] In one possible design, the matching module is specifically used for: querying the preset quality inspection action keyframes corresponding to the dishwasher model; comparing the dishwasher quality inspection action keyframes with the preset quality inspection action keyframes to obtain the quality inspection action keyframes that are initially matched successfully; determining whether the duration of the initially matched quality inspection action keyframe is greater than or equal to the duration of the preset quality inspection action keyframe; if the duration of the initially matched quality inspection action keyframe is greater than or equal to the duration of the preset quality inspection action keyframe, then the initially matched quality inspection action keyframe is considered a successfully matched quality inspection action keyframe.

[0024] Thirdly, this application provides a quality inspection process compliance detection system, including: a camera and a server;

[0025] The camera is installed at a preset position on the production line to collect image data of the quality inspection actions of any model of dishwasher on the production line;

[0026] The server includes: at least one processor and a memory; the memory stores computer-executable instructions; the at least one processor executes the computer-executable instructions stored in the memory, such that the at least one processor performs the quality inspection action process compliance testing method as described in the first aspect above and various possible designs of the first aspect.

[0027] Fourthly, this application provides a computer storage medium storing computer execution instructions, which, when executed by a processor, implement the quality inspection action process compliance detection method described in the first aspect and various possible designs of the first aspect.

[0028] The quality inspection process compliance detection method, device, system, and storage medium provided in this application acquire image data of dishwasher quality inspection actions, detect the image data, identify the dishwasher model and multiple key frames of the dishwasher quality inspection actions, match the identified key frames of the quality inspection actions with preset key frames, record the successfully matched key frames of the quality inspection actions and their detection order, determine whether the quality inspection process is compliant based on the recorded results, and issue an alarm if the quality inspection process is non-compliant so that staff can handle it, thereby improving the accuracy of quality inspection actions and increasing the pass rate of dishwashers. Attached Figure Description

[0029] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0030] Figure 1 A schematic diagram illustrating an application scenario for the compliance testing method for quality inspection procedures provided in this embodiment.

[0031] Figure 2 This is a schematic diagram of a quality inspection action process compliance testing method provided in one embodiment of this application;

[0032] Figure 3 This is a schematic diagram of a quality inspection action process compliance testing method provided in another embodiment of this application;

[0033] Figure 4 This is a schematic diagram of a quality inspection action process compliance testing method provided in another embodiment of this application;

[0034] Figure 5 A schematic diagram of the structure of the quality inspection process compliance testing device provided in the embodiments of this application;

[0035] Figure 6 This is a schematic diagram of the hardware structure of the server provided in an embodiment of this application. Detailed Implementation

[0036] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0037] In response to the technical problem of low dishwasher pass rate caused by the failure to detect omissions in quality inspection due to negligence of inspectors, the present application proposes the following technical solution: install cameras on the production line to collect image data of dishwasher quality inspection actions, identify dishwasher quality inspection actions through image data, and compare dishwasher quality inspection actions with preset specifications to determine whether the dishwasher quality inspection process is compliant and promptly detect omissions in quality inspection.

[0038] The following detailed embodiments will be used to illustrate the point.

[0039] Figure 1 This is a schematic diagram illustrating an application scenario for the compliance testing method for quality inspection procedures provided in this application. For example... Figure 1 As shown, camera 101 is installed at a preset position on the production line. Camera 101 is used to collect image data of the dishwasher's quality inspection action and send it to server 102. Server 102 analyzes the image data to obtain the detection result of the quality inspection action and sends the detection result to display device 103 for display.

[0040] It should be noted that the production line has a detection start line, a detection reporting line, and a detection end line. Any dishwasher model arriving on the production line will sequentially pass through the detection start line, detection reporting line, and detection end line.

[0041] Camera 101 can be installed above the starting line of the production line inspection.

[0042] The detection start line is the starting position of the dishwasher's quality inspection process, the detection reporting line is the position where the quality inspector records the quality inspection process, and the detection termination line is the position where the dishwasher's quality inspection process ends.

[0043] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0044] Figure 2 This is a schematic diagram of a quality inspection action process compliance testing method provided in one embodiment of this application. The execution entity of this embodiment can be... Figure 1 The server in the illustrated embodiment can also be any computing device; this embodiment does not impose any particular limitation. Figure 2 As shown, the method includes:

[0045] S201: Acquire image data of the quality inspection actions of any model of dishwasher on the production line.

[0046] The image data is collected by cameras pre-installed on the production line.

[0047] Specifically, it acquires image data of the quality inspection actions of any model of dishwasher on the production line, captured by a camera and transmitted in the form of a video stream.

[0048] S202: Using a pre-trained detection model, the image data is detected to identify the dishwasher model and key frames of multiple quality inspection actions of the dishwasher.

[0049] Specifically, image data is input into a pre-trained detection model to identify the dishwasher model and keyframes of multiple quality inspection actions of the dishwasher.

[0050] The quality inspection actions in the keyframe of the quality inspection action include at least one of the following: edge touch inspection, dispenser inspection, upper basket inspection, middle basket inspection, lower basket inspection, and instruction manual inspection.

[0051] S203: Obtain the preset quality inspection action key frame corresponding to the dishwasher model, compare the multiple quality inspection action key frames of the dishwasher with the preset quality inspection action key frame, and obtain the quality inspection action key frame that is successfully matched.

[0052] Specifically, S203 includes S2031 to S2033.

[0053] S2031: Query the preset quality inspection action keyframes corresponding to the dishwasher model.

[0054] Specifically, for quality inspection actions involving a large movement relative to the dishwasher's position, the dishwasher corresponding to the inspection action is determined by assessing the overlap between the inspection action and the dishwasher. For quality inspection actions involving a small movement relative to the dishwasher's position, the dishwasher corresponding to the inspection action is determined by assessing the distance between the action and the dishwasher. The preset quality inspection action keyframes for that dishwasher model are then retrieved.

[0055] S2032: Compare the dishwasher quality inspection action keyframes with the preset quality inspection action keyframes to obtain the quality inspection action keyframes that are initially matched.

[0056] Specifically, by comparing the dishwasher quality inspection action keyframes with preset quality inspection action keyframes through a preset program, the quality inspection action keyframes that are initially matched are obtained. The preset program can be an image feature matching program based on the SIFT algorithm.

[0057] S2033: Determine whether the duration of the key frame of the quality inspection action that was successfully matched for the first time is greater than or equal to the preset duration of the key frame of the quality inspection action, and obtain the key frame of the quality inspection action that was successfully matched.

[0058] For example, the preset key duration of the edge touch inspection action key frame is 1 minute, and the duration of the first successfully matched edge touch inspection action key frame is 1 minute and 10 seconds. Then, this edge touch inspection action key frame is a successfully matched quality inspection action key frame.

[0059] S204: After the dishwasher reaches the set position, the dishwasher's quality inspection actions and their inspection sequence are recorded according to the matched quality inspection action keyframes to obtain the recording results.

[0060] Specifically, after the dishwasher reaches the set position, a record result is generated based on the detection order of all successfully matched quality inspection action keyframes.

[0061] In this embodiment, the pptracking algorithm is used to monitor the dishwashers on the production line and record all successfully matched detection actions of the same dishwasher and their detection sequence.

[0062] The set position can be either the detection reporting line or the detection termination line.

[0063] S205: Determine whether the quality inspection process of the dishwasher is compliant based on the recorded results.

[0064] Specifically, each quality inspection action in the recorded results is compared with the quality inspection actions in the preset process specifications in the order of inspection. If there is a missed action, the quality inspection action process of the dishwasher is judged to be non-compliant; if there is no missed action, the quality inspection action process of the dishwasher is judged to be compliant.

[0065] S206: If the dishwasher's quality inspection process is non-compliant, an alarm message indicating that the dishwasher's quality inspection process is non-compliant will be output to the display device.

[0066] In this embodiment, any non-compliant or missed inspection actions in the dishwasher's quality inspection process are displayed on the display device, enabling inspectors to promptly and accurately identify the missed inspections and remind quality inspectors to re-inspect; or directly triggering a production line stoppage for re-inspection.

[0067] In summary, the quality inspection process compliance detection method provided in this embodiment acquires image data of dishwasher quality inspection actions, detects the image data, identifies the dishwasher model and multiple key frames of the dishwasher's quality inspection actions, matches the identified key frames with preset key frames, records the successfully matched key frames and their detection order, and determines whether the quality inspection process is compliant based on the recorded results. If the quality inspection process is non-compliant, an alarm is issued to prompt staff to handle the issue, thereby improving the accuracy of quality inspection actions and increasing the dishwasher's production pass rate.

[0068] Figure 3This is a schematic diagram of a quality inspection action process compliance testing method provided in another embodiment of this application. This embodiment of the application... Figure 2 Based on the provided embodiments, before step S201, a process for training the detection model to obtain a pre-trained detection model is also included, specifically including:

[0069] S301: Acquire the dishwasher quality inspection action image data of all models of dishwashers produced on the pre-collected production line as training sample data.

[0070] S302: Label the dishwasher model and quality inspection action keyframes in the training sample data to obtain labeled data.

[0071] The labeled data may include at least one of the following: the name of the quality inspection action, the duration of the quality inspection action, etc.

[0072] S303: Train the initial detection model based on the training sample data and labeled data to obtain a pre-trained detection model.

[0073] Specifically, a pre-set algorithm is used to train the initial detection model using training sample data and labeled data to obtain a pre-trained detection model.

[0074] In summary, the quality inspection action process compliance detection method provided in this embodiment collects and annotates image data of dishwasher quality inspection actions, and uses the image data and annotated data as training sample data to train a pre-trained detection model, thereby improving the accuracy of recognizing key frames of dishwasher quality inspection actions and thus improving the accuracy of quality inspection action process compliance detection.

[0075] Figure 4 This is a schematic diagram of a quality inspection action process compliance testing method provided in another embodiment of this application. This embodiment of the application... Figure 2 Based on the provided embodiment, the process for handling the missed dishwasher after S206 is as follows: Figure 4 As shown, the method includes:

[0076] S401: Controls the production line to automatically trigger a stop.

[0077] Specifically, control information is sent to the electronic control unit on the production line to cause the production line to automatically stop.

[0078] S402: After a missed detection action frame is detected, a notification for manual re-line detection will be sent to the display device or the re-line detection will be automatically triggered.

[0079] Specifically, the system acquires image data of quality inspection actions after the production line is stopped, uses a pre-trained detection model to detect the image data of quality inspection actions after the production line is stopped, identifies the dishwasher model and the dishwasher's missed inspection action frames, compares them with preset key frames of quality inspection actions, and if a match is successful, sends a manual re-line notification to the display device or automatically triggers the re-line.

[0080] In summary, the quality inspection process compliance detection method provided in this embodiment, after detecting a missed inspection action in the quality inspection process, automatically triggers a stop on the production line to allow quality inspection workers to make up for the missed action. After the missed action is identified, the line is restarted, further improving the pass rate of dishwasher production.

[0081] Figure 5 This is a schematic diagram of the structure of the compliance testing device for quality inspection procedures provided in an embodiment of this application. Figure 5 As shown, the compliance testing device for the quality inspection process includes: an acquisition module 501, an identification module 502, a matching module 503, a recording module 504, a judgment module 505, and an output module 506.

[0082] The acquisition module 501 is used to acquire image data of the quality inspection action of any model of dishwasher on the production line;

[0083] The recognition module 502 is used to detect image data using a pre-trained detection model, identify the dishwasher model, and multiple key frames of the dishwasher's quality inspection actions.

[0084] The matching module 503 is used to obtain the preset quality inspection action key frame corresponding to the dishwasher model, compare the multiple quality inspection action key frames of the dishwasher with the preset quality inspection action key frame, and obtain the quality inspection action key frame that is successfully matched.

[0085] The recording module 504 is used to record the quality inspection actions and their detection sequence of the dishwasher according to the matched quality inspection action key frames after the dishwasher reaches the set position, and obtain the recording results.

[0086] The judgment module 505 is used to determine whether the quality inspection process of the dishwasher is compliant based on the recorded results.

[0087] The output module 506 is used to output an alarm message indicating that the quality inspection process of the dishwasher is non-compliant to the display device if the quality inspection process of the dishwasher is non-compliant.

[0088] In one possible implementation, the matching module 503 is specifically used for: querying the preset quality inspection action key frame corresponding to the dishwasher model; comparing the dishwasher quality inspection action key frame with the preset quality inspection action key frame to obtain the quality inspection action key frame that is initially matched successfully; determining whether the duration of the quality inspection action key frame that is initially matched successfully is greater than or equal to the duration of the preset quality inspection action key frame; if the duration of the quality inspection action key frame that is initially matched successfully is greater than or equal to the duration of the preset quality inspection action key frame, then the quality inspection action key frame that is initially matched successfully is the quality inspection action key frame that is successfully matched.

[0089] In one possible implementation, the recording module 504 is specifically used to: compare each quality inspection action in the recorded results with the quality inspection actions in the preset process specifications according to the detection sequence; if there is a missed action, it is determined that the quality inspection action process of the dishwasher is non-compliant; if there is no missed action, it is determined that the quality inspection action process of the dishwasher is compliant.

[0090] In one or more embodiments of this application, reference continues to be made to... Figure 5 The device also includes a training module 507, which is specifically used to: acquire dishwasher quality inspection action image data of all models of dishwashers produced on the production line as training sample data; annotate the dishwasher models and quality inspection action keyframes of the training sample data to obtain annotated data; and train the initial detection model based on the training sample data and the annotated data to obtain a pre-trained detection model.

[0091] In one or more embodiments of this application, reference continues to be made to... Figure 5 The device also includes a processing module 508, which is specifically used to: control the production line to automatically trigger a stop; after a missed detection action frame is identified, send a manual re-line notification to the display device or automatically trigger the re-line.

[0092] The apparatus provided in this embodiment can be used to execute the technical solutions of the above method embodiments. Its implementation principle and technical effects are similar, and will not be described again here.

[0093] Figure 6 This is a schematic diagram of the hardware structure of the quality inspection process compliance detection system provided in an embodiment of this application. Figure 6 As shown, in this embodiment, the camera 101 is installed at a preset position on the production line to collect image data of the quality inspection actions of any model of dishwasher on the production line; the server includes: a processor 601 and a memory 602; wherein

[0094] Memory 602 is used to store instructions executed by the computer;

[0095] The processor 601 is used to execute computer execution instructions stored in the memory to implement the various steps performed by the server in the above embodiments. For details, please refer to the relevant descriptions in the foregoing method embodiments.

[0096] Alternatively, the memory 602 can be either standalone or integrated with the processor 601.

[0097] When the memory 602 is configured independently, the server also includes a bus 603 for connecting the memory 602 and the processor 601.

[0098] This application also provides a computer storage medium storing computer execution instructions. When the processor executes the computer execution instructions, it implements the above-mentioned quality inspection process compliance detection method.

[0099] This application also provides a computer program product, including a computer program, which, when executed by a processor, implements the above-mentioned quality inspection process compliance detection method.

[0100] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be indirect coupling or communication connection through some interfaces, devices, or modules, and may be electrical, mechanical, or other forms.

[0101] The modules described as separate components may or may not be physically separate. The components shown as modules may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to implement the solution of this embodiment according to actual needs.

[0102] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing unit, or each module can exist physically separately, or two or more modules can be integrated into one unit. The unit composed of the above modules can be implemented in hardware or in the form of hardware plus software functional units.

[0103] The integrated modules described above, implemented as software functional modules, can be stored in a computer-readable storage medium. These software functional modules, stored in a storage medium, include several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute some steps of the methods of the various embodiments of this application.

[0104] It should be understood that the aforementioned processor can be a Central Processing Unit (CPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), etc. A general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in this invention can be directly manifested as being executed by a hardware processor, or executed by a combination of hardware and software modules within the processor.

[0105] The memory may include high-speed RAM, and may also include non-volatile storage (NVM), such as at least one disk storage device, and may also be a USB flash drive, external hard drive, read-only memory, disk or optical disc, etc.

[0106] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of illustration, the buses shown in the accompanying drawings are not limited to a single bus or a single type of bus.

[0107] The aforementioned storage medium can be implemented from any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The storage medium can be any available medium accessible to general-purpose or special-purpose computers.

[0108] An exemplary storage medium is coupled to a processor, enabling the processor to read information from and write information to the storage medium. Alternatively, the storage medium can be an integral part of the processor. Both the processor and the storage medium can reside in an Application Specific Integrated Circuit (ASIC). Alternatively, the processor and storage medium can exist as discrete components in an electronic device or host device.

[0109] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0110] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A method for verifying compliance of a quality inspection process, characterized in that, include: Acquire image data of the quality inspection process for any model of dishwasher on the production line; A pre-trained detection model is used to detect the image data and identify the dishwasher model and multiple quality inspection action key frames of the dishwasher; the quality inspection action key frames include at least one of the following: edge touch inspection, dispenser inspection, upper rack inspection, middle rack inspection, lower rack inspection, and instruction manual inspection. Based on the dishwasher model, query the preset quality inspection action keyframe corresponding to that model of dishwasher; The key frames of multiple quality inspection actions of the dishwasher are compared with the preset key frames of quality inspection actions to obtain the key frames of quality inspection actions that are initially matched. Determine whether the duration of the first successfully matched quality inspection action key frame is greater than or equal to the preset duration of the quality inspection action key frame. If the duration of the first successfully matched quality inspection action key frame is greater than or equal to the preset duration of the quality inspection action key frame, then the first successfully matched quality inspection action key frame is a successfully matched quality inspection action key frame. After the dishwasher reaches the set position, the quality inspection actions and their detection sequence of the dishwasher are recorded according to the matched quality inspection action keyframes to obtain the recording results; According to the testing sequence, each quality inspection action in the recorded results is compared with the quality inspection actions in the preset process specifications; If any inspection actions are missed, the dishwasher's quality inspection process is deemed non-compliant; if no inspection actions are missed, the dishwasher's quality inspection process is deemed compliant. If the quality inspection process of the dishwasher is not compliant, an alarm message indicating that the quality inspection process of the dishwasher is not compliant will be output to the display device.

2. The method according to claim 1, characterized in that, Before acquiring image data of the quality inspection actions of any model of dishwasher on the production line, the process also includes: Acquire the quality inspection action image data of all models of dishwashers produced on the pre-collected production line as training sample data; The dishwasher models and keyframes of quality inspection actions in the training sample data are labeled to obtain labeled data; The initial detection model is trained based on the training sample data and the labeled data to obtain a pre-trained detection model.

3. The method according to claim 1, characterized in that, After the step of outputting an alarm message indicating non-compliance of the dishwasher's quality inspection process to the display device if the dishwasher's quality inspection process is non-compliant, the method further includes: Control the production line to automatically trigger a stop; Once a missed action frame is detected, a notification for manual re-line detection will be sent to the display device or the re-line detection will be automatically triggered.

4. A quality inspection process compliance testing device, characterized in that, include: The acquisition module is used to acquire image data of the quality inspection actions of any model of dishwasher on the production line; The recognition module is used to detect the image data using a pre-trained detection model, identify the dishwasher model, and multiple quality inspection action key frames of the dishwasher; the quality inspection action key frames include at least one of the following: edge touch inspection, dispenser inspection, upper rack inspection, middle rack inspection, lower rack inspection, and instruction manual inspection. The matching module is used to obtain the preset quality inspection action key frame corresponding to the dishwasher model, compare the multiple quality inspection action key frames of the dishwasher with the preset quality inspection action key frame, and obtain the quality inspection action key frame that is successfully matched. The recording module is used to record the quality inspection actions and their detection sequence of the dishwasher according to the successfully matched quality inspection action keyframes after the dishwasher reaches the set position, and obtain the recording results. The judgment module is used to determine whether the quality inspection process of the dishwasher is compliant based on the recorded results. The output module is used to output an alarm message indicating that the quality inspection process of the dishwasher is non-compliant to the display device if the quality inspection process of the dishwasher is non-compliant. The matching module is specifically used for: querying the preset quality inspection action key frame corresponding to the dishwasher model; comparing the dishwasher quality inspection action key frame with the preset quality inspection action key frame to obtain the quality inspection action key frame that is initially matched successfully; determining whether the duration of the initially matched quality inspection action key frame is greater than or equal to the duration of the preset quality inspection action key frame; if the duration of the initially matched quality inspection action key frame is greater than or equal to the duration of the preset quality inspection action key frame, then the initially matched quality inspection action key frame is a successfully matched quality inspection action key frame. The recording module is specifically used to: compare each quality inspection action in the recorded results with the quality inspection actions in the preset process specifications according to the detection order; if there is a missed action, it is determined that the quality inspection action process of the dishwasher is non-compliant; if there is no missed action, it is determined that the quality inspection action process of the dishwasher is compliant.

5. A quality inspection process compliance detection system, characterized in that, include: Cameras and servers; The camera is installed at a preset position on the production line to collect image data of the quality inspection actions of any model of dishwasher on the production line. The server includes: at least one processor and a memory; the memory stores computer-executable instructions; the at least one processor executes the computer-executable instructions stored in the memory, causing the at least one processor to perform the quality inspection process compliance detection method as described in any one of claims 1 to 3.

6. A computer storage medium, characterized in that, The computer storage medium stores computer execution instructions. When the processor executes the computer execution instructions, it implements the quality inspection action process compliance detection method as described in any one of claims 1 to 3.

Images