Automated Product Testing System with Human-in-the-Loop Hand-off
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Product testing can be lengthy and complicated, and outsourcing testing can be time-consuming, especially when fast turn-around is required, as many suppliers lack in-house testers and finding suitable testers is challenging.
Innovation Solution
A product testing system that integrates automated testing with human involvement through a hand-off module, using object detection algorithms for image and text matching, allowing users to select matching preferences, and providing screenshot suggestions for updating testing parameters.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If automated testing is used, then productivity is improved, but reliability deteriorates because automated devices cannot perform certain testing actions or make generic determinations
Solution Approach 1:
The testing process is divided into automated portions (performed by testing devices) and manual portions (performed by human testers). The hand-off module identifies and segments specific testing actions that require human judgment, allowing each type of action to be performed by the most suitable executor.
Solution Approach 2:
The hand-off module acts as an intermediary between automated testing devices and human testers. It receives testing actions from automated devices, determines which actions should be performed manually, and routes them to appropriate human testers, thereby coordinating the workflow between automation and human capability.
2Reliability
If human testers are used, then reliability is improved, but productivity deteriorates because finding suitable testers is time-consuming
Solution Approach 1:
The system pre-identifies and pre-configures human testers for specific testing actions that require human judgment. By having testers ready and assigned in advance, the system eliminates the time-consuming process of finding suitable testers when testing is needed, allowing immediate deployment of human expertise when required.
3Measurement precision
If traditional object detection is used, then measurement precision is improved, but adaptability deteriorates because the system cannot handle design changes without parameter updates
Solution Approach 1:
The system performs partial object detection by focusing on essential identifying features rather than requiring exact matches of all visual parameters. This allows the system to detect objects even when some visual characteristics differ from the original design, providing flexibility while maintaining detection capability.
Data Source
AI summary
An electronic product testing system includes: a product testing device having a processing unit configured to execute an electronic file to perform testing of a product based on product testing instruction in the electronic file; wherein the processing unit is configured to perform the testing of the product by performing a machine-testing action based on the product testing instruction in the electronic file; wherein the electronic file comprises hand-off instruction; and wherein the processing unit is also configured to generate a request for a human-testing action to be performed by a human-tester based on the hand-off instruction in the electronic file.