Robotic VR Software Testing with Automated Action Verification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional methods of automated testing for virtual reality (VR) software applications rely heavily on manual labor and require human intervention to ensure robotic devices complete tasks successfully, leading to inefficiencies and poor adaptability.
Innovation Solution
A system utilizing a server computing device that converts test workflow descriptions into sequences of actions interpretable by robotic devices, which automatically execute and analyze the outcomes of these actions using large language models and environmental data to determine success.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional automated testing methods are used, then testing can be performed with existing tools, but the efficiency is low and human intervention is required
Solution Approach 1:
The robotic device autonomously performs testing operations without human intervention. The system captures execution data from the robotic device, captures screenshots from the display device, and automatically analyzes whether the robotic device successfully executed the action using the processor. This self-service mechanism eliminates the need for human testers to monitor each testing operation.
Solution Approach 2:
The patent replaces manual human operations with an automated system comprising a robotic device, display device, and processing system. The processor automatically analyzes execution data and screenshots to determine testing outcomes, substituting the mechanical human decision-making process with an automated computational system.
2Adaptability or versatility
If manual testing is used, then complex test scenarios can be handled with human judgment, but the process is time-consuming and labor-intensive
Solution Approach 1:
The system autonomously handles complex test scenarios by automatically capturing execution data, capturing screenshots, and analyzing outcomes without human intervention. The processor independently determines whether the robotic device successfully executed each action, enabling the system to handle diverse test scenarios efficiently without requiring human time investment.
3Reliability
If robotic devices are used with human monitoring, then task execution can be verified, but the system complexity increases and automation is reduced
Solution Approach 1:
The patent replaces human monitoring with an automated analysis system. The processor captures execution data from the robotic device and screenshots from the display device, then automatically analyzes these data to determine whether the robotic device successfully executed the action. This substitution maintains reliability through systematic verification while reducing system complexity by eliminating the need for human operators.
Data Source
AI summary
Methods and systems for automated testing of virtual reality software applications using robotic devices include a server that converts a test workflow description into a sequence of actions in a format interpretable by a robotic device. The server transmits the sequence of actions to the robotic device. For each action in the sequence of actions, the server a) receives, from the robotic device, execution data corresponding to an outcome of execution of the action by the robotic device; b) captures, from a virtual reality device, one or more of image data and vector data corresponding to a current state of a virtual reality software application; c) analyzes one or more of the image data, the vector data, and the execution data to determine whether the robotic device successfully executed the action; and d) upon determining that the robotic device successfully executed the action, repeats steps a)-d) for the next action.