Intelligent Workflow Automation via Object Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Employees face inefficiencies in discovering and executing workflows for resolving IT issues, leading to lost productivity due to unfamiliarity with available services and time-consuming processes.
Innovation Solution
A system and method utilizing image recognition on a user device, leveraging machine learning to identify objects and match them with relevant backend systems, pre-filling necessary form fields, and initiating service requests efficiently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If users manually discover and execute workflows for IT issues, then they can resolve problems through existing systems, but they spend excessive time searching for services and filling forms
Solution Approach 1:
The system performs preliminary actions by automatically capturing device information, pre-filling workflow form fields with relevant data, and preparing the appropriate workflow form before user submission. This eliminates the need for users to manually search for services and fill in basic information, directly reducing the time spent on workflow discovery and execution.
Solution Approach 2:
The system enables self-service by automatically identifying the user's device, retrieving relevant information about the device and issue, and presenting the appropriate workflow form with pre-filled fields. This allows users to resolve IT issues independently without needing to search for services or consult with IT staff, thereby improving productivity and reducing time loss.
2Ease of operation
If users are unfamiliar with available IT services, then they can still access support through the system, but they experience additional delays in locating appropriate resources
Solution Approach 1:
The system performs automatic device identification and workflow form selection, enabling users who are unfamiliar with IT services to access support without needing to know which service to contact or what information to provide. The system handles the discovery and preparation steps automatically, maintaining ease of operation while eliminating the time users would otherwise spend searching for services.
Solution Approach 2:
The system performs preliminary actions by automatically capturing device information, identifying the appropriate workflow type, and pre-filling form fields before the user even submits their request. This preliminary processing occurs in the background, making the service accessible to all users regardless of their familiarity with IT systems, while eliminating the time they would otherwise spend locating and preparing service requests.
3Reliability
If users manually fill in workflow form fields, then they can provide necessary information for issue resolution, but they lose valuable time on repetitive data entry
Solution Approach 1:
The system performs preliminary actions by automatically capturing device information, retrieving user profile data, and pre-filling workflow form fields with accurate information before the user submits their request. This eliminates the need for users to manually enter repetitive information while maintaining data accuracy, as the system retrieves information from reliable sources such as device databases and user profiles.
Solution Approach 2:
The system enables self-service by automatically populating workflow forms with relevant device and user information, allowing users to submit accurate service requests without manual data entry. This maintains reliability by ensuring that accurate information is captured while eliminating the time users would otherwise spend filling in repetitive fields.
4Measurement precision
If the system requires user input for device identification, then it can ensure accurate device tracking, but it increases the complexity and time required to initiate workflows
Solution Approach 1:
The system performs preliminary actions by automatically capturing device information through device sensors and identification systems before the user needs to initiate a workflow. This preliminary device identification occurs in the background, ensuring accurate device tracking while eliminating the need for users to manually input device information, thereby reducing workflow initiation complexity.
Solution Approach 2:
The system performs self-service device identification by automatically detecting and capturing device information without requiring user input. This maintains measurement precision by accurately identifying the device through automated means while reducing the complexity of the workflow initiation process, as users no longer need to manually provide device details.
Data Source
AI summary
Examples described herein include systems and methods for providing a workflow on a user device. A user device can receive image data from a camera of the user device. The device can perform object recognition to recognize an object from the image data, as well as classification of the object. The user device can match the object classification with a backend system. The example method can also include launching a workflow form associated with the matching backend system. The user device can launch a form having these fields available, either within the workflow application or within a dedicated application associated with the relevant backend system. The user device can pre-fill one or more information fields in the workflow form based on the object classification, providing the user with a head start on submitting the form to the appropriate system.