Mobile Device Event Control via Topographical Image Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Mobile devices face limitations in user input options due to touchscreen size, which can impede the number and size of control elements, leading to frustrating user experiences and slow input operations.
Innovation Solution
A server system that processes digital images from mobile devices to identify user-selected content and user actions, determining event triggers to generate mobile device commands based on the relative position of objects within the image, allowing for advanced user input methods beyond traditional touchscreen gestures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If touchscreen size is increased to provide more control elements, then user input options increase, but device portability and compactness deteriorate
Solution Approach 1:
The patent extends the control interface from the two-dimensional touchscreen to three-dimensional physical space. Users can capture images of objects in the real world and manipulate them through spatial gestures, effectively adding a third dimension for interaction. This allows numerous control elements to be accessed without increasing the physical footprint of the device.
Solution Approach 2:
The patent introduces an image processing system as an intermediary between the user and the device commands. Instead of directly touching control elements on the screen, users capture images of external objects and use those images as mediators to trigger various device functions. This intermediary layer enables complex control without requiring proportional increases in touchscreen real estate.
2Adaptability or versatility
If more control elements are added to the touchscreen, then functionality increases, but ease of operation deteriorates due to smaller element size
Solution Approach 1:
The patent creates a copy of the real-world object in digital image form and uses this copy as the control interface. Instead of requiring users to locate and tap small virtual buttons on the touchscreen, users simply capture an image of a physical object and perform gestures in the air above the device. The physical object itself becomes the control element, eliminating the need to navigate small on-screen elements.
Solution Approach 2:
The patent replaces the mechanical touchscreen interaction system with an optical recognition system combined with gesture recognition. Instead of requiring physical contact with the screen surface, users perform gestures in the air that are captured by the device's camera and processed to determine intent. This substitution of mechanical interaction with optical-field interaction enables faster and more intuitive control.
3Adaptability or versatility
If traditional touchscreen gestures are used, then device complexity remains low, but adaptability to different user needs deteriorates
Solution Approach 1:
The patent creates a universal input system where a single mechanism—capturing images of physical objects and recognizing gestures above the device—can trigger multiple different device functions. The same hardware setup (camera, processor, gesture sensors) handles diverse tasks including launching applications, adjusting settings, and executing commands, eliminating the need for separate specialized interfaces for each function.
Data Source
AI summary
A server system for mobile device event control with digital images comprising: a processor configured to execute instructions; a memory containing instructions when executed on the processor, causes the processor to perform operations that: receive a digital image from a mobile device; identify a first element of the digital image and a second element of the digital image, wherein the first element of the digital image comprises a user-selected content, and wherein the second element comprises a depiction of a user action; determine an event trigger identified by the first element and the second element, wherein the event trigger comprises a mobile device operating system command, and wherein the mobile device operating system command comprises a command, to execute an image search with an online image search engine accessed by a web browser operating in the mobile device.