Mobile Terminal Coprocessor Image Recognition for Application Activation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing mobile terminal applications require time-consuming manual searches and complex operations for activation, especially with numerous installed applications, and existing methods like touch trajectories and fingerprint recognition can be inconvenient or fail in certain conditions.

Innovation Solution

A device in the mobile terminal processes images from a sensor to recognize application categories using a coprocessor and a main processor, allowing automatic activation without user interaction, reducing power consumption and memory burden.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a user manually searches for and taps an application icon on the main interface, then the application can be activated, but the operation process becomes time-consuming when many applications are installed

Engineering Contradiction:
Improveapplication activation operationVSAvoidtime to find and activate application
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs preliminary actions by capturing images of real-world objects and pre-processing them through object recognition and feature extraction before the user actually requests the application. The correspondence between objects and applications is established in advance, so when the user points the camera at an object, the application is already identified and can be quickly activated, eliminating the manual search process.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary system consisting of the camera, image processing unit, and object-application correspondence database. Instead of directly searching through application icons, the user interacts with real-world objects through the camera, and the intermediary system automatically translates this into application selection. This intermediary layer abstracts away the complexity of managing numerous applications.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If touch trajectories are preset for applications to enable quick startup, then user operations are simplified, but the user needs to remember multiple trajectories which increases memory burden

Engineering Contradiction:
Improvequick startup operationVSAvoidmemory burden for trajectories
Core Design Contradiction:
Ease of operationVSQuantity of substance

Solution Approach 1:

The system performs self-service by automatically recognizing objects and determining corresponding applications without requiring the user to remember or input any trajectory patterns. The object recognition system independently completes the task of identifying which application to launch based solely on the visual input from the camera, eliminating the need for users to memorize complex gesture sequences.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical gesture-based interaction system with an optical recognition system. Instead of using touch trajectories (mechanical input), the system uses camera-based image capture and optical pattern recognition to identify objects and map them to applications. This substitution eliminates the need for users to learn and remember physical gesture patterns.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If fingerprint recognition is added to enable different applications with different fingers, then application access is enhanced, but operations fail when fingers are wet, dry, sticky, or when wearing gloves

Engineering Contradiction:
Improveapplication access methodVSAvoidfingerprint recognition reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent introduces an intermediary optical recognition system that mediates between the user and the application access system. Instead of directly using fingerprint recognition, the camera captures images of objects, and the image processing system serves as an intermediary that translates visual information into application selection. This intermediary approach bypasses the reliability issues of direct fingerprint scanning in adverse conditions.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system changes the parameter of identification from physiological characteristics (fingerprint patterns) to visual characteristics (object appearance, color, shape). By changing the identification parameter from tactile/optical fingerprint data to camera-based image data, the system becomes reliable under various finger conditions including wet, dry, sticky, or gloved states, while maintaining versatile application access.

Inventive Principle:
Principle #35Parameter changes

4Productivity

If the main processor processes application activation requests, then comprehensive control is achieved, but power consumption increases

Engineering Contradiction:
Improveapplication activation controlVSAvoidpower consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent segments the application activation control process into distinct functional modules: image capture by camera, image processing and object recognition by dedicated processing units, correspondence matching by the processor, and final activation control. This segmentation allows different components to handle specific tasks, enabling the main processor to remain in low-power states while dedicated units handle intensive processing operations.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces intermediary processing units that act as mediators between the camera and the main processor. These intermediary units perform initial image processing and object recognition, filtering and pre-processing data before passing relevant information to the main processor. This intermediary layer reduces the computational burden on the main processor, allowing it to maintain comprehensive control while consuming less power.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP3873074B1Apparatus in mobile terminal for identifying application program, and terminal
Publication Date: 2025.06.25 HUAWEI TECH CO LTD
  • EP3873074B1 patent drawingFigure 1~2
  • EP3873074B1 patent drawingFigure 3~4a
  • EP3873074B1 patent drawingFigure 4b

AI summary

This application provides a device for recognizing an application in a mobile terminal, including: a coprocessor, configured to identify an image obtained by a signal processing device to obtain a first image category, and determine a first application corresponding to the first image category; and a main processor, configured to receive an identifier of the first application from the coprocessor, and activate the first application or prompt a user to download the first application. The device can relatively accurately determine, based on an image from an image sensor, an application that the user may want to use, and activate the application. In this process, the user does not need to tap an application icon, thereby simplifying user operations. In addition, the coprocessor implements feature extraction on the image and determines a to-be-activated application, and the main processor does not need to perform a related operation, so that processing efficiency is high, and power consumption is reduced.