Phone-to-Ear Gesture Recognition Using Sensor Fusion
Solution Overview
Problem
The existing systems for recognizing the 'phone-to-ear' gesture in mobile devices rely on proximity sensors, which occupy space, consume energy, and increase manufacturing costs, and are aesthetically undesirable due to the need for notches in the screen design.
Innovation Solution
A system that integrates a movement sensor and a pressure sensor with a sensor-fusion algorithm to recognize the gesture of bringing a mobile device to a user's ear, eliminating the need for a proximity sensor by using sensors already present in the device, such as accelerometers and pressure sensors, to detect movement and pressure changes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a proximity sensor is used to recognize the phone-to-ear gesture, then the gesture recognition function is achieved, but the device occupies more space and requires a larger top border
Solution Approach 1:
The patent extracts the proximity sensing function from a dedicated proximity sensor and implements it using existing sensors (accelerometer and pressure sensor) that are already present in the device. This eliminates the need for additional sensor components and their associated mounting space, thereby removing the constraint on top border area while maintaining gesture recognition capability.
Solution Approach 2:
The patent makes existing sensors (accelerometer and pressure sensor) perform multiple functions: the accelerometer detects device orientation and movement, the pressure sensor detects pressure changes during phone-to-ear gesture, and together they enable gesture recognition without requiring a dedicated proximity sensor. This multi-functionality approach eliminates the need for additional components and space.
2Reliability
If a proximity sensor is used to recognize the phone-to-ear gesture, then the gesture recognition function is achieved, but the power consumption increases
Solution Approach 1:
The patent makes existing sensors (accelerometer and pressure sensor) perform multiple functions. These sensors are already operational for other device functions, so utilizing them for gesture recognition avoids the additional power consumption that would result from operating a dedicated proximity sensor continuously.
Solution Approach 2:
The patent enables the device's existing sensor system to serve itself by using the accelerometer and pressure sensor data that are already being collected for other purposes. This self-service approach eliminates the need for additional power-consuming components while maintaining gesture recognition functionality.
3Reliability
If a proximity sensor is used to recognize the phone-to-ear gesture, then the gesture recognition function is achieved, but the device complexity and manufacturing cost increase
Solution Approach 1:
The patent extracts the proximity sensing capability from a dedicated hardware component and implements it through software processing of data from existing sensors. This eliminates the need for additional PCB components, connection paths, and mounting structures, thereby simplifying the overall device architecture and reducing manufacturing complexity.
Solution Approach 2:
The patent makes existing sensors perform multiple functions, including gesture recognition. By reusing existing components rather than adding new ones, the patent reduces the number of components on the PCB, simplifies the electrical architecture, and reduces manufacturing steps while maintaining the gesture recognition function.
4Reliability
If a proximity sensor is used to recognize the phone-to-ear gesture, then the gesture recognition function is achieved, but a notch is required in the screen design
Solution Approach 1:
The patent extracts the proximity sensing function from a physical component that would require a notch in the screen and implements it using existing sensors. This eliminates the need for any physical opening or notch in the screen, allowing for a complete borderless design while maintaining gesture recognition capability.
Solution Approach 2:
The patent enables existing sensors to perform the proximity detection function, eliminating the need for a dedicated proximity sensor component that would require a notch. This allows the screen to maintain its full aesthetic design without any interruptions or notches.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution reduces device dimensions, simplifies PCB layout, lowers manufacturing costs, and decreases power consumption while effectively recognizing the 'phone-to-ear' gesture without the need for a proximity sensor, enhancing user experience and device efficiency.
Implementation Method 1
a movement sensor configured to provide a movement signal indicative of the movement of the mobile electronic device
Implementation Method 2
A pressure sensor is configured to provide a pressure signal indicative of the pressure acting on the mobile electronic device during the movement
Data Source
AI summary
A system recognizes a gesture of bringing a mobile electronic device to a user ear. The system may be integrated in the mobile electronic device and is provided with a movement sensor which provides a movement signal indicative of the movement of the mobile electronic device. A pressure sensor provides a pressure signal indicative of a pressure acting on the mobile electronic device during the movement. A processing stage performs a joint processing of the movement signal and of the pressure signal in order to recognize the gesture.