Camera Subsystem Initialization via Sensor Predictions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current mobile devices require multiple user actions to transition from a locked state to a usable state, including power-saving, input-lock, and security-lock states, which is inefficient and time-consuming, especially with existing camera-based unlocking methods that only activate after user interaction.

Innovation Solution

A mobile device automatically initializes its camera subsystem based on sensor inputs such as angular acceleration, light, proximity, and audio transitions, anticipating the user's intention to unlock, and uses facial recognition for authentication, potentially uploading a captured photo to a social network.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If the camera subsystem is activated only after user interaction, then power consumption is reduced, but the unlocking process becomes slower and less convenient

Engineering Contradiction:
Improveunlocking process timeVSAvoidcamera power consumption
Core Design Contradiction:
Loss of timeVSUse of energy by moving object

Solution Approach 1:

The camera subsystem is activated in advance based on sensor predictions of user intent (detecting when the user picks up the device, removes it from a pocket, or approaches it). This preliminary activation occurs before the user actually interacts with the device to unlock it, thereby reducing the total unlocking time while only consuming power when sensor conditions indicate imminent user interaction

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Multiple sensors (accelerometer, light sensor, proximity sensor, microphone) continuously monitor environmental and device state changes, providing feedback about user behavior patterns. This feedback loop allows the system to intelligently predict when the user will interact with the device and activate the camera subsystem at the optimal moment, balancing power consumption with unlocking speed

Inventive Principle:
Principle #23Feedback

2Ease of operation

If multiple sensor inputs are monitored to predict user intent, then the user experience is enhanced, but the device complexity increases

Engineering Contradiction:
Improveunlocked state accessibilityVSAvoidsensor hub complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The sensor hub is designed to perform multiple functions: it monitors various sensor inputs (accelerometer, light, proximity, microphone), processes this data to predict user intent, and triggers appropriate system responses (camera activation, screen wake). By making the sensor hub multi-functional, the patent reduces the need for separate dedicated components for each sensing task, thereby managing complexity while enhancing user experience

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution streamlines the unlocking process by reducing the number of user interactions needed, enhancing efficiency and convenience by automatically preparing the camera for image capture and authentication, and allowing seamless integration with social network updates.

Implementation Method 1

detects the angular acceleration about one or more axis from an accelerometer or gyrometer in a sensor hub indicative of a user picking up the mobile device

Methodology Applied
Scientific EffectAccelerometer: Accelerometer

Implementation Method 2

detects a transition from a low-light to high-light environment via a light sensor in a sensor hub indicative of a user removing the mobile device from a pocket, bag, or case

Methodology Applied
Scientific EffectLight sensor: Photoelectric Effect

Implementation Method 3

detects a transition from having nearby objects to having no nearby objects via a proximity sensor indicative of the mobile device being removed from a pocket, bag, or case

Methodology Applied
Scientific EffectProximity sensor:

Implementation Method 4

detects a transition from a low volume to high volume environment via a microphone indicative of the mobile device being removed from a pocket, bag, or case

Methodology Applied
Scientific EffectMicrophone: Electret

Data Source

PatentUS10728442B2Initializing camera subsystem for face detection based on sensor inputs
Publication Date: 2020.07.28 META PLATFORMS INC
  • US10728442B2 patent drawing
  • US10728442B2 patent drawing

AI summary

In one embodiment, a method comprises monitoring one or more sensors of a computing device that is in a locked state and is associated with an authorized user of a social-networking system, identifying, based on information associated with the authorized user, content to be downloaded from the social-networking system, and downloading the identified content from the social-networking system, wherein the identified content is stored for display after the computing device is unlocked. The downloading may be in response to determining that an operation to unlock the computing device is imminent, and the content may include commonly-viewed content. The downloading may include downloading one or more notifications from the social-networking system. The downloading may be based on one or more previous habits of the authorized user. The information associated with the authorized user may include information indicating that the authorized user habitually checks one or more sites or feeds.