Terminal Device Face Detection for Secure Voice Activation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional contactless operation methods for mobile devices lack security, allowing unauthorized activation of voice communication functions, leading to potential unintended answering of incoming calls by others.

Innovation Solution

A terminal device equipped with a microphone, communication unit, depth sensor, and processor, which performs face detection to control the sound input mode, ensuring that voice communication functions are activated only by a specific user based on authenticated face presence.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If contactless operation methods are implemented without face authentication, then ease of operation is improved, but security deteriorates

Engineering Contradiction:

Improvecontactless activationVSAvoidsecurity

Core Design Contradiction:

Ease of operationVSReliability

Solution Approach 1:

The system performs preliminary face authentication before enabling contactless voice activation. The authentication unit verifies the user's identity using depth information and face detection before allowing the sound input mode to be activated, ensuring that only authorized users can utilize the contactless operation feature.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The authentication unit acts as an intermediary between the face detection unit and the sound input mode activation. It processes the depth information and face detection results to determine whether to grant access to the sound input mode, thereby mediating between security requirements and ease of operation.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Reliability

If face detection and authentication are performed, then security is improved, but device complexity increases

Engineering Contradiction:

ImprovesecurityVSAvoidsystem complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The authentication unit is designed to perform multiple functions: it processes depth information from the depth sensor, executes face detection, verifies user identity, and controls the activation of sound input mode. By consolidating these functions into a single multi-functional unit, the system achieves security enhancement without proportionally increasing overall device complexity.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines the face detection unit, authentication unit, and sound input mode control into an integrated system. The authentication unit merges the tasks of verifying depth information, detecting faces, and controlling mode activation, thereby reducing the number of separate components and simplifying the overall system architecture.

Inventive Principle:

Principle #5Merging (Combining)

3Reliability

If manual button operations are required, then security is maintained, but ease of operation deteriorates

Engineering Contradiction:

ImprovesecurityVSAvoidoperation convenience

Core Design Contradiction:

ReliabilityVSEase of operation

Solution Approach 1:

The system replaces the mechanical button press operation with a contactless face-based authentication and activation mechanism. Instead of requiring physical interaction with a button, the user simply needs to be within the detection range and have their face recognized, substituting mechanical input with optical and acoustic sensing.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service operation where the user's presence and facial features automatically trigger the activation of sound input mode without requiring manual intervention. The face detection and authentication process autonomously determines when to activate or deactivate the sound input mode based on real-time detection results.

Inventive Principle:

Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances security by allowing contactless activation of voice communication functions specifically for the intended user, preventing unintended activation by others, and simplifies the operation process by eliminating the need for manual button operations.

Implementation Method 1

a first sensor 14, which is configured to obtain depth information

Methodology Applied

Scientific EffectTime of Flight: Time of Flight

Data Source

PatentUS11979511B2Terminal device, terminal device control method, and memory medium

Publication Date: 2024.05.07 SONY GROUP CORP

AI summary

A terminal device according to an embodiment includes: a microphone; a communication unit that performs communication via a network; a first sensor that obtains depth information; a first face detecting unit that detects a face and the distance to the face based on the depth information; and a processor. When a communication program, which is meant for making the processor perform transmission and reception of messages including voice messages and which has a sound input mode for enabling collection of sounds using the microphone and transmission of voice messages based on the collected sounds, is executed, and when a message is received by the communication unit under the control of the communication program being executed; the processor performs first-type face detection using the first face detecting unit and controls turning ON and turning OFF the sound input mode according to the result of the first-type face detection.