Command processing using multi-modal signal analysis

By analyzing multimodal signals and combining them with signal modalities such as posture and gaze direction, the system can identify and respond to commands and queries based on natural human behavior. This solves the limitations of existing systems in specific domains and locations, and enables flexible and accurate natural language interaction.

CN115273252BActive Publication Date: 2026-06-23APPLE INC
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
APPLE INC
Filing Date
2017-08-15
Publication Date
2026-06-23

AI Technical Summary

Technical Problem

Existing systems, when detecting and responding to natural human movement and conversational queries, are typically limited to specific domains and locations and cannot effectively utilize natural human behavior for general-purpose interactions.

Method used

A multimodal signal analysis method is adopted, which combines signal modalities such as posture and gaze direction. Signal data is acquired through sensors, and machine learning and natural language processing techniques are used to identify the objects of individual attention and perform related operations.

Benefits of technology

It achieves accurate recognition and response to natural language commands and queries in non-location and domain-specific contexts, supports comprehensive analysis of multiple signal modalities, and improves the system's flexibility and accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115273252B_ABST
    Figure CN115273252B_ABST
Patent Text Reader

Abstract

The present disclosure relates to command processing using multi-modal signal analysis. A first set of signals corresponding to a first signal modality, such as the direction of gaze, is collected from an individual during a time interval. A second set of signals corresponding to a different signal modality, such as a finger pointing gesture made by the individual, is also collected. In response to a command, where the command does not identify a particular object to which the command is directed, the first and second sets of signals are used to identify candidate objects of interest, and an operation associated with a selected object from the candidate objects is performed.
Need to check novelty before this filing date? Find Prior Art