Unlock instant, AI-driven research and patent intelligence for your innovation.

Automatically adapting user interfaces for hands-free interaction

A user-friendly, hands-free technology that is applied to devices with voice recognition, branch office equipment, electrical components, etc., and can solve problems that hinder security, device or system practicality, and usability limitations

Inactive Publication Date: 2014-07-30
APPLE INC
View PDF4 Cites 91 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, if the specific limitations inherent in hands-free operation are not taken into account, situations can arise where both the utility and usability of the device or system are limited, and can even hinder safety

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatically adapting user interfaces for hands-free interaction
  • Automatically adapting user interfaces for hands-free interaction
  • Automatically adapting user interfaces for hands-free interaction

Examples

Experimental program
Comparison scheme
Effect test

example 1

[0302] Example 1: call the contact, clear

[0303] User's voice input: "Call Adam Smith"

[0304] · Voice output from assistant 1002: "Calling Adam Smith, mobile phone."

[0305] ·dial number

[0306] Similar interactions would occur for any of the following use cases:

[0307] · Call a contact by name (“Call Adam Smith”)

[0308] · Call a contact by name, non-default phone number ("Call Adam Smith Mobile")

[0309] Call by number (“Call 800 555 1212”)

[0310] · Call a contact by relationship alias ("Call my mom")

[0311] · Call contacts by location alias (“call home”)

[0312] Call via FaceTime (“Video call with Adam Smith”)

[0313] Call back by context ("Call him back")

example 2

[0314] Example 2: Canceling a phone call

[0315] User's voice input: "Call Adam Smith"

[0316] · Voice output from assistant 1002: "Calling Adam Smith, mobile phone."

[0317] The user notices that the wrong person is calling; the user presses the home button once to cancel the call, or say "Stop"

[0318] · The call was canceled

example 3

[0319] Example 3: Call by name, ambiguous

[0320] User's voice input: "Call Adam"

[0321] Speech output from assistant 1002: "Multiple matches found for Adam "

[0322] · Assistant 1002's visual output: "Multiple matches found for Adam "

[0323] Speech output of the assistant 1002: read the name aloud

[0324] · Assistant 1002's visual output:

[0325] Disambiguation menu

[0326] Adam Shanye Residence

[0327] Adam Sandler Residence

[0328] adam smith mobile

[0329] User's voice input: "Adam Shanye"

[0330] Voice output from assistant 1002: "Calling Adam Shanye"

[0331] ·dial number

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A user interface for a system such as a virtual assistant is automatically adapted for hands-free use. A hands-free context is detected via automatic or manual means, and the system adapts various stages of a complex interactive system to modify the user experience to reflect the particular limitations of such a context. The system of the present invention thus allows for a single implementation of a complex system such as a virtual assistant to dynamically offer user interface elements and alter user interface behavior to allow hands-free use without compromising the user experience of the same system for hands-on use.

Description

technical field [0001] The present invention relates to multimodal user interfaces, and more particularly, to user interfaces that include both voice-based and visual modalities. Background technique [0002] Many existing operating systems and devices use voice input as a modality through which users can control operations. One example is a voice command system that maps specific verbal commands into actions, such as to initiate the dialing of a phone number by speaking a person's name. Another example is an Interactive Voice Response (IVR) system that allows people to access static information through a telephone, such as an automated telephone help desk. [0003] Many voice command and IVR systems are relatively narrow in scope and can only handle a predetermined set of voice commands. Furthermore, its output is usually obtained from a fixed set of responses. [0004] An intelligent automated assistant, also referred to herein as a virtual assistant, is capable of prov...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H04M1/725H04M1/72436H04M1/72454
CPCH04M2250/74H04M1/72436H04M1/72454
Inventor 托马斯·罗伯特·格鲁贝尔哈里·J·萨德勒
Owner APPLE INC