Unlock instant, AI-driven research and patent intelligence for your innovation.

Information processing method and apparatus

An information processing method and a technology for inputting information, which are applied in the field of multi-modal user interfaces, can solve problems such as inability to reflect meanings, errors in language interpretation, and inability to process and express input meanings.

Inactive Publication Date: 2006-07-05
CANON KK
View PDF4 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, these existing techniques require complex processing such as language interpretation in integrating multiple types of modalities
Even if such complex processing is performed, the meaning of the input intended by the user may not be reflected in the application due to interpretation errors in language interpretation, etc.
The technology represented by XHTML+Voice profile and SALT and the conventional description method using markup language do not have a solution to deal with the semantic attribute description representing the meaning of the input

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Information processing method and apparatus
  • Information processing method and apparatus
  • Information processing method and apparatus

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0042] FIG. 1 is a block diagram showing a basic configuration of an information processing system according to a first embodiment. The information processing system has a GUI input unit 101, a speech input unit 102, a speech recognition / interpretation unit 103, a multimodal input integration unit 104, a storage unit 105, a mark analysis unit 106, a control unit 107, a speech synthesis unit 108, a display unit 109 and communication unit 110.

[0043] The GUI input unit 101 includes an input device such as a button group, a keyboard, a mouse, a touch panel, a pen, a tablet, and the like, and serves as an input interface for inputting various instructions from a user to this device. The voice input unit 102 includes a microphone, an A / D converter, etc., and converts what the user says into a voice signal. The speech recognition / interpretation unit 103 interprets a speech signal supplied from the speech input unit 102, and performs speech recognition. Note that a known technolo...

no. 2 example

[0102] A second embodiment of the information processing system according to the present invention will be described below. In the foregoing example of the first embodiment, a semantic attribute is assigned to a piece of input information (GUI element or input voice). The second embodiment will exemplify a case where a plurality of semantic attributes can be assigned to a piece of input information.

[0103] Fig. 20 shows an example of an XHTML document for expressing each GUI component in the information processing system according to the second embodiment. In FIG. 20, it is described by the same description method as that of FIG. 3 in the first embodiment Tags, type attributes, value attributes, ref attributes, and class attributes. However, unlike the first embodiment, the class attribute describes a plurality of semantic attributes. For example, a button having a value of "Tokyo" describes "station (station) area (area)" in its class attribute. The markup parsing unit...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

In an information processing method for processing a user's instruction on the basis of a plurality of pieces of input information which are input by a user using a plurality of types of input modalities, each of the plurality of types of input modalities has a description including correspondence between the input contents and semantic attributes. Each input content is acquired by parsing each of the plurality of pieces of input information which are input using the plurality of types of input modalities, and semantic attributes of the acquired input contents are acquired from the description. A multimodal input integration unit integrates the acquired input contents on the basis of the acquired semantic attributes.

Description

technical field [0001] The present invention relates to so-called multimodal user interfaces for issuing instructions using multiple types of input modalities. Background technique [0002] It is very convenient for a user to have a multimodal user interface that allows input using a desired modality among various types of modalities (input modes) such as GUI input, voice input, and the like. In particular, high convenience is obtained by performing input using a plurality of types of modalities at the same time. For example, when a user clicks a button indicating an object on the GUI while issuing an instruction word such as "this", even a user who is not accustomed to technical language such as a command can freely operate the target device. In order to obtain such an operation, processing for integrating input through various types of modalities is required. [0003] As examples of processing for integrating input through various types of modalities, a method of applyin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/00G06F3/01G06F3/033G06F3/038G06F3/16G10L15/18
CPCG10L15/1815G10L15/19G06F3/16G06F3/038G10L15/1822G06F3/00G06F9/00
Inventor 近江裕美广田诚中川贤一郎
Owner CANON KK