Unlock instant, AI-driven research and patent intelligence for your innovation.

Method, device, system and storage medium for executing natural language commands in combination with UI

A natural language and natural language processing technology, applied in speech analysis, speech recognition, instruments, etc., can solve problems such as inability to understand and correctly respond to user natural language commands, lack of semantics, and the state of NLP devices losing UI, so as to improve interaction The effect of experience

Active Publication Date: 2018-12-21
杭州蓦然认知科技有限公司
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, the instructions between different existing human-computer interaction methods are isolated and cannot communicate with each other. In the process of interaction between the user and the device, there is a need to switch between multiple interaction modes. If the user interacts with the device In the process of voice interaction, the change of the UI (User Interface, user interface) state of the device is not caused by the user input voice, which will cause the NLP device to lose the UI state, or the voice input by the user has semantic missing related to the UI state , resulting in the inability to understand and correctly respond to the user's natural language commands, reducing the interactive experience

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, device, system and storage medium for executing natural language commands in combination with UI
  • Method, device, system and storage medium for executing natural language commands in combination with UI
  • Method, device, system and storage medium for executing natural language commands in combination with UI

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0055] Embodiment one : The UI state is triggered to change due to the non-voice interaction operation performed by the user during the voice interaction with the smart device

[0056] Here, the manner of non-voice interactive operation includes but not limited to at least any one of the following: - remote controller; - keyboard; - joystick; on-board buttons.

[0057] For example, user A wants to search for Faye Wong's music by voice through smart device 1 (assuming that smart device 1 is an electronic product such as a smart voice TV), assuming that the smart voice TV is equipped with a client corresponding to natural language processing device 2, such as Voice -APP, user A opens the client, or wakes it up by voice, or directly sends the natural language command "Faye Wong's music" to the smart voice TV, and gets the result list returned by the natural language processing device 2, such as list-1 At this time, user A selects the third song in the list through the TV remote...

Embodiment 2

[0059] Embodiment two : The smart device automatically switches to the next item after playing the current item, triggering the UI state to change

[0060] Also, following the above example, after user A’s smart voice TV plays the second episode of "Three Lives, Three Worlds, Ten Miles of Peach Blossom", it automatically switches to the next episode for playback, and then the detection device 11 uses the application provided by the smart voice TV itself. The program interface (API) detects that the UI state of the TV is changed because the smart voice TV automatically switches to the next item after playing the current item.

[0061] Here, the next item may be the next one of a long program such as the next song, the next episode of a TV series, the next episode of a program, or a plurality of relatively independent paragraphs or parts in a film.

[0062] Here, it should be noted that the item played by the smart device may be played through a third-party multimedia website ...

Embodiment 3

[0063] Embodiment Three : A third-party application installed in the smart device triggers the UI state to change

[0064] For example, assuming that the smart device 1 of user A is a smart vehicle-mounted device, in addition to carrying a client corresponding to the natural language processing device 2 such as Voice-APP, the smart device 1 is also installed with a third-party application such as a navigation APP. A drives from location-A to location-B, and sets a navigation route such as Route-A on the navigation app. When the navigation app navigates to the destination location-B, the navigation state is automatically terminated, or the vehicle does not follow the original navigation route Route- A's driving causes the navigation APP to regenerate the navigation route Route-B, and the detection device 11 can obtain these changes through the application program interface (API) provided by the third-party application itself, and then judge that the UI state has changed. Trig...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The purpose of the invention is to provide a method, a device and a system for executing a natural language command of a user based on the state of a UI (User Interface). The method specifically includes the following steps: detecting whether the state of UI changes; if the state of UI changes, acquiring corresponding relevant information; sending the relevant information to a natural language processing device used for responding to voice interaction commands of a users; and acquiring a natural language command input by a user, and sending the natural language command to the natural language processing device. Compared with the prior art, natural language commands of users are executed according to the state of UI in the process of voice interaction between users, so that natural language commands of users can be responded to correctly in the process of voice interaction between users even if the UI state change of the device is not caused by voice input by users, and the interaction experience is enhanced.

Description

technical field [0001] The present invention relates to the technical field of voice interaction, in particular to a technology for executing a user's natural language command in combination with a UI state. Background technique [0002] The interaction between the user and the device includes button control, remote control control, somatosensory control, touch operation control, graphic control, etc. With the development of NLP (Natural Language Processing, natural language processing) technology, another interaction mode has been added between the user and the device, that is, voice interactive control. [0003] However, the instructions between different existing human-computer interaction methods are isolated and cannot communicate with each other. In the process of interaction between the user and the device, there is a need to switch between multiple interaction modes. If the user interacts with the device In the process of voice interaction, the change of the UI (Use...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G10L15/22G10L15/18G10L15/34
CPCG10L15/1822G10L15/22G10L15/34G10L2015/223
Inventor 戴帅湘袁志伟李国华李龙飞张伟萌
Owner 杭州蓦然认知科技有限公司