Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

AR interface interaction method based on speech recognition engine and system thereof

A voice recognition engine and interface interaction technology, applied in the field of AR, can solve the problem that the player's voice cannot be recognized, and achieve the effect of improving accuracy

Inactive Publication Date: 2017-10-20
WUHAN AR SHOW SOFTWARE CO LTD
View PDF5 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The technical problem to be solved by the present invention is to provide an AR interface interaction method and system based on a voice recognition engine, which solves the problem that the player's voice cannot be recognized by the existing augmented reality technology, and can not only improve the playability of AR game applications , also enriches the interaction between people and virtual reality, and enhances the fun of AR technology products

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • AR interface interaction method based on speech recognition engine and system thereof
  • AR interface interaction method based on speech recognition engine and system thereof
  • AR interface interaction method based on speech recognition engine and system thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0051] The principles and features of the present invention are described below in conjunction with the accompanying drawings, and the examples given are only used to explain the present invention, and are not intended to limit the scope of the present invention.

[0052] Such as figure 1 Shown, a kind of AR interface interaction method based on speech recognition engine comprises the following steps,

[0053] S1, using a speech recognition engine to generate a speech command;

[0054]S2. Identify the coordinate position of the virtual object in the AR interface, and make the virtual object in the AR interface perform a corresponding interactive behavior at the coordinate position according to the voice instruction.

[0055] In this specific embodiment, the S1 is specifically, such as figure 2 as shown,

[0056] S11, performing offline learning on the vocabulary that requires speech recognition to obtain a speech recognition library;

[0057] S12, importing the speech rec...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an AR interface interaction method based on a speech recognition engine and a system thereof. The method comprises the following steps of S1, generating a speech instruction by means of the speech recognition engine; and S2, recognizing the coordinate position of a virtual object in the AR interface, and making the virtual object in the AR interface perform a corresponding interaction behavior at the coordinate position according to the speech instruction. The AR interface interaction method based on the speech recognition engine settles a problem of incapability of recognizing the speech of a player in existing augment reality technology, and improves interaction between human and a game in AR application. Not only is interaction with the virtual object through a picture realized, but also a control function to certain behaviors of the virtual object through the speech can be performed. Furthermore interest and playability of an AR game are improved.

Description

technical field [0001] The present invention relates to the field of AR technology, in particular to an AR interface interaction method and system based on a speech recognition engine. Background technique [0002] The existing gameplay of augmented reality (Augmented Reality, AR) games is that players operate the buttons on the device interface to perform behavioral operations on virtual characters, but this gameplay cannot quickly achieve commanding virtual objects on the AR interface. At the same time, the existing speech recognition technology cannot achieve high recognition accuracy for the recognition of large vocabulary, and in AR games, it is impossible to allow a high false detection rate for voice commands. The false positive rate will reduce the playability of the game. Contents of the invention [0003] The technical problem to be solved by the present invention is to provide an AR interface interaction method and system based on a voice recognition engine, wh...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G10L15/06G10L15/22G06F3/01G06F9/44
CPCG06F3/011G06F8/38G10L15/063G10L15/22
Inventor 胡德志孙碧亮袁超飞
Owner WUHAN AR SHOW SOFTWARE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products