Self-service terminal based on microphone array voice interaction

A self-service terminal and microphone array technology, applied in speech analysis, speech recognition, instruments, etc., can solve problems such as difficult operation and poor speech understanding, and achieve the effect of suppressing collection, convenient and simple operation, and good use effect.

Pending Publication Date: 2017-12-22
维拓智能科技(深圳)有限公司
10 Cites 9 Cited by

AI-Extracted Technical Summary

Problems solved by technology

[0005] The main purpose of the present invention is to provide a self-service terminal, which aims to solv...
View more

Abstract

The present invention discloses a self-service terminal based on the microphone array voice interaction. The self-service terminal comprises a voice interaction system used for acquiring the user voice and converting into the instructions and a control module used for receiving the instructions and outputting the services needed by the users according to the instructions, wherein the voice interaction system comprises a microphone array composed of at least two microphones. According to the present invention, by setting the microphone array to acquire the user voice, the lateral sound of the microphones is weakened, thereby inhibiting the acquisition of the noise in an environment. The voice signals are analyzed by the voice interaction system, are converted into the operation instructions and are sent to the control module, so that the identification degree and the understanding rate of the voice interaction system to the user sound in the noisy environment are enhanced relatively, and accordingly, the voice interaction system can understand and determine the user voice more accurately, the interaction efficiency between the self-service terminal and the users is improved, the operations are more convenient and simpler, and the self-service terminal has a good usage effect.

Application Domain

Speech recognition

Technology Topic

Speech soundSelf-service +2

Image

  • Self-service terminal based on microphone array voice interaction
  • Self-service terminal based on microphone array voice interaction
  • Self-service terminal based on microphone array voice interaction

Examples

  • Experimental program(1)

Example Embodiment

[0024] In order to explain the technical solutions of the present invention more clearly, the technical solutions of various embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings.
[0025] The present invention provides a self-service terminal based on microphone 11 array voice interaction, such as figure 1 As shown, the self-service terminal includes: a voice interaction system 1 for collecting user voice and converting it into instructions;
[0026] The control module 2 is used to receive the instruction and output the services required by the user according to the instruction;
[0027] The voice interaction system 1 includes a microphone 11 array composed of at least two microphones 11 for collecting user voice.
[0028] In this embodiment, the self-service terminal refers to a device that is used in communications, finance, government, transportation, medical, industry and commerce, taxation and other industries without assistance from counter personnel. The user can follow the text and screen on the interface Or voice prompts to complete the required services by themselves. For example, if the user speaks to the self-service terminal and speaks the service content or service keywords he needs, the voice interaction system 1 converts the voice into instructions after voice recognition, and the control module 2 converts the instructions into corresponding Operation, that is, after the customer speaks, the corresponding service process and operation details will be directly displayed on the display interface 3, and the customer will be prompted to perform the next operation or voice instructions, for example, enter a password or other important numbers in the input box 4, and enter the card slot Insert the identification card in 5 and receive the receipt from the receipt exit 6 until all the services required by the user are completed.
[0029] The present invention mainly completes the service required by the user through the voice interaction between the user and the terminal. The way of voice interaction is: the user speaks the service he needs to the microphone 11 according to the prompt of the self-service terminal. After the microphone array collects the voice of the user, that is, the user’s service request, the voice interaction system 1 will Recognition and processing are performed, and converted into corresponding instructions, and the instructions are sent to the control module 2, and the control module 2 can output corresponding operations according to the instructions.
[0030] Among them, the present invention includes at least two microphones 11 according to a certain geometric structure (such as linear, circular, etc.) combined into a microphone 11 array to collect user voice, because the use of the microphone array to collect user voice has the effect of reducing the sideways radio, therefore It is possible to suppress the microphone's collection of noise in the environment, and relatively enhance the recognition and understanding rate of the voice interaction system 1 of the user's voice in the noise environment.
[0031] In addition, the voice interaction system 1 of the present invention can further suppress the noise in the collected sound according to the microphone array signal processing technology, and effectively enhance the user voice in the noise environment, thereby eliminating the influence of noise on the user’s original voice and determining the signal Information about the location, intensity, and status of the source.
[0032] The invention improves the recognition of the user's voice by the method of collecting the user's voice by the microphone 11 array in combination with the self-service terminal, so that the voice interaction system 1 can more accurately understand and judge the user's voice, namely Let the self-service terminal understand the specific requirements of the user and operate accordingly, thereby improving the interaction efficiency between the self-service terminal and the user, making the user operation more convenient and simple, improving the humanized design of the product, and having a good Effect.
[0033] In a preferred embodiment, the distance between every two microphones 11 is 30-50 mm.
[0034] The distance between the two microphones 11 refers to the hole center distance between the two microphone mounting holes 7 for mounting the microphone. The present invention is mainly aimed at collecting and analyzing a single user's sound source, so an array composed of two microphones 11 is preferred, which can form an array to collect user voice, support far-field recording, de-reverberation, and noise reduction, while reducing production costs. And difficulty of realization. The distance between the two microphones 11 is 30-50 mm, preferably 40 mm. This distance is suitable for the size of commonly used self-service terminal bodies, and at the same time satisfies the range of user voice collection.
[0035] Such as figure 1 As shown, the voice interaction system 1 further includes a voice processing module 12, which is used to process the voice collected by the microphone 11 to improve the voice recognition.
[0036] Such as figure 1 As shown, the speech processing module 12 includes a noise reduction module 121 for performing noise reduction processing on the speech.
[0037] In this embodiment, the present invention mainly performs noise reduction processing for Gaussian white noise. Gaussian white noise refers to a kind of noise whose amplitude distribution obeys Gaussian distribution, and its power spectral density is uniformly distributed, including the environment where the user is located. Thermal noise and shot noise, such as car horn sound and alarm sound, which are easy to appear, the existence of these frequency bandwidth noises can easily affect the discrimination rate of the voice processing module 12 to the main sound source. In the present invention, a noise reduction module 121 is specially provided to suppress and filter these environmental noises, so as to retain a simpler main sound.
[0038] In a preferred embodiment, such as figure 1 As shown, the speech processing module 12 further includes a filtering module 122 for performing Kalman filtering on the speech. Among them, Kalman filtering refers to an algorithm that uses linear system state equations to perform optimal estimation of system state through system input and output observation data. That is, the filtering module 122 estimates the sound wave signal closest to the actual user's original voice based on the acoustic wave signal collected by the microphone 11 through optimization calculation, so as to perform further noise filtering on the user's voice.
[0039] In a preferred embodiment, such as figure 1 As shown, the voice processing module 12 further includes a beamforming module 123 for beamforming the voice to eliminate voice in the side direction of the microphone 11 and enhance voice in the vertical direction, thereby improving the transmission quality of the sound source signal.
[0040] In a preferred embodiment, such as figure 1 As shown, the speech processing module 12 also includes a speech enhancement module 124, which is used to frame the noisy speech to ensure the short-term stability of the speech, and then through windowing processing, the final output is composed of multiple adjacent speech frames Synchronize the superimposed voice signal to obtain an enhanced voice signal.
[0041] In a preferred embodiment, such as figure 1 As shown, the voice interaction system 1 further includes a semantic understanding module 13 for receiving voice signals and converting them into corresponding instructions. Wherein, the speech signal is preferably the speech processed by the speech processing module 12, which can improve the understanding of the original speech by the semantic understanding module 13.
[0042] In a preferred embodiment, such as figure 1 As shown, the semantic understanding module 13 includes a speech-to-text module 131 for converting speech into text.
[0043] In a preferred embodiment, such as figure 1 As shown, the semantic understanding module 13 further includes a matching degree calculation module 132 and an instruction query module 133. The matching degree calculation module 132 is used to convert the text into a corresponding instruction number, and the instruction query module 133 is used to The instruction number is converted into an operation instruction, and the operation instruction is sent to the control module 2.
[0044] In this embodiment, the operation mode of the semantic understanding module 13 is: the speech-to-text module 131 receives the enhanced speech signal and converts the speech into text, and the matching degree calculation module 132 converts the converted text into a corresponding instruction number. The specific method of this conversion is to perform an intersection comparison between the text and the reserved instruction number keywords in the instruction table, and calculate a ratio score. If the ratio score exceeds the system preset threshold, the comparison is considered successful. The matching degree calculation module 132 sends the instruction number to the instruction query module 133 after the comparison is successful. The instruction query module 133 queries the actual operation instruction according to the instruction number, and sends it to the control module 2, and the control module 2 outputs the corresponding service.
[0045] The present invention understands the user's voice through the semantic understanding module 13, and outputs the operation instructions of the service required by the user, which reduces the user's operation difficulty and improves the user experience.
[0046] The present invention also includes a voice output module, which is used to convey service information content and operation requirements to users through voice output, which is convenient for user groups who are inconvenient to read to use the present invention.
[0047] The present invention also includes a touch display screen and a touch interaction module, so that the user can realize touch operation through touch interaction with the self-service terminal.
[0048] The present invention is also provided with video monitoring equipment used to ensure the safety of the user's use process; 4G routers used to provide external data exchange; printers used to output required information; IC manual card readers used to input information and output device status; Three-in-one card reader used for output card demand operations; contactless card reader used for inputting information and output device status; and equipment such as encrypted keyboard used for inputting information. The purpose is to provide users with exactly the services they need to achieve the purpose of improving customer experience and improving equipment utilization.
[0049] It should be noted that the technical solutions between the various embodiments of the present invention can be combined with each other, but they must be based on what can be achieved by a person of ordinary skill in the art. When the combination of technical solutions is contradictory or cannot be achieved, it should be considered that this technical solution is The combination does not exist, nor does it fall within the scope of protection of the present invention.
[0050] The above are only part of or preferred embodiments of the present invention. Neither the text nor the drawings can therefore limit the scope of protection of the present invention. All the contents of the description and drawings of the present invention are used under the overall concept of the present invention. The equivalent structural transformation, or direct/indirect application in other related technical fields are all included in the protection scope of the present invention.

PUM

no PUM

Description & Claims & Application Information

We can also present the details of the Description, Claims and Application information to help users get a comprehensive understanding of the technical details of the patent, such as background art, summary of invention, brief description of drawings, description of embodiments, and other original content. On the other hand, users can also determine the specific scope of protection of the technology through the list of claims; as well as understand the changes in the life cycle of the technology with the presentation of the patent timeline. Login to view more.

Similar technology patents

Information communication system and method

PendingCN111240867ASimplify the interaction processImprove interaction efficiency
Owner:CHINA MOBILEHANGZHOUINFORMATION TECH CO LTD +1

Method, system and device for setting electronic certificate and data exchange

InactiveCN106415629ADiversified receipt formsImprove interaction efficiency
Owner:SHENZHEN CIFPAY NETWORK BANK TECH

Smart television interactive service operation system and method based on operation resource sharing

ActiveCN110401871AImprove interaction efficiencyReduce overall computation
Owner:ZHEJIANG UNIVERSITY OF MEDIA AND COMMUNICATIONS

Live streaming interaction method and device, equipment and storage medium

ActiveCN113163268AImprove interaction efficiencyEnsure fairness
Owner:WUBA

Video data processing method, device and system

PendingCN112402954AImprove interaction efficiency
Owner:BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products