Touch screen interactive system combined with clicking, sliding, gesture recognition and voice

An interactive system and gesture recognition technology, applied in the input/output process of data processing, telephone communication, instruments, etc., to achieve the effect of reducing the misoperation rate

Inactive Publication Date: 2014-01-08
BEIHANG UNIV
View PDF8 Cites 19 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Problems solved by the technology of the present invention: In order to overcome the difficulties encountered by the visually impaired (especially the blind) when using the existing technology, a touch screen interactive system combining click, slide, gesture recognition and voice is provided, which solves the problem of the visually impaired ( Especially for blind people) when using touch screen devices, the problems of fast positioning, precise input and quick operation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Touch screen interactive system combined with clicking, sliding, gesture recognition and voice
  • Touch screen interactive system combined with clicking, sliding, gesture recognition and voice
  • Touch screen interactive system combined with clicking, sliding, gesture recognition and voice

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] Such as figure 1 As shown, the interactive system of the present invention includes four functional modules: a dialing module, an address book module, a call record module, an emergency call module, and an engine control module. The dialing module and the address book module perform operations such as adding, deleting, modifying and checking the information in the existing database, and the call recording module and the emergency call module query the information in the database. All operations on the database are coordinated and controlled by the engine control module, which is also responsible for switching among the four functional modules.

[0047] Such as figure 2 As shown, the specific implementation of the dialing module in the present invention is as follows:

[0048] (1) Capture user gestures;

[0049] (2) Capture the match between the gesture and the gesture symbol library of the system, and return the operation information corresponding to the gesture;

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Disclosed is a touch screen interactive system combined with clicking, sliding, gesture recognition and voice. Top-down sliding is conducted at the left end of a touch screen, so that node information in a content page is obtained, and voice broadcast output is achieved. Left-to-right sliding is conducted on the screen until sliding is achieved to the right end of the screen, starting of selected nodes or page switchover of selected content nodes is achieved, and meanwhile location information of voice broadcast is obtained. By the way of sliding on the screen and drawing up stipulated gesture symbols, operation represented by the stipulated gesture symbols is achieved or corresponding functions are started, and operation voice prompt information is obtained. All the content nodes are designed to be slide switches, the corresponding routine user operation of fixed gesture symbols is defined, through the way of finger sliding on the screen, users can achieve the operation like 'turning on', 'inputting', 'dialing', 'returning', 'undoing' and the like, all the gesture symbols are designed to be 'one stroke' input, meanwhile, voice auxiliary prompt is achieved accompanying each operation and inputting process, and therefore the purpose that the users can accurately and rapidly operate and use equipment is guaranteed.

Description

technical field [0001] The present invention relates to an intelligent touch screen terminal device, in particular to a touch screen terminal device interaction system for the visually impaired (especially the blind), to help the visually impaired operate more quickly and accurately and use the smart touch screen terminal equipment. Background technique [0002] At present, the mobile phones used by the visually impaired, especially the blind, are mainly divided into two categories: one is the "blind mobile phone" specially designed and produced for the blind. Prompt the blind to make corresponding operations through voice; the other is to install screen voice assistant software on some ordinary mobile phones equipped with smart phone systems, so that the blind can complete operations with the help of voice prompts. The latter is more popular with the blind due to the novel style of the mobile phone and the support for installing software applications for personal needs. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/0488G06F3/0484H04M1/725
Inventor 宋友杨娜杨帆张野
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap