Intelligent system based on open-source wireless mouse and used for helping disabled people

An intelligent and wireless technology, applied in the input/output process of data processing, the input/output of user/computer interaction, instruments, etc., can solve problems such as difficulties in using computers and electrical appliances

Inactive Publication Date: 2016-08-10
NANCHANG UNIV
View PDF3 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The present invention aims at the difficulty in using computers and electrical appliances for persons with physical disabilities, and provides an intelligent disability assistance system based on an open-source wireless mouse, which can liberate the limbs of persons with disabilities

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent system based on open-source wireless mouse and used for helping disabled people
  • Intelligent system based on open-source wireless mouse and used for helping disabled people
  • Intelligent system based on open-source wireless mouse and used for helping disabled people

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] Refer to attached figure 1. Intelligent disability assistance system based on open source wireless mouse, including Arduino pro mini main controller module, gravity sensor module, non-specific human speech recognition module, infrared emission sensor module, wireless bluetooth module, power supply module, VB mouse control host computer and VB electrical appliance control PC. Wherein, the wireless bluetooth module is composed of a master module and a slave module. For the gravity sensor module, the gravitational acceleration gyroscope sensor MPU6050 is preferred; for the non-specific human voice recognition module, the voice recognition chip LD3320 designed by ICRoute is preferred; for the infrared emission sensor module, the infrared emission module compatible with open source hardware series is preferred; wireless Bluetooth module, HC-05 is preferred; USB transfer interface, CP2102USB to UART data converter is preferred.

Embodiment 2

[0040] Refer to attached figure 2 . The system is fixed in a hanging decoration carrier shell, and the hanging decoration carrier is clamped on the headset or earphone, and the movement of the entire system information collection module and signal transmission module in the casing is driven by the up, down, left, and right movement of the head. When the system is working, firstly power it on. After power on, the Bluetooth will automatically pair. After the pairing is successful, the system enters the standby mode. Once the voice recognition module collects the "start" voice command, the system starts to operate, the mouse enters the flag, and the MPU6050 senses The head moves and converts this moving signal into a corresponding electrical signal, and transmits it to the Arduino pro mini microcontroller, and then transmits it to the computer through the wireless Bluetooth through the USB interface to control the movement of the cursor, which solves the problem of armless disab...

Embodiment 3

[0044] Refer to attached image 3 . The non-specific speech recognition module LD3320 has a quick response, 50 voices capacity, non-specific speech recognition, supports local Mandarin pronunciation, and can realize speech recognition, voice control, and man-machine dialogue functions. First, use it to collect human voice information under certain conditions, and input instructions, such as "left button", "right button", "double click", "correction", "acceleration", "deceleration", "stop", "termination" Wait for instructions. If the non-specific person voice recognition module collects the corresponding cursor control command, the cursor can be controlled to realize the corresponding functions of the mouse, such as "click", "double click", "stop" and so on; if the electrical voice control command is collected, then Select the selected electrical appliance for voice control. For the switch, connect the AC terminal of the relay module to the neutral switch, and use the voice t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

An intelligent system based on an open-source wireless mouse and used for helping disabled people comprises a main controller, a gravity sensor module, a speaker-independent voice recognition module, an infrared ray emission sensor module, a wireless Bluetooth module, a VB mouse control upper computer, a VB electric appliance control upper computer and the like. The gravity sensor module and the speaker-independent voice recognition module are used for acquiring and transmitting movement information of the head of disabled people or other parts of a body and voice information to the main controller, the movement information and the voice information are transmitted to the VB mouse control upper computer through the wireless Bluetooth module, a cursor is controlled through voice and head movement of the disabled people, and the mouse function is realized. The mouse is taken as a core, the infrared ray emission sensor module and the VB electric appliance control upper computer are added, an emitter is controlled through voice or the VB electric appliance control upper computer to emit infrared emission codes of common appliances such as an air conditioner, a television and the like, infrared wireless communication between the system and the appliances is realized, and the system can assist the disabled people without arms in controlling some common household appliances.

Description

technical field [0001] The invention belongs to the technical field of artificial intelligence, and in particular relates to a mouse control system controlled by head movement and voice. Background technique [0002] In the modern society with the rapid development of information, computers and electrical appliances have gradually become the necessities of the family, but the control of these devices largely depends on the human limbs, so it is difficult for those with armless disabilities or high amputee patients to operate. It is convenient for them to communicate with the outside world and even take care of themselves. Some existing voice-activated mice can only be used in a limited environment; there is also a gyroscope device, which can determine the change of the orientation by using a single gyroscope, and multiple gyroscopes can make the judgment of the target rotation, but if the user Turning in circles or turning the head, the gyroscope will not be able to disting...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/01G06F3/16
CPCG06F3/012G06F3/16
Inventor 廖庆洪秦丹曾维鋆胡婉如
Owner NANCHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products