Oral Device Control System

Abstract

A mechanism is provided for implementing an intraoral control mechanism that allows a user to control the operation of a computer system or electronic device. The intraoral control mechanism detects strain due to the user's tongue moving the control mechanism away from a fixed position, converts the detected strain into a control signal, amplifies the amplitude of the control signal, thereby generating an amplified control signal, converts the amplified control signal into a digital input signal, modulates the digital input signal to a transmission frequency, and transmits the digital input signal to a computer system. The computer system may then either execute the digital control signal on the computer system itself to perform an action or transmit the digital control signal to an electronic device to operate as indicated by the digital control signal. The digital input signal is stored for user characterization.

Description

[Technical field]

[0001] This application relates to an intraoral device and user interface system for controlling a computer or other device by the movement of the tongue and jaw of a user. It can be used by people with different assistance needs, from non-disabled to quadriplegic. The mechanism can be used by humans in tasks where both hands and possibly both feet are occupied, or in cases of impaired limbs. The mechanism may also be used in situations where it is not appropriate to take one's eyes off the current task, and the user needs to make control inputs to a computer system or device. [Background technology]

[0002] Assistive devices are non-medical tools related to mobility, transportation, communication, activities of daily living, and performance of work-related activities. The most common examples of assistive devices are mobility devices such as wheelchairs, walkers, and crutches that aid those who cannot walk on their own. Adaptive technology is a type of assistive technology that adapts existing tools for use by physically disabled people. These assistive devices may be used by people with "classic" mobility impairments as well as those with cardiovascular conditions, fatigue-based conditions, paralysis-based conditions, etc. Summary of the Invention

[0003] This Summary is provided to introduce a selection of concepts in a simplified form that are further described in the Detailed Description. This Summary is not intended to identify key elements or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.

[0004] In one exemplary embodiment, a method is provided in a data processing system to implement an intra-oral control mechanism that allows a user to control the operation of a computer system or electronic device according to an exemplary embodiment. The exemplary embodiment detects, via a sensor in the intra-oral control mechanism, a distortion due to a user's tongue moving the control mechanism away from a fixed position. The exemplary embodiment converts, via the sensor, the detected distortion into a control signal. The exemplary embodiment amplifies, via an amplifier in the intra-oral control mechanism, an amplitude of the control signal, thereby generating an amplified control signal. The exemplary embodiment converts, via an analog-to-digital converter in the intra-oral control mechanism, the amplified control signal into a digital input signal. The exemplary embodiment modulates, via a radio frequency (RF) microcontroller in the intra-oral control mechanism, the digital input signal into a transmit frequency. The exemplary embodiment transmits, via the RF microcontroller, the digital input signal to a computer system, which interprets, via pre-trained classifiers and other software, the digital input signal into a digital control signal. The exemplary embodiments then either execute the digital control signal on the computer system itself to perform the operation associated with the digital control signal, or transmit the digital control signal to an electronic device control of the electronic device, thereby causing the electronic device in which the electronic device control is contained to operate as indicated by the digital control signal. The exemplary embodiments may store the digital input signal to characterize the health status of the user.

[0005] Preferably, the present invention provides a method in which the intra-oral control mechanism is contained within a dental retainer worn by a user.

[0006] Preferably, the present invention provides a method for treating a hard food substance in a user's mouth. palate The present invention provides a method for making a dental retainer, the method comprising the steps of: providing a dental retainer having a molded plastic center that adheres to a dental prosthesis; and providing a molded plastic center that includes at least a control mechanism and a sensor.

[0007] Preferably, the present invention provides a method in which the amplifier, analog to digital converter, microcontroller and antenna are contained within a molded plastic centerpiece.

[0008] Preferably, the present invention provides a method whereby the amplifier, analog to digital converter, microcontroller, and antenna are contained within a wire attached to a molded plastic center, and the wire is wrapped around the user's upper teeth to hold the dental retainer in the user's mouth.

[0009] Preferably, the present invention provides a method wherein the control mechanism has a 360 degree movement and an upward movement followed by a downward movement.

[0010] Preferably, the invention provides a method, wherein the sensor is selected from the group comprising a metallic structure, a piezoresistive structure or a piezoelectric structure.

[0011] Preferably, the invention provides a method wherein the strain is selected from the group including stress, force, torque, displacement, acceleration, or position.

[0012] Preferably, the present invention provides a method wherein the control mechanism is a protrusion on a molded plastic center of the dental retainer, the protrusion being selected from the group including kinematic protrusions, deployment type protrusions, disintegration type protrusions, rebound type protrusions, or bound type protrusions.

[0013] Preferably, the present invention provides a method, wherein the control signal indicates an operation of an electronic device, the operation being selected from the group including on, off, select, forward, back, left, right, up, down, or any other arbitrarily defined operation.

[0014] Viewed from another aspect, the present invention provides an apparatus including at least one processor and at least one memory coupled to the at least one processor, the at least one memory including instructions that, when executed by the at least one processor, cause the at least one processor to enable a user to control operation of a computer system or electronic device according to an exemplary embodiment, further comprising: receiving a digital input signal from an intra-oral control mechanism, the digital input control signal being received from the intra-oral control mechanism via the intra-oral control mechanism; detecting, by a sensor of the intra-oral control mechanism, a distortion due to a user's tongue moving the control mechanism away from a fixed position; converting the detected distortion into a control signal by the sensor; and amplifying, by an amplifier of the intra-oral control mechanism, an amplitude of the control signal, thereby transmitting the amplified control signal. and converting the amplified control signal by an analog-to-digital converter of the intra-oral control mechanism into a digital input signal; modulating the digital input signal to a transmission frequency by a radio frequency (RF) microcontroller of the intra-oral control mechanism; and transmitting the digital input signal by the RF microcontroller to a computer system which then interprets the digital input signal by pre-trained classifiers and other software into a digital control signal and either executes the digital control signal on the computer system itself to perform an operation associated with the digital control signal or transmits the digital control signal to an electronic device control mechanism of the electronic device, thereby causing the electronic device in which the electronic device control mechanism is contained to operate as indicated by the digital control signal and stores the digital input signal for user analysis and characterization.

[0015] Viewed from another aspect, the present invention provides an apparatus in which an intra-oral control mechanism is included in a dental retainer worn by a user.

[0016] Preferably, the present invention provides a method for treating a hard food substance in a user's mouth. palateThe present invention provides an apparatus in which the dental retainer has a molded plastic center that adheres to the dental retainer, the molded plastic center containing at least a control mechanism and a sensor.

[0017] Preferably, the present invention provides an apparatus in which the amplifier, analog to digital converter, microcontroller and antenna are contained within a molded plastic centerpiece.

[0018] Preferably, the present invention provides a device in which an amplifier, analog to digital converter, microcontroller, and antenna are contained within a wire attached to a molded plastic center, which is wrapped around a user's upper teeth to hold the dental retainer in the user's mouth.

[0019] Preferably, the present invention provides a device in which the control mechanism has a 360 degree movement and an upward movement followed by a downward movement.

[0020] Preferably, the invention provides a device, wherein the sensor is selected from the group comprising a metallic structure, a piezoresistive structure or a piezoelectric structure.

[0021] Preferably, the invention provides an apparatus in which the strain is selected from the group including stress, force, torque, displacement, acceleration, or position.

[0022] Preferably, the present invention provides a device where the control mechanism is a protrusion on a molded plastic center of the dental retainer, the protrusion being selected from the group including kinematic protrusions, deployment type protrusions, disintegration type protrusions, rebound type protrusions, or bound type protrusions.

[0023] Viewed from another perspective, the present invention provides a computer program product including a computer readable storage medium having stored therein a computer readable program enabling a user to control operation of a computer system or electronic device, the computer readable program, when executed on a data processing system, causes the data processing system to, when executed by at least one processor, enable the at least one processor to enable a user to control operation of a computer system or electronic device according to an exemplary embodiment, and further causes the at least one processor to: receive a digital input signal from an intra-oral control mechanism, the digital input control signal being received from the intra-oral control mechanism via the intra-oral control mechanism; detecting, by a sensor of the intra-oral control mechanism, a distortion due to a user's tongue moving the control mechanism away from a fixed position; converting the detected distortion into a control signal by the sensor; and controlling, by an amplifier of the intra-oral control mechanism, and amplifying the amplitude of the control signal, thereby generating an amplified control signal; converting the amplified control signal by an analog-to-digital converter of the intra-oral control mechanism into a digital input signal; modulating the digital input signal to a transmission frequency by a radio frequency (RF) microcontroller of the intra-oral control mechanism; and transmitting the digital input signal by the RF microcontroller to a computer system which then interprets the digital input signal by pre-trained classifiers and other software into a digital control signal and either executes the digital control signal on the computer system itself to perform an operation associated with the digital control signal or transmits the digital control signal to an electronic device control of the electronic device, thereby causing the electronic device in which the electronic device control mechanism is contained to operate as indicated by the digital control signal and to store the digital input signal for user analysis and characterization.

[0024] These and other features and advantages of the present invention will be described in, or will become apparent to those skilled in the art in view of, the following detailed description of illustrative embodiments of the invention.

[0025] The invention, together with its preferred mode of use, further objects and advantages, will be best understood by reference to the following detailed description of illustrative embodiments when read in conjunction with the accompanying drawings. [Brief description of the drawings]

[0026] [Figure 1] 1 is an example diagram of a distributed data processing system in which aspects of the illustrative embodiments may be implemented; [Diagram 2] FIG. 1 is an example block diagram of a computing device capable of implementing aspects of the illustrative embodiments. [Diagram 3] FIG. 1 is an example functional block diagram of an intra-oral control mechanism that allows a user to control the operation of an electronic device according to an illustrative embodiment. [Figure 4] FIG. 1 illustrates an example schematic of an electrical circuit for an intraoral control mechanism that allows a user to control the operation of an electronic device according to an illustrative embodiment. [Figure 5A] FIG. 1 illustrates, by way of example, one embodiment of an intra-oral control mechanism according to one exemplary embodiment. [Figure 5B] FIG. 1 illustrates, by way of example, one embodiment of an intra-oral control mechanism according to one exemplary embodiment. [Figure 5C] FIG. 1 illustrates, by way of example, one embodiment of an intra-oral control mechanism according to one exemplary embodiment. [Figure 5D] FIG. 1 illustrates, by way of example, one embodiment of an intra-oral control mechanism according to one exemplary embodiment. [Figure 6] FIG. 1 illustrates an example of an intra-oral control mechanism that fits within a user's mouth in accordance with an exemplary embodiment. [Figure 7] FIG. 13 illustrates an exemplary flowchart of operations performed by an intra-oral control mechanism to enable a user to control the operation of an electronic device according to an exemplary embodiment. [Figure 8]FIG. 13 illustrates an example flowchart of operations performed by a computer system receiving digital input signals from an intra-oral control mechanism to control the operation of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] Users with limited access, such as those with amputations, paralysis-based users, including hemiplegia, monoplegia, paraplegia, quadriplegia, etc., as well as other users not affected by such conditions, can utilize devices to provide input to a data processing system, which can then control other devices or systems. These devices and systems can include surgical robots, flight or other transportation control systems, telephones, lighting, air conditioning and heating systems, blinds, wheelchairs, or other mobility devices. Controllable systems also include immersive augmented reality (AR) and virtual reality (VR) technologies (e.g., Microsoft HoloLens, Google Glass, etc.). Head-mounted technology worn in daily life is difficult to control when hands are used for driving, surgery, walking, or other simultaneous tasks. With regard to wheelchairs, previous examples of such control systems can be "sip and puff" mouth-controlled wheelchair systems, lip-controlled joystick wheelchair systems, tongue implant-controlled wheelchair systems, etc. However, "sip and puff" mouth-controlled wheelchair systems are not a tactilely intuitive way to control movement. In addition, lip-controlled joystick wheelchair systems are complex, bulky, and require adjustments by another person. Furthermore, tongue-controlled wheelchair systems require a tongue implant to detect changes in the magnetic field or perform the necessary tapping on a series of contacts. Yet another implementation of control systems is non-keyboard-based communication tools that utilize input from a pointing stick and eye tracker. These non-keyboard-based communication tools require dedicated applications, which means it is difficult to do anything else and requires a great deal of dexterity (turning the whole head using neck muscles) and concentration.

[0028] Exemplary embodiments describe a flexible, biologically influenced, eccentric shaped "controller" that can be configured with a shape that is easily manipulated with a body part (e.g., tongue) but stays in place during other applications (e.g., chewing, swallowing, speaking). Movement of this controller by a human user is converted into digital input signals by one or more strain gauges, pressure sensors, or other sensors, and the digital input signals are transmitted to a computer system, which may be a smartwatch, phone, laptop, or other such device. This movement is deconvolved by a trained classifier running on the computer system into "control" actions such as on, off, select, forward, back, left, right, up, down, or any other arbitrary command. These control commands can then affect the receiving computer system or be passed on to another system or controlled device. Input signals from the device generated during daily life can also be used to characterize activities and health conditions related to chewing, swallowing, coughing, teeth grinding, and temporomandibular joint disorders. The signals are deconvolved in a similar manner, and different features control commands are generated.

[0029] Before commencing with the description of various aspects of the exemplary embodiment and the improved computer operations performed by the exemplary embodiment, it should first be understood that throughout this description, the term "mechanism" is used to refer to elements of the invention that perform various operations, functions, and the like. The term "mechanism" as used herein may be an implementation of a function or aspect of the exemplary embodiment in the form of an apparatus, a procedure, or a computer program product. In the case of a procedure, the procedure is implemented by one or more devices, apparatus, computers, data processing systems, and the like. In the case of a computer program product, the logic represented by the computer code or instructions embedded in or embodied on the computer program product is executed by one or more hardware devices to implement the functionality or perform the operations associated with the particular "mechanism." Thus, the mechanisms described herein may be implemented as dedicated hardware, or as software that executes on the hardware to configure the hardware to implement dedicated functionality of the invention that cannot otherwise be implemented by that hardware, or as software instructions stored on a medium such that the instructions are readily executable by the hardware, thereby specifically configuring the hardware to perform the aforementioned functionality and specific computer operations described herein, or as a combination of the above.

[0030] The description and claims of this application may use the terms "a," "at least one," and "one or more" in reference to specific features and elements of the exemplary embodiments. It should be understood that these terms and phrases contemplate the presence of at least one of the specific features or elements present in a particular exemplary embodiment, but that more than one may be present. That is, these terms / phrases are not intended to limit the description or claims to a single feature / element present, but require that multiple such features / elements are present. Conversely, these terms / phrases only require at least one single feature / element with the possibility of multiple such features / elements being within the scope of the description and claims.

[0031] Furthermore, it should be understood that the use of the term "engine" as used herein with respect to describing embodiments and features of the present invention is not intended to limit any particular implementation for accomplishing and / or performing the operations, steps, processes, etc., attributed to and / or performed by the engine. An engine is any software, hardware, or firmware, or combination thereof, or any combination thereof that performs specified functions, including, but not limited to, any use of a general or dedicated processor or both, in combination with appropriate software that is loaded or stored in a machine-readable memory and executed by the processor. Furthermore, any names associated with a particular engine are not intended to be limited to a particular implementation, unless otherwise specified, for ease of reference. Furthermore, any functionality attributed to an engine may be equally performed by multiple engines, incorporated or combined with the functionality of another engine of the same or different type, or distributed across one or more engines in various configurations.

[0032] Furthermore, it should be understood that the following description uses a number of different examples for the various elements of the exemplary embodiment to further illustrate implementations of the exemplary embodiment and aid in understanding the features of the exemplary embodiment. These examples are not intended to be limiting and are not exhaustive of the various possibilities for implementing the features of the exemplary embodiment. It will be apparent to those skilled in the art in view of the description herein that there are numerous other alternative embodiments for these various elements that may be utilized in addition to or in place of the examples provided herein without departing from the scope of the present invention.

[0033] As such, the exemplary embodiments may be utilized in many different types of data processing environments. To provide a context for the description of certain elements and functions of the exemplary embodiments, Figures 1 and 2 are illustrated below as exemplary environments in which aspects of the exemplary embodiments may be implemented. It should be understood that Figures 1 and 2 are only examples and are not intended to assert or imply any limitations with regard to the environments in which aspects or embodiments of the invention may be implemented. Many modifications to the illustrated environments may be made without departing from the spirit and scope of the invention.

[0034] 1 illustrates a visual representation of an exemplary distributed data processing system in which aspects of the exemplary embodiments may be implemented. Distributed data processing system 100 may include a network of computers in which aspects of the exemplary embodiments may be implemented. Distributed data processing system 100 includes at least one network 102, which is the medium used to provide communications links between various devices and computers connected together within distributed data processing system 100. Network 102 may include connections such as wired communications links, wireless communications links, or fiber optic cables.

[0035] In the illustrated example, the intra-oral control mechanism 116 communicates with a set of devices 114, such as phones, watches, laptops, home hub servers, wheelchairs, etc., via various wireless protocols such as Bluetooth, Zigbee, NFC, Wi-Fi, LiFi, 3G, etc., that are capable of operating interactively and autonomously to some degree. The set of devices 114 receives input from the intra-oral control mechanism 116 and converts the input into commands or communication primitives by software using machine learning models. These communication requests can be turned into text input and cursor movement for email or other computer functions, wheelchair directions, health indicators related to speaking, chewing, swallowing, coughing, etc. These communications may be operated on one or more sets of devices 114 or may be stored or forwarded. Other devices 118 having their own protocols may be connected via a wired network or via various wireless protocols such as Bluetooth, Zigbee, NFC, Wi-Fi, LiFi, 3G, etc., which can operate interactively and autonomously to some degree, and can be controlled or influenced by one or more sets of devices 114 based on input from the intra-oral control mechanism 116. In one example, home lights and shades are controlled by a home hub device connected to the intra-oral control mechanism 116. In the illustrated example, the set of device servers 104 and server 106 are connected to the network 102 along with cloud-based analysis and storage 108. Additionally, clients 110 and 112, as well as a smart device 114, are connected to the network 102. In the illustrated example, the server 104 provides data, such as boot files, operating system images, and applications, to the clients 110 and 112 and the smart device 114. The clients 110 and 112 are clients to the server 104 in the illustrated example. Clients 110 and 112 may be, for example, personal computers, network computers, etc. Distributed data processing system 100 may include additional servers, clients, and other devices not shown.Cloud-based analytics and storage 108 is a model of service delivery for enabling convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, network bandwidth, servers, processing, memory, storage, applications, virtual machines, and services) that can be rapidly provisioned and released with minimal administrative effort or interaction with the provider of the service. As such, a cloud computing environment is service oriented with a focus on statelessness, loose coupling, modularity, and semantic interoperability. At the heart of cloud computing is an infrastructure that includes a network of interconnected nodes.

[0036] In the depicted example, distributed data processing system 100 is an Internet having network 102, which represents a worldwide collection of networks and gateways that use the Transmission Control Protocol / Internet Protocol (TCP / IP) suite of protocols to communicate with one another. At the heart of the Internet is a backbone of data communication lines between major nodes or host computers, consisting of thousands of commercial, governmental, educational, and other computer systems that route data and messages. Of course, distributed data processing system 100 may be implemented to include a number of different types of networks, such as, for example, an intranet, a local area network (LAN), a wide area network (WAN), a body area network, Wi-Fi, Bluetooth, Bluetooth Low Energy, Near Field Communication (NFC), etc. As noted above, FIG. 1 is intended as an example and not as an architectural limitation for various embodiments of the present invention, and thus the specific elements illustrated in FIG. 1 should not be considered limiting with regard to the environments in which illustrative embodiments of the present invention may be implemented.

[0037] As shown in FIG. 1, one or more of the computing devices, e.g., 114 and server 104, may be specifically configured to implement control mechanisms for providing input to the computing device or for controlling the operation of the electronic device. The configuration of the computing device may include providing application-specific hardware, firmware, etc., to facilitate the performance of the operations and generation of output as described herein with respect to the exemplary embodiments. The configuration of the computing device may further, or alternatively, include providing software applications stored in one or more storage devices and loaded into memory of the computing device, such as server 104, for the purpose of causing one or more hardware processors of the computing device to execute the software applications that configure the processors to perform the operations and generate output as described herein with respect to the exemplary embodiments. Moreover, any combination of application-specific hardware, firmware, software applications executing on the hardware, etc. may be used without departing from the spirit and scope of the exemplary embodiments.

[0038] It should be understood that once a computing device is configured in one of these ways, the computing device becomes a dedicated computing device specifically configured to implement the mechanisms of the exemplary embodiments, and not a general-purpose computing device. Moreover, as described below, implementation of the mechanisms of the exemplary embodiments improves the functionality of the computing device and provides useful, tangible results that facilitate input to the computing device or control of the operation of an electronic device that utilizes an intra-oral control mechanism.

[0039] As described above, the mechanisms of the exemplary embodiments utilize specifically configured computing devices, or data processing systems, to perform operations that provide input to a computing device or control the operation of an electronic device utilizing an intraoral control mechanism. These computing devices, or data processing systems, may include various specifically configured hardware elements, either through a hardware configuration, a software configuration, or a combination of hardware and software configurations, to implement one or more of the systems / subsystems described herein. FIG. 2 is a block diagram illustrating just one example of a data processing system in which aspects of the exemplary embodiments may be implemented. Data processing system 200 is an example of a computer, such as server 104 of FIG. 1, in which computer usable code or instructions implementing the processes and aspects of the exemplary embodiments of the present invention may be arranged and / or executed to effectuate the operations, outputs, and external effects of the exemplary embodiments described herein.

[0040] In the illustrated example, data processing system 200 utilizes a hub architecture including a north bridge and memory controller hub (NB / MCH) 202 and a south bridge and input / output (I / O) controller hub (SB / ICH) 204. A processing unit 206, a main memory 208, and a graphics processor 210 are connected to the NB / MCH 202. The graphics processor 210 may be connected to the NB / MCH 202 via an accelerated graphics port (AGP).

[0041] In the illustrated example, a local area network (LAN) adapter 212 is connected to the SB / ICH 204. An audio adapter 216, a user interface 220, which may be a keyboard, mouse, adapter, or intraoral control system 220, a modem 222, a read only memory (ROM) 224, a hard disk drive (HDD) 226, a storage medium 230, a universal serial bus (USB) port and other communication ports 232, and a PCI / PCIe device 234 connect to the SB / ICH 204 via a bus 238 and a bus 240. The PCI / PCIe devices may include, for example, Ethernet adapters, add-in cards, and PC cards for notebook computers. PCI uses a card bus controller, but PCIe does not. The ROM 224 may be, for example, a flash basic input / output system (BIOS).

[0042] The HDD 226 and storage medium 230 connect to the SB / ICH 204 via a bus 240. The HDD 226 and storage medium 230 may use, for example, an Integrated Drive Electronics (IDE) or a Serial Advanced Technology Attachment (SATA) interface. A Super I / O (SIO) device 236 may connect to the SB / ICH 204.

[0043] An operating system runs on the processing unit 206. The operating system coordinates and provides control of the various components within the data processing system 200 of FIG. 2. As a client, the operating system may be a commercially available operating system such as Microsoft® Windows 10®, Swift®, Python®, etc. An object oriented programming system, such as a Java® programming system, runs in conjunction with the operating system and provides calls to the operating system from Java® programs or applications running on the data processing system 200.

[0044] As a server, data processing system 200 may be, for example, any general-purpose computer system running any general-purpose operating system. Data processing system 200 may also be a symmetric multi-processor (SMP) system that includes multiple processors in processing unit 206. Alternatively, a single processor system may be used.

[0045] Instructions for the operating system, object oriented programming system, applications, or programs may be located on a storage device, such as HDD 226, and loaded into main memory 208 for execution by processing unit 206. Processes for exemplary embodiments of the present invention may be implemented by processing unit 206 using computer-usable program code, which may be located in a memory, such as main memory 208, ROM 224, or one or more peripheral devices 226 and 230.

[0046] A bus system, such as bus 238 or bus 240 shown in FIG. 2, may be comprised of one or more buses. Of course, a bus system may be implemented with any type of communications fabric or architecture that provides for the transport of data between different components or devices attached to the fabric or architecture. A communications unit, such as modem 222 or network adapter 212 in FIG. 2, may include one or more devices used to transmit and receive data. A memory may be, for example, main memory 208, ROM 224, or a cache such as found in NB / MCH 202 in FIG. 2.

[0047] As mentioned above, in some exemplary embodiments, the mechanisms of the exemplary embodiments may be implemented as application specific hardware, firmware, or the like, stored in a storage device, such as HDD 226, loaded into a memory, such as main memory 208, and executed by one or more hardware processors, such as processing unit 206. Thus, the computing device illustrated in FIG. 2 may be specifically configured to implement the mechanisms of the exemplary embodiments, and specifically configured to generate output, as described below with respect to intra-oral control mechanisms, to provide input to data processing system 200 via cursor input to data processing system 200, or to control the operation of an electronic device, such as electronic device 242, as described below.

[0048] Those skilled in the art will appreciate that the hardware in Figures 1 and 2 may vary depending on the implementation. Other internal hardware or peripheral devices, such as flash memory, equivalent non-volatile memory, or optical disk drives, may be used in addition to or in place of the hardware depicted in Figures 1 and 2. Additionally, the processes of the illustrative embodiments may be applied to multiprocessor data processing systems other than the SMP systems described above without departing from the spirit and scope of the present invention.

[0049] Further, data processing system 200 may take the form of any of a number of different data processing systems, including a client computing device, a server computing device, a tablet computer, a laptop computer, a telephone or other communications device, a personal digital assistant (PDA), etc. In some illustrative examples, data processing system 200 may be a portable computing device configured with flash memory to provide non-volatile memory for storing operating system files and / or user generated data. In essence, data processing system 200 may be any known or later developed data processing system without architectural limitation.

[0050] FIG. 3 shows an example of a functional block diagram of an intraoral control mechanism that allows a user to control the operation of an electronic device according to an exemplary embodiment. The intraoral control mechanism 300 includes a sensor 302, an amplifier 304, an analog-to-digital converter 306, a radio frequency (rf) microcontroller 308, and an antenna 310. The sensor 302 may be one or more sensors, such as a strain gauge sensor, a pressure sensor, etc., that measure strain, such as stress, force, torque, or other stimuli, including displacement, acceleration, or position. The sensor 302 may be composed of a metal (foil), a semiconductor (called a piezoresistance, where the base material is doped by diffusion of a doping material (usually boron or arsenide for p-type or n-type) to obtain a base resistance as required), a piezoelectric material (usually a perovskite (PZT)), etc. According to an exemplary embodiment, the sensor 302 is coupled to a control mechanism 312 that may take the form of a kinematic, deployable, disintegrating, springy, or bounding feature, etc., which, when touched by the user's tongue, creates a distortion on the control mechanism 312 that is sensed by the sensor 302. That is, the movement of the control mechanism 312 by the user's tongue is translated by the sensor 302 into a control signal, such as on, off, select, forward, back, left, right, up, down, etc. According to an exemplary embodiment, the control mechanism 312 has a 360 degree movement as well as an up movement followed by a down movement.

[0051] An amplifier 304 receives the control signal and uses power from a power source to increase the amplitude of the control signal applied to its input terminal to generate a proportionally larger amplitude control signal at its output terminal. An analog-to-digital converter 306 receives the amplified control signal in the form of an analog signal and converts the analog amplified control signal to a digital input signal. A radio frequency (RF) microcontroller 308 receives the digital input signal and modulates the digital input signal to a desired transmission frequency such as Wi-Fi, Bluetooth, Near Field Communication (NFC), Body Area Network, Bluetooth Low Energy, etc., which the RF microcontroller 308 then transmits via an antenna 310. The digital input signals transmitted by the RF microcontroller 308 are then received by a matching network antenna (not shown) which is then utilized by the computer system which interprets the digital input signals by means of pre-trained classifiers and other software into digital control signals so that the computer system either executes the digital control signals on the computer system itself to perform an operation associated with the digital control signals or transmits the digital control signals to an electronic device control mechanism of an electronic device, thereby causing an electronic device associated with and operating in the electronic device in which the electronic device control mechanism is contained.

[0052] According to an exemplary embodiment, the intra-oral control mechanism 300 may take the form of a customized, removable dental retainer. The central portion of the dental retainer, i.e., the hard part in the user's mouth, palate A molded plastic centerpiece that fastens to the dental retainer contains at least the control mechanism 312 and the sensor 302. An amplifier 304, an analog to digital converter 306, an RF microcontroller 308, and an antenna 310 may be contained within the molded plastic centerpiece or may be fastened to a wire that wraps around the user's upper teeth and holds the dental retainer in the user's mouth.

[0053] Since users vary in dexterity, the user's use of the control mechanism 312 may be used, by way of example, to train the wheelchair direction control mechanism. That is, on first use, the user uses the control mechanism 312 to perform a particular action in a sequence of actions, such as on, off, forward, backward, left, right, up, etc. In this manner, as the user repeatedly uses the control mechanism 312 to perform a particular action, such as forward, the wheelchair direction control mechanism trains the wheelchair direction control mechanism by labeling signals received via the intra-oral control mechanism 300 and associating the received signals with the forward label. This process is repeated for each of the sequence of actions. After training, as the user moves the control mechanism 312, the wheelchair direction control mechanism receives signals from the intra-oral control mechanism 300 and moves the wheelchair in the direction associated with the trained signaling.

[0054] Thus, the exemplary embodiments provide a flexible, biologically influenced, eccentric shaped "controller" that can be configured in a shape that is easily manipulated by a body part (e.g., a tongue) but remains in place during other applications (e.g., chewing, swallowing, speaking). Movements of this controller by a human user are converted by sensors into digital signals that are deconvolved by trained classifiers into "control" actions such as on, off, select, forward, back, left, right, up, etc. These control actions include directional, distinctive, characterizing, or other input type signals.

[0055] FIG. 4 shows an example schematic of an electrical circuit for an intraoral control mechanism, such as intraoral control mechanism 300 of FIG. 3, for user control of the operation of an electronic device according to an exemplary embodiment. Intraoral control mechanism 400 includes a sensor 402, an amplifier 404, an analog-to-digital converter / RF microcontroller 406, and a matching network antenna 410. Sensor 402, similar to sensor 302 of FIG. 3, may be a strain gauge sensor, pressure sensor, or other sensor that measures strain, such as stress, force, torque, or other stimuli including displacement, acceleration, or position. Sensor 402 is shown as a Wheatstone bridge circuit, which is an electrical circuit used to measure an unknown electrical resistance by balancing two legs of a bridge circuit, one of which includes an unknown component. In this case, the unknown component is a piezoresistive sensor. According to an exemplary embodiment, the sensor 402 is coupled to a control mechanism that may have kinematic, deployable, disintegrating, springy, bounding, etc. features that, when touched by the user's tongue, cause a distortion on the control mechanism that is sensed by the sensor 402. That is, movement of the directional control mechanism by the user's tongue is translated by the sensor 402 into a directional control signal, such as on, off, select, forward, back, left, right, up, down, etc. FIG. 4 shows only one sensor 402, multiple sensors 402 may be utilized to increase the accuracy of detection of the movement by the user's tongue.

[0056] The sensor 402, and other power consuming devices of FIG. 4, can be powered in many different ways. In one embodiment, power may be provided via a rechargeable coin cell battery that may be recharged when the intraoral control system is removed from the user's mouth and placed in a charging station, or may be recharged while the intraoral control system is still in the user's mouth via a wireless charging system such as near field communication (NFC), radio frequency (RF) over the air charging, etc. The intraoral control system is still in the user's mouth via a wireless charging system such as near field communication (NFC), radio frequency (RF) over the air charging, etc. In another embodiment, power may be provided directly via NFC, RF over the air charging, etc. In yet another embodiment, the energy collection circuit may be used as a power source for the piezoelectric circuit, the friction circuit, the chewing-based circuit, etc.

[0057] The amplifier 404 receives the direction control signal and uses power from the power source to increase the amplitude of the direction control signal applied to its input terminal to generate a proportionally sized amplitude direction control signal at its output terminal. The analog to digital converter / RF microcontroller 406 receives the amplified direction control signal in the form of an analog signal and converts the analog amplified direction control signal to a digital direction control signal, which is then modulated to a desired transmission frequency such as Wi-Fi, Bluetooth, Near Field Communication (NFC), Body Area Network, Bluetooth Low Energy, etc., and then sent out via a matching network antenna 410. The matching network antenna 414, coupled to a device 416, which may be one or more sets of devices such as the set of devices 114, receives the digital direction control signal sent by the analog to digital converter / RF microcontroller 406, which is then utilized by the device 416 to operate an associated electronic device in an associated manner.

[0058] 5A-5D show, by way of example, an embodiment of an intra-oral control mechanism, such as intra-oral control mechanism 300 of FIG. 3 and intra-oral control mechanism 400 of FIG. 4, according to one exemplary embodiment. As previously mentioned, intra-oral control mechanism 300 / 400 may take the form of a customized, removable dental retainer. FIG. 5A shows an exemplary dental retainer including an intra-oral control mechanism according to one exemplary embodiment. Dental retainer 502 is comprised of a molded plastic center portion 504 secured to wire 506 that wraps around a user's upper teeth and holds dental retainer 502 in the user's mouth. Molded plastic center portion 504 includes at least a directional control mechanism 508 and a sensor 510. Sensor 510 is coupled to other components, namely an amplifier, an analog-to-digital converter, an RF microcontroller, and an antenna, which may be included within molded plastic center portion 504 or may be secured to wire 506 via coupling 512. As a note, the sensor 510 may be multiple sensors to increase the accuracy of detecting the movement of the user's tongue. In FIG. 5A, the coupling 512 is shown to have six wires because, in this example, the sensor 510 utilizes three strain gauges, and each strain gauge requires two wires. Therefore, six wires is only an example, and the sensor 510 may include any number of sensors to provide greater accuracy in detecting the movement of the user's tongue. It should also be noted that all devices, i.e., the sensor 510, the coupling 512, etc., are insulated according to an exemplary embodiment to protect the user.

[0059] 5B shows another view of the molded plastic center section 504, according to an example embodiment. As shown, the molded plastic center section 504 includes at least a directional control mechanism 508 and a sensor 510, which are coupled to other components, namely, an amplifier, an analog-to-digital converter, an RF microcontroller, and an antenna, via coupling 512. Additionally, the other components, namely, the amplifier, the analog-to-digital converter, the RF microcontroller, and the antenna, which are coupled to the sensor 510 via coupling 512, may be included within the molded plastic center section 504 or may be affixed to wires that include the molded plastic center section 504.

[0060] FIG. 5C shows a close-up view of the directional control mechanism 508 and the sensor 510 according to one exemplary embodiment. In the illustrated example, the sensor 510 is described as a foil including three strain gauge (piezoresistive) sensors. Again, while the sensor 510 in FIG. 5C shows three strain gauges, it is recognized that in an exemplary embodiment, any number of sensors may be utilized to provide greater accuracy in detecting movements by the user's tongue. In FIG. 5C, the coupling 512 is shown to have six wires because, in this example, the sensor 510 utilizes three strain gauges, with each strain gauge requiring two wires. Thus, six wires is merely an example, and the sensor 510 may include any number of sensors to provide greater accuracy in detecting movements by the user's tongue.

[0061] FIG. 5D illustrates a close-up view of the directional control mechanism 508 according to one exemplary embodiment. As shown, the directional control mechanism 508 is coupled to a sensor 510 according to one exemplary embodiment. In this example, the sensor 510 is illustrated as a foil including one strain gauge (piezoresistive) sensor. Again, while the sensor 510 in FIG. 5D illustrates one strain gauge, it is recognized that in an exemplary embodiment, any number of sensors may be utilized to provide greater accuracy in detecting movements by the user's tongue. In FIG. 5D, the coupling 512 is shown to have two wires because, in this example, the sensor 510 utilizes one strain gauge, and each strain gauge requires two wires. Thus, two wires is merely an example, and the sensor 510 may include any number of sensors to provide greater accuracy in detecting movements by the user's tongue.

[0062] FIG. 6 illustrates an example of an intra-oral control mechanism, such as intra-oral control mechanism 300 of FIG. 3 and intra-oral control mechanism 400 of FIG. 4, that fits within a user's mouth according to an exemplary embodiment. As shown, intra-oral control mechanism 600 includes a molded plastic center portion 604 secured to wires 606 that wrap around the user's upper teeth and hold dental retainer 502 in the user's mouth. Molded plastic center portion 604 includes at least a directional control mechanism 608 and a sensor 610. Sensor 610 is coupled to other components, namely an amplifier, an analog-to-digital converter, an RF microcontroller, and an antenna, which may be included within molded plastic center portion 604 or may be secured to wires 606 via couplings 612. It should also be noted that all devices, namely sensor 610, couplings 612, etc., are insulated according to an exemplary embodiment to protect the user.

[0063] The present invention may be a system, method, or computer program product, or a combination thereof. The computer program product may include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to perform aspects of the present invention.

[0064] A computer readable storage medium may be a tangible device capable of holding and storing instructions for use by an instruction execution device. A computer readable storage medium may be, for example, but not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of computer readable storage media includes portable computer diskettes, hard disks, random access memories (RAM), read-only memories (ROM), erasable programmable read-only memories (EPROM or flash memory), static random access memories (SRAM), portable compact disk read-only memories (CD-ROM), digital versatile disks (DVDs), memory sticks, floppy disks, mechanically encoded devices such as punch cards or ridge-in-groove structures having instructions recorded thereon, and any suitable combination of the foregoing. Computer-readable storage media, as used herein, should not be construed as being themselves transitory signals such as electric waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission medium (e.g., light pulses through a fiber optic cable), or electrical signals transmitted over wires.

[0065] The computer readable program instructions described herein can be downloaded from a computer readable storage medium to each computing / processing device or to an external computer or storage device via a network, such as the Internet, a local area network, a wide area network, or a wireless network, or a combination thereof. The network can include copper transmission cables, optical transmission fiber, wireless transmission, routers, firewalls, switches, gateway computers, or edge servers, or a combination thereof. A network adapter card or network interface in each computing / processing device receives the computer readable program instructions from the network and sends the computer readable program instructions for storage in a computer readable storage medium in each computing / processing device.

[0066] The computer readable program instructions for carrying out the operations of the present invention may be either assembler instructions, instruction set architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages, including object oriented programming languages ​​such as JAVA, Smalltalk, C++, and traditional procedural programming languages ​​such as the Python programming language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or partially on the remote computer or entirely on the remote computer. In the latter scenario, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (e.g., via the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, programmable logic circuitry, a field programmable gate array (FPGA), or a programmable logic array (PLA), may execute computer readable program instructions according to state information of the computer readable program instructions to implement aspects of the invention.

[0067] Aspects of the present invention are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer readable program instructions.

[0068] These computer readable program instructions may be provided to a processor of a computer, or other programmable data processing apparatus, to generate a machine such that the instructions, executed via the processor of the computer or other programmable data processing apparatus, generate means for implementing the functions / operations specified in one or more blocks of the flowcharts and / or block diagrams. These computer readable program instructions may also be stored on a computer readable storage medium that can cause a computer, programmable data processing apparatus, or other device, or combination thereof, to function in a particular manner, and thus a computer readable storage medium having instructions stored therein may include an article of manufacture including instructions that implement aspects of the functions / operations specified in one or more blocks of the flowcharts and / or block diagrams.

[0069] The computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device such that the instructions, which execute on the computer, other programmable apparatus, or other device, implement the functions / operations specified in one or more blocks of the flowcharts and / or block diagrams, causing a series of operational steps to be performed on the computer, other programmable apparatus, or other device to produce a computer-implemented process.

[0070] 7 illustrates an exemplary flow chart of operations performed by an intra-oral control mechanism to allow a user to control the operation of an electronic device according to an exemplary embodiment. When an operation is initiated, a sensor in the intra-oral control mechanism detects distortion in the form of stress, force, torque, or other stimuli including displacement, acceleration, or position (step 702). The distortion detected by the sensor comes from a control mechanism that may have kinematic features, expand-type features, explode-type features, spring-type features, bound-type features, etc., when touched by the user's tongue. Using the detected distortion, the sensor converts the detected distortion into a control signal such as on, off, select, front, back, left, right, up, down, etc. (step 704).

[0071] The amplifier of the intra-oral control mechanism amplifies the amplitude of the control signal using power from the power source, thereby generating a proportionally sized amplitude control signal, i.e., an amplified control signal (step 706). The analog-to-digital converter of the intra-oral control mechanism converts the amplified control signal, which is an analog signal, to a digital input signal (step 708). The radio frequency (RF) microcontroller of the intra-oral control mechanism then modulates the digital input signal to a desired transmission frequency (step 710). The RF microcontroller then transmits the digital input signal to the computer system via a matched antenna system (step 712). The computer system interprets the digital input signal by pre-trained classifiers and other software into a digital control signal so that the computer system either executes the digital control signal on the computer system itself to perform the desired operation, or the computer system transmits the digital control signal to an electronic device control of an electronic device, thereby causing the electronic device contained in the electronic device control to operate in a manner indicated by the digital control signal. The operation then ends and may or may not be stored for analysis.

[0072] FIG. 8 illustrates an example of a flow chart of operations performed by a computer system receiving digital input signals from an intra-oral control mechanism to control the operation of an electronic device according to an exemplary embodiment. According to one or more embodiments of the present invention, the intra-oral control system includes providing a sensor including one or more strain gauges to establish a human-computer interface (step 802), the interface outputting a signal related to the stress on the strain gauge by the sensor (step 804). A receiver receives the signal output by the sensor (step 806) and processes the signal to determine a parameter of interest (step 808). According to one or more embodiments of the present invention, the parameter of interest is a characterization of motion and can aid in locomotion, transportation, communication, activities of daily living, and performance of work-related activities. It should be understood that the parameters described herein are exemplary and that one skilled in the art can map additional parameters to the signal output by the sensor. According to an exemplary embodiment, the parameter of interest is then operated on or transferred to another machine (step 810).

[0073] In accordance with one or more embodiments of the invention, a machine learning process (step 812) establishes a mapping from a signal (e.g., a waveform signal) to a parameter of interest for the sensor (step 808). The mapping is used in processing the signal in step 808. For example, the output of the sensor can be instrumented to determine that a given waveform corresponds to a certain movement.

[0074] According to one or more embodiments of the present invention, the machine learning process in step 812 and the signal processing in step 808 are adapted to mobility devices such as wheelchairs, walkers, and crutches to assist people who are unable to walk themselves.

[0075] According to an embodiment of the present invention, for characterization of movements, the machine learning in step 812 includes a training session. The machine learning process in step 812 further includes estimation of a piecewise linear regression model from the strain measurements and the movement measurements. Given the piecewise linear regression model (i.e., step 812), the signal processing in step 808 inputs the signals into the model, in this example, to predict the parameter of interest. According to an embodiment of the present invention, the signal processing in step 808 includes grouping / clustering the received strain signals into movements (see step 806). The signal processing in step 808 includes recording the strain signals over time (e.g., during different visits to a physician or technician, when in wireless communication range of a receiver, etc.), and the strains are observed for one or more movements and compared over time.

[0076] Given the distortion measurements and the known movements, the machine learning at step 812 includes grouping distortion measurements that correspond to known movement actions, applying dynamic time warping (DTW), and identifying idioms. DTW is a method for measuring similarity between two temporal sequences with varying speeds. In one or more embodiments of the present invention, the DTW method is applied to compensate for variability (e.g., different subjects do things at different speeds), and DTW outputs a set of aligned distortion measurements. The machine learning at step 812 further includes generating a classifier (e.g., k-nearest neighbors, support vector machine (SVM), neural network, etc.) trained with the distortion measurements mapped to character and gesture labels. According to one embodiment of the present invention, the signal processing at step 808 includes receiving signals from a sensor and predicting characters and / or gestures from the received signals using a classifier.

[0077] The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block of the flowcharts or block diagrams may represent a module, segment, or portion of instructions, including one or more executable instructions for implementing the specified logical function. In some alternative embodiments, the functions noted in the blocks may occur out of the order noted in the figures. For example, two blocks shown in succession may in fact be executed substantially simultaneously, or the blocks may be executed in reverse order, depending on the functionality involved. It should also be noted that each block of the block diagrams and / or flowchart illustrations, as well as combinations of blocks in the block diagrams and / or flowchart illustrations, may be implemented by a dedicated hardware-based system that performs the specified functions or operations or implements a combination of dedicated hardware and computer instructions.

[0078] Thus, the exemplary embodiments provide a mechanism for an intra-oral control mechanism that allows a user to control the operation of an electronic device. The exemplary embodiments provide a flexible, biologically influenced, eccentric shaped "controller" that can be configured in a shape that is easily manipulated with a body part (e.g., tongue) but remains out of the way during other uses (e.g., chewing, swallowing, speaking). Movement of this controller by a human user is converted by a sensor into a digital signal that is deconvolved by a trained classifier into "control" actions such as on, off, select, forward, back, left, right, up, etc.

[0079] As noted above, it should be understood that the exemplary embodiments may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment containing both hardware and software elements, In one exemplary embodiment, mechanisms of the exemplary embodiments are implemented in software or program code, including but not limited to firmware, resident software, microcode, etc.

[0080] A data processing system suitable for storing and / or executing program code will include at least one processor coupled directly or indirectly to memory elements through a communications bus, such as a system bus. The memory elements may include local memory employed during the actual execution of the program code, bulk storage, and cache memory that provides temporary storage of at least some of the program code to reduce the number of times the code must be read from the bulk storage during execution. Memory may include, but is not limited to, ROM, PROM, EPROM, EEPROM, DRAM, SRAM, flash memory, solid state memory, and the like.

[0081] Input / output or I / O devices (including but not limited to keyboards, displays, pointing devices) can be coupled to the system either directly or through an intervening wired or wireless I / O interface. I / O devices can take many different forms other than traditional keyboards, displays, pointing devices, etc., such as, but not limited to, smart phones, tablet computers, touch screen devices, voice recognition devices, and other communication devices coupled through wired or wireless connections. Any I / O device now known or later developed is intended to be within the scope of the exemplary embodiments.

[0082] Network adapters may also be coupled to the system to enable the data processing system to be coupled to other data processing systems or remote printers or storage devices through intervening private or public networks. Modems, cable modems, and Ethernet cards are just a few of the currently available types of wired communication network adapters. Wireless communication based network adapters may also be utilized, including, but not limited to, 802.11a / b / g / n wireless communication adapters, Bluetooth wireless adapters, and the like. Any now known or later developed network adapter is intended to be within the spirit and scope of the present invention.

[0083] The description of the present invention has been presented for purposes of illustration and description, and is not intended to be exhaustive or to limit the invention to the disclosed form. Many modifications and variations will become apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The embodiments have been chosen and described in order to best explain the principles and practical applications of the invention, and to enable those skilled in the art to understand the invention in various embodiments with various modifications as appropriate for the specific use envisioned. The terms used in this specification have been chosen in order to best explain the principles, practical applications, or technical improvements over the technology found in the marketplace of the embodiments, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. 1. A method in a data processing system including at least one processor and at least one memory, the memory including instructions executed by the processor to configure the processor to implement an intra-oral control mechanism that allows a user to control the operation of a computer system or electronic device, the method comprising: receiving an input of a digital input signal from the intraoral control mechanism, the intraoral control mechanism comprising: detecting, with a sensor in the intra-oral control mechanism, a distortion caused by a user's tongue moving the control mechanism from a fixed position; converting the detected distortion into a signal by the sensor; converting said signal by an analog to digital converter of said intraoral control mechanism to said digital input signal; transmitting said digital input signal to said computer system by a radio frequency (RF) microcontroller of said intraoral control mechanism; receiving an input of the digital input signal; predicting a control action from the digital input signal by a machine learning classifier pre-trained with the distortion measurements mapped to labels; performing the predicted actions by the computer system; and storing said digital input signal for analysis and characterization of said user; The method includes:

2. The method of claim 1, wherein the signal converted by the sensor is amplified in amplitude by an amplifier in the intraoral control mechanism before being converted to the digital input signal by an analog-to-digital converter in the intraoral control mechanism, and the digital input signal is modulated to a transmission frequency by the RF microcontroller before being transmitted to the computer system and transmitted to the computer system in the form of the transmission frequency, and performing the operation includes the computer system itself performing the operation or the computer system causing an electronic device control mechanism of the electronic device to perform the operation.

3. The method of claim 2, wherein the intraoral control mechanism is contained within a dental retainer worn by the user, the dental retainer having a molded plastic center that is fixed in the user's mouth, and the molded plastic center includes at least the control mechanism and the sensor.

4. The method of claim 3 , wherein the amplifier, the analog-to-digital converter, the RF microcontroller, and the antenna are contained within the molded plastic center section.

5. 4. The method of claim 3, wherein the amplifier, the analog to digital converter, the RF microcontroller, and the antenna are contained within a wire attached to the molded plastic center, the wire being wrapped around the user's upper teeth to hold the dental retainer in the user's mouth.

6. The method of claim 1 , wherein the control mechanism has a 360 degree movement, an up movement followed by a down movement.

7. The method of claim 1 , wherein the sensor is selected from the group comprising a metallic structure, a piezoresistive structure, or a piezoelectric structure.

8. The method of claim 1 , wherein the strain is selected from the group including stress, force, torque, displacement, acceleration, or position.

9. 10. The method of claim 1, wherein the control mechanism is a protrusion on a molded plastic center of the dental retainer, the protrusion being selected from the group including kinematic protrusions, deployment type protrusions, disintegration type protrusions, rebound type protrusions, or bound type protrusions.

10. The method of claim 1, wherein the action is selected from a group including on, off, select, forward, back, left, right, up, down, or any other arbitrarily defined action.

11. At least one processor; at least one memory coupled to said at least one processor; the memory includes instructions that, when executed by the processor, cause the processor to enable a user to control operation of a computer system or electronic device, and further cause the processor to: receiving a digital input signal from an intraoral control mechanism, the digital input signal being received from the intraoral control mechanism via the intraoral control mechanism, the intraoral control mechanism comprising: detecting, with a sensor in the intra-oral control mechanism, a distortion caused by a user's tongue moving the control mechanism from a fixed position; converting the detected distortion into a signal by the sensor; converting said signal by an analog to digital converter of said intraoral control mechanism to said digital input signal; transmitting said digital input signal to said computer system by a radio frequency (RF) microcontroller of said intraoral control mechanism; receiving the digital input signal; predicting a control action from the digital input signal by a machine learning classifier pre-trained with the distortion measurements mapped to labels; performing the predicted actions by the computer system; and storing said digital input signal for analysis and characterization of said user; A device that performs the above function.

12. The apparatus of claim 11, wherein the signal converted by the sensor is amplified in amplitude by an amplifier in the intraoral control mechanism before being converted to the digital input signal by an analog-to-digital converter in the intraoral control mechanism, and the digital input signal is modulated to a transmission frequency by the RF microcontroller before being transmitted to the computer system and transmitted in the form of the transmission frequency to the computer system, and performing the operation includes the computer system itself performing the operation or the computer system causing an electronic device control mechanism of the electronic device to perform the operation.

13. The device described in claim 12, wherein the intraoral control mechanism is contained within a dental retainer worn by the user, the dental retainer having a molded plastic center that is fixed in the user's mouth, the molded plastic center including at least the control mechanism and the sensor.

14. The apparatus of claim 13 , wherein the amplifier, the analog-to-digital converter, the RF microcontroller, and the antenna are contained within the molded plastic center section.

15. 14. The device of claim 13, wherein the amplifier, the analog to digital converter, the RF microcontroller, and the antenna are contained within a wire attached to the molded plastic center, the wire being wrapped around the user's upper teeth to hold the dental retainer in the user's mouth.

16. 12. The device of claim 11, wherein the control mechanism has a 360 degree movement and an up movement followed by a down movement.

17. The apparatus of claim 11 , wherein the sensor is selected from the group comprising a metallic structure, a piezoresistive structure, or a piezoelectric structure.

18. The apparatus of claim 11 , wherein the strain is selected from the group including stress, force, torque, displacement, acceleration, or position.

19. 12. The device of claim 11, wherein the control mechanism is a protrusion on a molded plastic center of the dental retainer, the protrusion being selected from the group including kinematic protrusions, deployment type protrusions, disintegration type protrusions, rebound type protrusions, or bound type protrusions.

20. 1. A computer program for user control of the operation of a computer system or electronic device, the computer program comprising: receiving a digital input signal from an intraoral control mechanism, the digital input signal being received from the intraoral control mechanism via the intraoral control mechanism, the intraoral control mechanism comprising: detecting, with a sensor in the intra-oral control mechanism, a distortion caused by a user's tongue moving the control mechanism from a fixed position; converting the detected distortion into a signal by the sensor; converting said signal by an analog to digital converter of said intraoral control mechanism to said digital input signal; transmitting said digital input signal to said computer system by a radio frequency (RF) microcontroller of said intraoral control mechanism; receiving an input of the digital input signal; predicting a control action from the digital input signal by a classifier pre-trained with the distortion measurements mapped to labels; performing the predicted actions by the computer system; and storing said digital input signal for analysis and characterization of said user; A computer program that causes

Images