Human-computer interaction method and tongue training system

Abstract

The present application relates to the field of human-computer interaction, and provides a human-computer interaction method and a tongue training system based on a human-computer interface. The human-computer interaction method includes the following steps: monitoring the touch signal from the tongue fed back by a sensor arranged in the user's mouth; displaying the feedback result on the human-computer interface according to the fed back touch signal. The tongue training system includes: a terminal, on which a human-computer interface is displayed; a sensor, arranged in the user's mouth, for feeding back the touch signal from the user's tongue, the sensor being communicatively connected with the terminal; and the terminal displaying the feedback result on the human-computer interface according to the fed back touch signal. The implementation method of the present application greatly enriches the control sense of applications and electronic games, and improves the user experience.

Description

Technical Field

[0001] The present invention relates to the field of human-computer interaction, and in particular to a human-computer interaction method and a tongue training system. Background Art

[0002] Human-Computer Interaction (HCI) refers to the process of information exchange between people and computers using a certain dialogue language and a certain interactive method to complete a certain task.

[0003] With the evolution of virtual reality and augmented reality technologies, human-computer interaction has also seen many new breakthroughs in traditional keyboard and mouse operations and touch screen operations that have been popular in the past decade, forming more types of somatosensory operations. For example, operations based on motion capture technology that capture user gestures and body movements, and operations based on artificial intelligence recognition technology that capture user facial expressions and eye contact, etc. Summary of the invention

[0004] In one embodiment of the present application, a human-computer interaction method is provided, based on a human-computer interface, comprising the following steps:

[0005] Monitoring the touch signal from the tongue fed back by a sensor disposed in the user's mouth;

[0006] According to the feedback touch signal, the feedback result is displayed on the human-machine interface.

[0007] The embodiments of the present application not only help users train tongue movement and improve tongue flexibility, but also provide a new human-computer interaction method. The human-computer interaction method obtains the movement state of the user's tongue with the help of a sensor set in the user's mouth, so that the interaction result of the user's tongue movement can be fed back on the human-computer interface, so that the user can control the application or game through the tongue, which improves the fun of use. The new somatosensory interaction method can also bring a sense of immersion to the user, improving the user experience.

[0008] In another embodiment of the present application, a tongue training system is provided, comprising:

[0009] Terminal, on which a human-machine interface is displayed;

[0010] A sensor is disposed in the user's oral cavity and is used to feedback a touch signal from the user's tongue. The sensor is in communication connection with the terminal;

[0011] The terminal displays the feedback result on the human-machine interface according to the feedback touch signal.

[0012] The embodiment of the present application uses a sensor disposed in the user's mouth to obtain the movement state of the user's tongue, so that the interaction result with the user's tongue movement can be fed back on the human-computer interface. While providing a new human-computer interaction method, it can also help users train tongue movement and improve tongue flexibility. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In order to more clearly illustrate the implementation methods of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the implementation methods or the description of the prior art. Obviously, the drawings described below are some implementation methods of the present application. For ordinary technicians in this field, without paying any creative work, they can also deduce related structures that do not appear in other drawings based on these drawings.

[0014] Figure 1 is a flow chart of the human-computer interaction method provided by the first embodiment of the present application;

[0015] Figure 2 is a module block diagram of a tongue training system provided in the first embodiment of the present application;

[0016] Figure 3 is a schematic diagram of the tongue training system provided by the second embodiment of the present application when it is installed in the oral cavity;

[0017] Figure 4 is a three-dimensional schematic diagram of a tongue training system provided in a second embodiment of the present application;

[0018] Figure 5 It is a schematic cross-sectional view of a human body when the tongue training system provided in the second embodiment of the present application is inserted into the oral cavity.

[0019] Description of reference numerals:

[0020] 1- Sensor;

[0021] 2-Data transmission component;

[0022] 3-bracket; 31-fixing part; 311-biting groove; 32-attaching part;

[0023] 4- Power supply components. DETAILED DESCRIPTION

[0024] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of this application.

[0025] Implementation Method 1

[0026] The embodiments of the present application provide a human-computer interaction method and a tongue training system.

[0027] The human-computer interaction in the prior art usually operates a computer or other device based on the user's body sense, for example, through the user's gestures, body movements, eyelid movements, etc. These interaction methods greatly enrich the control sense of applications and electronic games.

[0028] Based on the prior art, this application further proposes a new control method. Figure 1 As shown, in a first embodiment of the present application, a human-computer interaction method is provided, comprising the following steps:

[0029] Monitoring the touch signal from the tongue fed back by the sensor 1 disposed in the user's mouth;

[0030] According to the feedback touch signal, the feedback result is displayed on the human-machine interface.

[0031] A tongue training system, see Figure 2 As shown, including:

[0032] Terminal, on which a human-machine interface is displayed;

[0033] Sensor 1 is arranged in the user's oral cavity and is used to feedback a touch signal from the user's tongue. Sensor 1 is connected to the terminal for communication;

[0034] The terminal displays the feedback result on the human-machine interface according to the feedback touch signal.

[0035] Among them, the touch signal can be generated according to the tongue position and muscle strength of the user's tongue. The implementation method of the present application proposes a new interaction method. The human-computer interface can display feedback results according to the touch signal of the user's tongue, which greatly enriches the interactive experience. For example, people can control applications and electronic games with their tongues, which enhances the fun and sense of control. In particular, for disabled people who have lost both hands, smart devices can be controlled by the tongue to reduce the obstacles for disabled people to use smart devices and improve their social conditions. Of course, in actual operation, visual tracking technology, motion capture technology, etc. in the existing technology can also be used in combination to improve the accuracy of feedback and the convenience of use.

[0036] In this embodiment, the terminal may be a wired terminal or a wireless terminal. The wireless terminal may be a handheld device with wireless connection capability, a computing device, or other processing device connected to a wireless modem. Generally, the user's terminal may be a personal computer or a mobile terminal, with a mobile phone or a tablet computer being a preferred solution. The sensor 1 may be connected to the terminal by wireless communication, for example, by means of Bluetooth, Wlan, or NFC, so as to improve the convenience of the user when using it.

[0037] In order to improve the reliability of use, the tongue training system can also include a data transmission component 2 and a power supply component 4. The data transmission component 2 can be communicatively connected to the sensor 1 and to the terminal; the power supply component 4 can be electrically connected to the sensor 1 and the data transmission component 2 respectively.

[0038] The data transmission component 2 and the power supply component 4 can be separately arranged. Of course, the data transmission component 2 and the power supply component 4 can also be combined and arranged outside the user's dentition to prevent interference with the user's oral opening and closing movements.

[0039] Preferably, the data transmission component 2 and the power supply component 4 can be wrapped by a box body. A waterproof cover can be provided on the box body, and the waterproof cover is detachably covered on the box body by bolts, and a sealing ring is also provided between the waterproof cover and the main body of the power supply box. The power supply component 4 can be waterproofed by the provided box body, and the battery can be easily replaced.

[0040] The box body can also be fixedly connected to the user's teeth and move up and down with one side of the user's teeth, which improves flexibility. In addition, the battery in the power supply component 4 can also be a sports rechargeable battery. In the process of the power supply component 4 moving up and down with the teeth, the battery itself can be charged. In this way, the waterproof structure can be omitted, and the power supply component 4 and the data transmission component 2 are completely sealed, which improves convenience and safety.

[0041] It is worth mentioning that the human-computer interaction method of this embodiment is not limited to the above-mentioned hardware during application, which will not be elaborated here.

[0042] According to the touch signal fed back by the sensor 1, the feedback result can be displayed on the human-machine interface. Therefore, this embodiment can make the tongue more flexible through tongue training. During actual training, the feedback result displayed on the human-machine interface can monitor the user's tongue training situation. Therefore, the user can intuitively monitor the status of the tongue training and improve the user's enthusiasm for training.

[0043] In particular, it can also meet deeper user needs, such as learning foreign language pronunciation, practicing vocal music, etc., and can also be provided to tongue cancer patients after partial glossectomy for tongue muscle recovery training. Therefore, in this embodiment, the sensor 1 can be set at any part of the oral cavity that needs to be triggered by the tongue during tongue movement training, typically, such as the palate, the palatal and lingual surface of the anterior teeth, etc.

[0044] Among them, sensor 1 can be a bioelectric signal sensor for detecting the bioelectric signal of the tongue, or sensor 1 can be a trigger switch, which sends a signal when it detects that the tongue presses the trigger switch. Others may also include some auxiliary sensors, such as temperature sensors, humidity sensors, etc.

[0045] Taking the trigger switch as an example, when the user is doing tongue exercise, each time the tongue presses the trigger switch, a trigger signal can be sent to the data transmission component 2. At the same time, the data transmission component 2 feeds back the signal to the external terminal, and the training status can be obtained through the terminal.

[0046] Taking learning foreign language pronunciation as an example, when learning a minority language (such as Italian, Russian, Spanish, etc.), tongue-flicking training is required. One of the training methods is: the tip of the tongue needs to be against the alveolar ridge (the raised part of the gums at the upper roots of the teeth) and try not to touch the incisors; at the same time, the tongue needs to be straightened and slightly spread to both sides, sticking to the surrounding tooth roots to prevent air leakage; when the user obtains the correct tongue position, inhale to make the tip of the tongue vibrate to produce a tongue-flicking sound.

[0047] However, in reality, users are often unable to complete the training requirements quickly because they are not clear about the location of the alveolar ridge, that is, the correct tongue position, which wastes time and perseverance.

[0048] Therefore, in this embodiment, a press trigger switch can be provided on the alveolar ridge and the incisor, so that during actual training, the user can be guided to obtain the correct tongue position and given positive feedback to improve the efficiency and effect of tongue training.

[0049] Alternatively, the sensor 1 may also be a pressure sensor.

[0050] As a preferred solution of this embodiment, a plurality of sensors 1 may be provided, and the sensors 1 are dispersedly provided in the user's oral cavity.

[0051] Taking the mobile game "Don't Step on the White Blocks" as an example, the pressure sensor can be set at a position where the tip of the tongue can easily touch, such as the palate, incisor, canine and other areas. In the prior art, the user only needs to "step on" the black block to move forward by constantly touching the touch screen with his fingers. However, in this embodiment, the user can press the pressure sensor by controlling the tongue to "step on" the black block and skip the white block. Compared with pressing the touch screen of the smart terminal with fingers, this embodiment proposes a new interaction method and improves the fun. In addition, some disabled people with limited mobility can also experience the joy of the game, which improves the applicability of this embodiment.

[0052] The pressure sensor can also measure the magnitude of the abutment pressure, so the pressure sensors dispersed in the user's mouth can be used to detect the abutment pressure of the user's tongue on various surfaces in the mouth. By detecting the abutment pressure of the tongue, the tongue exercise process and exercise effect can be well quantified, so that the user can get more positive feedback, thereby stimulating the user's interest in practice and cultivating perseverance.

[0053] Among them, the pressure sensor can adopt a thin film pressure sensor to reduce the thickness and improve the training quality. Of course, other forms of pressure sensors are also feasible and will not be elaborated here.

[0054] The human-machine interface of the present application can display feedback results according to the touch signal of the user's tongue, which greatly enriches the interactive experience. For example, people can control applications and electronic games through the tongue, which improves the fun and sense of control. In particular, controlling smart devices through the tongue can reduce the obstacles for some disabled people to use smart devices and improve their social conditions. In addition, this embodiment enables the user to intuitively monitor the status of tongue training by monitoring the touch signal fed back by the sensor 1, thereby improving the efficiency and enthusiasm of tongue training and improving the effect of practice.

[0055] Implementation Method 2

[0056] Due to the complex environment inside the oral cavity, it is difficult for ordinary users to install the separate sensor 1, data transmission component 2, power supply component 4 and other structures one by one in their own oral cavity.

[0057] In view of this, the second embodiment of the present application provides a tongue training system. The tongue training system of the second embodiment is substantially the same as the tongue training system of the first embodiment, the main difference being that, in the first embodiment of the present application, a box body is used to place the data transmission component 2 and the sensor 1; whereas, in the second embodiment of the present application, a bracket 3 is used to fix the various components of the tongue training system.

[0058] Specifically, combined Figures 3 to 5 As shown, the tongue training system also includes:

[0059] The support 3 comprises:

[0060] A fixing portion 31, used for relatively fixing the position of the tongue training system;

[0061] The attaching portion 32 is connected to the fixing portion 31 , and is attached to the surface of the user's oral cavity to place the sensor 1 .

[0062] Optionally, when the sensor 1 is arranged on the oral palate, the attachment portion 32 may cover at least a portion of the surface of the user's oral palate. When the attachment portion 32 covers the oral palate, the sensor 1 arranged on the attachment portion 32 may cover the position of the most important part that needs to be contacted for tongue muscle training.

[0063] In addition, optionally, the fixing portion 31 is formed with an occlusal groove 311, and the occlusal groove 311 matches the shape of the user's teeth. The occlusal groove 311 matching the shape of the user's teeth can firmly fix the bracket 3 to prevent slippage. Specifically, the bracket 3 can be customized into a shape that matches the user's occlusion and other parts through 3D printing. Due to shape matching, the position of each sensor 1 can be more accurately located. In addition, the customized bracket 3 can also improve the user's comfort.

[0064] Of course, the fixing portion 31 may also be made of a common template made of a flexible material to facilitate mass production and reduce costs.

[0065] Even, the fixing part 31 can be formed as a dental appliance. While the user is correcting teeth, it plays a role in tongue training, so as to expand the applicability of the tongue training system of this embodiment. Typical dental appliances can be orthodontic brackets, invisible braces, orthopedic devices, retainers, etc.

[0066] Since the tongue training system is structurally integrated with the help of the bracket 3, when using it, the user only needs to put the entire bracket 3 into the mouth without the need for precise and professional positioning operations, which significantly improves the convenience of operation and the user experience.

[0067] The power supply component 4 and the data transmission component 2 can be mounted on the outside of the bracket 3 for easy disassembly. Figure 4 An accommodation space may be formed in the bracket 3, and the power supply component 4 and the data transmission component 2 are built in the accommodation space. The wires connecting each sensor 1 and the data transmission component 2 and the power supply component 4 may also be buried inside the bracket 3 to reduce interference in the use state.

[0068] The data transmission component 2 may further include a charging interface or a data transmission interface provided on the surface of the bracket 3, and these interfaces may be sealed by a waterproof rubber plug.

[0069] In addition, as an optional solution, the power supply component 4 may also include a battery and a wireless charging coil, which are sealed in the bracket 3, and the wireless charging coil is used to charge the battery. With the help of wireless charging, in combination with the wireless data transmission component 2, the waterproof performance can be further improved and the convenience can be improved.

[0070] In this embodiment, the integrated bracket 3 makes the installation and use of the tongue training system more convenient. Even the user can easily install and remove the tongue training system at home, and can perform tongue muscle training anytime and anywhere, thereby significantly improving convenience and solving the problem of poor user compliance.

[0071] In this embodiment, a typical tongue training method based on the dental appliance of the present application is also proposed, comprising the following steps:

[0072] 1. Download an application (app) in the terminal and use the application to establish a communication connection between the sensor 1 and the terminal.

[0073] 2. The number, position, and current sensing state (such as the pressure magnitude and direction, etc.) of each sensor 1 can be displayed intuitively on the terminal. The terminal can display the information in a graphical interface or in a digital form. The details displayed on the terminal can be intuitively seen by the user.

[0074] 3. After the dental appliance is installed, the user can start tongue training. When the user's tongue touches each sensor 1, the terminal can provide corresponding numerical values, graphics or game interactive feedback.

[0075] Implementation Method 3

[0076] The third embodiment of the present application provides a human-computer interaction method. The third embodiment is a further improvement of the first embodiment. The main improvement is that in the third embodiment of the present application, the human-computer interface displays:

[0077] The subject, which is displayed in the human-computer interface as constantly moving relative to the surrounding environment;

[0078] Obstacles appear in front of the subject's direction of movement;

[0079] The main body changes its relative movement direction in response to the feedback touch signal to avoid the obstacle.

[0080] By guiding the user's tongue to touch the target sensor 1 and avoid non-target sensors through the main body and obstacles on the human-machine interface, the fun of control can be improved compared with traditional touch control.

[0081] For example, the subject displayed on the human-computer interface can be a frog, which needs to avoid obstacles and jump onto the target lotus leaf to eat mosquitoes. In actual training, when the user touches the correct sensor 1, the frog can jump onto the target lotus leaf; when the user presses the sensor 1 with appropriate force, the frog can eat the mosquito. Among them, positive feedback can be given to the user in the form of music, scores and rewards. Compared with controlling the game interface with both hands, this embodiment controls the game through the tongue, which can increase the fun of use. The new somatosensory interaction method can also bring a sense of immersion to the user and improve the user experience.

[0082] In addition, for users who need to train tongue flexibility, games can also be used to guide users to train their tongues and give them positive feedback, thereby maintaining the user's perseverance and determination in tongue training. For most people, especially children and adolescents, this method can significantly improve the problem of poor compliance with tongue training, making the tongue training process fun.

[0083] Preferably, when the user completely avoids non-target sensors during training, that is, when the frog avoids all obstacles in the frog eating mosquito game, more positive feedback can be given, such as double scores, rewards, etc. When the user's scores, rewards, etc. accumulate to a certain amount, more game levels can be unlocked or more in-depth tongue training courses can be obtained, thereby increasing the user's enthusiasm for tongue training and improving the training effect.

[0084] For similar purposes, the human-computer interaction interface can also display a timing module so that the frog can eat mosquitoes within a limited time. The timing module can be triggered after the user's training times, scores or rewards reach a specified requirement to urge the user to improve the efficiency of training.

[0085] In this embodiment, the frog can avoid obstacles and jump to the target lotus leaf in real time according to the feedback signal of the user's tongue, or it can be blind tested after a period of use - only the result of tongue training is displayed, but not or temporarily not displayed, so as to reduce the user's dependence on the game. When the user needs to watch the training process, he can review it by playback to optimize the user experience.

[0086] Of course, the human-machine interface can also display other feedback screens, the display interface can simulate different scenes, the user's tongue can be simulated as a role in the oral environment, and the sensor 1 can be displayed as different modules. For example:

[0087] 1. Scene Simulation

[0088] In the simple mode, preliminary prompts (such as light emission, color change, etc.) are issued through modules arranged at different positions to guide the user to touch the sensor 1 at the corresponding position in the oral cavity;

[0089] In the difficult mode, the module issues advanced prompts (such as flashing, digital countdown, etc.) to guide the user to control the duration or pressure of touching the sensor 1.

[0090] Among them, the scene can simulate the oral environment, the human-machine interface can be displayed in a third-person perspective, and the display interface can be displayed as a character looking up at the ceiling (upper palate). Similarly, a backboard, a goal, etc. can also be simulated, and the user can score a goal by touching the target sensor 1.

[0091] Of course, it can also simulate the starry sky, and pick stars by touching the target sensor 1; it can also simulate the galaxy, and the user can complete a virtual interstellar travel by touching the target sensor 1.

[0092] In actual use, scenarios can be recommended based on the user's gender and age to improve the user experience.

[0093] 2. Button touch type

[0094] The human-machine interface can be displayed as a first-person perspective or a third-person perspective.

[0095] One type is a combat game: all modules slide to one side of the interface and disappear, and new modules iterate over the blank spaces. Points are gained by touching target modules and skipping non-target modules.

[0096] Taking "Taiko no Tatsujin" as an example, the game rules can be defined as: touch the sensor 1 on the canine to switch the difficulty of the game. After starting the game, when the notes fall into the target position, touch the sensor 1 on the left side of the mouth to hit the red notes, and touch the sensor 1 on the right side of the mouth to hit the blue notes to get points. Users can experience the fun of playing drums in the game by touching the sensors 1 on both sides of the mouth.

[0097] Take "Don't Step on the White Block" as an example. When the black block on the left side of the interface is about to disappear, the user touches the sensor 1 on the left side of the mouth to "step on" the black block. When the black block on the right side of the interface is about to disappear, the user touches the sensor 1 on the right side of the mouth to "step on" the black block and get points. Similarly, it can also be applied to combat games such as "Rhythm Master", where the user can switch the row of the module by sliding the tongue.

[0098] Preferably, there can be provided a classic mode to complete a specified number of modules at the fastest speed; a time-limited mode to test the completion within a specified time (e.g., within 30 seconds); a relay mode to complete, for example, 50 modules; an extreme speed mode to complete the relay mode within a specified time; and a Zen mode in which the game does not end when encountering obstacles.

[0099] One type is a development game, in which the fate of the character is determined by touching different sensors 1. In order to distinguish the functions of different modules, the modules of the display interface can be labeled with text.

[0100] Taking the game "Travel Frog" as an example, the frog is fed with food or equipped with travel props by touching different sensors 1, so as to be fully prepared for the frog's journey. The tongue continuously sweeps across different sensors 1 to harvest clover.

[0101] Taking "Farm" as an example, by touching different sensors 1, you can sow crop seeds, water, fertilize, remove pests, harvest, and interact with friends by stealing vegetables. Similarly, it can also be applied to games such as city construction and interstellar attack and defense.

[0102] 3. Long-range shooting

[0103] The shooting range is controlled according to the holding force of the tongue, the shooting direction is controlled according to the sensor 1 touched by the tongue, or different sensors 1 may correspond to different shooting positions, such as the "Billiards" game.

[0104] 4. Parkour

[0105] The jumping distance / height is controlled according to the length of time the tongue touches the sensor 1, so as to control the character to avoid obstacles or obtain bonuses.

[0106] Preferably, this embodiment can be used in conjunction with other human-computer interaction methods to reduce tongue fatigue and bring a better immersive experience.

[0107] Implementation Method 4

[0108] Existing technologies often do not provide feedback on training results, and users need to explore on their own. The training process is very boring, not to mention whether the work is in vain. What's more serious is that if the user's tongue position is still incorrect after a long period of training without knowing it, he will fall into self-denial and lose his enthusiasm for training itself.

[0109] In view of this, the fourth embodiment of the present application provides a human-computer interaction method. The fourth embodiment is a further improvement of the first and third embodiments. The main improvement is that in the third embodiment of the present application, there can be multiple sensors 1, and the human-computer interface can give the user positive feedback.

[0110] Specifically, the human-machine interface displays:

[0111] A number of objects, the number of objects is the same as that of sensor 1 and they correspond one to one;

[0112] The object changes its display state in response to the touch signal sent by the corresponding sensor 1.

[0113] This embodiment helps users to perform tongue training through the interactive objects provided, which can improve the efficiency of tongue training. Compared with the prior art, users can intuitively monitor the status of tongue training without having to figure out the tongue position and muscle strength by themselves, which improves the convenience of use and user experience.

[0114] Among them, the object responds to the touch signal sent by the corresponding sensor 1 and can change its own display state through highlighting, feature points or voice prompts to improve the convenience of use.

[0115] In order to further improve the user experience, the human-computer interface can also display: a prompt control, which is used to prompt the user to touch the object next. For example, in scene simulation games, preliminary prompts (such as light, color change, etc.) are issued by modules set in different positions to guide the user to touch the sensor 1 at the corresponding position in the mouth; advanced prompts (such as flashing, digital countdown, etc.) issued by the module guide the user to control the length of time or pressure of touching the sensor 1. Of course, it is also possible to urge users to perform tongue training in a timely manner by setting an alarm reminder, thereby avoiding the problem of a small number of exercises caused by users' escape or forgetfulness; voice reminders can also be used to correct the user's tongue position and muscle release to reduce the occupation of text on the display interface, such as "Object A is in the correct position" and "Object A should be harder."

[0116] Preferably, the human-computer interface also displays: a background map that approximates the oral environment, wherein the background map can be a cartoon or realistic two-dimensional or three-dimensional model displayed as the inside of the user's mouth, to help the user intuitively monitor and correct the tongue position, thereby improving convenience and compliance.

[0117] In touch-button games, all modules will slide to one side of the interface and disappear, and new modules will iterate over the blank space. Users can gain points by touching target modules and skipping non-target modules. In Taiko no Tatsujin, different drum sounds will be played when users touch different notes, but there is no feedback on hits.

[0118] Therefore, preferably, in this embodiment, when the user touches the target sensor 1, an incentive sound effect, such as "good", "great", "perfect", etc., can be played; when the user touches the non-target sensor 1, a sound effect expressing regret, such as "a ou", "again", etc., can be played to create a better gaming atmosphere and improve the user experience. Of course, when the user touches the non-target sensor, regret can also be expressed by vibration. For example, a stimulator can be provided in the user's mouth, and the stimulator is coupled to the external coil. The generated current can stimulate the tongue, thereby giving the user a better immersive experience.

[0119] It should be understood that the terms used in the embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit the present application. The singular forms of "a", "said" and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings, and "multiple" generally includes at least two, but does not exclude the inclusion of at least one.

[0120] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0121] It should be understood that, although the terms first, second, third, etc. may be used to describe certain components in the embodiments of the present application, these components should not be limited to these terms. These terms are only used to distinguish the components from each other. For example, without departing from the scope of the embodiments of the present application, the first so-and-so component may also be referred to as the second so-and-so component, and similarly, the second so-and-so component may also be referred to as the first so-and-so component.

[0122] Depending on the context, the words "if" and "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to monitoring." Similarly, depending on the context, the phrases "if it is determined" or "if monitoring (stated condition or event)" may be interpreted as "when determining" or "in response to determining" or "when monitoring (stated condition or event)" or "in response to monitoring (stated condition or event)."

[0123] In the embodiments of the present application, "substantially equal to", "substantially perpendicular to", "substantially symmetrical", etc. means that the macroscopic size or relative position relationship between the two features is very close to the relationship mentioned. However, those skilled in the art know that due to objective factors such as errors and tolerances, the position relationship of objects is difficult to be constrained exactly at a small scale or even at a microscopic angle. Therefore, even if there is a slight error in the size and position relationship between the two, it will not have a significant impact on the realization of the technical effect of the present application.

[0124] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a product or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such a product or system. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the product or system including the elements.

[0125] In each of the above-mentioned embodiments, although the above-mentioned methods are illustrated and described as a series of actions for simplicity of explanation, a person skilled in the art should understand and appreciate that these methods are not limited by the order of the actions, because according to one or more embodiments, some actions may occur in a different order and / or concurrently with other actions from those illustrated and described herein or not illustrated and described herein but understandable to those skilled in the art.

[0126] Those skilled in the art will appreciate that information, signals, and data may be represented using any of a variety of different technologies and techniques. For example, data, instructions, commands, information, signals, bits, symbols, and chips cited throughout the above description may be represented by voltage, current, electromagnetic waves, magnetic fields or magnetic particles, optical fields or optical particles, or any combination thereof.

[0127] Those skilled in the art will further appreciate that the various illustrative logic blocks, modules, units, circuits, and algorithm steps described in conjunction with the embodiments disclosed herein can be implemented as electronic hardware, computer software, or a combination of the two. To clearly illustrate this interchangeability of hardware and software, various illustrative components, boxes, modules, units, circuits, and steps are described generally in the form of their functionality above. Whether such functionality is implemented as hardware or software depends on the specific application and the design constraints imposed on the overall system. The technician can implement the described functionality in different ways for each specific application, but such implementation decisions should not be interpreted as resulting in a departure from the scope of the present application.

[0128] Finally, it should be noted that those skilled in the art can understand that in order to enable readers to better understand the present application, the embodiments of the present application provide many technical details. However, even without these technical details and various changes and modifications based on the above-mentioned embodiments, the technical solutions claimed for protection by the claims of the present application can be basically realized. Therefore, in practical applications, various changes can be made to the above-mentioned embodiments in form and detail without departing from the spirit and scope of the present application.

Claims

1. A human-computer interaction method, based on a human-computer interface, characterized in that: The steps include: Monitoring the touch signal from the tongue fed back by a sensor disposed in the user's mouth; Displaying a feedback result on the human-machine interface according to the feedback touch signal; The human-machine interface also displays: a prompt control, which is used to prompt the user to touch the object next, guide the user to control the length of time or pressure of touching the sensor, and correct the user's tongue position and muscle force release through voice reminders; the sensor is a pressure sensor; The human-computer interaction method is applied to tongue muscle recovery training and guides users to train their tongues through games; the sensor is set at any part of the tongue in the oral cavity that needs to be triggered when the user is performing tongue movement training; The feedback result includes positive feedback information for the user; The human-machine interface also displays: A subject, the subject being displayed in the human-machine interface as being in constant motion relative to a surrounding environment; an obstacle, appearing in front of the direction of movement of the subject; The subject changes its relative movement direction in response to the feedback touch signal to avoid the obstacle; There are multiple sensors, and the human-machine interface also displays: A plurality of objects, the number of the objects is the same as the number of the sensors and they correspond one to one; The object changes its display state in response to a touch signal sent by a corresponding sensor.

2. The human-computer interaction method according to claim 1, characterized in that: The human-machine interface also displays: Background map that approximates the oral environment.

3. A tongue training system, characterized in that: include: A terminal, wherein a human-machine interface is displayed on the terminal; A sensor, disposed in the user's oral cavity, for feeding back a touch signal from the user's tongue, wherein the sensor is communicatively connected with the terminal; The terminal displays the feedback result on the human-machine interface according to the feedback touch signal; The human-machine interface also displays: a prompt control, which is used to prompt the user to touch the object next, guide the user to control the length of time or pressure of touching the sensor, and correct the user's tongue position and muscle force release through voice reminders; the sensor is a pressure sensor; The tongue training system is applied to tongue muscle recovery training and guides users to train their tongues through games; the sensor is arranged at any part of the tongue in the oral cavity that needs to be triggered when the user is performing tongue movement training; The feedback result includes positive feedback information for the user; The human-machine interface also displays: A subject, the subject being displayed in the human-machine interface as being in constant motion relative to a surrounding environment; an obstacle, appearing in front of the direction of movement of the subject; The subject changes its relative movement direction in response to the feedback touch signal to avoid the obstacle; There are multiple sensors, and the human-machine interface also displays: A plurality of objects, the number of the objects is the same as the number of the sensors and they correspond one to one; The object changes its display state in response to a touch signal sent by a corresponding sensor.

4. The tongue training system according to claim 3, characterized in that: There are a plurality of sensors, and the sensors are dispersedly arranged in the user's mouth.

5. The tongue training system according to claim 3, characterized in that: The tongue training system further comprises: A support, comprising: A fixing part, used for relatively fixing the position of the tongue training system; The attaching part is connected to the fixing part, and the attaching part is attached to the surface of the user's oral cavity and is used for placing the sensor.

6. The tongue training system according to claim 5, characterized in that: The fixing portion is formed with an engagement groove, and the engagement groove matches the shape of the user's teeth; Alternatively, the fixing portion is formed as a dental appliance.

Images