Method and apparatus for providing game-form training application that combines hearing training and brain training executed by terminal
A game-based training interface integrating hearing and brain exercises addresses the monotony of conventional hearing training, enhancing both auditory and cognitive functions through adjustable difficulty levels and varied tasks.
Patent Information
- Application Number
- JP2024187024
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-09-03
- Filing Date
- 2024-10-23
- Publication Date
- 2025-06-25
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Conventional hearing training techniques are monotonous and only focus on auditory stimuli, failing to improve cognitive functions, leading to difficulty in maintaining user engagement and ineffective enhancement of hearing and cognitive abilities.
A training interface combining game-based hearing and brain training, incorporating three hearing trainings (episodic memory, working memory, and attention) and three brain trainings (finding shapes, line tracing, and inference), with adjustable difficulty levels based on user performance, to enhance auditory and cognitive functions.
The combined training approach improves user engagement and effectively enhances both hearing and cognitive functions, reducing the need for hearing aids and providing a more comprehensive training experience.
Smart Images

Figure 2025094901000001_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to a method and apparatus for providing a training application in a game format that combines hearing training and brain training executed by a terminal. More specifically, the present invention relates to a method and apparatus for providing a training interface that combines hearing training and brain training to improve a user's hearing function and cognitive function.
Background Art
[0002] With the continuing trend of the increasing elderly population, hearing loss due to aging has become a matter of concern.
[0003] Hearing loss has a great impact on daily life. Since hearing loss causes problems such as difficulty in speech recognition, cognitive dysfunction, social isolation, reduction in quality of life, risk of depression, and decreased participation in daily life activities, there has been a growing interest in methods for improving hearing.
[0004] Conventional hearing training techniques for improving hearing train a user to listen to words and sentences together with white noise and to discriminate correct information in the presence of noise. Such conventional hearing training techniques only provide auditory stimuli, so it has been difficult for users to continue boring and monotonous training for a long time.
[0005] Hearing is of utmost importance for listening to auditory information. At this time, in order to selectively process and understand necessary information and interact with others, it is necessary to train not only hearing but also cognitive functions such as selective attention and intellectual ability at the same time.
[0006] However, since conventional hearing training techniques have problems such as monotonous content or training only the auditory sense, they cannot exert the effect of improving hearing.
Summary of the Invention
Problems to be Solved by the Invention
[0007] The present invention aims to improve the user's auditory function and cognitive function by providing a training interface in the form of a game that randomly combines three hearing trainings and three brain trainings.
[0008] However, the technical problems to be solved by the present invention should not be limited to those described above, and may be variously extended within the scope not departing from the technical idea and scope of the present invention.
Means for Solving the Problems
[0009] In a method for providing a training application that combines a game-based hearing training and a brain training executed by a terminal according to an embodiment of the present invention, the method includes providing a training interface that combines a game-based hearing training and a brain training in an area of the terminal screen, receiving a user's selection input through the training interface, and determining the task execution ability for each of the hearing training and the brain training, and adjusting the difficulty level of the training interface for improving the auditory function and the cognitive function according to the determination result.
[0010] In a device for providing a training application that combines a game-based hearing training and a brain training executed by a terminal according to an embodiment of the present invention, the device includes a training providing unit that provides a training interface that combines a game-based hearing training and a brain training in an area of the terminal screen, an execution ability determination unit that receives a user's selection input through the training interface and determines the task execution ability for each of the hearing training and the brain training, and a training control unit that adjusts the difficulty level of the training interface for improving the auditory function and the cognitive function according to the determination result.
Effects of the Invention
[0011] According to an embodiment of the present invention, by providing a training interface in a game format that randomly combines three hearing trainings and three brain trainings, it is possible to improve the problems of the prior art, such as the monotony of hearing training and the fact that only hearing is trained.
[0012] According to an embodiment of the present invention, by providing a training interface that improves the auditory function and cognitive function, it is possible to eliminate the annoyance of wearing a hearing aid for a user with a reduced auditory function and liberate the user from a situation where a hearing aid cannot be used.
[0013] However, the effects of the present invention should not be limited to those described above, and may be variously extended within the scope not departing from the technical idea and scope of the present invention.
Brief Description of the Drawings
[0014]
Figure 1
Figure 2
Figure 3
Figure 4
Figure 5
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Figure 12
Figure 13
Figure 14
Figure 15
Embodiments for Carrying Out the Invention
[0015] The advantages and features of the present invention, and the methods for achieving them, will become apparent by referring to the embodiments described in detail below together with the accompanying drawings. However, the present invention should not be limited to the embodiments disclosed below, and may be realized in various different forms. These embodiments are provided to make the disclosure of the present invention complete and to fully inform those with ordinary knowledge in the technical field to which the present invention pertains of the scope of the present invention. The present invention is only defined by the scope of the claims.
[0016] The terms used in this specification are only for explaining the embodiments and are not intended to limit the present invention. In this specification, the singular form includes the plural form unless otherwise specifically mentioned. The terms "comprises" and / or "comprising" used in this specification do not exclude the presence or addition of one or more other components, steps, operations, and / or elements.
[0017] Unless otherwise defined, all terms (including technical and scientific terms) used in this specification are used with the meaning commonly understood by those with ordinary knowledge in the technical field to which the present invention pertains. Also, terms defined in commonly used dictionaries should not be interpreted ideally or excessively unless specifically defined otherwise.
[0018] Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the accompanying drawings. The same reference numerals are used for the same components in the drawings, and redundant descriptions of the same components are omitted.
[0019] The gist of the present invention is to provide a training interface in the form of a game that combines hearing training and brain training.
[0020] The training application providing platform service according to an embodiment of the present invention provides various services necessary for training that combines hearing training and brain training executed by a terminal.
[0021] The greatest advantage is that the user can improve their auditory function and cognitive function by using earphones and a terminal device and executing a game-style training that combines hearing training and brain training provided through an application in the terminal according to the sound received through the earphones. At this time, the user may be an elderly person and includes all users aiming to improve their auditory function and cognitive function.
[0022] Hereinafter, the present invention will be described in detail with reference to FIGS. 1 to 15.
[0023] FIG. 1 is a diagram for explaining the configuration of a training application providing platform system in an embodiment of the present invention.
[0024] Referring to FIG. 1, a training application providing platform system 100 according to an embodiment of the present invention includes a platform server 110 and a plurality of user electronic devices 120. That is, at least one user may access the platform server 110 through the terminal device 122 in the electronic device 120 and receive data necessary for training from the platform server 110. At this time, the earphone 121 is in an interlocked state with the terminal device 122.
[0025] First, the platform server 110 may provide a training application in the form of a game that combines hearing training and brain training, and collect and manage the user's auditory state information and user information through the application. For example, the user accesses the platform server 110 through the terminal 122 to install the application and executes the registration procedure through the application. At this time, the user may input and register at least one or more pieces of information among name, ID, password, earphone information for earphone linkage, and hearing test data.
[0026] The platform server 110 accepts the registration procedure through the user information, provides sounds related to the training interface through the terminal 122 and the earphone 121 linked to the terminal 122, and may provide a training interface that combines hearing training and brain training suitable for the user's auditory function and cognitive function in an area of the terminal screen.
[0027] The user may execute the training interface through the application using the electronic device 120 including the earphone 121 and the terminal 122. At this time, the earphone 121 may be a hearing aid earphone, and may also be a commonly used Bluetooth (registered trademark) earphone or a wired earphone. The terminal 122 is owned by the user and may be any one of a smartphone, a mobile phone, a notebook PC, and a tablet that the user usually uses.
[0028] The user may execute the training application according to the embodiment of the present invention through the terminal device 122 while wearing the earphone 121, and execute the training interface displayed in an area of the screen of the terminal device 122 through the application. According to the embodiment, the user can also execute the training application by using only the terminal device 122 with the earphone 121 not worn, but in order to more effectively improve the auditory function, it is basically required to wear the earphone 121 and execute the application. In addition, the user may access the platform server 110 through the owned terminal device 122 to receive and update the information necessary for the training.
[0029] Hereinafter, a method and system for providing a training application executed by a terminal device 122 owned by a user and its examples will be schematically described.
[0030] FIG. 2 is a flowchart showing the operation of a method for providing a training application in a game format that combines hearing training and brain training executed by a terminal device in an embodiment of the present invention.
[0031] Referring to FIG. 2, the method for providing a training application according to the embodiment of the present invention is executed by an application installed in a terminal device owned by a user.
[0032] In step 210, a training interface in a game format that combines hearing training and brain training is provided in an area of the screen of the terminal device.
[0033] Step 210 according to an embodiment of the present invention is characterized in that it provides a game - type training interface that combines three hearing trainings and three brain trainings according to a goal set based on the user's auditory state information to improve the user's auditory function and cognitive function. The hearing trainings provided by the present invention include episodic memory (the first hearing training), working memory (the second hearing training), and attention (the third hearing training), and the brain trainings include finding shapes (the first brain training), line tracing (the second brain training), and inference (the third brain training).
[0034] Accordingly, the present invention proposes "today's training" to the user as a daily goal, and the goal may be randomly set from among the hearing trainings and brain trainings based on the user's hearing test data or training history. Step 210 may randomly select a training from each of the hearing trainings and brain trainings based on 24:00 every day, set it as "today's training", and display it on the screen of the terminal device, so that the user can execute "today's training" to complete the training. At this time, there is no limitation on the type and number of selected trainings, nor is there a limitation on the set time interval.
[0035] The three hearing trainings provided by the present invention are for improving the auditory function. Hereinafter, each of the three hearing trainings will be described in detail.
[0036] The first hearing training is called "episodic memory" and aims to improve hearing. It is a training where the user memorizes the played words and their order and selects the correct answer that matches the question. Thus, step 210 provides the sounds of a preset number of words, allows the user to memorize the played words and their order, and then selects the words in order. For example, step 210 plays the preset three words "ant", "crab", "horse" in sequence and makes the user memorize the words in order. After playing all three word sounds, step 210 provides a selection of the three words mixed together and asks the user to input the three words in order. When the user inputs the words "ant", "crab", "horse" in order, the training ends.
[0037] The second hearing training is called "working memory" and aims to improve hearing. It is a training where the user memorizes the played words and their order and selects the correct answer that matches the question. Thus, step 210 provides the sounds of a preset number of words, allows the user to memorize the played words and their order, and then selects the words in reverse order. For example, step 210 plays the preset three words "ant", "crab", "horse" in sequence and makes the user memorize the words in reverse order. After playing all three word sounds, step 210 provides a selection of the three words mixed together and asks the user to input the three words in reverse order. When the user inputs the words "horse", "crab", "ant", which are the reverse order of "ant", "crab", "horse", the training ends.
[0038] The third hearing training is called "Attention" and aims to improve hearing. It is a training where the user listens to the words spoken by the character and presses the button that matches the problem. Thus, in step 210, when the character emits the sound of a specific word and the sound of the same word as the word spoken by the character is generated, the user is made to click the button. For example, only when the character emits the words "na" and "to", the user must click the push button. The character randomly emits a preset number of word sounds. At this time, the user must not click the push button when the character emits "a", and must only click the push button when the character emits "na" and "to".
[0039] Here, although an example has been described in which the number of options provided in the first hearing training, the second hearing training, and the third hearing training is three, the number of characters is two or less, and the number of syllables is one, it is not limited to this. As the level increases, the number of options, the number of characters, and the number of syllables of the words may be increased.
[0040] The three brain trainings provided by the present invention are for improving cognitive functions. Hereinafter, each of the three brain trainings will be described in detail.
[0041] The first brain training is called "Finding Shapes" and is a training where the user searches for and selects the same symbol as the presented shape. Thus, in step 210, a specific symbol is provided, and after providing options in which various symbols are mixed, the user is made to select the same symbol as the specific symbol from the options. For example, in step 210, after providing a star as a specific symbol, options in which a circle, a square, a triangle, a cross, a U-shape, a star, and an arrow are mixed are provided, and when the user selects a star from the options, the training ends.
[0042] The second brain training is called "Line Tracing" and is a training where small or large numbers are sequentially selected. Accordingly, in step 210, a plurality of numbers are randomly displayed on the screen of the terminal device, and the user is made to select them in order from the smallest number. For example, in step 210, the numbers 1, 2, 3, 4, 5 are randomly arranged and provided, and when the user selects the numbers from 1, which is the smallest number, to 5 in order, the training ends.
[0043] The third brain training is called "Inference" and is a training where a specific rule is found and what to enter in the question mark box is selected. Accordingly, in step 210, the rule hidden in the problem is found, and the user is made to select the answer to be entered in the question mark box. For example, in step 210, after providing 1, 2, 3,?, 5, and then providing the options 1, 4, 5, when the user infers the number to be entered in the square (or the question mark box) and selects "4", the training ends. Here, although numbers are used as an example for explanation, it is also possible to provide rules for figures instead of numbers.
[0044] In step 220, the user's selection input is received according to the training interface, and the task execution ability for each of the listening training and the brain training is determined.
[0045] In step 220, in the three listening trainings and the three brain trainings, the task execution ability for the training can be determined based on accuracy and order. Accordingly, in step 220, in a training interface where a plurality of questions are presented within a preset time, the correct and incorrect answers are determined based on the user's selection input received for each question, and the user's task execution ability can be determined according to the correct answer rate and the incorrect answer rate. Accordingly, in step 220, it can be determined whether to maintain or increase the level of the training interface executed by the user according to the user's task execution ability.
[0046] As an example, if a user inputs the correct answer within a preset time in the test provided at level 1 of the first hearing training and achieves a correct answer rate of 90% or more, step 220 determines that this user is capable of performing level 1 and levels up. Thereafter, when the user conducts the first hearing training, level 2 may be provided. As another example, if a user inputs the correct answer outside the preset time in the test provided at level 1 of the first hearing training, or inputs only incorrect answers within the preset time and achieves a correct answer rate of 50 - 70%, step 220 determines that this user has not fully completed level 1, and thereafter, when the user conducts the first hearing training, level 1 may be provided as it is.
[0047] In step 230, in order to improve the auditory function and cognitive function, the difficulty level of the training interface is adjusted according to the judgment result.
[0048] Step 230 may control to provide the user with the training interface at the same level or the updated level according to the result judged in step 220. At this time, step 230 may gradually lower the volume of the provided sound and adjust the difficulty level of the training while increasing the options, the number of words, and the number of syllables (or the number of characters) of the words used in the training interface. For example, there are 4 words provided at level 1 of the first hearing training, but 7 words may be provided at level 5. However, the number of words and the number of syllables of the words provided according to the level shall not be limited to those described above and can be adjusted by the administrator.
[0049] Stage 230 may provide the terminal with a training result screen of the final score area, correct answer rate notation area, correct answer rate graph area, and score table through the training interface. At this time, the final score area indicates the final score played in the immediately previous training interface, and the correct answer rate notation area indicates the total number of questions the user trained and the number of questions answered correctly. The correct answer rate graph area represents the correct answer rate in a pie chart, and the correct answer rate is rounded to an integer and indicated at the center of the graph. The score table indicates the top three scores in the order of year, month, hour / level / score. The total number of questions is based on individual questions rather than difficulty units, and partial scores are also processed for correct / incorrect answers.
[0050] Figures 3 to 14 are diagrams showing examples of a training application in a game format that combines listening training and brain training executed by a terminal in an embodiment of the present invention.
[0051] Figures 3 to 14 show examples of a training application executed on a terminal owned by a user. Although the Korean version and the Japanese version are mixed, it is possible to execute in a unified language version according to the country. The following drawings show examples of a training application after the user installs the training application on the terminal they own and completes registration by inputting basic information.
[0052] Referring to FIG. 3, a training application 300 according to an embodiment of the present invention represents a calendar 310 and a training banner area 320. The calendar 310 shows a week by day of the week, and the results of past weeks are not saved or displayed. The calendar 310 represents incomplete days of the week in gray color, and the days on which the execution is completed, that is, the days on which training is conducted, are represented in the primary color. The training banner area 320 is a banner that notifies the completion of today's training 330. When all two trainings 330 of today are completed, a completed execution banner is represented, and when one or more are incomplete, an incomplete banner is represented. Here, today's training 330 is one randomly displayed from among three hearing trainings and one randomly displayed from among three brain trainings, and different combinations of training are provided every day. Further, for today's training 330, "Completed" may be displayed in the upper right of the box when the training is completed, and "Incomplete" may be displayed when the training is incomplete.
[0053] Also, the training application 300 represents a target button 340 and a training button 350. The target button 340 provides the main screen of FIG. 3 and provides the training target that the user should train. The training button 350 provides a training interface for hearing training and brain training. When the user clicks the training button 350, it is represented as shown in FIG. 4.
[0054] The training application 300 lists game trainings for the first hearing training (episodic memory) 421, the second hearing training (working memory) 422, and the third hearing training (attention) 423 for the hearing training (or ear training) 410 as shown in FIG. 4. Also, the training application 300 lists game trainings for the first brain training (finding shapes) 521, the second brain training (line tracing) 522, and the third brain training (inference) 523 for the brain training (or brain training) 510 as shown in FIG. 5.
[0055] FIG. 6 is a diagram showing an example in which the first hearing training 421 shown in FIG. 4 is executed.
[0056] Referring to FIG. 6, the training application 300 displays the current level 601 of the first hearing training selected by the user and displays the name and description 602 of the first hearing training. Also, the training application 300 displays a score list 603 and a level selection button 604. The score list 603 displays the top three training scores within the corresponding training (or the first hearing training), and displays them in the order of rank / year, month, day, time / score, with the time displayed up to the minute unit.
[0057] When the user clicks the level selection button 604 to execute the first hearing training, a level selection screen 605 for executing the first hearing training is displayed, and the user can select a level. At this time, the user can select from among the levels below the current level as a reference.
[0058] After the user selects a level and clicks the ready button, a basic tutorial for the training is provided. At this time, the tutorial is provided in the same way for all training interfaces provided in the present invention, and guides the user to adjust the volume for the training.
[0059] When the user clicks the preparation completion button on the tutorial screen, the training application 300 explains the game method for the first hearing training, and then sequentially emits the sounds 606 of three preset words for the first hearing training. For example, in the order selection option 607, assume that the sound 606 of the word "ant" is generated when the first one is activated, the sound 606 of the word "crab" is generated when the second one is activated, and the sound 606 of the word "horse" is generated when the third one is activated. Thereby, the user memorizes the words in the order of "ant", "crab", and "horse". After that, the training application 300 activates the selection area 608 and then allows the user to input in the button area 609 what the word provided in the selection area 608 is, in order to confirm whether the user remembers the words in order. Thereby, when the user clicks the ant button corresponding to the first selection area 608, the crab button corresponding to the second display area, and the horse button corresponding to the third display area among the button areas 609 where "ant", "crab", and "horse" are written, the execution of level 1 of the first hearing training is completed. The first hearing training according to the embodiment of the present invention may repeatedly provide the above-described test at least 5 times or more, and different words, different numbers of words, and different syllables of words may be provided in each test.
[0060] In addition, the training application 300 provides a level display 611 and a score display 612 at the upper end of the screen, and provides a remaining time display 613 and a pause button 614. The level display 611 indicates the level of the currently running game. The levels are displayed from 1 to 8, and the difficulty is adjusted by the number of options and the number of syllables. In the present invention, level 1 has 3 options / 2 characters, level 2 has 3 options / 3 characters, level 3 has 4 options / 2 characters, level 4 has 4 options / 3 characters, level 5 has 5 options / 2 characters, level 6 has 5 options / 3 characters, level 7 has 6 options / 2 characters, and level 8 may have 6 options / 3 characters. Also, the score display 612 indicates the score obtained in the currently running game.
[0061] FIG. 7 is a diagram showing an example in which the second listening training 422 shown in FIG. 4 is executed.
[0062] Referring to FIG. 7, the training application 300 displays the current level 701 of the second listening training selected by the user, and displays the name and description 702 of the second listening training. Also, the training application 300 displays a score list 703 and a level selection button 704. The score list 703 displays the top three training scores within the corresponding training (or the second listening training), and is displayed in the order of rank / year, month, day, time / score, where the time is displayed up to the minute unit.
[0063] When the user clicks the level selection button 704 to execute the second listening training, a level selection screen 705 for executing the second listening training is displayed, and the user can select a level. At this time, the user can select from among the levels below the current level.
[0064] After the user selects a level and clicks the preparation completed button, a basic tutorial for training is provided. After this, the training application 300 explains a game method for second listening training, and then sequentially emits the sounds 706 of three preset words for second listening training. For example, in the order selection option 707, assume that the sound 706 of the word "ant" is generated when the first one is activated, the sound 706 of the word "crab" is generated when the second one is activated, and the sound 706 of the word "horse" is generated when the third one is activated. Thereby, the user memorizes the words in reverse order, such as "horse", "crab", "ant". After this, the training application 300 activates the selection area 708 in order to confirm whether the user has memorized the words in reverse order, and then allows the user to input in the button area 709 what the word provided in the selection area 708 is. Thereby, when the user clicks the horse button corresponding to the third selection area 708, the crab button corresponding to the second display area, and the ant button corresponding to the first display area among the button area 709 where "ant", "crab", "horse" are written, the execution of level 1 of the second listening training is completed. The second listening training according to the embodiment of the present invention may repeatedly provide the above-described test at least 5 times or more, and different words, different numbers of words, and different syllables of words may be provided in each test.
[0065] In addition, the training application 300 provides a level display 711 and a score display 712 at the upper end of the screen, and provides a remaining time display 713 and a pause button 714. The level display 711 indicates the level of the currently running game. The levels are displayed from 1 to 8, and the difficulty level is adjusted by the number of options and the number of syllables. In the present invention, level 1 has 3 options / 2 characters, level 2 has 3 options / 3 characters, level 3 has 4 options / 2 characters, level 4 has 4 options / 3 characters, level 5 has 5 options / 2 characters, level 6 has 5 options / 3 characters, level 7 has 6 options / 2 characters, and level 8 may have 6 options / 3 characters. Also, the score display 712 indicates the score obtained in the currently running game.
[0066] FIG. 8 is a diagram showing an example in which the third auditory training interface 423 shown in FIG. 4 is executed.
[0067] Referring to FIG. 8, the training application 300 displays the current level 801 of the third auditory training selected by the user, and displays the name and description 802 of the third auditory training. Also, the training application 300 displays a score list 803 and a level selection button 804. The score list 803 displays the top three training scores within the corresponding training (or the third auditory training), and is displayed in the order of rank / year, month, day, time / score, where the time is displayed up to the minute unit.
[0068] When the user clicks the level selection button 804 to execute the third auditory training, a level selection screen 805 for executing the third auditory training is displayed, and the user can select a level. At this time, the user can select from among the levels below the current level.
[0069] After the user selects a level and clicks the "Ready" button, a basic tutorial for training is provided. After this, the training application 300 explains a game method for third-auditory training and prompts the user to press the push button 808 if the character 807 provides the word 806 "a". For example, the character 807 emits a one-syllable sound continuously at regular time intervals, and the word "a" is randomly included during the continuous sound. Thereby, after the user listens carefully to the sound provided by the character 807, if the sound of the word "a" occurs, the user presses the push button 808. The third-auditory training may be configured to emit the sound of words about 10 times or more and check the user's correct and incorrect answers. The third-auditory training according to an embodiment of the present invention repeatedly provides the above-described test at least 5 times or more, and different words, different numbers of words, and different syllables of words may be provided in each test.
[0070] In addition, the training application 300 provides a level display 811 and a score display 812 at the upper end of the screen, and provides a remaining time display 813 and a pause button 814. The level display 811 indicates the level of the currently running game. The levels are displayed from 1 to 8, and the difficulty is adjusted by the number of options and the number of syllables. Level 1 provided in the present invention has 3 options / 1 or 2 characters, level 2 has 3 options / 3 characters, level 3 has 4 options / 2 characters, level 4 has 4 options / 3 characters, level 5 has 5 options / 2 characters, level 6 has 5 options / 3 characters, level 7 has 6 options / 2 characters, and level 8 has 6 options / 3 characters. Also, the score display 812 indicates the score obtained in the currently running game.
[0071] FIG. 9 is a diagram showing an example in which the first brain training 521 shown in FIG. 5 is executed.
[0072] Referring to FIG. 9, the training application 300 displays the current level 901 of the first brain training selected by the user, and displays the name and description 902 of the first brain training. Further, the training application 300 displays a score list 903 and a level selection button 904. The score list 903 displays the top three training scores within the corresponding training (or the first brain training), and is displayed in the order of rank / year, month, day, hour / score, with the hour displayed up to the minute unit.
[0073] When the user clicks the level selection button 904 to execute the first brain training, a level selection screen 905 for executing the first brain training is displayed, and the user can select a level. At this time, the user can select from among the levels below the current level.
[0074] After the user selects a level and clicks the start button, a basic tutorial for the training is provided. After that, the training application 300 explains the game method for the first brain training and presents a specific symbol 906. For example, a specific symbol 906 in the shape of a star is presented, and a selection option 907 in which circles, squares, triangles, crosses, U-shapes, stars, and arrows are mixed is presented. Thereby, when the user selects the same symbol as the specific symbol 906 in the shape of a star from the selection option 907, the execution of level 1 of the first brain training is completed.
[0075] In addition, the training application 300 provides a level display 911 and a score display 912 at the upper end of the screen, and provides a remaining time display 913 and a pause button 914. The level display 911 indicates the level of the currently running game, with the level displayed up to 1 to 3 levels, and the difficulty is adjusted by the number of selection options and the number of syllables. The score display 912 indicates the score obtained in the currently running game.
[0076] FIG. 10 and FIG. 11 are diagrams showing an example in which the second brain training 522 shown in FIG. 5 is executed.
[0077] Referring to FIG. 10, the training application 300 displays the current level 1001 of the second brain training selected by the user, and displays the name and description 1002 of the second brain training. Further, the training application 300 displays a score list 1003 and a level selection button 1004. The score list 1003 displays the top three training scores within the corresponding training (or the second brain training), and displays them in the order of rank / year, month, day, hour / score, with the hour displayed up to the minute unit.
[0078] When the user clicks the level selection button 1004 to execute the second brain training, a level selection screen 1005 for executing the second brain training is displayed, and the user can select a level. At this time, the user can select from among the levels below the current level.
[0079] After the user selects a level and clicks the start button, a basic tutorial for the training is provided. After that, the training application 300 explains the game method for the second brain training, randomly displays a plurality of numbers on the screen of the terminal, and allows the user to select them in order from the smallest number. For example, as shown in FIG. 10, the numbers 1007 of 1, 2, 3, 4, and 5 are randomly arranged and provided, and when the user selects the numbers from 1, which is the smallest number, to 5 in order, the execution of level 1 of the second brain training is completed.
[0080] In addition, the training application 300 provides a level display 1011 and a score display 1012 at the upper end of the screen, and provides a remaining time display 1013 and a pause button 1014. The level display 1011 indicates the level of the currently running game. The levels are displayed from 1 to 8, and the difficulty is adjusted by the number of options and the number of syllables. Also, the score display 1012 indicates the score obtained in the currently running game.
[0081] At this time, the randomly arranged numbers 1007 may be provided in different colors (such as blue, yellow, red, purple, etc.) and different sizes (such as small, normal, big, huge, etc.) depending on the level, as shown in FIG. 11. FIG. 11(a) shows the 4th level of the second brain training, and FIG. 11(b) shows the 8th level of the second brain training. The user may simply select the numbers from 1 to 9, which are the smallest numbers in FIG. 11(a), in order, and select the numbers from -25 to 24, which are the smallest numbers in FIG. 11(b), in order. As shown in FIG. 11, the present invention is characterized in that the difficulty of the game is adjusted by presenting numbers and the intervals between numbers within a wide spectrum from minus to plus, for example, presenting -13 next to -25.
[0082] FIGS. 12 and 13 are diagrams showing an example in which the third brain training 523 shown in FIG. 5 is executed.
[0083] Referring to FIG. 12, the training application 300 indicates the current level 1201 of the third brain training selected by the user, and indicates the name and description 1202 of the third brain training. In addition, the training application 300 indicates a score list 1203 and a level selection button 1204. The score list 1203 indicates the top three training scores within the corresponding training (or the third brain training), and is indicated in the order of rank / year, month, day, time / score, where the time is displayed up to the minute unit.
[0084] When the user clicks the level selection button 1204 to execute the third brain training, a level selection screen 1205 for executing the third brain training is displayed, and the user can select a level. At this time, the user can select from the levels below based on the current level. At this time, the third brain training provides levels for numerical inference and figure inference respectively.
[0085] After the user selects a level from numerical inference and figure inference and then clicks the start button, a basic tutorial for training is provided. After that, the training application 300 explains the game method of the third brain training, finds out the rules hidden in the questions, and allows the user to select the answer to be entered in the Hatena box. For example, find out the rule hidden in the provided questions of 1, 2, 3, 5, and guess the answer to be entered in the Hatena box 1206 from the options 1207 of 1, 4, 5. When the user selects "4" as the number to be entered in the Hatena box 1206, the execution of level 1 of the third brain training is completed.
[0086] In addition, the training application 300 provides a level display 1211 and a score display 1212 at the upper end of the screen, and provides a remaining time display 1213 and a pause button 1214. The level display 1211 indicates the level of the currently running game. The levels are displayed from 1 to 8 levels, and the difficulty is adjusted by the number of options for numerical inference and figure inference. Also, the score display 1212 indicates the score obtained in the currently running game.
[0087] At this time, FIG. 12 is a diagram explaining an example of numerical inference, and FIG. 13 is a diagram explaining an example of figure inference. In FIG. 13, FIG. 13(a) shows the first level of figure inference, FIG. 13(b) shows the second level of figure inference, FIG. 13(c) shows the third level of figure inference, and FIG. 13(d) shows the fourth level of figure inference.
[0088] Referring to FIG. 14, the training application 300 displays a final score area 1410 indicating the final score of the corresponding training immediately after completing the execution of each of the first listening training, the second listening training, the third listening training, the first brain training, the second brain training, and the third brain training. Further, the training application 300 displays a correct answer rate display area 1420, a correct answer rate graph area 1430, and a score table 1440.
[0089] The correct answer rate display area 1420 displays the total number of questions the user trained on and the number of questions answered correctly. The correct answer rate graph area 1430 represents the correct answer rate as a pie chart, and the correct answer rate is rounded to an integer and displayed at the center of the graph. Also, the correct answer rate graph area 1430 displays the number of correct answers and the number of incorrect answers on the right side.
[0090] The score table 1440 displays the top three scores in the order of year, month, hour / level / score. If the previous training is included in the ranking, the background color is shown in gray color, the total number of questions is based on individual questions rather than difficulty units, and partial scores are also processed for correct / incorrect.
[0091] Further, the training application 300 may display the user's profile, the degree of activation of the listening ability, and the degree of activation of the brain. The profile may display the nickname entered by the user and the goal selected by the user. The degree of activation of the listening ability and the degree of activation of the brain display the highest point of each training, and in the case of the highest point, the highest score among the three trainings within each training may be displayed.
[0092] FIG. 15 is a configuration diagram showing in detail a training application providing device in the form of a game that combines listening training and brain training executed by a terminal device in an embodiment of the present invention.
[0093] Referring to FIG. 15, a training application providing apparatus 1500 according to an embodiment of the present invention includes a training providing unit 1510, an execution ability determination unit 1520, and a training control unit 1530.
[0094] The training providing unit 1510 provides a game - type training interface that combines hearing training and brain training in an area of the terminal's screen.
[0095] In an embodiment of the present invention, the training providing unit 1510 is characterized by providing a game - type training interface that combines three hearing trainings and three brain trainings according to a goal set based on the user's auditory state information to improve the user's auditory function and cognitive function. The hearing trainings provided by the present invention include episodic memory (the first hearing training), working memory (the second hearing training), and attention (the third hearing training), and the brain trainings include figure search (the first brain training), line tracing (the second brain training), and inference (the third brain training).
[0096] Thus, the present invention proposes "today's training" to the user as a daily goal, and the goal may be randomly set from among hearing training and brain training based on the user's hearing test data or training history. The training providing unit 1510 may randomly select a training from each of the hearing training and the brain training based on 24:00 every day, set it as "today's training", and display it on the terminal's screen, so that the user can execute "today's training" to complete the training. At this time, there is no limitation on the type and number of the selected trainings, nor is there a limitation on the set time interval.
[0097] The three hearing trainings provided by the present invention are for improving the auditory function. Hereinafter, each of the three hearing trainings will be described in detail.
[0098] The first hearing training is called "episodic memory" and aims to improve hearing. It is a training where the user memorizes the played words and their order and selects the correct answer that matches the question. Thus, the training provider 1510 provides the sounds of a preset number of words, makes the user memorize the played words and their order, and makes the user select the words in order. For example, the training provider 1510 plays the three preset words "ant", "crab", and "horse" in sequence, making the user memorize the words in order. After playing all three word sounds, the training provider 1510 provides a choice with the three words mixed together and makes the user input the three words in order. Thus, when the user inputs the words "ant", "crab", and "horse" in order, the training ends.
[0099] The second hearing training is called "working memory" and aims to improve hearing. It is a training where the user memorizes the played words and their order and selects the correct answer that matches the question. Thus, the training provider 1510 provides the sounds of a preset number of words, makes the user memorize the played words and their order, and makes the user select the words in reverse order. For example, the training provider 1510 plays the three preset words "ant", "crab", and "horse" in sequence, making the user memorize the words in reverse order. Step 210 provides a choice with the three words mixed together after playing all three word sounds and makes the user input the three words in reverse order. Thus, when the user inputs the words "horse", "crab", and "ant" in reverse order of "ant", "crab", and "horse", the training ends.
[0100] The third hearing training is called "Attention" and aims to improve hearing. It is a training where the user listens to the words spoken by the character and presses the button that matches the problem. Through this, the training provider 1510 causes the user to click the button when the character emits the sound of a specific word and the sound of the same word as the word spoken by the character is generated. For example, the user must click the push button only when the character says the words "na" and "to". The character randomly emits a preset number of word sounds. At this time, the user must not click the push button when the character says "a", and must click the push button only when the character says "na" and "to".
[0101] Here, an example has been described where the number of options provided in the first hearing training, the second hearing training, and the third hearing training is 3, the number of characters is 2 or less, and it is one syllable, but it should not be limited to this. As the level increases, the number of options, the number of characters, and the syllables of the words may be increased.
[0102] The three brain trainings provided by the present invention are for improving cognitive functions. Hereinafter, each of the three brain trainings will be described in detail.
[0103] The first brain training is called "Finding Shapes" and is a training where the user searches for and selects the same symbol as the presented shape. Through this, the training provider 1510 provides a specific symbol, provides options in which various symbols are mixed, and then causes the user to select the same symbol as the specific symbol from the options. For example, after the training provider 1510 provides a star as a specific symbol, it provides options in which a circle, a square, a triangle, a cross, a U shape, a star, and an arrow are mixed. When the user selects a star from the options, the training ends.
[0104] The second brain training is called "Line Tracing" and is a training where small or large numbers are sequentially selected. Through this, the training provision unit 1510 randomly displays a plurality of numbers on the screen of the terminal device and makes the user select them in order from the smallest number. For example, in stage 210, the numbers 1, 2, 3, 4, 5 are randomly arranged and provided. When the user selects the numbers from 1, which is the smallest number, to 5 in order, the training ends.
[0105] The third brain training is called "Inference" and is a training where a specific rule is found and what to enter in the question mark box is selected. Through this, the training provision unit 1510 finds the rule hidden in the problem and makes the user select the answer to be entered in the question mark box. For example, in stage 210, after providing 1, 2, 3,?, 5, options 1, 4, 5 are provided. When the user infers the number to be entered in the square (or the question mark box) and selects "4", the training ends. Here, numbers are used as an example for explanation, but it is also possible to provide rules for figures instead of numbers.
[0106] The execution ability judgment unit 1520 receives the user's selection input through the training interface and judges the task execution ability for each of the listening training and the brain training.
[0107] The execution ability judgment unit 1520 may judge the task execution ability for the training training based on accuracy and order in the three listening trainings and the three brain trainings. Through this, the execution ability judgment unit 1520 judges the correct and incorrect answers based on the user's selection input received for each question in the training interface where a plurality of questions are presented within a preset time, and may judge the user's task execution ability according to the correct answer rate and the incorrect answer rate. Through this, the execution ability judgment unit 1520 may judge whether to maintain or increase the level of the training interface executed by the user according to the user's task execution ability.
[0108] As an example, if a user enters the correct answer within a preset time in the test provided at level 1 of the first hearing training and achieves a correct answer rate of 90% or more, the execution ability determination unit 1520 determines that this user is capable of executing level 1 and raises the level (Up). Thereafter, when the user conducts the first hearing training, level 2 may be provided. As another example, if a user enters the correct answer outside the preset time in the test provided at level 1 of the first hearing training, or enters only incorrect answers within the preset time and achieves a correct answer rate of 50 - 70%, the execution ability determination unit 1520 determines that this user has not fully executed level 1. Thereafter, when the user conducts the first hearing training, level 1 may be provided as it is.
[0109] The training control unit 1530 adjusts the difficulty level of the training interface according to the judgment result in order to improve the auditory function and cognitive function.
[0110] The training control unit 1530 may control to provide the user with a training interface at the same level or a training interface at an updated level according to the result determined by the execution ability determination unit 15020. At this time, the training control unit 1530 may gradually lower the volume of the provided sound and adjust the difficulty level of the training while increasing the options, the number of words, and the number of syllables (or the number of characters) of the words used in the training interface. For example, the number of words provided at level 1 of the first hearing training is 4, but 7 words may be provided at level 5. However, the number of words and the number of syllables of the words provided according to the level shall not be limited to those described above and can be adjusted by the administrator.
[0111] The training control unit 1530 may provide a training result screen of the final score area, correct answer rate notation area, correct answer rate graph area, and score table to the terminal device through the training interface. At this time, the final score area indicates the final score obtained in the immediately previous training interface play, and the correct answer rate notation area indicates the total number of questions the user trained and the number of correct answers. The correct answer rate graph area represents the correct answer rate in a pie chart, and the correct answer rate is rounded to an integer and shown in the center of the graph. The score table shows the top three scores in the order of year, month, hour / level / score. The total number of questions is based on individual questions rather than difficulty levels, and partial scores are also processed for correct / incorrect answers.
[0112] Although the description of the device in FIG. 15 is omitted, each constituent means constituting FIG. 15 can include all the contents described in FIGS. 1 to 14, and is obvious to those skilled in the art of this technology.
[0113] The above-described system or apparatus may be implemented by hardware components, software components, and / or a combination of hardware components and software components. For example, the apparatuses and components described in the embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as a processor, a controller, an ALU (arithmetic logic unit), a digital signal processor, a microcomputer, an FPGA (field programmable gate array), a PLU (programmable logic unit), a microprocessor, or various apparatuses capable of executing instructions and responding. The processing device may execute an operating system (OS) and one or more software applications executed on the OS. Further, the processing device may access data, record, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, although it may be described as using one processing device, those skilled in the art will understand that the processing device may include a plurality of processing elements and / or a plurality of types of processing elements. For example, the processing device may include a plurality of processors or one processor and one controller. Also, other processing configurations, such as a parallel processor, are possible.
[0114] Software may include a computer program, code, instruction, or a combination of one or more of these, and may configure a processing device to operate as desired or instruct the processing device independently or collectively. Software and / or data may be permanently or temporarily embodied in any kind of machine, component, physical device, virtual equipment, computer recording medium or device, or transmitted signal wave for the purpose of being interpreted by the processing device or providing instructions or data to the processing device. Software may be distributed on a computer system connected by a network and recorded or executed in a distributed state. Software and data may be recorded on one or more computer-readable recording media.
[0115] The method according to the embodiment may be realized in the form of program instructions executable by various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be those specially designed for the embodiment or those that can be used and are known to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy (registered trademark) disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to record and execute program instructions such as ROMs, RAMs, flash memories, etc. Examples of program instructions include not only machine language codes such as those generated by a compiler but also high-level language codes executable by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules for executing the operations of the embodiment, and vice versa.
[0116] As described above, the embodiments have been described based on limited embodiments and drawings. However, those skilled in the art will be able to make various modifications and variations from the above description. For example, even if the described technology is executed in an order different from the described method, and / or the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from the described method, or are opposed or replaced by other components or equivalents, appropriate results can be achieved.
[0117] Therefore, even if they are different embodiments, as long as they are equivalent to the scope of the claims, they belong to the scope of the appended claims.
Description of Reference Numerals
[0118] 1500: Training Application Providing Device 1510: Training Providing Unit 1520: Execution Ability Judgment Unit 1530: Training Control Unit
Claims
1. A method for providing a game-style training application that combines hearing training and brain training and is executed by a terminal device, comprising: Providing a game-style training interface that combines hearing training and brain training on a certain area of the screen of the terminal device; and receiving a user's selection input via the training interface and determining task execution ability for each of the hearing training and the brain training; A method for providing a training application, including:
2. The step of providing a training interface comprises: providing the training interface for combining three hearing trainings and three brain trainings according to a goal set based on the user's hearing state information to improve the user's hearing function and cognitive function; The method of providing a training application according to claim 1 .
3. The step of providing a training interface comprises: To provide a game-style training interface by randomly combining the three hearing trainings and the three brain trainings according to the goal. The method for providing a training application according to claim 2 .
4. The step of providing a training interface comprises: providing a first hearing training in which the sounds of a preset number of words are provided, and the user is prompted to memorize the words and the order in which they are played back, and to select the words in the correct order; and providing a second hearing training in which the sounds of a preset number of words are provided, and the user is prompted to memorize the words and the order in which they are played back, and to select the words in the reverse order; The method of providing a training application according to claim 2 .
5. The step of providing a training interface comprises: providing a third hearing training in which a character utters a sound of a specific word, and when the sound of the word uttered by the character occurs, the user is prompted to click a button; The method of providing a training application according to claim 4 .
6. The step of providing a training interface comprises: The first brain training involves having the child search for and select the same symbol from among the options as the one presented, the second brain training involves having the child select numbers in order from smallest to largest, and the third brain training involves having the child find a rule and select the answer that goes in the question box. The method for providing a training application according to claim 2 .
7. The step of determining the task execution ability includes: In each of the hearing training and the brain training, a correct answer or an incorrect answer is determined based on a user's selection input for a question displayed within a preset time, and a determination is made as to whether to maintain or raise the level of the training interface depending on the user's task execution ability based on the correct answer rate and the incorrect answer rate. The method of providing a training application according to claim 2 .
8. The step of determining the task execution ability includes: A step of adjusting the difficulty of a training interface for improving the auditory function and the cognitive function according to the judgment result. The method of claim 7 , comprising:
9. The step of adjusting the difficulty level includes: Adjust the difficulty of the training interface by lowering the volume and increasing the number of options and characters used in the training. The method of claim 8 , further comprising:
10. A training application providing device that combines game-style hearing training and brain training executed by a terminal, a training providing unit that provides a game-style training interface that combines hearing training and brain training in one area of the screen of the terminal device; an execution ability determination unit for receiving a selection input from a user through the training interface and determining task execution abilities for the hearing training and the brain training, respectively; A training application providing device comprising:
11. The training providing unit includes: providing the training interface for combining three hearing trainings and three brain trainings according to a goal set based on the user's hearing state information to improve the user's hearing function and cognitive function; The training application providing device according to claim 10.
12. The training providing unit includes: To provide a game-style training interface by randomly combining the three hearing trainings and the three brain trainings according to the goal. The training application providing device according to claim 11 .
13. The execution capability determination unit is In each of the hearing training and the brain training, a correct answer or an incorrect answer is judged based on a user's selection input for a problem displayed within a preset time, and a judgment is made as to whether to maintain or raise the level of the training interface depending on the user's task execution ability based on the correct answer rate and the incorrect answer rate. The training application providing device according to claim 12.
14. A step of adjusting the difficulty of a training interface for improving the auditory function and the cognitive function according to the judgment result. The training application providing device of claim 10 , further comprising:
15. The training control unit is Adjust the difficulty of the training interface by lowering the volume and increasing the number of options and characters used in the training. The training application providing device according to claim 14 .
Citation Information
Patent Citations
Systems and methods for training phonological recognition, phonological processing and reading ability
JP2003504646A
Device of learning, method of learning, learning program, and computer readable recording medium having learning program recorded thereon
JP2004117731A
Methods and apparatus for training users
JP2009501583A
Selection system, selection method, and selection program
JP2018055359A
Composition for improving working memory in cognitive functions
JP2022100719A