Spatial Perception Training Method and Device Based on Auditory Information

Abstract

The present invention provides a spatial perception training method and device based on auditory information, relating to the technical field of medical devices. The method sets training tasks and simulates a real-time sound field in a virtual space, enabling blind people to complete training tasks according to sound responses, thereby assisting blind people in establishing a mapping from auditory information to spatial perception. By establishing a physical maze similar to the virtual scene, it assists blind people in achieving a smooth transition from virtual space training to real physical space training, strengthening the understanding and perception of auditory information and improving the spatial perception ability of blind people. Based on the principles and experience of perceptual learning, the present invention has formed a scientific and systematic training method featuring mixed precision, combination of static and dynamic, timely evaluation and feedback. It does not require wearing heavy wearable devices, can take into account comfort, portability and scalability, while reducing the learning difficulty, accelerating the training process, and improving the spatial perception ability of blind people based on auditory information.

Description

Technical Field

[0001] The present invention relates to the technical field of medical devices, and in particular, to a spatial perception training method and device based on auditory information. Background Art

[0002] For blind and visually impaired people, independent travel is a major challenge, which not only affects the quality of their daily life and social activities, but even poses a threat to their life safety.

[0003] Existing visual rehabilitation devices (such as smart blind glasses) have not been widely popularized among the visually impaired population. On the one hand, these systems cannot well balance comfort, portability, and expandability, especially the high price; on the other hand, there is a lack of scientific and systematic training tutorials, and the learning difficulty is very high. These objective difficulties ultimately lead to a long training cycle and poor training effect of the spatial perception ability of blind users. Summary of the Invention

[0004] In view of this, the present invention provides a spatial perception training method and device based on auditory information to solve the above technical problems existing in the prior art.

[0005] The present invention provides a spatial perception training method based on auditory information, including:

[0006] Loading a pre-established virtual training system; the virtual space simulated in the virtual training system is set with one or more levels according to training needs, and each level simulates one or more training tasks;

[0007] In the case of entering the first level among the multiple levels, obtaining a practice instruction input by the trainee and making a sound response to the practice instruction, so that the trainee completes one or more training tasks simulated by the first level based on the sound response.

[0008] Further, the spatial perception training method based on auditory information provided by the present invention further includes:

[0009] Obtaining a first accuracy rate for testing the trainee in completing one or more training tasks simulated by the first level; the first accuracy rate is used to characterize the spatial perception ability obtained by the trainee when completing one or more training tasks simulated by the level.

[0010] Further, the spatial perception training method based on auditory information provided by the present invention further includes:

[0011] When the first accuracy rate is greater than the first threshold, enter the second level among the multiple levels, so that the trainee continues to complete one or more training tasks simulated by the second level; the difficulty of one or more training tasks simulated by the second level is greater than that of one or more training tasks simulated by the first level.

[0012] Further, the spatial perception training method based on auditory information provided by the present invention further includes:

[0013] When the first accuracy rate is less than or equal to the first threshold, continue to enter the first level, so that the trainee continues to complete one or more training tasks simulated by the first level.

[0014] Further, the obtaining of the practice instruction input by the trainee and the sound response to the practice instruction include:

[0015] Obtain a first instruction input by the trainee, where the first instruction is an instruction for controlling simulated sound production; the practice instruction includes the first instruction;

[0016] Simulate sound production based on the first instruction.

[0017] Further, the obtaining of the practice instruction input by the trainee and the sound response to the practice instruction include:

[0018] Obtain a second instruction input by the trainee, where the second instruction is an instruction for moving in a virtual space simulated in the virtual training system; the practice instruction includes the second instruction;

[0019] Simulate sound production based on the second instruction.

[0020] Further, the obtaining of the practice instruction input by the trainee and the sound response to the practice instruction include:

[0021] Obtain a third instruction input by the trainee, where the third instruction is a sound instruction issued by the trainee; the practice instruction includes the third instruction;

[0022] Simulate the echo of the sound issued by the trainee based on the third instruction.

[0023] Further, the spatial perception training method based on auditory information provided by the present invention further includes:

[0024] When the trainee completes all the training tasks simulated by the levels and the first accuracy rate of testing the trainee is greater than the second threshold, obtain the test result of the trainee's training in the real physical space;

[0025] Obtain a second accuracy rate for testing the trained person in completing a training task in a real physical space; the real physical space matches the virtual space simulated in the virtual training system;

[0026] Evaluate the training effect of training using the virtual training system based on the second accuracy rate, and optimize the virtual training system based on the training effect.

[0027] The present invention also provides a spatial perception training device based on auditory information, including:

[0028] A loading module, configured to load a pre-established virtual training system; in the virtual space simulated in the virtual training system, one or more levels are set according to training needs, and each level simulates one or more training tasks;

[0029] A response module, configured to, when entering the first level among the multiple levels, obtain a practice instruction input by the trained person and make a sound response to the practice instruction, so that the trained person can complete one or more training tasks simulated by the first level based on the sound response.

[0030] The present invention also provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where when the processor executes the program, it implements the spatial perception training method based on auditory information as described in any one of the above.

[0031] The spatial perception training method and device based on auditory information provided by the present invention set levels in a virtual space, simulate one or more training tasks in each level, and through the simulated real-time sound field, enable the trained person to complete the one or more training tasks based on the sound response, thereby assisting the trained person to establish a mapping from auditory information to spatial perception and improving the spatial perception ability of the trained person. The present invention does not require wearing heavy wearable devices, and only needs to be deployed in portable devices such as mobile phones and laptops to perform systematic training, which can better balance comfort, portability, and scalability. In addition, based on the principles and experience of perceptual learning, the present invention forms a scientific and systematic training method with characteristics such as mixed precision, combination of static and dynamic, timely evaluation and feedback, reduces the learning difficulty, and speeds up the training process, thus helping blind users better and faster improve their spatial perception ability. Description of the Drawings

[0032] To more clearly illustrate the technical solutions in the present invention or the prior art, the following will briefly introduce the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other accompanying drawings can be obtained based on these drawings.

[0033] Figure 1 is a schematic flow chart of the spatial perception training method based on auditory information provided by the present invention;

[0034] Figure 2 is a schematic overall operation flow chart of training based on the virtual space simulated in the virtual training system provided by the present invention;

[0035] Figure 3 is a schematic flow chart of a single training and test provided by the present invention;

[0036] Figure 4 is a level scene diagram of the spatial perception training based on auditory information provided by the present invention;

[0037] Figure 5 is a schematic structural diagram of the virtual training system for spatial perception based on auditory information provided by the present invention;

[0038] Figure 6 is a schematic structural diagram of the spatial perception training device based on auditory information provided by the present invention;

[0039] Figure 7 is a schematic structural diagram of the electronic device provided by the present invention. Detailed implementation manners

[0040] For blind and visually impaired people, independent travel is a major challenge, which not only affects the quality of their daily life and social activities, but even poses a threat to their life safety. Existing visual rehabilitation devices have not been widely popularized among the visually impaired group. On the one hand, these systems cannot well balance comfort, portability and scalability, especially the high price. On the other hand, the lack of a scientific and systematic training tutorial and the high learning difficulty are also key obstacles.

[0041] To solve the above problems, the present invention provides a spatial perception training method and device based on auditory information, which assist users in establishing a mapping from auditory information to spatial perception by synthesizing a real-time sound field in a virtual scene. Without wearing heavy wearable devices, it only needs to be deployed in portable devices such as mobile phones and laptops to carry out systematic training. In addition, based on the principles and experiences of perceptual learning, the present invention forms a set of training methods with characteristics such as mixed precision, combination of static and dynamic, timely evaluation and feedback, which reduces the training threshold for users and accelerates the training process. Finally, the present invention also constructs a physical maze similar to the virtual scene to assist users in smoothly transitioning from virtual scene training to relatively familiar physical scene training, and strengthening the understanding and perception of auditory information.

[0042] A spatial perception training method and device based on auditory information provided by the present invention aim to help visually impaired groups establish or strengthen the mapping ability from auditory information to spatial perception, thereby assisting users to travel independently.

[0043] To make the objectives, technical solutions, and advantages of the present invention clearer, the technical solutions in the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the present invention. Obviously, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present invention without creative efforts shall fall within the protection scope of the present invention.

[0044] The following will be combined with Figures 1 to 7 Describe the spatial perception training method based on auditory information of the present invention. Figure 1 It is a schematic diagram of the spatial perception training method based on auditory information provided by the present invention. As Figure 1 shown, the specific implementation steps are as follows:

[0045] Step 101: Load a pre-established virtual training system; one or more levels are set in the virtual space simulated in the virtual training system according to training needs, and each level simulates one or more training tasks.

[0046] Figure 2 It is a schematic diagram of the overall operation process of training in the virtual space simulated in the virtual training system provided by the present invention. As Figure 2 shown, specifically, it includes the following steps:

[0047] (1) Login: In the case of the first login, personal information such as username and password needs to be registered, and parameters such as virtual environment sound sources, wall materials, movement speed, and single-step length are custom-configured; in the case of non-first login, the username and password can be directly entered to enter the virtual training system.

[0048] (2) Training: Enter the historical level, the current level, the next level or restart, and complete the training for all different difficulty levels of this level.

[0049] Figure 3 is a schematic diagram of the single training and testing process. As Figure 3 shown, during the single static training process, continuously make sounds through the input device until a judgment selection can be made through the input device, and feedback whether the current selection is accurate through voice or vibration; during the single dynamic training process, continuously make sounds through the input device and complete the movement of position or angle until hitting the wall or reaching the destination, and feedback the failure or success of the task. After the single training process ends, record all operation information, and repeat the single process multiple times to complete the training tasks for all different difficulty levels of this level.

[0050] (3) Judgment: The system asks whether to conduct the test for this level. If agreeing to the test, go to step four, otherwise go to step two.

[0051] (4) Testing: The trained personnel conduct a mixed-precision test and obtain the first accuracy rate for testing the trained personnel in one or more training tasks simulated in the first level; the first accuracy rate is used to characterize the spatial perception ability obtained by the trained personnel when completing one or more training tasks simulated in the level.

[0052] As described above Figure 3 shown, the process of single static testing is basically similar to the static training process, but its precision mixes 4 difficulty levels and there is no feedback prompt; the process of single dynamic testing is basically similar to the dynamic training process, but only feedbacks the end of the task. After the single testing process ends, record all operation information, repeat the single process multiple times to complete all the testing contents of this level, and thus obtain the first accuracy rate for testing the trained personnel.

[0053] The first accuracy rate is used to characterize the spatial perception ability obtained by the trained personnel when completing one or more training tasks simulated in the level. The higher the first accuracy rate, that is, the stronger the spatial perception ability obtained by the trained personnel when completing one or more training tasks simulated in the level, otherwise, the weaker the spatial perception ability obtained by the trained personnel when completing one or more training tasks simulated in the level.

[0054] By repeating the single training and testing process in the embodiments of the present invention, the first accuracy rate of the trained personnel is gradually improved, and thus the spatial perception ability of blind users (i.e., the trained personnel) based on auditory information is improved.

[0055] (5)Evaluation: Evaluate the test results, calculate the accuracy rate of the test results to obtain the above-mentioned first accuracy rate, and determine whether to enter the next level based on the comparison result between the first accuracy rate and the first threshold T. If yes, it is determined that training for the next level can be carried out; otherwise, it is determined that the content of this level needs to be retrained.

[0056] When the first accuracy rate is greater than the first threshold, enter the second level among the multiple levels to enable the trainee to continue to complete one or more training tasks simulated by the second level; the difficulty of one or more training tasks simulated by the second level is greater than the difficulty of one or more training tasks simulated by the first level.

[0057] When the first accuracy rate is less than or equal to the first threshold, continue to enter the first level to enable the trainee to continue to complete one or more training tasks simulated by the first level.

[0058] (6)Selection: If the user requests to end the training, save the level selected based on the evaluation results as the training level for the next login; otherwise, according to the level selected based on the evaluation results, go to step two to continue the training.

[0059] (7)End: If all virtual courses have been completed, the virtual training course ends; otherwise, go to step two to train the content of the next level.

[0060] Based on any of the above embodiments, 10 levels are set in the virtual space simulated in the virtual training system of the present invention according to training needs. Figure 4 It is the level scene map for spatial perception training based on auditory information. Table 1 is the level information table for spatial perception training based on auditory information, as Figure 4 and shown in Table 1, where Figure 4 in (A) is the level map of the 1st - 4th levels, Figure 4 in (B) is the level map of the 5th - 6th levels, Figure 4 in (C) is the level map of the 7th - 8th levels, Figure 4 in (D) is the level map of the 9th level, Figure 4 in (E) is the level map of the 10th level. In addition, the 10 levels are mainly divided into static levels and dynamic levels according to type, where each static level is divided into 4 levels of difficulty training tasks according to the initial position and angle.

[0061] Table 1 Level Information Table for Spatial Perception Training Based on Auditory Information

[0062]

[0063] A virtual training method for spatial perception based on auditory information provided by an embodiment of the present invention forms a set of training methods integrating characteristics such as mixed precision, combination of static and dynamic, timely evaluation and feedback based on the principles of perceptual learning and experience, reduces the training threshold for users, and accelerates the training process.

[0064] Step 102: When entering the first level among the multiple levels, obtain the practice instruction input by the trainee, and make a sound response to the practice instruction, so that the trainee completes one or more training tasks simulated by the first level based on the sound response.

[0065] The obtaining of the practice instruction input by the trainee and making a sound response to the practice instruction includes:

[0066] Obtain the first instruction input by the trainee, where the first instruction is an instruction for controlling simulated sound generation; the practice instruction includes the first instruction; simulate sound generation based on the first instruction.

[0067] Specifically, during the process of a single static training, the first instruction is an instruction issued by the trainee through an input device, and the virtual space simulated in the virtual training system simulates sound generation based on the first instruction, and the trainee judges whether the current selection is accurate through voice or vibration feedback.

[0068] Obtain the second instruction input by the trainee, where the second instruction is an instruction for moving in the virtual space simulated in the virtual training system; the practice instruction includes the second instruction; simulate sound generation based on the second instruction.

[0069] Specifically, during the process of a single dynamic training, the second instruction is a movement instruction issued by the trainee through an input device to complete a position or angle movement until hitting a wall or reaching the destination, and the virtual space simulated in the virtual training system simulates sound generation based on the second instruction to feedback task failure or success.

[0070] Obtain the third instruction input by the trainee, where the third instruction is a sound instruction issued by the trainee; the practice instruction includes the third instruction; simulate the echo of the sound issued by the trainee based on the third instruction.

[0071] Specifically, during the training process of a single static or dynamic training, the third instruction is the sound issued by the trainee collected by the input device, and the virtual space simulated in the virtual training system simulates the emission of an echo based on the collected sound issued by the trainee.

[0072] Figure 5 is a schematic structural diagram of the virtual training system for spatial perception based on auditory information provided by the present invention, asFigure 5 As shown in the figure, the present invention provides a virtual training system for spatial perception based on auditory information. The hardware part includes portable devices such as mobile phones, tablets, and laptops, output devices such as headphones, and input devices such as keyboards, gamepads, and touchscreens. The software part includes a user module, a protagonist module, and a calculation module.

[0073] Among them, the user module mainly includes functions such as user login, registration, and related user-defined configurations.

[0074] The protagonist module is used to control functions such as the movement and voice of the virtual character corresponding to the trainee, including a position module for controlling the position movement of the virtual character corresponding to the trainee, an angle module for controlling the angle rotation, a signal module for controlling the voice and sound source timbre, and a recording module for recording information such as the movement and selection of the virtual character corresponding to the trainee.

[0075] The calculation module is mainly used for all calculation, determination, and feedback functions during the training process, including an echo module for real-time calculation of the simulated sound field, a determination module for judging whether the training is over, an evaluation module for evaluating whether to enter the next stage of training, and a feedback module for outputting all feedback information during the training and testing processes.

[0076] The virtual training method for spatial perception based on auditory information provided by the embodiment of the present invention does not require wearing expensive wearable devices and can be deployed in portable devices such as mobile phones for training, which can better compress costs and is user-friendly.

[0077] Based on any of the above embodiments, the spatial perception training method based on auditory information provided by the present invention further includes:

[0078] When the trainee completes all the training tasks of the level simulation and the first accuracy rate of testing the trainee is greater than the second threshold, obtain the test results of the trainee during training in the real physical space;

[0079] Obtain the second accuracy rate of testing the trainee during the training task in the real physical space; the real physical space matches the virtual space simulated in the virtual training system;

[0080] Evaluate the training effect of training using the virtual training system based on the second accuracy rate, and optimize the virtual training system based on the training effect.

[0081] Specifically, after step (7) in step 101 above, when the trainee completes the training tasks of all level simulations and the first accuracy rate of testing the trainee is greater than the second threshold, training and testing can also be transferred to the real physical space, where the real physical space involved is established according to the virtual scene of the 10th level, as described above. Figure 4 as shown in (E) in the above.

[0082] The trainee can use the echo information obtained by vocalization methods such as snapping fingers and clicking the tongue to walk in the real physical corridor, judge the intersections passed during the walking process, avoid the walls, and stop at the end of the corridor. When the trainee makes mistakes in judging intersections, collides with the walls, fails to reach the minimum distance from the corridor, exceeds the time limit, etc. during the training process, corresponding deductions are made. If the score (i.e., the second accuracy rate) is not lower than the third threshold S, the result is determined to be qualified and the training ends; otherwise, the training continues.

[0083] A virtual training method for spatial perception based on auditory information provided by the present invention constructs a physical maze similar to the virtual scene to assist blind users (trainees) in completing a smooth transition from virtual scene training to relatively familiar physical scene training, strengthens the understanding and perception of auditory information, and helps to better and faster improve the spatial perception ability of blind users based on auditory information.

[0084] Next, a spatial perception training device based on auditory information provided by the present invention will be described. The spatial perception training device based on auditory information described below can be mutually corresponding and referred to the spatial perception training method described above.

[0085] Based on any of the above embodiments, Figure 6 is a schematic structural diagram of a spatial perception training device based on auditory information provided by an embodiment of the present invention. As Figure 6 shown, an embodiment of the present invention provides a spatial perception training device based on auditory information, including a loading module 601 and a response module 602, where:

[0086] The loading module 601 is used to load a pre-established virtual training system; in the virtual training system, one or more levels are set in the simulated virtual space according to training needs, and each level simulates one or more training tasks; the response module 602 is used to obtain a practice instruction input by the trainee when entering the first level among the multiple levels, and perform a sound response to the practice instruction, so that the trainee completes one or more training tasks simulated by the first level based on the sound response.

[0087] The spatial perception training device based on auditory information provided by the embodiments of the present invention sets levels in a virtual space, simulates one or more training tasks in each level, and through the simulated real-time sound field, enables blind users to complete the one or more training tasks based on sound responses, thereby assisting blind users to establish a mapping from auditory information to spatial perception and improving the spatial perception ability of blind users. The present invention does not require wearing heavy wearable devices and only needs to be deployed in portable devices such as mobile phones and laptops to carry out systematic training, which can better balance comfort, portability and expandability. In addition, based on the principles and experience of perceptual learning, the present invention has formed a scientific and systematic training method with characteristics such as mixed precision, combination of dynamic and static, timely evaluation and feedback, reducing the learning difficulty, accelerating the training process, and assisting blind users to complete a smooth transition from virtual scene training to relatively familiar physical scene training by establishing a physical maze similar to the virtual scene, strengthening the understanding and perception of auditory information, and better and faster improving the spatial perception ability of blind users based on auditory information.

[0088] Figure 7 Illustrates a schematic physical structure diagram of an electronic device, as Figure 7 shown, the electronic device may include: a processor 710, a communications interface 720, a memory 730, and a communication bus 740. Among them, the processor 710, the communications interface 720, and the memory 730 complete mutual communication through the communication bus 740. The processor 710 can call logic instructions in the memory 730 to execute the spatial perception training method based on auditory information, and the method includes:

[0089] Loading a pre-established virtual training system; the virtual space simulated in the virtual training system is set with one or more levels according to training needs, and each level simulates one or more training tasks;

[0090] In the case of entering the first level among the multiple levels, obtaining a practice instruction input by the person to be trained, and performing a sound response to the practice instruction, so that the person to be trained completes one or more training tasks simulated in the first level based on the sound response.

[0091] In addition, when the logical instructions in the above-mentioned memory 730 are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, or a part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in various embodiments of the present invention. The aforementioned storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical discs that can store program codes.

[0092] On the other hand, the present invention also provides a computer program product. The computer program product includes a computer program that can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the spatial perception training method based on auditory information provided by the above-mentioned various methods. The method includes:

[0093] Loading a pre-established virtual training system; in the virtual space simulated in the virtual training system, one or more levels are set according to training needs, and each level simulates one or more training tasks;

[0094] In the case of entering the first level among the multiple levels, obtaining the practice instructions input by the trainee and making a sound response to the practice instructions, so that the trainee can complete one or more training tasks simulated by the first level based on the sound response.

[0095] In yet another aspect, the present invention also provides a non-transitory computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, it is implemented to execute the spatial perception training method based on auditory information provided by the above-mentioned various methods. The method includes:

[0096] Loading a pre-established virtual training system; in the virtual space simulated in the virtual training system, one or more levels are set according to training needs, and each level simulates one or more training tasks;

[0097] In the case of entering the first level among the multiple levels, obtaining the practice instructions input by the trainee and making a sound response to the practice instructions, so that the trainee can complete one or more training tasks simulated by the first level based on the sound response.

[0098] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. A person of ordinary skill in the art can understand and implement it without creative labor.

[0099] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the essence of the above technical solution, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0100] In addition, it should be noted that the terms "target", "first", "second", etc. in the present invention are used to distinguish similar objects, rather than to describe a specific order or sequence. It should be understood that such terms can be interchanged under appropriate circumstances so that the embodiments of the present application can be implemented in an order other than those illustrated or described herein, and the objects distinguished by "first" and "second" are usually of the same category, and the number of objects is not limited. For example, the first object can be one or multiple.

[0101] The term "and / or" in the present invention describes the association relationship of associated objects and indicates that three relationships can exist. For example, A and / or B can represent three situations: A exists alone, A and B exist simultaneously, and B exists alone. The character " / " generally represents an "or" relationship between the associated objects before and after.

[0102] "Determining B based on A" in the embodiments of this application means that the factor A should be considered when determining B. It is not limited to "determining B only based on A", but should also include: "determining B based on A and C", "determining B based on A, C, and E", "determining C based on A and further determining B based on C", etc. In addition, it can also include using A as a condition for determining B. For example, "when A meets the first condition, use the first method to determine B"; for another example, "when A meets the second condition, determine B"; for another example, "when A meets the third condition, determine B based on the first parameter", etc. Of course, it can also be a condition for using A as a factor for determining B. For example, "when A meets the first condition, use the first method to determine C and further determine B based on C", etc.

[0103] In the present invention, the term "a plurality of" means two or more, and other quantifiers are similar thereto.

[0104] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than limiting them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements on some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A spatial perception training method based on auditory information, characterized in that, Including: Loading a pre-established virtual training system; In the virtual training system, multiple levels are set in the simulated virtual space according to training needs, and each level simulates one or more training tasks; the training tasks are used to train the spatial perception ability of the blind person to be trained; When entering the first level among the multiple levels, obtaining a practice instruction input by the blind person to be trained and making a voice response to the practice instruction, so that the blind person to be trained completes one or more training tasks simulated by the first level based on the voice response; The obtaining a practice instruction input by the blind person to be trained and making a voice response to the practice instruction includes: Obtaining a third instruction input by the blind person to be trained, where the third instruction is a voice instruction issued by the blind person to be trained; the practice instruction includes the third instruction; Simulating the echo of the voice issued by the blind person to be trained based on the third instruction; When the blind person to be trained completes all the training tasks simulated by the levels and the first accuracy rate of testing the blind person to be trained is greater than a second threshold, obtaining the test result of the blind person to be trained in the real physical space for training; Obtaining the second accuracy rate of testing the blind person to be trained in the training task in the real physical space; the real physical space matches the virtual space simulated in the virtual training system; Evaluating the training effect of training using the virtual training system based on the second accuracy rate and optimizing the virtual training system based on the training effect; The blind person to be trained conducts training in the real physical space, including: the blind person to be trained walks in the real physical corridor using the echo information obtained by the vocalization method of snapping fingers or clicking the tongue, judges the passing intersections during the walking process, avoids the walls, and stops at the end of the corridor.

2. The spatial perception training method based on auditory information according to claim 1, characterized in that The method further includes: Obtaining the first accuracy rate of testing the blind person to be trained in the one or more training tasks simulated by the first level; the first accuracy rate is used to represent the spatial perception ability obtained by the blind person to be trained when completing the one or more training tasks simulated by the level.

3. The spatial perception training method based on auditory information according to claim 2, characterized in that The method further includes: When the first accuracy rate is greater than a first threshold, entering the second level among the multiple levels, so that the blind person to be trained continues to complete one or more training tasks simulated by the second level; the difficulty of the one or more training tasks simulated by the second level is greater than the difficulty of the one or more training tasks simulated by the first level.

4. The spatial perception training method based on auditory information according to claim 2, wherein The method further includes: When the first accuracy rate is less than or equal to the first threshold, continuing to enter the first level, so that the blind person to be trained continues to complete one or more training tasks simulated by the first level.

5. The spatial perception training method based on auditory information according to claim 1, characterized in that The obtaining a practice instruction input by the trained person and making a voice response to the practice instruction includes: Obtaining a first instruction input by the trained person, where the first instruction is an instruction for controlling simulated vocalization; the practice instruction includes the first instruction; Simulating vocalization based on the first instruction.

6. The spatial perception training method based on auditory information according to claim 1, wherein The obtaining a practice instruction input by the trained person and making a voice response to the practice instruction includes: Obtain a second instruction input by the trainee, where the second instruction is an instruction to move in a virtual space simulated in the virtual training system; the practice instruction includes the second instruction. Simulate a sound based on the second instruction.

7. A spatial perception training device based on auditory information, characterized in that, It includes: A loading module for loading a pre-established virtual training system. Multiple levels are set in the virtual space simulated in the virtual training system according to training needs, and each level simulates one or more training tasks; the training tasks are used to train the spatial perception ability of the blind trainee. A response module for, when entering the first level among the multiple levels, obtaining a practice instruction input by the blind trainee and making a sound response to the practice instruction, so that the blind trainee completes one or more training tasks simulated by the first level based on the sound response. The obtaining of the practice instruction input by the blind trainee and making a sound response to the practice instruction includes: Obtain a third instruction input by the blind trainee, where the third instruction is a sound instruction issued by the blind trainee; the practice instruction includes the third instruction. Simulate the echo of the sound made by the blind trainee based on the third instruction. When the blind trainee completes the training tasks simulated by all levels and the first accuracy rate of testing the blind trainee is greater than a second threshold, obtain the test result of the blind trainee during training in the real physical space. Obtain the second accuracy rate of testing the blind trainee during the training task in the real physical space; the real physical space matches the virtual space simulated in the virtual training system. Evaluate the training effect of training using the virtual training system based on the second accuracy rate, and optimize the virtual training system based on the training effect. The blind trainee conducts training in the real physical space, including: the blind trainee walks in a real physical corridor using the echo information obtained by the sound-making methods of snapping fingers or clicking the tongue, judges the passing intersections during walking, avoids the walls, and stops at the end of the corridor.

8. An electronic device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the spatial perception training method based on auditory information according to any one of claims 1 to 6.

Images