Method and apparatus for enhancing human cognition

By presenting visual and auditory information to humans simultaneously, the problem that existing learning methods involve only a single sense is solved, and the learning effect is improved, especially when multiple senses are combined.

CN119744412APending Publication Date: 2025-04-01VIMBAL ENTERPRISES PTY LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202380061480.X
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-06-22
Filing Date
2023-06-22
Publication Date
2025-04-01

AI Technical Summary

Technical Problem

Existing learning methods usually involve only one sense of humanity, limiting the learning ability of most people, and when multiple sensations are involved, the effect of a certain sensory input is discounted by receiving another sensory input simultaneously.

Method used

A human sensory information presentation mechanism is provided, which presents visual and auditory information to a person through a controller, including visual information and nonverbal auditory signals, and uses a visual presentation device and an auditory presentation device to present characters or structured character sets and nonverbal auditory signals respectively.

Benefits of technology

By presenting visual and auditory information simultaneously, human memory and cognitive abilities are improved and learning effects are enhanced, especially when multiple sensations are involved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119744412A_ABST
    Figure CN119744412A_ABST
Patent Text Reader

Abstract

The present invention relates to a human sensory information presentation mechanism for presenting sensory information to a person, the mechanism having: a controller programmed to provide human visual and auditory presentation information comprising at least visual information and a non-linguistic auditory signal; at least one human visual presentation device for receiving visual information from the controller, where the visual information includes at least one or more human-readable characters or structured character sets from a predetermined alphabet and a predetermined set of numbers to form human-readable words or numbers, one character or one structured character set being presented at a time; and at least one human auditory presentation device for receiving a non-linguistic auditory signal from the controller, where the controller presents each human readable character or structured character set while presenting at least one predetermined non-linguistic auditory signal. The mechanism can be used by various users with different intellectual acuity and cognitive competence, and the combinations and methods of use of certain elements are more effective than other combinations and methods of use of elements in training, reading tasks, and helping people with various human cognitive disorders and conditions.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The field of the invention is methods, devices and systems for enhancing human cognition, mental activity or the process of acquiring knowledge and understanding through thinking, experience and senses. Background Art

[0002] Humans learn to survive and, in most cases, adapt well to their environment. Learning behavior is multifaceted, and the field of cognitive neuropsychology grew out of the early recognition that humans primarily act and react to their environment in predictable ways. However, learning is not a process that is the same for all people, even though statistically speaking, the way humans receive and process information and the way they make relationships between perceived events and knowledge about that event are normally distributed. Even the ability to remember that event, recall that event, and understand the meaning of that event in the context of events at the time or in the future are uniquely human traits.

[0003] Perception is central to learning, and most people have five senses (taste, smell, sight, touch, and hearing) that help them see and understand their environment. However, not everyone is equally able to use each sense.

[0004] Many studies have shown that some people are visual learners. First, they see, then they understand and do it. Some people need to be told what to do, while others need a combination of both. Some people use touch better than others when it is part of an event, and some people are better at one or both of these ways of taking in sensory input and connecting it to concepts and facts when it includes taste and smell.

[0005] Some people consciously or unconsciously suppress or diminish their understanding of their perceptions. As a result, their recollection of sensory experiences is affected by common human psychological problems as well as some that are unique to them.

[0006] Learning is one of the many results of the human brain receiving sensory inputs, which can be filled with every waking moment and can even be perceived during sleep. First, the human sensory input mechanism transforms the sensory input into perceptual information, which after some processing, is stored in whole or in part in a memory location. Thereafter, the brain exercises its reasoning ability using the existing information and sometimes incoming perceptual sensory input. Reasoning allows people to apply large amounts of memorized information, and the logical processing of this information is an example of the thinking and cognitive ability of the human brain that facilitates learning.

[0007] The study of how humans learn is a very active field. It is fundamental to the human experience, even more so when humans need to learn in order to pass an exam or be deemed fit to practice a skill or work in a safe and responsible environment. The fields of human endeavor are very wide, and the fact that humans receive and learn new information at work and in their private lives means that improving the way humans learn will benefit them and others. How humans perceive information is crucial to the effectiveness of learning from that information.

[0008] However, the learning process typically involves only one human sense at a time. This limits most people's ability to learn. When multiple senses are involved, there are many examples where the effect of one sensory input is compromised by receiving input from another sensory input at the same time. There is much that can be done to present visual and auditory sensory input to people to enable more effective memory and recognition of information than previous methods. Summary of the invention

[0009] In one embodiment, a human sensory information presentation mechanism is provided for presenting sensory information to a person, the mechanism comprising:

[0010] a controller including a memory and a central processing unit, the controller being programmed to provide human visual and auditory presentation information including at least visual information and non-verbal auditory signals;

[0011] at least one human visual presentation device for receiving visual information from the controller, the visual presentation device having a configuration for displaying the received visual presentation information exclusively to the one person within a predetermined field of view, wherein the visual information comprises at least one or more human-readable characters or structured character sets from a predetermined alphabet and a predetermined set of digits to form human-readable words or digits, one character or one structured character set being presented at a time; and

[0012] at least one human auditory presentation device for receiving non-verbal auditory signals from the controller, the human auditory presentation device being configured to direct the non-verbal auditory signals specifically to the one person, the non-verbal auditory signals comprising one or more non-verbal auditory signals,

[0013] Wherein, the controller presents each human-readable character or structured character set and simultaneously presents at least one predetermined non-verbal auditory signal.

[0014] In one approach, the human readable characters or structured character set are presented by the visual presentation means to contrast with a predetermined background color also presented by the visual presentation means.

[0015] In one embodiment, the visual presentation of human-readable characters or structured character sets includes one or more of the following groups: predetermined colors for one or more human-readable characters or structured character sets; groupings of human-readable characters or structured character sets of different colors; human-readable characters or structured character sets that appear to move in front of a person viewing the presentation.

[0016] In one approach, a predetermined color is used for a predetermined word and contrasts with another predetermined color that is different from the predetermined color of the predetermined word.

[0017] In one approach, a plurality of predetermined colors are used when a series of presented words form a human-readable phrase or a human-readable sentence.

[0018] In one way, predetermining a palette, word, phrase, sentence or font size involves using a library of these elements, which can be used to find the required elements. Therefore, for example, when a certain palette suitable for autistic human users is to be used, the palette is predetermined by the input provided at the beginning of the user session, which is based on the available selections recorded and used by the server computer or local processor. Similarly, text and background visual information are presented using predetermined colors. In another example, when a word is predetermined, the word is found from the memory associated with the computer server or local processor. The source is the result of the parsing of the source information to be presented during the session, wherein, at the beginning of the session, the selection of the source and the visual information will be presented for the human user, the secure session recipient or the person who wants to read a specific book, etc. to study during the session. Similarly, a predetermined phrase, sentence or font size is used. The font size mentioned later can be predetermined to suit a specific person with vision problems.

[0019] In one embodiment, the visual presentation includes human-readable characters or structured character sets that appear to move toward the person and then away from the person within the person's field of vision, wherein the movement occurs just as each consecutive human-readable character or structured character set appears, or the movement occurs over the course of a consecutive human-readable character or structured character set.

[0020] In one approach, the rate at which the successive presentation of the human-readable characters or structured character set is presented to the person is variable based on an initial predetermined rate.

[0021] In one approach, the font size of successive presentations of human-readable characters or structured character sets presented to the person is variable based on an initial predetermined font size.

[0022] In one approach, successive presentations of human-readable characters or structured character sets presented to the person are accompanied by the image of a trap door through which previous human-readable characters or structured character sets presented to the person appear to enter and disappear.

[0023] In one approach, successive presentations of human-readable characters or structured sets of characters presented to the person are accompanied by an image of a moving corridor in which previous human-readable characters or structured sets of characters presented to the person appear to enter and disappear.

[0024] In one approach, the one or more human-readable characters or structured character sets are presented repeatedly as the human-readable characters or structured character sets are presented continuously to the person.

[0025] In one approach, each predetermined non-verbal auditory signal is continuous during presentation of the human-readable characters or structured character set and during intervals between consecutive presentations of the human-readable characters or structured character set.

[0026] In one approach, the predetermined non-verbal auditory signal is binaural and provided to each ear of the person.

[0027] In one approach, the predetermined non-verbal auditory signal is a combination of two tones, and a monaural tone is provided to both ears of the person.

[0028] In one approach, the predetermined non-verbal auditory signal is binaural and provided to each ear of the person.

[0029] In one embodiment, the predetermined non-language auditory signal is an isochronous tone. In one aspect, the isochronous tone has a predetermined pitch and a predetermined interval. In one aspect, at least one human auditory presentation device for receiving the non-language auditory signal from the controller also includes a transducer for converting electrical energy representing the non-language auditory signal controlled and provided by the controller into mechanical energy to vibrate surrounding air, the transducer is located near the ear of the person, and the received vibrated air is a manifestation of the non-language auditory signal.

[0030] In one approach, at least one human auditory presentation device further comprises a housing having a transducer located within the housing, wherein the housing is used to direct sound generated by the non-speech auditory transducer into a human ear.

[0031] In one approach, the presentation of the human-readable characters or structured character set is coordinated with the presentation of predetermined non-verbal auditory signals through an application programming interface executed by the controller.

[0032] In one embodiment, the human visual presentation device comprises a video signal presentation screen or two video signal presentation screens extending at least to the boundary of the human visual field.

[0033] In one approach, a computer server having a computer server memory and a central processing unit for providing visual and non-verbal auditory presentation information from the computer server memory;

[0034] a computer device having a digital signal receiving mechanism, a computer device memory, and a central processing unit, the central processing unit being operable to store an application programming interface in the computer device memory and to execute the application programming interface, the computer device being operable to receive and process visual and non-verbal auditory presentation information provided by the computer server; and

[0035] at least one human visual presentation device for receiving visual presentation information from said computer device, said visual presentation device having a configuration for exclusively displaying the received visual presentation information to said one human user within a predetermined field of view, wherein said visual information comprises at least one or more human-readable characters or structured character sets from a predetermined alphabet and a predetermined number set to form human-readable words or numbers, one character or one structured character set being presented at a time; and

[0036] and at least one human auditory presentation device for receiving non-verbal auditory signals from the computer device, the human auditory presentation device being configured to direct the non-verbal auditory signals specifically to the one human user, the non-verbal auditory signals comprising one or more non-verbal auditory signals, wherein the computer device presents each human-readable character or structured character set and simultaneously presents at least one predetermined non-verbal auditory signal.

[0037] In one approach, the visual presentation information is provided to the computer server for use and stored in the computer server memory.

[0038] In one approach, the central processor parses visual presentation information stored in a computer server memory that is partitioned to identify words and subsets of sentences or complete sentences using one or more text spacing elements or punctuation marks as delimiters for words or sentences or subsets of complete sentences.

[0039] The systems, methods, and apparatus disclosed in this specification are intended to provide at least one alternative to any currently available system, alleviating or minimizing its problems and disadvantages.

[0040] The reference to any prior art in this specification is not, and should not be taken as, an admission that the prior art forms part of the common general knowledge.

[0041] Throughout the specification and the claims that follow, unless the context requires otherwise, the words "comprises" and "comprising" and variations thereof, should be understood to imply the inclusion of a stated integer or group of integers but not the exclusion of any other integer or group of integers. Unless the context indicates otherwise, the terms "a" and "an" mean "one or more".

[0042] It will be appreciated by those skilled in the art that the use of the disclosure described herein is not limited to the specific applications described herein. The disclosure is not limited to any preferred embodiments involving the elements and features described or depicted herein. It will be appreciated that the scope of the disclosure is not limited to the disclosed embodiments, but is capable of a variety of rearrangements, modifications, and substitutions without departing from the scope set forth and defined by the claims.

[0043] Some embodiments described herein can be implemented using program elements, which are generally referred to as modules or components, although other names are also used. Such program elements can include programs, subroutines, parts of programs, software components or hardware components that can perform one or more specified tasks or functions. As used herein, modules or components can exist on hardware components independently of other modules / components, or modules / components can be shared elements or processes of other modules / components, programs or machines. Modules or components may reside on a machine, such as a client or a computer server. Modules / components may be distributed on multiple machines, such as distributed on multiple clients or computer server machines. Any system described can be implemented in whole or in part on a computer server, or as part of a network service. Alternatively, the system described herein can be implemented in whole or in part on a local computer, terminal or server. In either case, unless otherwise specified, the implementation of the system provided in this application may require the use of memory, processors and network resources (including data ports and signal lines (optical, electrical and other communication methods).

[0044] Some embodiments described herein may generally require a computer, including processing resources and memory resources. For example, the system described herein may be implemented on a server or a network. Such a computer server may be connected and available to users through a network such as the Internet or a combination of multiple networks (e.g., a cellular network and the Internet). Alternatively, one or more embodiments described herein may be implemented locally on a computer such as a desktop, a cellular phone, a personal digital assistant, or a notebook computer, in whole or in part. Therefore, memory, processing resources, and network resources may be used in connection with the establishment, use, or execution (including the execution of any method or the implementation of any system) of any embodiment described herein.

[0045] In addition, some embodiments described herein may be implemented using instructions that can be executed by one or more processors. These instructions may be carried on a computer-readable medium. The machines that may be shown in the drawings provide examples of processing resources and computer-readable media on which instructions for implementing the embodiments can be executed and run. Numerous machines associated with one or more embodiments include processors and various forms of memory for storing data and instructions. Examples of computer-readable media include permanent memory devices, such as hard disks on personal computers or computer servers. Other examples of computer storage media include portable storage units, such as CD or DVD units, flash memory (carried on many mobile phones and personal digital assistants (PDAs)), and magnetic memory. Computers, terminals, and network-enabled devices (such as mobile devices such as mobile phones) are examples of processors and devices. Instructions are typically stored on temporary and non-temporary computer-readable media, including RAM, ROM, and EPROM devices.

[0046] The present disclosure can be implemented in a variety of ways, including as a process, device, system, or computer-readable medium (e.g., a computer-readable storage medium or a computer network in which program instructions are sent via wireless, optical, or electronic communication links). It should be noted that within the scope of the present disclosure, the order of the steps of the disclosed process can be changed.

[0047] Details regarding computers, computer networks, software programming, remote communications, etc. may sometimes not be explicitly described because these details are not necessary for a person skilled in the art to fully understand the embodiments and do not limit a person skilled in the art from performing the embodiments, but these details should be considered to exist because these details are considered to be within the skills of a person of ordinary skill in the art.

[0048] The preceding Summary section introduces some simplified conceptual selections, which are further described in the following Detailed Description section. The Summary section is not intended to identify any or all key or essential features of the claimed subject matter.

[0049] It will be appreciated by those skilled in the art that the use of the present disclosure is not limited to those specific applications described. The present disclosure is not limited to the preferred embodiments involving the specific elements and features described or depicted herein. It will be appreciated that the present disclosure is not limited to the disclosed embodiments, but is capable of multiple rearrangements, modifications, and substitutions without departing from the scope set forth. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] Figure 1 shows an application configuration flow chart for handling text and color;

[0051] Figure 2A flowchart of an application configuration for processing text-to-speech is shown;

[0052] Figure 3 A flow chart of the visual feature process used to select and process user files is shown;

[0053] Figure 4 Shown is a word parsing process flow chart for processing and rendering words;

[0054] Figure 5 A flow chart of a words per minute process for handling a word count incrementing process is shown;

[0055] Figure 6 A word location process flow chart for processing word location within a visual field is shown;

[0056] Figure 7 The rendering process of the selected word and the selected color is shown;

[0057] Figure 8 Shows Figure 7 The display process of the selected word and the selected color;

[0058] Fig. 9 Shows Figure 8 The display process of the selected word and the selected color is automatically accelerated;

[0059] Fig.10 The display process of the selected word and the selected color is shown, and the Fig. 9 Automatic speed-up process and font size adjustment;

[0060] Fig.11 The display process of the selected word and the selected color is shown, and the Fig.10 Automatic speed increase, font size adjustment process and position adjustment within the field of view;

[0061] Fig.12 The display process of the selected word and the selected color is shown, and the Fig.11 Automatic speed increase, font size adjustment, position adjustment within the visual field, and font adjustment to accommodate users with dyslexia;

[0062] Fig.13 A word parsing process flow chart for processing and rendering colored words is shown;

[0063] Fig.14 Shows Fig.13 A flowchart of a word parsing process for processing and rendering colored words in the process of displaying one word at a time;

[0064] Fig.15 Shows Fig.14 A flowchart of a word parsing process in a process for processing and rendering colored words, displaying one word at a time, and applying an automatic speed boost;

[0065] Fig.16 Shows Fig.15 A flowchart of a word parsing process in a process for processing and rendering colored words, displaying one word at a time, applying an automatic speed boost, and applying font adjustments;

[0066] Fig.17 Shows Fig.16 A flowchart of a word parsing process in a process for processing and rendering colored words, displaying one word at a time, applying an automatic speed boost and font adjustment process, and applying a position adjustment within the field of view;

[0067] Fig.18 Shows Fig.17 A flowchart of a word parsing process in a process for processing and rendering colored words, displaying one word at a time, applying automatic speed boost, font adjustment and position adjustment in the field of view, and applying font adjustment to accommodate dyslexic users;

[0068] Fig.19 A word parsing process flow chart is shown for processing and rendering colored words to accommodate dyslexic users;

[0069] Fig. 20 Shows Fig.19 A flowchart of a word parsing process in a process for processing and rendering colored words to accommodate dyslexic users and displaying one word at a time;

[0070] Fig.21 Shows Fig. 20 A flowchart of a word parsing process in a process for processing and rendering colored words to accommodate dyslexic users, displaying one word at a time, and applying an automatic speed boost;

[0071] Fig. 22 Shows Fig.21 a flowchart of a word parsing process in a process for processing and rendering colored words to accommodate dyslexic users, displaying one word at a time, applying an automatic speed boost, and applying font adjustments;

[0072] Fig.23 Shows Fig. 22 A flowchart of a word parsing process in a process for processing and rendering colored words to accommodate dyslexic users, displaying one word at a time, applying automatic speed boost and font adjustment, and applying position adjustment within the field of view;

[0073] Fig.24 Shows Fig.23 A flowchart of a word parsing process in a process for processing and rendering colored words to accommodate dyslexic users, displaying one word at a time, applying automatic speed boost, font adjustment, and position adjustment within the field of view, and applying font adjustment to accommodate dyslexic users;

[0074] Fig.25 An environment creation device using a dark display background for a single word is shown;

[0075] Fig.26 Shows an image Fig.25 The same device was created for the environment using a dark display background for a single word, where a corridor display background was used;

[0076] Fig. 27 An environment creation device using a dark display background for a single word is shown, wherein the Fig.26 The corridor shows the background, and uses the position adjustment within the field of view;

[0077] Fig.28 An environment creation device using a dark display background for a single word is shown, wherein the Fig. 27 The background of the corridor display and the position within the field of view have been adjusted, and the elevated sight line within the field of view is used;

[0078] Fig.29 An environment creation device using a dark display background for a single word is shown, wherein the Fig.28 The corridor display background, position adjustment within the visual field, elevated gaze within the visual field, and adjustments to word presentation were used to promote disjunctive learning, including displaying words from the side of the user's visual field;

[0079] Fig.30 An environment creation device using a dark display background for a single word is shown, wherein the Fig.29 The corridor display background, position adjustment within the visual field, elevated gaze within the visual field, and word presentation adjustment were used to facilitate disjunctive learning, and word presentation adjustment was used to facilitate visualization of the trapdoor;

[0080] Fig.31 An environment creation device using a dark display background for a single word is shown, wherein the Fig.30 corridor display background, position adjustment within the visual field, elevated gaze within the visual field, adjustment of word presentation to promote disjunctive learning, adjustment of word presentation to facilitate visualization of the trapdoor, where the user experience was stopped at random intervals;

[0081] Fig.32The rendering process of selected words and selected colors that are beneficial to neurodiverse users is shown;

[0082] Fig.33 Shows Fig.32 The rendering process of the selected words and selected colors in the process is beneficial to neurodiverse users, and the corridor display background is used;

[0083] Fig.34 Shows Fig.33 Rendering of selected words and selected colors in a process that favors neurodiverse users, using a corridor display background and using position adjustment within the user's field of view;

[0084] Fig.35 Shows Fig.34 Rendering of selected words and selected colors in a process that benefits neurodiverse users, using a corridor display background and position adjustment within the user's field of view, and using an elevated gaze within the field of view;

[0085] Fig.36 Shows Fig.35 a rendering process of selected words and selected colors that benefit neurodiverse users using a corridor display background, position adjustments within the user's field of view, and elevated gaze within the field of view, and using adjustments to word presentation to promote disjunctive learning, including displaying words from the side of the user's field of view;

[0086] Fig.37 Shows Fig.36 a rendering process of selected words and selected colors that benefited neurodiverse users, using a corridor display background, position adjustment within the user's field of view, elevated gaze within the field of view, and adjustment of word presentation to facilitate dissociative learning, and using adjustment of word presentation to facilitate visualization of active gates;

[0087] Fig.38 Shows Fig.37 a rendering process of selected words and selected colors that are beneficial to neurodiverse users in a process that utilizes a corridor display background, position adjustment within the user's field of view, elevated gaze within the field of view, adjustment of word presentation to facilitate disjunctive learning, and adjustment of word presentation to facilitate visualization of active gates, wherein the user experience is stopped at random intervals;

[0088] Fig.39 A presentation of a moving corridor is shown to convey to the user the impression that the user is moving forward;

[0089] Fig.40 Shows Fig.39The presentation of a moving corridor during the process, in which the position of the words in the visual field is adjusted;

[0090] Fig.41 Shows Fig.40 The presentation of a moving corridor during the process, in which the position of the words in the visual field was adjusted, and binaural beats provided to the environment creation device were used;

[0091] Fig.42 Shows Fig.40 The presentation of a moving corridor during the process, where the position of the words in the field of view is adjusted, and binaural beats provided to the environment creation device are used and the user is prompted to keep their eyes open;

[0092] Fig.43 Shows Fig.40 Presentation of a moving corridor during the process, wherein the position of the words within the field of view is adjusted, binaural beats provided to the environment creation device are used, the user is prompted to open their eyes, and an elevated gaze within the user's field of view is used;

[0093] Fig.44 Shows Fig.40 Presentation of a moving corridor during a process wherein the position of words within the field of view is adjusted, binaural beats provided to an environment creation device are used, the user is prompted to open their eyes, an elevated gaze within the user's field of view is used, and a previously displayed word or set of words is repeated;

[0094] Fig.45 Shows Fig.40 presentation of a moving corridor during a process wherein adjustments to the position of words within the field of view are made, binaural beats provided to an environment creation device are used, the user is prompted to open their eyes, an elevated gaze within the user's field of view is used, previously displayed words or sets of words are repeated, and adjustments to word presentation are used to promote disjunctive learning, including displaying words from the side of the user's field of view;

[0095] Fig.46 Shows Fig.40 presentation of a moving corridor during a process wherein adjustments to the position of words within the field of view are made, binaural beats provided to an environment creation device are used, a user is prompted to open their eyes, an elevated gaze within the user's field of view is used, a previously displayed word or set of words is repeated, adjustments to word presentation are used to facilitate disjunctive learning, including displaying words from the side of the user's field of view, and adjustments to word presentation are used to facilitate visualization of a movable door;

[0096] Fig.47 Shows Fig.40presentation of a moving corridor during a process wherein adjustments to the position of words within the field of view are made, binaural beats provided to an environment creation device are used, the user is prompted to keep their eyes open, an elevated gaze within the user's field of view is used, a previously displayed word or set of words is repeated, adjustments to word presentation are used to facilitate disjunctive learning, including displaying words from the side of the user's field of view, and adjustments to word presentation are used to facilitate visualization of a movable door, wherein the user experience is stopped at random intervals;

[0097] Fig.48 A human non-verbal auditory presentation device is shown, which is configured to direct non-verbal auditory presentation information in the form of non-verbal auditory signals specifically to a person's ears using binaural beats having predetermined frequencies and a combination / summing arrangement to add to a predetermined audio recording;

[0098] Fig.49 A human nonverbal auditory presentation device is shown configured to direct nonverbal auditory presentation information in the form of nonverbal auditory signals specifically to a person's ears using binaural beats having a predetermined frequency and a text-to-speech mechanism to add a machine-created speech expression of a predetermined audio recording or predetermined text source;

[0099] Fig.50 A human nonverbal auditory presentation device is shown configured to direct nonverbal auditory presentation information in the form of nonverbal auditory signals specifically to a person's ears using binaural beats having predetermined frequencies and a combining / summing mechanism to add a predetermined audio signal, and also using a text-to-speech mechanism to add a predetermined audio recording or machine-created speech utterance of a predetermined text source;

[0100] Fig.51 Multiple sub-learning sessions are shown, where a learning session is broken down into multiple randomly spaced sessions with rest periods in between;

[0101] Fig.52 Shown in Fig.51 Add animation to the element to illustrate the active door on the header image;

[0102] Fig.53 Shown in Fig.51 and 52 Add eye movement desensitization and reprocessing simulation to the elements;

[0103] Fig.54 shows the calibration process and setup process for a head mounted virtual reality device, showing adjustments that may need to be made if the user has visual blind spots;

[0104] Fig.55 One embodiment of elements of a head mounted virtual reality device is shown;

[0105] Fig.56 An embodiment of a document upload arrangement and a client-server cloud architecture is shown;

[0106] Fig.57 Sound processing techniques are shown to make sound appear to come from sources farther away from the user, as shown in the figure, in front of, above, and behind the user at any one time. DETAILED DESCRIPTION

[0107] The disclosed methods, apparatus and systems include visual and non-verbal auditory arrangements for training personnel working in hazardous environments (by way of example only). In addition, while the various aspects of the proposed systems, alone or in combination, can be used to treat and manage post-traumatic stress disorder (PTSD), anxiety, attention deficit hyperactivity disorder (ADHA), autism, dyslexia and other neurological disorders, they can also be used to accelerate the learning of knowledge acquired through reading by students and professionals. Other possible application areas include gaming, retail, sports and any learning or training environment.

[0108] The arrangement of elements and features includes visual effects, including but not limited to: using contrasting colors / selected color palettes to account for dyslexia and color blindness, coloring human-readable characters or structured character sets (hereinafter referred to as text, which may also be referred to as words) and backgrounds, timing and movement (mainly text on visual presentation devices), using eye movement desensitization and reprocessing, and using the forward movement of text perceived when viewing the text. In addition, in one embodiment, the various parts of the arrangement are adjusted to provide an immersive, sensory-free environment for humans using the arrangement. In one embodiment, the structured character set can form words known in a word dictionary created by a subject alphabet. Alternatively, the structured character set can represent acronyms, slang, or words that have not yet been included in the dictionary. In scientific or engineering documents, the structured character set can be an abbreviation of a formula or a known longer form. The structured character set can be a number or a character from another alphabet or language. Some structured character sets may need to be translated or converted for user understanding.

[0109] The arrangement of elements and features also includes sound prompts, such as text to speech, binaural beats embedded in speech delivery (used to express the displayed text), binaural beats in the background, and 111 Hz sounds delivered specifically using the left ear. In contrast, the right ear emits beats within a selected frequency band, which affects a range of corresponding states in humans, such as relaxation (other suitable single frequencies may be used), states equivalent to rapid eye movement, concentration, and high engagement. The aforementioned disclosed sound prompts may be provided in the preliminary preparation phase, between the beginning and end of the process, with or without one or more of the previously described visual prompts. Moreover, thereafter, the process allows people to process the textual information they have perceived, but in one embodiment, this does not apply to text to speech prompts.

[0110] References to human-readable characters or structured character sets include, but are not limited to, those characters that are subsets of a corresponding alphabet. A character or structured character set may represent a single character, a word, or a collective character symbol, or have a known meaning. Additionally, a structured character set may represent a word whose meaning is known, or the character set may collectively represent an image whose meaning is known. Sometimes preceding or following characters or structured character sets affect the meaning of the character or structured character set as presented to a person. Visual information is a human-readable character or structured character set of one or more letters.

[0111] The disclosed methods, devices, and systems will create an arrangement that ranges from minimal basic prompts that affect the person using the arrangement to a combination of prompts that are delivered to selected people or groups of specific types of people, with possible variations depending on the type of user or types of users within a group.

[0112] The generation and control of the visual and auditory cues is controlled by a computer, such as a computer server and associated application programming interface, which can be provided from a cloud computing based environment and can be accessed by users on a time-based and purpose-built software basis as a service. Users can provide source text libraries or image libraries, or there can be pre-selected text and image libraries that become part of the available service.

[0113] Isochronous tones are single tones that are presented to the listener intermittently at regular, even intervals. The intervals are usually brief, producing a beat that is like a rhythmic pulse. These sounds can be embedded in other sounds, such as music or nature sounds.

[0114] Binaural stereo headphones have two channels and two speakers. With stereo headphones, the controls are always asymmetrical, meaning two different signals are output on the two speakers, but at the same volume.

[0115] Binaural headphones have two completely separate channels. In addition, each speaker has separate channels so the signals can be output independently, which means each speaker can have a different volume. It is also possible to provide both signals in just one speaker or in both speakers, which can be used for users who prefer or need to use one ear.

[0116] In one mode of the mechanism, visual and non-verbal auditory presentation information is provided to one or more people in an immersive environment without sensory interference. This mode is intended to eliminate external stimulation to humans as much as possible to provide an immersive environment. A virtual reality (VR) headset is an embodiment of such a mechanism, wherein the VR device has a structure that isolates people from external visual and auditory inputs, and only allows the use of a dedicated visual presentation device to present predetermined visual and predetermined non-verbal auditory presentation information. For example, the visual presentation device includes a video signal presentation screen or two video signal presentation screens (one screen for each eye of the person, or one screen for both eyes of the human user). A video signal presentation device includes a screen or two visual information presentation screens located in the headset, and displays the received visual presentation information specifically to the human wearer of the headset. The size of one or more screens is suitable for viewing within the visual field boundary of the person wearing the headset. The headset is configured so that the person cannot view anything other than the video signal presentation device. The resolution, frames per second, brightness and data rate of the video signal presentation device are constantly improving. However, a monochrome head mounted display with a 3840×2160 pixel resolution, a frame rate of 60 frames per second, and a constant data input processing rate of 150 megabits per second, or an omnidirectional 3840×2160 (3840×1080 per eye, from top to bottom of the screen), a frame rate of 60 frames per second, and a constant data input processing rate of 150 megabits per second, far exceeds the minimum requirements. The capabilities required to provide the types of images required for the source human visual presentation information disclosed herein are far less than these. The field of view of a person wearing a headset equipped with a video signal presentation device can be evaluated separately or assumed to be applicable to most human users.

[0117] In one embodiment, the human auditory presentation device includes a housing configured to provide one or more predetermined non-verbal auditory signals for each ear. At least one human non-verbal auditory presentation device is configured to receive predetermined non-verbal auditory signals from a controller. The human auditory presentation device also includes a transducer for converting electrical energy (representing the non-verbal auditory signal controlled and provided by the controller) into mechanical energy to vibrate the surrounding air. The transducer is located near the ear of the person, and the received vibrated air is a form of expression of the non-verbal auditory signal. Using two human auditory presentation devices can provide non-verbal auditory signals for both ears of the person. The human auditory presentation device also includes a housing, a shell of which is provided with a transducer, wherein the housing is used to guide the sound generated by the non-verbal auditory transducer into the ear of the person.

[0118] One feature (but not limited to) is that the visual information presented to the human should be manageable, so visual elements such as menus are not used during the presentation of predetermined visual presentation information (e.g., a predetermined alphabet, a predetermined set of numbers used to form human-readable words or numbers). Fig.55 The virtual reality head mounted device of the present invention provides an embodiment of at least one human auditory presentation device configured to direct non-verbal auditory presentation information in the form of non-verbal auditory signals specifically to one or both ears of a person wearing the head mounted device. Another alternative is a transducer located in the temple of the glasses that converts electrical signals into sound, or an in-ear transducer (sometimes called an earplug) of a bone conduction sound transmission device.

[0119] In one form of the mechanism, visual presentation information is displayed to a user within the person's field of view. When a virtual reality head-mounted device is used, a vision shield and surrounding housing collimate and direct the visual images generated and displayed on the video display screen to the eyes of the person wearing the head-mounted device. The video display screen is very close to the user's eyes. However, the field of view of each eye of a person can be approximately 130 degrees, which can add up to 180 degrees, with each eye's field of view overlapping by up to 120 degrees. As long as the visual image provided to the user is within their field of view, the user's visual attention can be guaranteed. Therefore, physical obstacles and screen areas limit the user's field of view. Because sensors are installed in the virtual reality head-mounted device, the user can change the direction of gaze by turning his head, etc., so that the area at the edge of the field of view is available for viewing. The mechanism can be used to change the user's field of view relative to the head movement and the user's vision to ensure that the visual information or background presented on one or more screens of the virtual reality device is always within the user's field of view.

[0120] One way of the mechanism is that the source characters or structured character sets of one or more alphabets readable by humans are generated by parsing the source information, which means that the source character set is segmented or decomposed into a single character, or a plurality of characters, or a set of characters or numbers. The central processing unit parses the visual presentation information stored in the computer server memory and partitions it to use one or more text space elements or punctuation marks as delimiters of words or sentences or a subset of a complete sentence to identify words and sentences or a subset of a complete sentence. For example, spaces, commas, semicolons, colons, quotation marks, full stops, question marks, exclamation marks and full stops can all be used as the end of words, sentences or sentence fragments. It is also possible to use one or more symbols to divide sentences into smaller fragments. The text stream can be further divided by identifying a single word or a set of known characters so that in a preferred embodiment, each fragment consisting of a word or symbol can be presented to people according to the described method, one at a time.

[0121] For example, information in a book that is required to be read and understood by people (who normally read at their reading speed) can be presented to people in a manner according to the described method, and the result may be that the book or relevant parts or paragraphs of the book can be read much faster than people can read. Nevertheless, the user's memory and perception of the information in the book is better than when reading at the speed at which they are most comfortable. The same applies to people in training who need to read information about safe and responsible methods for tasks they undertake in a work environment. Similarly, the average novel reader can read and enjoy the novel at a much faster reading speed than usual, while retaining and perceiving the details of the novel better than the average person.

[0122] One way of the mechanism is that the color of the text is predetermined, just as the background color can be predetermined for colored text. For example, in one embodiment, the text is white with a gray background, or vice versa. In addition, the parsed text can have a predetermined font and color, where these colors include four palettes, and the human user of the mechanism can choose from pastels, high chroma of purity, intensity or saturation, primary colors (or secondary colors or tertiary colors), and grayscale. For example, each fragment consisting of a word or symbol can be presented to the human user with the same color characteristics, a hue randomly selected or selected from a predetermined palette, and applied to each text fragment in the set or with a complementary contrasting background color. In one embodiment, a mechanism can be set to display text with predetermined colors, thereby improving the text reading ability and memory of human users (especially users with dyslexia).

[0123] This is one way to set predetermined text and background colors. So, for example, a dark color (such as black or royal blue) is used as a background for colored text to encourage the human user's eyes and mind to focus only on the text, sometimes also called hyperfocus. In one embodiment, if the human user is a vulnerable learner (neurodiverse learner), the background color is predetermined. In addition, in one embodiment, the mechanism can provide such an option: it can be configured to enable or disable a certain functional point, such as overlaying a solid color with a predetermined opacity in the field of view, which is beneficial for neurodiverse human users.

[0124] One form of the mechanism is to display one character or one character set representing a known word as text at a time. Essentially, one word of text is presented at a time. In one embodiment, a human visual presentation device (e.g., a liquid crystal display (LCD)) adjusts the size, alignment, and distance from the eyes of a human user to present the text as the only visual perception input within its field of view (i.e., the angular range of light received by each eye), without assistance, or by using one or more lenses located between the display device and each eye for assistance, or by using a light collimator for assistance to limit the view on each side of the physically defined area of ​​the display device. Using different mechanisms, the field of view may change accordingly, for example, when the display is a personal computer (using an application interface or a web browser), a screen away from the computing device or served by a remote server, or a mobile phone or tablet device. The head-mounted device is used to collimate the received visual information and direct the visual information into the human field of view. The display device may include a shielding layer to help the human viewer limit his field of view to the screen.

[0125] The rate of presentation of each word is such a characteristic: it can be predetermined, or it can be changed from a predetermined initial rate according to a predetermined adjustment rate. Generally, the longer the human uses the mechanism, the faster the presentation rate is, or the preset rate is faster than the average reading rate of a specific group of people similar to the person using the mechanism. In one embodiment, the rate may increase at the beginning and decrease near the end of the text material source to be presented to the human user (for example, the text material source in one or more pages of the document of predetermined training information). The rate can be expressed as the number of words per minute, but this is only an indicator that is easiest for human users to understand. The mechanism measures the rate in terms of the number of characters that appear in a specified time in a human-readable character or structured character set or symbol presented per minute or per second. In an embodiment, it can be presented like this: at the beginning of the document, the words are presented at a rate starting from 220 words per minute and then increasing to 1500 words per minute, and then gradually reducing the speed, such as from 1500 words per minute to 220 words per minute at the end of the document. Of course, in one embodiment, human users can choose the text display rate that they are most suitable for reading. However, controlling the rate through the mechanism can challenge human users to challenge their abilities.

[0126] In one form of the mechanism, the font size can be an initially predetermined size. Since the size of the visual presentation device is related to the configuration and position of the device relative to the human user, the text size is related to the visual presentation device and its environment. In one embodiment, the relative font sizes are small, medium, and large. In one embodiment, the font size can be changed during the presentation of the visual information. This variability will enhance the maintenance of the human user's attention to the visual information. The human user can select the text size that best suits their reading.

[0127] In one form of the mechanism, since there are multiple fonts, the type of font can be predetermined. To improve usability for people with dyslexia, in one embodiment of the font selection option, the OpenDyslexic font can be used. In one embodiment, human users can select the type of font that they are most comfortable reading.

[0128] In one form of the mechanism, the type of movement of text within the field of view of a human user can be predetermined. In one embodiment, the text moves within the field of view of a human user, and the presentation includes human-readable characters or a structured character set that appear to move within the field of view of the human. This movement will be perceived as: the position of the text within the field of view of the human user is closer to the human perception position and farther away from the person. The human user can select the movement speed that best suits their reading. The text size can also be adjusted, and the human user can select the text that best suits their reading.

[0129] In one approach of the agency, the presentation of the text gives a human user the impression that the text is moving forward through the corridor display background ( Figures 26 to 41 (excluding Fig. 22 ) provides illustrations of different variations of this setup), and the greater the words per minute display rate, the greater the distance moved. Grabbing the user's attention through the illustration of a corridor is just one of a range of visual display techniques, which can include using images that mimic corridor-like environments, such as skiers sliding down a snowy hillside, rucking their way on snow-covered slopes or between obstacles such as trees. A further visual display could be the lines a swimmer sees as he or she swims through an endless pool lane. It could also be a never-ending walking trail through a forest or bush. Human users can choose the speed of movement that they are most comfortable reading. Text size can also be adjusted, and human users can choose text that they are most comfortable reading when presented at a higher rate than they normally read.

[0130] In one form of the mechanism, the movement of text within the field of view of a human user may be predetermined. In one embodiment, the text moves within the field of view of a human user, and the presentation includes human-readable characters or a structured character set appearing to move within the field of view from a human-perceived position to one side of the human and then to the other side of the human-perceived position. Figure 6 A word location process flow chart is shown that handles the location of words within the user's field of view. The disclosed embodiment is one of many text variations presented to the user. Another variation is to move the text so that it flows from one side to the other. The movement can be gradual. For example, there are 20 independent movement increments from one side to the other.

[0131] Moreover, for example, the flow can appear continuous to the user, which is achieved by multiple small movements, which are perceived by human users as continuous movement, although in fact, these small movements are multiple such small movements: its rate makes it impossible for humans to perceive the actual position change as non-continuous. The movement of the text is described as from one side to the other, but in order to adapt to some cultures, the text moves from the top of the field of view to the bottom. In one embodiment, the presentation of the text gives the human user the impression that the text moves from one word to the next word within their field of view. Thus, for example, the first word is located at the lower left of the field of view and the second word is located in the center of the field of view. The third word is located at the upper right of the user's field of view - the subsequent words are displayed at a greater rate, and the number of words displayed per minute is more than the words encountered by the user before, whether before or after using the mechanism for a period of time. Alternatively, the degree and rate of subsequent word presentation can replicate the rapid eye movement (REM) sleep cycle rate. Human users can choose the degree and higher rate of subsequent word presentation that they are most comfortable reading in this new reading mechanism and environment.

[0132] In one form of the mechanism, at least one human auditory presentation device has a configuration that directs non-verbal auditory presentation information specifically to a person's ear in the form of a non-verbal auditory signal. For example, a human auditory presentation device that employs one or more non-verbal auditory signals is used, wherein the timing of each human-readable character or structured character set is coordinated with the presentation of at least one predetermined non-verbal auditory signal. In one embodiment, this coordination enables the predetermined text and the predetermined audio signal to be viewed as complementary and potentially helpful for learning and cognition by a human user. The transition of these elements from one element to another may be predetermined or provided simultaneously (in a variety of forms) to suit or be controlled by the user.

[0133] In one approach, the human auditory presentation device includes two audio transducers to convert electrical energy into mechanical energy exposed to air. A speaker of suitable size and transducer power capacity can be used directly to provide the non-verbal auditory signal used by the device. The speaker may need to be mounted in a jacket that covers the ears of the human user. The speaker can be independent. As with a virtual reality headset or headphones, the speaker can have wireless communication capabilities. The nature of the intended use of the non-verbal auditory signal is related to the setting of the session to be used by the person. The type of non-verbal auditory signal selected depends on the needs of the human user during the session. For example, if a person suffers from post-traumatic stress disorder, the frequency of the monophonic signal will be set within a range that is known to have the desired beneficial psychological effect.

[0134] In one embodiment, each predetermined non-verbal auditory signal is a continuous signal of a predetermined frequency or frequencies and is transmitted to the left and right ears as sound waves converted by corresponding speakers. In one embodiment, the sound waves have a predetermined frequency. In an embodiment, the frequency depends on a predetermined number of words displayed per minute. In one embodiment, the higher the frequency, the more words are displayed per minute.

[0135] These frequencies include binaural beats or low frequency sine waves designed to induce / replicate deep sleep, REM sleep, relaxation, focus, and the resulting aided cognition.

[0136] In one embodiment, the frequencies include: 111 Hz, which is the 11th harmonic of the earth's resonance frequency; the Schauman resonance, 7.83 Hz; and predetermined frequencies F1 to F14.

[0137] Although left and right ears are noted below, the reverse can also be used.

[0138] left ear

[0139] F1=111 Hz

[0140] Right ear

[0141] F4=122F5=125F6=128F7=131F8=134F9=137F10=140F11=143F12=146F13=149F14=152F14

[0142] In one form of the mechanism, the voiceover reads the text at a targeted number of words per minute. In one embodiment, the voiceover runs at a rate of between 100 wpm and 1000 wpm in increments. In one embodiment, the increment is 24 words per minute. In one embodiment, the human user can configure the voice to select the language, gender, or accent of the voiceover.

[0143] In one mode of the mechanism, background emotional sounds can be added. In one embodiment, sounds derived from or representing sounds from running water, waterfalls, rain forests and other sources can occur simultaneously with any one of the one or more embodiments described herein. In one embodiment, a human user can indicate a desire to provide an audio environment that may be relaxing. In one embodiment, there can be a predetermined audio signal that replicates or replays recordings of waves on a different location such as a rain forest, waterfall, stream, beach or underwater diving. In one embodiment, it can be provided before and after a reading arrangement.

[0144] In one approach, the mechanism includes a mechanism for encouraging a human user to use the mechanism with their eyes maximally dilated (eyes wide open state). The user is prompted to open their eyes as wide as possible. This is to replicate a fear state and prompt a fight or flight response to increase concentration.

[0145] In one aspect of the mechanism, there is an option for a human user to highlight a portion of text that they wish to mark for future reference. In one embodiment, the mechanism may retain the highlighted portion for future reference and possible reuse by the mechanism. Implementing such functionality may involve operation of a separate trigger (operable by a human user - touch, voice, physical switch, etc.) that is turned on during display of text of interest and turned off when the human user is not interested.

[0146] In one aspect of the mechanism, there is a display mode called raised eye level. In one embodiment, the mechanism may provide a configurable option to enable or disable this feature point. If enabled, the text / information will always be displayed at an angle between 10 degrees and 45 degrees from the horizontal eye level of the human user. This mechanism encourages the human user to raise his head to clearly read the visual information in an immersive environment. Implementing such a feature may involve operating a VR device with head tracking capabilities.

[0147] One of the mechanisms is a learning calendar that includes a predetermined schedule for revising previous texts or notes to help human users retain more of previous learning. In addition, intervals for instruction using the mechanism can be planned, and compliance with the instructed curriculum can be tracked.

[0148] In one approach of the mechanism, the visualization tool creates a dissociated learning state in a human user. In one embodiment of the teaching of this method, an animation is shown in the field of view showing a person (not unlike a human user) absorbing knowledge from a conversation. For example, an animation can be used to demonstrate a person reading from the side. The image is intended to prompt the user to imagine that they are reading from an out-of-body perspective, which helps to calm the user and focus on the text. In a similar embodiment, an image or short video animation of a trapdoor on or in the head of an animated character is used to illustrate that the top of the head opens like a trapdoor and information flows into the head in the form of text. In one embodiment, the visualization trapdoor is provided in an animation showing the top of a person's head opening like a trapdoor, and the visualization information flows into the opening and into the head. This image is intended to provide the user with a sense of being in a learning state of mind because this animated image will enhance the user's attention. Animation is described here, but it can be real-time or real-time video, and visual effects are applied in post-production of the real-time video for enhancement.

[0149] In one approach of the organization, a learning session is divided into a random number of sub-learning sessions by creating rest periods between the sub-sessions. In one embodiment, each sub-learning session can start and end automatically with an accelerated number of words per minute, see Fig.53 . The predefined configuration determines the duration of each sub-learning session. By way of example only, for each 7 to 10 minute learning sub-session, the user may be provided with a break of 30 to 60 seconds. In one embodiment, during the break, the visual signal is a black screen and may be silent, or there is at least one human auditory presentation device that is configured to specifically direct predetermined non-verbal auditory presentation information to at least one human ear in the form of a non-verbal auditory signal. In one embodiment, the audio signal is monophonic or binaural, or a combination of two tones or a monophonic tone is provided to the human ear.

[0150] Fig.54 The calibration and setup process for a head mounted virtual reality device is shown, showing adjustments that may need to be made if a user has a visual blind spot. The diagram is an example only, and the size and possible shape of the blind spot will vary from user to user. The location of the blind spot will also vary from user to user, and compensation for the blind spot may include moving the test and other images into the field of view reserved for the user.

[0151] A human sensory information presentation mechanism for presenting sensory information to at least one person is disclosed herein. It includes a memory controller and a central processing unit, which is programmed to provide sensory presentation information. Fig.56 One of many possible embodiments is shown. Fig.56 A client server cloud architecture is shown. One function to be performed is to collect and store documents that will form the basis for visually presenting information to at least one person, as shown when uploading the recording process described herein. Fig.56 In one embodiment of the human sensory information presentation mechanism shown, the client-server cloud architecture provides access to one or more stored documents through an application server, which can be located anywhere and the document storage can also be located anywhere. In one embodiment, a user-controlled client device sends a request to the application server, which is authorized based on a software-as-a-service agreement between the user (or a designated third party) to provide a learning session to the client device. The client device can be a mobile phone, tablet computer, personal computer, computer server, and various other devices. These devices have screen and audio output capabilities. In the disclosed embodiment, the learning session is transmitted to a virtual reality headset ( Fig.55), wherein the embedded sensor provides sensor signals to a user client, which can run a local session of the learning session or to an application server, which adjusts the delivery of the learning session according to various mechanisms generally disclosed in this document, such as raising the user's line of sight. In one embodiment, the application server includes a controller having a memory and a central processing unit, which is programmed to provide sensory presentation information to at least one human visual presentation device in this embodiment through a client device. In one embodiment, the virtual reality head-mounted device is configured to direct the visual presentation information exclusively to a human user. However, multiple users may wear multiple virtual reality head-mounted devices simultaneously to provide the same session.

[0152] In one approach, the visual and auditory presentation of information is used to support visually impaired users. In one embodiment, users with the vision-impairing disease macular degeneration will be able to use the capabilities of a virtual reality headset to Fig.54 The setup calibration process shown. Using the setup process, the user can provide a tangible indication of where in the user's field of view the perceived area is reduced. The mechanism can ensure that the presentation avoids using that or those areas, thereby maximizing the available area of ​​the user's field of view.

[0153] Fig.57 Described is the use of sound processing techniques to make sounds appear to be coming from a source far from the user at any time, as shown in the figure, in front of, above, and behind the user at any time. However, the perceived sound source can be located anywhere relative to the user, and the illustration of a distance of 30 centimeters is only an example. Techniques for generating the required sound signals to produce the desired results are known to those skilled in the art. The present embodiment provides a technique for focusing the user's attention while providing the sounds and images described herein in various forms.

[0154] Figures 1 to 57 Each of the figures in the drawings includes details of various embodiments. However, the embodiments shown are not the only embodiments of the elements disclosed in these figures. Each feature disclosed has multiple combinations, which are not shown, but various combinations are taught, providing a basis for using different combinations. Moreover, different combinations may be beneficial to one or more users. As the development process is implemented and used by various users with different acuity and cognitive abilities, some combinations will be more effective than other combinations. It is expected that some users will also benefit from using the disclosed devices and methods. Therefore, those users with increasing abilities may need different learning stimuli and information to make further progress, which involves other combinations of the disclosed elements. Then, the technology disclosed and taught herein will also be applied to fields that have not yet been thought of.

Claims

1. A human sensory information presentation mechanism, for presenting sensory information to a person, the mechanism comprising: a controller including a memory and a central processing unit, the controller being programmed to provide human visual and auditory presentation information including at least visual information and non-verbal auditory signals; at least one human visual presentation device for receiving visual information from the controller, the visual presentation device having a configuration for displaying the received visual presentation information exclusively to the one person within a predetermined field of view, wherein the visual information comprises at least one or more human-readable characters or structured character sets from a predetermined alphabet and a predetermined set of digits to form human-readable words or digits, one character or one structured character set being presented at a time; and at least one human auditory presentation device for receiving non-verbal auditory signals from the controller, the human auditory presentation device being configured to direct the non-verbal auditory signals specifically to the one person, the non-verbal auditory signals comprising one or more non-verbal auditory signals, Wherein, the controller presents each human-readable character or structured character set and simultaneously presents at least one predetermined non-verbal auditory signal.

2. The human sensory information presentation mechanism according to claim 1, wherein: The human readable characters or structured character set are presented by the visual presentation means to contrast with a predetermined background color also presented by the visual presentation means.

3. A human sensory information presentation mechanism as claimed in any preceding claim, wherein: The visual presentation of human-readable characters or structured character sets includes one or more of the following groups: predetermined colors for one or more human-readable characters or structured character sets; groupings of human-readable characters or structured character sets of different colors; human-readable characters or structured character sets that appear to move in front of a person viewing the presentation.

4. A human sensory information presentation mechanism as claimed in any preceding claim, wherein: The predetermined color is used for a predetermined word and contrasts with other predetermined colors that are different from the predetermined color of the predetermined word.

5. A human sensory information presentation mechanism as claimed in any preceding claim, wherein: When a series of presented words form a human-readable phrase or a human-readable sentence, a plurality of predetermined colors are used.

6. A human sensory information presentation mechanism as claimed in any preceding claim, wherein: The visual presentation includes human-readable characters or structured character sets that appear to move toward the person and then away from the person within the person's field of vision, wherein the movement occurs just as each consecutive human-readable character or structured character set appears, or the movement occurs over the course of a consecutive human-readable character or structured character set.

7. A human sensory information presentation mechanism as claimed in any preceding claim, wherein: The rate at which the human-readable characters or structured character set is presented to the person is variable based on an initial predetermined rate.

8. A human sensory information presentation mechanism as claimed in any preceding claim, wherein: The font size of the successive presentations of the human-readable characters or structured character set presented to the person is variable based on the initial predetermined font size.

9. A human sensory information presentation mechanism as claimed in any preceding claim, wherein: The successive presentations of human-readable characters or structured character sets presented to the person are accompanied by an image of a trapdoor into which previous human-readable characters or structured character sets presented to the person appear to enter and disappear.

10. A human sensory information presentation mechanism as claimed in any preceding claim, wherein: The successive presentations of human-readable characters or structured sets of characters presented to the person are accompanied by an image of a moving corridor in which previous human-readable characters or structured sets of characters presented to the person appear to enter and disappear.

11. A human sensory information presentation mechanism as claimed in any preceding claim, wherein: The one or more human-readable characters or structured character sets are presented repeatedly while the human-readable characters or structured character sets are presented continuously to the person.

12. A human sensory information presentation mechanism as claimed in any preceding claim, wherein: Each predetermined non-verbal auditory signal is continuous during presentation of the human-readable characters or structured character set and during intervals between consecutive presentations of the human-readable characters or structured character set.

13. A human sensory information presentation mechanism as claimed in any preceding claim, wherein: One predetermined non-speech auditory signal is monophonic and different from another predetermined non-speech auditory signal which is monophonic, both of which are independently provided to the person by the human auditory presentation device.

14. A human sensory information presentation mechanism as claimed in any preceding claim, wherein: The predetermined non-verbal auditory signal is binaural and provided to each ear of the person.

15. A human sensory information presentation mechanism as claimed in any preceding claim, wherein: The predetermined non-verbal auditory signal is a combination of two tones, and a monaural tone is provided to both ears of the person.

16. A human sensory information presentation mechanism as claimed in any preceding claim, wherein: The predetermined non-verbal auditory signal is an isochronous tone.

17. The human sensory information presentation mechanism according to claim 16, wherein: The isochronous tones have predetermined pitches and predetermined intervals.

18. The human sensory information presentation mechanism according to claim 1, wherein: At least one human auditory presentation device for receiving non-verbal auditory signals from the controller also includes a transducer for converting electrical energy representing the non-verbal auditory signals controlled and provided by the controller into mechanical energy to vibrate the surrounding air. The transducer is located near the ear of the person, and the received vibrated air is a manifestation of the non-verbal auditory signal.

19. The human sensory information presentation mechanism according to claim 17, wherein: At least one human auditory presentation device also includes a housing having a transducer located within the housing, wherein the housing is used to direct sound generated by the non-speech auditory transducer into a human ear.

20. A human sensory information presentation mechanism as claimed in any preceding claim, wherein: The presentation of the human-readable characters or structured character set is coordinated with the presentation of predetermined non-verbal auditory signals through an application programming interface executed by the controller.

21. A human sensory information presentation mechanism as claimed in any preceding claim, wherein: The human visual presentation device comprises one video signal presentation screen or two video signal presentation screens extending at least to the boundary of the human visual field.

22. A human sensory information presentation system, comprising: a computer server having a computer server memory and a central processing unit for providing visual and non-verbal auditory presentation information from said computer server memory; a computer device having a digital signal receiving mechanism, a computer device memory, and a central processing unit, the central processing unit being operable to store an application programming interface in the computer device memory and to execute the application programming interface, the computer device being operable to receive and process visual and non-verbal auditory presentation information provided by the computer server; as well as at least one human visual presentation device for receiving visual presentation information from said computer device, said visual presentation device having a configuration for exclusively displaying the received visual presentation information to said one human user within a predetermined field of view, wherein said visual information comprises at least one or more human-readable characters or structured character sets from a predetermined alphabet and a predetermined number set to form human-readable words or numbers, one character or one structured character set being presented at a time; and and at least one human auditory presentation device for receiving non-verbal auditory signals from the computer device, the human auditory presentation device being configured to direct the non-verbal auditory signals specifically to the one human user, the non-verbal auditory signals comprising one or more non-verbal auditory signals, wherein the computer device presents each human-readable character or structured character set and simultaneously presents at least one predetermined non-verbal auditory signal.

23. The human sensory information presentation system as claimed in claim 22, wherein: The visual presentation information is provided to the computer server for use and stored in the computer server memory.

24. The human sensory information presentation system according to claim 22, wherein: The central processor parses visual presentation information stored in a computer server memory, the visual presentation information being partitioned to identify words and sentences or subsets of complete sentences using one or more text spacing elements or punctuation marks as delimiters of words or sentences or subsets of complete sentences.