Method and apparatus for enhancing human cognitive ability

Abstract

According to the present disclosure, there is provided a human sensory information presentation device for presenting sensory information to a human, comprising: a control device including a central processing unit and a memory programmed to enable visual presentation information and auditory presentation information presented to the human, including at least visual information and non-verbal auditory signals; a human visual information presentation device configured to receive the visual presentation information from the control device and display the received visual presentation information only within a predetermined visual field of one human; and a human auditory information presentation device configured to receive the non-verbal auditory signal from the control device and present the received non-verbal auditory signal only to one human, wherein the control device is configured to control so as to present each of characters readable by a human, which is the visual presentation information, or a systematic character set, simultaneously with at least one predetermined non-verbal auditory signal, which is the auditory presentation information.

Description

Technical Field

[0001] The field of the present disclosure is methods, devices, and systems for enhancing human cognitive abilities, i.e., mental activities and thinking processes for acquiring and understanding knowledge through thinking, experience, and sensation.

Background Art

[0002] Humans learn to survive and mostly grow in their environment. The act of learning is multifaceted, and the field of cognitive neuropsychology has evolved from the initial understanding that humans act in their environment and respond to it mainly in predictable ways. However, even if there is a statistical normal distribution in the way humans receive, process, and construct the relationship between the events they have recognized and the knowledge related to them, learning is not the same process for all humans. The ability to remember an event and to recall it and understand what it means in the context of past or future events is a very human characteristic.

[0003] Perception forms the core of learning, and most humans are equipped with five senses (taste, smell, vision, touch, hearing), which facilitates the observation and cognition of the human environment. However, not all humans can use each of the five senses equally well.

[0004] Many studies have shown that some humans are visual learners. Visual learners first look with their eyes and then understand and execute. Those who are not visual learners need to be taught. Alternatively, they need both to be taught and to be shown what to do. When touch is involved, some people use touch better than others. Also, when taste and smell are involved, some people have an advantage in either or both of these sensory inputs for associating them with concepts and facts.

[0005] Some people, consciously or unconsciously, suppress or weaken their understanding of their own cognition. Therefore, the recollection of sensory experiences is influenced by psychological problems common to humans and psychological problems specific to individuals.

[0006] Learning is one of the multiple outputs obtained when sensory input is given to the human brain. Sensory input continues throughout waking hours and may also be perceived during sleep. First, the human sensory input mechanism converts sensory input into perceptual information. After some processing, all or part of this information is stored in memory locations. Then, the brain uses the available information and sometimes the still incoming perceived sensory input to exercise its inferential ability. Through inference, it becomes possible to use the vast amount of information stored. The logical processing of this information is an example of the thinking and cognitive abilities of the human brain that contribute to learning.

[0007] The study of how humans learn is a very interesting field. It is fundamental in human experience and becomes even more important when one needs to pass a test, be considered qualified to practice a skill, or learn in order to work safely and responsibly within an environment. There are many other fields where human effort is required, and the fact that humans accept and learn new information in their work and private lives means that improving the way humans learn benefits themselves and others. How humans perceive information is extremely important for the effectiveness of learning from that information.

[0008] However, in the learning process, it is common for only one of the human senses to be involved at a time. This restricts the learning ability of most humans. When multiple senses are involved, one sensory input is often impaired by the simultaneous reception of other sensory inputs. There is room for improvement in the presentation of visual and auditory sensory inputs to humans in order to achieve more effective information retention and cognition than with conventional approaches. Summary of the Invention Means for Solving the Problems

[0009] In one aspect of the present disclosure, a human sensory information presentation device for presenting sensory information to a human is provided. The human sensory information presentation device of the present disclosure includes a control device including a central processing unit and a memory programmed to enable the use of visual presentation information and auditory presentation information presented to a human including at least visual information and non-verbal auditory signals, at least one human visual information presentation device that receives visual presentation information from the control device and is configured to display the received visual presentation information only within a predetermined visual field of one human, the visual presentation information including at least one or more characters or a systematic character set composed of a predetermined alphabet and predetermined numbers set to form words or numbers readable by a human, and presenting one character or one systematic character set at a time, the human visual information presentation device; and at least one human auditory information presentation device that receives non-verbal auditory signals from the control device and is configured to present the received non-verbal auditory signals only to one human, the non-verbal auditory signals including one or more non-verbal auditory signals, the human auditory information presentation device. The control device controls each of the characters or systematic character sets readable by a human to be presented simultaneously with at least one predetermined non-verbal auditory signal.

[0010] In one aspect, the characters or systematic character sets readable by a human presented by the human visual information presentation device are presented in contrast to a predetermined background color presented by the human visual information presentation device.

[0011] In one aspect, the visual presentation of the characters or systematic character sets readable by a human includes one or more of the group consisting of displaying the characters or systematic character sets readable by a human in one or more predetermined colors, grouping the characters or systematic character sets readable by a human in different colors from each other, and adjusting the visual presentation of the characters or systematic character sets readable by a human to appear to move in front of the human viewing the visual presentation of the characters or systematic character sets readable by a human.

[0012] In one aspect, a predetermined color is used for the display of a predetermined word, and the word is presented in contrast to a predetermined background color that is different from the color used for the word.

[0013] In one aspect, when a series of presented words form a human-readable phrase or a human-readable sentence, a predetermined color is used for the display of the words.

[0014] In one aspect, the predetermination of a color palette, words, phrases, sentences, or font sizes includes the use of a library of such elements that can be used to supply the necessary elements. Thus, for example, when using a specific color palette suitable for users with autism, the color palette is pre-determined by the input provided at the start of the user session and made from the available options recorded and used by a server computer or a local processor. Similarly, a predetermined color is used for the presentation of visual information of text and background. In another example, when the words are pre-determined, the words are supplied from the memory associated with a computer server or a local processor. The source is the result of the analysis of the source information to be presented during the session, and the selection of the source, i.e., the visual information, is presented at the start of the session for a human user, a safety course attendee, or a person who wants to read a specific book, etc., for learning during the session. Similarly, predetermined phrases, sentences, or font sizes are used. The font sizes described later can be pre-set to suit a specific person with vision problems.

[0015] In one aspect, the visual presentation information includes human-readable characters or a systematic character set that appears to move away from a human after approaching the human within the human's field of vision, and the movement of the human-readable characters or the systematic character set is performed during or at the time of continuous presentation of the human-readable characters or the systematic character set.

[0016] In one aspect, the speed of continuous presentation of human-readable characters or a systematic character set presented to a human can be changed from an initial predetermined speed.

[0017] In one aspect, the font size of the continuous presentation of human-readable characters or a systematic character set presented to a human can be changed from an initial predetermined font size.

[0018] In one aspect, the continuous presentation of human-readable characters or a systematic character set presented to a human is presented together with an image of a trapdoor, and the previously presented human-readable characters or systematic character set are displayed as if they enter the trapdoor and disappear.

[0019] In one aspect, the continuous presentation of human-readable characters or a systematic character set presented to a human is presented together with an image of a moving corridor, and the previously presented human-readable characters or systematic character set are displayed as if they enter the corridor and disappear.

[0020] In one aspect, the continuous presentation of human-readable characters or a systematic character set presented to a human is repeated one or more times.

[0021] In one aspect, a predetermined non-verbal auditory signal is continuously presented during the presentation of human-readable characters or a systematic character set, or during the continuous presentation of human-readable characters or a systematic character set.

[0022] In one aspect, a predetermined non-verbal auditory signal is monaural and different from another monaural predetermined non-verbal auditory signal, and both are provided to a human independently of each other by the human auditory information presentation device.

[0023] In one aspect, a predetermined non-verbal auditory signal is binaural and provided to each of a human's two ears.

[0024] In one aspect, a predetermined non-verbal auditory signal is a combination of two tones, and the monaural tones are provided to both ears of a human.

[0025] In one aspect, a predetermined non-verbal auditory signal is an isochronous tone. In one aspect, the isochronous tone has a predetermined pitch and a predetermined interval. In one aspect, at least one human auditory information presenting device that receives a non-verbal auditory signal from a control device includes a transducer that converts electrical energy representing the non-verbal auditory signal controlled and provided by the control device into mechanical energy for vibrating the surrounding air, and the transducer is disposed near a human ear and presents the non-verbal auditory signal by the vibrating air.

[0026] In one aspect, at least one human auditory information presenting device further includes a housing that houses the transducer, and the housing is configured to provide the sound generated by the transducer to a human ear.

[0027] In one aspect, the presentation of characters readable by humans or a systematic character set is performed in cooperation with the presentation of a predetermined non-verbal auditory signal by an application programming interface executed by a control device.

[0028] In one aspect, a human visual information presenting device includes one or two video signal presenting screens that extend at least to the boundaries of a human field of view.

[0029] In one aspect of the present disclosure, a human sensory information presentation system is provided. The human sensory information presentation system of the present disclosure includes a computer server having a computer server memory and a central processing unit configured to make visual presentation information and non-verbal auditory presentation information available from the computer server memory, a digital signal receiving device, a computer device memory, and an application programming interface stored in the computer device memory and configured to receive and process the visual presentation information and non-verbal auditory presentation information made available by the computer server, and a central processing unit configured to execute the application programming interface. The human sensory information presentation system further includes at least one human visual information presentation device that receives visual presentation information from the computer device and is configured to display the received visual presentation information only within a predetermined visual field of a single human. The visual presentation information includes at least one or more human-readable characters or a systematic character set formed from a predetermined alphabet and predetermined numbers set to form words or numbers that can be read by humans, and presents one character or one systematic character set at a time. The human sensory information presentation system also includes at least one human auditory information presentation device that receives a non-verbal auditory signal from the computer device and is configured to present the received non-verbal auditory signal only to a single human. The non-verbal auditory signal includes one or more non-verbal auditory signals. The computer device is controlled to present each of the human-readable characters or systematic character sets simultaneously with at least one predetermined non-verbal auditory signal.

[0030] In one aspect, the visual presentation information is available on the computer server and is stored in the memory of the computer server.

[0031] In one aspect, the central processing unit analyzes the visual presentation information stored in the partitioned computer server memory and uses one or more text interval elements or punctuation marks as delimiters for words or sentences or subsets of complete sentences to identify words or sentences or subsets of complete sentences.

[0032] The systems, methods, and apparatuses disclosed herein are intended, at least in part, to provide an alternative to currently available systems and to mitigate or minimize problems and drawbacks of currently available systems.

[0033] References to prior art herein do not suggest, and are not to be taken as an admission, that such prior art is part of the common general knowledge.

[0034] Unless the context requires otherwise, throughout this specification and the claims, the words “comprise”, “include” and variations such as “comprising” and “including” are to be interpreted as including the recited integer or group of integers but not excluding any other integer or group of integers. The terms “a” and “the” are to be interpreted as meaning “one or more” unless the context clearly dictates otherwise.

[0035] Those skilled in the art will understand that the present disclosure is not limited to the particular applications described herein. Nor is the present disclosure limited to the preferred embodiments with respect to the elements and features described or illustrated herein. It should be understood that the scope of the present disclosure is not limited to the embodiments described herein, but various rearrangements, modifications, and substitutions are possible without departing from the scope defined and claimed herein.

[0036] Some embodiments of the present disclosure can be implemented using program elements (often referred to as modules or components, although other names may be used). Such program elements include programs, subroutines, portions of programs, software components, or hardware components that can execute one or more of the tasks or functions described herein. As used herein, a module or component can exist on a hardware component independently of other modules / components. Alternatively, a module / component can be a shared element or process of other modules / components, programs, or machines. A module or component can exist on a single machine such as a client or computer server. A module / component can be distributed among multiple machines such as multiple client or computer server machines. The system of the present disclosure can be implemented in whole or in part on a computer server or as part of a network service. Alternatively, the system of the present disclosure can be implemented in whole or in part on a local computer, terminal, or server. In any case, implementation of the system of the present disclosure requires the use of memory, a processor, and network resources (including data ports and signal lines (optical, electrical, and other communication forms)) unless otherwise specified.

[0037] Some embodiments of the present disclosure generally require a computer that includes processing and memory resources. For example, the systems of the present disclosure may be implemented on a server or a network. Such a computer server may be connected to and used by a user via a network such as the Internet, or by a combination of networks such as a cellular phone network and the Internet. Alternatively, one or more embodiments of the present disclosure may be implemented locally, in whole or in part, on a computer machine such as a desktop, cellular phone, personal digital assistant, or laptop computer. Thus, memory, processing, and network resources may be used in connection with the establishment, use, or implementation of any embodiment of the present disclosure (including the implementation of any method or any system).

[0038] Furthermore, some embodiments of the present disclosure may be implemented using instructions executable by one or more processors. These instructions may be stored on a computer-readable medium. The illustrated computer machine provides an example of a processing resource and a computer-readable medium that can execute instructions for implementing embodiments of the present disclosure. A number of computer machines associated with one or more embodiments include a processor and various forms of memory for holding data and instructions. Examples of computer-readable media include permanent storage devices such as hard drives on personal computers or computer servers. Other examples of computer-readable media include portable storage devices such as CD devices and DVD devices, flash memory incorporated in many cellular phones and personal digital assistants (PDAs), and magnetic memory. Computers, terminals, and network-enabled devices (e.g., mobile devices such as cellular phones) are all examples of processors and devices. Instructions are typically stored on a temporary or non-temporary computer-readable medium such as RAM, ROM, and EPROM devices.

[0039] This disclosure can be implemented in various ways, for example, in a process, an apparatus, a system, a computer-readable medium (e.g., a computer-readable storage medium), or a computer network through which program instructions are transmitted via a wireless, optical, or electronic communication link. It should be noted that the order of steps in the process of this disclosure may be changed within the scope of this disclosure.

[0040] Details regarding computers, computer networks, software programming, telecommunications, etc. are not explicitly illustrated because it is determined that they are not necessary for obtaining a complete understanding or for limiting those skilled in the art from implementing the embodiments of this disclosure, but they are considered to exist as they are within the technical scope of those skilled in the art.

[0041] In the foregoing summary, a simplified selection of concepts that will be further explained in the detailed description of the embodiments to be described later is introduced. This summary is not intended to identify all or any of the main or essential features of the subject matter recited in the claims.

[0042] Those skilled in the art will understand that this disclosure is not limited to the specific applications described herein. Also, this disclosure is not limited to the preferred embodiments regarding the specific elements and features described herein. It should be understood that this disclosure is not limited to the embodiments described herein, and various reconfigurations, modifications, and substitutions are possible without departing from the scope described herein.

Brief Description of the Drawings

[0043]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

Figure 27

Figure 28

Figure 29

Figure 30

Figure 31

Figure 32

Figure 33

Figure 34

Figure 35

Figure 36

Figure 37

Figure 38

Figure 39

Figure 40

Figure 41

Figure 42

Figure 43

Figure 44

Figure 45

Figure 46

Figure 47

Figure 48

Figure 49

Figure 50

Figure 51

Figure 52

Figure 53

Figure 54

Figure 55

Figure 56

Figure 57

DETAILED DESCRIPTION OF THE INVENTION

[0044] The methods, apparatuses, and systems of the present disclosure include visual and non-verbal auditory devices for use, for example, in training personnel working in hazardous environments. Additionally, aspects of the systems of the present disclosure can be used, either alone or in combination therapies, for the treatment and management of post-traumatic stress disorder (PTSD), anxiety, attention deficit hyperactivity disorder (ADHD), autism, dyslexia, and other neurological disorders, and can also be used to facilitate the learning of knowledge typically acquired through reading by students and professionals. Other applicable fields include gaming, retail, sports, and any learning or training environment.

[0045] The composition of elements and features includes vision. Such things include, but are not limited to, the use of a contrasting color / selected color palette considering dyslexia and color vision abnormalities, human-readable text or a systematic character set (hereinafter referred to as text or words) and background colorization, timing and movement (mainly of text on a visual presentation device), the use of desensitization and reprocessing of eye movements, and the use of the perceived forward movement of text when looking at text. Additionally, in one embodiment, a part of the composition is adapted to provide an immersive and sensually focused environment for one or more humans using the composition. In one embodiment, a systematic character set can form words known in a dictionary of words created from the alphabet of interest. Alternatively, a systematic character set can represent acronyms, colloquialisms, or words not yet listed in the dictionary. In scientific or engineering documents, a systematic character set can be an equation or an abbreviated form of a known longer form abbreviation. A systematic character set can be characters or numbers of another alphabet or language. In some cases, translation or conversion of some systematic character sets may be required to make it easier for the user to understand.

[0046] Also, the composition of elements and features includes auditory cues such as those that convert text to speech, binaural beats embedded in speech that describes the displayed text, background binaural beats, and a specific use of hearing a 111 Hz sound in the left ear. In contrast, the right ear delivers pulsations within a selected band that affect a human in each of a range of states such as relaxation (other appropriate specific frequencies can be used), rapid eye movement, concentration, and states corresponding to high levels of immersion. The auditory cues of the present disclosure described above are provided with or without one or more of the auditory cues described above during a preparatory stage intermediate to the start and end of the process. Similarly thereafter, this process enables a human to process text information perceived, but is an embodiment not applicable to cues that convert text to speech.

[0047] References to characters or systematic character sets that are human-readable include, but are not limited to, characters that are subsets of the corresponding alphabet. A character or systematic character set represents a single character, word, or collective character symbol or has a known meaning. Also, a systematic character set represents a word with a known meaning. Alternatively, a systematic character set collectively represents an image with a known meaning. Sometimes, the immediately preceding or following character or systematic character set may contribute to the meaning of the character or systematic character set presented to a human. Visual information is a character that a human can read or a systematic character set of one or more alphabets.

[0048] The methods, apparatuses, and systems of the present disclosure create configurations on a scale from the minimum essential cues that affect the people using their configurations to the combination of cues delivered to selected humans or groups of humans of a particular type. Note that there may be variations depending on the type of user or the type of users within the group.

[0049] The generation and control of visual cues and auditory cues are under computer control, such as a computer server and related application programming interfaces, which are transmitted from a cloud-based computing environment and accessible to users who can utilize software as a service (SaaS) as a service based on time and specific purposes. A user can provide a source text library or an image library. Alternatively, there may be a preselected text library and image library that are part of the available services.

[0050] An isochronic tone is a single tone that is repeatedly turned on and off at regular intervals and presented to a listener. The intervals are usually short, creating beats like a rhythmic pulse. Such a sound can be embedded in other sounds such as music or natural sounds.

[0051] A binaural stereo headset has two channels and two speakers. In a stereo headset, the controls are always asymmetric. That is, two different signals are output from the two speakers at the same volume.

[0052] A binaural split headset has two completely independent channels. In addition, since each speaker has a channel independent of the other, the signals can be output independently of each other. That is, each speaker can output a different volume. Also, it is possible to provide the two signals to only one of the speakers or to both speakers, and it can be used by users who prefer or require use with one ear.

[0053] In one aspect of the configuration, visual and non-verbal auditory presentation information provides an immersive and sensually focused environment for one or more humans. This aspect is intended to remove external stimuli related to humans as much as possible to provide an immersive environment. A virtual reality (VR) headset is an embodiment of such a configuration. The VR device has a structure that isolates a human from external visual and auditory inputs and allows only predetermined visual and predetermined non-verbal auditory presentation information to be used using a dedicated visual presentation device. The visual presentation device includes, for example, one video signal presentation screen or two video signal presentation screens (a screen for each eye of a human user or a screen viewed with both eyes of a human user). One video signal presentation device includes one visual information presentation screen or two visual information presentation screens arranged within the headset and displays the received visual presentation information only to the human wearing the headset. The size of the visual information presentation screen is set to a size that allows a human wearing the headset to view within the boundaries of the human's field of vision. The headset is configured so that a human cannot see anything other than the video signal presentation device. The resolution, number of frames per second, light intensity, and data rate of the video signal presentation device are continuously improved. However, a monocular head-mounted display screen with a resolution of 3840×2160 pixels at a frame rate of 60 frames per second and a data input processing rate of 150 megabits per second, or a screen with an omnidirectional resolution of 3840×2160 (3840×1080 for each eye, arranged from top to bottom of the screen) at a frame rate of 60 frames per second and a data input processing rate of 150 megabits per second well exceeds the minimum requirements. The types of images that need to be made available in this specification to provide the source human visual presentation information of the present disclosure require much less capability than the capabilities shown. The field of vision of a human wearing a headset incorporating a video signal presentation device may be evaluated individually or may be assumed to apply to most human users.

[0054] In one embodiment, the human auditory cue device includes an ear-by-ear housing configured to provide one or more predetermined non-verbal auditory signals. At least one human non-verbal auditory cue device is configured to receive a predetermined non-verbal auditory signal from a control device. The human auditory cue device further includes a transducer that converts electrical energy representing the non-verbal auditory signal controlled and provided by the control device into mechanical energy that vibrates the surrounding air. The transducer is disposed near the human ear and converts the received non-verbal auditory signal into air vibrations. By using two human auditory cue devices, non-verbal auditory signals can be provided to both ears of a human. The human auditory cue device further includes a housing having a transducer disposed inside the case, and the housing is configured to direct the sound generated by the non-verbal auditory transducer to the human ear.

[0055] One feature, but not limited to this, is that the visual information presented to humans should be manageable. Therefore, for example, during the presentation of predetermined visual cue information such as predetermined alphabets or predetermined numbers set to form characters or numbers readable by humans, visual elements such as menus are not used. The head-mounted device for virtual reality in FIG. 55 provides an embodiment of at least one human auditory cue device configured to direct non-verbal auditory cue information in the form of non-verbal auditory signals only to one or both ears of a human wearing the head-mounted device. As an alternative, a transducer that converts an electrical signal into sound may be disposed on the temple portion of the glasses, or an earpiece (also called an earphone) of a bone conduction sound transmission device may be used.

[0056] In one aspect of this configuration, the visual presentation information is displayed to the user within the human visual field. When using a head-mounted device for virtual reality, it is displayed on the image display screen of the head-mounted device, and a vision shield and a peripheral housing are provided to collimate the visual image provided to the eyes of the human wearing the head-mounted device. The image display screen is disposed immediately adjacent to the user's eyes. Still, the human visual field is approximately 130 degrees for each eye and 180 degrees for both eyes, and the visual fields of each eye overlap by 120 degrees. As long as the visual image provided to the user is within the user's visual field, the user's visual attention is ensured. Therefore, physical barriers and screen areas limit the user's visual field. For example, by providing a sensor in the head-mounted device for virtual reality that enables the user to change the direction of the line of sight by changing the orientation of the head, the peripheral area of the visual field can be made visible. This configuration is configured to change the visual field and the user's vision with respect to the movement of the user's head to ensure that the visual information or background presented on one or more screens of the virtual reality device is always within the user's visual field.

[0057] In one aspect of this configuration, the source characters or systematic character set that can be read by a human of one or more alphabets are the result of the analysis of the source information, which means that the source character set is divided or decomposed into individual characters or sets of one or more characters or numbers. The central processing unit analyzes the visual presentation information stored in the memory of the computer server and divides it using one or more text interval elements or punctuation marks as delimiters to identify words, sentences, or subsets of complete sentences. For example, spaces, commas, semicolons, colons, quotation marks, full stops, question marks, exclamation marks, and periods are all located at the end of words, sentences, or fragments of sentences. It is also possible to divide a sentence into smaller fragments using one or more symbols. The text stream can be further divided by identifying individual words or sets of known characters, whereby, in a preferred embodiment, each fragment consisting of one word or symbol can be presented to a human one by one according to the method of the present disclosure.

[0058] For example, the information described in a book that a human needs to read and understand (usually, a human reads at their own reading pace) can be presented to the human according to the method of the present disclosure, and as a result, the book or its relevant part or a theory can be read at a speed much faster than the human's reading pace. Even in this case, the memory and understanding of the information written in the book are improved compared to the case of reading at the most comfortable pace for the user. The same applies to a human in training who needs to read information regarding a safe and responsible approach to the work performed in the work environment. Similarly, a casual reader of a novel can read the novel at a much faster speed than usual, enjoy it, and can remember and understand the details of the novel much better than the average.

[0059] In one aspect of this configuration, the color of the text or the background color for the colored text is predetermined. For example, in one embodiment, the text is white and a gray background color is used (the reverse is also possible). Further, the analyzed text can have a predetermined font and color, and these colors can be selected by the human user of this configuration from four color palettes: pastel colors; high saturation for enhancing purity, intensity, or chroma; primary colors (or secondary or tertiary colors); and grayscale. For example, each fragment consisting of one word or symbol is presented to the human user with the same color characteristics in a color tone randomly selected or selected from a predetermined color palette, and is applied to a collection or each text fragment along with a complementary and contrasting background color. In one embodiment, it can be set to display the text in a predetermined color, which can improve the text reading ability and memory of the human user, especially the user with dyslexia.

[0060] This is a way of arranging a predetermined text and a background color. Therefore, for example, by using a dark color such as black or royal blue as the background of the colored text, the eyes and mind of a human user can be focused solely on the text. This is also called hyperfocus. In one embodiment, when the human user is a disadvantaged learner (a neurodiverse learner), the background color is predetermined. Additionally, in one embodiment, this configuration can provide an option that can enable or disable features such as a solid color arranged on a visual field having a predetermined opacity that has features advantageous to neurodiverse learners.

[0061] This is an aspect of a configuration in which one character or a set of characters representing known words is displayed as text at a time. That is, the text of one word is displayed at a time. In one embodiment, a human visual presentation device (e.g., a liquid crystal display (LCD)) is configured to present the text as the only visually perceivable input within the visual field, which is the angular range of light received by each eye, by adjusting the size, placement position, and distance from the eyes of the human user. This is done with or without using a lens located between the display device and each eye or assistance by using an optical collimator that limits the field of view on each side of the physically defined area of the display device. The visual field can vary depending on the use of various configurations when the display is a personal computer (using an application program interface or a web browser), a screen remote from the computer device, a screen provided by a remote server, or a mobile phone or tablet device. The head-mounted device is configured to collimate the received visual information and provide that visual information within the human visual field. The display device can include a shield that assists in limiting the human viewer's visual field to the screen.

[0062] The presentation speed of each word is a feature that can be preset or changed from a predetermined initial speed according to a predetermined adjustment rate. Typically, the longer a human uses this configuration, the faster it becomes, or it is preset to a speed faster than the average reading speed of a specific group of humans similar to those who use this configuration. In one embodiment, the speed increases at the start when a text material (e.g., a page of a document with predetermined training information) is presented to the user and decreases as the end approaches. This speed can be expressed as the number of words per minute, but this is merely the most understandable measure for human users. In this configuration, the speed is measured in terms of the number of characters, or a systematic character set, or symbols that a human can read per minute or per second. In an embodiment, at the beginning of the document, it starts at 220 words per minute and increases up to 1500 words, and then, towards the end of the document, words can be presented at a speed that decreases, for example, from 1500 words per minute to 220 words per minute. Naturally, in one embodiment, a human user can select the most readable text display speed. Also, by being able to control the display speed by this configuration, it enables a human user to be challenged regarding their own capabilities.

[0063] In one aspect of this configuration, the font size can be a predetermined initial size. The size of the visual presentation device is related to the configuration and position of that device relative to the human user, and the text size is related to the visual presentation device and its environment. The relative font size is, in one embodiment, small, medium, and large. In one embodiment, the font size can be changed during the presentation of visual information. This variability makes it easier for a human user to maintain a state of concentration on the visual information. A human user can select the most readable text size.

[0064] In one aspect of this configuration, since there are multiple font types, the font type can be determined in advance. In one embodiment of a font selection option that improves usability for people with dyslexia, the OpenDyslexic font is available. In one embodiment, a human user can select the most legible font type.

[0065] In one embodiment, the type of movement of text within the field of view of a human user can be determined in advance. In one embodiment, the text moves within the field of view of a human user, and the text display includes characters or a systematic set of characters that are legible to a human and appear to move within the field of view of the human. The movement of the text appears to move away from the human's field of view after the text approaches the human's perceptual position. A human user can select the most legible movement speed. It is also possible to adjust the text size, and the human user can select the most legible text size.

[0066] In one aspect of this configuration, the text display gives the human user the impression that the text is advancing on a corridor display background (Figs. 26 to 41 (excluding Fig. 22) show examples of variations of this embodiment). The greater the number of characters displayed per minute, the greater the movement distance. The illustration of the corridor to focus the user's attention is just one technique among various visual displays. Instead of the corridor, for example, an image imitating an environment like a corridor, such as a skier sliding through a long path covered with snow, winding through obstacles such as snow-covered slopes and trees, may be used. Another visual display could be, for example, the view from the perspective of a swimmer swimming in a continuously extending pool lane. Also, a continuously extending walking course through a forest or underbrush could be considered. A human user can select the most legible movement speed. It is also possible to adjust the text size, and the human user can select the most legible text size when the text is displayed at a speed faster than the normal reading speed.

[0067] In one aspect of this configuration, the movement of text within the field of view of a human user can be predetermined. In one embodiment, the text moves within the field of view of the human user, and the text display includes legible characters or a systematic character set for a human that appears to move from one perceived position to another within the field of view. FIG. 6 shows a flowchart of a word positioning process that addresses the position of words within the user's field of view. Embodiments of the present disclosure are one of many text variations presented to the user. One of the other variations is to move the text so that it flows from one side to the other. Alternatively, the movement of the text may be a stepwise movement. For example, it may be moved in 20 steps from one side to the other.

[0068] Furthermore, as an example, the movement of the text appears to be continuous to the user, which means that to the human user, the movement of the text is perceived as being continuous, but in reality, it is a plurality of small movements at a speed such that the human user continuously feels the change in the actual position of the text. The movement of the text has been described as a movement from one side to the other, but depending on some cultures, the text may be made to move from the top to the bottom of the field of view. In one embodiment, the text display gives the human user the impression that the text is moving from one word to the next within the field of view. For example, the first word is located at the lower left of the field of view, the second word is located in the center of the field of view, and the third word is located at the upper right of the user's field of view. This means that, before using this configuration or after using it for a while, more words per minute are displayed at a faster speed than before. Alternatively, the degree and speed of subsequent word displays may mimic the speed of the REM sleep cycle. The human user can select the degree and speed of word presentation at which they can read most comfortably in this new reading configuration and environment.

[0069] In one aspect of this configuration, at least one human auditory presentation device has a configuration that directly provides non-verbal auditory presentation information in the form of non-verbal auditory signals to only one human ear. For example, using a human auditory presentation device that uses one or more non-verbal auditory signals, the display timing of each character that a human can read or a systematic character set can be adjusted according to the presentation of at least one of the predetermined non-verbal auditory signals. In one embodiment, with this adjustment, the predetermined text and the predetermined auditory signal are considered complementary, increasing the likelihood of assisting the learning and cognition of a human user. The transition from one of these elements to the other or their simultaneous provision can be preset according to the user in many forms or can be controlled by the user.

[0070] In one aspect, the human auditory presentation device includes two voice converters for converting electrical energy into mechanical energy exposed to air. To provide the non-verbal auditory signals used in the auditory presentation device, a speaker having an appropriate size and conversion power capacity may be used. The speaker needs to be housed in a housing that covers the ear of a human user. The speaker may be standalone. Similar to virtual reality headsets and headphones, the speaker may have a wireless communication function. The predetermined property of using non-verbal auditory signals is related to the setting of sessions for human use. The selection of the type of non-verbal auditory signal depends on the needs of the human user during that session. For example, if a human suffers from PTSD, the frequency of the monaural acoustic signal may be within a range known to produce the desired psychological effect.

[0071] In one embodiment, each predetermined non-verbal auditory signal is a continuous signal of a predetermined frequency and is delivered to the left and right ears as sound waves converted by each speaker. In one embodiment, the sound waves have a predetermined frequency. In one embodiment, the frequency depends on the number of predetermined words displayed per minute. In one embodiment, the higher the frequency, the more words are displayed per minute.

[0072] The frequency includes binaural beats or low-frequency sine waves aimed at inducing / reproducing deep sleep, REM sleep, relaxation, attention, and resulting cognitive assistance.

[0073] In one embodiment, the frequencies include 111 Hz, which is the 11th harmonic of the Earth's resonance frequency, the Schumann resonance of 7.83 Hz, and predetermined frequencies F1 to F14. Although the left and right ears are mentioned below, the reverse case can also be used. [Left ear] F1 = 111 Hz [Right ear] F4 = 122 Hz F5 = 125 Hz F6 = 128 Hz F7 = 131 Hz F8 = 134 Hz F9 = 137 Hz F10 = 140 Hz F11 = 143 Hz F12 = 146 Hz F13 = 149 Hz F14 = 152 Hz

[0074] In one aspect of this configuration, the narration agent reads the text at the number of target words per minute. The narration agent is incrementally operable in the range of 100 wpm to 1000 wpm in one embodiment. In one embodiment, the increment is 24 words per minute. In one embodiment, the voice can be set by a human user by selecting the language, gender, or accent of the narration agent.

[0075] In one aspect of this configuration, it is possible to add background mood sounds. In one embodiment, sounds generated from water flows, waterfalls, tropical rainforests, and other sound sources, or sounds representative of them, can be added simultaneously to one or more of the described embodiments. In one embodiment, a human user can indicate preferences for providing an audioscape that is potentially relaxing. In one embodiment, a predetermined auditory signal that replicates or reproduces recordings of locations such as tropical rainforests, waterfalls, brooks, beach waves, or underwater scuba diving may be used. This can be provided before and after the reading placement in one embodiment.

[0076] In one aspect, this configuration includes an adaptation to encourage a human user to use this configuration with their eyes maximally open (wide - open eyes). The user is encouraged to open their eyes as wide as possible. This is intended to simulate a state of fear and to encourage a fight - or - flight response to increase attention.

[0077] In one aspect of this configuration, an option is provided to highlight sections of text that a human user wishes to mark for future reference. In one embodiment, this configuration can store and reuse sections that are highlighted for future reference. Implementing such a function requires the operation of another trigger (something the user can operate, such as touch, voice, a physical switch, etc.) that is on during the display of text of interest and off when the user has no interest.

[0078] In one aspect of this configuration, there is a display mode called "gaze up". In one embodiment, this configuration can provide an option to enable or disable this function. When enabled, the text / information is always displayed at an angle between 10 degrees and 45 degrees from the horizontal vision of the human user. This configuration encourages the human user to raise their head to clearly read visual information in an immersive environment. Implementing such a function may require the operation of a VR device with a head - tracking function.

[0079] In one aspect of this configuration, there is a learning calendar that includes a predetermined schedule for reviewing previous texts or notes in order to assist a human user in better remembering what they have learned previously. In addition, the intervals of instruction using this configuration can be scheduled, and the completion status of the coursework being instructed can be tracked.

[0080] In one embodiment of this configuration, a visualization tool creates a dissociative learning state for the human user. In one embodiment of the teachings of such an approach, an animation showing a person (very similar to a human user) absorbing knowledge from coursework is displayed within the field of view. For example, an animation showing a person reading from the side of the field of view is available. This image is intended to have the user imagine reading from an out-of-body perspective. This can calm the user and allow them to focus on the text. In a similar embodiment, an image or short video animation in which there is a trapdoor above or within the head of the animated character is used, showing the top of the head opening like a trapdoor and information flowing into the head in text form. In one embodiment, the visualization of the trapdoor is provided as an animation showing the human head opening like a trapdoor and information flowing into the head from the opened part. This animated image is intended to give the user a sense of being in a mental state suitable for learning in order to enhance the user's concentration. Although animations have been described, real-time video, or video edited by applying visual special effects after shooting real-time video, may also be used.

[0081] In one embodiment of this configuration, the learning session is divided into a random number of sub-learning sessions, and learning is promoted by providing breaks between sub-sessions. In one embodiment, as shown in FIG. 53, at the start and end of each sub-learning session, the number of words displayed per minute may be automatically ramped (adjusted). The duration of each sub-learning session is determined by a pre-defined setting. As an example, a break period of 30 seconds to 60 seconds can be provided to the user for each sub-learning session of 7 to 10 minutes. In one embodiment, during the break, the visual signal is a completely black screen (black screen) and is silent, or at least one non-verbal auditory cue is provided in the form of a non-verbal auditory signal to the ears of at least one human only by at least one human auditory presentation device. In one embodiment, the auditory signal is either monaural or binaural, or a combination of two tones or monaural tones is provided to the human ear.

[0082] FIG. 54 shows the setup process of the head-mounted virtual reality device's setting adjustment process and the adjustment required when the user has a visual blind spot. This figure is merely an example, and the size and shape of the visual blind spot vary from user to user. The position of the visual blind spot also varies from user to user, and as a form of compensation for the visual blind spot, it is conceivable to move a test image or other images within the remaining visual field of the user.

[0083] A human sensory information presentation device for presenting sensory information to at least one human is disclosed herein. The human sensory information presentation device includes a memory control device and a central processing unit programmed to enable the sensory presentation information. FIG. 56 shows one of various possible embodiments. FIG. 56 shows a client-server-cloud architecture. One function performed is the collection and storage of documents that form the basis for the visual presentation of information to at least one human, as exemplified in the upload of the documentation process. In one embodiment of the human sensory information presentation device as shown in FIG. 56, the client-server-cloud architecture provides access to one or more stored documents by an application server that can be placed anywhere, similar to document storage. In one embodiment, a client device controlled by a user issues a request to the application server, and the application server is permitted to provide a learning session to the client device according to a software (SaaS) contract as a service between the user (or a named third party). As the client device, a mobile phone, a tablet, a personal computer, a computer server, and various alternative devices can be used. Such devices have a screen and an audio output function. In an embodiment of the present disclosure, the learning session is transmitted to a virtual reality headset (FIG. 55) worn by the user, and sensors embedded in the headset provide sensor signals to the user client. The user client either executes a local session of the learning session or is provided to an application server that adjusts the transmission of the learning session according to various configurations generally disclosed herein (for example, raising the user's line of sight). In one embodiment, the application server includes a control device having a memory and a central processing unit programmed such that at least one human visual presentation device in this embodiment can utilize the sensory presentation information via the client device. In one embodiment, the head-mounted virtual reality device is configured to provide the visual presentation information only to one human user.However, it is also possible for multiple users to wear multiple head-mounted virtual reality devices and provide the same session simultaneously.

[0084] In one aspect of this configuration, the presentation of information by vision and hearing is adapted to support users with visual impairments. In one embodiment, a user with "macular degeneration", a visual impairment disease, is assisted by the function of a head-mounted virtual reality device having the setting adjustment process shown in FIG. 54. By using the setting adjustment process, the user can specifically indicate which part of the visual field has a reduced perception. With this configuration, the information display can be adjusted to avoid using those areas, and as a result, the usable area of the user's visual field can be maximized.

[0085] FIG. 57 shows the use of audio processing techniques to make the sound appear to come from a position away from the user, and the sound source appears to come from either the front, above, or behind. However, the perceived sound source may be in any position relative to the user, and the illustration of a distance of 30 cm is merely an example. Techniques for generating the audible signals necessary to produce the desired results are known to those skilled in the art. This embodiment provides techniques for concentrating the user's attention while providing the audio and images described herein in various forms.

[0086] Each of FIGS. 1-57 includes details of various embodiments. However, the illustrated embodiments are not the only embodiments of the various elements disclosed in those figures. Various combinations of each feature of the present disclosure are contemplated, which are not illustrated but provide a basis for using the various combinations. Further, the various combinations may be beneficial to one or more users. As the development process is implemented and comes to be used by various users with various mental acuities and cognitive abilities, certain combinations will prove to be more effective than other combinations. It is also expected that there will be users who will benefit from using the apparatus and processes of the present disclosure. Thus, users with improving capabilities may require various learning stimuli and information to encourage progress including other combinations of the various elements of the present disclosure. Further, the techniques disclosed and taught herein may also find application in fields not yet envisioned.

Claims

1. A human sensory information presentation device for presenting sensory information to a human, comprising a control device including a central processing unit and a memory programmed to enable visual presentation information and auditory presentation information presented to a human, including at least visual information and non-verbal auditory signals; at least one human visual information presentation device that receives the visual presentation information from the control device, configured to display the received visual presentation information only within a predetermined visual field of one human, the visual presentation information including at least one or more characters or a systematic character set formed from a predetermined alphabet and predetermined numbers set to form words or numbers readable by a human, and presenting one character or one systematic character set at a time, the human visual information presentation device; at least one human auditory information presentation device that receives non-verbal auditory signals from the control device, configured to present the received non-verbal auditory signals only to the one human, the non-verbal auditory signals including one or more non-verbal auditory signals, the human auditory information presentation device, and the control device controls to present each of the characters or the systematic character set readable by the human simultaneously with at least one predetermined non-verbal auditory signal.

2. The human sensory information presentation device according to claim 1, wherein the characters or the systematic character set readable by the human presented by the human visual information presentation device are presented in contrast to a predetermined background color presented by the human visual information presentation device.

3. The human sensory information presentation device according to claim 1 or 2, wherein the visual presentation of the characters or the systematic character set readable by the human includes displaying the characters or the systematic character set readable by the human in one or more predetermined colors, grouping the characters or the systematic character set readable by the human in different colors from each other, and adjusting so that the characters or the systematic character set readable by the human appear to move in front of a human looking at the visual presentation of the characters or the systematic character set readable by the human, and includes one or more of the group.

4. The human sensory information presentation device according to any one of claims 1 to 3, wherein a predetermined color is used for the display of a predetermined word, and the word is presented in contrast to a predetermined background color different from the color used for the word.

5. The human sensory information presentation device according to any one of Claims 1 to 4, wherein when a series of words to be presented form a phrase or sentence that can be read by a human, a predetermined color is used for the display of the words.

6. The human sensory information presentation device according to any one of Claims 1 to 5, wherein the visual presentation information includes characters or a systematic character set that can be read by a human and appears to move away from the human after approaching the human within the human's visual field, and the movement of the characters or the systematic character set that can be read by the human is performed during or while continuously presenting the characters or the systematic character set that can be read by the human.

7. The human sensory information presentation device according to any one of Claims 1 to 6, wherein the speed of the continuous presentation of the characters or the systematic character set that can be read by a human and presented to the human is changeable from an initial predetermined speed.

8. The human sensory information presentation device according to any one of Claims 1 to 7, wherein the font size of the continuous presentation of the characters or the systematic character set that can be read by a human and presented to the human is changeable from an initial predetermined font size.

9. The human sensory information presentation device according to any one of Claims 1 to 8, wherein the continuous presentation of the characters or the systematic character set that can be read by a human and presented to the human is presented together with an image of a trapdoor, and the characters or the systematic character set that can be read by a human and presented previously are displayed as entering and disappearing into the trapdoor.

10. The human sensory information presentation device according to any one of Claims 1 to 9, wherein the continuous presentation of the characters or the systematic character set that can be read by a human and presented to the human is presented together with an image of a moving corridor, and the characters or the systematic character set that can be read by a human and presented previously are displayed as entering and disappearing into the corridor.

11. The human sensory information presentation device according to any one of Claims 1 to 10, wherein the continuous presentation of the characters or the systematic character set that can be read by a human and presented to the human is performed one or more times repeatedly.

12. The human sensory information presentation device according to any one of Claims 1 to 11, The device is configured such that the predetermined non-verbal auditory signal is continuously presented during the presentation of or continuous presentation of the characters or systematic character set readable by the human. [

13. ] A human sensory information presentation device according to any one of Claims 1 to 12, wherein the predetermined non-verbal auditory signal is monaural and different from another predetermined monaural non-verbal auditory signal, and both are provided to the human independently of each other by the human auditory information presentation device. [

14. ] A human sensory information presentation device according to any one of Claims 1 to 13, wherein the predetermined non-verbal auditory signal is binaural and provided to each of the human's ears respectively. [

15. ] A human sensory information presentation device according to any one of Claims 1 to 14, wherein the predetermined non-verbal auditory signal is a combination of two tones and the monaural tones are provided to both ears of the human. [

16. ] A human sensory information presentation device according to any one of Claims 1 to 15, wherein the predetermined non-verbal auditory signal is an isochronic tone. [

17. ] A human sensory information presentation device according to Claim 16, wherein the isochronic tone has a predetermined pitch and a predetermined interval. [

18. ] A human sensory information presentation device according to Claim 1, wherein at least one of the human auditory information presentation devices that receives the non-verbal auditory signal from the control device includes a transducer that converts electrical energy representing the non-verbal auditory signal controlled and provided by the control device into mechanical energy for vibrating the surrounding air, and the transducer is arranged near the human's ear and presents the non-verbal auditory signal by the vibrating air. [

19. ] A human sensory information presentation device according to Claim 17, wherein at least one of the human auditory information presentation devices further includes a housing that houses the transducer, and the housing is configured to provide the sound generated by the transducer to the human's ear. [

20. ] A human sensory information presentation device according to any one of Claims 1 to 19, wherein the presentation of the characters or systematic character set readable by the human is performed in cooperation with the presentation of a predetermined non-verbal auditory signal by an application programming interface executed by the control device. [

21. ] A human sensory information presentation device according to any one of claims 1 to 20, wherein the human visual information presentation device includes one or two video signal presentation screens that extend at least to the boundary of the human visual field.

22. A human sensory information presentation system, a computer server having a computer server memory and a central processing unit configured to make visual presentation information and non-verbal auditory presentation information available from the computer server memory, a digital signal receiving device, a computer device memory, and a computer device having a central processing unit configured to store and execute an application programming interface in the computer device memory that receives and processes the visual presentation information and the non-verbal auditory presentation information made available by the computer server, at least one human visual information presentation device that receives the visual presentation information from the computer device, configured to display the received visual presentation information only within a predetermined visual field of one human, the visual presentation information including at least one or more characters or a systematic character set formed from a predetermined alphabet and predetermined numbers configured to form words or numbers readable by humans, and presenting one character or one systematic character set at a time, the human visual information presentation device, at least one human auditory information presentation device that receives a non-verbal auditory signal from the computer device, configured to present the received non-verbal auditory signal only to the one human, the non-verbal auditory signal including one or more non-verbal auditory signals, the human auditory information presentation device, comprising, wherein the computer device controls to present each of the characters or the systematic character set readable by the human simultaneously with at least one predetermined non-verbal auditory signal.

23. The human sensory information presentation system according to claim 22, wherein the visual presentation information is available to the computer server and is stored in the memory of the computer server.

24. The human sensory information presentation system according to claim 22, The central processing unit analyzes the visual presentation information stored in the partitioned computer server memory and uses one or more text interval elements or punctuation marks as delimiters for the words or sentences or subsets of complete sentences to identify words or sentences or subsets of complete sentences, a system.

Images