Display device and display method

Abstract

The ability to communicate smoothly with many people who have higher-order brain dysfunction. [Solution] A display device (glasses 1) worn on the head of a user with higher brain dysfunction is characterized by comprising: an audio input means (microphones 23, 24) for inputting sound, an image input means (camera 21) for inputting images, and a processing means (processing unit 13) that inputs sound and / or images and performs processing to support brain function due to higher brain dysfunction, in the event that a specific part of the user's brain is damaged.

Description

Technical Field

[0007] ,

[0001] The present invention relates to a display device and a display method.

Background Art

[0002] Regarding a system for assisting rehabilitation, there is a technology disclosed in Patent Document 1 and the like.

[0003] In the technology of Patent Document 1, in order to make it easier for a patient to recognize a target motion and smoothly proceed with rehabilitation, an index of the motion is presented in the patient's field of view.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, the technology disclosed in Patent Document 1 is for rehabilitation and is in a state where it is difficult to implement at home.

[0006] The present invention has been made in view of the above circumstances, and an object thereof is to provide a display device and a display method capable of smoothly communicating with many people with higher brain function disorders.

Means for Solving the Problems

[0007] In order to solve the above problems, the present invention provides a display device worn on the head of a user with higher brain function disorder, comprising: a voice input means for inputting voice, an image input means for inputting an image, and a processing means for inputting the voice and / or the image and performing a process for assisting brain function due to the higher brain function disorder. With this configuration, if a user has higher-order brain dysfunction, cognitive functions can be supported using voice and images. For example, by recording conversation content using voice input and supplementing it with visual information using image input, it becomes easier to organize information. As a result, users can receive support to smoothly carry out communication and executive functions in daily life and social activities. Furthermore, processing to assist memory, attention, and planning functions is performed automatically as needed, reducing the burden on the user.

[0008] Furthermore, the processing means is characterized by the fact that the image input means records the facial image or name of another person, so that even if it forgets, it can be understood by searching. This configuration allows you to search by name or face.

[0009] Furthermore, the processing means is characterized by recording the time and location using GPS. With this configuration, using GPS allows you to know your location and time even if you forget where you are.

[0010] Furthermore, the processing means is characterized by converting the audio into text and recording it. With this configuration, by converting speech to text and recording it, the content of the conversation can be reviewed later, thus supporting communication.

[0011] Furthermore, the processing means is characterized by converting the characters into simplified characters and recording them. This structure simplifies long sentences and complex language, making them easier to understand and thus reducing cognitive burden.

[0012] Furthermore, the processing means is characterized by converting the characters into illustrations and recording them. This type of structure, by illustrating text, makes information easier to understand visually and facilitates smoother communication.

[0013] Furthermore, the processing means is characterized in that the image input means records valuables or agreements so that even if they are forgotten, they can be understood by searching. With this configuration, you can record valuables and appointments, allowing you to quickly search and check them if you forget them.

[0014] Furthermore, the voice input means outputs sound when there is an attention deficit due to the aforementioned higher brain dysfunction. With this configuration, even in cases of attention deficit, voice instructions can be used to attract attention and encourage appropriate behavior.

[0015] Furthermore, in the case of aphasia due to higher brain dysfunction, the voice input means converts speech into text. With this configuration, even in cases of aphasia, it is possible to help communicate by converting speech into text.

[0016] Furthermore, in the case of aphasia due to higher brain dysfunction, the image input means converts the image into text. With this configuration, users with aphasia can utilize visual information to support communication by converting images into text.

[0017] Furthermore, if the number of characters is less than or equal to a certain number, the system is characterized by converting the audio or image. This structure allows for simplification of information and prevention of misunderstandings by limiting sentences to short ones.

[0018] Furthermore, it is characterized by creating text by collecting information. With this structure, communication can be easily facilitated by creating text based on the collected information.

[0019] Furthermore, it is characterized by illustrating the aforementioned audio or the aforementioned image. According to such a configuration, by converting voice or images into illustrations, visually understandable information can be provided.

[0020] Further, when there is an execution function disorder of the higher brain function disorder, when the user is performing execution, the voice and / or the image are input and monitored. According to such a configuration, even when there is an execution function disorder, by monitoring and supporting voice and images, the progress of the action can be confirmed and appropriately executed.

[0021] Further, when there is a social behavior disorder of the higher brain function disorder, the history of past social behavior disorders is confirmed, the same voice is output when there is the same history, and a token economy program is output when there is the same history above a certain level. According to such a configuration, even when there is a social behavior disorder, actions can be predicted and corrected based on past history, and action improvement can be promoted by the token economy program.

[0022] Further, when there is an agnosia of the higher brain function disorder, when it cannot be understood visually, auditorily, or tactilely, auditory and tactile, visual and tactile, and visual and auditory are output. According to such a configuration, when there is agnosia, recognition can be supported by providing information by combining vision, hearing, and touch.

[0023] Further, when there is an agnosia of the higher brain function disorder and there is topographical agnosia, the current location and the destination are specified, and the route is confirmed by GPS. According to such a configuration, when there is topographical agnosia, the route can be confirmed by GPS, and route guidance from the current location to the destination can be provided.

[0024] Further, when there is an apraxia of the higher brain function disorder and the usage method is not understood, the usage method is selected, displayed as a video, and displayed as voice. With this configuration, even in cases of apraxia, the user can be supported in using the device appropriately by providing instructions through videos and audio.

[0025] Furthermore, in cases of easy fatigability due to the aforementioned higher brain dysfunction, when checking brain energy, the symptoms, effects, consumption, and responses to easy fatigability are checked. With this configuration, if someone is prone to fatigue, fatigue can be managed by checking the brain's energy consumption and encouraging appropriate rest and responses.

[0026] Furthermore, in a display method to be worn on the head of a user with higher brain dysfunction, the method is characterized by including an audio input step for inputting audio, an image input step for inputting an image, and a processing step for inputting the audio and / or the image and performing processing to support brain function due to the higher brain dysfunction, in the event that a specific part of the user's brain is damaged. This configuration allows for support of cognitive and executive functions, enabling users to smoothly carry out their daily lives by taking steps to support their brain function. [Effects of the Invention]

[0027] The present invention has been made in view of the above circumstances and makes it possible to provide a display device and display method that enable smooth communication with many people who have higher brain dysfunction. [Brief explanation of the drawing]

[0028] [Figure 1] This figure shows an example of the configuration of eyeglasses according to this embodiment. [Figure 2] This figure shows an example of the configuration of eyeglasses according to this embodiment. [Figure 3] This figure shows an example of the optical system configuration of the image display unit. [Figure 4] This is a block diagram that functionally illustrates the structure of eyeglasses. [Figure 5]This flowchart shows an example of memory impairment. [Figure 6] This figure shows an example of the configuration of eyeglasses according to this embodiment. [Figure 7] This figure shows illustrations and audio text related to the flowchart shown in Figure 5. [Figure 8] This flowchart shows an example of memory impairment. [Figure 9] This flowchart shows an example of memory impairment. [Figure 10] This flowchart shows an example of memory impairment. [Figure 11] This flowchart shows an example of an attention deficit. [Figure 12] This is a block diagram that functionally illustrates aphasia. [Figure 13] This is a flowchart illustrating an example of aphasia. [Figure 14] This is a diagram showing text and illustrations. [Figure 15] This diagram shows text and illustrations displayed on a screen. [Figure 16] This is a diagram that displays text as visual input from an image. [Figure 17] This is a flowchart illustrating an example of aphasia. [Figure 18] This diagram shows text and illustrations displayed on a screen. [Figure 19] This flowchart shows an example of executive function disorder. [Figure 20] This flowchart shows an example of a social behavior disorder. [Figure 21] This is a flowchart illustrating an example of agnosia. [Figure 22] This is a flowchart illustrating an example of agnosia. [Figure 23] This diagram shows text and illustrations displayed on a screen. [Figure 24] This flowchart shows an example of apraxia. [Figure 25]This flowchart shows an example of easy fatigue. [Modes for carrying out the invention]

[0029] Next, embodiments of the present invention will be described.

[0030] (A) Description of the configuration of the first embodiment of the present invention

[0031] Figures 1 and 2 show examples of the configuration of embodiments of the present invention. As shown in Figures 1 and 2, the eyeglasses 1 according to an embodiment of the present invention have a bridge 2, temples 3 and 4, lenses 5 and 6, a left half mirror 7, a right half mirror 8, buttons 19 and 20, a camera 21, a speaker 22, microphones 23 and 24, speakers 31 and 41, a smartphone connection unit 18, and a GPS 26.

[0032] Here, glasses 1 are glasses for higher-order brain dysfunction and are a device that enables verbal communication with others.

[0033] Bridge 2 is the part that connects the left and right rims (lenses 5 and 6) and connects to temples 3 and 4.

[0034] Temples 3 and 4 are the parts that rest on the ears from the hinge, and are the "arms that rest on the ears."

[0035] Lenses 5 and 6 come in various types, including those for nearsightedness, farsightedness, astigmatism, and close-up vision, and are designed to correct vision for people with nearsightedness, farsightedness, or astigmatism to provide normal vision.

[0036] The left half-mirror 7 and the right half-mirror 8 are mirrors that separate light into transmitted and reflected elements in a fixed ratio.

[0037] Buttons 19 and 20 can be turned on or off to, for example, enable or block information flow.

[0038] Camera 21 can capture light through an optical lens, create still images and videos, and record them in ROM or RAM.

[0039] Speakers 22, 31, and 41 receive electrical signals, convert them into mechanical vibrations, and then convert them into sound waves in the air to generate sound.

[0040] Microphones 23 and 24 capture sound waves in the air and convert them into electrical signals.

[0041] The smartphone connection unit 18 is the part that enables the smartphone to connect with other devices and networks.

[0042] Furthermore, GPS (Global Positioning System)26 is a system that determines the current location by receiving radio waves transmitted from artificial satellites in orbit around the Earth and calculating position, distance, time, etc.

[0043] Figure 3 shows an example of the configuration of the optical system of the image display unit. As shown in Figure 3, the optical system consists of a left half mirror 7, a right half mirror 8, a left display 71, a right display 81, a left optical system 72, a right optical system 82, a left light guide plate 73, and a right light guide plate 83.

[0044] The left display 71 is, for example, an OLED (Organic Light Emitting Diode) and emits image light. Similarly, the left display 71 is an OLED and emits image light.

[0045] The left optical system 72 is equipped with a group of lenses and other components that guide the image emitted by the left display 71. The right optical system 82 has a similar structure.

[0046] The left light guide plate 73 is a plate processed to diffuse light, thereby ensuring uniform brightness across the panel. The image emitted from the left display 71 is diffused to the left light guide plate 73 via the left optical system 72. The right light guide plate 83 has a similar structure.

[0047] Figure 4 is a block diagram that functionally shows the configuration of the glasses 1. As shown in Figure 4, it consists of a memory unit 11, an audio unit 12, a processing unit 13, a communication unit 14, a RAM (Random Access Memory) 15, a ROM (Read Only Memory) 16, a power supply unit 17, a smartphone connection unit 18, buttons 19, 20, a camera 21, a speaker 22, an API (Application Programming Interface) 25, a GPS 26, speakers 31, 41, a left display 71, and a right display 81.

[0048] The memory unit 11 is, for example, a non-volatile memory unit (EEPROM), which is a persistent memory whose contents are not lost even when the power is turned off.

[0049] The audio unit 12, for example, uses the frequency range of a human voice (80-800 Hz) and filters out and saves the other frequency ranges.

[0050] The processing unit 13 functions as a central processing unit (CPU), processing instructions from peripheral devices and software, as well as controlling memory. The processing unit 13 can also use generation AI. Furthermore, it utilizes all functions of memory units 11-81 and steps S10-S276 in conjunction.

[0051] The communication unit 14 can be, for example, Wi-Fi (Wireless Fidelity) or Bluetooth, and can wirelessly connect to communication devices such as smartphones and personal computers.

[0052] RAM15 is a memory device for temporarily storing and saving data.

[0053] ROM16 is a read-only storage device with non-volatile properties.

[0054] The power supply unit 17 is, for example, a lithium-ion battery, and can supply power when connected to the smartphone connection unit 18.

[0055] The smartphone connection unit 18 can connect to other smartphones to supply power, exchange information, and more.

[0056] API 25 provides an interface for integrating and coordinating various devices and functions within the system. For example, it manages communication between the processing unit 13, the communication unit 14, the displays 71 and 81, and the speaker 22, and controls the display of information and audio output in response to user operations and inputs. Furthermore, API 25 supports data transmission and reception, as well as location information acquisition via GPS 26, through integration with smartphones and external applications. As a result, the glasses 1 function as a smart device that can efficiently support rehabilitation and daily communication.

[0057] (B) Description of the operation of the first embodiment of the present invention Next, embodiments of the present invention will be described. Figures 5 to 7 illustrate memory impairment accompanied by higher brain dysfunction. Memory impairment refers to a condition in which there are problems with one or all of the following: encoding (learning new information), retention (maintaining information), and retrieval (recalling learned information (and, if necessary, being able to recall retained information)). This condition can make it difficult to learn new information or to forget information learned in the past.

[0058] Figure 5 shows the individual wearing glasses 1, who has developed memory impairment due to higher brain dysfunction.

[0059] As shown in S10, if a new event occurs (step S10:Y), the process proceeds to step S11. On the other hand, if there is no new event (step S10:N), the process ends (stops). A new event could be, for example, communication with another person. You can also confirm that an event has occurred by turning on button 19 or button 20.

[0060] As shown in S11, the time is recorded using GPS26. For example, the time information of 14:31 obtained by GPS26 is stored in the storage unit 11 or RAM15.

[0061] As shown in S12, location information from GPS 26 and photographs (image format) taken by camera 21 are recorded. For example, the location and photographs (e.g., facial images) of other people acquired by GPS 26 are stored in the storage unit 11 or RAM 15.

[0062] As shown in S13, the system searches for another person's face image. Specifically, it generates a face image using another person's photograph, and the processing unit 13 searches for the same face image stored in the storage unit 11. In addition, when the person meets another person, their name and face image are recorded. For example, the name is recorded using a smartphone.

[0063] As shown in S14, if the face image in the other person's photograph matches the face image stored in the memory unit 11 (step S14:Y), the process proceeds to step S15. On the other hand, if they do not match (step S14:N), the process proceeds to step S16.

[0064] As shown in S15, the facial images and names of other people are recorded. Specifically, as shown in Figure 6, the facial image and the name "Kenta Yamada" are stored in the memory unit 11 and displayed on the left display 71 and the right display 81. For example, if you frequently meet someone in person at the front door, the greetings and short conversations with neighbors are recorded in photographs.

[0065] As shown in S16, audio is recorded. Specifically, audio from other people is input through microphones 23 and 24 and recorded in the storage unit 11.

[0066] As shown in S17, speech is converted into text. Specifically, the processing unit 13 converts speech input from others through microphones 23 and 24 into text (hiragana, katakana, and kanji) and outputs it to the left display 71 and the right display 81. The text is also recorded in the storage unit 11. For example, the speech "If there is an earthquake, you should close the cock" is converted to "If there is an earthquake, you should close the cock" and output.

[0067] As shown in S18, the message is converted into simple text and illustrations. Specifically, in cases of aphasia, when oral communication is difficult, it is effective to simplify long sentences and convert them into illustrations as well as text. For example, as shown in Figure 7, the message "If there is an earthquake, close the valve!" becomes easier to understand with the help of an illustration.

[0068] As shown in S19, if the conversation is over (step S19:Y), proceed to step S20. On the other hand, if the conversation is not over (step S19:N), return to step S17. Specifically, if the conversation with Yamada is over, proceed to step S20.

[0069] As shown in S20, the text and audio are summarized. Specifically, the conversational text and audio data stored in the memory unit 11 are summarized using API 25. For example, long texts and audio can be shortened using API 25, which is a generation AI.

[0070] As described above, Glasses 1 understands and stores information to help you easily record other people's faces, voices, locations, etc., and to help you remember them.

[0071] Next, Figure 8 is shown. Figure 8 shows information about wallets and appointments.

[0072] As shown in S30, if a new event occurs (step S30:Y), the process proceeds to step S31. On the other hand, if there is no new event (step S30:N), the process terminates (stops). Note that you can confirm that an event has occurred by pressing button 19 or button 20 (ON).

[0073] As shown in S31, the GPS26 records the time. Specifically, the time obtained from the GPS26 is output and recorded in the storage unit 11.

[0074] As shown in S32, the location information acquired by GPS26 and the photographs taken by camera21 are recorded. Specifically, the location information acquired from GPS26 and the photographs taken by camera21 are stored in the storage unit11.

[0075] As shown in S33, if a wallet, mobile phone, keys, identification card, etc. are placed (step S33:Y), proceed to step S34. On the other hand, if no such items are placed (step S33:N), proceed to step S37. Specifically, if a similar wallet or other item has already been input by camera 21 and recognized, and these items are placed, proceed to step S34.

[0076] As shown in S34, photographs of items such as wallets, keys, mobile phones, and identification cards are recorded. Specifically, the processing unit 13 records similar wallets, etc., that it has already recognized as photographs in the storage unit 11. Note that wallets, keys, mobile phones, and identification cards are considered "valuables."

[0077] As shown in S35, the names of items such as wallets, keys, mobile phones, and identification cards are recorded. Specifically, the processing unit 13 encodes similar wallets that it has already recognized and stores them in the storage unit 11 as "wallet". For example, valuables such as wallets and keys are recorded along with their names and stored as valuables.

[0078] As shown in S36, the system outputs the voice message "Don't forget!". Specifically, for example, the message "Don't forget!" stored in ROM16 is retrieved and output from speakers 31 and 41.

[0079] As shown in S37, if there is an appointment, time, place, phone number, etc. (step S37:Y), proceed to step S38. On the other hand, if there is no appointment, etc. (step S37:N), terminate. Specifically, if an appointment, time, place, phone number, etc. is confirmed by a phone call from another person, proceed to step S38. Note that "appointment, time, place, phone number, etc." refers to an "agreement."

[0080] As shown in S38, the system records the appointment, time, place, phone number, etc. Specifically, it records information such as the "appointment" recognized by the processing unit 13 in the storage unit 11. For example, it records an appointment to have coffee with a friend at a shop at 1pm the day after tomorrow.

[0081] As shown in S39, the system outputs the voice message "Don't forget!". Specifically, for example, the message "Don't forget!" stored in ROM16 is retrieved and output from speakers 31 and 41.

[0082] Next, Figure 9 is shown. Figure 9 shows how, when you can't remember someone's face and name, pressing button 19 on glasses 1 displays their face and name. Pressing button 20 displays the conversation content. Note that in addition to pressing buttons 19 and 20, it is also possible to set them to operate automatically.

[0083] As shown in S50, if the other person's name is unknown (step S50:Y), proceed to step S51; if the other person's name is known (step S50:N), terminate.

[0084] As shown in S51, another person's face is photographed. Specifically, the processing unit 13 uses the camera 21 to photograph another person's face (and save it as a face image). For example, as shown in Figure 6, the processing unit 13 photographs the face of another person, "Kenta Yamada," and the image is saved in the storage unit 11.

[0085] As shown in S52, a facial image is searched and identified. Specifically, the camera 21 captures the face of another person, and a similar facial image is searched for and identified from the photographs stored in the memory unit 11.

[0086] As shown in S53, if the face image of the other person matches the recorded face image (step S53:Y), the process proceeds to step S54; otherwise, it proceeds to step S56. Specifically, as shown in Figure 6, if the captured face image of the other person matches the face image stored in the memory unit 11, the process proceeds to step S54.

[0087] As shown in S54, the name is output. Specifically, as shown in Figure 6, the name "Kenta Yamada" is displayed on the left display 71 and the right display 81. In addition, the name is output audibly from speakers 31 and 41 so that the person can understand it. Furthermore, considering the possibility of misidentification, a photograph can be displayed along with the name.

[0088] As shown in S55, simple text and illustrations from the past are output. Specifically, simple text and illustrations are displayed on the left display 71 and the right display 81. It is also possible to output summarized text and audio. As shown in Figure 7, the text and illustrations are displayed in an understandable format.

[0089] As shown in S56, the process terminates if the face and name cannot be identified.

[0090] As shown above, even if a person forgets their own face and name, it is easy to recall their face and name.

[0091] Next, Figure 10 is shown. Figure 10 shows that if you forget your wallet, appointments, etc., pressing button 19 on glasses 1 will display and allow you to confirm them.

[0092] As shown in S60, if the user presses button 19 when they forget something important (step S60:Y), the process proceeds to step S61. On the other hand, if the user does not press button 19 (step S60:N), the process ends. Specifically, the user presses button 19 when they have lost their memory.

[0093] As shown in S61, if there is a record of a wallet or an appointment (step S61:Y), proceed to step S62. On the other hand, if there is no record (step S61:N), the process ends. Specifically, if the person forgets their wallet or appointment, proceed to step S62. Also, if the person forgets their wallet or appointment, consult with family or friends.

[0094] As shown in S62, if there is a record of a wallet or other item (step S62:Y), proceed to step S63. On the other hand, if there is no record (step S62:N), proceed to step S64. Specifically, if there is a record of a photograph and name, proceed to step S62.

[0095] As shown in S63, recent wallets and other items are output. Specifically, information such as a photo of the wallet and its name, stored in the memory unit 11, is output. For example, valuables such as wallets and keys have their name and location information recorded and are displayed on the left display 71 and the right display 81. This allows them to be managed as valuables and easily understood.

[0096] As shown in S64, if there is a record such as an agreement (step S64:Y), proceed to step S65. On the other hand, if there is no record (step S64:N), terminate. Specifically, if there is a record such as an agreement, proceed to step S65.

[0097] As shown in S65, recent appointments and other information are output. Specifically, information such as appointments, time, location, and phone number stored in the memory unit 11 is output. For example, appointments have name and location information recorded and are displayed on the left display 71 and the right display 81. This allows appointments to be managed and easily understood.

[0098] As described above, using Glasses 1 can support the daily life of a person with memory impairment.

[0099] (C) Description of the operation of the second embodiment of the present invention Next, embodiments of the present invention will be described. Figure 11 shows an attention disorder accompanied by higher brain dysfunction. Note that there are various types of attention disorders, such as distributive attention disorder, sustained attention disorder, distracted attention disorder, and selective attention disorder.

[0100] Figure 11 shows the individual wearing glasses 1, who has developed attention deficit due to higher brain dysfunction.

[0101] As shown in S80, the target image and audio are input. Specifically, the processing unit 13 inputs the target image from the camera 21 and the target audio from the microphones 23 and 24.

[0102] As shown in S81, if multiple targets are to be distributed (step S81:Y), proceed to step S82. On the other hand, if multiple targets are not to be distributed (step S81:N), proceed to step S84. Specifically, for example, when a person is turning left at an intersection in their car, they may become distracted by pedestrians and cause an accident involving a bicycle, so it is important to distribute their attention.

[0103] As shown in S82, the voice output is "Be careful!". Specifically, the voice output is "Be careful!" from speakers 31 and 41, and at the same time, the processing unit 13 distributes the input from camera 21 to multiple targets.

[0104] As shown in S83, if distribution to multiple targets is completed (step S83:Y), the process ends. On the other hand, if distribution to multiple targets is not completed (step S83:N), the process returns to step S82. Specifically, if the operation of turning left at an intersection with a car is completed, the process stops at step S83.

[0105] As shown in S84, if the new object is to be continued (step S84:Y), proceed to step S85. On the other hand, if the new object is not to be continued (step S84:N), proceed to step S87. Specifically, for example, if the television is turned on while the person is eating, a new stimulus is added, interrupting the previous activity.

[0106] As shown in S85, the voice output is "Don't forget!". Specifically, the voice output is "Don't forget!" from speakers 31 and 41, and at the same time, the processing unit 13 interrupts the input from camera 21 (text, etc.) and switches to a new target.

[0107] As shown in S86, if the new target is terminated (step S86:Y), the process ends. On the other hand, if the new target is not terminated (step S86:N), the process returns to step S85.

[0108] As shown in S87, if the target is to be switched (step S87:Y), proceed to step S88; if the target is not to be switched (step S87:N), proceed to step S90. Specifically, for example, there are situations where a person is watching television and the phone rings, but their attention is not drawn to it and they do not notice it.

[0109] As shown in S88, the voice output is "Please change it!". Specifically, the voice output is "Please change it!" from speakers 31 and 41, and at the same time, the processing unit 13 switches the input (text, etc.) from camera 21 to the new target.

[0110] As shown in S89, if the target redirection is completed (step S89:Y), the process ends. On the other hand, if the target redirection is not completed (step S89:N), the process returns to step S88.

[0111] As shown in S90, if a target is selected (step S90:Y), the process proceeds to step S91. On the other hand, if no target is selected (step S90:N), the process ends. Specifically, for example, there may be a situation where the person cannot hear what the other person is saying in a room full of voices.

[0112] As shown in S91, the system outputs the voice message "This is a good choice!". Specifically, speakers 31 and 41 output the voice message "This is a good choice!", and simultaneously, the processing unit 13 selects the target using input (such as text) from camera 21.

[0113] As shown in S92, if the selection of targets is completed (step S92:Y), the process ends. On the other hand, if the selection of targets is not completed (step S92:N), the process returns to step S91.

[0114] As described above, using Glasses 1 can support the daily life of a person with attention deficit.

[0115] (D) Description of the operation of the third embodiment of the present invention Next, embodiments of the present invention will be described. Figure 12(A) shows aphasia accompanied by higher brain dysfunction. Aphasia refers to a condition in which there is damage to Wernicke's area, Broca's area, and the conceptual center. Wernicke's area processes auditory and visual information, and damage occurs to it. Broca's area is involved in the output of speech and hand movements, and damage also occurs to this area. The term "conceptual center" is not commonly used in the field of neuroscience, but language function is supported by a wide network in the brain, and is concisely defined in the form of a specific "conceptual center." Damage to the connection between Wernicke's area and Broca's area is called conduction aphasia, damage to the connection between Wernicke's area and the conceptual center is called transcortical sensory aphasia, and damage to the connection between the conceptual center and Broca's area is called transcortical motor aphasia.

[0116] Furthermore, as shown in Figure 12(B), the types of aphasia, their main symptoms, and the location of the damage are illustrated. Damage to Wernicke's area makes language comprehension difficult, resulting in fluent speech but unclear content. Damage to Broca's area makes speech difficult, but the meaning of words can be understood. Damage to the arcuate fasciculus leads to conduction aphasia, making it difficult to repeat words and paraphrase. Extensive damage to the frontal or temporal lobe results in transcortical sensory aphasia, making it particularly difficult to understand abstract words. Extensive damage to the frontal lobe results in transcortical motor aphasia, making speech difficult and simplifying sentence structure.

[0117] Figure 13 shows the individual wearing glasses 1, due to a Wernicke's area disorder caused by higher brain dysfunction. A Wernicke's area disorder refers to a condition where it becomes difficult to understand the content of spoken or read words.

[0118] As shown in S110, if there is auditory input from another person (step S110:Y), proceed to step S111; if there is no auditory input (step S110:N), proceed to step S117. Specifically, for example, if another person (the caretaker) speaks to the person, proceed to step S111.

[0119] As shown in S111, voice input from another person is provided. Specifically, the voice of another person is input through microphones 23 and 24.

[0120] As shown in S112, the processing unit 13 converts the speech into text. Specifically, for example, as shown in Figure 14, the speech is converted into the text "There is an autumn in the neighborhood, so please be careful."

[0121] As shown in S113, the processing unit 13 converts the characters into hiragana, katakana, and kanji. Specifically, for example, as shown in Figure 14, it converts it to "There have been burglaries in the neighborhood, so please be careful," and at the same time adds hiragana furigana.

[0122] As shown in S114, the processing unit 13 converts the text into a shorter format. Specifically, it converts it to something like "neighborhood burglary 10 minutes". A short text is preferably 10 characters or less, but 30 characters or less is also acceptable.

[0123] As shown in S115, the processing unit 13 will illustrate short sentences if possible. Specifically, as shown in Figure 14, it will illustrate short phrases such as "Beware of burglars in the neighborhood." More specifically, as shown in Figure 15, these are displayed on the left display 71 and the right display 81 near the lenses 5 and 6.

[0124] As shown in S116, if the voice from the other party ends (step S116:Y), the process ends; otherwise, it returns to step S111. Specifically, for example, if the other party (administrator) continues to speak to the person via voice, the process returns to step S111.

[0125] As shown in S117, the processing unit 13 receives image input from the camera 21 to the visual system. Specifically, for example, as shown in Figure 16(A), an image of a flyer is input to the camera 21.

[0126] As shown in S118, a specific part of the image is identified. Specifically, as shown in Figure 16(B), the area enclosed by the dashed line on the flyer is identified. More specifically, the specific part can be designated when the person points to it with their right hand or gives a verbal instruction.

[0127] As shown in S119, the image is converted into text. Specifically, as shown in Figure 16(B), the area enclosed by the dashed line is converted into the text "There have been burglaries in the neighborhood, so please be careful."

[0128] As shown in S120, the kanji characters are converted to hiragana and katakana. Specifically, "There have been burglaries in the neighborhood, so please be careful." is converted to "kinjo asu hassei juubun chuui".

[0129] As shown in S121, it is converted into a short sentence. Specifically, it is converted to "Beware of burglaries in the neighborhood".

[0130] As shown in S122, the processing unit 13 will illustrate short sentences if possible. Specifically, as shown in Figure 14, it will illustrate short phrases such as "Beware of burglars in the neighborhood." More specifically, as shown in Figure 15, these are displayed on the left display 71 and the right display 81 near the lenses 5 and 6.

[0131] As shown in S123, if image processing is complete (step S123:Y), the process ends. On the other hand, if image processing is not complete (step S123:N), the process returns to step S118. Specifically, for example, if you continue to view the image (flyer), the process returns to step S118.

[0132] As shown in Figure 13, in cases of Wernicke's area damage (aphasia), it is difficult to understand what others are saying, even when listening to or reading it. Therefore, using glasses 1, which display kanji, hiragana, and katakana in addition to audio, makes it easier for the individual to understand. Furthermore, illustrations would further enhance understanding.

[0133] Figure 17 shows the individual wearing glasses 1, due to Broca's area damage caused by higher brain dysfunction. Broca's area damage makes it difficult to construct appropriate sentences when trying to communicate one's thoughts to others.

[0134] As shown in S140, if the desired utterance is output (step S140:Y), proceed to step S141; if there is no output (step S140:N), proceed to step S147. Specifically, for example, if the person (with Broca's aphasia) speaks aloud, proceed to step S141.

[0135] As shown in S141, the person collects information from their ears, eyes, smartphone, etc. Specifically, they want to say "My appendicitis hurts" but can't say anything more than "chu...chu...", so they press their hand against the right side of their abdomen. The camera 21 then recognizes this action, and the processing unit 13 identifies the right side of the body. Also, when the person says "it hurts" aloud, microphones 23 and 24 recognize the word "it hurts".

[0136] As shown in S142, a sentence is created based on the collected information. Specifically, the generation AI of the processing unit 13 (API 25) infers that there is a high possibility of appendicitis based on the information "right side of the body" and "pain," and creates the sentence "appendicitis" based on that. Furthermore, it is more appropriate to add a question such as "Is it appendicitis?" in addition to "appendicitis."

[0137] As shown in S143, information is output to the left and right displays. Specifically, the generated text "Appendicitis" is output to the left display 71 and the right display 81. Furthermore, to make it easier to understand, as shown in Figure 18, the text and illustration "Is it appendicitis?" created by the generation AI are also displayed on the left and right displays. It is also possible to output sound from speakers 31 and 41.

[0138] As shown in S144, if the person can be identified (step S144:Y), proceed to step S145; if the person cannot be identified (step S144:N), return to step S141. Specifically, if the person understands that "I have appendicitis and my body hurts," proceed to step S145.

[0139] As shown in S145, the device outputs audio to others. Specifically, the processing unit 13 converts the text "My body aches because of appendicitis" into speech in the speech unit 12 and outputs it through the speaker 22. This allows others to understand that the person is saying "My body aches because of appendicitis."

[0140] As shown in S146, if the voice from another person (e.g., a doctor) has finished (step S146:Y), the process ends. On the other hand, if the voice has not finished (step S146:N), the process returns to step S141. It is also possible to return to step S145.

[0141] As shown in S147, if the desired hand movement is output (step S147:Y), the process proceeds to step S148; if there is no output (step S147:N), the process terminates. Specifically, for example, if the person (with Broca's aphasia) writes something, the process proceeds to step S148.

[0142] As shown in S148, a sentence is created based on the collected information. Specifically, the generation AI in processing unit 13 infers that there is a high possibility of appendicitis based on the information "right side of the body" and "pain," and creates the sentence "appendicitis" based on that. Furthermore, it is more appropriate to add a question such as "Is it appendicitis?" in addition to "appendicitis."

[0143] As shown in S149, a sentence is created based on the collected information. Specifically, the generation AI in processing unit 13 infers that there is a high possibility of appendicitis based on the information "right side of the body" and "pain," and creates the sentence "appendicitis" based on that. Furthermore, it is more appropriate to add a question such as "Is it appendicitis?" in addition to "appendicitis."

[0144] As shown in S150, information is output to the left and right displays. Specifically, the generated text "Appendicitis" is output to the left display 71 and the right display 81. Furthermore, to make it easier to understand, as shown in Figure 18, the text and illustration "Is it appendicitis?" created by the generation AI are also displayed on the left and right displays. It is also possible to output sound from speakers 31 and 41.

[0145] As shown in S151, if the person can be identified (step S151:Y), proceed to step S152; if the person cannot be identified (step S151:N), return to step S148. Specifically, if the person understands that "I have appendicitis and my body hurts," proceed to step S152.

[0146] As shown in S152, the patient writes a message. Specifically, the patient writes "My body aches because of appendicitis" using a pencil or similar writing instrument. Furthermore, the handwritten characters are read, recognized by the processing unit 13, and saved as text data. By having the patient write the message themselves, the doctor can understand its content.

[0147] As shown in S153, the process ends when the person has finished writing (step S153:Y). On the other hand, if the person has not finished writing (step S153:N), the process returns to step S148. Specifically, if the person is writing with a pencil or similar, the process returns to step S148.

[0148] As shown in Figures 12 to 18, not only Wernicke's aphasia and Broca's aphasia exist, but also global aphasia with Wernicke's aphasia and Broca's aphasia, or conduction aphasia. Conduction aphasia refers to a condition in which there is a problem with communication between Wernicke's area and Broca's area, where the person can understand what others are saying, but has difficulty repeating it or speaking appropriately.

[0149] Furthermore, as shown in Figures 12 to 18, using glasses 1 makes it possible to communicate with others even if you have aphasia.

[0150] (E) Description of the operation of the fourth embodiment of the present invention Next, embodiments of the present invention will be described. Figure 19 shows executive function disorder accompanied by higher brain dysfunction. Executive function is a complex higher brain function that oversees a series of cognitive activities from planning and formulating something to completing it. For example, planning to make curry and salad falls under executive function.

[0151] Figure 19 shows a person with executive function disorder using glasses 1.

[0152] As shown in S170, if the user performs the task (step S170:Y), the process proceeds to step S171; otherwise, the process terminates (step S170:N). Specifically, for example, if the user performs the task, they press button 19 or 20, or speak a specific phrase such as "I'll do it!" into microphones 23 or 24. The processing unit 13 then starts the task execution.

[0153] As shown in S171, a goal is set. Specifically, for example, if the person's goal is "curry" and "salad," the voice output will say, "Curry and salad are your goals." Microphones 23 and 24 receive this voice and record it in the storage unit 11 via the processing unit 13.

[0154] As shown in S172, planning is performed. Specifically, for example, when making curry and salad, a plan is made considering the cooking procedures and ingredients for each. More specifically, the processing unit 13 uses a smartphone via the communication unit 14 or the smartphone connection unit 18 to make a plan based on the cooking procedures and ingredients, and outputs it to the speakers 31, 41 and the left display 71 and the right display 81.

[0155] As shown in S173, the procedure, time, plan, tools, etc. are prepared. Specifically, when making curry and salad, the necessary ingredients and tools for cooking are gathered, and the time required for cooking is planned. More specifically, the processing unit 13 uses a smartphone via the communication unit 14 or the smartphone connection unit 18 to prepare each procedure, time, plan, and tool, and outputs them to the speakers 31, 41 and the left display 71 and right display 81.

[0156] As shown in S174, if the person confirms the planning and procedures (step S174:Y), proceed to step S175; otherwise (step S174:N), the process returns to step S172. More specifically, confirm the planning, procedures, time, plan, tools, etc., and if everything is alright, proceed to step S175. Further specifically, confirm the planning, procedures, time, plan, tools, etc., and if there are no problems, proceed to step S175.

[0157] As shown in S175, the person takes action. Specifically, the person initiates the action, for example, by gathering ingredients for curry and salad, cutting vegetables, sautéing meat, or simmering it.

[0158] As shown in S176, the actions are monitored. Specifically, when the person is performing an action, the camera 21 is used to confirm the action, and the actions are monitored via audio using microphones 23 and 24.

[0159] As shown in S177, each step is checked. Specifically, the processing unit 13 checks each step based on the monitoring data. In detail, if the user is unsure how to use the onion, the instructions "Peel the onion, cut it in half lengthwise, and then chop it finely" are output by speakers 31 and 41 and displayed on the left display 71 and the right display 81.

[0160] As shown in S178, if an unexpected situation occurs (step S178:Y), the process proceeds to step S179; if no unexpected situation occurs (step S178:N), the process proceeds to step S180. Specifically, if the user has stir-fried the vegetables first, the processing unit 13 outputs the message "Please stir-fry the meat" through the audio unit 12 to speakers 31 and 41, and displays it on the left display 71 and the right display 81.

[0161] As shown in S179, the system modifies its actions in response to unexpected situations. Specifically, if the user needs to "fry the meat" first, the system can modify the instruction and output it accordingly.

[0162] As shown in S180, if planning is complete (step S180:Y), the process ends. On the other hand, if planning is not complete (step S180:N), the process returns to step S175. Specifically, if planning is not complete, the process returns to step S175.

[0163] As described above, if an individual develops executive function disorder, using glasses 1 can support their performance and enable them to participate in activities in various fields.

[0164] (F) Description of the operation of the fifth embodiment of the present invention Next, embodiments of the present invention will be described. Figure 20 shows a social behavior disorder accompanied by higher brain dysfunction. A social behavior disorder refers to a condition in which it becomes difficult to control emotions and behavior due to brain damage or other causes, which impairs social life. For example, relationships with family and friends may deteriorate, or feelings of isolation may be experienced.

[0165] Figure 20 shows a person with a social behavior disorder wearing glasses 1.

[0166] As shown in S190, if the person's patience reaches its limit (step S190:Y), proceed to step S191; otherwise, proceed to step S196. The person's patience reaching its limit refers to situations such as speaking loudly or becoming prone to emotional outbursts.

[0167] As shown in S191, if a social behavior disorder is observed (step S191:Y), the process proceeds to step S192; if there is no social behavior disorder (step S191:N), the process proceeds to step S196. Specifically, if statements such as "Ah!", "Help!", or "Shut up!" are input from microphones 23 and 24, the processing unit 13 determines that there is a high possibility of a social behavior disorder and proceeds to step S192. More specifically, if the same thing is said repeatedly, if someone shouts at the user, or if the user has difficulty adapting to a new environment, there is a high possibility of a social behavior disorder, and this information is recorded in the storage unit 11.

[0168] As shown in S192, the history of past social behavioral disorders is checked. Specifically, it is checked whether there are any statements corresponding to social behavioral disorders, such as "Ah!", "Help!", and "Shut up!", recorded in the memory unit 11.

[0169] As shown in S193, if there is a history, it is output to the speaker. Specifically, since speakers 31 and 41 are installed near the person's ears, the processing unit 13 outputting the person's past voices such as "Ah!", "Help!", and "Shut up!" is likely to make it easier to control emotions. In addition, outputting "You did a good job" as a token economy program may further promote emotional control.

[0170] As shown in S194, the time-out method, TOOTS, and situational time-out are implemented. Specifically, the time-out method is a method of temporarily interrupting interaction when problematic behavior is observed, for example, by temporarily moving the person to a quiet and safe place to allow them to calm down. TOOTS (Time-Out Oriented Observation Training System) is a method in which staff leave the area for a few seconds and ignore the person when problematic behavior is observed, and then act as if nothing happened. Furthermore, situational time-out is a method of moving the person to another room or a corner of the room when problematic behavior is observed. The processing unit 13 can use the camera 21 and speakers 31, 41 to implement the time-out method, TOOTS, and situational time-out.

[0171] As shown in S195, if the social behavior disorder is resolved (step S195:Y), the process ends. On the other hand, if it is not resolved (step S195:N), the process returns to step S194. Specifically, the social behavior disorder may be resolved when the processing unit 13 uses the camera 21 and speakers 31,41 to perform the time-out method, TOOPS, and situational time-out.

[0172] As shown in S196, if social behavioral disorders have not occurred for a predetermined period of time (step S196:Y), proceed to step S197. On the other hand, if they have occurred for a predetermined period of time (step S196:N), terminate the process. Specifically, if social behavioral disorders have not occurred for a predetermined period of time, proceed to step S197 if several minutes to several tens of minutes have passed for short-term goals, or several hours to one day for long-term goals.

[0173] As shown in S197, a token economy program is implemented. Specifically, it provides a system where rewards such as cards, coins, or outings are given along with words of praise, and these can be exchanged for perks such as sweets or outings. More specifically, the processing unit 13 displays the message "You did a great job!" from the memory unit 11 on the left display 71 and the right display 81, and simultaneously outputs it as sound from speakers 31 and 41.

[0174] As described above, using glasses 1 is highly likely to improve the individual's social behavioral disorder.

[0175] (G) Description of the operation of the sixth embodiment of the present invention Next, embodiments of the present invention will be described. Figure 21 shows agnosia accompanied by higher brain dysfunction. Agnosia refers to a condition in which information obtained from the five senses (sight, hearing, touch, etc.) is not properly processed in the brain due to brain damage, making it impossible to understand the meaning and function of things.

[0176] Figure 21 shows a person with agnosia using glasses 1.

[0177] As shown in S210, if agnosia is present (step S210:Y), the process proceeds to step S211; otherwise, the process ends. Specifically, if the person is unable to correctly perceive visual, auditory, or tactile information, the process proceeds to step S211. Visual information can be viewed on the left display 71 and the right display 81. Auditory information can be understood through sounds output from speakers 31 and 41. Furthermore, regarding tactile information, speakers 31 and 41 operate near the ears, and if there is a loud low-frequency sound, it can be understood through the vibrations.

[0178] As shown in S211, if visual comprehension is not possible (step S211:Y), the process proceeds to step S212; if comprehension is possible (step S211:N), the process proceeds to the next step. Specifically, in cases of agnosia, individuals may face various difficulties in daily life, such as not knowing what kind of food is, not being able to distinguish between the front and back or top and bottom of clothing, getting lost, or not being able to recognize people's faces. More specifically, if visual information cannot be understood on the left display 71 and the right display 81, the process proceeds to step S212.

[0179] As shown in S212, the message "Please use your sense of touch and hearing" is output. Specifically, the processing unit 13 outputs the information "Please use your sense of touch and hearing" stored in the memory unit 11 to the speakers 31, 41 and the left display 71 and right display 81. As a result, even if something cannot be recognized visually, the likelihood of recognition increases by using the sense of touch and hearing.

[0180] As shown in S213, if auditory comprehension is not possible (step S213:Y), proceed to step S214; if comprehension is possible (step S213:N), proceed to the next step. Specifically, if agnosia is present, it may be difficult to participate in conversations, understand radio or television news, or hear approaching cars or warning sounds, potentially leading to dangerous situations. More specifically, if auditory information cannot be understood from the sounds output from speakers 31 and 41, proceed to step S214.

[0181] As shown in S212, the message "Please use your sight and touch" is output. Specifically, the processing unit 13 outputs the information "Please use your sight and touch" stored in the memory unit 11 to the speakers 31, 41, and the left display 71 and right display 81. As a result, even if recognition is not possible through hearing, the likelihood of recognition increases by using sight and touch.

[0182] As shown in S215, if understanding is not possible through touch (step S215:Y), the process proceeds to step S216; if understanding is possible (step S215:N), the process ends. Specifically, in cases of agnosia, the user may not be able to determine the hardness or temperature of food, recognize the material and shape of clothing, or the shape of everyday objects such as cups and keys, and therefore may not know how to use them. More specifically, regarding touch, if understanding is not possible through the sounds output from speakers 31 and 41, the process proceeds to step S216.

[0183] As shown in S216, the message "Please use your sight or hearing" is output. Specifically, the processing unit 13 outputs the information "Please use your sight or hearing" stored in the memory unit 11 to the speakers 31, 41, and the left display 71 and right display 81. As a result, even if recognition is not possible by touch, the likelihood of recognition increases by using sight or hearing.

[0184] As described above, using glasses 1 makes it highly likely that the individual will see an improvement in their agnosia.

[0185] (H) Description of the operation of the seventh embodiment of the present invention Next, embodiments of the present invention will be described. Figure 22 shows topographic agnosia accompanied by higher brain dysfunction. Topographic agnosia refers to a condition caused by brain damage that makes it difficult to recognize or judge places.

[0186] Figure 22 shows a person with geographical agnosia using glasses 1.

[0187] As shown in S230, if geographical agnosia is present (step S230:Y), the process proceeds to step S231; otherwise, the process ends (step S230:N). Specifically, for example, if a person gets lost in a familiar place or is unable to draw a floor plan of their home or a map of their neighborhood, it is determined that they have geographical agnosia (step S230:Y), and the process proceeds to step S231.

[0188] As shown in S231, if there is a destination (step S231:Y), proceed to step S232; if there is no destination (step S231:N), terminate the process. Specifically, for example, if you want to return home (destination) from a new restaurant, proceed to step S232.

[0189] As shown in S232, confirm your destination. Specifically, if you don't know where you are when returning home from a restaurant, confirm your home, which is your destination.

[0190] As shown in S233, the current location is determined using GPS26. Specifically, by using GPS26, you can accurately determine your location (latitude and longitude).

[0191] As shown in S234, the route is confirmed. Specifically, the destination and current location can be confirmed via the route. More specifically, whether traveling by car, bus, bicycle, or on foot, the destination and current location can be determined via the route using the communication unit 14 or a smartphone. More specifically, the route is created through the processing unit 13, communication unit 14, smartphone, etc. As a result, dotted lines indicating the route are displayed on the lenses 5 and 6 on the left display 71 and the right display 81, as shown in Figure 23.

[0192] As shown in S235, if the destination and route are appropriate (step S235:Y), proceed to step S236. On the other hand, if the destination and route are not appropriate (step S235:N), return to step S232. Specifically, if the destination, route, and means of transportation are correctly understood, for example, if walking home from a restaurant is an appropriate route, proceed to step S236.

[0193] As shown in S236, the GPS26 is used to determine the current location. Specifically, the GPS26 allows you to accurately determine your location (latitude and longitude).

[0194] As shown in S237, the route is confirmed. Specifically, the route is confirmed. Specifically, the destination and current location can be confirmed by route. In detail, the route is created through the processing unit 13, the communication unit 14, a smartphone, etc. As a result, dotted lines indicating the route are displayed on the lenses 5 and 6 on the left display 71 and the right display 81, as shown in Figure 23.

[0195] As shown in S238, if the destination is reached (step S238:Y), the process ends. On the other hand, if the destination has not been reached (step S238:N), the process returns to step S236.

[0196] As described above, using glasses 1 is highly likely to improve the patient's topographical agnosia.

[0197] (I) Description of the operation of the eighth embodiment of the present invention Next, embodiments of the present invention will be described. Figure 24 shows apraxia accompanied by higher brain dysfunction. Apraxia refers to a condition in which intended movements cannot be performed smoothly due to brain damage.

[0198] Figure 24 shows a person with apraxia wearing glasses 1.

[0199] As shown in S250, if apraxia is present (step S250:Y), the process proceeds to step S251; if there is no apraxia (step S250:N), the process ends. Specifically, there are constructional apraxia, ideomotor apraxia, ideational apraxia, dressing apraxia, walking apraxia, and other types of apraxia.

[0200] As shown in S251, if the user does not know how to use it (step S251:Y), the process proceeds to step S252, and if the user does know how to use it (step S251:N), the process ends. Specifically, if the user says, "I don't know how to use it!", that voice is input to microphones 23 and 24, and if the processing unit 13 determines that it cannot understand it, the process proceeds to step S252.

[0201] As shown in S252, select the method of use. Specifically, there are options (1) to (5), so you can select the appropriate method of use. (1) Constructional apraxia: Inability to properly construct three-dimensional structures, such as imitating puzzles. A disorder of spatial manipulation. (2) Ideomotor apraxia: Automatic movements are possible, but intentional movements are difficult, and using a single object is difficult. (3) Ideational apraxia: Individual actions such as making tea or brushing teeth are possible, but performing a series of actions becomes difficult. (4) Dressing apraxia: There are no problems with the movement of the limbs, but the person is unable to dress themselves. (5) Gait apraxia: Inability to walk despite having no paralysis or other physical impairment.

[0202] As shown in S253, the usage instructions are displayed as a video. Specifically, a video of how to use the device is acquired from the storage unit 13 or the communication unit 14 and displayed on the left display 71 and the right display 81. In detail, for example, in the case of ideational apraxia, the video shows the procedure for making tea, including opening the lid of the teapot and pouring hot water from the pot.

[0203] As shown in S254, instructions on how to use the device are provided via voice. Specifically, voice instructions on how to use the device are acquired from the memory unit 13 or the communication unit 14 and output by speakers 31 and 41. In detail, for example, in the case of ideational apraxia, voice instructions such as "Open the lid of the teapot and pour hot water from the pot" are provided for the procedure of making tea.

[0204] As shown in S255, if the usage is finished (step S255:Y), the process ends; if the usage is not finished (step S255:N), the process returns to step S252.

[0205] As described above, using glasses 1 makes it highly likely that the individual will be able to improve their apraxia.

[0206] (J) Description of the operation of the ninth embodiment of the present invention Next, embodiments of the present invention will be described. Figure 25 shows that easy fatigability with higher brain dysfunction refers to a condition in which, due to brain damage, a person becomes fatigued much faster than before during normal activities.

[0207] Figure 25 shows a person with fatigue-prone skin using glasses 1.

[0208] As shown in S270, if the brain is prone to fatigue (step S270:Y), the process proceeds to step S271; if the brain is not prone to fatigue (step S270:N), the process ends. Specifically, a damaged brain consumes more energy than usual to maintain normal function, so even light work can quickly lead to fatigue.

[0209] As shown in S271, if the brain energy needs to be checked (step S271:Y), the process proceeds to step S272; otherwise, the process ends (step S271:N). Specifically, since brain energy varies from person to person, the brain energy level can be determined by setting 100% to represent extreme fatigue and 0% to represent a state of not being fatigued at all. The information regarding brain energy is recorded in the memory unit 11 by the processing unit 13.

[0210] As shown in S272, symptoms of easy fatigability are checked. Specifically, symptoms of easy fatigability include physical fatigue (lethargy, sluggishness, headache, stiff shoulders, etc.), mental fatigue (decreased concentration, decreased motivation, irritability, anxiety, etc.), sleep disorders (insomnia or hypersomnia), and a feeling of heaviness in the body (feeling heavy in the limbs, general sluggishness). In detail, for example, if the processing unit 13 uses the camera 21 and microphones 23,24 and the person says aloud, "I'm suffering from physical fatigue," the processing unit 13 will output through speakers 31,41, "Do you mean lethargy, sluggishness, headache, stiff shoulders, etc." and the person will respond, "Yes," allowing the processing unit 13 to understand the situation.

[0211] As shown in S273, the effects of easy fatigue are examined. Specifically, as an impact on daily life, it may become difficult to perform household chores, childcare, and work. In terms of limitations on social participation, it may become difficult to perform tasks requiring concentration or activities that last for long periods, which may limit social participation. In terms of mental burden, a constant feeling of fatigue may persist, leading to mental distress. In detail, for example, when the processing unit 13 uses the camera 21 and microphones 23 and 24 and the person says "I'm working", the processing unit 13 outputs "Is work a little difficult?" through speakers 31 and 41, and the person replies "A little," allowing the processing unit 13 to understand the situation.

[0212] As shown in S274, brain energy consumption is checked. Specifically, if brain energy consumption is increased, even light work will cause fatigue, and simple tasks will consume a lot of energy. Mental stress accumulates due to dealing with social life, further consuming energy. In detail, the processing unit 13 uses the camera 21 and microphones 23,24 to check brain energy consumption, for example, by observing the person performing light work or dealing with social life.

[0213] As shown in S275, the brain's energy is managed and controlled. Specifically, for example, light work increases brain energy consumption, causing brain energy to decrease from 100% to 95%. In detail, the processing unit 13 monitors the person's light work using the camera 21 and microphones 23 and 24, and the processing unit 13 records the decrease in energy in the memory unit 11. Methods to reduce brain energy consumption include a reasonable lifestyle (sufficient sleep and a regular lifestyle), ensuring rest (taking frequent breaks during work), and adjusting the environment (working in a quiet and well-lit place). In addition to the person themselves, it is also important to provide support to those around them by respecting the person's pace (not forcing them, but supporting them at their own pace), encouraging breaks (encouraging them to take breaks when they feel tired), creating a suitable environment (making it possible to work in a quiet and well-lit place), and gaining understanding from those around them (seeking understanding from family, friends, and colleagues regarding higher brain dysfunction).

[0214] As shown in S276, if the brain energy check is complete (step S276:Y), the process ends. On the other hand, if the brain energy check is not complete (step S276:N), the process returns to step S272. Specifically, for example, if the checks regarding the impact on daily life, limitations on social participation, and mental burden are complete (step S276:Y), the process ends.

[0215] As described above, using glasses 1 is highly likely to improve the wearer's fatigue.

[0216] (K) Description of modified embodiments The above is just one example of an embodiment of the present invention, but the present invention is not limited to the embodiments described above. For example, the glasses 1 can be used not only for higher brain dysfunction but also for cognitive dysfunction. However, since the type and degree of the disability vary from person to person, adjustments accordingly are necessary.

[0217] Furthermore, it is not necessary to use both the left display 71 and the right display 81 of glasses 1; one can be used, or neither can be used at all.

[0218] Furthermore, it is not necessary to use both speakers 31 and 41 of glasses 1; it is also acceptable to use only one or not use any at all.

[0219] Furthermore, it's also fine to not use GPS26 at all.

[0220] Furthermore, when using the generated AI with API 25, the generated AI can also be used via the communication unit 14. Alternatively, the generated AI may be used directly by the processing unit 13.

[0221] Furthermore, this invention is broadly applicable to higher brain dysfunction and can be used without problems not only in cases of mild impairment but also in moderate and severe cases. Specifically, this system operates adaptively according to an individual's communication ability and can be customized to the specific needs and abilities of each user. Even for severely disabled individuals, the visual and auditory feedback of this system supports daily communication and contributes to improving the quality of life. Moreover, this invention can function as a professional aid for disabled individuals or as an effective communication tool in itself. Through this invention, disabled individuals can reduce barriers to communication with others and participate in society with greater confidence.

[0222] Furthermore, Glasses 1 can be used not only by people with disabilities, but also for communication between able-bodied individuals. For example, able-bodied individuals who are hard of hearing or who have difficulty reading long texts can use Glasses 1 to facilitate smoother communication.

[0223] Furthermore, with Glasses 1, even with memory impairment, important information, appointments, faces, and names can be easily recorded and retrieved, allowing for quick recall even if forgotten. This eliminates the need to rely on memory, enabling a more confident and secure daily life.

[0224] Furthermore, Glasses 1 is also effective for higher-order brain dysfunctions such as attention deficit, executive function disorder, social behavior disorder, agnosia, apraxia, and easy fatigability. Users with these disorders can use Glasses 1 to organize important information in daily life and social activities, and to support appropriate behavior. In addition, Glasses 1 monitors the progress of work and activities and prompts rest as needed to reduce fatigue, enabling users to continue living without strain. [Explanation of symbols]

[0225] 1: Glasses 2: Bridge 3,4: Temple 5,6: Lens 7: Left half mirror 8: Right half mirror 11: Storage section 12: Audio section 13: Processing Unit 14: Communications Department 15: RAM 16: ROM 17: Power supply section 18: Smartphone connection section 19,20: Buttons 21: Camera 22: Speaker 23,24: Mike 25: API 26: GPS 31,41: Speakers 71: Left display 81: Right display

Claims

1. In a display device to be attached to the head of a user with higher brain dysfunction, If a specific part of the user's brain is damaged, A voice input method for inputting voice, An image input method for inputting images, A processing means that inputs the aforementioned audio and / or the aforementioned images and performs processing to support brain function due to the aforementioned higher brain dysfunction, A display device characterized by having the following features.

2. The processing means records the facial image or name of another person, so that even if it is forgotten, it can be understood by searching. The display device according to feature 1.

3. The processing means records the time and location using GPS. The display device according to feature 2.

4. The processing means converts the sound into text and records it. The display device according to claim 2 or 3.

5. The processing means converts the characters into simplified characters and records them. The display device according to feature 4.

6. The processing means converts the characters into illustrations and records them. The display device according to feature 4 to 5.

7. The processing means records valuables or agreements in the image input means so that even if they are forgotten, they can be understood by searching. The display device according to feature 1.

8. If there is an attention deficit due to the aforementioned higher brain dysfunction, the voice input means outputs sound. The display device according to feature 1.

9. In the case of aphasia due to the aforementioned higher brain dysfunction, the voice input means converts the speech into text. The display device according to feature 1.

10. If the aforementioned higher brain dysfunction results in aphasia, the image input means converts the image into text. The display device according to feature 1.

11. If the number of characters is less than or equal to a certain number, the audio or image will be converted. The display device according to claim 9 or 10.

12. By gathering information, you can create a document. The display device according to claim 9 or 10.

13. To illustrate the aforementioned audio or the aforementioned image, The display device according to claims 9 to 12.

14. In the case of executive function impairment due to the aforementioned higher brain dysfunction, the user is monitored by inputting the voice and / or images while performing the task. The display device according to feature 1.

15. If the aforementioned higher-order brain dysfunction results in social behavioral disorders, the system checks the history of past social behavioral disorders. If the same history exists, it outputs the same voice; if the same history exceeds a certain number, it outputs a token economy program. The display device according to feature 1.

16. In cases of agnosia due to the aforementioned higher brain dysfunction, where comprehension is not possible through sight, hearing, or touch, the system outputs auditory and tactile information, visual and tactile information, and visual and auditory information. The display device according to feature 1.

17. In cases of agnosia due to the aforementioned higher brain dysfunction, and in cases of topographical agnosia, the current location and destination are identified, and the route is confirmed using GPS. The display device according to feature 1.

18. In cases of apraxia, a type of higher brain dysfunction, where the user does not know how to use the device, the user can select an instruction, which will be displayed as a video and audio. The display device according to feature 1.

19. In cases of easy fatigability due to the aforementioned higher brain dysfunction, when checking brain energy, the symptoms, effects, consumption, and responses to easy fatigability are checked. The display device according to feature 1.

20. In a display method to be attached to the head of a user with higher brain dysfunction, If a specific part of the user's brain is damaged, The voice input step involves entering voice, Image input step where you input an image, A processing step of inputting the aforementioned audio and / or the aforementioned image and performing processing to support brain function due to the aforementioned higher brain dysfunction, A display method characterized by comprising the following features.

Images