Dementia simulation device and dementia simulation program

Abstract

To provide a device and program for simulated dementia experience, which allow a user to experience simulated dementia by reproducing simulated vision of a dementia patient.SOLUTION: A dementia experience device designed to be worn on the head of a user for use is provided, the device comprising image capturing means for capturing images of the real world, correction means for correcting captured image information, and display means configured to display on a display screen the corrected state of the real world based on the corrected image information.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to a dementia pseudo-experience device and a dementia pseudo-experience program that can pseudo-experience dementia by pseudo-reproducing the vision of dementia patients.

Background Art

[0002] In recent years, with the increase in the elderly population, the number of dementia patients has also increased. In order to provide an environment in which dementia patients can live safely and comfortably, caregivers who take care of and support dementia patients are required to understand dementia more deeply. Under such circumstances, for example, it has been proposed to reproduce the vision of dementia patients using VR (virtual reality) technology to pseudo-experience dementia. However, since such a dementia pseudo-experience device represents the world that a dementia patient sees in a virtual space, it is less realistic than the real world and may not be able to be experienced in a state close to reality.

Summary of the Invention

Problems to be Solved by the Invention

[0003] The present invention has been made to solve such problems. That is, an object of the present invention is to provide a dementia pseudo-experience device that can pseudo-experience dementia by pseudo-reproducing the vision of dementia patients.

Means for Solving the Problems

[0004] The problems of the present invention are [1] A dementia pseudo-experience device that a user wears on the head and uses, comprising imaging means for imaging the real world, correction means for correcting the image information obtained by imaging, and display means for displaying the corrected state of the real world on a display screen based on the corrected image information; [2] The dementia simulation device according to [1], wherein the correction by the correction means corresponds to the symptoms of dementia, such as constricted visual field, decreased light perception, decreased pupillary response speed, decreased contrast perception, decreased depth perception, misrecognition of patterns, and / or misrecognition of reflexes; [3] A dementia simulation program that causes a computer device to function as an imaging means for capturing images of the real world, a correction means for correcting the image information obtained by imaging, and a display means for displaying the corrected state of the real world on a display screen based on the corrected image information; [4] A dementia simulation experience method comprising the steps of: attaching a dementia simulation device, which includes an imaging means for capturing images of the real world; a correction means for correcting image information obtained by imaging; and a display means for displaying the corrected state of the real world on a display screen based on the corrected image information, to the user's head so that the user can view the display screen; and having a third party, different from the user, guide the user to perform predetermined actions; This can be achieved. [Effects of the Invention]

[0005] According to the present invention, by simulating the vision of dementia patients, it is possible to experience dementia in a simulated way. [Brief explanation of the drawing]

[0006] [Figure 1] This is a block diagram showing the configuration of a computer device that constitutes a dementia simulation device according to an embodiment of the present invention. [Figure 2] This figure shows a flowchart of the display process according to an embodiment of the present invention. [Figure 3] This figure shows a flowchart of the first process according to an embodiment of the present invention. [Figure 4] This figure shows a flowchart of the second process according to an embodiment of the present invention. [Figure 5] This figure shows a flowchart of the third process according to an embodiment of the present invention. [Figure 6]This figure shows a flowchart of the fourth process according to an embodiment of the present invention. [Figure 7] This figure shows a flowchart of the fifth process according to an embodiment of the present invention. [Figure 8] This figure shows a flowchart of the sixth process according to an embodiment of the present invention. [Modes for carrying out the invention]

[0007] The following describes embodiments of the present invention, but the present invention is not limited to the following embodiments unless otherwise inconsistent with the spirit of the present invention.

[0008] Symptoms of dementia include, for example, visual impairment, attention deficit, and spatial and visual cognitive impairment. Visual impairments include, for example, constricted visual field, decreased light perception (seeing things darker than they actually are), decreased pupillary response speed (feeling more dazzled when the surroundings suddenly become brighter), and decreased contrast perception and color vision (reduced sensitivity to perceiving contrast, making it difficult to distinguish colors). Attention deficits include, for example, difficulty concentrating (easily influenced by the surrounding environment and unable to concentrate on what is in front of them) and difficulty with visual retrieval (unable to find desired information from a large amount of information). Spatial and visual cognitive impairments include misrecognition of patterns and reflections (patterns on things with patterns, such as the floor, appear to move, and patterns or reflections that don't actually exist appearing), and decreased depth perception (difficulty recognizing objects in three dimensions and not knowing how far away objects are). Furthermore, since most dementia patients are elderly, sensory impairments specific to the elderly include, for example, presbyopia (decreased visual acuity) and age-related hearing loss (decreased hearing).

[0009] The dementia simulation device of the present invention (hereinafter also referred to as the "simulation device") can display images on a screen that correspond to symptoms of dementia described above, such as constricted visual field, decreased light perception, decreased pupillary response speed, decreased contrast perception, decreased depth perception, misrecognition of patterns, misrecognition of reflexes, and / or decreased visual acuity, based on images of the real world. The simulation device can display an image on the screen that corresponds to only one symptom (for example, constricted visual field) from among symptoms such as constricted visual field, decreased light perception, decreased pupillary response speed, decreased contrast perception, decreased depth perception, misrecognition of patterns, misrecognition of reflexes, or decreased visual acuity, or it can display an image on the screen that corresponds to a state in which two or more symptoms (or all of the symptoms) are combined. Furthermore, the simulation device of the present invention can select which of the above symptoms to display on the screen through user operation. In addition, the simulation device of the present invention can output sounds corresponding to symptoms such as age-related hearing loss described above, based on sounds of the real world. The simulated experience device can also display images corresponding to one or more of the above-mentioned symptoms on the screen, while simultaneously outputting sounds corresponding to symptoms such as age-related hearing loss.

[0010] The simulated experience device consists of, for example, a portable computer device such as a smartphone, and a device for attaching this computer device to the user's head. By fixing the smartphone to the device and attaching it to the user's head, the display screen of the computer device can be fixed directly in front of both of the user's eyes. A commercially available smartphone goggle can be used as the device. The computer device that constitutes the simulated experience device is not particularly limited as long as it has an input function for inputting information, a display function for displaying images on the display screen, and / or an imaging function (camera function) for capturing images of the real world.

[0011] Figure 1 is a block diagram showing the configuration of a computer device such as a smartphone that constitutes a dementia simulation experience device according to an embodiment of the present invention. The computer device 1 consists of a control unit 11, RAM 12, storage unit 13, sound processing unit 14, graphics processing unit 15, communication interface 16, interface unit 17, video memory 19, display unit 21, and imaging unit 24, each connected by an internal bus.

[0012] The control unit 11 consists of a CPU and ROM. The control unit 11 executes programs stored in the storage unit 13 and controls the computer device 1. The RAM 12 is the work area of ​​the control unit 11. The storage unit 13 is a storage area for saving programs and data. The control unit 11 reads programs and data from the RAM 12 and processes them. By processing the programs and data loaded into the RAM 12, the control unit 11 outputs sound output instructions to the sound processing unit 14 and drawing instructions to the graphics processing unit 15.

[0013] The sound processing unit 14 is connected to the sound output device 20, which is a speaker. When the control unit 11 outputs a sound output instruction to the sound processing unit 14, the sound processing unit 14 outputs a sound signal to the sound output device 20. The computer device 1 may also have an audio acquisition unit. The sound output device 20 is a speaker, and may utilize headphones, earphones, bone conduction earphones, etc.

[0014] The graphics processing unit 15 is connected to the display device 21, which has a display screen 22. When the control unit 11 outputs a drawing command to the graphics processing unit 15, the graphics processing unit 15 loads the image into the video memory 19 and outputs a video signal to display the image on the display screen 22. The graphics processing unit 15 draws one image per frame. The duration of one image frame is, for example, 1 / 30th of a second.

[0015] It has a touch input unit 23 that receives input by contact by the player. The touch input unit 23 is not particularly limited as long as it can recognize contact operations such as pressing and moving by the user's finger, stylus, or the like.

[0016] An external memory 18 (e.g., SD card, etc.) is connected to the interface unit 17. The data read from the external memory 18 is loaded into the RAM 12, and arithmetic processing is executed by the control unit 11.

[0017] The communication interface 16 can be connected to the communication line 2 wirelessly or by wire, and can receive data via the communication line 2. The data received via the communication interface 16 is loaded into the RAM 12 and arithmetic processing is performed by the control unit 11, similar to the data read from the external memory 18.

[0018] The computer device 1 has a lens and includes an imaging unit 24 that images through the lens. The imaging unit 24 can image the real world. The image data imaged by the imaging unit 24 is loaded into the RAM 12, and arithmetic processing is executed by the control unit 11.

[0019] Next, the display processing will be described. FIG. 2 is a diagram showing a flowchart of the display processing according to an embodiment of the present invention. The order of each process constituting the flowchart described below is arbitrary as long as there is no contradiction or inconsistency in the processing content.

[0020] By starting the application program installed in the computer device 1 constituting the virtual experience device (step S1), the display processing is started. The user operates the computer device 1 to select which image corresponding to any of the symptoms such as visual field narrowing, decreased light perception, decreased speed of pupil reaction, decreased contrast sensation, decreased depth sensation, pattern misrecognition, or reflection misrecognition is to be displayed on the display screen (step S2). Also, in step S2, it is possible to select whether to output sound information corresponding to the symptom of presbycusis.

[0021] Furthermore, the user can adjust the severity of the selected symptom by operating the computer device 1 (step S3). For example, if the symptom is visual field constriction, the user can adjust the range of peripheral vision that becomes difficult to see (or disappears) to be larger or smaller. Similarly, if the symptom is decreased pupillary response speed, the user can adjust the pupillary response speed to be significantly or slightly reduced. If the symptom is decreased contrast perception, the user can adjust the symptom by arbitrarily selecting a combination of the original and changed colors (for example, changing blue to green, pink to red, etc.). In this way, by adjusting the severity of the symptom, the user can experience both severe and mild symptoms. Multiple symptom severity levels, such as mild or severe, are pre-set, and the user may adjust the severity of the symptom by pressing the displayed symptom severity level option. The user can also adjust the severity of the selected symptom while viewing the image reproduced by the imaging unit 24 and displayed on the display screen. If only one symptom severity level is selected, the adjustment in step S3 can be omitted. Image processing for reproducing various symptoms will be described later.

[0022] In step S2, the selection of symptoms may be limited to one symptom, or multiple symptoms may be selected. In other words, an image combining multiple symptoms may be displayed on the screen. When selecting multiple symptoms, the system may select multiple symptoms in step S2 and adjust the severity of each symptom in step S3, or it may select symptoms one by one and repeat steps S2 and S3 until all symptoms to be reflected in the image have been selected. Alternatively, the system may select the severity of symptoms to be displayed on the screen from a set of options corresponding to the severity of symptoms in dementia patients. For example, in step S2, multiple options for symptom severity such as severe, moderate, and mild may be displayed. In this case, the symptom severity is pre-set to include one or more symptoms to be reflected in the image displayed on the screen, as well as adjustments to the severity of each symptom. When selecting a mild symptom severity, the system combines pre-set symptoms of mild dementia patients (e.g., visual field constriction and decreased pupillary response speed) and displays an image on the screen corresponding to the selected symptom severity.

[0023] Once the selection of symptoms in step S2 and the adjustment of the severity of symptoms in step S3 are complete, the display mode is started (step S4). When the display mode is started, the user puts the simulation device, including computer device 1, on their head.

[0024] The imaging unit 24 captures images of the real world (step S5). When the user wears the simulation device on their head, the imaging unit 24 can capture images of the real world in the direction the user would be looking if they were not wearing the simulation device. In other words, it is preferable that the imaging unit 24 is positioned so that the direction of the user's line of sight and the direction of the imaging unit 24's viewing axis are approximately parallel when the user wears the simulation device on their head. This allows the imaging unit 24 to correct the image of the real world it captures and display it on the display screen 22, so that the real world the user would be looking at if they were not wearing the simulation device is displayed on the display screen 22 in a corrected state.

[0025] The captured image information is corrected according to the symptom selected in step S2 and / or the degree of the symptom adjusted in step S3 (step S6). Next, based on the corrected image information, the corrected real-world state is displayed on the display screen 22 (step S7). Here, the image information refers to the RGB (red, green, blue) gradation values ​​(also called pixel values ​​or density values) for each pixel that makes up the image, or the HSB (hue, saturation, brightness) values ​​for each pixel that makes up the image. In step S6, the RGB gradation values ​​or HSB values ​​are corrected for each pixel according to the program set for each symptom.

[0026] Steps S5 to S7 are repeatedly executed every frame until the display mode ends. Therefore, the corrected state of the real world is displayed on the screen in real time according to the user's movements and orientation. The display mode ends when the user operates the computer device 1 (step S8). The display process ends when steps S1 to S8 are executed. By wearing the simulation device and executing the above display process, the user can simulate the visual and auditory symptoms of dementia patients.

[0027] Furthermore, the selection of symptoms in step S2, or the adjustment of the severity of symptoms in step 3, can also be performed by operating a computer device other than computer device 1, which constitutes the simulated experience device. In this case, a third party other than the user wearing the simulated experience device operates the other computer device. Information for performing the selection of symptoms in step S2 or the adjustment of the severity of symptoms in step 3, based on the information input to the other computer device, is transmitted to computer device 1 via communication. Similarly, the termination of the display mode in step S8 can also be performed by operating a different computer device. In addition, the attachment of the simulated experience device, including computer device 1, to the head may occur before step S1. In this case, it is preferable that the user or a third party other than the user performs the selection of symptoms in step S2 or the adjustment of the severity of symptoms in step 3 by operating a computer device other than computer device 1, which constitutes the simulated experience device.

[0028] By the way, the correction in step S6 is performed as follows, based on the symptoms selected in step S2 and the degree of symptoms adjusted in step S3. The correction for each symptom will be explained below.

[0029] In cases of visual field constriction, correction is performed to lower the brightness and saturation of the peripheral field of view. In other words, the brightness and / or saturation are reduced in the peripheral parts of the image, excluding the central part. For example, the brightness and / or saturation are reduced for pixels in predetermined ranges on the left or right side of the image that makes up the image displayed on the display screen. In addition, the brightness and / or saturation can also be reduced for pixels in predetermined ranges on the upper or lower side, not just the left or right side. Figure 3 shows a flowchart of the first process according to an embodiment of the present invention. The first process is a process to correct the image to correspond to the symptoms of visual field constriction. First, the computer device 1 extracts the roundness and / or smoothness that have been set in advance (step S10). Next, the degree (intensity) of the selected symptom set in step S3 is extracted (step S11). Based on the values ​​extracted in steps S10 and S11, the computer device 1 corrects the brightness and / or saturation of pixels in predetermined ranges of the image captured by the imaging unit 24 (step S12). Then, the corrected image is output (step S13), and the process ends.

[0030] In the above, "roundness" is a parameter used to identify the shape of the area in the image where brightness and / or saturation are not reduced. Specifically, "roundness" can be used to specify whether the shape of this area should be close to a polygon or round. It is preferable to pre-set the center of the area where brightness and / or saturation are not reduced as the center of the image, but this can be changed as appropriate. "Smoothness" is a parameter used to identify whether the boundary line where brightness and / or saturation are reduced is clear. If the smoothness is small, the boundary where brightness and / or saturation are reduced is clearly visible. If the smoothness is large, the boundary where brightness and / or saturation are reduced becomes ambiguous, and near the boundary, brightness and / or saturation gradually decrease as you move from the center to the periphery. As a result, the area near the boundary appears blurred. "Smoothness" can also be said to be a parameter used to identify the clarity and blurring of the boundary. "Intensity" is a parameter used to identify the range and degree to which brightness and / or saturation are reduced.

[0031] In the correction in step S12, the brightness and / or saturation of pixels in a predetermined range of the image are reduced. This can also be described as correcting the color of pixels in a predetermined range of the image to black. The first process can utilize vignette processing in general image editing based on pre-set values ​​for roundness, smoothness, and intensity. Furthermore, the values ​​for roundness, smoothness, and / or intensity in steps S10 and S11 are preferably pre-set according to the degree of the symptom, but they may also be set by the user in step S3. Alternatively, for example, roundness and smoothness may be set, and in step S3, the user may adjust the intensity of the image displayed on the screen while viewing the displayed screen. The first process uniformly corrects the gradation values ​​of pixels in a predetermined part of the image based on the values ​​for roundness, smoothness, and / or intensity in steps S10 and S11.

[0032] Reduced pupillary response speed, decreased light perception, misrecognition of patterns, or misrecognition of reflections are corrected by adjusting the hue and / or brightness within a predetermined range of tones (gradations). Specifically, this is done by gamma correction. Gamma correction adjusts the brightness relative to the gradation data of an image and is used to optimize the number of bits used when encoding an image and the bandwidth used when converting an image, utilizing the non-linear way in which humans perceive light and color. Figure 4 shows a flowchart of the second process according to an embodiment of the present invention. The second process can be applied to the process of correcting an image to correspond to symptoms of reduced pupillary response speed, decreased light perception, misrecognition of patterns, or misrecognition of reflections. First, based on the inputs of steps S2 and S3, the color tone range and gamma value pre-set in the computer device 1 are extracted (step S20). Next, based on the range of tones and gamma values ​​extracted in step S20, the imaging unit 24 extracts the corresponding tones from the captured image and corrects the RGB tones of the pixels corresponding to those tones (step S21). Then, the corrected image is output (step S22), and the process ends. The second process can utilize general color grading processes.

[0033] The range of tones to be corrected, the calculation formula for pixel correction, and the gamma value combination are set in advance in computer device 1, and in step S2, the range of tones to be corrected, the calculation formula for pixel correction, and the gamma value are determined according to the selected symptom. The image is mainly corrected for hue and / or brightness. Brightness may be set in advance, or the user may set it in step S3 while viewing the image on the display screen. The range of tones to be emphasized by the correction is broadly divided into three parts: dark areas, mid-tones, and bright areas. In step S2, if the symptom of decreased pupil response speed or misrecognition of patterns is selected, the range of tones to be emphasized by the correction is determined to be the dark areas. In step S2, if the symptom of decreased light perception or misrecognition of reflections is selected, the range of tones to be emphasized by the correction is determined to be the bright areas. The specific range of tones to be emphasized by the correction as dark areas or bright areas can be set in advance in computer device 1.

[0034] In corrections that emphasize dark areas, for example, pixels with an RGB tonal value of 256 are fixed, and the overall RGB tonal values ​​are lowered towards 0. By increasing the amount of decrease in the tonal value as the tonal value approaches 0, it is possible to effectively enhance the tonal range of the dark areas. On the other hand, in corrections that emphasize bright areas, pixels with an RGB tonal value of 0 are fixed, and the overall RGB tonal values ​​are increased towards 256. By increasing the amount of increase in the tonal value as the tonal value approaches 256, it is possible to effectively enhance the tonal range of the bright areas.

[0035] By correcting the highlights, it is possible to reproduce the misperception of reflections. Specifically, by emphasizing the color tone of the highlights in the image displayed on the screen, parts that are not actually reflected can be perceived as being reflected. Furthermore, by correcting the dark areas, it is possible to reproduce the misperception of patterns that appear to have patterns that do not actually exist. Note that since the correction of pixels is performed within the same color range for reduced light perception and misperception of reflections, it is preferable in step S3 to select the degree of the symptom for only one of the symptoms. Similarly, since the correction of pixels is performed within the same color range for reduced pupil response speed and misperception of patterns, it is preferable in step S3 to select the degree of the symptom for only one of the symptoms.

[0036] A decrease in color perception (also called a decrease in contrast perception) is achieved using a color grading curve, specifically a "hue-to-hue curve." Furthermore, depending on the color whose perception is being reduced, this can be achieved using a "hue-to-saturation curve," a "saturation-to-saturation curve," and / or a "brightness-to-saturation curve." Figure 5 shows a flowchart of the third process according to an embodiment of the present invention. The third process is a process of correcting the captured image to an image corresponding to the symptom of decreased contrast perception. First, the color to be corrected and the corrected color, input in step S3, are extracted (step S30). In step 30, simultaneously with the extraction of the colors before and after correction, the settings for the "hue-to-hue curve," "hue-to-saturation curve," "saturation-to-saturation curve," and / or "brightness-to-saturation curve" corresponding to the colors before and after correction are extracted. Next, the hue set by the color grading curve is detected from the image captured by the imaging unit 24 (step S31). The detected hue is corrected to the corrected hue, saturation, and brightness (step S32). The corrected image is output (step S33), and the process ends.

[0037] In step S3, the selectable color combinations for correction include, for example, blue and green (correcting blue to green), pink and red (correcting pink to red), etc. Prior settings include, for example, when correcting blue to green, using the "hue and hue curve" to correct the blue hue to the green hue, and, if necessary, using the "hue and saturation curve," "saturation and saturation curve," and / or "brightness and saturation curve" to set saturation and / or brightness correction values ​​so that the green-corrected area does not stand out from the other areas. In other words, it is preferable to pre-register the settings for the "hue and hue curve," "hue and saturation curve," "saturation and saturation curve," and / or "brightness and saturation curve" as color combinations that reproduce the symptoms of dementia patients. Users can select the color to correct from the registered options. Note that the effect of the third process is influenced by the surrounding environment. For example, the color of the image captured by the imaging unit 24 will differ under an incandescent lamp that emits yellow light and a fluorescent lamp that emits white light, which may result in a different color tone in the image output in the third processing step. Therefore, when selecting symptoms in step S2, the user may be asked to input information about the environment in which they are using the system. It is preferable to set the color grading curve according to the environment.

[0038] The reduction in depth perception is achieved by utilizing the camera's stereoscopic rendering. Users are unable to accurately grasp the physical position of what they are seeing and lose their sense of distance. Figure 6 shows a flowchart of the fourth process according to an embodiment of the present invention. The fourth process is a process to correct the image to correspond to the symptoms of reduced depth perception. First, the degree of the symptoms input in step S3 is extracted (step S40). Next, the image captured by the imaging unit 24 is cropped based on the extracted degree of the symptoms (step S41). Images to be displayed for the right eye and the left eye are generated using the cropped image. The generated images are output to the display screen 22 so that they can be viewed by the right eye and the left eye respectively (step S42), and the process ends.

[0039] Cropping refers to the process of displaying an image captured by a lens on a screen using only a predetermined range of pixels. For example, if an image is normally displayed on a 12 x 6 cm screen, cropping means enlarging the image so that only the pixels corresponding to 11.98 x 5.99 cm of the screen are displayed on the 12 x 6 cm screen. The center position of the displayed image remains the same as the center position of the image before cropping.

[0040] Generally, when providing images to users using VR (virtual reality) technology, parallax is used to display different images to the right and left eyes, creating a three-dimensional effect. In the fourth process, the captured image is cropped, and then separate images are generated for the right and left eyes. By displaying these images to the right and left eyes respectively, it is possible to reproduce a field of view that feels shallower in depth than the actual field of view in the real world. Furthermore, by cropping the captured image to an even narrower area, the degree of the reduced sense of depth can be intensified.

[0041] In one embodiment of the present invention, a simulated experience device can use commercially available smartphone goggles, but it is preferable to use a binocular simulated experience device that displays different images for the right and left eyes. The right and left sides of the display screen display the respective images independently, with the right eye viewing only the image for the right eye and the left eye viewing only the image for the left eye. If the symptom of reduced depth perception is not selected in step S2, images for the right and left eyes are generated without cropping the image in step S41. Furthermore, the first, second, third, and / or fifth processes are performed on the images for the right and left eyes, respectively. In the processing of reduced depth perception in one embodiment of the present invention, general VR image editing software can be applied to crop the image captured by the imaging unit 24 and generate the images to be displayed to each eye. In one embodiment of the present invention, a single-lens simulated experience device can also be used. When using a single-lens simulated experience device, images for the right and left eyes are not generated, and images on which the respective processes have been performed are displayed. In the fourth process, the image cropped in step S41 is output in step S42.

[0042] Changes in visual acuity are simulated by adjusting the focus characteristics of the camera lens. It can also be said that changes in visual acuity are achieved by adjusting the depth of field. Depth of field refers to the range of areas that appear in focus when the subject is in focus. Therefore, by reducing the range of focus in an image, a decrease in visual acuity can be reproduced.

[0043] Figure 7 shows a flowchart of the fifth process according to an embodiment of the present invention. The fifth process is a process to correct the image to correspond to the symptoms of decreased visual acuity. First, the computer device 1 extracts the pre-set focal length, focus distance, and / or aperture value (step S50). The computer device 1 corrects the focal length of the image based on the extracted focal length (step S51). Next, it corrects the focus distance of the image based on the extracted focus distance (step S52). Next, it corrects the aperture value of the image based on the extracted aperture value (step S53). Finally, it outputs the corrected image to the display screen (step S54) and terminates. Steps S52 to S54 may be executed in any order, and if only the aperture value is extracted in step S50, steps S51 and S52 can be omitted.

[0044] Focal length refers to the distance between the lens and the film (subject). The closer the distance between the lens and the film, the more blurred the image will be; the further the distance to the subject, the less blurred the image will be. Focus distance refers to the distance to the focal point. The longer the distance to the focal point, the more blurred the image will be; the shorter the distance to the focal point, the less blurred the image will be. Aperture value refers to the aperture, also called the F-number. The smaller the F-number, the narrower the range in which the image is in focus, making the image more blurred. Note that the focal length, focus distance, and / or aperture values ​​in step S51 may be set by the user in steps S2 and S3, or they may be pre-set according to the degree of the symptom. Alternatively, for example, the focal length and focus distance may be set, and in step S3, the user may adjust the aperture value while looking at the display screen.

[0045] Furthermore, changes in visual acuity may be performed by spatial filtering of the image. At this time, image smoothing is performed based on the degree of symptoms entered in step S3. Image smoothing is a process in which the average value of grayscale values ​​within a predetermined range is used as the grayscale value of the output image.

[0046] Furthermore, changes in hearing are performed by conducting 3D spatial calculations on the direction of sound, sound delay, and / or sound intensity for the actual sound acquired. Specifically, by flattening the direction of the output sound, the user becomes unable to recognize where the sound is coming from. Figure 8 shows a flowchart of the sixth process according to an embodiment of the present invention. The sixth process is a process of correcting the sound to correspond to the symptoms of hearing loss. First, the degree of the symptoms input in step S3 is extracted (step S60). Next, the sound is corrected based on the extracted degree of the symptoms (step S61). The corrected sound is output from the sound output device 20 (step S62), and the process ends.

[0047] This section explains sound correction. When performing sound correction, the computer device 1 stores a calculation method for 3D spatial calculation regarding the direction of sound, sound delay, and / or sound volume. In addition, multiple microphones are set up in advance at multiple different locations in the area where the user will use the simulated experience device. The positions of the microphones are not particularly limited, but it is preferable to set them up on the left and right sides of the user, for example. Speakers such as earphones or headphones are connected to the computer device 1, and the user wears earphones or headphones on both ears. The direction of the output sound is flattened by 3D spatial calculation of the sound data collected by the multiple microphones. Specifically, the sound collected by the microphone on the user's left side is output from both the left and right sides of the earphone at the same volume, rather than outputting it only from the left side of the earphone. Similarly, the sound collected by the microphone on the user's right side is output from both the left and right sides of the earphone at the same volume, rather than outputting it only from the right side of the earphone. This makes it impossible to recognize where the sound is coming from. In the above method, the directionality of the sound is flattened, making it impossible to recognize where the sound is coming from. However, it is also possible to output sounds of different volumes to the right and left ears, emphasizing sounds from a specific direction. Furthermore, it is possible to output sound information with different frequencies emphasized or suppressed to the right and left ears. This makes it possible to reproduce the symptom of hearing sounds twice.

[0048] Furthermore, the first, second, third, fourth, and / or fifth processes described above are executed repeatedly every frame (e.g., every 1 / 30th of a second). This allows the captured image to be processed in real time, enabling the user to view the corrected real-world state without delay.

[0049] By wearing the simulated experience device of the present invention on the head, the user can experience dementia in a simulated way. In this case, a third party other than the user may guide the user to perform predetermined actions. For example, the third party may guide the user to move from one point to another, sit in a chair, or hold onto a chair or the like with their hands.

[0050] By using the dementia simulation device of the present invention, users can experience the world as perceived by dementia patients. Through this simulation, they can share their feelings and insights with other users, allowing them to reflect on their own approach to nursing dementia patients. After such an experience, learning about the concept of dementia-centered nursing and its practical methods will lead to more effective learning.

[0051] According to the present invention, a dementia simulation device comprising an imaging means for capturing images of the real world, a correction means for correcting the image information obtained by imaging, and a display means for displaying the corrected state of the real world on a display screen based on the corrected image information, can simulate the vision of dementia patients. In particular, since the correction of the image information obtained by imaging corresponds to the symptoms of dementia, such as constricted visual field, decreased light perception, decreased pupillary response speed, decreased contrast perception, decreased depth perception, misrecognition of patterns, and / or misrecognition of reflections, the vision of dementia patients can be reproduced in a state close to reality. Furthermore, according to the present invention, a dementia simulation device comprising a sound acquisition means for acquiring sounds from the real world, a correction means for correcting the acquired sound information, and a sound output means for outputting corrected sounds from the real world based on the corrected sound information, can simulate the hearing of elderly people, who make up the majority of dementia patients. In particular, since the correction of the acquired sound information corresponds to age-related hearing loss, the hearing of elderly people, who make up the majority of dementia patients, can be reproduced in a state close to reality.

[0052] According to the present invention, a third party, different from the user, guides the user, who is wearing the simulated experience device on their head, to perform predetermined actions, thereby enabling more effective learning of how to care for dementia patients. More specifically, the user of the simulated experience device can experience the care provided by a third party (nurse) from the perspective of a dementia patient, providing an opportunity to re-examine their own nursing practices and enabling them to provide appropriate feedback to the third party. [Explanation of Symbols]

[0053] 1 Computer unit 11 Control unit 12 RAM 13 Storage unit 14 Sound processing unit 15 Graphics processing unit 16 Communication interface 17 Interface section 18 External memory 19 Video memory 20 Sound output unit 21 Display device 22 Display screen 23 Touch input unit 24 Imaging unit

Claims

1. A dementia simulation device that is worn on the user's head, Imaging means for capturing images of the real world, Correction means for correcting image information obtained by imaging, A display means that displays the corrected state of the real world on a display screen based on corrected image information. Equipped with, One or more symptoms and the degree of said symptoms that are reflected in the image information by correction by the correction means are predetermined. A dementia simulation device in which correction means include corrections corresponding to decreased light perception, decreased pupillary response speed, decreased depth perception, misrecognition of patterns, and / or misrecognition of reflexes.

2. Computer equipment, Imaging means for capturing images of the real world, Correction means for correcting image information obtained by imaging, A display means that displays the corrected state of the real world on a display screen based on corrected image information. To make it function as, One or more symptoms and the degree of said symptoms that are reflected in the image information by correction by the correction means are predetermined. A dementia simulation program in which corrections by corrective means include corrections corresponding to reduced light perception, reduced pupillary response speed, reduced depth perception, misrecognition of patterns, and / or misrecognition of reflexes.

Images