Support system, support method, support device, and support computer program for supporting protocols for preventing and / or improving frailty

Abstract

To support a protocol for prevention and / or improvement of frailty.SOLUTION: The present invention is directed to a support system for supporting a protocol for prevention and / or improvement of frailty. The protocol includes a virtual reality visit in which a person desiring joining the protocol visits a facility having Japanese culture assets in a virtual realty space through a network. The Japanese culture assets are browsed by the person through the network as viewing digital content. The support system having an explaining person terminal used by a person explaining the Japanese culture assets and a user terminal used by the person desiring the joining allows dialog exchange between the explaining person and the user, thereby solving the problem.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] Disclosed herein are an assistance system, an assistance method, an assistance device, and an assistance computer program for supporting a protocol for preventing and / or improving frailty. [Background technology]

[0002] As the COVID-19 pandemic drags on, elderly people are confined to their homes, and lack of exercise leads to a decrease in muscle mass, which can lead to sarcopenia. Furthermore, a decrease in appetite can lead to malnutrition, and if this continues, there is a high possibility that they will become frail, which means they are more likely to require nursing care. If people become frail, their immune system will weaken, which can lead to a negative spiral in which they are more likely to become infected with COVID-19. On the other hand, as the COVID-19 pandemic has led to people being discouraged from gathering in large numbers, online tours and other events using networks have become a new business.

[0003] In addition, technologies such as virtual reality (VR) that allows users to experience virtual spaces as if they were real, and augmented reality (AR) that extends the real-world environment that humans perceive to a computer, have been developed and are being applied to games and other applications. Patent Document 1 discloses a device that detects a user's movements and reflects the movements in a virtual space. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Special Publication No. 2020-510944 Summary of the Invention [Problem to be solved by the invention]

[0005] The inventors conducted a large-scale cross-sectional study titled "Survey on the Association between Atrial Fibrillation with Palpitations and Depression in the Elderly" (2019-2020) targeting elderly people aged 65 years or older who participated in a disease awareness symposium in Kyoto City (a total of 1,533 people were surveyed and studied), and found that 23.2% of the elderly were diagnosed with depression (including depressive states). The current situation in which people tend to stay at home due to the spread of COVID-19 infection and opportunities for exercise and contact with others have decreased is likely to further accelerate frailty in the elderly. The objective of the present invention is to provide a support system, support method, support device, and support computer program for supporting the physical and social activities of the elderly in a manner that conforms to the "new lifestyle" and supporting protocols for preventing and / or improving frailty, which also leads to enjoyment and a sense of purpose in life. [Means for solving the problem]

[0006] The inventors include the following embodiments.

[0007] An embodiment of the present invention relates to a support system for supporting a protocol for preventing and / or improving frailty. In the support system, the protocol includes a virtual reality visit in which a candidate who wishes to participate in the protocol visits a facility where Japanese cultural artifacts are present in a virtual reality space via a network, and the Japanese cultural artifacts are viewed by the candidate via the network as digital content for appreciation. The support system includes an explainer terminal used by an explainer who explains the Japanese cultural artifacts, and a candidate terminal used by the candidate. Both the candidate and the explainer participate in a predetermined tour of the virtual reality visit. While a specified tour of the virtual reality visit is being carried out, the explanation terminal displays a presenter character representing the presenter; displays the digital content for viewing; displays and / or outputs as audio the explanation given by the presenter, displays a requester character representing the requester; displays and / or outputs as audio input information input by the requester from the presenter terminal regarding the digital content for viewing and / or the explanation, and transmits answer information corresponding to the input information input by the presenter to the presenter terminal as display information and / or audio information to the requester terminal. While the virtual reality visit is being carried out, the participant terminal displays the presenter character; displays the digital content for viewing; displays and / or outputs the explanation in audio; transmits the input information to the presenter terminal; and displays and / or outputs the answer information in audio. While the virtual reality visit is being carried out, the explanation, the presentation of the input information, and the presentation of the answer information are carried out in an interactive format between the requester and the explanation giver.

[0008] Preferably, the applicant terminal is communicatively connected to a virtual reality device, the applicant terminal is further communicatively connected to a stepping detection device having a sensor that detects the stepping of the applicant, and the applicant terminal control device acquires an output from the stepping detection device as dynamic information of the applicant and outputs the dynamic information to the network. The presenter terminal control device generates output information in which a scene image of a virtual reality space representing a scene within the facility changes in response to the dynamic information, and outputs the output information to the network. The applicant terminal control device also causes the output information to be output to the virtual reality device.

[0009] Preferably, the protocol for preventing and / or ameliorating frailty is for preventing social isolation in those who wish to do so.

[0010] Preferably, the Japanese cultural product is related to Buddhism or Shinto. More preferably, the explainer is a Buddhist monk when the Japanese cultural product is related to Buddhism, and a Shinto priest when the Japanese cultural product is related to Shinto. Preferably, there are a plurality of applicants.

[0011] Preferably, the applicant character is displayed as a virtual character.

[0012] An embodiment of the present invention relates to a support method for supporting a protocol for preventing and / or improving frailty, which is implemented by a computer, and includes the steps of: displaying a presenter character representing the presenter; displaying the digital content for appreciation; displaying and / or outputting by voice the explanation given by the presenter; displaying a requester character representing the requester; displaying and / or outputting by voice input information input by the presenter from the requester terminal regarding the digital content for appreciation and / or the explanation; and transmitting answer information corresponding to the input information input by the presenter to the presenter terminal to the requester terminal as display information and / or voice information. While the virtual reality visit is being carried out, the participant terminal displays the presenter character; displays the digital content for viewing; displays and / or outputs the explanation in audio; transmits the input information to the presenter terminal; and displays and / or outputs the answer information in audio, and while the virtual reality visit is being carried out, the explanation, presentation of the input information, and presentation of the answer information are carried out in an interactive format between the participant and the presenter.

[0013] Preferably, the presenter terminal acquires from the applicant terminal via a network outputs from a virtual reality device worn by the applicant and a stepping detection device having a sensor for detecting the stepping of the applicant as dynamic information of the applicant, generates output information for changing a scene image of the virtual reality space representing a scene within the facility in accordance with the dynamic information, and transmits the output information to the applicant terminal. The applicant terminal displays the received output information on the virtual reality device.

[0014] An embodiment of the present invention relates to an assistance program for supporting a protocol for preventing and / or improving frailty when executed by a computer, the protocol including a virtual reality visit in which a candidate who wishes to participate in the protocol visits a facility where Japanese cultural artifacts are present in a virtual reality space via a network, the Japanese cultural artifacts are viewed by the candidate via the network as digital content for appreciation, and the candidate and a presenter who provides an explanation about the Japanese cultural artifacts both participate in a predetermined tour of the virtual reality visit. The assistance program causes the computer to execute, during the execution of a predetermined tour of the virtual reality visit, a step of displaying a presenter character representing the presenter, displaying the digital content for appreciation, and displaying and / or outputting the explanation given by the presenter on a presenter terminal operated by the presenter, a step of displaying a requester character representing the applicant, a step of displaying and / or outputting input information input by the applicant from the presenter terminal on the digital content for appreciation and / or the explanation on the basis of sound, and a step of transmitting answer information corresponding to the input information input by the presenter to the presenter terminal as display information and / or sound information to the presenter terminal. During the execution of the virtual reality visit, the presenter terminal operated by the presenter corresponds to each step executed by the assistance program, displays a presenter character representing the presenter, transmits the input information to the presenter terminal, and displays and / or outputs the input information input by the applicant from the presenter terminal on the digital content for appreciation and / or the explanation on the basis of sound. While the virtual reality visit is being carried out, the explanation, the presentation of the input information, and the presentation of the answer information are carried out in an interactive format between the requester and the explanation giver.

[0015] Preferably, the assistance program further includes a step of acquiring output from a virtual reality device worn by the applicant and a footstep detection device having a sensor for detecting the footsteps of the applicant as dynamic information of the applicant, a step of generating output information in which a scene image of a virtual reality space representing a scene within the facility changes in accordance with the dynamic information, and a step of outputting the output information for reception by the applicant terminal.

[0016] An embodiment of the present invention relates to a support device for supporting a protocol for preventing and / or improving frailty. The device displays a presenter character representing the presenter; displays the digital content for appreciation; displays and / or outputs the explanation given by the presenter in audio; displays a candidate character representing the presenter; displays and / or outputs input information input by the presenter from the presenter terminal about the digital content for appreciation and / or the explanation in audio, and transmits answer information corresponding to the input information input by the presenter to the presenter terminal as display information and / or audio information to the presenter terminal. The presenter terminal, while the virtual reality visit is being performed, displays the presenter character; displays the digital content for appreciation; displays and / or outputs the explanation in audio; transmits the input information to the presenter terminal; and displays and / or outputs the answer information in audio. While the virtual reality visit is being performed, the explanation, the presentation of the input information, and the presentation of the answer information are performed in an interactive format between the presenter and the presenter.

[0017] Preferably, the control device further acquires output from a virtual reality device worn by the applicant and a footstep detection device equipped with a sensor for detecting the footsteps of the applicant as dynamic information of the applicant, generates output information in which a scene image in the virtual reality space representing the scene within the facility changes in accordance with the dynamic information, and transmits the output information to the applicant terminal. Effect of the Invention

[0018] It is possible to support protocols for preventing and / or improving frailty. In addition, by supporting protocols for preventing and / or improving frailty, it is possible to not only improve the mental function of those who wish to do so, but also to create a sense of purpose and enjoyment in life for the elderly and eliminate social isolation. Furthermore, by supporting protocols for preventing and / or improving frailty, it is possible to expect inbound tourism for owners of Japanese cultural artifacts, whose visitor numbers have decreased due to the COVID-19 pandemic. [Brief description of the drawings]

[0019] [Figure 1] 1 shows an overview of a support system 1000. [Diagram 2] 2 shows an outline of the hardware configuration of the presenter terminal 10. [Diagram 3] 2 shows an outline of the hardware configuration of the requester terminal 20. [Figure 4] 1 shows a process flow of the support system 1000. [Diagram 5] 1 shows a process flow of the support system 1000. [Figure 6] 2 shows an overview of a support system 2000. [Figure 7] 2 shows an outline of the hardware configuration of the presenter terminal 50. [Figure 8] 1 shows an outline of the hardware configuration of the requester terminal 60. [Figure 9] This shows an overview of the protocol that participants experienced. (a) shows the schedule of the experience. (b) shows the background of the participants. [Figure 10] The results of the evaluation of the appropriateness of time allocation for each session are shown below. [Figure 11] The evaluation results regarding virtual sickness are shown below. [Figure 12] The evaluation results regarding the sense of realism in the virtual reality space are shown below. [Figure 13] The results of the evaluation of the protocol of the present invention using a Likert scale are shown. (a) shows the contents of the questionnaire given to the participants after the completion of the protocol. (b) shows the evaluation scale summarizing the contents of the questionnaire. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] 1. Protocols to prevent and / or improve frailty Frailty is one of the geriatric syndromes observed in the elderly. It is said to be a state of increased vulnerability to environmental factors. It is said to have physical, psychological, and social factors. Frailty is also considered to be a precursor to a state of needing care.

[0021] The Ministry of Health, Labor and Welfare of Japan states that three things are important for preventing and / or improving frailty: nutrition, physical activity, and social participation. In this specification, a protocol for preventing and / or improving frailty (hereinafter also simply referred to as a "protocol") is intended to support physical activity and social participation in particular. Preferably, the protocol is applied to a subject with the aim of preventing social isolation of the elderly. The protocol is intended to be a "program" in the sense of a plan for supporting recovery, but is referred to as a "protocol" in this specification to distinguish it from a computer program. Here, the elderly refers to those aged 65 or older, preferably 70 or older.

[0022] "Prevention" can include preventing healthy people from becoming frail, preventing people who are likely to become frail from becoming frail, and preventing the condition of people who are frail from worsening. In addition, since frailty is not classified as a disease, in this specification, "improvement" is defined as becoming more extroverted in behavior and feelings.

[0023] One standard for assessing frailty is the Cardiovascular Health Study (CHS) criteria proposed by Fried et al. The CHS criteria define physical frailty as follows: 1) Weight loss (weight loss of 2-3 kg or more in 6 months) 2) Fatigue (I've been feeling tired for no apparent reason for the past two weeks) 3) Decreased activity level (not doing light exercise or gymnastics, or not doing regular exercise or sports) 4) Slowness (decreased walking speed: normal walking speed <1m / sec) 5) Weakness (decreased grip strength: men <28 kg, women <18 kg) The five criteria are: if three or more of the above criteria are met, the patient is diagnosed with frailty; if one or two criteria are met, the patient is in the pre-frail stage. In Japan, a 25-item questionnaire created by the Ministry of Health, Labour and Welfare for nursing care prevention is used as the J-CHS standard for evaluating frailty. Whether frailty has improved or not may be determined based on these evaluations. For example, if the number of applicable items in these check items has decreased, it can be evaluated as "improved," and if the number of applicable items has not decreased, it can be evaluated as "not improved."

[0024] 2. Support System 1000 2-1. Configuration of the support system A support system 1000 according to a first embodiment of the present invention will be described with reference to Fig. 1. The support includes a virtual reality visit in which a candidate V1 who wishes to participate in the protocol visits a facility where a Japanese cultural artifact A exists in a virtual reality space via a network 99. The Japanese cultural artifact A is viewed by the candidate V1 via the network 99 as digital content DA for viewing.

[0025] The support system 1000 includes an explainer terminal 10 used by an explainer H1 who explains Japanese cultural product A, and a requester terminal 20 used by the requester V1. The explainer terminal 10 and the requester terminal 20 are communicably connected via a network. The network 99 is preferably wireless. The requester V1 and the explainer H1 both participate in the virtual reality visit while the virtual reality visit is being carried out. During this time, the requester V1 and the explainer H1 exchange text, voice and sound, and video images with each other via the network 99 and each terminal. In other words, the exchange between the requester V1 and the explainer H1 while the virtual reality visit is being carried out is in the form of a dialogue.

[0026] Here, since there may be some applicants V1 who have hearing loss, it is preferable that communication between the applicants V1 and the presenter H1 can be carried out not only by voice but also by text input.

[0027] In this specification, Japanese cultural product A includes cultural products created or produced in Japan. Therefore, Japanese cultural product A may include cultural products currently existing in Japan, as well as those existing overseas, or those whose originals no longer exist but remain as still images or videos. Cultural products may include tangible cultural properties such as paintings, sculptures, crafts, calligraphy, classics, ancient documents, architecture, and gardens, as well as intangible cultural properties such as the tea ceremony, flower arrangement, kimono art, Noh theater, Bunraku, Kabuki, martial arts, dance, and music. It is preferable that cultural products are of high historical or artistic value.

[0028] It is preferable that Japanese cultural product A is related to Buddhism or Shinto. When Japanese cultural product A is related to Buddhism, there is no particular limitation on the sect. It is particularly preferable that the Buddhism is Zen sect, such as Rinzai, Soto, or Obaku. If the Buddhism is Zen sect, a given tour may include a mindfulness training course or meditation time. It is preferable that the presenter be a monk when Japanese cultural product A is related to Buddhism, and a Shinto priest when Japanese cultural product A is related to Shinto. The digital content for viewing DA is digitized content, and includes not only visual content but also content that can be perceived by the senses of hearing and touch. The number of people who wish to participate in one tour may be one or more. The number of presenters who participate in one tour may be one or more. Furthermore, the presenters may take turns to give a presentation to each person.

[0029] The virtual reality visit may include one or more types of tours. For example, one tour takes about 15 to 60 minutes. During this time, one or more facilities where Japanese cultural artifacts A are located can be visited. Also, one or more Japanese cultural artifacts A can be viewed within one facility. Also, a tour may include rest periods, etc.

[0030] 2-2. Explainer terminal 10 The hardware configuration of the presenter terminal 10 will be described with reference to Fig. 2. The presenter terminal 10 includes a presenter terminal control device 100 (hereinafter simply referred to as the control device 100), a presenter terminal audio device 111 (hereinafter simply referred to as the audio device 111), a presenter terminal input / output device 112 (hereinafter simply referred to as the input / output device 112), and a presenter terminal camera 113 (hereinafter simply referred to as the camera 113).

[0031] The control device 100 includes a presenter terminal CPU 101 (hereinafter simply referred to as CPU 101), a presenter terminal memory 102 (hereinafter simply referred to as memory 102), a presenter terminal ROM 103 (hereinafter simply referred to as ROM 103), a presenter terminal storage device 104 (hereinafter simply referred to as storage device 104), and a presenter terminal interface 105 (hereinafter simply referred to as I / F 105). The storage device 104 includes an operating system (OS) 1041 and a support program 1042. The operating system (OS) 1041 and the support program 1042 work together to cause the terminal to function as a presenter terminal 10. The presenter terminal 10 is also the support device 10.

[0032] The audio device 111 has a microphone and a speaker function. The audio device 111 captures the audio explanation given by the explainer H1 and surrounding sounds during the tour, and outputs the voice and sounds transmitted from the requester terminal 20.

[0033] The input / output device 112 is a touch panel and has the functions of a monitor, a keyboard, and a mouse. The input / output device 112 is used when the presenter H1 inputs characters. The input / output device 112 also presents digital content DA for viewing.

[0034] The camera 113 is capable of capturing still and moving images. For example, it is used to capture an image or video of the presenter H1, or a Japanese cultural product A or video when transmitting the image to the requester terminal. The components in the presenter terminal 10 are connected to each other via a bus 109 so as to be able to communicate data with each other.

[0035] 2-3. Applicant terminal 20 The hardware configuration of the applicant terminal 20 will be described with reference to Fig. 3. The applicant terminal 20 includes a applicant terminal control device 200 (hereinafter simply referred to as the control device 200), a applicant terminal audio device 211 (hereinafter simply referred to as the audio device 211), a applicant terminal input / output device 212 (hereinafter simply referred to as the input / output device 212), and a applicant terminal camera 213 (hereinafter simply referred to as the camera 213).

[0036] The control device 200 comprises a requester terminal CPU 201 (hereinafter simply referred to as CPU 201), a requester terminal memory 202 (hereinafter simply referred to as memory 202), a requester terminal ROM 203 (hereinafter simply referred to as ROM 203), a requester terminal storage device 204 (hereinafter simply referred to as storage device 204), and a requester terminal interface 205 (hereinafter simply referred to as I / F 205). The storage device 204 comprises an operating system 2041 and browser software 2042. The operating system 2041 and the browser software 2042 work together to cause the terminal to function as a large-scale fire-response terminal.

[0037] The audio device 211 has a microphone and a speaker function. The audio device 211 outputs the audio explanation transmitted by the presenter terminal 10 and the surrounding sounds during the tour, and acquires the voice of the requester V1 and the sounds around the requester V1.

[0038] The input / output device 212 is a touch panel and has the functions of a monitor, a keyboard, and a mouse. The input / output device 212 is used when the requester V1 inputs characters. The input / output device 212 also presents digital content DA for viewing. The camera 213 is capable of capturing still and moving images. For example, the camera 213 is used when transmitting an image or video of the viewer V1 to the presenter terminal 10. The components in the requester terminal 20 are connected to each other via a bus 209 so that data communication is possible.

[0039] 2-4. Processing flow of the system 1000 4 and 5, the process flow of the system 1000 is shown. In step S1 of FIG. 4, the presenter H1 inputs login information for a predetermined tour of virtual reality visits via the input / output device 112, which is accepted by the control unit 100, and the predetermined tour is started.

[0040] In step S51 on the applicant terminal 20 side, the control device 200 accepts the login information of the predetermined tour of virtual reality visit input by the applicant V1 via the input / output device 212, and transmits it to the presenter terminal 10 via the network 99. In step S3, the control device 100 of the presenter terminal 10 receives and acquires the login information transmitted from the applicant terminal 20. If the login information is proper, in step S5, the control device 100 permits login from the applicant terminal 20, and generates output information including the digital content DA for appreciation corresponding to the predetermined tour, display information for displaying the presenter character CH1 indicating the presenter, and audio information such as a greeting before the tour begins. The predetermined tour is started by starting transmission of the output information to the applicant terminal 20 via the network 99.

[0041] In step S53, the control device 200 of the applicant terminal 20 acquires the output information sent by the control device 100, outputs it to the input / output device 212 and / or audio device 211 of the applicant terminal 20, and presents the contents of the acquired output information to the applicant.

[0042] In addition, in step S55, the control device 200 of the applicant terminal 20 outputs output information to the network 99, including display information for displaying a applicant character VH1 representing the applicant, and audio information such as a greeting before starting the tour, and in step S7, the control device 100 acquires the output information, outputs it to the input / output device 112 and / or audio device 111, and presents the contents of the output information to the presenter. In step S9, the control device 100 of the presenter terminal 10 generates output information for the explanation given by the presenter, and outputs the generated output information to the network 99.

[0043] In S57, the control device 200 of the requester terminal 20 acquires the output information output in step S9, outputs it to the input / output device 212 and / or the audio device 211, and presents the contents of the output information to the requester.

[0044] Moving on to Figure 5, in step S59, if the candidate V1 has any comments or questions regarding the digital content DA for viewing presented by the presenter or the explanation, he or she inputs these as input information from the input / output device 212 and / or audio device 211 of the candidate terminal 20, and the control device 200 accepts the input and outputs it to the network 99.

[0045] In step S11, the control device 100 of the presenter terminal 10 acquires the input information output by the control device 200, outputs it to the input / output device 112 and / or audio device 111 of the presenter terminal 10, and presents the contents of the input information to the presenter.

[0046] In step S13, the control device 100 of the presenter terminal 10 accepts answers input by the presenter via the input / output device 112 and / or audio device 111, corresponding to the digital content for viewing DA and comments and questions regarding the explanation, as answer information, and outputs the answer information to the network 99.

[0047] In step S61, the control device 200 of the desirer terminal 20 acquires the answer information, outputs it from the input / output device 212 and / or the audio device 211 of the desirer terminal 20, and presents the contents of the answer information to the desirer V1.

[0048] In step S15, the presenter H1 asks those who wish to do so whether they have any additional comments or questions, so the control device 100 of the presenter terminal 10 outputs information to the network 99 from the input / output device 112 and / or audio device 111 to confirm whether or not there is any additional input information to be entered by the presenter H1.

[0049] In step S63, the control device 200 of the applicant terminal 20 accepts information for confirming the presence or absence of additional input information, outputs this from the input / output device 212 and / or the audio device 211, and presents it to the applicant V1. If the applicant inputs from the input / output device 212 and / or the audio device 211 that there are additional comments or questions (if YES), the control device 200 returns to S59. If the applicant inputs from the input / output device 212 and / or the audio device 211 that there are additional comments or questions (if YES), the control device 200 returns to S59. If the applicant inputs from the input / output device 212 and / or the audio device 211 that there are no additional comments or questions (if NO), the control device 200 outputs this information to the network 99 as question completion information. Here, the input of whether there are additional comments or questions is not limited as long as it can respond to the confirmation information input by the presenter in step S15. It may be a text input, an icon click, or a voice input.

[0050] In step S17, the control device 100 of the presenter terminal 10 acquires the question completion information transmitted from the requester terminal 20, outputs the question completion information from the input / output device 112 and / or the audio device 111, and presents it to the presenter H1. Next, the presenter H1 acquires information on the end of the tour input from the input / output device 112 and / or the audio device 111, and outputs the information on the end of the tour to the network. After acquiring the information on the end of the tour, the control device 200 of the applicant terminal 20 outputs this information from the input / output device 212 and / or the audio device 211 to present it to the applicant V1.

[0051] The control device 100 of the presenter terminal 10 accepts the logout information from the presenter H1 and logs out from the tour. The control device 200 of the requester terminal 20 also accepts the logout information from the requester V1 and logs out from the tour, and the tour ends.

[0052] 3. Support System 2000 3-1. Configuration of Support System 2000 6, the configuration of the support system 2000 is basically the same as that of the support system 1000. It includes a presenter terminal 50 and a requester terminal 60. However, the requester terminal 60 is connected to a virtual reality device worn by the requester C1 and a stepping detection device including a sensor that detects the requester's stepping.

[0053] 3-2. Explainer terminal 50 The hardware configuration of the presenter terminal 50 will be described with reference to Fig. 7. The presenter terminal 50 includes a presenter terminal control device 500 (hereinafter simply referred to as the control device 500), a presenter terminal audio device 511 (hereinafter simply referred to as the audio device 511), a presenter terminal input / output device 512 (hereinafter simply referred to as the input / output device 512), and a presenter terminal camera 513 (hereinafter simply referred to as the camera 513).

[0054] The control device 500 includes a presenter terminal CPU 501 (hereinafter simply referred to as CPU 501), a presenter terminal memory 502 (hereinafter simply referred to as memory 502), a presenter terminal ROM 503 (hereinafter simply referred to as ROM 503), a presenter terminal storage device 504 (hereinafter simply referred to as storage device 504), and a presenter terminal interface 505 (hereinafter simply referred to as I / F 505). The storage device 504 includes an operating system (OS) 5041, an assistance program 5042, a virtual reality program 5043, and a scene video content 5044. The operating system (OS) 5041, the assistance program 5042, and the virtual reality program 5043 work together to cause the terminal to function as a presenter terminal 50. The presenter terminal 50 is also a support device 50.

[0055] The audio device 511 has a microphone and a speaker function. The audio device 511 captures the audio explanation given by the explainer H1 and surrounding sounds during the tour, and outputs the voice and sounds transmitted from the requester terminal 60.

[0056] The input / output device 512 is a touch panel and has the functions of a monitor, a keyboard, and a mouse. The input / output device 512 is used when the presenter H1 inputs characters. The input / output device 512 also presents digital content DA for viewing.

[0057] The camera 513 is capable of taking still and moving images. For example, it is used when transmitting an image or video of the presenter H1, or a video of the Japanese cultural product A to the requester terminal. The components in the presenter terminal 60 are connected to each other via a bus 609 so as to be able to communicate data with each other.

[0058] 3-3. Applicant terminal 60 The hardware configuration of the candidate terminal 60 will be described with reference to Fig. 8. The candidate terminal 20 includes a candidate terminal control device 600 (hereinafter simply referred to as the control device 600), a stepping detection device 611 (hereinafter simply referred to as the detection device 611), a virtual reality device 612, and a candidate terminal camera 613 (hereinafter simply referred to as the camera 213).

[0059] The control device 600 includes a candidate terminal CPU 601 (hereinafter simply referred to as CPU 601), a candidate terminal memory 602 (hereinafter simply referred to as memory 602), a candidate terminal ROM 603 (hereinafter simply referred to as ROM 603), a candidate terminal storage device 604 (hereinafter simply referred to as storage device 604), and a candidate terminal interface 605 (hereinafter simply referred to as I / F 605). The storage device 604 includes an operating system 6041, browser software 6042, and a virtual reality device control program 6043. The operating system 6041, the browser software 6042, and the virtual reality device control program 6043 work together to cause the terminal to function as the candidate terminal 60.

[0060] The virtual reality device 612 is equipped with the functions of an audio device and an input / output device. In addition, the field of view of the virtual reality space can be changed according to the movement of the part of the wearer where the device is worn. The virtual reality device 612 outputs the audio explanation and surrounding sounds during the tour transmitted by the presenter terminal 50 under the control of the virtual reality device control program 6043, and acquires the voice of the requester V1 and sounds around the requester V1. The virtual reality device 612 presents the digital content DA for viewing under the control of the virtual reality device control program 6043. The camera 613 is capable of capturing still and moving images. For example, it is used when transmitting an image or video of the requester V1 to the presenter terminal 50. The components in the requester terminal 60 are connected to each other via a bus 609 so that data communication is possible. Furthermore, the requester terminal 60 may be provided with an input device for inputting text, separate from the virtual reality device 612 .

[0061] 3-4. Operation of the Support System 2000 The operation of the support system 2000 is basically the same as that of the support system 1000. That is, in this embodiment, the control device 500 performs the processes performed by the control device 100, and the control device 600 performs the processes performed by the control device 200.

[0062] 4, the digital content for viewing corresponding to the predetermined tour is scene video content 5044 of a virtual reality space representing a scene within the facility that holds Japanese cultural artifact A stored in presenter terminal 50. Dynamic information received by a stepping detection device connected to participant terminal 60 is transmitted to presenter terminal 50 via the network. Control device 500 of presenter terminal 50 generates output information that changes the scene of scene video content 5044 based on the acquired dynamic information. Control device 500 outputs the generated output information to network 99, and a control unit of participant terminal 60 acquires this output information, which is then output via virtual reality device 612 by virtual reality device control program 6043 and presented to the participant.

[0063] 4. Variations Each terminal may be a smartphone, a tablet, a personal computer, or the like.

[0064] The presenter character CH1 and the applicant character CV1 may be a photograph or video of an actual participant, or may be a virtual character such as an avatar. When multiple applicants participate, it is preferable to display each applicant as a different virtual character. When using a virtual character as the presenter character CH1, the storage device 104, 504 of the presenter terminal 10, 50 or the storage device 204, 604 of the applicant terminal 20, 20 stores a virtual character generation program, and generates a virtual character using the program and displays it as the presenter character CH1 or the applicant character CV1. The virtual character generation program is a publicly known program, and examples of the programs described in Japanese Patent Publication No. 6980946 and Japanese Patent Publication No. 6980150 can be cited.

[0065] The applicant may step on the stepping detection device 611 while standing or sitting. Although the stepping detection device 611 is in the form of a pad in FIG. 6, the stepping detection device 611 may be in the form of a band attached to the leg. In the case of the band-shaped stepping detection device 611, the sensor is preferably of a type capable of detecting the movement of the leg by acceleration. Furthermore, the pad-shaped stepping detection device 611 allows smoother movement in the virtual reality space, and can prevent motion sickness in the virtual reality space. This is expected to have the effect of allowing the applicant to enjoy the tour in the virtual reality space even more. The virtual reality program 5043 and the virtual reality device control program 6043 are well known and are described in, for example, Patent Document 1.

[0066] In the support system 2000, the presenter terminal 50 includes an audio device 511 and an input / output device 512, but may include a virtual reality device instead of the audio device 511 and the input / output device 512, as in the case of the requester terminal 60. In this case, the virtual reality device substitutes for the functions of the audio device 511 and the input / output device 512.

[0067] Furthermore, when a mindfulness training course or meditation time is incorporated into the tour, the presenter inputs a request to start the mindfulness training or meditation to the input / output device 112 and / or audio device 111 between steps S17 and S19 shown in FIG. 5, the control device 100 of the presenter terminal 10 accepts this request and transmits information to start the mindfulness training or meditation to the applicant terminal 20. Next, the control device 200 of the applicant terminal 20 outputs this from the input / output device 212 and / or audio device 211 and presents it to the applicant V1. After a predetermined time (for example, about 5 to 30 minutes) has elapsed since the start of the mindfulness training or meditation, the presenter inputs a request to end the mindfulness training or meditation to the input / output device 112 and / or audio device 111, the control device 100 of the presenter terminal 10 accepts this request and transmits information to end the mindfulness training or meditation to the applicant terminal 20. This is output from the input / output device 212 and / or audio device 211 and presented to the candidate V1. Furthermore, the information to end the mindfulness training or meditation may be automatically transmitted by the control device 100 of the presenter terminal 10 to the candidate terminal 20 after a predetermined time has elapsed since the start of the mindfulness training or meditation.

[0068] The presenter may input a request to the presenter terminal to transmit information for providing a pre-explanation regarding the tour before step S5 shown in Fig. 4. The control device 100 of the presenter terminal 10 accepts this request and transmits the information for the pre-explanation to the applicant terminal 20. The control unit 200 of the applicant terminal 20 outputs this information from the input / output device 212 and / or the audio device 211 to present it to the applicant V1.

[0069] Furthermore, apart from stepping that causes the connected stepping detection device to receive dynamic information, the applicant may be made to do warm-up exercises such as stepping. In this case, the presenter inputs a request to the presenter terminal to transmit information for encouraging the participants to do warm-up exercises before step S5 shown in Fig. 4. The control device 100 of the presenter terminal 10 accepts this request and transmits information encouraging the participants to do warm-up exercises to the applicant terminal 20. The control unit 200 of the applicant terminal 20 outputs this information from the input / output device 212 and / or audio device 211 and presents it to the applicant V1.

[0070] 5.Verification of effectiveness According to the schedule shown in FIG. 9(a), 10 elderly people actually experienced the protocol of the present invention. The background of the participants is shown in FIG. 9(b). The schedule was divided into several sessions, and the total session time from the preliminary explanation to the meditation was 50 minutes. The participants were asked to wear a virtual reality device (Meta Quest2, Meta) and a footstep detection device (accelerometer: M5StickC Plus, M5Stack Technology). The footstep exercise before the cultural property appreciation lasted for 5 minutes while wearing the virtual reality device. The actual interactive appreciation of the cultural property lasted for 24 minutes while stepping on the feet. The experience was all conducted in a seated position. As shown in FIG. 9(b), the average age of the participants was 80.3 years old, and the average score on the UCLA Loneliness Scale (reference: BMC Women's Health. 2019, Jul 26; 19(1):105) was 40.3, which was comparable to the average score of the same gender both in Japan and worldwide. In addition, based on the CHS criteria, eight of the participants were judged to be frail and two were judged to be pre-frail.

[0071] After all sessions were completed, we asked all participants to evaluate the appropriateness of the time of each session. The results are shown in Figure 10. All sessions were generally considered to be appropriate.

[0072] When wearing a virtual reality device and experiencing a virtual reality space, some people may experience what is called "virtual sickness." For this reason, we checked whether the participants experienced virtual sickness. Virtual sickness was evaluated according to the method described in RS Kennedy, et al. The International Journal of Aviation Psychology, 3(3), pp.203-220, 1993, and was assessed for nausea, oculomotor, disorientation, and total score. The results are shown in Figure 11. No one became ill as a result of this experience. Next, the sense of realism in the virtual reality space was evaluated using the IPQ item (http: / / www.igroup.org / pq / ipq / ). The IPQ item evaluates five items in the virtual reality space: General Presence, Spatial Presence, Involvement, and Experienced Realism. The results are shown in Figure 12. A high sense of realism (GP, SP) and immersion (I) were generally achieved. On the other hand, the sense of realism (ER) was also high, which was thought to be due to the interactive viewing of cultural assets using live-action virtual reality images.

[0073] Next, the protocol of the present invention was evaluated using a Likert scale. Figure 13(a) shows the contents of the questionnaire given to the participants after the completion of this protocol. Figure 13(b) shows the Likert evaluation scale for the questionnaire contents. Many participants answered that they felt that this experience was meaningful and that it gave them a positive and enjoyable feeling. They were also eager to try the next experience. Furthermore, many participants were found to want to actually visit the temple they visited in the virtual reality space and to enjoy more interactions with people.

[0074] From the above, it was shown that the protocol of the present invention is effective in preventing and improving frailty. [Explanation of symbols]

[0075] 1000,2000 Support System 10,50 Explainer terminal 20,60 User terminals

Claims

1. A support system for supporting a protocol for preventing and / or improving frailty, comprising: The protocol includes a virtual reality visit to a facility where Japanese cultural artifacts are present, in which a person who wishes to participate in the protocol visits the facility in a virtual reality space via a network; The support system includes an explainer terminal used by an explainer who explains the Japanese cultural product, and a requester terminal used by the requester, the explainer terminal and the requester terminal being communicatively connected via a network; the presenter terminal accepts login information for a predetermined tour of the virtual reality space input by the presenter, and starts the predetermined tour; The requester terminal accepts login information input by the requester, and transmits the login information input by the requester to the presenter terminal via a network; the presenter terminal receives the login information input by the applicant, and if the received login information input by the applicant is correct, permits the applicant to participate in the predetermined tour and starts the predetermined tour; the presenter terminal is equipped with a camera, and provides the Japanese cultural artifact captured by the camera as digital content for viewing by the applicant in a virtual reality visit; The applicant and the explainer both participate in a predetermined tour of the virtual reality visit; The presenter terminal, while the predetermined tour of the virtual reality visit is being carried out, displaying an explainer character representing the explainer; displaying the digital content for viewing; displaying and / or outputting by voice the explanation given by the explainer, and displaying a requester character representing the requester; presenting text and / or outputting by voice information input by the requester regarding the digital content for viewing and / or the explanation from the requester terminal, outputting, to the requester terminal, answer information corresponding to the input information input by the presenter to the presenter terminal, as display information and / or audio information; The participant terminal, while the virtual reality visit is being performed, displaying the presenter character presented by the presenter terminal; displaying the digital content for appreciation; displaying and / or outputting the explanation as sound; transmitting the input information to the presenter terminal; displaying and / or outputting the answer information as sound, During the virtual reality visit, the explanation, the presentation of the input information, and the presentation of the answer information are performed in an interactive format between the requester and the explainer. The support system.

2. the participant terminal is communicatively connected to a virtual reality device; The requester terminal is further connected to a stepping detection device having a sensor for detecting the stepping of the requester so as to be capable of communicating with the requester; the requester terminal acquires an output from the stepping detection device as dynamic information of the requester, and outputs the dynamic information to the presenter terminal via the network; the presenter terminal generates output information in which a scene image of a virtual reality space representing a scene within the facility changes in response to the dynamic information, and presents or outputs the output information to the participant terminal; The requester terminal outputs the output information to the virtual reality device, and the virtual reality device outputs to the requester a presentation of the digital content for appreciation included in the output information, an audio explanation, and ambient sounds during the tour. The support system according to claim 1 .

3. The support system according to claim 1 , wherein the protocol for preventing and / or improving frailty is for preventing social isolation of a person who wishes to do so.

4. 3. The support system according to claim 1, wherein the Japanese cultural product relates to Buddhism or Shintoism.

5. The support system according to claim 1 , wherein the requester is a plurality of people.

6. The support system according to claim 1 , wherein the requester character is displayed as a virtual character.

7. 5. The support system according to claim 4, wherein the explainer is a Buddhist monk when the Japanese cultural product is related to Buddhism, and a Shinto priest when the Japanese cultural product is related to Shinto.

8. 1. A computer-implemented method for supporting a protocol for preventing and / or ameliorating frailty, comprising: The protocol includes a virtual reality visit to a facility where Japanese cultural artifacts are present, in which a person who wishes to participate in the protocol visits the facility in a virtual reality space via a network; The computer is an explainer terminal used by an explainer who explains the Japanese cultural product, and a requester terminal used by the requester, and the explainer terminal and the requester terminal are connected to each other via a network so as to be able to communicate with each other; the presenter terminal accepts login information for a predetermined tour of the virtual reality space input by the presenter, and starts the predetermined tour; The requester terminal accepts login information input by the requester, and transmits the login information input by the requester to the presenter terminal via a network; the presenter terminal receives the login information input by the applicant, and if the received login information input by the applicant is correct, permits the applicant to participate in the predetermined tour and starts the predetermined tour; the presenter terminal is equipped with a camera, and provides the Japanese cultural artifact captured by the camera as digital content for viewing by the applicant in a virtual reality visit; The applicant and the explainer both participate in a predetermined tour of the virtual reality visit; The presenter terminal operated by the presenter, while the predetermined tour of the virtual reality visit is being carried out, displaying an explainer character representing the explainer; displaying the digital content for viewing; displaying and / or outputting by voice the explanation given by the explainer, and displaying a requester character representing the requester; presenting text and / or outputting by voice information input by the requester regarding the digital content for viewing and / or the explanation from the requester terminal, outputting, to the requester terminal, answer information corresponding to the input information input by the presenter to the presenter terminal, as display information and / or audio information; The participant terminal, while the virtual reality visit is being performed, displaying the presenter character presented by the presenter terminal; displaying the digital content for appreciation; displaying and / or outputting the explanation as sound; transmitting the input information to the presenter terminal; displaying and / or outputting the answer information as sound, During the virtual reality visit, the explanation, the presentation of the input information, and the presentation of the answer information are performed in an interactive format between the requester and the explainer. How to help.

9. the participant terminal is communicatively connected to a virtual reality device; The requester terminal is further connected to a stepping detection device having a sensor for detecting the stepping of the requester so as to be capable of communicating with the requester; the requester terminal acquires an output from the stepping detection device as dynamic information of the requester, and outputs the dynamic information to the presenter terminal via the network; the presenter terminal generates output information in which a scene image of a virtual reality space representing a scene within the facility changes in response to the dynamic information, and presents or outputs the output information to the participant terminal; The support method described in claim 8, wherein the requester terminal outputs the output information to the virtual reality device, and the virtual reality device outputs to the requester a presentation of the digital content for viewing contained in the output information, an audio explanation, and ambient sounds during the tour.

10. A support program for supporting a protocol for preventing and / or improving frailty, the support program being implemented in a computer, The protocol includes a virtual reality visit in which a person who wishes to participate in the protocol visits a facility where a Japanese cultural artifact is present in a virtual reality space via a network, and the person who wishes to participate in the protocol participates in a predetermined tour of the virtual reality visit together with an explainer who explains the Japanese cultural artifact; The support program is installed in a presenter terminal used by the presenter, accepting login information for a predetermined tour of the virtual reality space input by a presenter and starting the predetermined tour; receiving login information input by the applicant from a applicant terminal, and if the received login information input by the applicant is correct, permitting the applicant to participate in the predetermined tour and starting the predetermined tour; providing said Japanese cultural artifacts captured by the presenter terminal through a camera to a requester terminal used by said requester through a network as digital content for viewing by said requester in a virtual reality visit; While a given tour of the virtual reality visit is being carried out, displaying an explainer character representing the explainer, displaying the digital content for appreciation, and displaying and / or outputting the explanation given by the explainer by audio; displaying a requester character representing the requester, and presenting and / or outputting by voice the text and / or the audio of the input information input by the requester from the requester terminal regarding the digital content for viewing and / or the description; a step of transmitting answer information corresponding to the input information input by the presenter to the presenter terminal to the requester terminal in an interactive manner between the presenter and the requester as display information and / or audio information; and execute The support program.

11. acquiring outputs from a virtual reality device worn by the applicant and a stepping detection device having a sensor for detecting stepping of the applicant as dynamic information of the applicant; generating output information that changes a scene image in a virtual reality space representing a scene within the facility in response to the dynamic information; outputting the output information to be received by the requester terminal; The assistance program according to claim 10, further comprising:

12. An assistive device for assisting a protocol for preventing and / or improving frailty, comprising: The protocol includes a virtual reality visit in which a person who wishes to participate in the protocol visits a facility where a Japanese cultural artifact is present in a virtual reality space via a network, and the person who wishes to participate in the protocol participates in a predetermined tour of the virtual reality visit together with an explainer who explains the Japanese cultural artifact; The support device is an explainer terminal used by the explainer, and includes a control device; The control device includes: Accepting login information for a specific tour of the virtual reality space input by a presenter and starting the specific tour; receiving login information input by the applicant from a applicant terminal, and if the received login information input by the applicant is correct, permitting the applicant to participate in the predetermined tour and starting the predetermined tour; providing said Japanese cultural artifacts, captured by a camera of said explainer terminal, to said applicant terminal via a network as digital content for the applicant to enjoy in virtual reality; While a given tour of the virtual reality visit is being carried out, displaying an explainer character representing the explainer, displaying the digital content for viewing, displaying and / or outputting by voice the explanation given by the explainer, displaying a requester character representing the requester, and presenting text and / or outputting by voice information input by the requester regarding the digital content for viewing and / or the explanation from the requester terminal, The presenter inputs answer information corresponding to the input information into the presenter terminal, and the answer information is transmitted to the requester terminal as display information and / or audio information in an interactive manner between the presenter and the requester. The support device.

13. The control device further comprises: acquiring outputs from a virtual reality device worn by the applicant and a stepping detection device having a sensor for detecting the stepping of the applicant as dynamic information of the applicant; generating output information that changes a scene image in a virtual reality space representing a scene within the facility in response to the dynamic information; outputting the output information to be received by the requester terminal; 13. The support device of claim 12.

Images