Metaverse healthcare content recommendation method and metaverse healthcare system

The metaverse healthcare system addresses the lack of cognitive function enhancement in virtual interactions by recommending personalized content based on user data analysis, effectively maintaining and improving cognitive functions through social engagement in a virtual environment.

JP2024162460AInactive Publication Date: 2024-11-21HITACHI LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2023077983
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-10
Publication Date
2024-11-21
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing technologies do not effectively maintain and improve cognitive functions in elderly individuals through interactions in virtual spaces, neglecting the importance of social engagement for dementia prevention.

Method used

A metaverse healthcare system that recommends content based on user data analysis to enhance cognitive function, including interactions with others in a virtual environment, using a processor and storage unit to classify users, calculate analysis values, and select content for recommendation.

Benefits of technology

Enhances cognitive function maintenance and improvement by promoting effective interactions in a virtual space, increasing the effectiveness of cognitive function maintenance and improvement through personalized content recommendations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024162460000001_ABST
    Figure 2024162460000001_ABST
Patent Text Reader

Abstract

To provide a metaverse healthcare content recommendation method and a system for maintaining and improving psychosomatic functions of a user including a cognitive function by the user interacting with others in a metaverse.SOLUTION: In a virtual reality system S in which a wearable device 2 and a metaverse healthcare server 1 are connected to the nearest gateway through radio communication and connected to each other via a network N, the metaverse healthcare server classifies users into user groups on the basis of user basic data 121 and real world data 122, calculates an analysis value of a score for every user group on the basis of inspection data 124, selects a content used by the user groups having the analysis value equal to or more than a constant value as a recommended content that the users are recommended to use on the basis of metaverse data 123, and outputs information on the recommended content to a display 27 of the wearable device performing display for the users to recognize the metaverse.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a metaverse healthcare content recommendation method and a metaverse healthcare system. [Background technology]

[0002] Currently, the world is aging, and as the number of elderly people increases, so does the number of elderly people who need nursing care. The number of dementia patients is also on the rise, and according to the World Health Organization (WHO), the number of dementia patients worldwide has exceeded 55 million, and is expected to increase to 78 million by 2030 and 139 million by 2050. As a result, there are concerns about the increase in medical and nursing care costs. Dementia also causes large economic losses, with a reported economic loss of 1.3 trillion dollars per year.

[0003] Meanwhile, attempts are being made to incorporate virtual reality (VR), a technology that has made great advances in recent years, into medical care. For example, Patent Document 1 discloses a VR treatment system for psychotherapy that measures the characteristics of a conversation between a patient's character and another character in a virtual space to determine the patient's mental state, and uses a coach character to provide verbal or visual feedback.

[0004] For example, Patent Document 2 discloses an electronic device for use in performing pain management through virtual reality or for treating or improving kinesiphobia. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Special Publication No. 2022-538996 [Patent Document 2] Special Publication No. 2022-540641 Summary of the Invention [Problem to be solved by the invention]

[0006] According to the Ministry of Health, Labor and Welfare, dementia is the number one cause of elderly people needing care, and from the perspective of preventive care to delay the onset and worsening of the need for care, the prevention of dementia has been set as a social goal. For example, in order to maintain and improve cognitive function, in addition to paying attention to exercise and diet, it is known that continuing to be involved with society (other people) is effective, that is, social participation such as interacting with friends and family, work, hobbies, lessons, volunteer activities, local events, and participation in salons.

[0007] However, some elderly people find it difficult to interact with society due to physical factors such as a decline in walking ability and cognitive function, psychological factors such as a decrease in confidence in activities of daily living, depression, and loss of meaning in life, and social and environmental factors such as the climate, financial hardship, and a lack of close friends around them.

[0008] The technology disclosed in Patent Document 1 allows elderly people to interact with others in a virtual space, but does not take into consideration maintaining and improving cognitive function through such interactions. Patent Document 2 also does not consider maintaining and improving cognitive function through interactions between elderly people and others in a virtual space.

[0009] The present invention has been made in consideration of the above, and aims to enable users to maintain and improve mental and physical functions, including cognitive functions, by interacting with others in the metaverse. [Means for solving the problem]

[0010] As one aspect for solving the above-mentioned problem, there is provided a metaverse healthcare content recommendation method executed by a metaverse healthcare system that provides content in the metaverse to maintain and improve a user's cognitive function, the metaverse healthcare system having a processor and a storage unit, the storage unit storing user basic data including attributes of the user, real-world data including information on at least one of the user's vital signs, lifestyle habits, medical history, and medication in the real world, and at least one of the usage status of the content used by the user in the metaverse and physical data of the user when using the content. The system is characterized in that it has the following processes: metaverse data including information on the user's basic data and real-world data, and test data including scores obtained by testing the user's cognitive function; the processor classifies the users into user groups based on the user basic data and the real-world data, calculates an analysis value of the score for each user group based on the test data, selects the content used by the user group whose analysis value is equal to or greater than a certain value based on the metaverse data as recommended content to be used by the user; and outputs information regarding the recommended content to a display that displays information allowing the user to recognize the metaverse. Effect of the Invention

[0011] According to the present invention, elderly people can maintain and improve their cognitive function by interacting with others in a virtual space. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram showing an example of the configuration of a virtual reality system according to a first embodiment. [Diagram 2] FIG. 4 is a diagram showing an example of a configuration of user basic data according to the first embodiment. [Diagram 3] FIG. 2 is a diagram showing an example of a configuration of real world data according to the first embodiment. [Figure 4] FIG. 2 is a diagram showing an example of the configuration of metaverse data 123 according to the first embodiment. [Diagram 5] FIG. 2 is a diagram showing an example of a configuration of test data according to the first embodiment. [Figure 6] FIG. 2 is a diagram showing an example of a configuration of recommended content data according to the first embodiment. [Figure 7] 11 is a flowchart showing an example of a metaverse process according to the first embodiment. [Figure 8] FIG. 2 is a diagram showing an example of a recommended content display group according to the first embodiment. [Figure 9] 4 is a flowchart showing an example of a data analysis process according to the first embodiment. [Figure 10] 11 is a flowchart showing an example of a data analysis process according to the second embodiment. [Figure 11] 13 is a flowchart showing an example of a data analysis process according to the third embodiment. [Figure 12] FIG. 13 is a diagram showing an example of the configuration of a predicted list of users with cognitive decline according to the third embodiment. [Figure 13] 13 is a flowchart showing an example of a data analysis process according to the fourth embodiment. [Figure 14] 13 is a flowchart showing an example of an exclusion content determination process according to the fourth embodiment. [Figure 15] FIG. 13 is a view showing an example of the configuration of excluded content list data according to the fourth embodiment. [Figure 16] 13 is a flowchart showing an example of an exclusion content determination process according to the fifth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. In this embodiment, the same components are generally designated by the same reference numerals, and repeated explanations will be omitted. Note that this embodiment is merely an example for realizing the present invention, and does not limit the technical scope of the present invention. The number of each component in this embodiment is not limited unless otherwise noted.

[0014] In the following description, when the same components are described with distinction, reference numerals including suffixes are used, and when they are described without distinction, reference numerals without suffixes are used. For example, when the AAA parts 15a and 15b are described with distinction, reference numerals 15a and 15b including suffixes a and b are used, and when they are described without distinction, reference numeral 15 without suffixes is used.

[0015] In the following explanation, the processing performed by a program may be described. A computer performs processing defined by a program using a processor (e.g., a CPU (Central Processing Unit), a GPU (Graphics Processing Unit)) while using memory in a main storage device, etc. Therefore, the processor may be the entity that performs processing by executing a program. The processor executes a program to realize a functional unit that performs processing.

[0016] Similarly, the subject of the processing performed by executing the program may be a controller, device, system, computer, or node having a processor. The subject of the processing performed by executing the program may be a computing unit, and may include a dedicated circuit that performs specific processing. The dedicated circuit is, for example, an FPGA (Field Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit).

[0017] In the following description, a program may be installed in a computer from a program source. The program source may be, for example, a program distribution server or a non-transitory storage medium readable by a computer. When the program source is a program distribution server, the program distribution server may include a processor and a storage resource (storage) for storing a program to be distributed, and the processor of the program distribution server may distribute the program to be distributed to other computers. In addition, in an embodiment, two or more programs may be realized as one program, and one program may be realized as two or more programs.

[0018] In the following description, various data will be described in a table format, but the data format is not limited to the table format and may be other data formats such as a queue, a list, or CSV (Comma Separated Value).

[0019] [Embodiment 1] Daily lifestyle habits are closely related to the onset of dementia and the decline of cognitive function. It is effective to prevent lifestyle-related diseases such as a well-balanced diet, moderate exercise and sleep, diabetes, high blood pressure, and dyslipidemia. Furthermore, interacting with others and intellectual activities are also effective in preventing dementia and maintaining and improving cognitive function. When talking with others, we use our brains to think of responses to match what the other person is saying, and to get a sense of the other person's mood by observing their appearance. In addition, when meeting others, we use the memory area of ​​the brain to think about multiple things, such as what day, what time, and where to meet, what time to leave to make it in time, and which route to take. By having diverse interactions with family, friends, and hobby groups, the brain receives a lot of stimulation from hearing different stories from multiple people and gaining new knowledge, which is effective in preventing dementia and maintaining and improving cognitive function. In this way, interacting with others is effective in suppressing and maintaining cognitive function decline.

[0020] Therefore, in embodiment 1, the content that a user who has achieved the maintenance and improvement of cognitive function actually uses in the metaverse is proposed to other users as content suitable for maintaining and improving cognitive function, thereby achieving the maintenance and improvement of cognitive function using the metaverse.

[0021] (Configuration of Metaverse Healthcare System S according to the First Embodiment) FIG. 1 is a diagram showing an example of the configuration of a metaverse healthcare system S according to the first embodiment.

[0022] The Metaverse Healthcare System S provides a virtual reality in a metaverse (virtual space) constructed on the Internet to a user wearing a VR (Virtual Reality) device (VR goggles, VR headset, etc.) equipped with a head-mounted display. The Metaverse Healthcare System S provides users with various experiences in the metaverse by executing content data. Users who use the same content in the metaverse can communicate with each other, such as by having conversations or competing against each other.

[0023] In this embodiment, each user is recommended to use content that has a track record of maintaining and improving the cognitive functions of other users. Note that content that is not limited to cognitive functions may be recommended as content that is highly effective in maintaining and improving other mental and physical functions depending on the characteristics of the content. For example, walking content may be recommended as content that is highly effective in maintaining and improving walking functions.

[0024] The metaverse healthcare system S includes a metaverse healthcare server 1 and a wearable device 2, which is a VR device for each user. The wearable device 2 and the metaverse healthcare server 1 are connected to the nearest gateway by wireless communication, and are connected by communication via the gateway and a network N such as the Internet. The metaverse healthcare server 1 may be built in an on-premise environment or a cloud environment.

[0025] The metaverse healthcare server 1 includes a processor 11, a storage unit 12 including a memory and storage, and a communication device 13. The processor 11 includes a metaverse processing unit 111 and a data analysis processing unit 112, which are implemented by executing a program.

[0026] The memory unit 12 stores user basic data 121, real world data 122, metaverse data 123, and test data 124. The memory unit 12 also stores recommended content list data 125, cognitive impairment user predicted list data 126, excluded content list data 127, and content data 128. The user basic data 121 and real world data 122 are input when a user who uses the metaverse provided by the metaverse healthcare server 1 is registered. The cognitive impairment user predicted list data 126 will be described in embodiment 3. The excluded content list data 127 will be described in embodiment 4.

[0027] 2 is a diagram showing an example of the configuration of the user basic data 121 according to embodiment 1. The user basic data 121 stores attribute information of each user, such as a user ID, a user name, a date of birth, a sex, a height, a weight, and so on.

[0028] 3 is a diagram showing an example of the configuration of real world data 122 according to the first embodiment. The real world data 122 stores information on at least one of the user's vital signs, lifestyle habits, medical history, and medication, such as daily health data, medical history data, and medication data, for each user. The daily health data stores various information on lifestyle habits that affect physical and mental health, such as the number of steps, heart rate, sleep time, weight, living status (living alone / living with someone), whether or not the user smokes, whether or not the user drinks, whether or not the user exercises regularly, and whether or not the user has a hobby. The daily health data may include a record of the user's actions acquired by a GPS (Global Positioning System) function of the wearable device 2.

[0029] The medical history data stores history information on illnesses and injuries such as diabetes, high blood pressure, history of falls, hyperlipidemia, Parkinson's disease, dementia, hearing loss, visual impairment, history of head trauma, etc. The medication data stores history information on medications and treatments for illnesses and injuries such as diabetes medicine, high blood pressure medicine, heart disease medicine, antineurotic medicine, anti-Parkinson's disease medicine, sleeping pills, Chinese herbal medicine, acupuncture, etc.

[0030] FIG. 4 is a diagram showing an example of the configuration of the metaverse data 123 according to the first embodiment. The metaverse data 123 stores, for each user and for each content, the usage status of the content, such as the recommended date and time, the total value of the usage time of the content, the voice data recording the voice when using the content, and the total value of the conversation time of the user when using the content. The metaverse data 123 also stores physical data indicating the physical condition of the user when using the content, such as the heart rate and the calories burned. The recommended date and time is the date and time when the corresponding content is presented in step S12 of the metaverse processing (FIG. 7). For example, when three dates and times are recorded in the recommended date and time, it indicates that the corresponding content has been recommended to the corresponding user three times in the past. The metaverse data 123 may also manage attributes such as the genre of each content.

[0031] Content genres include, for example, sports (badminton, tennis, volleyball, skiing, etc.), travel (domestic travel, overseas travel, etc.), table games (cards, shogi, mahjong, etc.), and hobbies (calligraphy, handicrafts, etc.). Content genres also include, for example, learning (attending lectures, etc.), brain training (calculation, memory, reaction speed, etc.), shopping, and medical services (counseling, etc.). Users can experience sports, travel, table games, hobbies, learning, brain training, shopping, medical services, etc. in the metaverse in the same way as they would in the real world.

[0032] FIG. 5 is a diagram showing an example of the configuration of the test data 124 according to the first embodiment. The test data 124 stores the test scores of the mental and physical functions such as cognitive function and walking function for each user in chronological order. The test data 124 is the test score of each physical function for each user recorded and provided by a medical institution or an administrative agency at regular intervals, such as once every three or six months. In the case of cognitive function, the scores of MMSE, MoCA, DASC-21, Mini-Cog, HDS-R, ABC-DS, etc. are used as the evaluation scale. The DASC-21 can evaluate both cognitive impairment and daily living impairment, and can be easily evaluated in the form of answers to questions.

[0033] The tests or assessments on which the test data 124 is based may be conducted in the real world, the metaverse, or online.

[0034] 6 is a diagram showing an example of the configuration of the recommended content list data 125 according to the embodiment 1. The recommended content list data 125 stores a predetermined number of latest information on IDs of contents that are recommended for use by the user to maintain and improve cognitive function, with priority assigned to the contents.

[0035] Returning to the explanation of Fig. 1, the content data 128 is content that provides various simulated experiences to users in the metaverse provided by the metaverse healthcare server 1. For example, if the content genre is social, users who use the same content in the metaverse can enjoy conversations with each other. Also, if the content genre is sports, users who use the same content in the metaverse can enjoy sports in a simulated manner.

[0036] The metaverse processing unit 111 of the processor 11 operates and controls the metaverse provided by the metaverse healthcare server 1, and executes the content data 128 to provide a simulated experience to the user. The metaverse processing unit 111 presents a list of contents recommended for use from the perspective of maintaining and improving cognitive function to the user who enters the metaverse based on the recommended content list data 125, and allows the user to select content. The metaverse processing unit 111 also acquires and records, via the wearable device 2, a history of the user who enters the metaverse, such as actions, movements, and physical conditions.

[0037] The data analysis processing unit 112 of the processor 11 selects content to be recommended to the user from the perspective of maintaining and improving cognitive function, based on the user basic data 121, the real world data 122, the metaverse data 123, and the test data 124. The data analysis processing unit 112 stores the ID of the selected content in the recommended content list data 125. The data analysis processing unit 112 repeats the selection of recommended content and the storage in the recommended content list data 125 at a predetermined cycle, so that the latest data is reflected in the recommended content list data 125.

[0038] The communication device 13 is a communication interface for the metaverse healthcare server 1 to communicate with the wearable device 2.

[0039] The wearable device 2 is, for example, a head-mounted VR device, and includes a processor 21, a storage unit 22, a communication device 23, a sensor 24, a speaker 25, a microphone 26, and a display 27.

[0040] The processor 21 controls the entire wearable device 2. The storage unit 22 includes a memory and a storage, and stores programs for controlling the wearable device 2 executed by the processor 21 and various data.

[0041] The communication device 23 is a communication interface that enables the wearable device 2 to communicate with the metaverse healthcare server 1.

[0042] The sensor 24 is a type of sensor, such as a pulse wave sensor, a thermometer, and a motion sensor, that acquires vital signs, physical data, motion information, and environmental information of the user wearing the wearable device 2. For example, the user's body movements detected by the motion sensor are processed by the metaverse healthcare server 1 and displayed via the display 27 of the wearable device 2 of another user so that the movements are recognized as the user's movements in the metaverse in the same way as in the real world.

[0043] Based on the actions of the user wearing the wearable device 2 while executing each content, detected by the motion sensor, the "usage time" of each content in the metaverse data 123 is measured. The heartbeat of the user wearing the wearable device 2 while executing each content, detected by the pulse wave sensor, is counted by the processor 21, and becomes the "heart rate" of each content in the metaverse data 123. In addition, the body temperature of the user wearing the wearable device 2 while executing each content, detected by the thermometer, and the actions of the user wearing the wearable device 2 while executing each content, detected by the motion sensor, are analyzed by the processor 21. Then, it becomes the "calories consumed" of each content in the metaverse data 123.

[0044] The speaker 25 outputs sound to the user wearing the wearable device 2. The microphone 26 picks up sounds from the user wearing the wearable device 2 and the surrounding area. The display 27 is a head-mounted display, and displays various information to the user wearing the wearable device 2 so as to immerse the user in the metaverse. The display 27 may superimpose or additionally display information related to the metaverse while allowing the user to see through the real world around the user.

[0045] The sensor 24 may be a separate smart device that cooperates with the wearable device 2. For example, when the sensor 24 is a pulse wave sensor, a pulse wave sensor provided in a smart watch that cooperates with the wearable device 2 may be used.

[0046] (Metaverse processing according to the first embodiment) 7 is a flowchart showing an example of a metaverse process according to embodiment 1. The metaverse process is executed every time a user enters the metaverse.

[0047] First, in step S11, the metaverse processing unit 111 of the metaverse healthcare server 1 accepts a user's entry into the metaverse. The user wears the wearable device 2 on his / her head or the like, starts it up, and enters user information to perform an entry operation into the metaverse. The metaverse processing unit 111 accepts the user's entry operation into the metaverse from the wearable device 2 and performs entry processing.

[0048] Next, in step S12, the metaverse processing unit 111 presents the recommended content, which is recorded in the record with the most recent update date and time recorded in the recommended content list data 125, to the user via the display 27.

[0049] Next, in step S13, the metaverse processing unit 111 accepts content selected by the user from the list of recommended content presented to the user in step S21.

[0050] Next, in step S14, the metaverse processing unit 111 reads and executes the content data 128 of the content whose selection was accepted in step S13.

[0051] Next, in step S15, the metaverse processing unit 111 collects physical data and the like detected by the user's wearable device 2 in the metaverse during execution of the content started in step S14, and stores the collected data as metaverse data 123.

[0052] Next, in step S16, the metaverse processing unit 111 accepts the user's exit from the metaverse.

[0053] (Recommended content display group 27D according to embodiment 1) Fig. 8 is a diagram showing an example of a recommended content display group 27D according to embodiment 1. The recommended content display group 27D shown in Fig. 8 is displayed on the display 27 of the wearable device 2 worn by the user in step S12 (Fig. 7) of the metaverse process. As an example, five recommended content displays 27D1 to 27D5 are displayed in the recommended content display group 27D. For example, the user can execute the content by pressing the recommended content display 27D1 to 27D5 that the user wants to execute.

[0054] (Data Analysis Processing According to the First Embodiment) 9 is a flowchart showing an example of data analysis processing according to embodiment 1. The data analysis processing is executed at a predetermined cycle, and creates recommended content list data 125 based on user basic data 121, real world data 122, metaverse data 123, and inspection data 124. By periodically executing the data analysis processing, it is possible to hold recommended content list data 125 updated based on the latest user basic data 121, real world data 122, metaverse data 123, and inspection data 124.

[0055] First, in step S21, the data analysis processing unit 112 of the metaverse healthcare server 1 acquires user basic data 121 stored in the metaverse healthcare server 1. Next, in step S22, the data analysis processing unit 112 acquires real world data 122 stored in the metaverse healthcare server 1. Next, in step S23, the data analysis processing unit 112 acquires metaverse data 123 stored in the metaverse healthcare server 1. Next, in step S24, the data analysis processing unit 112 acquires test data 124 stored in the metaverse healthcare server 1.

[0056] Next, in step S25, the data analysis processing unit 112 classifies the users by cluster analysis using the user basic data 121 and the real world data 122. It is desirable to perform clustering so that each cluster of users has approximately 10 to 100 people.

[0057] Next, in step S26, the data analysis processing unit 112 analyzes the cognitive function scores of the test data 124, and identifies good users whose analysis value of the score is equal to or greater than a certain value, or is in the top predetermined number or a predetermined percentage. The analysis value of the score is the degree of maintenance and improvement of the user's cognitive function, which is expressed as a ratio obtained by dividing the score of test data of a certain implementation date that is different from the implementation date of the test data 124 by the score of test data of the test date that is one date older than the test data. The degree of maintenance and improvement may be the difference between the latest data and the most recent previous data, or may be the average of the improvement rate or improvement amount of multiple data from the latest data over a predetermined period of time in the past.

[0058] The good users are a group of users whose analysis score is equal to or above a certain value, or is in the top predetermined number or a predetermined percentage, among the user groups grouped in step S25, and whose cognitive function is progressing well.

[0059] In step S26, instead of the transition of the cognitive function scores in the test data 124, the excellent users may be identified in descending order of the latest cognitive function scores in the test data 124.

[0060] Next, in step S27, the data analysis processing unit 112 identifies a top predetermined number or a top predetermined percentage of good content based on the metaverse data 123, which has the longest conversation time of the good users identified in step S26.

[0061] Next, in step S28, the data analysis processing unit 112 updates the recommended content list data 125 with the quality content identified in step S27.

[0062] In step S27, the content may not be limited to those that the good users have been talking about for a long time, but may be all the content that the good users have used for a certain period of time or more.

[0063] In addition, a report on the usage time of each piece of content and cognitive function test data may be created for the user on a regular basis (eg, whenever the recommended content list data 125 is updated).

[0064] (Effects of the First Embodiment) In the above-described first embodiment, for each user group into which users are classified based on the user basic data 121 and the real-world data 122, a cognitive function score is calculated based on the test data 124. Based on the metaverse data 123, content used by a user group with an excellent cognitive function score is selected as recommended content to be used by other users, and output to the display 27 of the wearable device 2.

[0065] Therefore, by encouraging users to use content that has a proven track record in maintaining and improving cognitive function and promoting user interaction in the metaverse, the effectiveness of maintaining and improving cognitive function can be increased.

[0066] In addition, by selecting as recommended content those whose total conversation time during content execution is equal to or longer than a certain time based on the metaverse data 123, it is possible to efficiently maintain and improve cognitive function based on the causal relationship between conversation time and cognitive function.

[0067] [Embodiment 2] In the first embodiment, each user is recommended to use content that has a proven track record of maintaining and improving the cognitive function of other users. However, simply interacting with many people is not enough. Stress and anxiety associated with human relationships and sudden changes in the environment may lead to the onset of dementia and cognitive decline. For example, forcing oneself to meet people one does not want to meet, forcing oneself to interact with many people when one prefers interacting with a small number of people, interacting with many people without considering the upper limit of one's mental and physical strength, etc., can cause stress, anxiety, and extreme fatigue. This may lead to the onset of dementia and the decline of cognitive function. Increasing high-quality interactions while making the person feel comfortable and without a large burden is effective in preventing dementia and maintaining and improving cognitive function.

[0068] Therefore, in embodiment 2, by increasing positive emotions such as joy and trust over negative emotions such as anxiety and fear when interacting with other users, it is possible to encourage interactions that are effective in preventing dementia and maintaining and improving cognitive function.

[0069] (Data analysis processing according to the second embodiment) Fig. 10 is a flowchart showing an example of the data analysis process according to the embodiment 2. The data analysis process according to the embodiment 2 is different from the data analysis process according to the embodiment 1 (Fig. 9) in that step S27a is executed between steps S27 and S28, and is otherwise similar.

[0070] In step S27a, the data analysis processing unit 112 of the metaverse healthcare server 1 performs a conversation voice analysis of the excellent contents identified in step S27, and narrows down the excellent contents whose time ratio of positive conversation is equal to or greater than a certain ratio or whose number is in the top predetermined range.

[0071] According to emotion analysis using voice data, emotions can be classified into, for example, joy, trust, pride, relief, gratitude, hope, interest, satisfaction, pleasure, familiarity, anxiety, fear, sadness, disgust, guilt, anger, disappointment, loneliness, resentment, etc. Among these, joy, trust, pride, relief, gratitude, hope, interest, satisfaction, pleasure, and familiarity are classified as positive emotions. Moreover, anxiety, fear, sadness, disgust, guilt, anger, disappointment, loneliness, and resentment are classified as negative emotions. Emotions are acquired by analyzing voice during conversation with others, or by analyzing vital signs such as heart rate, heart rate variability, pulse rate, blood pressure, transcutaneous arterial oxygen saturation, respiration, and calories burned.

[0072] The data analysis processing unit 112 calculates the time ratio of positive emotions (positive time ratio) using formula (1). Note that emotions are not limited to voice, and may be estimated from heart rate variability, pulse rate, or a combination of voice, heart rate variability, and pulse rate. Positive Time Ratio = Time spent with positive emotions / (Time spent with positive emotions + Time spent with negative emotions) (1)

[0073] In step S28, the data analysis processor 112 updates the recommended content list data 125 with the quality content narrowed down in step S27a.

[0074] (Effects of the second embodiment) In the above-mentioned second embodiment, the content is selected as the recommended content if the ratio of the total conversation time during which the user expresses positive emotions to the total conversation time during the execution of the content is equal to or greater than a certain ratio. This allows the content that is highly efficient and effective in maintaining and improving cognitive function to be selected as the recommended content, taking into account the emotions given by the user.

[0075] [Embodiment 3] In embodiment 3, by narrowing down the target of recommendations to specific users to use content that has a proven track record of maintaining and improving the cognitive functions of other users, unnecessary notifications of recommendations are suppressed and the effectiveness of maintaining and improving cognitive functions is further enhanced.

[0076] (Data analysis processing according to the third embodiment) Fig. 11 is a flowchart illustrating an example of the data analysis process according to the embodiment 3. Fig. 11 is a diagram illustrating an example of the configuration of the cognitive impairment user prediction list data 126 according to the embodiment 3.

[0077] The data analysis process according to the third embodiment is different from the data analysis process according to the first embodiment (FIG. 9) in that steps S27b and S27c are executed between steps S27 and S28, but otherwise is similar.

[0078] In step S27b, the data analysis processing unit 112 of the metaverse healthcare server 1 predicts users whose cognitive function will decline in the future, based on the user basic data 121, the real world data 122, and the metaverse data 123.

[0079] For example, the cognitive function of each user after a predetermined period of time (for example, two years later) is predicted by a regression analysis using the cognitive function score as the objective variable and the item values ​​of the user basic data 121, the real world data 122, and the metaverse data 123 as explanatory variables. Then, users whose cognitive function has declined from the current state are extracted. Alternatively, a model in which the item values ​​of the user basic data 121, the real world data 122, and the metaverse data 123 are input and the cognitive function score is output may be machine-learned, and the decline in the cognitive function of the user may be predicted based on this model. This model is re-learned at regular intervals to reflect updates to the real world data 122 and the metaverse data 123.

[0080] Next, in step S27c, the data analysis processing unit 112 updates the cognitively impaired user predicted list data 126 (FIG. 12) with the users extracted in step S27b. If the cognitively impaired user predicted list data 126 exists, when presenting recommended content in step S12 of the metaverse process (FIG. 7), the recommended content is presented only to users whose user IDs are recorded in the cognitively impaired user predicted list data 126.

[0081] (Effects of the Third Embodiment) In the above-mentioned third embodiment, users who are predicted to have a decline in cognitive function scores in the future are extracted based on the prediction model, and recommended content is notified to the extracted users. This narrows down the targets that require notification, suppresses notification of unnecessary recommended content, and further improves the efficiency and effectiveness of maintaining and improving cognitive function.

[0082] [Embodiment 4] In the third embodiment, the target is narrowed down to users who can be expected to maintain and improve their cognitive functions. In contrast, in the fourth embodiment, users who have not achieved any effect on maintaining or improving their cognitive functions in the past with a certain content are excluded from the target, thereby suppressing useless recommendations of the content and meaningless execution of the content.

[0083] (Data Analysis Processing According to the Fourth Embodiment) FIG. 13 is a flowchart illustrating an example of the data analysis process according to the fourth embodiment.

[0084] The data analysis process according to the fourth embodiment is different from the data analysis process according to the first embodiment (FIG. 9) in that step S27d is executed between steps S27 and S28, but is otherwise similar.

[0085] In step S27d, the data analysis processing unit 112 of the metaverse healthcare server 1 executes an exclusion content determination process to exclude content that is less effective in maintaining and improving the cognitive function of the user from the excellent content identified in step S27. In the exclusion content determination process, exclusion content list data 127 (FIG. 15) described later is created. Details of the exclusion content determination process will be described later with reference to FIG. 14.

[0086] If excluded content list data 127 (FIG. 15) exists, in step S12 of the metaverse process (FIG. 7), the recommendation of the user and content corresponding to the user ID and content ID recorded in the excluded content list data 127 is canceled and not presented.

[0087] (Exclusion content determination process according to the fourth embodiment) 14 is a flowchart showing an example of an exclusion content determination process according to embodiment 4. First, in step S27d1, the data analysis processing unit 112 of the metaverse healthcare server 1 selects one content from the excellent contents identified in step S27 (FIG. 12).

[0088] Next, in step S27d2, the data analysis processing unit 112 refers to the metaverse data 123 and the test data 124, and judges whether the content selected in step S27d1 is a content for which there exists a user whose cognitive function has continuously decreased a predetermined number of times in the past (for example, twice). If the content is a content for which there exists a user whose cognitive function has continuously decreased a predetermined number of times in the past (YES in step S27d2), the data analysis processing unit 112 moves the process to step S27d3. On the other hand, if the content is not a content for which there exists a user whose cognitive function has continuously decreased a predetermined number of times in the past (NO in step S27d2), the data analysis processing unit 112 moves the process to step S27d6.

[0089] In step S27d3, the data analysis processing unit 112 refers to the metaverse data 123 and determines whether the content selected in step S27d1 is content that has been recommended a predetermined number of times in the past (e.g., twice) to the user for whom the result in step S27d2 is YES. If the content has been recommended a predetermined number of times in the past (YES in step S27d3), the data analysis processing unit 112 moves the process to step S27d4. On the other hand, if the content has not been recommended a predetermined number of times in the past (NO in step S27d3), the data analysis processing unit 112 moves the process to step S27d6.

[0090] In step S27d4, the data analysis processing unit 112 refers to the metaverse data 123 and determines whether the content selected in step S27d1 is a content whose usage time exceeds a certain time (for example, 5 hours) for the user whose result in step S27d3 is YES. If the content is a content whose usage time exceeds a certain time (YES in step S27d4), the data analysis processing unit 112 moves the process to step S27d5. On the other hand, if the content is not a content whose usage time exceeds a certain time (NO in step S27d4), the data analysis processing unit 112 moves the process to step S27d6.

[0091] In step S27d5, the data analysis processing unit 112 registers in the exclusion content list data 127 the combination of the content and the user for which the determination in steps S27d2, S27d3, and S27d4 is YES.

[0092] 15 is a diagram showing an example of the configuration of the excluded content list data 127 according to the embodiment 4. The excluded content list data 127 stores the IDs of excluded contents for each user ID.

[0093] In step S27d6, the data analysis processing unit 112 judges whether all the quality contents identified in step S27 (FIG. 12) have been confirmed. If all the quality contents identified in step S27 (FIG. 12) have been confirmed (YES in step S27d6), the data analysis processing unit 112 ends the exclusion content determination process and moves the process to step S28 (FIG. 12). On the other hand, if not all the quality contents have been confirmed (NO in step S27d6), the data analysis processing unit 112 returns the process to step S27d1.

[0094] (Effects of the fourth embodiment) In the above-mentioned fourth embodiment, if the user has used previously recommended content for a certain period of time or more, but the cognitive function of the user has deteriorated, the same content is not recommended to the user. Thus, by suppressing useless content recommendations and suppressing meaningless content execution, the user's time wasting can be avoided.

[0095] [Embodiment 5] In the fourth embodiment, useless recommendation of content is suppressed by excluding from the target users who have not been effective in maintaining and improving cognitive function in the past with respect to a certain content. In contrast, in the fifth embodiment, useless recommendation of content is suppressed by excluding from the target users who have had a high ratio of negative conversations in the past with respect to a certain content.

[0096] (Exclusion content determination process according to the fifth embodiment) Fig. 16 is a flowchart showing an example of the exclusion content determination process according to embodiment 5. The exclusion content determination process according to embodiment 5 is different from the exclusion content determination process according to embodiment 4 (Fig. 14) in that steps S27d2a and S27d5a are executed instead of steps S27d2 to S27d5, but is otherwise similar.

[0097] In step S27d2a, the data analysis processing unit 112 of the metaverse healthcare server 1 determines whether the ratio of negative conversations for the user who has the content selected in step S27d1 is equal to or greater than a certain ratio as a result of the conversation voice analysis of the excellent content. The data analysis processing unit 112 calculates the time ratio of negative emotions (negative time ratio) using formula (2). Negative Time Ratio = Time with Negative Emotions / (Time with Positive Emotions + Time with Negative Emotions) (2)

[0098] If the content has a ratio of negative conversations about a certain user that is equal to or greater than a certain ratio (step S27d2a YES), the data analysis processor 112 proceeds to step S27d5. On the other hand, if the content has a ratio of negative conversations about all users that is less than a certain ratio (step S27d2a NO), the data analysis processor 112 proceeds to step S27d6.

[0099] In step S27d6, the data analysis processing unit 112 registers in the excluded content list data 127 the content and the user corresponding to YES in step S28d2a.

[0100] (Effects of the fifth embodiment) In the above-mentioned embodiment 5, by excluding from the recommended content those contents and users that have had a high ratio of negative conversations in the past, it is possible to suppress unnecessary recommendation of contents while taking into consideration the negative emotions given to users. In particular, when there is a user who has negative emotions about a certain content, it is considered that other users have similarly had negative emotions about this content. Therefore, by excluding users who have negative emotions from this content, it is possible to take into consideration the emotions of other users.

[0101] Although the embodiments of the present disclosure have been described above in detail, the present disclosure is not limited to the above-described embodiments, and various modifications can be made without departing from the spirit of the present disclosure. For example, the above-described embodiments have been described in detail to clearly explain the present invention, and the present disclosure is not necessarily limited to those having all of the configurations described. In addition, it is possible to add, delete, or replace part of the configuration of the above-described embodiments with other configurations.

[0102] In addition, the above-mentioned configurations, functional units, processing units, etc. may be realized in part or in whole by hardware, for example, by designing them as integrated circuits. In addition, the above-mentioned configurations, functions, etc. may be realized in software by a processor interpreting and executing a program that realizes each function. Information such as the program, table, file, etc. that realizes each function can be stored in a memory, a recording device such as an HDD or SSD, or a recording medium such as an IC card, an SD card, or a DVD.

[0103] In addition, in each of the above figures, the control lines and information lines are shown as those considered necessary for the explanation, and do not necessarily show all the control lines and information lines in the actual implementation. For example, it may be considered that almost all the components are actually connected to each other.

[0104] The above-described arrangement of functions and data in each system and device is merely an example. The arrangement of functions and data can be changed to an optimal arrangement in terms of hardware and software performance, processing efficiency, communication efficiency, etc. [Explanation of symbols]

[0105] S: Metaverse healthcare system, 1: Metaverse healthcare server, 2: Wearable device, 11, 21: Processor, 27: Display, 111: Metaverse processing unit, 112: Data analysis processing unit, 121: User basic data, 122: Real world data, 123: Metaverse data, 124: Examination data, 125: Recommended content list data, 126: Cognitive impairment user prediction list data, 127: Excluded content list data.

Claims

1. A metaverse healthcare content recommendation method executed by a metaverse healthcare system that provides content in a metaverse to maintain and improve a user's cognitive function, The metaverse healthcare system includes a processor and a memory unit, The storage unit is User basic data including attributes of the user; Real-world data including information regarding at least one of the user's vital signs, lifestyle habits, medical history, and medication in the real world; Metaverse data including information regarding at least one of the usage status of the content used by the user in the metaverse and the physical data of the user when using the content; and test data including a score obtained by performing a test on the cognitive function of the user; The processor, classifying the users into user groups based on the user basic data and the real-world data; Calculating an analysis value of the score for each of the user groups based on the test data; Based on the metaverse data, the content used by the user group with the analysis value of a certain value or more is selected as a recommended content to be recommended to the user; The information about the recommended content is output to a display that displays the information so that the user can recognize the metaverse. A metaverse healthcare content recommendation method comprising each process.

2. The metaverse healthcare content recommendation method according to claim 1, The test data includes a plurality of test data items each having a different test date; The analysis value is a degree of maintenance and improvement of the cognitive function of the user, which is expressed as a difference or ratio between the score in the test data on a certain implementation date and the score in the test data on an implementation date that is one date older than the test data on that date. A metaverse healthcare content recommendation method comprising:

3. The metaverse healthcare content recommendation method according to claim 1, the metaverse data includes a total conversation time of the user during execution of the content; The processor, The content, the total conversation time during which the content is being executed based on the metaverse data is equal to or longer than a certain time, is selected as the recommended content. A metaverse healthcare content recommendation method comprising the steps of:

4. The metaverse healthcare content recommendation method according to claim 3, the metaverse data includes audio data of the user's conversation during execution of the content; The processor, performing a speech analysis of the speech data; Calculating a total time of the conversation during execution of the content in which the user's positive emotion is expressed based on the result of the voice analysis; The content in which the ratio of the total conversation time during which the user expresses positive emotions to the total conversation time of the user while the content is being played is equal to or greater than a certain ratio is selected as the recommended content. A metaverse healthcare content recommendation method comprising each process.

5. The metaverse healthcare content recommendation method according to claim 1, The inspection data includes a plurality of inspection data items each having an inspection date that is different from the inspection date; The processor, creating a prediction model for predicting the score for each user after a predetermined period of time has elapsed from the present based on the user basic data, the real-world data, the metaverse data, and the test data; extracting the users whose scores are predicted to decrease after a predetermined period of time has elapsed from the present based on the prediction model; The information regarding the recommended content is output to a display that displays the information so that the user who is extracted as being predicted to have a lower score can recognize the metaverse. A metaverse healthcare content recommendation method comprising each process.

6. The metaverse healthcare content recommendation method according to claim 2, The metaverse data includes a recommended date and time when the content was recommended to the user as the recommended content in the past, The processor, Based on the test data, it is determined whether there is a combination of the recommended content and the user in which the maintenance improvement degree has been continuously decreasing for a predetermined number of implementation dates including the latest implementation date; If the combination exists, it is determined based on the metaverse data whether the content in the combination has been recommended as the recommended content to the user in the combination a predetermined number of times in the past; When the content in the combination has been recommended to the user in the combination a predetermined number of times in the past, determining whether the user's usage time of the content has exceeded a certain period of time based on the metaverse data; When the user's usage time of the content exceeds a certain period of time, the content is excluded from the content recommended to the user. A metaverse healthcare content recommendation method comprising each process.

7. The metaverse healthcare content recommendation method according to claim 4, further comprising: The processor, Calculating a total time of the conversation during execution of the content in which the user's negative emotions are expressed based on the results of the voice analysis; selecting a piece of content in which a ratio of a total time of the conversation in which the user expresses negative emotions to a total value of the conversation time of the user during execution of the piece of content is equal to or greater than a certain ratio; The selected content is excluded from the recommended content for the user. A metaverse healthcare content recommendation method comprising each process.

8. A metaverse healthcare system that provides content in a metaverse to maintain and improve a user's cognitive function, A processor and a storage unit are included. The storage unit is User basic data including attributes of the user; Real-world data including information regarding at least one of the user's vital signs, lifestyle habits, medical history, and medication in the real world; Metaverse data including information regarding at least one of the usage status of the content used by the user in the metaverse and the vital signs of the user when using the content; and test data including a score obtained by performing a test on the cognitive function of the user; The processor, classifying the users into user groups based on the user basic data and the real-world data; Calculating an analysis value of the score for each of the user groups based on the test data; Based on the metaverse data, the content used by the user group with the analysis value of a certain value or more is selected as a recommended content to be recommended to the user; The information about the recommended content is output to a display that displays the information so that the user can recognize the metaverse. A metaverse healthcare system characterized by:

Citation Information

Patent Citations

  • Virtual Reality Therapy System

    JP2022538996A

  • Electronic devices and related methods for virtual or augmented reality-based therapeutic interventions

    JP2022540641A