Virtual reality space interaction method and system for nursing home

Abstract

The invention discloses a virtual reality space interaction method and system for a nursing home. The virtual reality space interaction method for the nursing home comprises the steps that whether user identity information can be obtained or not is judged according to user head portrait information, and if yes, the user identity information and user position information are obtained; acquiring user demand information; judging whether a user virtual human needs to be established according to the user demand information, and if so, establishing the user virtual human; task information is acquired according to the user demand information; controlling the virtual person of the user to complete the task information in the virtual reality space and generating a task report; and performing man-machine interaction with the user according to the task report so as to obtain a new round of task information until interaction is finished. Only the demand information of the user needs to be obtained, and the system automatically controls the virtual human to complete the demand items of the user.

Description

Technical Field

[0001] The present application relates to the field of virtual reality technology, and in particular to a virtual reality space interaction method for a nursing home and a virtual reality space interaction system for a nursing home. Background Art

[0002] Existing large-scale nursing homes occupy a huge area. For example, a nursing home covers an area of ​​about 140,000 square meters and can provide about 3,000 nursing units. Assuming two elderly people in one household, the number is about 6,000 people. The nursing home is equipped with gyms, cinemas, multiple restaurants, massage, community hospitals and other facilities for the elderly in the nursing home to use. The large area provides the elderly in the nursing home with enough space and facilities for activities. However, it also causes the elderly to need more exercise when exercising in the nursing home. For example, it may take an ordinary person 10 minutes to walk from their residence to the restaurant, while the elderly (especially those with underlying diseases) may need 20 minutes or more to walk the same distance from their residence to the hotel. However, if they go to the site and find that there is no space or other situations, it will not only disappoint the elderly, but also cause physical burden on them.

[0003] In the prior art, one can inquire whether there are vacancies in various facilities by calling. However, the disadvantages of this method are:

[0004] (1) The facility owner needs to arrange for someone to provide telephone service, which wastes manpower;

[0005] (2) The number of consultation calls that can be accommodated by general facilities is limited. When there are many people consulting, the phone line may be busy for a long time;

[0006] (3) Elderly people may be hard of hearing or have speech problems, which may lead to poor communication. This not only fails to solve the problem, but also prolongs the telephone communication time and delays other telephone calls.

[0007] (4) Even if the call is connected and the service provider is communicating, the service provider may not understand the specific situation or be unable to express it in detail. For example, when asking about the number of people swimming in the gym's pool, the service provider may only be able to say general statements such as "a lot" or "a little". Or when asking about the cafeteria menu today, the service provider may not be able to tell the elderly about each dish one by one.

[0008] Therefore, it is hoped that a technical solution can be provided to solve or at least alleviate the above-mentioned deficiencies of the prior art. Summary of the invention

[0009] The purpose of the present invention is to provide a virtual reality space interaction method for nursing homes to solve at least one of the above-mentioned technical problems.

[0010] The present invention provides the following scheme:

[0011] According to one aspect of the present invention, a virtual reality space interaction method for a nursing home is provided, and the virtual reality space interaction method for a nursing home comprises:

[0012] Get user avatar information;

[0013] Determine whether the user's identity information can be obtained based on the user's profile picture information. If so,

[0014] Obtaining the user's identity information and obtaining the user's location information using a device for obtaining the user's head portrait information;

[0015] Obtain user demand information;

[0016] Analyze the user demand information, and determine whether it is necessary to establish a user virtual person according to the user demand information. If so,

[0017] Creating a user virtual person in the virtual reality space at the location of the user;

[0018] Acquiring task information according to the user demand information;

[0019] Controlling the user virtual person to complete the task information in the virtual reality space and generate a task report; wherein the virtual reality space includes twin spaces of various facilities in the nursing home;

[0020] Human-computer interaction is performed with the user according to the task report, thereby obtaining a new round of task information until the interaction ends.

[0021] Optionally, acquiring task information according to the user demand information includes:

[0022] Acquire a user expression habit database according to the user identity information, wherein the expression habit database includes a location sub-library and a behavior sub-library, wherein the location sub-library includes at least one group of names of activity areas in a nursing home; the behavior sub-library includes at least one group of behavior names, and one of the behavior name groups is associated with at least one group of names of activity areas in a nursing home;

[0023] According to the user demand information, obtaining a group of activity area names of the nursing home required by the user from the position sub-library and a group of behavior names required by the user from the behavior sub-library;

[0024] Determine whether the obtained nursing home active area name group and behavior name group are related. If so, use the obtained nursing home active area name group and behavior name group as task information.

[0025] Optionally, controlling the user virtual person to complete the task information in the virtual reality space and generate a task report includes:

[0026] Generate at least two virtual human motion paths from the current location of the virtual human to the target movable area corresponding to the movable area name group according to the current location of the virtual human and the movable area name group;

[0027] Obtain the name of the movable area passed by in the middle of each virtual human motion path;

[0028] Sending the names of the movable areas passed by each virtual human motion path to the user;

[0029] Obtaining selection information fed back by users;

[0030] Selecting one of the virtual human movement paths according to the selection information fed back by the user, thereby controlling the virtual human to move according to the selected virtual human movement path until reaching the target movable area;

[0031] After the virtual person reaches the target movable area, intelligence data is collected from the target movable area to generate a mission report.

[0032] Optionally, when one of the virtual human motion paths is selected according to the selection information fed back by the user, thereby controlling the virtual human to move according to the selected virtual human motion path until reaching the movable area name group, the virtual reality space interaction method for a nursing home further includes:

[0033] Acquire a user virtual reality space preference database, wherein the user virtual reality space preference database is provided with at least one preset user preference sub-library and preset user identity information corresponding to each preset user preference sub-library;

[0034] Acquire a preset user preference sub-library corresponding to the preset user identity information that is the same as the user identity information;

[0035] Determine whether there is a preset scenery style preference setting in the preset user preference sub-library, and if so,

[0036] In the process of controlling the virtual human to move according to the selected virtual human movement path until reaching the movable area name group, the scenery along the way is displayed to the user according to the scenery style preference setting along the way.

[0037] Optionally, the scenery style preference setting along the way includes a real scenery style, a virtual scenery style and a real scenery historical style; wherein, when the scenery style preference setting along the way is set to the real scenery style, in the process of controlling the virtual person to move according to the selected virtual person movement path until reaching the movable area name group, displaying the scenery along the way for the user according to the scenery style preference setting along the way includes:

[0038] Obtaining a nursing home camera device range database, wherein the nursing home camera device range database includes the ID of each camera device of the nursing home and the shooting range information of each camera device;

[0039] According to the current coordinate position of the virtual person, video information of a camera device capable of photographing the current coordinate position is retrieved in real time and transmitted to a control terminal for interacting with the user.

[0040] Optionally, when the scenery style preference setting along the way is set to a real scenery style, in the process of controlling the virtual person to move according to the selected virtual person movement path until reaching the movable area name group, displaying the scenery along the way to the user according to the scenery style preference setting along the way includes:

[0041] Determine whether there are historical conditions in the scenery style preference settings along the way. If so, then

[0042] Determine whether historical video information can be retrieved based on historical conditions. If so,

[0043] Retrieve historical video information based on historical conditions.

[0044] Optionally, the historical conditions include date information, climate information and time information;

[0045] The retrieving historical video information according to historical conditions includes:

[0046] Determine whether the historical conditions include date information, climate information and time information, and have a priority between the date information and the climate information. If the historical conditions include date information and time information, retrieve the historical video information according to the date information and the time information; if only the date information is included, retrieve the historical video information according to the date information and the current time; if both the date information and the climate information are included, select the one with a higher priority and the current time according to the priority of the date information and the climate information to retrieve the historical video information; if both the date information, the climate information and the time information are included, select the one with a higher priority and the time information according to the priority of the date information and the climate information to retrieve the historical video information; if both the climate information and the time information are included, retrieve the historical video information according to the climate information and the time information.

[0047] Optionally, after the virtual person reaches the target movable area, collecting intelligence data from the target movable area to generate a mission report includes:

[0048] Obtaining data collection requirements based on the behavior name group;

[0049] According to the data collection requirements, one or more of the information on the number of active personnel in the target active area, information on interactive items, and appointment arrangement information is collected, wherein the obtained one or more of the information on the number of active personnel, information on interactive items, and appointment arrangement information constitutes the task report.

[0050] Optionally, collecting one or more of the information on the number of active personnel in the target active area, information on interactive items, and appointment arrangement information according to the data collection requirements includes:

[0051] Control the virtual person to reach the data collection location and the direction of the virtual person's viewing angle according to the data collection requirements;

[0052] Obtaining the starting point of the viewing angle and the preset visual range of the virtual person according to the viewing direction of the virtual person;

[0053] Obtain information about virtual objects within a visible range in a virtual reality space;

[0054] The intelligence information of the current time point corresponding to the virtual object is obtained according to the information of the virtual object.

[0055] The present application also provides a virtual reality space interaction system for a nursing home, and the virtual reality space interaction system for a nursing home includes:

[0056] Control terminals, the number of which is multiple, the address and location information of each control terminal are known, each control terminal is provided with a human-computer interaction system and a photographing system, the human-computer interaction system is used for human-computer interaction with a user, and the photographing system is used for photographing images according to instructions;

[0057] A system server, wherein a virtual reality space is provided on the system server;

[0058] A camera device, wherein the number of the camera devices is multiple and distributed in various locations of the nursing home; wherein,

[0059] The control terminal, system server and camera device cooperate to implement the virtual reality space interaction method for nursing homes as described above.

[0060] The virtual reality space interaction method for nursing homes in this application has the following advantages:

[0061] (1) Considering that most of the users of nursing homes are elderly people, and the elderly are usually unlikely to control virtual people, therefore, this application only needs to obtain the user's demand information, and the system automatically controls the virtual person to complete the user's needs.

[0062] (2) The method of the present application enables the elderly to understand the specific conditions of each facility in the nursing home without leaving their homes, thereby preventing the elderly from going out without knowing the operating status of each facility, which results in wasting physical energy and time without being able to achieve the desired state. For example, if the restaurant is crowded or the restaurant's menu today does not have the elderly's favorite food, the method of the present application can directly obtain the number of people in the restaurant and the menu through a virtual person visiting the restaurant, so that the elderly can consider whether to go to the restaurant by themselves, without having to walk to the restaurant or call the restaurant to find out the situation. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] Figure 1 It is a flowchart of a virtual reality space interaction method for a nursing home in one embodiment of the present application. DETAILED DESCRIPTION

[0064] The technical solution of the present invention will be described clearly and completely below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0065] like Figure 1 The virtual reality space interaction methods for nursing homes shown include:

[0066] Get user avatar information;

[0067] Determine whether the user's identity information can be obtained based on the user's profile picture information. If so,

[0068] Obtaining the user's identity information and obtaining the user's location information using a device for obtaining the user's head portrait information;

[0069] Obtain user demand information;

[0070] Analyze the user demand information, and determine whether it is necessary to establish a user virtual person according to the user demand information. If so,

[0071] Creating a user virtual person in the virtual reality space at the location of the user;

[0072] Acquiring task information according to the user demand information;

[0073] Controlling the user virtual person to complete the task information in the virtual reality space and generate a task report; wherein the virtual reality space includes twin spaces of various facilities in the nursing home;

[0074] Human-computer interaction is performed with the user according to the task report, thereby obtaining a new round of task information until the interaction ends.

[0075] The virtual reality space interaction method for nursing homes in this application has the following advantages:

[0076] (1) Considering that most of the users of nursing homes are elderly people, and the elderly are usually unlikely to control virtual people, therefore, this application only needs to obtain the user's demand information, and the system automatically controls the virtual person to complete the user's needs.

[0077] (2) The method of the present application enables the elderly to understand the specific conditions of each facility in the nursing home without leaving their homes, thereby preventing the elderly from going out without knowing the operating status of each facility, which results in wasting physical energy and time without being able to achieve the desired state. For example, if the restaurant is crowded or the restaurant's menu today does not have the elderly's favorite food, the method of the present application can directly obtain the number of people in the restaurant and the menu through a virtual person visiting the restaurant, so that the elderly can consider whether to go to the restaurant by themselves, without having to walk to the restaurant or call the restaurant to find out the situation.

[0078] In this embodiment, the user's head portrait information can be obtained by using a camera device provided on the control terminal. In this embodiment, the control terminal is a human-computer interaction device.

[0079] In this embodiment, judging whether the user identity information can be obtained according to the user's head portrait information includes:

[0080] Acquire a preset face database, wherein the preset face database includes at least one preset face image and user identity information corresponding to each preset face image;

[0081] The similarity between the user portrait information and each preset face image is calculated respectively. If the similarity between a preset face image and the user portrait information exceeds a preset threshold, it is judged as yes.

[0082] When the judgment is yes, the user identity information corresponding to the preset face image whose similarity exceeds the preset threshold is obtained.

[0083] In this embodiment, each camera device on the control terminal has its own ID number and preset location information. Therefore, the user's location information can be obtained by obtaining the preset location information of the camera device.

[0084] It is understandable that, since it is a nursing home, each elderly person's room will be equipped with a control terminal for the elderly to use.

[0085] In this embodiment, the user demand information can be provided in the form of voice or text. For example, a user can say in voice: I plan to go to the cafeteria to eat at 12 o'clock.

[0086] In one embodiment, parsing the user demand information and determining whether to establish a user virtual person according to the user demand information includes:

[0087] When the user provides the user demand information by voice, the voice is converted into text by voice recognition;

[0088] A communication preference database is obtained, wherein the communication preference database includes at least one preset identity and a personal text database corresponding to each preset identity; in this embodiment, each personal text database stores a large amount of keyword information, including various place name information in the nursing home (for example, canteen, cinema, it can be understood that since canteen, etc. may have other alternative nouns in real life, for example, the canteen of the nursing home is just a popular noun, and the actual noun may be Changchun Garden, etc., in this case, all these nouns that can refer to the canteen are also included in the place name information), and colloquial names commonly used by the user may also be provided (for example, the canteen next to the cinema, in this case , it may refer specifically to a specific canteen, then the canteen near the cinema will be associated with the specific canteen, and when the text information appears about the canteen near the cinema, the canteen associated with it will be automatically identified), and also includes the noun information that can reflect the purpose in the nursing home (for example, eating, exercising, fitness, swimming, etc.), and also includes the colloquial noun information that can reflect the purpose commonly used by users (for example, the user likes to play cards, just say playing cards, and the sports area corresponding to playing cards may be a rehabilitation center for the elderly. At this time, playing cards is associated with the rehabilitation center for the elderly. Once the user appears with the noun playing cards, it is automatically identified as a rehabilitation center for the elderly).

[0089] Obtaining a personal text database corresponding to a preset identity that is identical to the user identity information;

[0090] Segment the user demand information (i.e. text information) into words to obtain each phrase;

[0091] Comparing each phrase with each keyword information in the personal text database for similarity, thereby obtaining keyword information with a similarity exceeding a preset threshold, and obtaining each keyword information with a similarity exceeding the preset threshold;

[0092] When the obtained keyword information whose similarities exceed the preset threshold includes various place name information in the nursing home, it is judged that it is necessary to establish a virtual person for the user. It can be understood that the present application does not require the elderly to go out at this time. Therefore, even if the corresponding action information is not obtained, a virtual person can actually be established, because in this case it will not cause unnecessary burden to the elderly. For example, the user's text information is canteen. Assuming there are only two words, at this time, although there is no action information about what to do, a virtual person can be established, because maybe the elderly just want to go to the canteen for a stroll through the virtual person. Therefore, in this case, a virtual person is also established for the user. It can be understood that establishing a user virtual person in the virtual space is a prior art and will not be repeated here. For example, virtual person login in the metaverse, login of virtual characters in games, etc.

[0093] It is understandable that if the number of place name information obtained is multiple, the elderly can be allowed to select one as keyword information through human-computer interaction (as described above, for example, the cafeteria next to the cinema actually has two place name information, but when the actual word segmentation is performed, the existing technology can identify the cinema part as the attributive of the cafeteria through word segmentation recognition, that is, it will not be divided into two words, and the overall word has a corresponding noun associated with it. Therefore, this description is actually still a place name information after recognition, that is, the cafeteria associated with it).

[0094] In one embodiment, obtaining task information according to the user demand information includes:

[0095] Acquire a movable destination library, wherein the movable destination library includes a plurality of destination names and location information corresponding to each destination name;

[0096] Acquire a destination name identical to the keyword information from the movable destination library according to the acquired keyword information;

[0097] It is determined whether the acquired keyword information contains action information. If so, the destination name and the action information are combined to form task information.

[0098] It is determined whether the acquired keyword information contains action information. If not, the destination name is used alone as task information.

[0099] The advantage of adopting this method is that creating a virtual person requires a certain amount of computing power and network. If a virtual person is created without being sure whether there are clear instructions, it will waste computing power and network.

[0100] In this embodiment, the present application analyzes the user demand information and determines whether it is necessary to establish a user virtual person based on the user demand information. As long as it is determined that text information can be obtained through voice information or it is determined that text information is obtained, it is determined that a virtual person needs to be established. That is to say, in this embodiment, after obtaining the user demand information, a virtual person is directly established and then the specific task is analyzed.

[0101] In this embodiment, acquiring task information according to the user demand information includes:

[0102] A user expression habit database is obtained according to the user identity information, and the expression habit database includes a position sub-library and a behavior sub-library, wherein the position sub-library includes at least one nursing home active area name group; the behavior sub-library includes at least one behavior name group, and one behavior name group is associated with at least one nursing home active area name group; in this embodiment, one nursing home active area name group corresponds to an active area in the nursing home. For example, the nursing home has a cinema A and a cinema B, then cinema A has a corresponding active area name group A, and cinema B has an active area name group B. Regardless of the active area name group A or the active area name group B, multiple active area names are included therein. The reason for having multiple active area names is that different users may have different descriptions of the active area. For example, the name set for cinema A in the nursing home itself is the first active cinema, but some elderly people may habitually call it the old cinema when using the name. At this time, in order to be able to identify the description of the elderly, multiple possible descriptions are placed in one active area name group.

[0103] In this embodiment, there are multiple user expression habit databases, and one user expression habit database corresponds to one user identity information. Therefore, the corresponding user expression habit database can be obtained according to the user identity information.

[0104] According to the user demand information, the activity area name group of the nursing home required by the user is obtained from the position sub-library, and the behavior name group required by the user is obtained from the behavior sub-library; specifically, the activity area name group and the behavior name group required can also be determined by obtaining the activity area name that is the same as the keyword in the user demand information through word segmentation, semantic recognition and similarity;

[0105] Determine whether the obtained nursing home active area name group and behavior name group are related. If so, use the obtained nursing home active area name group and behavior name group as task information.

[0106] In this embodiment, both the activity area name and the behavior name are required to proceed to the next step. If not, questions can be asked to the user through intelligent interaction to obtain the missing information. The advantage of this method is that it can remind the user through voice inquiries in case the user forgets to describe the missing part.

[0107] In this embodiment, controlling the user virtual person to complete the task information in the virtual reality space and generating a task report includes:

[0108] At least two virtual human movement paths are generated from the current location of the virtual human to the target movable area corresponding to the movable area name group according to the current location of the virtual human and the movable area name group; it can be understood that any two locations in a general nursing home (such as location H and location O) cannot have only one passable road. Therefore, in order to allow users to make their own choices, at least two virtual human movement paths are set for users to choose from.

[0109] The names of the movable areas passed by in each virtual human motion path are obtained; when the user is selecting a path, he may consider the distance and speed on the one hand, and the scenery or facilities passed by on the other hand. Therefore, the names of the movable areas passed by in each virtual human motion path are obtained, so that when the user is provided with a choice, the user can consider selecting a path according to the places passed by.

[0110] Sending the names of the movable areas passed by each virtual human motion path to the user;

[0111] Acquire the selection information fed back by the user; it is understandable that in order to reduce the user's operations, the feedback selection information can be obtained by voice or direct screen selection.

[0112] Selecting one of the virtual human movement paths according to the selection information fed back by the user, thereby controlling the virtual human to move according to the selected virtual human movement path until reaching the target movable area;

[0113] After the virtual person reaches the target movable area, intelligence data is collected from the target movable area to generate a mission report.

[0114] In this embodiment, the virtual reality space of the present application can be constructed based on digital twin technology or metaverse technology. In the three-dimensional scene constructed based on digital twin technology or metaverse technology, various equipment and facilities that are consistent with reality exist in the corresponding positions. It is understandable that in order to save computing power, it is not necessary to model all equipment and facilities. For example, only ticket gates need to be established in the theater, because going to the theater is mainly to understand the current theater's movie schedule, the next movie content, and the number of scheduled people, etc., and there is no need to fully establish the detailed models inside. It is understandable that if there is no lack of computing power, a 1:1 restoration can also be performed.

[0115] In this embodiment, when one of the virtual human motion paths is selected according to the selection information fed back by the user, the virtual human is controlled to move according to the selected virtual human motion path until it reaches the movable area name group, the virtual reality space interaction method for the nursing home further includes:

[0116] Acquire a user virtual reality space preference database, wherein the user virtual reality space preference database is provided with at least one preset user preference sub-library and preset user identity information corresponding to each preset user preference sub-library;

[0117] Acquire a preset user preference sub-library corresponding to the preset user identity information that is the same as the user identity information;

[0118] Determine whether there is a preset scenery style preference setting in the preset user preference sub-library, and if so,

[0119] In the process of controlling the virtual human to move according to the selected virtual human movement path until reaching the movable area name group, the scenery along the way is displayed to the user according to the scenery style preference setting along the way.

[0120] In this embodiment, since the application adopts the method of virtual human movement to reach the destination, the basic form is the same as the method of the character in the game reaching the destination by walking. Both need to walk through a predetermined route. At this time, the user can observe the scenery along the way through the scenery style preference setting. The reason for adopting this method is mainly to allow the user to enjoy the scenery along the way. It is understandable that if the user does not need it, the virtual person can also be transmitted to each virtual transmission point in the virtual reality space of this application through coordinate point transmission, and travel to the destination through the transmission point, and the transmission point is usually closer to the destination.

[0121] In this embodiment, the scenery style preference setting along the way includes a real scenery style, an imaginary scenery style, and a real scenery historical style; wherein, when the scenery style preference setting along the way is set to the real scenery style, in the process of controlling the virtual person to move according to the selected virtual person movement path until reaching the movable area name group, displaying the scenery along the way for the user according to the scenery style preference setting along the way includes:

[0122] Obtaining a nursing home camera device range database, wherein the nursing home camera device range database includes the ID of each camera device of the nursing home and the shooting range information of each camera device;

[0123] According to the current coordinate position of the virtual person, video information of a camera device capable of photographing the current coordinate position is retrieved in real time and transmitted to a control terminal for interacting with the user.

[0124] In this way, the current video images of different areas are provided to users in different areas. For example, there is an outdoor stadium in the nursing home. Then, the video stream information of the outdoor stadium at the current time can be obtained through the camera device and transmitted to the control terminal used by the user, so that the user can see the current situation of the outdoor stadium. The reason for this is that on the one hand, some elderly people who do not want to go out can watch the external scenery, and on the other hand, the elderly can also observe the flow of people in different areas and whether there are acquaintances, which can provide some motivation for the elderly and encourage them to go out for exercise. In addition, the elderly can also see the weather conditions outside through the video. For example, even if it is raining or snowing at the time, the size of the snow in different locations can be obtained through the video, so that the user can further reasonably arrange his next travel plan.

[0125] In this embodiment, when the scenery style preference along the way is set to the real scenery historical style, in the process of controlling the virtual person to move according to the selected virtual person movement path until reaching the movable area name group, displaying the scenery along the way to the user according to the scenery style preference along the way includes:

[0126] Determine whether there are historical conditions in the scenery style preference settings along the way. If so, then

[0127] Determine whether historical video information can be retrieved based on historical conditions. If so,

[0128] Retrieve historical video information based on historical conditions.

[0129] In some cases, the user may want to see scenery of a season different from the current season. For example, it is currently winter, and the user wants to see scenes of spring or summer. In this case, the scenes of this year's spring or summer can be retrieved for the elderly to watch. It is understandable that historical videos of more specific time points can also be retrieved according to the needs of the elderly. For example, if the elderly miss the scene of taking a walk with someone in a nursing home on a certain day, historical videos of these places on that day can be retrieved.

[0130] In this embodiment, the historical condition may be previously entered by the user. If there is no historical condition and the real scenery historical style is selected, the application further includes:

[0131] Get the time point required by the user through human-computer interaction.

[0132] In this embodiment, the historical conditions include date information, climate information, and time information;

[0133] The retrieving historical video information according to historical conditions includes:

[0134] Determine whether the historical conditions include date information, climate information and time information, and have a priority between the date information and the climate information. If the historical conditions include date information and time information, retrieve the historical video information according to the date information and the time information; if only the date information is included, retrieve the historical video information according to the date information and the current time; if both the date information and the climate information are included, select the one with a higher priority and the current time according to the priority of the date information and the climate information to retrieve the historical video information; if both the date information, the climate information and the time information are included, select the one with a higher priority and the time information according to the priority of the date information and the climate information to retrieve the historical video information; if both the climate information and the time information are included, retrieve the historical video information according to the climate information and the time information.

[0135] In this embodiment, the priority level can be set according to the user's own needs.

[0136] As described above, if the user only needs to see the conditions of different seasons, the climate information can be directly given, such as descriptive words such as spring, winter, snow, etc. At this time, the corresponding video can be directly retrieved from the historical video information.

[0137] In this embodiment, the historical video information includes multiple videos of different nursing home locations, and each video is set with a corresponding label. The corresponding keywords can be obtained through label search. For example, the labels may include snowy days, rainy days, spring, etc. In this way, if there are corresponding descriptive words in the historical conditions, the corresponding video can be retrieved. It can be understood that if there are descriptions such as snowy days and rainy days, there may be multiple videos that meet the conditions. At this time, when there are no other historical conditions, a video can be randomly selected.

[0138] The historical conditions also include specific character conditions;

[0139] When the historical conditions include specific character conditions, the virtual reality space interaction method for a nursing home of the present application further includes:

[0140] Acquire a social relationship database, wherein the social relationship database includes a plurality of social relationship sub-databases, wherein one social relationship sub-database corresponds to one user identity information, and each social relationship sub-database includes one user information and basic information of other persons having intersection with the user information, and each basic information of other persons includes at least identity information, identity number information, and disclosure level;

[0141] Obtaining the communication relationship sub-library corresponding to the user identity information of the current user;

[0142] Based on the basic information of other people in the acquired social relationship sub-database, determine whether there is a person whose basic information meets the specific person conditions. If so,

[0143] Get the reveal level that matches the conditions of a specific character;

[0144] According to the disclosure level that meets the condition of the specific character, an active area that can display the specific character in the process of controlling the virtual character to move according to the selected virtual character movement path until reaching the active area is obtained;

[0145] When the virtual person moves to an active area where a specific person can be displayed, historical video information is retrieved according to the specific person.

[0146] In this embodiment, the specific character condition can be a name, a relationship or a specific title. For example, the specific character condition of user A can be: the specific name of user B, husband and wife (relationship), wife (specific title), younger brother (relationship), older brother (relationship), etc.

[0147] In this embodiment, the basic information of other people may include the name of the person, the relationship with the user information that intersects with the basic information, and a preset specific title, etc. For example, in the social relationship sub-library of Zhang San, the user information is Zhang San, and there are two groups of basic information of other people that intersect with the user information, one group is Li Si's basic information, and the other group is Wang Wu's basic information. Li Si's basic information includes identity information, for example, it may include Li Si's name, the relationship between Li Si and Zhang San (for example, husband and wife), and the titles that Li Si and Zhang San usually use to address each other (for example, wife, dear), etc.

[0148] In this embodiment, the identity number information is used to find historical video information. Specifically, since the same name or title is likely to appear in a nursing home, each person is assigned an identity number information (similar to a student ID number, etc.). In each historical video information, the person appearing in the historical video information is obtained through manual labeling or image recognition, and the identity number information corresponding to the person is set as a label in the historical video information (it can be understood that if the identified person does not have identity number information in the nursing home, for example, a person who has not registered or is outside the nursing home and has not actively requested to obtain the identity number information, no label will be set).

[0149] In this embodiment, the disclosure level refers to the location of the video that can be obtained. For example, if it is an outdoor activity scene, the required disclosure level may be relatively low, because in most cases, outdoor activity scenes will not reveal too much other information. If it is a room or a swimming pool, a higher disclosure level may be required. The reason for setting such a level is to prevent users from abusing the right to obtain historical video information.

[0150] The reason why this application sets the condition of specific people is that most elderly people are relatively old when they enter nursing homes, and in many cases they live in with relatives and friends. As time goes by, many elderly people may not be able to walk for a long time or even walk on their own due to physical reasons, and many relatives and friends of the elderly may also leave the nursing home one after another. However, memories are precious. Sometimes, if users can see some of the previous scenes through this method of this application, it can bring psychological comfort to users.

[0151] In this embodiment, obtaining the movable area of ​​the specific character in the process of controlling the virtual character to move according to the selected virtual character movement path until reaching the movable area according to the disclosure level that meets the specific character condition includes:

[0152] Get the level range of each active area setting;

[0153] Determine whether the disclosure level that meets the conditions of a specific character is within the level range set in the movable area. If so,

[0154] The movable area is determined to be a movable area capable of displaying a specific person.

[0155] In this embodiment, when there is a specific person condition, the specific person condition is given the highest priority, that is, if there is date information, climate information and time information after the specific person condition, it must be ensured that the specific person condition must be met at the same time.

[0156] In this embodiment, when the virtual person moves to an active area where a specific person can be displayed, retrieving historical video information according to the specific person includes:

[0157] Obtain historical video information with specific character conditions through tags in each historical video information;

[0158] The historical video information with specific character conditions is further screened according to one or more of date information, climate information and time information, so as to select the historical video information to be played.

[0159] It is understandable that if it is impossible to filter out historical video information that meets the specific character condition and can satisfy other information (one or more of date information, climate information and time information), a historical video information that meets the specific character condition is randomly selected.

[0160] It can be understood that in the process of further screening historical video information with specific character conditions based on one or more of date information, climate information and time information, the screening method can be the same as the above-mentioned screening method when there is only one or more of date information, climate information and time information.

[0161] In this embodiment, after the virtual person reaches the target movable area, collecting intelligence data from the target movable area to generate a mission report includes:

[0162] The data collection requirements are obtained according to the behavior name group; for example, the behavior names in the behavior name group may include eating, watching a movie, looking at a menu, looking at the number of people swimming, and the like.

[0163] In this embodiment, obtaining data collection requirements according to the behavior name group includes:

[0164] Acquire a data collection database, wherein the data collection database includes at least one preset behavior name and a data collection requirement corresponding to each preset behavior name;

[0165] Obtain the data collection requirements corresponding to the preset behavior name that is the same as the behavior name. It can be understood that when there are multiple behavior names, there can be multiple data collection requirements, for example, one data collection requirement is the number of people, and another data collection requirement is menu information.

[0166] Target information is collected according to data collection requirements, and one or more target information constitutes the mission report.

[0167] It is understandable that if there is no behavior name group in an embodiment, all collectible information of the target movable area can be collected. For example, the behaviors that may exist in a cafeteria include the number of people eating and recipe information, so both are collected.

[0168] In this embodiment, the task may be delivered to the user in the form of text or voice.

[0169] In this embodiment, collecting target information according to data collection requirements includes:

[0170] Control the virtual person to reach the data collection location and the direction of the virtual person's viewing angle according to the data collection requirements;

[0171] Obtaining the starting point of the viewing angle and the preset visual range of the virtual person according to the viewing direction of the virtual person;

[0172] Obtain information about virtual objects within a visible range in a virtual reality space;

[0173] The intelligence information of the current time point corresponding to the virtual object is obtained according to the information of the virtual object.

[0174] For example, in this embodiment, several virtual devices are generated for each movable area. For example, the restaurant will generate a virtual portrait of the waiter and a display cabinet device. The reason for setting up such virtual objects is to enable different virtual objects to provide different intelligence information. For example, when the user's virtual person approaches the virtual portrait of the waiter, it means that the user needs to obtain data on the number of diners, and when the user's virtual person approaches the display cabinet device, it means that menu information is needed. This can avoid the problem that the user only needs one of the information but cannot provide it as needed.

[0175] In order to enable each virtual object to provide corresponding intelligence information, this application can be implemented through the following methods:

[0176] Obtain a real-time database of an active area. There are multiple real-time databases of the active area. One active area corresponds to one real-time database of the active area. The data in each real-time database of the active area includes both real-time data and preset storage data. For example, taking a restaurant as an example, it is assumed that the intelligence information that can be provided in the restaurant includes menus and number of people data; among them, for restaurants that can order food, in most cases the menu will not change for a month or several months, so it can be stored as preset storage data, or for restaurants that provide buffet services, the menu of the day is generally fixed, which can also be stored as preset storage data. In contrast, the number of diners in the restaurant changes in real time. At this time, the video stream of the restaurant can be obtained through the restaurant's camera device, and the number of people in the video stream can be obtained as the number of diners through image recognition. At this time, the number of diners is updated every certain period of time, and the number of diners can be dynamically transmitted to the real-time database of the active area as real-time data.

[0177] In this embodiment, the data in the real-time database of the movable area can be associated with the corresponding virtual objects, for example, the number of diners can be associated with the virtual portrait of the service staff.

[0178] When the position information of the user's virtual person enters the preset range of the waiter's virtual portrait and it is determined through the pre-set visible range of the virtual person that the waiter's virtual portrait is within the visible range of the virtual person, the corresponding and latest data (i.e. the latest number of diners data) of the virtual person of the waiter can be retrieved from the real-time database of the movable area.

[0179] In this embodiment, after the task is reported to the user, the user may issue a new command, and the method of this application can be repeated. For example, when the user obtains the number of diners and the menu of restaurant A, but feels that he does not want to eat, he may also provide the information of restaurant B, so that the virtual person can go to restaurant B to obtain the information.

[0180] The method of the present application can be used as a channel for users to obtain information, and can also be used as a form of entertainment when users have nothing to do. For example, if a user wants to reminisce about the scene of walking with someone on the road to a nursing home, the method of the present application can also be used to retrieve the corresponding historical video information.

[0181] The present application also provides a virtual reality space interaction system for a nursing home, the virtual reality space interaction system for a nursing home comprising a control terminal, a system server and a camera device, wherein:

[0182] There are multiple control terminals, the address and location information of each control terminal are known, and each control terminal is provided with a human-computer interaction system and a photographing system, wherein the human-computer interaction system is used for human-computer interaction with a user, and the photographing system is used for photographing images according to instructions;

[0183] A virtual reality space is set up on the system server;

[0184] There are multiple camera devices, which are distributed in various locations in the nursing home;

[0185] The control terminal, the system server and the camera device cooperate to implement the virtual reality space interaction method for the nursing home as described above.

[0186] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A virtual reality space interaction method for a nursing home, characterized in that: The virtual reality space interaction method for a nursing home comprises: Get user avatar information; Determine whether the user's identity information can be obtained based on the user's profile picture information. If so, Obtaining the user's identity information and obtaining the user's location information using a device for obtaining the user's head portrait information; Obtain user demand information; Analyze the user demand information, and determine whether it is necessary to establish a user virtual person according to the user demand information. If so, Creating a user virtual person in the virtual reality space at the location of the user; Acquiring task information according to the user demand information; Controlling the user virtual person to complete the task information in the virtual reality space and generate a task report; wherein the virtual reality space includes twin spaces of various facilities in the nursing home; Human-computer interaction is performed with the user according to the task report, thereby obtaining a new round of task information until the interaction ends.

2. The virtual reality space interaction method for a nursing home as claimed in claim 1, characterized in that: The acquiring of task information according to the user demand information comprises: Acquire a user expression habit database according to the user identity information, wherein the expression habit database includes a location sub-library and a behavior sub-library, wherein the location sub-library includes at least one nursing home active area name group; the behavior sub-library includes at least one behavior name group, and one behavior name group is associated with at least one nursing home active area name group; According to the user demand information, obtaining a group of activity area names of the nursing home required by the user from the position sub-library and a group of behavior names required by the user from the behavior sub-library; Determine whether the obtained nursing home active area name group and behavior name group are related. If so, use the obtained nursing home active area name group and behavior name group as task information.

3. The virtual reality space interaction method for a nursing home as claimed in claim 2, characterized in that: The controlling the user virtual person to complete the task information in the virtual reality space and generate a task report comprises: Generate at least two virtual human motion paths from the current location of the virtual human to the target movable area corresponding to the movable area name group according to the current location of the virtual human and the movable area name group; Obtain the name of the movable area passed by in the middle of each virtual human motion path; Sending the names of the movable areas passed by each virtual human motion path to the user; Obtaining selection information fed back by users; Selecting one of the virtual human movement paths according to the selection information fed back by the user, thereby controlling the virtual human to move according to the selected virtual human movement path until reaching the target movable area; After the virtual person reaches the target movable area, intelligence data is collected from the target movable area to generate a mission report.

4. The virtual reality space interaction method for a nursing home as claimed in claim 3, characterized in that: When one of the virtual human motion paths is selected according to the selection information fed back by the user, thereby controlling the virtual human to move according to the selected virtual human motion path until reaching the movable area name group, the virtual reality space interaction method for the nursing home further includes: Acquire a user virtual reality space preference database, wherein the user virtual reality space preference database is provided with at least one preset user preference sub-library and preset user identity information corresponding to each preset user preference sub-library; Acquire a preset user preference sub-library corresponding to the preset user identity information that is the same as the user identity information; Determine whether there is a preset scenery style preference setting in the preset user preference sub-library, and if so, In the process of controlling the virtual human to move according to the selected virtual human movement path until reaching the movable area, the scenery along the way is displayed to the user according to the scenery style preference setting along the way.

5. The virtual reality space interaction method for a nursing home as claimed in claim 4, characterized in that: The scenery style preference setting along the way includes a real scenery style, an imaginary scenery style and a real scenery historical style; wherein, when the scenery style preference setting along the way is set to the real scenery style, in the process of controlling the virtual person to move according to the selected virtual person movement path until reaching the movable area name group, displaying the scenery along the way for the user according to the scenery style preference setting along the way includes: Obtaining a nursing home camera device range database, wherein the nursing home camera device range database includes the ID of each camera device of the nursing home and the shooting range information of each camera device; According to the current coordinate position of the virtual person, video information of a camera device capable of photographing the current coordinate position is retrieved in real time and transmitted to a control terminal for interacting with the user.

6. The virtual reality space interaction method for a nursing home as claimed in claim 5, characterized in that: When the scenery style preference setting along the way is set to the real scenery historical style, in the process of controlling the virtual person to move according to the selected virtual person movement path until reaching the movable area name group, displaying the scenery along the way to the user according to the scenery style preference setting along the way includes: Determine whether there are historical conditions in the scenery style preference settings along the way. If so, then Determine whether historical video information can be retrieved based on historical conditions. If so, Retrieve historical video information based on historical conditions.

7. The virtual reality space interaction method for a nursing home as claimed in claim 6, characterized in that: The historical conditions include date information, climate information and time information; The retrieving historical video information according to historical conditions includes: Determine whether the historical conditions include date information, climate information and time information, and have a priority between the date information and the climate information. If the historical conditions include date information and time information, retrieve the historical video information according to the date information and the time information; if only the date information is included, retrieve the historical video information according to the date information and the current time; if both the date information and the climate information are included, select the one with a higher priority and the current time according to the priority of the date information and the climate information to retrieve the historical video information; if both the date information, the climate information and the time information are included, select the one with a higher priority and the time information according to the priority of the date information and the climate information to retrieve the historical video information; if both the climate information and the time information are included, retrieve the historical video information according to the climate information and the time information.

8. The virtual reality space interaction method for a nursing home as claimed in claim 7, characterized in that: After the virtual person reaches the target movable area, collecting intelligence data from the target movable area to generate a mission report includes: Obtaining data collection requirements based on the behavior name group; Target information is collected according to data collection requirements, and one or more target information constitutes the mission report.

9. The virtual reality space interaction method for a nursing home as claimed in claim 8, characterized in that: The target information collected according to the data collection requirements includes: Control the virtual person to reach the data collection location and the direction of the virtual person's viewing angle according to the data collection requirements; Obtaining the starting point of the viewing angle and the preset visual range of the virtual person according to the viewing direction of the virtual person; Obtain information about virtual objects within a visible range in a virtual reality space; The intelligence information of the current time point corresponding to the virtual object is obtained according to the information of the virtual object.

10. A virtual reality space interactive system for nursing homes, characterized in that: The virtual reality space interaction system for nursing homes includes: Control terminals, the number of which is multiple, the address and location information of each control terminal are known, each control terminal is provided with a human-computer interaction system and a photographing system, the human-computer interaction system is used for human-computer interaction with a user, and the photographing system is used for photographing images according to instructions; A system server, wherein a virtual reality space is provided on the system server; A camera device, wherein the number of the camera devices is multiple and distributed in various locations of the nursing home; wherein, The control terminal, system server and camera device cooperate to implement the virtual reality space interaction method for a nursing home as described in any one of claims 1 to 9.

Images