A virtual reality space interaction method and system for nursing homes

Abstract

This application discloses a method and system for interacting with a virtual reality space in a nursing home. The method includes: determining whether the user's identity information can be obtained based on the user's portrait information; if so, obtaining the user's identity information and the user's location information; obtaining the user's demand information; determining whether a user virtual person needs to be established based on the user's demand information; if so, establishing the user virtual person; obtaining task information based on the user's demand information; controlling the user virtual person to complete the task information in the virtual reality space and generate a task report; and interacting with the user based on the task report to obtain a new round of task information until the interaction ends. This application only requires obtaining the user's demand information, and the system automatically controls the virtual person to complete the user's demand items.

Description

Technical Field

[0001] The present application relates to the field of virtual reality technology, and in particular to a virtual reality space interaction method and a virtual reality space interaction system for a nursing home. Background Art

[0002] Existing large-scale nursing homes occupy a huge area. For example, a nursing home covers an area of ​​about 140,000 square meters and can provide about 3,000 nursing units. Assuming that there are two elderly people in one household, there are about 6,000 people. The nursing home is equipped with various facilities such as gyms, cinemas, multiple restaurants, massage, community hospitals, etc. for the elderly in the nursing home to use. The large area provides the elderly in the nursing home with enough space and facilities for activities. However, it also causes the elderly to need more exercise when exercising in the nursing home. For example, ordinary people may need to walk for 10 minutes from their residence to the restaurant, while the elderly (especially those with underlying diseases) may need to walk for 20 minutes or more from their residence to the hotel for the same distance. However, if they go to the site and find that there are no seats or other situations, it will not only disappoint the elderly, but also cause physical burden on them.

[0003] In the prior art, it is possible to inquire whether there are vacancies in various facilities by calling. However, the shortcomings of this method are:

[0004] (1) The facility owner needs to arrange for a dedicated person to provide telephone service, which wastes manpower;

[0005] (2) The number of consultation calls that can be arranged by general facilities is limited. When there are many people consulting, the phone may be busy for a long time;

[0006] (3) Elderly people may be hard of hearing or have speech problems, which may lead to poor communication. This not only fails to solve the problem, but also prolongs the telephone communication time and delays the access of other calls.

[0007] (4) Even if the call is connected and the service provider is able to communicate, the service provider may not understand the specific situation or be unable to express it in detail. For example, if the elderly person inquires about the number of people swimming in the gym's pool, the service provider may only be able to say a general statement such as "a lot" or "a little." Similarly, if the elderly person inquires about the cafeteria menu, the service provider may not be able to tell the elderly person each dish one by one.

[0008] Therefore, it is hoped that there will be a technical solution to solve or at least alleviate the above-mentioned deficiencies in the prior art. Summary of the Invention

[0009] The purpose of the present invention is to provide a virtual reality space interaction method for nursing homes to solve at least one of the above technical problems.

[0010] The present invention provides the following solutions:

[0011] According to one aspect of the present invention, a method for interacting with a virtual reality space in a nursing home is provided, the method comprising:

[0012] Get user avatar information;

[0013] Determine whether the user's identity information can be obtained based on the user's profile picture information. If so,

[0014] Obtaining user identity information and obtaining user location information using a device for obtaining user portrait information;

[0015] Obtain user demand information;

[0016] Analyze the user demand information and determine whether it is necessary to create a user virtual person based on the user demand information. If so,

[0017] Creating a user avatar in the virtual reality space at the user's location;

[0018] Acquiring task information according to the user demand information;

[0019] Controlling the user virtual person to complete the task information in the virtual reality space and generate a task report; wherein the virtual reality space includes twin spaces of various facilities in the nursing home;

[0020] Perform human-computer interaction with the user according to the task report, thereby obtaining a new round of task information until the interaction ends.

[0021] Optionally, acquiring task information according to the user demand information includes:

[0022] Obtaining a user expression habit database based on the user identity information, the expression habit database including a location sub-library and a behavior sub-library, wherein the location sub-library includes at least one group of names of available nursing home activity areas; the behavior sub-library includes at least one group of behavior names, and each behavior name group is associated with at least one group of names of available nursing home activity areas;

[0023] According to the user demand information, a group of names of activity areas in the nursing home required by the user is obtained from the location sub-library, and a group of names of behavior required by the user is obtained from the behavior sub-library;

[0024] Determine whether the obtained nursing home active area name group and behavior name group are related. If so, use the obtained nursing home active area name group and behavior name group as task information.

[0025] Optionally, controlling the user virtual person to complete the task information in the virtual reality space and generate a task report includes:

[0026] generating at least two virtual human movement paths from the current location of the virtual human to the target movable area corresponding to the movable area name group according to the current location of the virtual human and the movable area name group;

[0027] Obtain the name of the movable area passed through in the middle of each virtual human movement path;

[0028] Sending the names of the movable areas passed by each virtual human movement path to the user;

[0029] Obtaining selection information fed back by users;

[0030] Selecting one of the virtual human movement paths according to the selection information fed back by the user, thereby controlling the virtual human to move along the selected virtual human movement path until reaching the target movable area;

[0031] After the virtual person reaches the target movable area, intelligence data is collected from the target movable area to generate a mission report.

[0032] Optionally, when one of the virtual human movement paths is selected according to the selection information fed back by the user, thereby controlling the virtual human to move according to the selected virtual human movement path until it reaches the group of movable area names, the virtual reality space interaction method for a nursing home further includes:

[0033] Obtaining a user virtual reality space preference database, wherein the user virtual reality space preference database is provided with at least one preset user preference sub-library and preset user identity information corresponding to each preset user preference sub-library;

[0034] Obtaining a preset user preference sub-library corresponding to the preset user identity information that is the same as the user identity information;

[0035] Determine whether there is a preset scenery style preference setting in the preset user preference sub-library. If so,

[0036] In the process of controlling the virtual human to move according to the selected virtual human movement path until reaching the movable area name group, the scenery along the way is displayed to the user according to the scenery style preference setting along the way.

[0037] Optionally, the scenery style preference setting along the way includes a real scenery style, an imaginary scenery style, and a real scenery historical style; wherein, when the scenery style preference setting along the way is set to the real scenery style, in the process of controlling the virtual human to move according to the selected virtual human movement path until reaching the movable area name group, displaying the scenery along the way to the user according to the scenery style preference setting along the way includes:

[0038] Obtaining a nursing home camera device range database, wherein the nursing home camera device range database includes the ID of each camera device in the nursing home and shooting range information of each camera device;

[0039] According to the current coordinate position of the virtual person, the video information of the camera device that can shoot the coordinate position is retrieved in real time and transmitted to the control terminal that interacts with the user.

[0040] Optionally, when the scenery style preference along the way is set to a real scenery style, in the process of controlling the virtual human to move according to the selected virtual human movement path until reaching the movable area name group, displaying the scenery along the way to the user according to the scenery style preference along the way includes:

[0041] Determine whether there are historical conditions in the scenery style preference settings along the way. If so, then

[0042] Determine whether historical video information can be retrieved based on historical conditions. If so,

[0043] Retrieve historical video information based on historical conditions.

[0044] Optionally, the historical conditions include date information, climate information, and time information;

[0045] The retrieving of historical video information according to historical conditions includes:

[0046] Determine whether the historical conditions include date information, climate information, and time information, and have the priority of date information and climate information. If both date information and time information are included, retrieve historical video information based on the date information and time information; if only date information is included, retrieve historical video information based on the date information and current time; if both date information and climate information are included, select the one with higher priority and the current time based on the priority of the date information and climate information to retrieve historical video information; if both date information, climate information, and time information are included, select the one with higher priority and the time information based on the priority of the date information and climate information to retrieve historical video information; if both climate information and time information are included, retrieve historical video information based on the climate information and time information.

[0047] Optionally, after the virtual person reaches the target movable area, collecting intelligence data from the target movable area to generate a mission report includes:

[0048] Obtaining data collection requirements based on the behavior name group;

[0049] According to the data collection requirements, one or more of the information on the number of active personnel, interactive project information, and appointment arrangement information in the target active area is collected, wherein the obtained information on the number of active personnel, interactive project information, and appointment arrangement information constitutes the task report.

[0050] Optionally, collecting one or more of the following information on the number of active persons in the target active area, information on interactive items, and appointment arrangement information according to data collection requirements includes:

[0051] Control the virtual person's arrival at the data collection location and the direction of the virtual person's viewing angle according to data collection requirements;

[0052] Obtaining the viewing angle starting point and the preset visual range of the virtual person according to the viewing direction of the virtual person;

[0053] Obtain information about virtual objects within the visible range of the virtual reality space;

[0054] The intelligence information of the current time point corresponding to the virtual object is obtained based on the information of the virtual object.

[0055] The present application also provides a virtual reality space interaction system for a nursing home, the virtual reality space interaction system for a nursing home comprising:

[0056] A control terminal, wherein the number of the control terminals is multiple, the address and location information of each control terminal are known, and each control terminal is provided with a human-computer interaction system and a camera system, wherein the human-computer interaction system is used to interact with the user, and the camera system is used to capture images according to instructions;

[0057] A system server, wherein a virtual reality space is provided on the system server;

[0058] There are multiple camera devices, which are distributed in various locations of the nursing home;

[0059] The control terminal, system server and camera device cooperate to implement the virtual reality space interaction method for nursing homes as described above.

[0060] The virtual reality space interaction method for nursing homes in this application has the following advantages:

[0061] (1) Considering that most of the users of nursing homes are elderly people, who are usually unlikely to control virtual people, this application only needs to obtain the user's demand information, and the system automatically controls the virtual person to complete the user's needs.

[0062] (2) The method of the present application enables the elderly to understand the specific conditions of each facility in the nursing home without leaving home, thereby preventing the elderly from going out without knowing the operating status of each facility, which results in wasting physical energy and time and failing to achieve the expected state. For example, if the restaurant is crowded or the restaurant's menu today does not have the elderly's favorite food, the method of the present application can directly obtain the number of people in the restaurant and the menu through the virtual person's visit, so that the elderly can consider whether to go to the restaurant on their own, without having to walk to the restaurant or call the restaurant to inquire about the situation. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] Figure 1 It is a flowchart of a virtual reality space interaction method for a nursing home in one embodiment of the present application. DETAILED DESCRIPTION

[0064] The technical solution of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the embodiments described are only some embodiments of the present invention, not all embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0065] like Figure 1 The illustrated methods of interacting with the VR space for nursing homes include:

[0066] Get user avatar information;

[0067] Determine whether the user's identity information can be obtained based on the user's profile picture information. If so,

[0068] Obtaining user identity information and obtaining user location information using a device for obtaining user portrait information;

[0069] Obtain user demand information;

[0070] Analyze the user demand information and determine whether it is necessary to create a user virtual person based on the user demand information. If so,

[0071] Creating a user avatar in the virtual reality space at the user's location;

[0072] Acquiring task information according to the user demand information;

[0073] Controlling the user virtual person to complete the task information in the virtual reality space and generate a task report; wherein the virtual reality space includes twin spaces of various facilities in the nursing home;

[0074] Perform human-computer interaction with the user according to the task report, thereby obtaining a new round of task information until the interaction ends.

[0075] The virtual reality space interaction method for nursing homes in this application has the following advantages:

[0076] (1) Considering that most of the users of nursing homes are elderly people, who are usually unlikely to control virtual people, this application only needs to obtain the user's demand information, and the system automatically controls the virtual person to complete the user's needs.

[0077] (2) The method of the present application enables the elderly to understand the specific conditions of each facility in the nursing home without leaving home, thereby preventing the elderly from going out without knowing the operating status of each facility, which results in wasting physical energy and time and failing to achieve the expected state. For example, if the restaurant is crowded or the restaurant's menu today does not have the elderly's favorite food, the method of the present application can directly obtain the number of people in the restaurant and the menu through the virtual person's visit, so that the elderly can consider whether to go to the restaurant on their own, without having to walk to the restaurant or call the restaurant to inquire about the situation.

[0078] In this embodiment, the user's head portrait information can be obtained by using a camera device provided on the control terminal. In this embodiment, the control terminal is a human-computer interaction device.

[0079] In this embodiment, determining whether the user identity information can be obtained based on the user's profile picture information includes:

[0080] Obtaining a preset face database, the preset face database including at least one preset face image and user identity information corresponding to each preset face image;

[0081] The similarity between the user's head portrait information and each preset face image is calculated respectively. If the similarity between a preset face image and the user's head portrait information exceeds a preset threshold, it is judged as yes.

[0082] When the judgment is yes, the user identity information corresponding to the preset face image whose similarity exceeds the preset threshold is obtained.

[0083] In this embodiment, the camera device on each control terminal has its own ID number and preset location information. Therefore, the user's location information can be obtained by obtaining the preset location information of the camera device.

[0084] It is understandable that since it is a nursing home, each elderly person's room will be equipped with a control terminal for the elderly to use.

[0085] In this embodiment, the user demand information can be provided in the form of voice or text. For example, a user can say in voice: I plan to go to the cafeteria for dinner at 12 o'clock.

[0086] In one embodiment, analyzing the user demand information and determining whether to establish a user virtual person according to the user demand information includes:

[0087] When the user provides user demand information by voice, the voice is converted into text by voice recognition;

[0088] Obtain a communication preference database, the communication preference database including at least one preset identity and a personal text database corresponding to each preset identity; in this embodiment, each personal text database stores a large amount of keyword information, including various place name information in the nursing home (for example, canteen, cinema, it is understandable that since canteen, etc. may have other alternative nouns in real life, for example, the canteen of the nursing home is just a popular noun, and the actual noun may be Changchun Garden, etc., in this case, all these nouns that can refer to the canteen are also included in the place name information), and colloquial names frequently used by the user may also be provided (for example, the canteen next to the cinema, in this case , it may specifically refer to a specific canteen, then the canteen near the cinema will be associated with the specific canteen, and when the text information appears about the canteen near the cinema, the canteen associated with it will be automatically identified) and also includes the noun information that can reflect the purpose in the nursing home (for example, eating, exercising, fitness, swimming, etc.), and also includes the colloquial noun information that can reflect the purpose commonly used by users (for example, the user likes to play cards, and directly says playing cards, and the exercise area corresponding to playing cards may be a rehabilitation center for the elderly. At this time, playing cards is associated with the rehabilitation center for the elderly. Once the user appears the noun playing cards, it is automatically identified as a rehabilitation center for the elderly).

[0089] Obtaining a personal character database corresponding to a preset identity that is identical to the user's identity information;

[0090] Segment the user demand information (i.e. text information) to obtain each phrase;

[0091] Comparing each phrase with each keyword information in the personal text database for similarity, thereby obtaining keyword information having a similarity exceeding a preset threshold, and obtaining keyword information having each similarity exceeding the preset threshold;

[0092] When the obtained keyword information with similarities exceeding the preset threshold includes various place name information in the nursing home, it is judged that a virtual person of the user needs to be established. It can be understood that the present application does not require the elderly to go out at this time. Therefore, even if the corresponding action information is not obtained, a virtual person can actually be established, because in this case it will not cause unnecessary burden to the elderly. For example, the user's text information is canteen. Assuming there are only two words, at this time, although there is no action information about what to do, a virtual person can be established, because maybe the elderly just want to go to the canteen for a stroll through the virtual person. Therefore, a virtual person is also established for the user in this case. It can be understood that establishing a virtual person of the user in the middle of a virtual space is an existing technology and will not be repeated here. For example, the login of a virtual person in the metaverse, the login of a virtual character in a game, etc.

[0093] It is understandable that if there are multiple place name information obtained, the elderly can be allowed to select one from them as keyword information through human-computer interaction (as described above, for example, the cafeteria next to the cinema actually has two place name information, but when actually performing word segmentation, the existing technology can identify the cinema part as the attributive of the cafeteria through word segmentation recognition, that is, it will not be divided into two words, and the overall word has a corresponding noun associated with it. Therefore, this description is actually still a place name information after recognition, that is, the cafeteria associated with it).

[0094] In one embodiment, obtaining task information according to the user demand information includes:

[0095] Acquire a movable destination library, wherein the movable destination library includes a plurality of destination names and location information corresponding to each destination name;

[0096] Acquire a destination name identical to the keyword information from the movable destination database according to the acquired keyword information;

[0097] It is determined whether the acquired keyword information contains action information. If so, the destination name and the action information are combined to form task information.

[0098] It is determined whether the acquired keyword information contains action information. If not, the destination name is used alone as task information.

[0099] The advantage of using this method is that creating a virtual person requires a certain amount of computing power and network. If a virtual person is created without being sure whether there are clear instructions, it will be a waste of computing power and network.

[0100] In this embodiment, when the present application parses the user demand information and determines whether it is necessary to establish a user virtual person based on the user demand information, as long as it is determined that text information can be obtained through voice information or it is determined that text information is obtained, it is determined that a virtual person needs to be established. That is to say, in this embodiment, after obtaining the user demand information, a virtual person is directly established and then the specific task is analyzed.

[0101] In this embodiment, obtaining task information according to the user demand information includes:

[0102] A user expression habit database is obtained according to the user identity information, and the expression habit database includes a location sub-library and a behavior sub-library, wherein the location sub-library includes at least one nursing home active area name group; the behavior sub-library includes at least one behavior name group, and one behavior name group is associated with at least one nursing home active area name group; in this embodiment, one nursing home active area name group corresponds to an active area in the nursing home. For example, if the nursing home has cinema A and cinema B, then cinema A has a corresponding active area name group A, and cinema B has an active area name group B. Both the active area name group A and the active area name group B include multiple active area names. The reason for having multiple active area names is that different users may have different descriptions of the active area. For example, the name of cinema A in the nursing home itself is the first active cinema, but some elderly people may habitually call it the old cinema when using it. At this time, in order to be able to identify the description of the elderly, multiple possible descriptions are placed in one active area name group.

[0103] In this embodiment, there are multiple user expression habit databases, and one user expression habit database corresponds to one user identity information. Therefore, the corresponding user expression habit database can be obtained according to the user identity information.

[0104] According to the user demand information, a group of activity area names required by the user in the nursing home is obtained from the location sub-library, and a group of behavior names required by the user is obtained from the behavior sub-library. Specifically, the activity area names identical to the keywords in the user demand information can be obtained by word segmentation, semantic recognition, and similarity to determine the required activity area name group and behavior name group.

[0105] Determine whether the obtained nursing home active area name group and behavior name group are related. If so, use the obtained nursing home active area name group and behavior name group as task information.

[0106] In this embodiment, both the activity area name and the behavior name are required to proceed to the next step. If not, questions can be asked to the user through intelligent interaction to obtain the missing information. The advantage of this method is that it can remind the user through voice inquiries, in case the user forgets to describe the missing part.

[0107] In this embodiment, controlling the user virtual person to complete the task information in the virtual reality space and generating a task report includes:

[0108] At least two virtual human movement paths are generated from the current location of the virtual human to the target movable area corresponding to the movable area name group based on the current location of the virtual human and the movable area name group; it can be understood that there is no possible way to connect any two locations in a general nursing home (such as location H and location O) with only one passable road. Therefore, in order to allow users to make their own choices, at least two virtual human movement paths are set for users to choose from.

[0109] The names of the movable areas passed by in each virtual human movement path are obtained; when the user selects a path, on the one hand, he may consider the distance and speed, and on the other hand, he may consider the scenery or facilities along the way. Therefore, the names of the movable areas passed by in each virtual human movement path are obtained, so that when the user is provided with a choice, the user can consider selecting a path based on the places passed by.

[0110] Sending the names of the movable areas passed by each virtual human movement path to the user;

[0111] Acquire the selection information fed back by the user; it is understandable that, in order to reduce the user's operations, the feedback selection information can be obtained through voice or direct screen selection.

[0112] Selecting one of the virtual human movement paths according to the selection information fed back by the user, thereby controlling the virtual human to move along the selected virtual human movement path until reaching the target movable area;

[0113] After the virtual person reaches the target movable area, intelligence data is collected from the target movable area to generate a mission report.

[0114] In this embodiment, the virtual reality space of the present application can be constructed based on digital twin technology or metaverse technology. In the three-dimensional scene constructed based on digital twin technology or metaverse technology, various equipment and facilities that are consistent with reality exist in corresponding positions. It is understandable that in order to save computing power, it is not necessary to model all equipment and facilities. For example, in a theater, only ticket gates need to be built, because going to the theater is mainly to understand the current theater's movie schedule, the next movie content, and the number of scheduled viewers, etc., and there is no need to fully build all the detailed models inside. It is understandable that if there is no lack of computing power, a 1:1 restoration can also be performed.

[0115] In this embodiment, when one of the virtual human movement paths is selected according to the selection information fed back by the user, the virtual human is controlled to move along the selected virtual human movement path until it reaches the group of movable area names. The virtual reality space interaction method for a nursing home further includes:

[0116] Obtaining a user virtual reality space preference database, wherein the user virtual reality space preference database is provided with at least one preset user preference sub-library and preset user identity information corresponding to each preset user preference sub-library;

[0117] Obtaining a preset user preference sub-library corresponding to the preset user identity information that is the same as the user identity information;

[0118] Determine whether there is a preset scenery style preference setting in the preset user preference sub-library. If so,

[0119] In the process of controlling the virtual human to move according to the selected virtual human movement path until reaching the movable area name group, the scenery along the way is displayed to the user according to the scenery style preference setting along the way.

[0120] In this embodiment, since the present application uses the movement of virtual people to reach the destination, the basic form is the same as the way the characters in the game reach the destination by walking. Both need to walk through a predetermined route. At this time, the user can observe the scenery along the way through the scenery style preference settings. The reason for using this method is mainly to allow the user to enjoy the scenery along the way. It is understandable that if the user does not need it, the virtual person can also be teleported to the various virtual teleportation points in the virtual reality space of this application through coordinate point teleportation, and travel to the destination through the teleportation points, and the teleportation points are usually closer to the destination.

[0121] In this embodiment, the scenery style preference setting along the way includes a real scenery style, an imaginary scenery style, and a real scenery historical style; wherein, when the scenery style preference setting along the way is set to the real scenery style, in the process of controlling the virtual human to move according to the selected virtual human movement path until reaching the movable area name group, displaying the scenery along the way to the user according to the scenery style preference setting along the way includes:

[0122] Obtaining a nursing home camera device range database, wherein the nursing home camera device range database includes the ID of each camera device in the nursing home and shooting range information of each camera device;

[0123] According to the current coordinate position of the virtual person, the video information of the camera device that can shoot the coordinate position is retrieved in real time and transmitted to the control terminal that interacts with the user.

[0124] This approach provides users with current video footage of different areas. For example, if a nursing home has an outdoor sports area, a camera can capture the current video stream of the outdoor sports area and transmit it to the user's control terminal, allowing the user to see the current situation at the outdoor sports area. This allows elderly people who don't want to go out to see the scenery outside. It also allows them to observe the flow of people in different areas and even whether there are acquaintances, which can provide some motivation and encourage them to go out and exercise. Furthermore, the elderly can see the weather conditions outside through the video. For example, even if it is raining or snowing, the amount of snow in different locations can be obtained through the video, allowing users to further plan their next trip.

[0125] In this embodiment, when the scenery style preference along the way is set to the real scenery historical style, in the process of controlling the virtual human to move according to the selected virtual human movement path until reaching the movable area name group, displaying the scenery along the way to the user according to the scenery style preference along the way includes:

[0126] Determine whether there are historical conditions in the scenery style preference settings along the way. If so, then

[0127] Determine whether historical video information can be retrieved based on historical conditions. If so,

[0128] Retrieve historical video information based on historical conditions.

[0129] In some cases, the user may want to see scenery of a season different from the current season. For example, it is winter now, and the user wants to see scenes of spring or summer. In this case, the scenes of this year's spring or summer can be retrieved for the elderly to watch. It is understandable that historical videos of more specific time points can also be retrieved according to the needs of the elderly. For example, if the elderly miss the scene of walking with someone in a nursing home on a certain day, historical videos of these places on that day can be retrieved.

[0130] In this embodiment, the historical condition may be one that the user has previously entered. If there is no historical condition and the real scenery historical style is selected, the application further includes:

[0131] Obtain the time point required by the user through human-computer interaction.

[0132] In this embodiment, the historical conditions include date information, climate information, and time information;

[0133] The retrieving of historical video information according to historical conditions includes:

[0134] Determine whether the historical conditions include date information, climate information, and time information, and have the priority of date information and climate information. If both date information and time information are included, retrieve historical video information based on the date information and time information; if only date information is included, retrieve historical video information based on the date information and current time; if both date information and climate information are included, select the one with higher priority and the current time based on the priority of the date information and climate information to retrieve historical video information; if both date information, climate information, and time information are included, select the one with higher priority and the time information based on the priority of the date information and climate information to retrieve historical video information; if both climate information and time information are included, retrieve historical video information based on the climate information and time information.

[0135] In this embodiment, the priority can be set according to the user's own needs.

[0136] As described above, if the user only needs to view the conditions of different seasons, the climate information can be directly provided, such as descriptive words such as spring, winter, and snow. At this time, the corresponding video can be directly retrieved from the historical video information.

[0137] In this embodiment, the historical video information includes multiple videos of different nursing home locations. Each video is set with a corresponding label, and the corresponding keywords can be obtained through label search. For example, the labels may include snowy days, rainy days, spring, etc. In this way, if there are corresponding descriptive words in the historical conditions, the corresponding video can be retrieved. It can be understood that if you want descriptions such as snowy days and rainy days, there may be multiple videos that meet the conditions. At this time, if there are no other historical conditions, you can randomly select a video.

[0138] The historical conditions also include specific character conditions;

[0139] When the historical conditions include specific character conditions, the virtual reality space interaction method for a nursing home of the present application further includes:

[0140] Obtaining a social relationship database, the social relationship database including a plurality of social relationship sub-databases, each social relationship sub-database corresponding to a user identity information, each social relationship sub-database including a user information and basic information of other persons having an intersection with the user information, the basic information of each other person including at least identity information, identity number information, and disclosure level;

[0141] Obtaining the communication relationship sub-library corresponding to the user identity information of the current user;

[0142] According to the basic information of other people in the acquired social relationship sub-database, determine whether there is a person whose basic information meets the specific person conditions. If so, then

[0143] Get the reveal level that matches the conditions of a specific character;

[0144] Obtaining, according to the disclosure level that meets the conditions of the specific character, a movable area that can display the specific character in the process of controlling the virtual character to move according to the selected virtual character movement path until reaching the movable area;

[0145] When the virtual person moves to an active area where a specific person can be displayed, historical video information is retrieved according to the specific person.

[0146] In this embodiment, the specific character condition can be a name, relationship or specific title. For example, the specific character condition of user A can be: the specific name of user B, husband and wife (relationship), wife (specific title), younger brother (relationship), older brother (relationship), etc.

[0147] In this embodiment, the basic information of other people may include the name of the person, the relationship with the user information that intersects with the basic information, and a preset specific title, etc. For example, in the social relationship sub-library of Zhang San, the user information is Zhang San, and there are two groups of basic information of other people that intersect with the user information, one group is Li Si's basic information, and the other group is Wang Wu's basic information. Li Si's basic information includes identity information, for example, it may include Li Si's name, the relationship between Li Si and Zhang San (for example, husband and wife), and the names that Li Si and Zhang San usually call each other (for example, wife, dear).

[0148] In this embodiment, the identity number information is used to find historical video information. Specifically, since the same name or title is likely to appear in a nursing home, each person is assigned an identity number information (similar to a student ID number, etc.). In each historical video information, the person appearing in the historical video information is obtained through manual labeling or image recognition, and the identity number information corresponding to the person is set as a label in the historical video information (it can be understood that if the identified person does not have identity number information in the nursing home, for example, the person has not registered or is outside the nursing home and has not actively requested to obtain the identity number information, no label will be set).

[0149] In this embodiment, the disclosure level refers to the location of the video that can be obtained. For example, if it is an outdoor activity scene, the required disclosure level may be relatively low, because in most cases outdoor activity scenes do not reveal much other information. However, if it is a room or swimming pool, a higher disclosure level may be required. This level is set to prevent users from abusing the right to obtain historical video information.

[0150] The reason why this application sets the condition of specific people is that most elderly people are relatively old when they enter nursing homes, and in many cases they live in with relatives and friends. As time goes by, many elderly people may not be able to walk for a long time or even walk on their own due to physical reasons, and many relatives and friends of the elderly may also leave the nursing home one after another. However, memories are precious. Sometimes, if users can see some of the past scenes through this method of this application, it can bring psychological comfort to users.

[0151] In this embodiment, obtaining, based on the disclosure level that meets the conditions of the specific character, a movable area that can display the specific character in the process of controlling the virtual character to move according to the selected virtual character movement path until reaching the movable area includes:

[0152] Get the level range of each active area setting;

[0153] Determine whether the exposure level of a specific character is within the level range set in the active area. If so,

[0154] The movable area is determined to be a movable area capable of displaying a specific person.

[0155] In this embodiment, when there is a specific person condition, the specific person condition is given the highest priority. That is, if there is date information, climate information and time information after the specific person condition, it must be ensured that the specific person condition must be met at the same time.

[0156] In this embodiment, when the virtual human moves to an active area where a specific person can be displayed, retrieving historical video information based on the specific person includes:

[0157] Obtain historical video information with specific character conditions through tags in each historical video information;

[0158] The historical video information with specific character conditions is further filtered according to one or more of date information, climate information and time information, so as to select the historical video information to be played.

[0159] It is understandable that if it is impossible to filter out historical video information that meets the specific character conditions and can meet other information (one or more of date information, climate information and time information), a historical video information that meets the specific character conditions is randomly selected.

[0160] It can be understood that in the process of further screening historical video information with specific character conditions based on one or more of date information, climate information and time information, the screening method can be the same as the above-mentioned screening method when there is only one or more of date information, climate information and time information.

[0161] In this embodiment, after the virtual person reaches the target movable area, collecting intelligence data from the target movable area to generate a mission report includes:

[0162] The data collection requirements are obtained according to the behavior name group; for example, the behavior names in the behavior name group may include eating, watching a movie, looking at a menu, and looking at the number of people swimming.

[0163] In this embodiment, obtaining data collection requirements based on the behavior name group includes:

[0164] Acquire a data collection database, wherein the data collection database includes at least one preset behavior name and a data collection requirement corresponding to each preset behavior name;

[0165] Obtain the data collection requirements corresponding to the preset behavior name that is the same as the behavior name. It can be understood that when there are multiple behavior names, there can be multiple data collection requirements, for example, one data collection requirement is the number of people, and another data collection requirement is menu information.

[0166] Target information is collected according to data collection requirements, and one or more target information constitutes the mission report.

[0167] It is understandable that if there is no behavior name group in the embodiment, all collectible information of the target active area can be collected. For example, the behaviors that may be included in the cafeteria include the number of people eating and recipe information, and both can be collected.

[0168] In this embodiment, the task may be delivered to the user in text form or voice form.

[0169] In this embodiment, collecting target information according to data collection requirements includes:

[0170] Control the virtual person's arrival at the data collection location and the direction of the virtual person's viewing angle according to data collection requirements;

[0171] Obtaining the viewing angle starting point and the preset visual range of the virtual person according to the viewing direction of the virtual person;

[0172] Obtain information about virtual objects within the visible range of the virtual reality space;

[0173] The intelligence information of the current time point corresponding to the virtual object is obtained based on the information of the virtual object.

[0174] For example, in this embodiment, several virtual devices are generated for each movable area. For example, the restaurant will generate a virtual portrait of the waiter and a display cabinet device. The reason for setting up such virtual objects is to enable different virtual objects to provide different intelligence information. For example, when the user's virtual person is close to the virtual portrait of the waiter, it means that the user needs to obtain data on the number of diners, and when the user's virtual person is close to the display cabinet device, it means that the menu information is needed. This can avoid the problem that the user only wants one of the information but cannot provide it as needed.

[0175] In order to enable each virtual object to provide corresponding intelligence information, this application can be implemented through the following methods:

[0176] Obtain a real-time database of movable areas. There are multiple real-time databases of movable areas, and one movable area corresponds to one real-time database of movable areas. The data in each real-time database of movable areas includes both real-time data and preset storage data. For example, taking a restaurant as an example, it is assumed that the intelligence information provided by the restaurant includes menus and number of people. Among them, for restaurants that can order food, in most cases the menu will not change for a month or several months, so it can be stored as preset storage data. Or for restaurants that provide buffet services, the menu of the day is generally fixed, which can also be stored as preset storage data. In contrast, the number of diners in the restaurant changes in real time. At this time, the video stream of the restaurant can be obtained through the restaurant's camera device, and the number of people in the video stream can be obtained as the number of diners through image recognition. At this time, the number of diners is updated every certain period of time, and the number of diners can be dynamically transmitted to the real-time database of the movable area as real-time data.

[0177] In this embodiment, the data in the real-time database of the movable area can be associated with the corresponding virtual objects, for example, the number of diners can be associated with the virtual portrait of the service staff.

[0178] When the position information of the user's virtual person enters the preset range of the waiter's virtual portrait and the waiter's virtual portrait is determined to be within the virtual range of the virtual person through the pre-set visual range of the virtual person, the latest data corresponding to the waiter's virtual portrait (i.e. the latest number of diners data) can be retrieved from the real-time database of the movable area.

[0179] In this embodiment, after the task is reported to the user, the user may issue a new command, and the method of this application can be repeated. For example, when the user obtains the number of diners and the menu of restaurant A, but feels that he does not want to eat, he may also provide information about restaurant B, so that the virtual person can go to restaurant B to obtain information.

[0180] The method of the present application can be used as a channel for users to obtain information, and can also be used as a form of entertainment when users have nothing to do. For example, if a user wants to reminisce about the scene of walking on the road to a nursing home with someone, the method of the present application can also be used to retrieve the corresponding historical video information.

[0181] The present application also provides a virtual reality space interaction system for a nursing home, which includes a control terminal, a system server, and a camera device, wherein:

[0182] There are multiple control terminals, the address and location information of each control terminal are known, and each control terminal is equipped with a human-computer interaction system and a camera system, wherein the human-computer interaction system is used to interact with the user, and the camera system is used to capture images according to instructions;

[0183] A virtual reality space is set up on the system server;

[0184] There are multiple camera devices distributed in various locations of the nursing home;

[0185] The control terminal, the system server and the camera device cooperate to implement the virtual reality space interaction method for the nursing home as described above.

[0186] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the above embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A virtual reality space interaction method for a nursing home, characterized in that: The virtual reality space interaction method for a nursing home includes: Get user avatar information; Determine whether the user's identity information can be obtained based on the user's profile picture information. If so, Obtaining user identity information and obtaining user location information using a device for obtaining user portrait information; Obtain user demand information; Analyze the user demand information and determine whether it is necessary to create a user virtual person based on the user demand information. If so, Creating a user avatar in the virtual reality space at the user's location; Acquiring task information according to the user demand information; Controlling the user virtual person to complete the task information in the virtual reality space and generate a task report; wherein the virtual reality space includes twin spaces of various facilities in the nursing home; Performing human-computer interaction with the user according to the task report, thereby obtaining a new round of task information until the interaction ends; The acquiring of task information according to the user demand information includes: Obtaining a user expression habit database based on the user identity information, the expression habit database including a location sub-library and a behavior sub-library, wherein the location sub-library includes at least one nursing home active area name group; the behavior sub-library includes at least one behavior name group, and one behavior name group is associated with at least one nursing home active area name group; According to the user demand information, a group of names of activity areas in the nursing home required by the user is obtained from the location sub-library, and a group of names of behavior required by the user is obtained from the behavior sub-library; Determine whether the obtained nursing home active area name group and behavior name group are related, and if so, use the obtained nursing home active area name group and behavior name group as task information; The controlling the user virtual person to complete the task information in the virtual reality space and generate a task report includes: generating at least two virtual human movement paths from the current location of the virtual human to the target movable area corresponding to the movable area name group according to the current location of the virtual human and the movable area name group; Obtain the name of the movable area passed through in the middle of each virtual human movement path; Sending the names of the movable areas passed by each virtual human movement path to the user; Obtaining selection information fed back by users; Selecting one of the virtual human movement paths according to the selection information fed back by the user, thereby controlling the virtual human to move along the selected virtual human movement path until reaching the target movable area; After the virtual person reaches the target movable area, collecting intelligence data from the target movable area to generate a mission report; After the virtual person arrives at the target movable area, collecting intelligence data from the target movable area to generate a mission report includes: Obtaining data collection requirements based on the behavior name group; Target information is collected according to data collection requirements, and one or more target information constitutes the mission report.

2. The virtual reality space interaction method for a nursing home according to claim 1, wherein: When one of the virtual human movement paths is selected according to the selection information fed back by the user, thereby controlling the virtual human to move according to the selected virtual human movement path until it reaches the group of movable area names, the virtual reality space interaction method for a nursing home further includes: Obtaining a user virtual reality space preference database, wherein the user virtual reality space preference database is provided with at least one preset user preference sub-library and preset user identity information corresponding to each preset user preference sub-library; Obtaining a preset user preference sub-library corresponding to the preset user identity information that is the same as the user identity information; Determine whether there is a preset scenery style preference setting in the preset user preference sub-library. If so, In the process of controlling the virtual human to move according to the selected virtual human movement path until reaching the movable area, the scenery along the way is displayed to the user according to the scenery style preference setting along the way.

3. The virtual reality space interaction method for a nursing home as claimed in claim 2, characterized in that: The scenery style preference setting along the way includes a real scenery style, an imaginary scenery style, and a real scenery historical style; wherein, when the scenery style preference setting along the way is set to the real scenery style, in the process of controlling the virtual human to move according to the selected virtual human movement path until reaching the movable area name group, displaying the scenery along the way to the user according to the scenery style preference setting along the way includes: Obtaining a nursing home camera device range database, wherein the nursing home camera device range database includes the ID of each camera device in the nursing home and shooting range information of each camera device; According to the current coordinate position of the virtual person, the video information of the camera device that can shoot the coordinate position is retrieved in real time and transmitted to the control terminal that interacts with the user.

4. The virtual reality space interaction method for a nursing home as claimed in claim 3, characterized in that: When the scenery style preference along the way is set to the real scenery historical style, in the process of controlling the virtual human to move according to the selected virtual human movement path until reaching the movable area name group, displaying the scenery along the way to the user according to the scenery style preference along the way includes: Determine whether there are historical conditions in the scenery style preference settings along the way. If so, then Determine whether historical video information can be retrieved based on historical conditions. If so, Retrieve historical video information based on historical conditions.

5. The virtual reality space interaction method for a nursing home as claimed in claim 4, characterized in that: The historical conditions include date information, climate information and time information; The retrieving of historical video information according to historical conditions includes: Determine whether the historical conditions include date information, climate information, and time information, and have the priority of date information and climate information. If both date information and time information are included, retrieve historical video information based on the date information and time information; if only date information is included, retrieve historical video information based on the date information and current time; if both date information and climate information are included, select the one with higher priority and the current time based on the priority of the date information and climate information to retrieve historical video information; if both date information, climate information, and time information are included, select the one with higher priority and the time information based on the priority of the date information and climate information to retrieve historical video information; if both climate information and time information are included, retrieve historical video information based on the climate information and time information.

6. The virtual reality space interaction method for a nursing home according to claim 5, characterized in that: Target information collected based on data collection requirements includes: Control the virtual person's arrival at the data collection location and the direction of the virtual person's viewing angle according to data collection requirements; Obtaining the viewing angle starting point and the preset visual range of the virtual person according to the viewing direction of the virtual person; Obtain information about virtual objects within the visible range of the virtual reality space; The intelligence information of the current time point corresponding to the virtual object is obtained based on the information of the virtual object.

7. A virtual reality space interactive system for nursing homes, characterized in that: The virtual reality space interaction system for nursing homes includes: A control terminal, wherein the number of the control terminals is multiple, the address and location information of each control terminal are known, and each control terminal is provided with a human-computer interaction system and a camera system, wherein the human-computer interaction system is used to interact with the user, and the camera system is used to capture images according to instructions; A system server, wherein a virtual reality space is provided on the system server; There are multiple camera devices, which are distributed in various locations of the nursing home; The control terminal, system server and camera device cooperate to implement the virtual reality space interaction method for nursing homes as described in any one of claims 1 to 6.

Images