A real-time object interaction method and system based on extended reality

Abstract

The present invention relates to a real-time object interaction method and system based on augmented reality, and relates to the field of augmented reality, which includes: prompting an experiencer to wear a preset wearable device, and collecting spatial positioning information of the wearable device and the wearing start time; sorting the experience order of the experiencer based on the wearing start time to obtain an experience serial number; determining the experience session of the experiencer based on the single-session limit and the experience serial number; prompting the experiencer to enter the first scene according to the experience session, and projecting the virtual scene onto the wearable device, after the single-scene experience time, prompting the experiencer to enter the second scene, and prompting the experiencer of the next experience session to enter the first scene; when there are experiencers staying in the first scene, the experiencers staying in the first scene are marked as staying personnel, and blocking walls and guide walls are set in the first scene to guide the staying personnel to evacuate to the second scene. The present application has the effect of improving the experience efficiency of players.

Description

Technical Field

[0001] The present invention relates to the field of augmented reality, and in particular to a real-time object interaction method and system based on augmented reality. Background Art

[0002] Extended reality covers all technologies that integrate real and virtual environments, including immersive technologies such as virtual reality, augmented reality, and mixed reality. Its goal is to expand human perception and interaction with reality through technological means and create a richer experience.

[0003] Existing commercial augmented reality experiences typically take place in larger rooms. By setting the virtual world to the same scale as the real room and dividing it into multiple scenes, players can interact with objects in real time and traverse between adjacent scenes. Due to the limited space in each scene, players must enter the augmented reality experience in batches, and the previous batch of players must complete the experience before the next batch can proceed. This results in long waiting times and a low efficiency. Summary of the Invention

[0004] In order to improve the player's experience efficiency, the present invention provides a real-time object interaction method and system based on augmented reality.

[0005] In a first aspect, the present invention provides a real-time object interaction method based on augmented reality, which adopts the following technical solutions:

[0006] A real-time object interaction method based on augmented reality, comprising:

[0007] S1: Prompt the user to wear a preset wearable device, and collect the spatial positioning information of the wearable device and the wearing start time;

[0008] S2: Sort the experience order of the experiencers based on the wearing start time to obtain an experience serial number;

[0009] S3: Determine the experience session for the experiencer based on the preset single-session limit number and the experience sequence number;

[0010] S4: prompting the experiencer to enter a preset first scene according to the experience session, and projecting the preset virtual scene onto the wearable device. After a preset single-scene experience time, prompting the experiencer to enter a preset second scene, and prompting the experiencer of the next experience session to enter the first scene;

[0011] S5: Determining whether there is an experiencer staying in the first scene based on the spatial positioning information of the wearable device of the experiencer;

[0012] S6: When there are experiencers staying in the first scene, the experiencers staying in the first scene will be marked as lingering personnel, and a preset blocking wall and a preset guide wall will be set in the first scene using a preset scene guidance method to guide the lingering personnel to evacuate to the second scene.

[0013] By adopting the above technical solution, when the experiencers of the previous session are about to complete the experience activities of the current scene, the system will arrange for the experiencers of the next session to enter the venue for the experience in advance; and when the experiencers of the previous session stay, in order to prevent the experiencers of the two sessions from meeting, the system sets up blocking walls and guide walls between the experiencers of the two sessions, thereby guiding the experiencers of the previous session to leave and preventing the experiencers of the two sessions from meeting, thereby greatly improving the experience efficiency of the players.

[0014] Optionally, the scenario guidance method includes:

[0015] S60: Determine the location of the barrier wall based on the spatial positioning information of the resident and a preset distance;

[0016] S600: Controlling a preset hoisting device to place the barrier wall at the barrier wall setting position to separate the experiencers of the two experience sessions;

[0017] S601: Generate a guidance path based on the spatial positioning information of the lingering person and a preset second scene entrance position;

[0018] S602: Controlling the hoisting device to set the guide walls on both sides of the guide path based on the guide path;

[0019] S603: Creating a digital channel in the virtual scene based on the guide path, projecting the blocking wall and the guide wall onto the virtual scene, and issuing a guidance prompt to guide the lingering person to move along the digital channel.

[0020] Optionally, the method for handling the situation in which an experiencer approaches the barrier wall during the evacuation of the lingering personnel in the guided path includes:

[0021] S61: Determining whether the lingering person has left the first scene based on the spatial positioning information of the lingering person;

[0022] S610: If the lingering person has left the first scene, control the hoisting device to lift the blocking wall and the guide wall away;

[0023] S611: If the lingering person has not left the first scene, determine the experiencer closest to the barrier wall based on the location of the barrier wall and the spatial positioning information of the experiencer in the next experience session, and mark the experiencer as an encounter person;

[0024] S6110: Determine a collision distance based on the spatial positioning information of the encountering persons and the location of the barrier wall;

[0025] S6111: Based on the collision distance being less than the holding distance, generating a translation path of the barrier wall according to the spatial positioning information of the lingering person and the guiding path;

[0026] S6112: Control the hoisting equipment to translate the barrier wall along the translation path at a preset translation speed, and control the hoisting equipment to lift away the guide walls on both sides of the translation path.

[0027] Optionally, the virtual scene has different experience mode types, including a viewing mode and a plot mode. The method for processing the encountering person approaching the barrier wall under different experience mode types further includes:

[0028] S62: Determine the moving speed of the encountered person based on the spatial positioning information of the encountered person within a preset unit time;

[0029] S620: When the moving speed of the encountering person is greater than the translation speed of the barrier wall, matching the experience mode type based on a preset experience reservation item;

[0030] S621: Based on the scenario mode, controlling a preset inflation device to inflate an air cushion preset on the barrier wall, and determining whether the spatial positioning information of the encountering person overlaps with the position of the barrier wall in the virtual scene;

[0031] S6210: When the spatial positioning information of the encountering person overlaps with the position of the blocking wall in the virtual scene, issuing a collision warning;

[0032] S622: Based on the viewing mode, two options are provided to the encountering person to control the barrier wall using a preset selection control method.

[0033] Optionally, also include:

[0034] S6220: In the viewing mode, determining the number of the encountered persons based on the spatial positioning information of the encountered persons;

[0035] S62200: When the number of the encountering persons is 1, providing the encountering person with two options for controlling the barrier wall using the selection control method;

[0036] S62201: When the number of the encountered persons is not 1, determining the number of splits of the blocking wall based on the number of the encountered persons;

[0037] S622010: Determine a separate setting position of each of the barrier walls based on the spatial positioning information of each of the encountered persons;

[0038] S622011: controlling the barrier wall to split according to the number of splits of the barrier wall, and setting each of the split barrier walls at a separate setting position;

[0039] S622012: Control the inflation device to inflate the air cushion of each barrier wall to block each of the encountering persons.

[0040] Optionally, the control method includes:

[0041] S6221: Projecting preset scene selection items in the virtual scene of the encounter person, and collecting the movement posture of the encounter person;

[0042] S6222: When the motion posture is consistent with the preset reference posture, controlling the inflation device to inflate the air cushion on the barrier wall, and issuing a collision warning when the spatial positioning information of the encountering person overlaps with the position of the barrier wall in the virtual scene;

[0043] S6223: When the action posture is inconsistent with the reference posture, controlling the barrier wall to split in the middle to form a channel feature, and generating a virtual portal at the location of the barrier wall in the virtual scene of the encountering person;

[0044] S6224: Determine whether the encountered person passes through the virtual portal based on the spatial positioning information of the encountered person and the guided path;

[0045] S6225: After the encounter person passes through the virtual portal, the encounter person is marked as the lingering person and a guidance prompt is issued.

[0046] Optionally, the control method of the guide wall includes:

[0047] S63: Determine the path length based on the spatial positioning information of the lingering person, the second scene entrance position, and the guided path;

[0048] S630: When the path length is not greater than a preset reference setting length, determining the number of guide walls according to the path length and a preset guide wall length;

[0049] S6300: Controlling the hoisting device to set the guide walls on both sides of the guide path based on the number of guide walls and the guide path, and counting the number of guide walls;

[0050] S6301: When the lingering person moves in the digital channel, the real-time moving distance of the lingering person is determined in real time according to the spatial positioning information of the lingering person;

[0051] S6302: When the real-time moving distance is greater than the length of the guide wall, control the lifting device to lift away from a group of the guide walls, and reduce the count of the number of the guide walls by one until the count of the number of guide walls reaches 0.

[0052] Optionally, also include:

[0053] S631: When the path length is greater than the reference setting length, determining the setting positions of guide walls located on both sides of the lingering person and on both sides of the guide path according to the spatial positioning information of the lingering person and the guide path;

[0054] S6310: Determine a change speed of the lingering personnel according to the spatial positioning information of the lingering personnel within a unit time;

[0055] S6311: Control the hoisting equipment to set the guide wall at the guide wall setting position, and control the guide wall to move along the guide path following the lingering personnel according to the scene change speed.

[0056] Optionally, the preparatory method for setting the barrier wall before the first scene includes:

[0057] Based on the spatial positioning information of each of the experiencers and the location of the second scene entrance, a first person and a second person who are farther away from the second scene entrance are screened out;

[0058] S64: Determine the middle position of the persons based on the spatial positioning information of the first person and the spatial positioning information of the second person;

[0059] S640: Matching the sliding setting position of the barrier wall at the top of the scene based on the middle position of the personnel;

[0060] S641: updating the middle position of the personnel in real time and controlling the hoisting setting to set the barrier wall at the sliding setting position.

[0061] In a second aspect, the present application provides a real-time object interaction system based on augmented reality, which adopts the following technical solutions:

[0062] A real-time object interaction system based on augmented reality, comprising:

[0063] An acquisition module, configured to acquire spatial positioning information of the wearable device and a wearing start time;

[0064] A memory for storing a program for a real-time object interaction method based on augmented reality;

[0065] The program in the memory can be loaded and executed by the processor to implement a real-time object interaction method based on augmented reality.

[0066] In summary, this application includes at least one of the following beneficial technical effects:

[0067] 1. When the previous session of participants is about to complete the current scene experience, the system will arrange for the next session of participants to enter the scene in advance; and if there are participants from the previous session lingering, in order to prevent the participants from the two sessions from meeting, the system will set up a barrier wall and a guide wall between the two sessions of participants, thereby guiding the participants from the previous session to leave and preventing the participants from the two sessions from meeting, thus greatly improving the player experience efficiency;

[0068] 2. The system will set up a barrier wall between the lingering user and the next group of users, forcing the lingering user to move forward to enter the second scene and unable to retreat to meet the next group of users. To help the lingering user quickly leave, the system will generate a guide path between the lingering user and the entrance to the second scene, and set up guide walls on both sides of the guide path to ensure that the lingering user can only move along the guide path. In the lingering user's virtual world, the system will project a digital channel unique to the lingering user, allowing the lingering user to quickly enter the second scene under the guidance of the system.

[0069] 3. When the speed of the encountering person is greater than the translation speed of the barrier wall, the system will control the barrier wall according to different experience modes. If it is in plot mode, in order to ensure that the encountering person's plot experience is complete, the system will inflate the air cushion on the barrier wall, so that the encountering person will not be easily injured even if the encountering person touches the barrier wall. The system will also generate a virtual barrier wall in the encountering person's virtual world to remind the encountering person that there is a barrier wall ahead. In viewing mode, the encountering person can choose to directly enter the second scene or choose to stay in the first scene to wait for other experiencers in the same session. If you choose to wait, the system will use the control method of the barrier wall in plot mode to control the barrier wall. If you choose to enter the second scene, the encountering person can be reclassified by the system as a stayer among the experiencers in the previous session. At this time, the system will control the barrier wall to split from the middle to form a channel feature for entering the guide path, allowing the encountering person to quickly enter the second scene through the guide path. BRIEF DESCRIPTION OF THE DRAWINGS

[0070] Figure 1 is a method flow chart of a real-time object interaction method based on augmented reality according to an embodiment of the present invention;

[0071] Figure 2 is a method flow chart of a scene guidance method according to an embodiment of the present invention;

[0072] Figure 3 This is a flowchart of a method for handling a situation where an experiencer is close to a barrier wall according to an embodiment of the present invention;

[0073] Figure 4 This is a method flow of a method for handling a situation where an experiencer is close to a barrier wall under different experience mode types in an embodiment of the present invention. Figure 1 ;

[0074] Figure 5 This is a method flow of a method for handling a situation where an experiencer is close to a barrier wall under different experience mode types in an embodiment of the present invention. Figure 2 ;

[0075] Figure 6 4 is a flow chart of a selection control method according to an embodiment of the present invention. DETAILED DESCRIPTION

[0076] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0077] The embodiment of the present application discloses a real-time object interaction method based on augmented reality.

[0078] Reference Figure 1 , a real-time object interaction method based on augmented reality includes the following steps:

[0079] Step S1: prompting the experiencer to wear a preset wearable device, and collecting the spatial positioning information of the wearable device and the wearing start time.

[0080] Before engaging in the augmented reality experience, participants must first put on a wearable device as prompted by the system. In this embodiment, the wearable device is a VR helmet with a display device positioned at the user's eye level. The system projects a virtual image onto the display device, allowing participants to view the virtual world through the wearable device's display, thereby engaging in the augmented reality experience.

[0081] Spatial positioning information refers to the location of the wearable device in the room, which is also equivalent to the location of the experiencer. The wearable device has a positioning chip, and the system can read spatial positioning information from the positioning chip. Subsequent experiencers will need to collect spatial positioning information from the wearable device to determine their location in the room during the experience.

[0082] The wear start time refers to the time when the user puts on the wearable device. When the user puts on the wearable device, the system can collect the wear start time from the wearable device's built-in clock. The system will then divide the user's experience order based on the wear start time.

[0083] Step S2: Sort the experience order of the experiencers based on the wearing start time to obtain the experience serial number.

[0084] The experience number refers to the order in which the user participates in the augmented reality experience. The experience number is sorted by the time the wearer starts wearing the device. The higher the number, the shorter the waiting time for the experience.

[0085] Step S3: Determine the experience session for the experiencer based on the preset single-session limit number and the experience sequence number.

[0086] The maximum number of people in a single scene is set by technicians based on the size of the room scene. Each scene can accommodate a certain number of people. If the number of people exceeds this, the scene will be crowded and the experience will be affected. I will not go into details here.

[0087] There are multiple sessions of the XR experience, and you can move on to the next session after completing one. A session refers to the specific session of the XR experience that participants can participate in.

[0088] In this embodiment, all experiencers are divided according to their experience numbers, and the experience numbers included in each experience session are determined based on the number of people allowed in a single session. For example, if there are 100 experience numbers and the number of people allowed in a single session is 20, then the 100 people are divided into 5 sessions, with 20 people in each session. The higher the experience number, the earlier the experience session.

[0089] Step S4: Prompt the experiencer to enter the preset first scene according to the experience session, and project the preset virtual scene onto the wearable device. After the preset single-scene experience time, prompt the experiencer to enter the preset second scene, and prompt the experiencer of the next experience session to enter the first scene.

[0090] The augmented reality experience activity has multiple experience scenes. In this embodiment, there are two scenes, namely the first scene and the second scene. After passing through the first scene, the experiencer can proceed to the second scene after completing the first scene. The number of experience scenes can be greater than two, and the experience method is the same, so I will not elaborate on it here.

[0091] To ensure the efficiency of the extended reality experience, each participant is limited to a specific time in a scene. The single-scene experience time refers to the amount of time a participant can stay in a scene. After the single-scene experience time is up, participants will move on to the next scene. At the same time, participants in the next experience session will also begin entering the scene.

[0092] Step S5: Determine whether there is an experiencer staying in the first scene based on the spatial positioning information of the wearable device of the experiencer.

[0093] The length of time each participant stays in a scene is determined by personal preference. Most participants move on to the next scene after experiencing a single scene for a certain period of time. However, some participants may prefer a particular scene and continue to stay in the current scene after the period of time has expired. By analyzing the spatial positioning information of the participant's wearable device, we determine whether the participant's location is within the range of the current scene, thereby determining whether any participant has remained in the first scene.

[0094] Step S6: When there are experiencers staying in the first scene, the experiencers staying in the first scene are marked as lingering personnel, and a preset blocking wall and a preset guide wall are set in the first scene using a preset scene guidance method to guide the lingering personnel to evacuate to the second scene.

[0095] After the single-scene experience time, if an experiencer lingers in the first scene, the system will automatically locate the experiencer and mark him / her as a lingering person. In order to prevent the lingering person from meeting the experiencers of the next experience session, the system will use the scene guidance method to guide the lingering person into the second scene. In this embodiment, the system will set up a barrier wall in the first scene to prevent the lingering person from retreating and preventing the experiencers of the next experience session from approaching, and the system will set up a guide wall in the first scene to guide the lingering person. The specific scene guidance method will not be described in detail here, and will be described in detail in subsequent embodiments.

[0096] Reference Figure 2 , the scene guidance method includes the following steps:

[0097] In this embodiment, a barrier wall is set between the lingering person and the experiencers of the next experience session to prevent the lingering person from running in the wrong direction, and a guide wall is set between the lingering person and the entrance to the second scene to form a path so that the lingering person can move along the path.

[0098] Step S60: Determine the location of the barrier wall based on the spatial positioning information of the lingering personnel and the preset distance.

[0099] The distance to be maintained is the distance that needs to be maintained between the personnel and the persons staying there when setting up the barrier wall, as set by the technical staff, so as to ensure that the persons staying there are not easily harmed when setting up the barrier wall.

[0100] By obtaining the real-time spatial location information of the lingering user, the barrier wall is positioned based on the location of the lingering user, extending the distance in the direction of the next experiencer. The barrier wall is placed between the lingering user and the next experiencer, separating them from each other.

[0101] Step S600: controlling the preset hoisting equipment to set the barrier wall at the barrier wall setting position to separate the experiencers of the two experience sessions.

[0102] The hoisting equipment is arranged at the top of the room for hoisting the blocking wall and the guide wall so that the blocking wall and the guide wall can be arranged in the room.

[0103] When the barrier wall setting position is determined, the hoisting equipment can lower the barrier wall prepared in advance on the top of the room and set it at the barrier wall setting position, so that the people staying there cannot retreat but can only move forward to the next scene.

[0104] Step S601: Generate a guidance path based on the spatial positioning information of the lingering person and a preset second scene entrance position.

[0105] The guidance path refers to the route that the lingering personnel need to move to evacuate to the second scene.

[0106] The entrance to the second scene is a fixed point in the room and will not be described in detail here.

[0107] When the spatial positioning information of the lingering person is determined, the system can determine the shortest route between the two points based on the current location of the lingering person and the location of the entrance to the second scene, and the lingering person can move along the shortest route.

[0108] Step S602: Based on the guide path, the hoisting device is controlled to set the guide walls on both sides of the guide path.

[0109] To ensure that lingering users can quickly move along the guidance path to the entrance to the second scene, the system will set up guide walls on both sides of the guidance path to prevent them from straying. Since the route of the guidance path is already determined, the location of the guide walls on both sides of the guidance path can also be determined.

[0110] Step S603: creating a digital channel in the virtual scene based on the guide path, projecting the blocking wall and the guide wall onto the virtual scene, and issuing a guidance prompt to guide the lingering person to move along the digital channel.

[0111] The blocking walls, guide walls and guide paths in the above method are all set up by the system in the real world, and the system will also provide guidance in the virtual world.

[0112] In this embodiment, in order to enable the resident to concentrate on entering the second scene without being attached to the first scene, the system will generate a digital channel in the virtual scene. The digital channel is a scene picture generated by the system for the resident to quickly enter the second scene. There are no other experiencers in the digital channel.

[0113] The digital pathway is a system-generated, one-to-one replica of the real-world guided path. This pathway is displayed in the virtual scene. Visitors can see the digital pathway and follow it under the guidance of the system. As they move along the digital pathway, they appear to be moving along the guided path in real life.

[0114] Reference Figure 3 The method for handling the situation in which a person staying in the guide path is evacuated and an experienced person approaches the barrier wall comprises the following steps:

[0115] Step S61: determining whether the lingering person has left the first scene based on the spatial positioning information of the lingering person.

[0116] By obtaining the spatial positioning information of the lingering person and comparing the spatial positioning information with the room range of the second scene, if the two are consistent, it means that the lingering person has left the first scene, otherwise it means that the lingering person has not left.

[0117] When the next experiencer approaches the barrier wall, whether the lingering person has left the current scene will affect the system's control of the barrier wall and guide wall, so it is necessary to make a judgment first.

[0118] Step S610: If the lingering person has left the first scene, control the hoisting equipment to lift away the blocking wall and the guide wall.

[0119] If the lingering person has left the first scene, the blocking wall and guide wall have lost their function. At this time, when the experiencer of the next experience session approaches the blocking wall, the system will directly remove the blocking wall and guide wall, so that there is no blocking wall and guide wall in the room where the first scene is located to interfere with the experiencer of the next experience session.

[0120] Step S611: If the lingering person has not left the first scene, the experiencer closest to the barrier wall is determined based on the location of the barrier wall and the spatial positioning information of the experiencer in the next experience session, and is marked as an encounter person.

[0121] If the lingering person has not left the first scene, the system cannot directly remove the blocking wall and the guide wall, so the lingering person may be evacuating in the guide path at this time.

[0122] In this embodiment, the system will obtain the spatial positioning information of each experiencer in the next experience session and compare it with the position of the barrier wall, so as to determine the experiencer in the next experience session who is closest to the barrier wall. This experiencer is the encounter person, and the encounter person is the person most likely to collide with the barrier wall.

[0123] When the encountering persons are found, the system will process the relationship between the encountering persons and the blocking wall.

[0124] Step S6110: Determine the collision distance based on the spatial positioning information of the encountering persons and the location of the barrier wall.

[0125] The collision distance refers to the distance between the encountering persons and the barrier wall. The collision distance can be calculated based on the spatial positioning information of the encountering persons and the location of the barrier wall.

[0126] Step S6111: Based on the collision distance being smaller than the holding distance, a translation path of the barrier wall is generated according to the spatial positioning information of the lingering person and the guide path.

[0127] In this embodiment, to prevent collisions between people and the barrier wall, the system uses a lifting device to translate the barrier wall along a guide path. This translation path is the path the barrier wall takes as it moves along the guide path. The translation path is generated based on the spatial positioning information of the person and the guide path, and the translation path and the guide path overlap. As the person moves along the guide path, space is created between them and the barrier wall, allowing the barrier wall to move. This effectively synchronizes the movement of the barrier wall with the person.

[0128] When the collision distance between the encountering person and the barrier wall is less than the maintaining distance, it means that the encountering person is about to hit the barrier wall. At this time, the system controls the barrier wall to move to maintain a distance from the encountering person.

[0129] Step S6112: controlling the hoisting equipment to translate the barrier wall along the translation path at a preset translation speed, and controlling the hoisting equipment to lift away the guide walls on both sides of the translation path.

[0130] The translation speed is the movement speed of the system-controlled barrier wall set by the technicians and will not be described in detail here.

[0131] When the barrier wall needs to be moved, the system controls the barrier wall to move along the translation path at a translation speed through the lifting equipment. During the movement of the barrier wall, in order to prevent the guide wall from affecting the movement of the barrier wall, the system will lift the guide wall away through the lifting setting.

[0132] Reference Figure 4 The virtual scene has different experience mode types, including viewing mode and plot mode. In viewing mode, the main activity of the experiencer is to watch the scene, and in plot mode, the main activity of the experiencer is to experience the plot. The processing method of the encounter person approaching the barrier wall is different in different experience modes. The processing method of the encounter person approaching the barrier wall in different experience mode types also includes the following steps:

[0133] Step S62: Determine the moving speed of the encountered person based on the spatial positioning information of the encountered person within a preset unit time.

[0134] The unit time is the time interval set by the technician to determine the experiencer's movement speed. By repeatedly acquiring the spatial positioning information of the encountering person within the unit time, the position change of the spatial positioning information is obtained. The movement speed of the encountering person can be calculated based on the position change and the unit time.

[0135] Step S620: When the moving speed of the encountering person is greater than the translation speed of the blocking wall, the experience mode type is matched based on a preset experience reservation item.

[0136] The experience reservation item is the parameters of the scene that have been determined before the experiencer begins. The experience reservation item can determine the type of experience mode of the current experiencer, including viewing mode and story mode.

[0137] If the moving speed of the encountering persons is not greater than the translation speed of the blocking wall, the encountering persons will not encounter the blocking wall, and there is no need to operate the blocking wall at this time.

[0138] If the moving speed of the encountering person is greater than the translation speed of the barrier wall, it means that the encountering person will definitely encounter the barrier wall. When the two meet, the system will control the barrier wall in a targeted manner according to the different experience mode types.

[0139] Step S621: Based on the scenario mode, control the preset inflation device to inflate the air cushion preset on the barrier wall, and determine whether the spatial positioning information of the encountering person overlaps with the position of the barrier wall in the virtual scene.

[0140] In this embodiment, an air cushion is provided on the barrier wall, and the air cushion can be inflated by an inflation device provided in the barrier wall. Even if the encountering persons collide with the barrier wall, they are not easily injured due to the cushioning of the air cushion.

[0141] In story mode, encounters are required to experience the entire scenario, so encounters cannot leave the room they are currently in. When encounters are about to collide with a barrier wall, the system controls the inflator to inflate the air cushion. The system determines whether the encounter's spatial location information in the virtual world overlaps with the barrier wall, thereby determining whether the encounter has collided with the barrier wall in the real world.

[0142] Step S6210: When the spatial positioning information of the encountering person overlaps with the position of the blocking wall in the virtual scene, a collision warning is issued.

[0143] If the spatial positioning information of the encountering persons overlaps with the position of the barrier wall in the virtual scene, it means that the encountering persons have collided with the barrier wall, and the system will issue a collision warning.

[0144] Step S622: Based on the viewing mode, provide the encountering person with two options to control the barrier wall using a preset selection control method.

[0145] In viewing mode, participants can choose to continue viewing the current scene or advance to the second scene. The system uses a selection control method to give participants the option to make this choice. Different choices made by participants will affect the system's control of the barrier wall. The selection control method will not be described in detail here and will be described in detail in subsequent embodiments.

[0146] Reference Figure 5 In this embodiment, in viewing mode, whether the system grants the encountering person the right to choose to enter the next scene is determined by the number of encountering persons. The method for handling different numbers of encountering persons approaching the barrier wall includes the following steps:

[0147] Step S6220: In the viewing mode, the number of the encountered persons is determined based on the spatial positioning information of the encountered persons.

[0148] The number of encounters refers to the number of people who simultaneously approached the barrier wall. The system compares the spatial location information of all encounters with the location of the barrier wall, filters out all encounters close to the barrier wall, and then counts all encounters to determine the number of encounters.

[0149] Step S62200: When the number of the encountering persons is 1, the selection control method is used to provide the encountering person with two options to control the barrier wall.

[0150] If the number of encountered people is 1, it means that there is only one experiencer approaching the barrier wall. At this time, the system will provide the option of entering the next scene in advance and control the barrier wall.

[0151] Step S62201: When the number of the encountering persons is not 1, the number of splits of the blocking wall is determined based on the number of the encountering persons.

[0152] If the number of encountered persons is not 1, it indicates that there is more than one person in the encounter. In this case, the system needs to control the barrier wall to block each person in the encounter. In this embodiment, the barrier wall is composed of multiple units and can be split and controlled individually. The number of splits refers to the number of splits generated by the barrier wall. The number of splits of the barrier wall is determined by the number of encountered persons and corresponds to each other.

[0153] Step S622010: Determine the individual setting position of each of the barrier walls based on the spatial positioning information of each of the encountered persons.

[0154] The individual placement position refers to the placement position of each split barrier wall when blocking the corresponding encountering person. The individual placement position is determined based on the spatial positioning information of the encountering person.

[0155] The principle for an experiencer to be marked as an encounter person is that the experiencer is close to the barrier wall. When there are multiple encounter persons, since the position of the barrier wall before it is split is unique, the distance between the encounter persons will not be far apart. Therefore, the distance between each barrier wall after splitting will not be far, and can still be uniformly controlled by the lifting equipment.

[0156] Step S622011: controlling the partition wall to split according to the number of splits of the partition wall, and setting each of the split partition walls at a separate setting position.

[0157] When there are multiple encountering persons, the system will control the lifting equipment to split the barrier wall. The number of split barrier walls corresponds to the number of encountering persons, and the system will control the position of each split barrier wall according to the position of each encountering person.

[0158] Step S622012: Control the inflation device to inflate the air cushion of each barrier wall to block each of the encountering persons.

[0159] In this embodiment, when there are multiple encountering persons, due to the large number of persons, the system no longer provides the option of entering the next scene in advance, but instead inflates the air cushion of the barrier wall to block each encountering person.

[0160] Reference Figure 6 , selecting a control method includes the following steps:

[0161] Step S6221: Projecting preset scene selection items in the virtual scene of the encounter person, and collecting the movement posture of the encounter person.

[0162] Scene selection options are interactive options screens within the virtual scene that allow the user to make selections. In viewing mode, if the user is about to collide with a barrier, the system will generate a scene selection screen within the virtual scene screen for the user.

[0163] The gestures and movements of the encountering persons refer to the gestures and movements of the experiencing persons obtained through the cameras set up in the room. Specific gestures and movements can produce different interactive meanings in the scene images of the virtual world and are used to interact with the scene selection items.

[0164] Step S6222: When the action posture is consistent with the preset reference posture, the inflation device is controlled to inflate the air cushion on the barrier wall, and a collision warning is issued when the spatial positioning information of the encountering person overlaps with the position of the barrier wall in the virtual scene.

[0165] The baseline posture is a posture action in the scene screen of the virtual world set by the technician, which is used to interact with the scene selection options. The baseline posture represents the experiencer's rejection of the options given by the system, and will not be elaborated here.

[0166] In this embodiment, the scenario selection item has two selection items, agree or reject. If you select either one, the system will respond according to the selection result of the experiencer.

[0167] When the scene selection options appear, the user performs a corresponding gesture. If the camera detects that the user's gesture matches the baseline gesture, it indicates that the user has selected "Reject" from the scene selection options on the scene screen. After selecting "Reject," the user can continue to experience the first scene. The system's control method for the barrier wall at this point is the same as in steps S621 and S6210 and will not be further explained here.

[0168] Step S6223: When the action posture is inconsistent with the reference posture, the barrier wall is controlled to split in the middle to form a channel feature, and a virtual portal is generated at the position of the barrier wall in the virtual scene of the encountering persons.

[0169] If the camera detects that the person's posture is inconsistent with the baseline posture, it means that the person has chosen to agree. After choosing to agree, the system determines that the person has agreed to enter the second scene in advance.

[0170] In this embodiment, when the experiencer chooses to agree to proceed to the second scene in advance, the system can control the barrier wall to split from the middle to form a channel feature, which refers to a channel in the barrier wall that the experiencer can pass through.

[0171] If the encountering persons choose to agree, when they approach the barrier wall, the system will control the lifting equipment to open the barrier wall, thereby creating a passage for the encountering persons to pass through and enter the guide path.

[0172] Correspondingly, a virtual portal will be generated at the corresponding position of the blocking wall in the virtual scene of the encountering persons. The virtual portal is a feature in the virtual scene set by the technicians. When the experiencer interacts with the virtual portal, he or she can pass through the virtual portal.

[0173] Step S6224: Determine whether the encountered person has passed through the virtual portal based on the spatial positioning information of the encountered person and the guidance path.

[0174] By collecting the spatial positioning information of the encountered persons and comparing the spatial positioning information with the location of the guided path, it is determined whether the encountered persons have passed through the virtual portal.

[0175] Step S6225: After the encounter person passes through the virtual portal, the encounter person is marked as the lingering person and a guidance prompt is issued.

[0176] Once the user enters the guided path, the system re-labels them as a lingering user. Once they become a lingering user, the system quickly guides them into the second scene using the same treatment as lingering users. This treatment involves projecting a digital channel into their virtual scene.

[0177] In this embodiment, the guide wall is planned according to the actual length of the guide path. The control method of the guide wall includes the following steps:

[0178] Step S63: determining the path length based on the spatial positioning information of the lingering person, the second scene entrance position, and the guided path.

[0179] The path length is the distance from the person's location to the second scene entrance. The distance between the two points can be calculated based on the person's spatial location information as the starting point, the second scene entrance as the end point, and the guided path as the path.

[0180] Step S630: When the path length is not greater than a preset reference setting length, the number of guide walls is determined according to the path length and a preset guide wall length.

[0181] The reference setting length is a length set by technicians based on the actual number of existing guide walls. The number of existing guide walls can only set the distance of the reference setting length, which will not be elaborated here.

[0182] If the path length is no longer than the baseline setting, the existing guide walls can fully support both sides of the guide path. At this point, the required number of guide walls must be determined. The number of guide walls is the quotient of the path length and the preset guide wall length. The guide wall length is a standard parameter for guide walls and represents the length of a single guide wall. This is not detailed here.

[0183] Step S6300: Based on the number of guide walls and the guide path, the hoisting device is controlled to set the guide walls on both sides of the guide path, and the number of guide walls is counted.

[0184] After determining the required number of guide walls, the system places the required number of guide walls on both sides of the guide path. As people move through the guide path, the overall length of the guide walls needs to change based on their location, so the number of guide walls changes and needs to be counted.

[0185] Step S6301: When the lingering person moves in the digital channel, the real-time moving distance of the lingering person is determined in real time according to the spatial positioning information of the lingering person.

[0186] Real-time travel distance refers to the distance a person moves within a digital channel. This distance can be determined by collecting the person's spatial location information. Initial spatial location information is collected, and then, after a period of time, the next spatial location information is collected. The distance between these two spatial location information is the real-time travel distance.

[0187] Step S6302: When the real-time moving distance is greater than the length of the guide wall, the hoisting device is controlled to lift away from a group of the guide walls, and the count of the number of the guide walls is reduced by one until the count of the number of guide walls is 0.

[0188] If the real-time travel distance exceeds the length of a guide wall, it means the person has passed through a guide wall. At this point, the guide wall needs to be lifted off using a hoist. Once the guide wall is lifted off, the guide wall count decreases by one. By the time the person reaches the entrance to the second scene, they have passed through all guide walls and, therefore, all have been lifted off. The guide wall count is now zero.

[0189] The control method of the guide wall further comprises the following steps:

[0190] Step S631: When the path length is greater than the reference setting length, the setting positions of the guide walls located on both sides of the lingering person and on both sides of the guide path are determined according to the spatial positioning information of the lingering person and the guide path.

[0191] If the path length is longer than the baseline setting length, the existing guide walls are insufficient to fully fill both sides of the guide path. In this embodiment, the system will set up two guide walls on both sides of the lingering person to prevent them from straying, and the guide walls can be moved along the guide path according to the speed of the lingering person.

[0192] The guide wall setting position refers to the setting position of the guide wall on both sides of the staying person. If the position of the staying person changes, the guide wall setting position will also change. The system determines the position on both sides of the staying person by determining the spatial positioning information of the staying person.

[0193] Step S6310: determining the scene-changing speed of the lingering personnel according to the spatial positioning information of the lingering personnel within a unit time.

[0194] The scene change speed is the speed at which the lingering person moves on the guided path. The scene change speed can be determined by determining the amount of change in the spatial positioning information of the lingering person per unit time.

[0195] Step S6311: controlling the hoisting equipment to set the guide wall at the guide wall setting position, and controlling the guide wall to move along the guide path following the lingering personnel according to the scene change speed.

[0196] In this embodiment, since the guide walls need to move synchronously with the resident, the resident's switching speed is equal to the guide wall's movement speed. As the resident moves along the guide path, the system controls the hoisting equipment to move the guide walls at the switching speed, ensuring that the guide walls are always located on both sides of the resident.

[0197] The preparatory method for setting up the barrier wall before the first scenario includes the following steps:

[0198] Before installing the barrier and guide walls in the scene using the hoisting equipment, they must be prepared for placement at the top of the scene room. This allows them to be readily placed in the scene to guide occupants. This embodiment describes the barrier wall preparation method; the guide wall preparation method is the same as the barrier wall preparation method and is not detailed here.

[0199] Step S64: Based on the spatial positioning information of each of the experiencers and the second scene entrance position, the first person and the second person who are farther away from the second scene entrance position are screened out.

[0200] To ensure the barrier wall can be lowered and placed within the scene for isolation at any time, it must be pre-positioned at the top of the scene room to follow the lingering user. Since it's uncertain which user will ultimately become the lingering user, the system uses spatial positioning information to select the two users farthest from the entrance to the second scene. These users are the first and second selected. One of these two users will ultimately become the lingering user.

[0201] Step S640: Determine the middle position of the persons based on the spatial positioning information of the first person and the spatial positioning information of the second person.

[0202] The middle position of the person refers to the middle position between the position of the first person and the position of the second person, which is the center point of the line connecting the two. Based on the spatial positioning information of the first person and the spatial positioning information of the second person, the line connecting the two can be determined, thereby determining the middle position of the person.

[0203] Step S641: Match the sliding setting position of the barrier wall at the top of the scene based on the middle position of the personnel.

[0204] The sliding setting position is the sliding position of the barrier wall at the top of the scene. In this embodiment, the barrier wall is always located above the middle position of the people. When one of the experiencers becomes a lingering person, the barrier wall can approach the lingering person as quickly as possible to guide the lingering person.

[0205] Step S642: updating the middle position of the personnel in real time and controlling the hoisting setting to set the barrier wall at the sliding setting position.

[0206] Since the positions of the first and second persons are always changing, and the position between the persons is also changing, the sliding setting position of the barrier wall at the top of the scene is also changing. The system needs to update the spatial positioning information of the first and second persons in real time to determine the sliding setting position of the barrier wall.

[0207] Based on the same inventive concept, an embodiment of the present invention provides a real-time object interaction system based on augmented reality, including:

[0208] The acquisition module is used to acquire the spatial positioning information of the wearable device and the wearing start time.

[0209] A memory is used to store a program for a real-time object interaction method based on augmented reality.

[0210] The program in the memory can be loaded and executed by the processor to implement a real-time object interaction method based on augmented reality.

[0211] The above description is merely a preferred embodiment of the present invention. The scope of protection of the present invention is not limited to the above embodiment. All technical solutions based on the concept of the present invention are within the scope of protection of the present invention. It should be noted that for those skilled in the art, various improvements and modifications that do not depart from the principles of the present invention should also be considered within the scope of protection of the present invention.

Claims

1. A real-time object interaction method based on augmented reality, characterized in that: include: S1: Prompt the user to wear a preset wearable device, and collect the spatial positioning information of the wearable device and the wearing start time; S2: Sort the experience order of the experiencers based on the wearing start time to obtain an experience serial number; S3: Determine the experience session for the experiencer based on the preset single-session limit number and the experience sequence number; S4: prompting the experiencer to enter a preset first scene according to the experience session, and projecting the preset virtual scene onto the wearable device. After a preset single-scene experience time, prompting the experiencer to enter a preset second scene, and prompting the experiencer of the next experience session to enter the first scene; S5: Determining whether there is an experiencer staying in the first scene based on the spatial positioning information of the wearable device of the experiencer; S6: When there is an experiencer staying in the first scene, mark the experiencer staying in the first scene as a lingering person, and set a preset blocking wall and a preset guiding wall in the first scene using a preset scene guidance method to guide the lingering person to evacuate to the second scene; The scene guidance method includes: S60: Determine the location of the barrier wall based on the spatial positioning information of the resident and a preset distance; S600: Controlling a preset hoisting device to place the barrier wall at the barrier wall setting position to separate the experiencers of the two experience sessions; S601: Generate a guidance path based on the spatial positioning information of the lingering person and a preset second scene entrance position; S602: Controlling the hoisting device to set the guide walls on both sides of the guide path based on the guide path; S603: Creating a digital channel in the virtual scene based on the guide path, projecting the blocking wall and the guide wall onto the virtual scene, and issuing a guidance prompt to guide the lingering person to move along the digital channel; The method for handling the situation in which the experience personnel approach the barrier wall during the evacuation of the lingering personnel in the guide path includes: S61: Determining whether the lingering person has left the first scene based on the spatial positioning information of the lingering person; S610: If the lingering person has left the first scene, control the hoisting device to lift the blocking wall and the guide wall away; S611: If the lingering person has not left the first scene, determine the experiencer closest to the barrier wall based on the location of the barrier wall and the spatial positioning information of the experiencer in the next experience session, and mark the experiencer as an encounter person; S6110: Determine a collision distance based on the spatial positioning information of the encountering persons and the location of the barrier wall; S6111: Based on the collision distance being less than the holding distance, generating a translation path of the barrier wall according to the spatial positioning information of the lingering person and the guiding path; S6112: Control the hoisting device to translate the barrier wall along the translation path at a preset translation speed, and control the hoisting device to lift the guide walls on both sides of the translation path away; The virtual scene has different experience mode types, including viewing mode and plot mode. The method for handling the encounter person approaching the barrier wall under different experience mode types further includes: S62: Determine the moving speed of the encountered person based on the spatial positioning information of the encountered person within a preset unit time; S620: When the moving speed of the encountering person is greater than the translation speed of the barrier wall, matching the experience mode type based on a preset experience reservation item; S621: Based on the scenario mode, controlling a preset inflation device to inflate an air cushion preset on the barrier wall, and determining whether the spatial positioning information of the encountering person overlaps with the position of the barrier wall in the virtual scene; S6210: When the spatial positioning information of the encountering person overlaps with the position of the blocking wall in the virtual scene, issuing a collision warning; S622: Based on the viewing mode, two options are provided to the encountering person to control the barrier wall using a preset selection control method.

2. The method for real-time object interaction based on augmented reality according to claim 1, characterized in that: Also includes: S6220: In the viewing mode, determining the number of the encountered persons based on the spatial positioning information of the encountered persons; S62200: When the number of the encountering persons is 1, providing the encountering person with two options for controlling the barrier wall using the selection control method; S62201: When the number of the encountered persons is not 1, determining the number of splits of the blocking wall based on the number of the encountered persons; S622010: Determine a separate setting position of each of the barrier walls based on the spatial positioning information of each of the encountered persons; S622011: controlling the barrier wall to split according to the number of splits of the barrier wall, and setting each of the split barrier walls at a separate setting position; S622012: Control the inflation device to inflate the air cushion of each barrier wall to block each of the encountering persons.

3. The method for real-time object interaction based on augmented reality according to claim 1, characterized in that: Select control methods include: S6221: Projecting preset scene selection items in the virtual scene of the encounter person, and collecting the movement posture of the encounter person; S6222: When the motion posture is consistent with the preset reference posture, controlling the inflation device to inflate the air cushion on the barrier wall, and issuing a collision warning when the spatial positioning information of the encountering person overlaps with the position of the barrier wall in the virtual scene; S6223: When the action posture is inconsistent with the reference posture, controlling the barrier wall to split in the middle to form a channel feature, and generating a virtual portal at the location of the barrier wall in the virtual scene of the encountering person; S6224: Determine whether the encountered person passes through the virtual portal based on the spatial positioning information of the encountered person and the guided path; S6225: After the encounter person passes through the virtual portal, the encounter person is marked as the lingering person and a guidance prompt is issued.

4. The method for real-time object interaction based on augmented reality according to claim 1, characterized in that: The control method of the guide wall includes: S63: Determine the path length based on the spatial positioning information of the lingering person, the second scene entrance position, and the guided path; S630: When the path length is not greater than a preset reference setting length, determining the number of guide walls according to the path length and a preset guide wall length; S6300: Controlling the hoisting device to set the guide walls on both sides of the guide path based on the number of guide walls and the guide path, and counting the number of guide walls; S6301: When the lingering person moves in the digital channel, the real-time moving distance of the lingering person is determined in real time according to the spatial positioning information of the lingering person; S6302: When the real-time moving distance is greater than the length of the guide wall, control the lifting device to lift away from a group of the guide walls, and reduce the count of the number of the guide walls by one until the count of the number of guide walls reaches 0.

5. The method for real-time object interaction based on augmented reality according to claim 4, characterized in that: Also includes: S631: When the path length is greater than the reference setting length, determining the setting positions of guide walls located on both sides of the lingering person and on both sides of the guide path according to the spatial positioning information of the lingering person and the guide path; S6310: Determine a change speed of the lingering personnel according to the spatial positioning information of the lingering personnel within a unit time; S6311: Control the hoisting equipment to set the guide wall at the guide wall setting position, and control the guide wall to move along the guide path following the lingering personnel according to the scene change speed.

6. The method for real-time object interaction based on augmented reality according to claim 1, characterized in that: The preparatory method for setting the barrier wall before the first scene includes: S64: Filtering out the first person and the second person who are farther away from the second scene entrance location based on the spatial positioning information of each of the experiencers and the second scene entrance location; S640: Determine a middle position of the persons based on the spatial positioning information of the first person and the spatial positioning information of the second person; S641: Matching the sliding setting position of the barrier wall at the top of the scene based on the middle position of the personnel; S642: updating the middle position of the personnel in real time and controlling the hoisting setting to set the barrier wall at the sliding setting position.

7. A real-time object interaction system based on augmented reality, characterized in that: include: An acquisition module, configured to acquire spatial positioning information of the wearable device and a wearing start time; A memory for storing a program of a real-time object interaction method based on augmented reality according to any one of claims 1 to 6; The program in the memory can be loaded and executed by the processor to implement a real-time object interaction method based on augmented reality.

Images