Real-time object interaction method and system based on expanded reality

Abstract

The invention relates to a real-time object interaction method and system based on expanded reality, and relates to the field of expanded reality, and the method comprises the steps: prompting an experiencer to wear a preset wearing device, and collecting the spatial positioning information and wearing starting time of the wearing device; sorting the experience sequence of the experiencer based on the wearing starting time to obtain an experience sequence number; determining an experience session of the experiencer based on the single-session limited number of people and the experience serial number; prompting the experiencer to enter a first scene according to the experience session, projecting a virtual scene to the wearable device, prompting the experiencer to enter a second scene after the single-scene experience time, and prompting the experiencer of the next experience session to enter the first scene; and when the experiencer stays in the first scene, marking the experiencer staying in the first scene as a staying person, and setting a barrier wall and a guide wall in the first scene to guide the staying person to evacuate to the second scene. The method has the effect of improving the experience efficiency of players.

Description

Technical Field

[0001] The present invention relates to the field of extended reality, and in particular, to a real-time object interaction method and system based on extended reality. Background Art

[0002] Extended reality encompasses all technologies that integrate the real world with virtual environments, including immersive technologies such as virtual reality, augmented reality, and mixed reality. Its goal is to expand the way humans perceive and interact with reality through technological means and create richer experiences.

[0003] Existing commercial extended reality experience activities are usually carried out in a relatively large set room. By setting the virtual world to the same scale as the real room and dividing it into multiple scenes, players can perform real-time object interactions in the scenes and interact and cross between adjacent scenes. Due to the limited space of each scene, players need to enter the experience in batches when carrying out extended reality experience activities, and usually the next batch of players can start their experience activities only after the previous batch of players have completed their experiences. Players need to wait for a long time, and the experience efficiency is low. Summary of the Invention

[0004] In order to improve the experience efficiency of players, the present invention provides a real-time object interaction method and system based on extended reality.

[0005] In a first aspect, the present invention provides a real-time object interaction method based on extended reality, adopting the following technical solution: A real-time object interaction method based on extended reality, comprising: S1: Prompting the experience personnel to wear a preset wearable device, and collecting the spatial positioning information and the wearing start time of the wearable device; S2: Sorting the experience order of the experience personnel based on the wearing start time to obtain an experience serial number; S3: Determining the experience session of the experience personnel based on a preset maximum number of people per session and the experience serial number; S4: Prompting the experience personnel to enter a preset first scene according to the experience session, and projecting a preset virtual scene onto the wearable device. After a preset single-scene experience time, prompting the experience personnel to enter a preset second scene, and prompting the experience personnel of the next experience session to enter the first scene; S5: Determining whether there is any experience personnel staying in the first scene based on the spatial positioning information of the wearable device of the experience personnel; S6: When there are experience personnel staying in the first scene, mark the experience personnel staying in the first scene as staying personnel, and set a preset barrier wall and a preset guiding wall in the first scene with a preset scene guiding method to guide the staying personnel to evacuate to the second scene.

[0006] By adopting the above technical solution, when the experience personnel in the previous session are about to complete the experience activity of the current scene, the system will arrange in advance for the experience personnel in the next session to enter the venue for experience; and when there are staying experience personnel in the previous session, in order to prevent the personnel in the two sessions from meeting, the system sets a barrier wall and a guiding wall between the experience personnel in the two sessions, so as to guide the staying personnel in the previous session to leave the venue and prevent the experience personnel in the two sessions from meeting, thus greatly improving the experience efficiency of players.

[0007] Optionally, the scene guiding method includes: S60: Determine the position for setting the barrier wall based on the spatial positioning information of the staying personnel and a preset distance to be maintained; S600: Control a preset hoisting device to set the barrier wall at the position for setting the barrier wall to separate the experience personnel in the two experience sessions; S601: Generate a guiding path based on the spatial positioning information of the staying personnel and the preset position of the entrance to the second scene; S602: Control the hoisting device to set the guiding wall on both sides of the guiding path based on the guiding path; S603: Create a digital passage in the virtual scene based on the guiding path, project the barrier wall and the guiding wall onto the virtual scene, and issue a guiding prompt to guide the staying personnel to move along the digital passage.

[0008] Optionally, the processing method for the situation where there are experience personnel approaching the barrier wall during the process of the staying personnel evacuating in the guiding path includes: S61: Determine whether the staying personnel have left the first scene based on the spatial positioning information of the staying personnel; S610: If the staying personnel have left the first scene, control the hoisting device to lift the barrier wall and the guiding wall; S611: If the staying personnel have not left the first scene yet, determine the experience personnel closest to the barrier wall based on the position for setting the barrier wall and the spatial positioning information of the experience personnel in the next experience session, and mark them as meeting personnel; S6110: Determine the collision distance based on the spatial positioning information of the meeting personnel and the position for setting the barrier wall; S6111: Based on the collision distance being less than the holding distance, generate a translation path for the barrier wall according to the spatial positioning information of the staying personnel and the guiding path; S6112: Control the hoisting device to translate the barrier wall along the translation path at a preset translation speed, and control the hoisting device to lift the guiding walls on both sides of the translation path.

[0009] Optionally, the virtual scene has different experience mode types, and the experience mode types include an ornamental mode and a plot mode. The processing methods for the meeting personnel approaching the barrier wall under different experience mode types further include: S62: Determine the moving speed of the meeting personnel based on the spatial positioning information of the meeting personnel within a preset unit time; S620: When the moving speed of the meeting personnel is greater than the translation speed of the barrier wall, match the experience reservation item with the experience mode type based on a preset; S621: Based on the plot mode, control a preset inflating device to inflate the air cushion preset on the barrier wall, and determine whether the spatial positioning information of the meeting personnel overlaps with the position of the barrier wall in the virtual scene; S6210: When the spatial positioning information of the meeting personnel overlaps with the position of the barrier wall in the virtual scene, issue a collision warning; S622: Based on the ornamental mode, provide two options for the meeting personnel to control the barrier wall by a preset selection control method.

[0010] Optionally, it further includes: S6220: In the ornamental mode, determine the number of the meeting personnel based on the spatial positioning information of the meeting personnel; S62200: When the number of the meeting personnel is 1, provide two options for the meeting personnel to control the barrier wall by the selection control method; S62201: When the number of the meeting personnel is not 1, determine the splitting number of the barrier wall based on the number of the meeting personnel; S622010: Determine the individual setting positions of each barrier wall based on the spatial positioning information of each meeting personnel; S622011: Control the barrier wall to split according to the splitting number of the barrier wall, and respectively set each split barrier wall at the individual setting position; S622012: Control the inflating device to inflate the air cushion of each barrier wall to block each meeting personnel.

[0011] Optionally, the selection control method includes: S6221: Project a preset scene selection item in the virtual scene of the encountering personnel, and collect the action postures of the encountering personnel; S6222: When the action posture is consistent with the preset reference posture, control the inflation device to inflate the air cushion on the barrier wall, and issue a collision warning when the spatial positioning information of the encountering personnel overlaps with the position of the barrier wall in the virtual scene; S6223: When the action posture is inconsistent with the reference posture, control the barrier wall to split from the middle to form a passage feature, and generate a virtual portal at the position of the barrier wall in the virtual scene of the encountering personnel; S6224: Determine whether the encountering personnel pass through the virtual portal based on the spatial positioning information of the encountering personnel and the guiding path; S6225: After the encountering personnel pass through the virtual portal, mark the encountering personnel as the staying personnel and issue a guiding prompt.

[0012] Optionally, the control method of the guiding wall includes: S63: Determine the path length based on the spatial positioning information of the staying personnel, the position of the second scene entrance, and the guiding path; S630: When the path length is not greater than the preset reference setting length, determine the number of guiding walls according to the path length and the preset guiding wall length; S6300: Based on the number of guiding walls and the guiding path, control the hoisting device to set the guiding walls on both sides of the guiding path, and count the number of guiding walls; S6301: When the staying personnel move in the digital passage, determine the real-time moving distance of the staying personnel in real time according to the spatial positioning information of the staying personnel; S6302: When the real-time moving distance is greater than the guiding wall length, control the hoisting device to lift off a group of guiding walls, and subtract one from the count of the number of guiding walls until the count of the number of guiding walls is 0.

[0013] Optionally, it further includes: S631: When the path length is greater than the reference setting length, determine the guiding wall setting positions on both sides of the staying personnel and on both sides of the guiding path according to the spatial positioning information of the staying personnel and the guiding path; S6310: Determine the scene change speed of the staying personnel within a unit time according to the spatial positioning information of the staying personnel; S6311: Control the hoisting device to set the guiding wall at the guiding wall setting position, and control the guiding wall to move along the guiding path following the staying personnel according to the changeover speed.

[0014] Optionally, the method for preparing the barrier wall before the first scene includes: Based on the spatial positioning information of each of the experiencing personnel and the position of the second scene entrance, filter out the first person and the second person who are far from the second scene entrance; S64: Determine the intermediate position of the personnel based on the spatial positioning information of the first person and the spatial positioning information of the second person; S640: Match the barrier wall to the sliding setting position at the top of the scene based on the intermediate position of the personnel; S641: Update the intermediate position of the personnel in real time and control the hoisting device to set the barrier wall at the sliding setting position.

[0015] In a second aspect, the present application provides a real-time object interaction system based on augmented reality, adopting the following technical solutions: A real-time object interaction system based on augmented reality, comprising: An acquisition module, configured to acquire the spatial positioning information of the wearable device and the starting time of wearing; A memory, configured to store a program of a real-time object interaction method based on augmented reality; A processor, the program in the memory can be loaded and executed by the processor and implement a real-time object interaction method based on augmented reality.

[0016] In summary, the present application includes at least one of the following beneficial technical effects: 1. When the experiencing personnel in the previous session are about to complete the experience activity of the current scene, the system will arrange the experiencing personnel in the next session to enter the venue for experience in advance; and when there are staying experiencing personnel in the previous session, in order to prevent the personnel in the two sessions from meeting, the system sets a barrier wall and a guiding wall between the experiencing personnel in the two sessions, so as to guide the staying personnel in the previous session to leave the venue and prevent the experiencing personnel in the two sessions from meeting, thereby greatly improving the experience efficiency of the players; 2. The system will set up a partition wall between the lingering personnel and the experience personnel of the next session, so that the lingering personnel can only move forward to enter the second scene and cannot move backward to meet the experience personnel of the next session. And to assist the lingering personnel to leave quickly, the system will generate a guiding path between the lingering personnel and the entrance of the second scene and set up guiding walls on both sides of the guiding path so that the lingering personnel can only move along the guiding path. And in the virtual world of the lingering personnel, the system will project a digital passage exclusive to the lingering personnel, and the lingering personnel can quickly enter the second scene along the digital passage under the guidance of the system. 3. When the moving speed of the meeting personnel is greater than the translation speed of the partition wall, the system will control the partition wall according to different experience modes. If it is in the plot mode, in order to make the plot experience of the meeting personnel complete, the system will inflate the air cushion on the partition wall so that the meeting personnel are not easily injured even if they touch the partition wall. And the system will generate a virtual partition wall in the virtual world of the meeting personnel to remind the meeting personnel that there is a partition wall ahead. In the viewing mode, the meeting personnel can choose to directly enter the second scene or stay in the first scene to wait for other experience personnel in the same session. If they choose to wait, the system will control the partition wall using the control method of the partition wall in the plot mode. And if they choose to enter the second scene, the meeting personnel can be reclassified into the experience personnel of the previous session and become lingering personnel. At this time, the system will control the partition wall to split from the middle to form the channel characteristics of the entrance guiding path, so that the meeting personnel can quickly enter the second scene through the guiding path. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 is the flowchart of a method for real-time object interaction based on extended reality according to an embodiment of the present invention; Figure 2 is the flowchart of the scene guiding method according to an embodiment of the present invention; Figure 3 is the flowchart of the processing method for experience personnel approaching the partition wall according to an embodiment of the present invention; Figure 4 is the flowchart of the processing method for experience personnel approaching the partition wall under different types of the experience modes according to an embodiment of the present invention Figure 1 ; Figure 5 is the flowchart of the processing method for experience personnel approaching the partition wall under different types of the experience modes according to an embodiment of the present invention Figure 2 ; Figure 6 is the flowchart of the selection control method according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0018] To make the objectives, technical solutions and advantages of the present invention more clearly understood, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0019] An embodiment of the present application discloses a real-time object interaction method based on extended reality.

[0020] Refer to Figure 1 , a real-time object interaction method based on extended reality includes the following steps: Step S1: Prompt the experience personnel to wear a preset wearable device, and collect the spatial positioning information and the wearing start time of the wearable device.

[0021] Before the experience personnel carry out the extended reality experience activity, they need to wear the wearable device under the prompt of the system first. In this embodiment, the wearable device is a VR helmet, and there is a display device at the position corresponding to the eyes of the experience personnel in the VR helmet. The system can project the virtual picture onto the display device, and the experience personnel can view the picture of the virtual world through the display device of the wearable device, so as to carry out the extended reality experience activity.

[0022] The spatial positioning information refers to the position of the wearable device in the room, which is also equivalent to the position of the experience personnel. There is a positioning chip in the wearable device, and the system can read the spatial positioning information from the positioning chip. Subsequently, during the experience activity, the experience personnel need to collect the spatial positioning information of the wearable device to determine their position in the room.

[0023] The wearing start time refers to the time point when the experience personnel put on the wearable device. When the experience personnel put on the wearable device, the system can collect the wearing start time from the built-in clock of the wearable device. Subsequently, the system needs to divide the experience sequence of the experience personnel according to the wearing start time.

[0024] Step S2: Sort the experience sequence of the experience personnel based on the wearing start time to obtain an experience serial number.

[0025] The experience serial number refers to the experience sequence of the experience personnel carrying out the extended reality experience activity. The experience serial number is sorted according to the wearing start time. The earlier the sorting, the less the experience waiting time.

[0026] Step S3: Determine the experience session of the experience personnel based on the preset maximum number of people per session and the experience serial number.

[0027] The maximum number of people per session is a value set by the technical personnel according to the size of the room scene. Each scene can accommodate a certain number of experience personnel. After exceeding this number, the scene will be too crowded and affect the experience. This will not be elaborated here.

[0028] There are many sessions of the extended reality experience activity. After completing one session, the next session is carried out. The experience session refers to the specific session of the extended reality experience activity that the experience personnel can participate in.

[0029] In this embodiment, all the experience personnel are divided according to the experience serial numbers, and the experience serial numbers included in each experience session are determined according to the limited number of people per session. For example, if there are 100 experience serial numbers and the limited number of people per session is 20, then these 100 people are divided into 5 sessions, with 20 people in each session. The earlier the experience serial number, the earlier the session it is assigned to.

[0030] Step S4: Prompt the experience personnel to enter the preset first scene according to the experience session, and project the preset virtual scene onto the wearable device. After the preset single-scene experience time, prompt the experience personnel to enter the preset second scene, and prompt the experience personnel of the next experience session to enter the first scene.

[0031] The extended reality experience activity has multiple experience scenes. In this embodiment, there are two scenes, namely the first scene and the second scene. Passing through the first scene is the second scene. After completing the experience of the first scene, the experience personnel can proceed to the second scene. The number of experience scenes can also be greater than 2, and the experience method is the same, which will not be elaborated here.

[0032] To ensure the experience efficiency of the extended reality experience activity, the time that each experience personnel can stay in a scene is limited. The single-scene experience time refers to the time that the experience personnel can experience and stay in a scene. After the single-scene experience time, the experience personnel need to enter the next scene. And after the single-scene experience time, the experience personnel of the next experience session also start to enter the scene for experience.

[0033] Step S5: Determine whether there are experience personnel staying in the first scene based on the spatial positioning information of the wearable device of the experience personnel.

[0034] The time that each experience personnel stays in a scene depends on personal preference. Most experience personnel enter the next experience scene after the single-scene experience time. It is also possible that some experience personnel like the current scene and continue to stay in the current scene after the single-scene experience time. By analyzing the spatial positioning information of the wearable device of the experience personnel, it is determined whether the positioning position of the experience personnel is within the range of the current scene, so as to determine whether there are experience personnel staying in the first scene.

[0035] Step S6: When there are experience personnel staying in the first scenario, mark the experience personnel staying in the first scenario as staying personnel, and set a preset barrier wall and a preset guiding wall in the first scenario by using a preset scenario guiding method to guide the staying personnel to evacuate to the second scenario.

[0036] After the single-scenario experience time, when there are experience personnel staying in the first scenario, the system will automatically locate the experience personnel and mark them as staying personnel. In order to prevent the staying personnel from meeting the experience personnel in the next experience session, the system will use a scenario guiding method to guide the staying personnel into the second scenario. In this embodiment, the system will set a barrier wall in the first scenario to block the staying personnel from retreating and to prevent the experience personnel in the next experience session from approaching, and the system will set a guiding wall in the first scenario to guide the staying personnel. The specific scenario guiding method will not be elaborated here and will be introduced in detail in subsequent embodiments.

[0037] Refer to Figure 2 , the scenario guiding method includes the following steps: In this embodiment, a barrier wall is set between the staying personnel and the experience personnel in the next experience session to prevent the staying personnel from running in the wrong direction, and a guiding wall is set between the staying personnel and the entrance of the second scenario to form a path along which the staying personnel can move.

[0038] Step S60: Determine the barrier wall setting position based on the spatial positioning information of the staying personnel and a preset distance to be maintained.

[0039] The distance to be maintained is the distance that needs to be maintained from the staying personnel when the technical personnel set the barrier wall to ensure that the staying personnel are not easily injured when setting the barrier wall.

[0040] By obtaining the real-time spatial positioning information of the staying personnel, and then extending the distance to be maintained from the position of the spatial positioning information in the direction of the experience personnel in the next experience session, the position obtained at this time is the barrier wall setting position. The barrier wall is set between the staying personnel and the experience personnel in the next experience session, and can separate the staying personnel from the experience personnel in the next experience session.

[0041] Step S600: Control a preset hoisting device to set the barrier wall at the barrier wall setting position to separate the experience personnel in the two experience sessions.

[0042] The hoisting device is set on the top of the room for hoisting the barrier wall and the guiding wall so that the barrier wall and the guiding wall can be set in the room.

[0043] After the installation position of the partition wall is determined, the hoisting device can lower the partition wall pre-prepared at the top of the room and install it at the installation position of the partition wall, so that the staying personnel cannot retreat but can only move forward into the next scene.

[0044] Step S601: Generate a guiding path based on the spatial positioning information of the staying personnel and the preset second scene entrance position.

[0045] The guiding path refers to the route that the staying personnel need to move along to evacuate into the second scene.

[0046] The second scene entrance position is a fixed position point in the room and will not be elaborated here.

[0047] After the spatial positioning information of the staying personnel is determined, the system can determine the shortest route between the current position of the staying personnel and the second scene entrance position, and the staying personnel can move along this shortest route.

[0048] Step S602: Control the hoisting device to install the guiding wall on both sides of the guiding path based on the guiding path.

[0049] To ensure that the staying personnel can quickly move along the guiding path to the second scene entrance position, the system will set guiding walls on both sides of the guiding path to prevent the staying personnel from deviating. Since the route of the guiding path has been determined, the installation positions of the guiding walls on both sides of the guiding path can also be determined.

[0050] Step S603: Create a digital passage in the virtual scene based on the guiding path, project the partition wall and the guiding wall onto the virtual scene, and issue guiding prompts to guide the staying personnel to move along the digital passage.

[0051] The partition wall, the guiding wall, and the guiding path in the above method are all set by the system in the real world, and the system will also guide in the virtual world.

[0052] In this embodiment, in order to enable the staying personnel to concentrate on entering the second scene without being nostalgic for the first scene, the system will generate a digital passage in the virtual scene. The digital passage is a scene picture generated by the system for the staying personnel to quickly enter the second scene, and there are no other experiencing personnel in this digital passage.

[0053] The digital passage is a passage generated by the system by restoring the guiding path in the real world one-to-one. This passage will be presented in the virtual scene. The staying personnel can see the digital passage and move along the digital passage under the guiding prompts of the system. When the staying personnel move along the digital passage, in reality, the staying personnel will move along the guiding path.

[0054] Refer toFigure 3 When a visitor is evacuating along the guiding path and an experience participant approaches the barrier wall, the processing method includes the following steps: Step S61: Determine whether the visitor has left the first scene based on the spatial positioning information of the visitor.

[0055] By obtaining the spatial positioning information of the visitor and comparing it with the room range of the second scene, if they are the same, it means the visitor has left the first scene; otherwise, it means the visitor has not left.

[0056] When an experience participant of the next experience session approaches the barrier wall, whether the visitor has left the current scene will affect the system's control of the barrier wall and the guiding wall. Therefore, a judgment needs to be made first.

[0057] Step S610: If the visitor has left the first scene, control the hoisting device to lift the barrier wall and the guiding wall.

[0058] If the visitor has left the first scene, the barrier wall and the guiding wall have lost their functions. At this time, when an experience participant of the next experience session approaches the barrier wall, the system will directly remove the barrier wall and the guiding wall, so that there are no barrier wall and guiding wall in the room where the first scene is located to interfere with the experience participants of the next experience session.

[0059] Step S611: If the visitor has not left the first scene, determine the experience participant closest to the barrier wall based on the installation position of the barrier wall and the spatial positioning information of the experience participant of the next experience session, and mark this person as the encountering person.

[0060] If the visitor has not left the first scene, the system cannot directly remove the barrier wall and the guiding wall. Therefore, at this time, the visitor may be evacuating along the guiding path.

[0061] In this embodiment, the system will obtain the spatial positioning information of each experience participant of the next experience session and compare it with the position of the barrier wall, so as to determine the experience participant closest to the barrier wall among the experience participants of the next experience session. This experience participant is the encountering person, and the encountering person is the one most likely to collide with the barrier wall.

[0062] After finding the encountering person, the system will process the relationship between the encountering person and the barrier wall.

[0063] Step S6110: Determine the collision distance based on the spatial positioning information of the encountering person and the installation position of the barrier wall.

[0064] The collision distance refers to the distance between the meeting personnel and the barrier wall, and the collision distance can be calculated based on the spatial positioning information of the meeting personnel and the set position of the barrier wall.

[0065] Step S6111: Based on the collision distance being less than the holding distance, generate a translation path of the barrier wall according to the spatial positioning information of the staying personnel and the guiding path.

[0066] In this embodiment, in order to prevent the meeting personnel from easily colliding with the barrier wall, the system will translate the barrier wall along the guiding path through a hoisting device. The translation path is the path when the barrier wall moves on the guiding path, and the translation path is generated according to the spatial positioning information of the staying personnel and the guiding path, and the translation path coincides with the guiding path. When the staying personnel move along the guiding path, a space will be formed between the staying personnel and the barrier wall, and this space can be used for the barrier wall to move, which is equivalent to the barrier wall moving synchronously when the staying personnel move.

[0067] When the collision distance between the meeting personnel and the barrier wall is less than the holding distance, it indicates that the meeting personnel are about to hit the barrier wall. At this time, the system controls the movement of the barrier wall to maintain a distance from the meeting personnel.

[0068] Step S6112: Control the hoisting device to translate the barrier wall along the translation path at a preset translation speed, and control the hoisting device to lift the guiding walls on both sides of the translation path.

[0069] The translation speed is the movement speed set by the technician when the system controls the movement of the barrier wall, which will not be elaborated here.

[0070] When the barrier wall needs to move, the system controls the barrier wall to move along the translation path at the translation speed through the hoisting device. And during the movement of the barrier wall, in order to prevent the guiding wall from easily affecting the movement of the barrier wall, the system will lift the guiding wall through the hoisting device.

[0071] Refer to Figure 4 , the virtual scene has different experience mode types, and the experience mode types include the viewing mode and the plot mode. In the viewing mode, the main activity of the experience personnel is to view the picture, and in the plot mode, the main activity of the experience personnel is to experience the plot. The processing methods for the meeting personnel approaching the barrier wall are different under different experience modes. The processing methods for the meeting personnel approaching the barrier wall under different experience mode types also include the following steps: Step S62: Determine the movement speed of the meeting personnel based on the spatial positioning information of the meeting personnel within a preset unit time.

[0072] The unit time is the time interval set by the technician to determine the moving speed of the experiencer. By repeatedly acquiring the spatial positioning information of the encounter person within the unit time, the position change of the spatial positioning information is obtained, and then the moving speed of the encounter person can be calculated by the position change and the unit time.

[0073] Step S620: When the moving speed of the encountering person is greater than the translation speed of the blocking wall, the experience mode type is matched based on a preset experience reservation item.

[0074] The experience reservation project is the parameters of the scene that have been determined before the experiencer has experienced it. The experience reservation project can be used to determine the experience mode type of the current experiencer, including viewing mode and plot mode.

[0075] If the moving speed of the encountering persons is not greater than the translation speed of the blocking wall, the encountering persons will not encounter the blocking wall, and there is no need to operate the blocking wall at this time.

[0076] If the moving speed of the encountering person is greater than the translation speed of the barrier wall, it means that the encountering person will definitely encounter the barrier wall. When the two meet, the system will control the barrier wall in a targeted manner according to different experience mode types.

[0077] Step S621: Based on the plot mode, control the preset inflation device to inflate the air cushion preset in the barrier wall, and determine whether the spatial positioning information of the encounter person overlaps with the position of the barrier wall in the virtual scene.

[0078] In this embodiment, an air cushion is provided on the barrier wall, and the air cushion can be inflated by an inflation device provided in the barrier wall. Even if the encountering persons collide with the barrier wall, the encountering persons are not easily injured due to the cushioning of the air cushion.

[0079] In the plot mode, the encountering personnel need to experience the complete scene plot, so the encountering personnel cannot leave the room of the current scene. When the encountering personnel are about to collide with the barrier wall, the system will control the inflating device to inflate the air cushion. The system determines whether the encountering personnel will collide with the barrier wall in the real world by judging whether the spatial positioning information of the encountering personnel in the virtual world overlaps with the position of the barrier wall.

[0080] Step S6210: When the spatial positioning information of the encountering person overlaps with the position of the blocking wall in the virtual scene, a collision warning is issued.

[0081] If the spatial positioning information of the encountering persons overlaps with the position of the blocking wall in the virtual scene, it means that the encountering persons have collided with the blocking wall, and the system will issue a collision warning.

[0082] Step S622: Based on the viewing mode, provide two options for the encountering personnel to control the barrier wall using a preset selection control method.

[0083] In the viewing mode, the encountering personnel can choose to continue viewing the current scene image or choose to enter the second scene in advance. The system will give the encountering personnel the right to choose using the selection control method. Different choices of the encountering personnel will affect the system's control of the barrier wall. The selection control method will not be elaborated here and will be specifically introduced in subsequent embodiments.

[0084] Refer to Figure 5 , in this embodiment, in the viewing mode, whether the system gives the encountering personnel the right to choose to enter the next scene is determined by the number of the encountering personnel. The processing methods for encountering personnel with different numbers when approaching the barrier wall include the following steps: Step S6220: In the viewing mode, determine the number of the encountering personnel based on the spatial positioning information of the encountering personnel.

[0085] The number of the encountering personnel refers to the number of encountering personnel approaching the barrier wall simultaneously at the same time. The system compares and analyzes the spatial positioning information of all the encountering personnel with the set position of the barrier wall, screens out all the encountering personnel relatively close to the barrier wall, and then counts all the encountering personnel to obtain the number of personnel.

[0086] Step S62200: When the number of the encountering personnel is 1, provide two options for the encountering personnel to control the barrier wall using the selection control method.

[0087] If there is 1 encountering personnel, it means that only 1 experiencing personnel is approaching the barrier wall. At this time, the system will provide the option to choose to enter the next scene in advance and control the barrier wall.

[0088] Step S62201: When the number of the encountering personnel is not 1, determine the splitting number of the barrier wall based on the number of the encountering personnel.

[0089] If the number of the encountering personnel is not 1, it means that the number of the encountering personnel is more than 1. At this time, the system needs to control the barrier wall to block each encountering personnel. In the embodiment, the barrier wall is formed by combining multiple units and can split and be controlled individually. The splitting number refers to the number generated after the barrier wall splits. The splitting number of the barrier wall is determined by the number of the encountering personnel and corresponds one by one.

[0090] Step S622010: Determine the individual setting position of each barrier wall based on the spatial positioning information of each encountering personnel.

[0091] The individual setting position refers to the setting position of each split barrier wall when blocking the corresponding meeting personnel. The individual setting position is determined according to the spatial positioning information of the meeting personnel.

[0092] The principle for an experience personnel to be marked as a meeting personnel is that the experience personnel is relatively close to the barrier wall. When there are multiple meeting personnel, since the position of the barrier wall before splitting is unique, the distance between the meeting personnel will not be far apart. Therefore, the distance between each split barrier wall will not be far apart, and they can still be uniformly controlled by the hoisting equipment.

[0093] Step S622011: Control the barrier wall to split according to the number of splits of the barrier wall, and respectively set each split barrier wall at the individual setting position.

[0094] When there are multiple meeting personnel, the system will control the hoisting equipment to split the barrier wall. The number of splits of the barrier wall corresponds to the number of meeting personnel, and the system controls the position of each split barrier wall according to the position of each meeting personnel.

[0095] Step S622012: Control the inflation device to inflate the air cushions of each barrier wall to block each meeting personnel.

[0096] In this embodiment, when there are multiple meeting personnel, due to the large number of personnel, the system no longer provides the option to advance to the next scenario in advance, but blocks each meeting personnel by inflating the air cushions of the barrier wall.

[0097] Refer to Figure 6 , the selection control method includes the following steps: Step S6221: Project a preset scenario selection item in the virtual scenario of the meeting personnel, and collect the action postures of the meeting personnel.

[0098] The scenario selection item is an option screen that can interact with the experience personnel in the virtual scenario for the experience personnel to select. In the viewing mode, if the meeting personnel is about to collide with the barrier wall, the system will generate a scenario selection item in the virtual scenario screen of the meeting personnel.

[0099] The action posture of the meeting personnel refers to the posture and movement of the experience personnel obtained through the cameras set in the room. Specific posture and movements can have different interaction meanings in the scenario screen of the virtual world for interacting with the scenario selection item.

[0100] Step S6222: When the action posture is consistent with the preset reference posture, control the inflation device to inflate the air cushions on the barrier wall, and issue a collision warning when the spatial positioning information of the meeting personnel overlaps with the position of the barrier wall in the virtual scenario.

[0101] The reference posture is a posture action in the scene picture of the virtual world set by the technical personnel, which is used to interact with the scene selection item. The reference posture represents that the experience personnel reject the option given by the system, and will not be elaborated here.

[0102] In this embodiment, the scene selection item has two selection items, agree or reject. Selecting any one of them, the system will react according to the selection result of the experience personnel.

[0103] When the scene selection item appears, the encountering personnel make corresponding action postures. If the camera detects that the action posture of the encountering personnel is the same as the reference posture, it means that the experience personnel have selected to reject in the scene selection item of the scene picture. After selecting to reject, the encountering personnel can continue to stay in the first scene to continue the experience. At this time, the control method and steps of the barrier wall are the same as those in step S621 and step S6210, and will not be elaborated here.

[0104] Step S6223: When the action posture is inconsistent with the reference posture, control the barrier wall to split from the middle to form a channel feature, and generate a virtual portal at the position of the barrier wall in the virtual scene of the encountering personnel.

[0105] If the camera detects that the action posture of the encountering personnel is inconsistent with the reference posture, it means that the experience personnel have selected to agree. After selecting to agree, the system determines that the encountering personnel agree to enter the second scene in advance.

[0106] In this embodiment, when the experience personnel select to agree to advance to the second scene, the system can control the barrier wall to split from the middle to form a channel feature. The channel feature refers to a channel in the barrier wall through which the experience personnel can pass.

[0107] In the case where the encountering personnel select to agree, when the encountering personnel approach the barrier wall, the system will control the hoisting equipment to open the barrier wall, so as to generate a channel for the encountering personnel to pass through and enter the guiding path.

[0108] And correspondingly, a virtual portal will also be generated at the corresponding position of the barrier wall in the virtual scene of the encountering personnel. The virtual portal is a feature in the virtual scene set by the technical personnel. When the experience personnel interact with the virtual portal, they can pass through the virtual portal.

[0109] Step S6224: Determine whether the encountering personnel pass through the virtual portal based on the spatial positioning information of the encountering personnel and the guiding path.

[0110] By collecting the spatial positioning information of the encountering personnel and comparing the spatial positioning information with the position where the guiding path is located, it is determined whether the encountering personnel have passed through the virtual portal.

[0111] Step S6225: After the encountered person passes through the virtual portal, mark the encountered person as the staying person and issue a guiding prompt.

[0112] When the encountered person enters the guiding path, the system will re-mark the encountered person and define them as the staying person. After becoming the staying person, the system guides the experiencing person to quickly enter the second scene using the processing method for the staying person. The processing method for the staying person is to project a digital passage in the virtual scene of the experiencing person.

[0113] In this embodiment, the guiding wall will be planned according to the actual length of the guiding path. The control method of the guiding wall includes the following steps: Step S63: Determine the path length based on the spatial positioning information of the staying person, the position of the second scene entrance, and the guiding path.

[0114] The path length is the distance length of the guiding path from the position where the staying person is located to the position of the second scene entrance. Taking the position of the spatial positioning information of the staying person as the starting point, the position of the second scene entrance as the end point, and the guiding path as the path, the distance between the two points can be calculated based on these three parameters.

[0115] Step S630: When the path length is not greater than the preset reference setting length, determine the number of guiding walls according to the path length and the preset guiding wall length.

[0116] The reference setting length is the length set by the technician according to the actual number of existing guiding walls. The number of existing guiding walls can only set the distance of the reference setting length, which will not be elaborated here.

[0117] When the path length is not greater than the reference setting length, it means that the existing guiding walls can fill both sides of the guiding path. At this time, it is necessary to determine the number of required guiding walls. The number of guiding walls is the quotient of the path length and the preset guiding wall length. The guiding wall length is the standard parameter of the guiding wall and is the length value of a single guiding wall, which will not be elaborated here.

[0118] Step S6300: Based on the number of guiding walls and the guiding path, control the hoisting device to set the guiding walls on both sides of the guiding path and count the number of guiding walls.

[0119] After determining the number of required guiding walls, the system sets the guiding walls with the number of guiding walls on both sides of the guiding path. Since the overall length of the guiding walls needs to be changed according to the position of the staying person when the staying person moves in the guiding passage, the number of guiding walls will change, and it is necessary to count the number of guiding walls.

[0120] Step S6301: When the staying person moves within the digital passage, determine the real-time moving distance of the staying person in real time according to the spatial positioning information of the staying person.

[0121] The real-time moving distance refers to the distance value of the staying person moving within the digital passage. The real-time moving distance can be determined by collecting the spatial positioning information of the staying person. First, collect the initial spatial positioning information, and after a period of time, collect the next spatial positioning information. The distance between the two spatial positioning information is the real-time moving distance.

[0122] Step S6302: When the real-time moving distance is greater than the length of the guiding wall, control the hoisting device to lift a group of the guiding walls, and subtract one from the count of the number of the guiding walls until the count of the number of the guiding walls is 0.

[0123] When the real-time moving distance is greater than the length of the guiding wall, it means that the staying person has passed a guiding wall. At this time, it is necessary to use the hoisting device to lift the passed guiding wall. After the guiding wall is lifted, the count of the number of the guiding walls is subtracted by one. When the staying person moves to the second scene entrance position, the staying person has passed all the guiding walls. Therefore, all the guiding walls are lifted, and at this time, the count of the number of the guiding walls is 0.

[0124] The control method of the guiding wall further includes the following steps: Step S631: When the path length is greater than the reference setting length, determine the guiding wall setting positions on both sides of the staying person and on both sides of the guiding path according to the spatial positioning information of the staying person and the guiding path.

[0125] If the path length is greater than the reference setting length, the existing guiding walls are not enough to fill both sides of the guiding path. In this embodiment, in response to the above situation, the system will set two guiding walls on both sides of the staying person to prevent the staying person from straying, and the guiding walls can move along the guiding path according to the speed of the staying person.

[0126] The guiding wall setting position refers to the setting positions of the guiding walls on both sides of the staying person. When the position of the staying person changes, the guiding wall setting position will also change. The system determines the positions on both sides of the staying person by determining the spatial positioning information of the staying person.

[0127] Step S6310: Determine the scene-changing speed of the staying person according to the spatial positioning information of the staying person within a unit time.

[0128] The scene-changing speed is the moving speed of the staying person on the guiding path. The scene-changing speed can be determined by determining the change amount of the spatial positioning information of the staying person within a unit time.

[0129] Step S6311: Control the hoisting device to set the guiding wall at the guiding wall setting position, and control the guiding wall to move along the guiding path following the staying personnel according to the scene change speed.

[0130] In this embodiment, since the guiding wall needs to move synchronously with the staying personnel, the scene change speed of the staying personnel is the moving speed of the guiding wall. When the staying personnel move along the guiding path, the system controls the hoisting device to move the guiding wall at the scene change speed, so that the guiding wall is always on both sides of the staying personnel.

[0131] The preliminary method for setting the barrier wall before the first scene includes the following steps: Before the barrier wall and the guiding wall are set in the scene by the hoisting device, it is necessary to prepare the positions of the barrier wall and the guiding wall at the top of the scene room, so that the barrier wall and the guiding wall can be placed in the scene by the hoisting device at any time to guide the staying personnel. In this embodiment, the preliminary method for the barrier wall is described. The preliminary method for the guiding wall is the same as that for the barrier wall and will not be elaborated here.

[0132] Step S64: Based on the spatial positioning information of each experience personnel and the position of the second scene entrance, screen out the first personnel and the second personnel who are farther away from the position of the second scene entrance.

[0133] In order to enable the barrier wall to be lowered and placed in the scene at any time for isolation, it is necessary to pre-move the barrier wall at the top of the scene room so that it follows the staying personnel. Since it is impossible to determine which experience personnel will ultimately become the staying personnel, the system directly screens out two experience personnel who are farthest from the position of the second scene entrance through the spatial positioning information. The first personnel and the second personnel are the screened-out personnel. One of the first personnel and the second personnel will ultimately become the staying personnel.

[0134] Step S640: Determine the intermediate position of the personnel based on the spatial positioning information of the first personnel and the spatial positioning information of the second personnel.

[0135] The intermediate position of the personnel refers to the intermediate position between the position of the first personnel and the position of the second personnel, which is the center point of the connection line between the two. According to the spatial positioning information of the first personnel and the spatial positioning information of the second personnel, the connection line between the two can be determined, thereby determining the intermediate position of the personnel.

[0136] Step S641: Match the sliding setting position of the barrier wall at the top of the scene based on the intermediate position of the personnel.

[0137] The sliding setting position is the sliding position of the barrier wall at the top of the scene. In this embodiment, the barrier wall is always above the middle position of the personnel. When one of the experience personnel becomes a staying personnel, the barrier wall can approach the staying personnel at the fastest speed to guide the staying personnel.

[0138] Step S642: Update the middle position of the personnel in real time and control the hoisting setting to set the barrier wall at the sliding setting position.

[0139] Since the positions of the first personnel and the second personnel are always changing, the middle position of the personnel is also changing. Therefore, the sliding setting position of the barrier wall at the top of the scene is also changing. The system needs to update the spatial positioning information of the first personnel and the second personnel in real time to determine the sliding setting position of the barrier wall.

[0140] Based on the same inventive concept, an embodiment of the present invention provides a real-time object interaction system based on extended reality, including: An acquisition module for acquiring the spatial positioning information and the wearing start time of the wearing device.

[0141] A memory for storing a program of a real-time object interaction method based on extended reality.

[0142] A processor, and the program in the memory can be loaded and executed by the processor to implement a real-time object interaction method based on extended reality.

[0143] The above is only the preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions within the idea of the present invention belong to the protection scope of the present invention. It should be noted that for those of ordinary skill in the art, without departing from the principle of the present invention, several improvements and refinements should also be regarded as the protection scope of the present invention.

Claims

1. A real-time object interaction method based on augmented reality, characterized in that, Including: S1: Prompt the experience personnel to wear a preset wearable device, and collect the spatial positioning information and the wearing start time of the wearable device; S2: Sort the experience order of the experience personnel based on the wearing start time to obtain an experience serial number; S3: Determine the experience session of the experience personnel based on a preset maximum number of people per session and the experience serial number; S4: Prompt the experience personnel to enter a preset first scene according to the experience session, project a preset virtual scene onto the wearable device, after a preset single-scene experience time, prompt the experience personnel to enter a preset second scene, and prompt the experience personnel of the next experience session to enter the first scene; S5: Determine whether there are experience personnel staying in the first scene based on the spatial positioning information of the wearable device of the experience personnel; S6: When there are experience personnel staying in the first scene, mark the experience personnel staying in the first scene as staying personnel, and set a preset barrier wall and a preset guiding wall in the first scene by a preset scene guiding method to guide the staying personnel to evacuate to the second scene.

2. The real-time object interaction method based on extended reality according to claim 1, characterized in that, The scene guiding method includes: S60: Determine the barrier wall setting position based on the spatial positioning information of the staying personnel and a preset distance to keep; S600: Control a preset hoisting device to set the barrier wall at the barrier wall setting position to separate the experience personnel of two experience sessions; S601: Generate a guiding path based on the spatial positioning information of the staying personnel and a preset second scene entrance position; S602: Control the hoisting device to set the guiding wall on both sides of the guiding path based on the guiding path; S603: Create a digital passage in the virtual scene based on the guiding path, project the barrier wall and the guiding wall onto the virtual scene, and issue a guiding prompt to guide the staying personnel to move along the digital passage.

3. The real-time object interaction method based on extended reality according to claim 2, characterized in that, The processing method for the situation where an experience personnel approaches the barrier wall during the process of the staying personnel evacuating in the guiding path includes: S61: Determine whether the staying personnel has left the first scene based on the spatial positioning information of the staying personnel; S610: If the staying personnel has left the first scene, control the hoisting device to lift the barrier wall and the guiding wall; S611: If the staying personnel has not left the first scene yet, determine the experience personnel closest to the barrier wall based on the barrier wall setting position and the spatial positioning information of the experience personnel of the next experience session, and mark them as meeting personnel; S6110: Determine the collision distance based on the spatial positioning information of the meeting personnel and the barrier wall setting position; S6111: Based on the collision distance being less than the distance to keep, generate a translation path of the barrier wall according to the spatial positioning information of the staying personnel and the guiding path; S6112: Control the hoisting device to translate the barrier wall along the translation path at a preset translation speed, and control the hoisting device to lift the guiding walls on both sides of the translation path.

4. An augmented reality-based real-time object interaction method according to claim 3, characterized in that, The virtual scene has different experience mode types, and the experience mode types include an ornamental mode and a plot mode. The processing methods for the encountering persons approaching the barrier wall under different experience mode types further include: S62: Determine the moving speed of the encountering persons based on the spatial positioning information of the encountering persons within a preset unit time; S620: When the moving speed of the encountering persons is greater than the translation speed of the barrier wall, match the experience mode type based on a preset experience reservation item; S621: Based on the plot mode, control a preset inflating device to inflate an air cushion preset on the barrier wall, and determine whether the spatial positioning information of the encountering persons overlaps with the position of the barrier wall in the virtual scene; S6210: When the spatial positioning information of the encountering persons overlaps with the position of the barrier wall in the virtual scene, issue a collision warning; S622: Based on the ornamental mode, provide two options for the encountering persons to control the barrier wall by a preset selection control method.

5. The real-time object interaction method based on extended reality according to claim 4, characterized in that It further includes: S6220: In the ornamental mode, determine the number of the encountering persons based on the spatial positioning information of the encountering persons; S62200: When the number of the encountering persons is 1, provide two options for the encountering persons to control the barrier wall by the selection control method; S62201: When the number of the encountering persons is not 1, determine the splitting number of the barrier wall based on the number of the encountering persons; S622010: Determine the individual setting positions of each barrier wall based on the spatial positioning information of each encountering person; S622011: Control the barrier wall to split according to the splitting number of the barrier wall, and respectively set each split barrier wall at the individual setting position; S622012: Control the inflating device to inflate the air cushion of each barrier wall to block each encountering person.

6. An augmented reality-based real-time object interaction method according to claim 4, characterized in that The selection control method includes: S6221: Project preset scene selection items in the virtual scene of the encountering persons, and collect the action postures of the encountering persons; S6222: When the action posture is consistent with a preset reference posture, control the inflating device to inflate the air cushion on the barrier wall, and issue a collision warning when the spatial positioning information of the encountering persons overlaps with the position of the barrier wall in the virtual scene; S6223: When the action posture is inconsistent with the reference posture, control the barrier wall to split from the middle to form a passage feature, and generate a virtual teleportation portal at the position of the barrier wall in the virtual scene of the encountering persons; S6224: Determine whether the encountering persons pass through the virtual teleportation portal based on the spatial positioning information of the encountering persons and the guiding path; S6225: After the encountering persons pass through the virtual teleportation portal, mark the encountering persons as the staying persons and issue a guiding prompt.

7. An augmented reality-based real-time object interaction method according to claim 3, characterized in that, The control method of the guiding wall includes: S63: Determine the path length based on the spatial positioning information of the staying persons, the position of the second scene entrance, and the guiding path; S630: When the path length is not greater than a preset reference setting length, determine the number of guiding walls according to the path length and the preset guiding wall length; S6300: Based on the number of guiding walls and the guiding path, control the hoisting device to set the guiding walls on both sides of the guiding path, and count the number of guiding walls; S6301: When the staying personnel move within the digital passage, determine the real-time moving distance of the staying personnel in real time according to the spatial positioning information of the staying personnel; S6302: When the real-time moving distance is greater than the guiding wall length, control the hoisting device to lift off a group of the guiding walls, and subtract one from the count of the number of guiding walls until the count of the number of guiding walls is 0.

8. A real-time object interaction method based on extended reality according to claim 7, characterized in that, Further included: S631: When the path length is greater than the reference setting length, determine the guiding wall setting positions on both sides of the staying personnel and on both sides of the guiding path according to the spatial positioning information of the staying personnel and the guiding path; S6310: Determine the changing scene speed of the staying personnel according to the spatial positioning information of the staying personnel within a unit time; S6311: Control the hoisting device to set the guiding walls at the guiding wall setting positions, and control the guiding walls to move along the guiding path following the staying personnel according to the changing scene speed.

9. The real-time object interaction method based on extended reality according to claim 2, wherein The preparation method for setting the barrier wall before the first scene includes: S64: Based on the spatial positioning information of each experience personnel and the second scene entrance position, screen out the first personnel and the second personnel who are farther away from the second scene entrance position; S640: Determine the intermediate position of the personnel based on the spatial positioning information of the first personnel and the spatial positioning information of the second personnel; S641: Match the sliding setting position of the barrier wall at the top of the scene based on the intermediate position of the personnel; S642: Update the intermediate position of the personnel in real time and control the hoisting device to set the barrier wall at the sliding setting position.

10. A real-time object interaction system based on extended reality, characterized in that, Included: An acquisition module, configured to acquire the spatial positioning information of the wearable device and the starting time of wearing; A memory, configured to store a program of a real-time object interaction method based on augmented reality according to any one of claims 1 to 9; A processor, the program in the memory can be loaded and executed by the processor and implement a real-time object interaction method based on augmented reality.

Images