Control Method, System and Terminal of a Large-Space Immersive Experience Device

Abstract

The present invention relates to a control method, system and terminal for large-space immersive experience devices, belonging to the technical field of extended reality, and includes: obtaining the wearing trigger information, information trigger time and positioning information of the wearable device within the waiting area range; controlling a scanning device to scan a person according to the wearing trigger information to generate person feature data; creating a digital human model according to the person feature data; determining the person experience batch according to the information trigger time and the time batch table, and marking the digital human model according to the person experience batch; when the positioning information of the wearable device enters the activity area range, projecting the digital human model onto the scene picture, separating the digital human models of different person experience batches by a batch separation method, and outputting the scene picture to a display device. The experience batches of the experiencers are divided and separated according to the batch separation method, thereby improving the experience efficiency of the XR experience device.

Description

Technical Field

[0001] The present invention relates to the technical field of extended reality, and in particular to a control method, system and terminal for a large-space immersive experience device. Background Art

[0002] XR technology is a technology that combines the real world and the virtual world. Through computer technology and wearable devices, it provides an immersive interaction environment for users. The experiencer wears the wearable device on the body. The wearable device includes a VR helmet, and the display device in the VR helmet will display the images of the virtual world. Then, the experiencer is arranged to move in a room that is restored in a one-to-one ratio with the virtual world space.

[0003] In the prior art, when experiencing XR experience devices, due to the limited room space of each scene picture, in order to ensure the experience feeling of each experiencer and the personal safety of the experiencer, each room can only accommodate a certain number of experiencers to experience simultaneously. Only after the current batch of experiencers complete the experience can the next batch of experiencers enter the room to experience, and the efficiency is low. Summary of the Invention

[0004] In order to improve the experience efficiency of XR experience devices and enable XR experience devices to be experienced by more experiencers, the present invention provides a control method, system and terminal for a large-space immersive experience device.

[0005] In the first aspect, the present invention provides a control method for a large-space immersive experience device, adopting the following technical solution:

[0006] A control method for a large-space immersive experience device includes:

[0007] Obtain the wearing trigger information, information trigger time and positioning information of a preset wearable device within a preset waiting area range. The wearable device includes a VR device and a wearing vest;

[0008] Control a preset scanning device to scan a person according to the wearing trigger information to generate person feature data;

[0009] Create a digital human model according to the person feature data;

[0010] Determine the person experience batch according to the information trigger time and a preset time batch table, and mark the digital human model according to the person experience batch;

[0011] When the positioning information of the wearable device enters the range of the preset activity area, project the digital human model onto the preset scene screen, separate the digital human models of different personnel experience batches by a preset batch separation method, and output the scene screen to a preset display device.

[0012] By adopting the above technical solution, the system pre-divides the experience batches of the experiencers based on the information trigger time of the wearable devices of each experiencer, and the experiencer who generates the wearable trigger information first experiences. After the experiencer wears the wearable device and enters the activity area range, the system will re-plan the experience time process of the experiencers in each batch by using a preset batch separation method, thereby improving the experience efficiency of the experiencers experiencing the XR device.

[0013] Optionally, the scene screen has multiple different scene modules, and the batch separation method includes:

[0014] Divide the digital human model into the previous batch features and the current batch features according to the personnel experience batch;

[0015] Determine whether there are previous batch features that have entered the next scene module according to the positioning information of the wearable devices of the previous batch features and the preset scene module features;

[0016] If there are previous batch features that have entered the next scene module, control the wearable devices of the previous batch features to issue a countdown reminder;

[0017] After a preset waiting duration, control the wearable devices of the current batch features to issue a ready prompt and guide the current batch features into the activity area range;

[0018] Project the digital human model of the current batch features onto the scene screen and output the scene screen to the display device of the current batch features.

[0019] Optionally, the processing method when there are still previous batch features staying in the scene module where the current batch features are located after the waiting duration includes:

[0020] Determine the stranded personnel according to the positioning information of the wearable devices of the previous batch features and the scene module;

[0021] Match the corresponding digital human model according to the stranded personnel;

[0022] Transparently display the digital human models of the stranded personnel in the scene module where the current batch features are located;

[0023] Guide the stranded personnel to enter the next scene module by a preset evacuation guiding method.

[0024] Optionally, the evacuation guiding method includes:

[0025] Generate an evacuation path based on the positioning information of the wearable device of the stranded person and the preset entrance position of the next scenario module;

[0026] Create an evacuation digital channel in the preset guiding scenario screen according to the evacuation path, project the guiding scenario screen onto the display device of the stranded person, and issue guiding prompts to guide the stranded person to move along the evacuation digital channel;

[0027] Determine the position of the virtual wall according to the positioning information of the wearable device of the stranded person and the preset safety distance;

[0028] Determine the evacuation speed of the stranded person according to the positioning information of the wearable device of the stranded person within the preset unit time;

[0029] Project the preset virtual wall feature onto the guiding scenario screen according to the virtual wall position to isolate the stranded person from the current batch of features, and control the virtual wall feature to move along the evacuation path following the stranded person in the scenario screen according to the evacuation speed.

[0030] By adopting the above technical solution, the system will set a virtual wall feature in the scenario screen. The virtual wall feature is located between the stranded person and the experiencer of the current round of features, so that the stranded person can only move forward to enter the next scenario module and cannot move backward to meet the experiencer of the current round of features; in the scenario screen of the display device of the stranded person, the system will project an evacuation scenario screen exclusive to the stranded person, and create an evacuation digital channel in this evacuation scenario screen. The experiencer can quickly enter the next scenario module under the guidance of the system and along the evacuation digital channel.

[0031] Optionally, the processing method when the current batch of features approaches the virtual wall feature during the evacuation of the stranded person includes:

[0032] Determine whether the stranded person has left the scenario module where the current batch of features is located according to the positioning information of the wearable device of the stranded person and the preset position of the next scenario module;

[0033] If the stranded person has left the scenario module where the current batch of features is located, cancel the virtual wall feature from the scenario screen;

[0034] If the stranded person has not left the scenario module where the current batch of features is located, determine the current batch of features closest to the virtual wall according to the virtual wall position, and define it as the approaching person;

[0035] Determine the approaching distance according to the positioning information of the approaching person's wearable device and the virtual wall position;

[0036] When and only when the approaching distance is 0, obtain the pose information of the approaching person at the positioning information of the approaching person's wearable device;

[0037] Determine the collision trigger position of the wearable device according to the posture information of the approaching person and the position of the virtual wall;

[0038] Determine the retreat prompt direction sent by the scene picture to the approaching person according to the collision trigger position;

[0039] Control the wearable device to vibrate at the collision trigger position with a preset vibration intensity, and send a retreat prompt according to the retreat prompt direction to prompt the approaching person to stay away from the virtual wall feature, and then determine whether the approaching distance is 0 again after a preset reaction time;

[0040] Currently, only when the approaching distance is 0, control the wearable device to continuously vibrate with a preset alarm vibration intensity and a preset continuous vibration time.

[0041] Optionally, it further includes:

[0042] Obtain the collision trigger times of the wearable device of the approaching person;

[0043] When and only when the collision trigger times are greater than the preset trigger times of the override option, output the preset override option to the display device of the approaching person, send an override prompt, and obtain the posture image information of the approaching person;

[0044] Based on the posture image information being consistent with the consent posture, generate a portal feature at the virtual wall position in the scene picture;

[0045] Determine whether the approaching person passes through the portal feature according to the positioning information of the wearable device of the approaching person and the position of the virtual wall;

[0046] After the approaching person passes through the portal feature, mark the approaching person as a detained person, make the digital human model of the detained person transparent, replace the guiding scene picture with the scene picture where the current batch of features is located and project it onto the display device of the detained person, and send a guiding prompt.

[0047] Optionally, in the case where the power consumption of the wearable device affects the device experience, the wearable device charging method includes:

[0048] Obtain the remaining power information of the wearable device;

[0049] Match and generate a device power flag according to the remaining power information, and project the device power flag onto the scene picture of the experience person;

[0050] Based on the remaining power information being less than the preset reference charging power, send a charging prompt, and project the preset spare battery flag onto the spare battery placement position in the scene picture;

[0051] Determine the charging distance between each spare battery placement position and the experience personnel according to the placement position of the spare battery and the positioning information of the wearable device;

[0052] Arrange the charging distances in descending order to obtain the spare battery placement position corresponding to the minimum charging distance, and define it as the nearest charging position point;

[0053] Match the charging guidance path according to the nearest charging position point and the positioning information of the wearable device;

[0054] Send a prompt according to the charging guidance path to guide the experience to go to the nearest charging position point to replace the spare battery.

[0055] Optionally, a wireless charging device is provided underground in the scenario module for charging the wearable device. The processing method for the situation where the power of the wearable device is too low during the process of the experience personnel going to the nearest charging position point includes:

[0056] Divide the ground of the scenario module into multiple circular areas with continuously changing radii from small to large, and number the circular areas in sequence from the inside to the outside to obtain the charging area numbers;

[0057] Control the charging power of the wireless charging device in the circular area to increase with a preset power increment according to the charging area number, and determine the stepped charging power corresponding to the circular area;

[0058] Determine the estimated usage time according to the remaining power information and the preset power consumption speed;

[0059] Determine the estimated arrival time according to the charging distance and the preset personnel movement speed;

[0060] Based on the estimated usage time being less than the estimated arrival time, match the required charging power of the wireless charging device according to the remaining power information;

[0061] Match the charging area number of the circular area where the experience personnel are located according to the positioning information of the wearable device;

[0062] Correct the stepped charging power corresponding to the charging area number according to the required charging power.

[0063] In a second aspect, the present application provides a control system for a large-space immersive experience device, adopting the following technical solution:

[0064] A control system for a large-space immersive experience device, applying the above-mentioned control method for a large-space immersive experience device, includes:

[0065] An acquisition unit, used to acquire the wearing trigger information, information trigger time, positioning information of the wearable device, attitude image information of the approaching personnel, number of collision triggers, and remaining power information of the wearable device;

[0066] A memory for storing a program of a control method for a large - space immersive experience device;

[0067] A processor, and the program in the memory can be loaded and executed by the processor to implement a control method for a large - space immersive experience device.

[0068] In a third aspect, the present application provides an intelligent terminal, adopting the following technical solution:

[0069] An intelligent terminal includes a memory and a processor, and a computer program capable of being loaded and executed by the processor to implement a control method for a large - space immersive experience device is stored on the memory.

[0070] In summary, the present application includes at least one of the following beneficial technical effects:

[0071] 1. The system pre - divides the experience batches of the experiencers based on the information trigger time of the wearable devices of each experiencer, and the experiencer who generates the wearable trigger information first experiences. When the experiencer wears the wearable device and enters the activity area range, the system will re - plan the experience time process of the experiencers in each batch using a pre - set batch separation method, thereby improving the experience efficiency of the experiencers using XR devices;

[0072] 2. The system will set a virtual wall feature in the scene picture, and the virtual wall feature is located between the detained person and the experiencer of the current round feature, so that the detained person can only move forward to enter the next scene module and cannot move backward to meet the experiencer of the current round feature; in the scene picture of the display device of the detained person, the system will project an evacuation scene picture exclusive to the detained person, and create an evacuation digital channel in this evacuation scene picture. The experiencer can quickly enter the next scene module under the guidance of the system and along the evacuation digital channel;

[0073] 3. If the experiencer of the current batch feature approaches and touches the virtual wall feature, the wearable vest worn by the current batch feature can generate vibration at the corresponding collision position, thereby prompting the experiencer of the current batch feature to stay away from the virtual wall feature. BRIEF DESCRIPTION OF THE DRAWINGS

[0074] Figure 1 is a flowchart of a control method for a large - space immersive experience device according to an embodiment of the present invention;

[0075] Figure 2 is a flowchart of a batch separation method according to an embodiment of the present invention;

[0076] Figure 3It is the flowchart of the processing method when there are characteristics of the previous batch still remaining in the scenario module where the current batch characteristics are located after the waiting duration in the embodiment of the present invention;

[0077] Figure 4 It is the flowchart of the guiding evacuation method in the embodiment of the present invention;

[0078] Figure 5 It is the flowchart of the processing method when the current batch characteristics approach the barrier wall during the evacuation of the stranded persons in the embodiment of the present invention Figure 1 ;

[0079] Figure 6 It is the flowchart of the processing method when the current batch characteristics approach the barrier wall during the evacuation of the stranded persons in the embodiment of the present invention Figure 2 。 Detailed implementation manners

[0080] In order to make the objectives, technical solutions and advantages of the present invention clearer and more understandable, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0081] The embodiments of the present application disclose a control method for a large - space immersive experience device.

[0082] Refer to Figure 1 , a control method for a large - space immersive experience device includes the following steps:

[0083] Step S100: Obtain the wearing trigger information, information trigger time and positioning information of a preset wearing device within a preset waiting area range. The wearing device includes a VR device and a wearing vest.

[0084] The waiting area range is opposite to the activity area range, and both are venues set by technicians. The waiting area range is used for the experiencers who have not participated in the experience device to queue up and wait. At this time, the experiencers can pre - perform the wearing process of the wearing device, but will not enter the scene picture. The activity area range is the area range for the experiencers to conduct the experience. After the experiencers enter the activity area range from the waiting area range, the experiencers connect with the virtual space through the wearing device to conduct the experience.

[0085] The wearable trigger information refers to the information triggered when the experiencer wears the wearable device on the body, which is used to indicate that the experiencer has worn the wearable device on the body. When the experiencer puts on the wearable device, the system can directly read the wearable trigger information from the wearable device. In this embodiment, the wearable device is a VR device and a wearable vest. The VR device can be a VR helmet, and a display device is integrated at the position opposite to the experiencer's eyes in the VR helmet for projecting the virtual world so that the experiencer can see the virtual world. The wearable vest is worn on the experiencer's body, and the wearable vest can interact with the features in the scene picture.

[0086] The information trigger time refers to the time when the wearable trigger information is triggered, and the information trigger time can be directly obtained by the system from the wearable device when the wearable trigger information is triggered.

[0087] The positioning information of the wearable device refers to the position of the wearable device within the active area range or the waiting area range. Since the wearable device is worn on the experiencer, the positioning information can also be used to determine the positioning position of the experiencer. A positioning chip is set in the wearable device, and the system can directly obtain the current positions of the wearable device and the experiencer through the positioning chip.

[0088] Step S101: Control a preset scanning device to scan the personnel according to the wearable trigger information to generate personnel feature data.

[0089] The personnel feature data is the feature data collected by the experiencer on their body shape data through the scanning device within the waiting area range, and the personnel feature data is used in the virtual world. When the experiencer puts on the wearable device, the cameras within the waiting area range will scan the experiencer comprehensively to obtain the personnel feature data.

[0090] Step S102: Create a digital human model according to the personnel feature data.

[0091] The digital human model is a virtual human portrait model in the virtual world, which corresponds to the experiencer in the real world. The experiencer can control the digital human model in the virtual world to move in the virtual world. The digital human model is created by analyzing the personnel feature data collected through pre-scanning. After the digital human model is created, the digital human model is temporarily saved in the database and will not be directly projected onto the scene picture. The method of creating a digital human model from the personnel feature data is common knowledge known to those skilled in the art and will not be elaborated here.

[0092] Step S103: Determine the personnel experience batch according to the information trigger time and a preset time batch table, and mark the digital human model according to the personnel experience batch.

[0093] The time batch table is the classification basis for technicians to divide the experiencers into batches. In the time batch table, the experiencers within each specific time range are divided into one batch, which will not be elaborated here.

[0094] The personnel experience batch refers to the batch to which the current experiencer is assigned after putting on the wearable device. The experiencers conduct device experience in sequence according to the personnel experience batch.

[0095] Querying in the time batch table according to the information trigger time can determine the personnel experience batch where the experiencer of this information trigger time is located.

[0096] Step S104: When the positioning information of the wearable device enters the preset activity area range, project the digital human model onto the preset scene picture, separate the digital human models of different personnel experience batches by the preset batch separation method, and output the scene picture to the preset display device.

[0097] When it is the turn of the experiencer in the waiting area range to conduct the experience, the experiencer will be brought into the activity area range, and the system will detect the positioning information of the wearable device to determine whether the experiencer enters the activity area range. When the experiencer is within the activity area range, a scene picture will appear on the display device of the experiencer, and the pre-created digital human model can be projected onto the scene picture, and the digital human models of the experiencers in the same batch can be seen by each other in the scene picture. Since there may still be the previous batch of experiencers in the virtual world of the current scene when this batch of experiencers enter the virtual world, it is necessary to separate the two so that they do not interfere with each other. Here, they are separated by the batch separation method, and the batch separation method will not be elaborated here and will be introduced in detail in the subsequent embodiments.

[0098] Refer to Figure 2 , the batch separation method includes the following steps:

[0099] In this embodiment, there are multiple different scene modules in the activity area range, and the experiencers in two scene modules do not interfere with each other.

[0100] Step S200: Divide the digital human model into the previous batch feature and the current batch feature according to the personnel experience batch.

[0101] Both the previous batch feature and the current batch feature refer to the experiencer and the digital human model of the experiencer. The previous batch feature is the experiencer who has entered the activity area range for a period of time to conduct the experience, and the current batch feature is the experiencer who is about to enter the activity area range to conduct the experience.

[0102] The previous batch feature and the current batch feature can be determined by dividing according to the personnel experience batch. Dividing the digital human models of different batches is convenient for processing the digital human models of different batches so that they do not interfere with each other.

[0103] Step S201: Determine whether there are previous batch features that have entered the next scenario module based on the positioning information of the wearable device with previous batch features and the preset scenario module features.

[0104] The system detects the positioning information of the experiencers with previous batch features, compares this positioning information with the location of the next scenario module features, and determines whether the experiencers with previous batch features have entered the next scenario module. Only based on the situation of the experiencers with previous batch features entering the next scenario module can the experiencers with the current batch features be arranged.

[0105] Step S202: If there are previous batch features that have entered the next scenario module, control the wearable device with previous batch features to issue a countdown prompt.

[0106] If there is positioning information in the next scenario module, it means that there are already experiencers with previous batch features who have entered the next scenario module, which means that most of the experiencers with previous batch features are about to complete the current scenario module. At this time, the system will arrange the experiencers with the current batch features to enter the activity area range. In order to enable the experiencers with previous batch features to quickly enter the next scenario module, the system will issue a countdown to prompt the experiencers with previous batch features.

[0107] If there are no experiencers with previous batch features in the next scenario module, it means that the experiencers with previous batch features are still experiencing in the current scenario module, and the experiencers with the current batch features still need to wait in the waiting area range.

[0108] Step S203: After the preset waiting duration, control the wearable device with the current batch features to issue a ready prompt and guide the current batch features into the activity area range.

[0109] The waiting duration is the duration set by the technical staff from the start of the next scenario module for the previous batch features to the time when the current batch features are ready to enter the current scenario module. This waiting duration is mainly used for the remaining personnel with previous batch features to enter the next scenario module.

[0110] Step S204: Project the digital human model of the current batch features onto the scenario screen and output the scenario screen to the display device of the current batch features.

[0111] After the experiencers with the current batch features enter the activity area range, their corresponding digital human models will also be projected onto the current scenario screen.

[0112] Refer to Figure 3, after the waiting duration, if there are still features of the previous batch remaining in the scenario module where the current batch features are located, the system needs to perform targeted processing on this experiencer. The processing method includes the following steps:

[0113] Step S300: Determine the stranded personnel based on the positioning information of the wearable device of the previous batch features and the scenario module.

[0114] By obtaining the positioning information of the previous batch features and comparing it with the position of the current scenario module, the experiencer of the previous batch features whose positioning information is still within the position of the current scenario module will be set as the stranded personnel. The stranded personnel are those experiencers who should have entered the next scenario module but haven't had time to do so. To ensure that the stranded personnel do not interfere with the experiencers of the current batch features by meeting them, the stranded personnel need to be processed.

[0115] Step S301: Match the corresponding digital human model according to the stranded personnel.

[0116] In addition to processing the stranded personnel in the real world, the digital human model corresponding to this stranded personnel in the virtual world also needs to be processed. By determining the information of the stranded personnel, the corresponding digital human model can be matched.

[0117] Step S302: Transparently display the digital human model of the stranded personnel in the scenario module where the current batch features are located.

[0118] To ensure that the experiencers of the current batch features do not see the digital human model of the stranded personnel when entering the activity area, the system will transparently display the digital human model of the stranded personnel, and this operation will not affect the experience of the stranded personnel in their scenario screen.

[0119] Step S303: Guide the stranded personnel to enter the next scenario module using a preset guiding evacuation method.

[0120] After transparently displaying the digital human model, the system will guide the stranded personnel to quickly enter the next scenario module using the guiding evacuation method. The system will guide in the real world and also synchronously guide in the virtual world. The guiding evacuation method will not be elaborated here and will be introduced in detail in the subsequent embodiments.

[0121] Refer to Figure 4 , the guiding evacuation method includes the following steps:

[0122] In this embodiment, a virtual wall feature is set between the stranded personnel in the scenario screen and the experiencers of the current batch features to prevent the stranded personnel from running in the wrong direction.

[0123] Step S400: Generate an evacuation route based on the positioning information of the wearable device of the stranded person and the preset entrance position of the next scenario module.

[0124] The evacuation route refers to the route that the stranded person needs to move along to evacuate into the next scenario module.

[0125] The entrance position of the next scenario module is a fixed position point within the scenario, which will not be elaborated here.

[0126] After the position of the stranded person is determined, the system can determine the shortest route between two points based on the position in the scene image corresponding to the current location of the stranded person and the entrance position of the next scenario module, and the stranded person can move along this shortest route.

[0127] Step S401: Create an evacuation digital channel in the preset guiding scene image, project the guiding scene image onto the display device of the stranded person, and issue guiding prompts to guide the stranded person to move along the evacuation digital channel.

[0128] In this embodiment, in order to enable the stranded person to concentrate on entering the next scenario module without being nostalgic for the current scenario module, the system will replace the current scenario image with the guiding scene image and project it onto the display device of the stranded person. The guiding scene image is a scene image generated by the system for the stranded person to quickly enter the next scenario module, and there are no other digital human models in it.

[0129] The evacuation digital channel is a channel generated by the system, and this channel will appear in the guiding scene image. The stranded person can see the evacuation digital channel in the guiding scene image and move along the evacuation digital channel under the guiding prompts of the system.

[0130] Step S402: Determine the virtual wall position based on the positioning information of the wearable device of the stranded person and the preset safety distance.

[0131] The safety distance is the distance that needs to be maintained from the stranded person when the technician sets the virtual wall features.

[0132] By obtaining the real-time positioning information of the stranded person, and then extending the safety distance from the location of the positioning information in the direction of the current batch of feature experiencers, the position obtained at this time is the virtual wall position. The virtual wall position is set between the stranded person and the current batch of feature experiencers, and can separate the stranded person from the current batch of feature experiencers.

[0133] Step S403: Determine the evacuation speed of the stranded person based on the positioning information of the wearable device of the stranded person within the preset unit time.

[0134] The evacuation speed is the moving speed of the stranded people on the evacuation path. The evacuation speed can be determined by determining the change amount of the positioning information of the stranded people within a unit time.

[0135] Step S404: Project the preset virtual wall feature onto the guiding scene image according to the virtual wall position to isolate the stranded people from the current batch feature, and control the virtual wall feature to move along the evacuation path following the stranded people in the scene image according to the evacuation speed.

[0136] After determining the virtual wall position according to the position of the stranded people, the system projects the virtual wall feature in the scene image to isolate the stranded people and the current batch feature. Since there is a virtual wall feature blocking behind the stranded people, at this time, the stranded people can only move along the evacuation path to the next scene module, and the virtual wall feature will move following the stranded people until the stranded people enter the next scene module.

[0137] Refer to Figure 5 , the processing method when the current batch feature approaches the virtual wall feature during the evacuation of the stranded people includes the following steps:

[0138] Step S500: Determine whether the stranded people have left the scene module where the current batch feature is located according to the positioning information of the wearable device of the stranded people and the position of the preset next scene module.

[0139] By obtaining the positioning information of the stranded people and comparing the positioning information with the position where the next scene module is located, if the two are the same, it means that the stranded people have left the scene module where the current batch feature is located, otherwise it means that the stranded people have not left.

[0140] When the experiencer of the current batch feature approaches the virtual wall feature, whether the stranded people have left the current scene module will affect the system's control of the virtual wall feature, so it needs to be judged first.

[0141] Step S5011: If the stranded people have left the scene module where the current batch feature is located, cancel the virtual wall feature from the scene image.

[0142] If the stranded people have left the current scene module, the virtual wall feature has lost its function. At this time, when the experiencer of the current batch feature approaches the virtual wall feature, the system will directly remove the virtual wall feature so that there is no virtual wall feature in the scene image of the current scene module to interfere with the experiencer of the current batch feature.

[0143] Step S5012: If the stranded people have not left the scene module where the current batch feature is located, determine the current batch feature closest to the virtual wall according to the virtual wall position and define it as the approaching person.

[0144] If the detained person has not left the current scene module, the system cannot directly virtual wall feature, because the detained person may be in the process of evacuation on the evacuation path at this time.

[0145] In this embodiment, the system will obtain the positioning information of each experiencer of the current batch of features and compare it with the virtual wall position, so as to determine the experiencer in the current batch of features who is closest to the virtual wall feature. This experiencer is the approaching person, and the approaching person is the one most likely to collide with the virtual wall feature.

[0146] When the approaching person is found, the system will process the relationship between the approaching person and the virtual wall feature.

[0147] Step S503: Determine the approaching distance according to the positioning information of the wearable device of the approaching person and the virtual wall position.

[0148] The approaching distance refers to the distance between the approaching person and the virtual wall feature, and the approaching distance can be calculated through the positioning information of the approaching person and the virtual wall position.

[0149] Step S504: When and only when the approaching distance is 0, obtain the posture information of the approaching person at the positioning information of the wearable device of the approaching person.

[0150] If the approaching distance is not 0, it means that the distance between the approaching person and the virtual wall feature is relatively far, and the approaching person will not touch the virtual wall feature temporarily. At this time, there is no need to process the virtual wall feature.

[0151] If the approaching distance is 0, it means that the approaching person has collided with the virtual wall feature. At this time, the wearable vest worn by the approaching person can interact with the virtual wall.

[0152] The posture information of the approaching person refers to the body posture when the approaching person touches the virtual wall feature, and the posture information can be obtained through image recognition and analysis of the approaching person by the camera. When the approaching person touches the virtual wall feature with different posture information, the body parts where the approaching person touches the virtual wall feature are different.

[0153] Step S505: Determine the collision trigger position of the wearable device according to the posture information of the approaching person and the virtual wall position.

[0154] The collision trigger position of the wearable device refers to the position where the wearable vest simulates a sense of collision when the approaching person touches the virtual wall feature. When the posture information of the approaching person is determined, the overlapping part of the approaching person's body and the virtual wall feature is the collision trigger position of the wearable device.

[0155] Step S506: Determine the retreat prompt direction sent by the scene picture to the approaching person according to the collision trigger position.

[0156] The retreat prompt direction is the direction in which the system prompts the approaching person to move away from the virtual wall feature through the wearable device in the scene picture. The retreat prompt direction is the opposite direction of the collision trigger position.

[0157] Step S507: Control the wearable device to vibrate at a preset vibration intensity at the collision trigger position, and issue a retreat prompt according to the retreat prompt direction to prompt the approaching person to move away from the virtual wall feature, and then judge again whether the approaching distance is 0 after a preset reaction time.

[0158] In this embodiment, when the approaching person collides with the virtual wall feature, the wearable vest will vibrate at the collision trigger position to prompt the approaching person that a retreat is required. The vibration intensity is the intensity of the vibration generated by the wearable vest set by the technician. Vibration of the human body with this vibration intensity is not likely to cause harm to the human body while being able to give people a feeling of collision, which will not be elaborated here.

[0159] After the wearable vest generates vibration, the system will simultaneously issue a prompt to the approaching person, prompting the approaching person in which direction to retreat.

[0160] The reaction time is the time set by the technician for the approaching person to make the next retreat action after the wearable device generates vibration, which will not be elaborated here.

[0161] After the reaction time, the system will confirm again whether the approaching person has moved away from the virtual wall feature to make the next operation.

[0162] Step S508: Currently, only when the approaching distance is 0, control the wearable device to continuously generate vibration with a preset alarm vibration intensity and a preset continuous vibration time.

[0163] If it is found during the reconfirmation that the approaching distance of the approaching person is not 0, it means that the approaching person has moved away from the virtual wall feature, and at this time the wearable vest will stop vibrating. If it is found during the reconfirmation that the approaching distance of the approaching person is still 0, it means that the approaching person has not retreated.

[0164] The alarm vibration intensity is the intensity of the vibration generated by the wearable device when the system forces the approaching person to retreat set by the technician. The alarm vibration intensity is greater than the vibration intensity when the approaching person first touches the virtual wall feature, which will not be elaborated here. The continuous vibration time is the duration of the vibration of the wearable device with the alarm vibration intensity, which will not be elaborated here.

[0165] When the approaching person does not retreat, the system will control the wearable vest to continuously emit vibration to drive the approaching person away from the virtual wall feature.

[0166] Refer to Figure 6, the processing method when the characteristics of the current batch are close to the virtual wall characteristics during the evacuation of stranded personnel further includes the following steps:

[0167] Step S600: Obtain the number of collision triggers of the wearable device of the approaching person.

[0168] The number of collision triggers is the number of times the approaching person continuously collides with the virtual wall characteristics, causing the wearable device to vibrate. The wearable device can automatically record the number of collision triggers and can be directly read by the system.

[0169] Step S601: When and only when the number of collision triggers is greater than the preset trigger number of the override option, output the preset override option to the display device of the approaching person, issue an override prompt, and obtain the pose image information of the approaching person.

[0170] In this embodiment, for approaching persons who collide with the virtual wall characteristics multiple times and show a desire to enter the next scene module, the system will provide an override option. The override option is an option screen for human-computer interaction with the experiencer in the scene picture, which is an option for the approaching person to enter the next scene module in advance, and it can be projected in the scene picture of the approaching person in the form of an entity box for the approaching person to select.

[0171] The trigger number of the override option is the number of collisions that can trigger the override option set by the technical personnel. This number of collisions is the number of times the approaching person collides with the virtual wall characteristics, which will not be elaborated here.

[0172] When the number of collision triggers is not greater than the trigger number of the override option, the system will not trigger the override option. When the number of collision triggers is greater than the trigger number of the override option, the system will project the selection box corresponding to the override option in the scene picture of the approaching person, which can only be seen by the approaching person, and based on the actual reaction actions of the approaching person, to determine the subsequent actions.

[0173] The pose image information of the approaching person refers to obtaining the pose action situation of the approaching person through the camera. Specific pose actions can generate different interaction meanings in the scene picture of the virtual world, which are used to interact with the override option.

[0174] Step S602: Based on the pose image information being consistent with the consent pose, generate a portal feature at the position of the virtual wall in the scene picture.

[0175] The consent pose is a pose action in the scene picture of the virtual world set by the technical personnel, which is used to interact with the override option, and will not be elaborated here. In this embodiment, the override option has two selection items, consent or refusal. Selecting any one of them, the system will react according to the selection result of the experiencer.

[0176] When there is an override option, if the camera detects that the pose image information of the approaching person is inconsistent with the consent pose, it means that the approaching person does not want to enter the next scene module in advance, and the approaching person can continue to stay in the current scene module to continue the experience.

[0177] If the camera detects that the pose image information of the approaching person is consistent with the consent pose, it means that the experiencer has selected consent in the override option of the scene screen. After selecting consent, the system determines that the approaching person agrees to enter the next scene module in advance.

[0178] The portal feature is a virtual door generated by the system in the scene screen for the approaching person to pass through to enter the next scene module. The portal feature is set on the virtual wall feature, that is, the portal feature appears on the virtual wall feature. When the approaching person agrees to enter the next scene module in advance, the portal feature will be generated on the virtual wall feature for the approaching person to enter.

[0179] Step S603: Determine whether the approaching person has passed through the portal feature according to the positioning information of the approaching person's wearable device and the position of the virtual wall.

[0180] By obtaining the positioning information of the approaching person and comparing the positioning information with the position where the virtual wall is located, it is determined whether the approaching person has passed through the passage feature and whether to interact with the portal feature.

[0181] Step S604: When the approaching person passes through the portal feature, mark the approaching person as a stranded person, make the digital human model of the stranded person transparent, replace the current batch feature's scene screen with the guiding scene screen and project it onto the display device of the stranded person, and issue a guiding prompt.

[0182] When the approaching person enters the evacuation path, the system will redefine the approaching person, define it as a stranded person, and divide the person's experience batch into the previous batch feature. When becoming a stranded person, the system guides the experiencer to quickly enter the next scene module with the handling method for stranded persons. The handling method for stranded persons is to make the digital human model of the experiencer transparent and replace the current batch feature's scene screen with the guiding scene screen.

[0183] There is a situation where the wearable device has power consumption and affects the device experience. The wearable device charging method includes the following steps:

[0184] Step S700: Obtain the remaining power information of the wearable device.

[0185] The system can directly obtain the remaining power information from the system of the wearable device. When the remaining power is insufficient, the system of the wearable device will shut down, so that it can no longer interact with the scene screen.

[0186] Step S701: Generate a device power flag according to the remaining power information and project the device power flag onto the scene picture of the experience personnel.

[0187] The device power flag is a shape flag generated by the system in the scene picture, which is used for the experience personnel to know the power situation of the current wearable device. The device power flag corresponds one-to-one with the remaining power information and can be obtained by inputting the remaining power information into a preset power flag database for matching. The power flag database is a database preset by technicians and contains the one-to-one correspondence between the remaining power information and the device power flag, which will not be elaborated here.

[0188] Step S702: Based on the remaining power information being less than a preset reference charging power, issue a charging prompt and project a preset spare battery flag onto the spare battery placement position in the scene picture.

[0189] The reference charging power is the power when the wearable device can be used normally, which is set by technicians. When the remaining power information is less than the reference charging power, it will affect the normal use of the wearable device, which will not be elaborated here.

[0190] When the system detects that the remaining power information is less than the reference charging power, the system will issue a charging prompt to the experience personnel, prompting the experience personnel to replace the battery.

[0191] In this embodiment, there are multiple spare battery placement positions for placing spare batteries distributed around the scene module. When the wearable device has low power, the experience personnel can go there by themselves to replace the battery. And, in order to facilitate the experience personnel to know the location of the spare battery placement position, the system will generate a spare battery flag at the spare battery placement position in the scene picture. The spare battery flag is a shape flag generated by the system in the scene picture and is used to represent the spare battery.

[0192] Step S703: Determine the charging distance between each spare battery placement position and the experience personnel according to the spare battery placement position and the positioning information of the wearable device.

[0193] The charging distance refers to the distance that the experience personnel need to move from the current position to the spare battery placement position. The charging distance can be determined by the spare battery placement position and the positioning information of the wearable device and is the straight-line distance between the two.

[0194] Step S704: Arrange the charging distances in descending order to obtain the spare battery placement position corresponding to the minimum charging distance, which is defined as the nearest charging position point.

[0195] Since there are multiple spare battery placement locations in the scenario module, in order to recharge the wearable device more quickly, the system will prompt the nearest spare battery placement location. The nearest charging location point is the spare battery placement location closest to the user experiencing the scenario. After the distance between each spare battery placement location and the user experiencing the scenario is determined, by sorting all the charging distances, the nearest charging location point can be obtained.

[0196] Step S705: Match a charging guidance path based on the nearest charging location point and the positioning information of the wearable device;

[0197] The charging guidance path is the shortest path from the user experiencing the scenario to the nearest charging location point, and the charging guidance path is generated by the system based on the nearest charging location point and the positioning information of the wearable device.

[0198] Step S706: Issue a prompt according to the charging guidance path to guide the user experiencing the scenario to go to the nearest charging location point to replace the spare battery.

[0199] When the wearable device has low battery power, the system will give a prompt and guidance to the user experiencing the scenario according to the charging guidance path, enabling the user experiencing the scenario to move along the charging guidance path and recharge the wearable device in the shortest time.

[0200] In the embodiment, a wireless charging device is installed underground in the scenario module for wirelessly charging the wearable device. The wireless charging principle here is electromagnetic induction charging, and the wearable device can be charged when the user stands on the ground. The processing method for the situation where the wearable device has too low battery power during the process of the user experiencing the scenario going to the nearest charging location point includes the following steps:

[0201] In this embodiment, a wireless charging device covering the entire scenario module is installed underground in the scenario module. The charging power of the wireless charging device is in a ring shape and is stepped. The charging power in the central area of the scenario module is the smallest, and the charging power in the outermost part is the largest, with a stepped change between the two, and the charging power in the ring-shaped area is the same. Moreover, the charging power at any position on the ground of the scenario module can be changed.

[0202] Step S800: Divide the ground of the scenario module into multiple ring-shaped areas with continuously changing radii from small to large, and number the ring-shaped areas from the inside to the outside in sequence to obtain charging area numbers.

[0203] After numbering each ring-shaped area of the wireless charging device from the inside to the outside to obtain the charging area numbers, it is convenient to determine in which ring-shaped area with a charging area number the user experiencing the scenario is located in subsequent embodiments, so as to adjust the charging power of this charging area.

[0204] Step S801: Control the charging power of the wireless charging devices in the annular area to increase in a preset power increment according to the charging area number, and determine the stepped charging power corresponding to the annular area.

[0205] The stepped charging power refers to the charging power of the wireless charging devices in each annular area. In this embodiment, the charging power of the wireless charging devices in the annular area is stepped according to the change of the charging area number, that is, the charging power of the wireless charging device in the central area with the smallest number is the smallest, and the charging power of the wireless charging device in the outermost peripheral area with the largest number is the largest. The difference in charging power between adjacent annular areas is the power increment. The power increment is a parameter set by technicians when designing the wireless charging devices under the scenario module, which will not be elaborated here.

[0206] By controlling the wireless charging devices with the method of stepped charging power to adapt to the situation of the experience personnel when experiencing the device. The experience personnel are mostly concentrated in the central area. At this time, the stepped charging power is small and does not affect the normal use of the wearable device. When the wearable device has low power and the experience personnel move to the standby battery placement position at the outermost periphery, the stepped charging power becomes larger as they move outward, so that the wearable device is not easily powered off.

[0207] Step S802: Determine the estimated usage time according to the remaining battery level information and the preset power consumption speed.

[0208] The power consumption speed is the speed of power consumption when the wearable device is in use itself, which will not be elaborated here.

[0209] The estimated usage time is the time that the wearable device can continue to be used until it runs out of power. The estimated usage time is the quotient of the remaining battery level information and the power consumption speed.

[0210] Step S803: Determine the estimated arrival time according to the charging distance and the preset personnel movement speed.

[0211] The personnel movement speed is the maximum running speed that the experience personnel can reach when experiencing the device.

[0212] The estimated arrival time refers to the time required for the experience personnel to move from the current location to the standby battery placement position. The estimated arrival time is the quotient of the charging distance and the personnel movement speed.

[0213] Step S804: Based on the estimated usage time being less than the estimated arrival time, match the required charging power of the wireless charging device according to the remaining battery level information.

[0214] If the estimated usage time is not less than the estimated arrival time, it means that the wearable device can reach the standby battery placement position to replace the battery before running out of power completely.

[0215] If the estimated usage time is less than the estimated arrival time, it means that the wearable device will run out of power before reaching the spare battery placement position. Even though there is a wireless charging device constantly charging the wearable device, the charging power is slower than the power consumption speed. At this time, it is necessary to correct the charging power of the wireless charging device so that the power of the wearable device can support it until it reaches the spare battery placement position.

[0216] The required charging power refers to the power that can balance the charging speed and power consumption speed of the wearable device to keep the wearable device powered on, and it is the power for correcting the stepped charging power of the wireless charging device.

[0217] The required charging power is inversely proportional to the remaining battery information. The smaller the remaining battery information, the greater the required charging power.

[0218] Step S805: Match the charging area number of the circular area where the experience personnel are located according to the positioning information of the wearable device.

[0219] According to the positioning information of the wearable device, it is possible to know the circular area where the experience personnel are currently located, and thus the charging area number corresponding to this circular area.

[0220] Step S806: Correct the stepped charging power corresponding to the charging area number according to the required charging power.

[0221] After determining the charging area number of the circular area, the system can control the wireless charging device in the circular area corresponding to the charging area number to perform power correction according to the charging area number. When the experience personnel appear in this circular area, the stepped charging power is corrected with the required charging power.

[0222] Based on the same inventive concept, an embodiment of the present invention provides a control system for a large-space immersive experience device, applying a control method for a large-space immersive experience device, including:

[0223] An acquisition module, configured to acquire the wearing trigger information, information trigger time, positioning information of the wearable device, attitude image information of the approaching personnel, number of collision triggers, and remaining battery information of the wearable device.

[0224] A memory, configured to store a program of a control method for a large-space immersive experience device.

[0225] A processor, the program in the memory can be loaded and executed by the processor and implement a control method for a large-space immersive experience device.

[0226] Based on the same inventive concept, an embodiment of the present invention provides an intelligent terminal, including a memory and a processor, and a computer program capable of being loaded and executed by the processor and implementing a control method for a large-space immersive experience device is stored on the memory.

[0227] The above are only the preferred embodiments of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions falling within the concept of the present invention belong to the protection scope of the present invention. It should be noted that for those of ordinary skill in the art, several improvements and refinements made without departing from the principle of the present invention should also be regarded as within the protection scope of the present invention.

Claims

1. A control method for a large-space immersive experience device, characterized in that Including: Obtain the wearing trigger information, information trigger time, and positioning information of a preset wearable device within a preset waiting area. The wearable device includes a VR device and a wearable vest; Control a preset scanning device to scan a person according to the wearing trigger information to generate person feature data; Create a digital human model according to the person feature data; Determine the person experience batch according to the information trigger time and a preset time batch table, and mark the digital human model according to the person experience batch; When the positioning information of the wearable device enters the preset activity area range, project the digital human model onto a preset scene screen, separate the digital human models of different person experience batches by a preset batch separation method, and output the scene screen to a preset display device; The scene screen has multiple different scene modules. The batch separation method includes: Divide the digital human model into previous batch features and current batch features according to the person experience batch; Determine whether there are previous batch features that have entered the next scene module according to the positioning information of the wearable device of the previous batch features and the preset scene module features; If there are previous batch features that have entered the next scene module, control the wearable device of the previous batch features to issue a countdown prompt; After a preset waiting duration, control the wearable device of the current batch features to issue a ready prompt and guide the current batch features into the activity area range; Project the digital human model of the current batch features onto the scene screen and output the scene screen to the display device of the current batch features; The processing method when there are still previous batch features staying in the scene module where the current batch features are located after the waiting duration includes: Determine the stranded personnel according to the positioning information of the wearable device of the previous batch features and the scene module; Match the corresponding digital human model according to the stranded personnel; Transparify the digital human models of the stranded personnel in the scene module where the current batch features are located; Guide the stranded personnel to enter the next scene module by a preset evacuation guidance method; The evacuation guidance method includes: Generate an evacuation path according to the positioning information of the wearable device of the stranded personnel and the entrance position of the preset next scene module; Create an evacuation digital passage in a preset guidance scene screen according to the evacuation path, project the guidance scene screen onto the display device of the stranded personnel, and issue a guidance prompt to guide the stranded personnel to move along the evacuation digital passage; Determine the virtual wall position according to the positioning information of the wearable device of the stranded personnel and a preset safety distance; Determine the evacuation speed of the stranded personnel according to the positioning information of the wearable device of the stranded personnel within a preset unit time; Project the preset virtual wall features onto the guidance scene screen according to the virtual wall position to isolate the stranded personnel from the current batch features, and control the virtual wall features to move along the evacuation path following the stranded personnel in the scene screen according to the evacuation speed.

2. The control method of a large-space immersive experience device according to claim 1, characterized in that The processing method when the current batch features approach the virtual wall features during the evacuation of the stranded personnel includes: Determine whether the stranded personnel have left the scene module where the current batch features are located according to the positioning information of the wearable device of the stranded personnel and the position of the preset next scene module; If the detained person has left the scene module where the current batch of features is located, cancel the virtual wall feature from the scene screen; If the detained person has not left the scene module where the current batch of features is located, determine the current batch of features closest to the virtual wall based on the virtual wall position and define it as the person near the wall; Determine the approaching distance based on the positioning information of the wearable device of the person near the wall and the virtual wall position; When and only when the approaching distance is 0, obtain the pose information of the person near the wall at the positioning information of the wearable device of the person near the wall; Determine the collision trigger position of the wearable device based on the pose information of the person near the wall and the virtual wall position; Determine the retreat prompt direction issued by the scene screen to the person near the wall based on the collision trigger position; Control the wearable device to vibrate at the collision trigger position with a preset vibration intensity, and issue a retreat prompt according to the retreat prompt direction to prompt the person near the wall to stay away from the virtual wall feature, and then judge whether the approaching distance is 0 again after a preset reaction time; When and only when the approaching distance is 0, control the wearable device to continuously vibrate with a preset alarm vibration intensity and a preset continuous vibration time.

3. The control method of a large-space immersive experience device according to claim 2, characterized in that, It also includes: Obtain the collision trigger count of the wearable device of the person near the wall; When and only when the collision trigger count is greater than a preset trigger count for the override option, output the preset override option to the display device of the person near the wall, issue an override prompt, and obtain the pose image information of the person near the wall; Based on the pose image information being consistent with the consent pose, generate a portal feature at the virtual wall position in the scene screen; Determine whether the person near the wall passes through the portal feature based on the positioning information of the wearable device of the person near the wall and the virtual wall position; After the person near the wall passes through the portal feature, mark the person near the wall as a detained person, make the digital human model of the detained person transparent, replace the scene screen where the current batch of features is located with a guiding scene screen and project it onto the display device of the detained person, and issue a guiding prompt.

4. The control method of a large-space immersive experience device according to claim 1, characterized in that, In the case where the wearable device has power consumption that affects the device experience, the wearable device charging method includes: Obtain the remaining power information of the wearable device; Match and generate a device power indicator based on the remaining power information, and project the device power indicator onto the scene screen of the experience person; Based on the remaining power information being less than a preset reference charging power, issue a charging prompt, and project a preset spare battery indicator onto the spare battery placement position in the scene screen; Determine the charging distance between each spare battery placement position and the experience person based on the spare battery placement position and the positioning information of the wearable device; Arrange the charging distances in descending order to obtain the spare battery placement position corresponding to the minimum charging distance, and define it as the nearest charging position point; Match a charging guidance path based on the nearest charging position point and the positioning information of the wearable device; Issue a prompt according to the charging guidance path to guide the experience to go to the nearest charging position point to replace the spare battery.

5. The control method of a large-space immersive experience device according to claim 4, characterized in that, There is a wireless charging device underground in the scene module for charging the wearable device. The processing method for the situation where the wearable device has too low power during the process of the experience person going to the nearest charging position point includes: Divide the ground of the scene module into multiple annular regions with continuously varying radii from small to large, number the annular regions in sequence from the inside to the outside to obtain the charging area numbers; Control the charging power of the wireless charging devices in the annular regions to increase in a preset power increment according to the charging area numbers and determine the stepped charging power for the corresponding annular regions; Determine the estimated usage time according to the remaining battery information and the preset power consumption speed; Determine the estimated arrival time according to the charging distance and the preset personnel movement speed; Based on the estimated usage time being less than the estimated arrival time, match the required charging power of the wireless charging device according to the remaining battery information; Match the charging area number of the annular region where the experience personnel are located according to the positioning information of the wearable device; Correct the stepped charging power corresponding to the charging area number according to the required charging power.

6. A control system for a large-space immersive experience device, applying a control method for a large-space immersive experience device as described in any one of claims 1 to 5, characterized in that, Comprising: An acquisition module, configured to acquire the wearing trigger information, information trigger time, positioning information of the wearable device, attitude image information of the approaching personnel, collision trigger times, and remaining battery information of the wearable device; A memory, configured to store a program of a control method for a large-space immersive experience device; A processor, the program in the memory can be loaded and executed by the processor and implement a control method for a large-space immersive experience device.

7. An intelligent terminal, characterized in that, Comprising a memory and a processor, and a computer program capable of being loaded and executed by the processor is stored on the memory, and the computer program implements a control method for a large-space immersive experience device according to any one of claims 1 to 5.

Images