Control method and system of large-space immersive experience equipment and terminal

Abstract

The invention relates to a control method and system of a large-space immersive experience device and a terminal, and relates to the technical field of expanded reality, and the method comprises the steps: obtaining wearing trigger information and information trigger time of a wearable device and positioning information of the wearable device in a waiting area range; controlling a scanning device to scan the personnel according to the wearing trigger information to generate personnel feature data; creating a digital human model according to the personnel characteristic data; determining a personnel experience batch according to the information triggering time and the time batch table, and marking the digital human model according to the personnel experience batch; and when the positioning information of the wearable device enters the range of the activity area, projecting the digital human model in a scene picture, separating the digital human models of different personnel experience batches by using a batch separation method, and outputting the scene picture to a display device. The experience batch division is carried out on the experiencer, and separation is carried out according to the batch separation method, so that the experience efficiency of the XR experience equipment is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of augmented reality, and in particular to a control method, system and terminal for a large-space immersive experience device. Background Art

[0002] XR technology is a technology that combines the real world and the virtual world, providing users with an immersive interactive environment through computer technology and wearable devices. The experiencer wears the wearable device on his body, which includes a VR helmet. The display device in the VR helmet will display the image of the virtual world, and then the experiencer is arranged in a room that restores the proportion of the virtual world space in a one-to-one ratio to carry out activities.

[0003] In the prior art, when experiencing XR experience equipment, due to the limited room space for each scene screen, in order to ensure the experience of each experiencer and to ensure the personal safety of the experiencer, each room can only accommodate a certain number of experiencers to experience at the same time. Only after the current batch of experiencers completes the experience can the next batch of experiencers enter the room for experience, which is inefficient. Summary of the invention

[0004] In order to improve the experience efficiency of XR experience devices and enable more experiencers to experience the XR experience devices, the present invention provides a control method, system and terminal for a large-space immersive experience device.

[0005] In a first aspect, the present invention provides a control method for a large-space immersive experience device, which adopts the following technical solution: A control method for a large-space immersive experience device, comprising: Obtaining the wear trigger information, information trigger time and positioning information of the preset wearable device within the preset waiting area, where the wearable device includes a VR device and a wearable vest; According to the wear trigger information, the preset scanning device is controlled to scan the person and generate the person feature data; Create a digital human model based on personnel characteristic data; Determine the personnel experience batch according to the information trigger time and the preset time batch table, and mark the digital human model according to the personnel experience batch; When the positioning information of the wearable device enters the preset activity area, the digital human model is projected into the preset scene screen, the digital human models of different personnel experience batches are separated by the preset batch separation method, and the scene screen is output to the preset display device.

[0006] By adopting the above technical solution, the system pre-divides the experience batches of experiencers according to the information trigger time of each experiencer's wearable device, and the experiencer who generates the wear trigger information first will experience it first. When the experiencer puts on the wearable device and enters the activity area, the system will use the pre-set batch separation method to re-plan the experience time process of each batch of experiencers, thereby improving the experience efficiency of the experiencer's experience of XR devices.

[0007] Optionally, the scene screen has multiple different scene modules, and the batch separation method includes: The digital human model is divided into the previous batch characteristics and the current batch characteristics according to the personnel experience batch; Determine whether there are previous batch features that have entered the next scene module based on the positioning information of the wearable device of the previous batch features and the preset scene module features; If there are previous batch features that have entered the next scene module, the wearable device that controls the previous batch features will issue a countdown prompt; After a preset waiting time, the wearable device controlling the current batch of features issues a location prompt and guides the current batch of features into the activity area; The digital human model of the current batch characteristics is projected onto the scene screen, and the scene screen is output to the display device of the current batch characteristics.

[0008] Optionally, after the waiting time, when there are still features of the previous batch remaining in the scene module where the features of the current batch are located, the processing method includes: Determine the stranded personnel based on the positioning information and scenario modules of the wearable devices with the characteristics of the previous batch; Match the corresponding digital human model according to the stranded personnel; Make the digital human models of the stranded personnel in the scene module where the current batch features are located transparent; The stranded personnel are guided to enter the next scenario module using the preset guided evacuation method.

[0009] Optional guided evacuation methods include: Generate an evacuation route based on the positioning information of the wearable device of the stranded personnel and the preset entrance position of the next scene module; An evacuation digital channel is created in a preset guidance scene screen according to the evacuation path, the guidance scene screen is projected onto the display device of the stranded personnel, and guidance prompts are issued to guide the stranded personnel to move along the evacuation digital channel; Determine the location of the virtual wall based on the positioning information of the wearable device of the stranded person and the preset safety distance; Determine the evacuation speed of stranded personnel based on the positioning information of their wearable devices within a preset unit time; The preset virtual wall features are projected into the guidance scene screen according to the virtual wall position to isolate the stranded personnel from the current batch features, and the virtual wall features are controlled to follow the stranded personnel along the evacuation path in the scene screen according to the evacuation speed.

[0010] By adopting the above technical solution, the system will set a virtual wall feature in the scene screen, and the virtual wall feature is located between the stranded person and the experiencer of the current round of features, so that the stranded person can only move forward to enter the next scene module but cannot retreat to meet the experiencer of the current round of features; in the scene screen of the display device of the stranded person, the system will project an evacuation scene screen unique to the stranded person, and create an evacuation digital channel in the evacuation scene screen, and the experiencer can quickly enter the next scene module under the guidance of the system and along the evacuation digital channel.

[0011] Optionally, during the evacuation of stranded personnel, the processing method when the current batch feature is close to the virtual wall feature includes: Determine whether the stranded person has left the scene module where the current batch of features is located based on the positioning information of the stranded person's wearable device and the preset next scene module position; If the stranded personnel have left the scene module where the current batch feature is located, the virtual wall feature will be cancelled from the scene screen; If the stranded person has not left the scene module where the current batch feature is located, the current batch feature closest to the virtual wall is determined according to the position of the virtual wall and defined as a close person; The approach distance is determined based on the positioning information of the wearable device of the person approaching and the position of the virtual wall; When and only when the approach distance is 0, the posture information of the approaching person is obtained from the positioning information of the wearable device of the approaching person; Determine the collision trigger position of the wearable device based on the posture information of the person approaching and the position of the virtual wall; Determine the direction of the retreat prompt issued by the scene screen to the approaching person according to the collision trigger position; The wearable device is controlled to vibrate at the collision trigger position with a preset vibration intensity, and a retreat prompt is issued according to the retreat prompt direction to prompt the approaching person to stay away from the virtual wall feature, and after a preset reaction time, it is determined again whether the approach distance is 0; Currently, only when the approach distance is 0, the wearable device is controlled to vibrate continuously with the preset alarm vibration intensity and the preset continuous vibration time.

[0012] Optionally, also include: Get the number of collision triggers of wearable devices close to people; If and only if the number of collision triggers is greater than the preset number of overtaking option triggers, the preset overtaking option is output to a display device near the person, an overtaking prompt is issued, and posture image information of the person near the person is obtained; Based on the consistency between the posture image information and the agreed posture, a portal feature is generated at the virtual wall position in the scene screen; Determine whether the person near the door has passed through the portal feature based on the positioning information of the wearable device of the person near the door and the position of the virtual wall; When the approaching person passes through the portal feature, the approaching person will be marked as a stranded person, the digital human model of the stranded person will be made transparent, the guidance scene picture will replace the scene picture where the current batch feature is located and will be projected onto the display device of the stranded person, and a guidance prompt will be issued.

[0013] Optionally, if the wearable device has power loss that affects the device experience, the wearable device charging method includes: Get the remaining power information of the wearable device; Generate a device power mark based on the remaining power information and project the device power mark onto the experiencer's scene screen; Based on the remaining power information being less than a preset reference charging power, a charging reminder is issued, and a preset backup battery logo is projected onto the backup battery placement position of the scene screen; Determine the charging distance between each backup battery placement location and the experiencer based on the backup battery placement location and the positioning information of the wearable device; Arrange the charging distances in descending order to obtain the backup battery placement position corresponding to the minimum charging distance, and define it as the nearest charging position point; Match the charging guidance path according to the nearest charging location and the positioning information of the wearable device; Prompts are issued based on the charging guidance route to guide the experience to the nearest charging location to replace the backup battery.

[0014] Optionally, a wireless charging device is provided underground in the scene module for charging the wearable device. The method for handling the low battery of the wearable device when the experiencer goes to the nearest charging location includes: The ground of the scene module is divided into a plurality of annular areas with a radius that continuously changes from small to large, and the annular areas are numbered from the inside to the outside to obtain the charging area number; Control the charging power of the wireless charging device in the annular area to increase by a preset power increment according to the charging area number and determine the step charging power of the corresponding annular area; Determine the estimated usage time based on the remaining power information and the preset power consumption speed; Determine the estimated arrival time based on the charging distance and the preset personnel movement speed; Based on the estimated usage time being less than the estimated arrival time, the required charging power of the wireless charging device is matched according to the remaining power information; Match the charging area number of the circular area where the experiencer is located according to the positioning information of the wearable device; The step charging power corresponding to the charging area number is corrected according to the required charging power.

[0015] In the second aspect, the present application provides a control system for a large-space immersive experience device, which adopts the following technical solution: A control system for a large space immersive experience device, using the above-mentioned control method for a large space immersive experience device, comprises: Acquisition, used to obtain the wear trigger information of the wearable device, information trigger time, positioning information of the wearable device, posture image information of the person approaching, number of collision triggers, and remaining power information of the wearable device; A memory, used to store a program of a control method of a large-space immersive experience device; The program in the processor and the memory can be loaded and executed by the processor to realize a control method of a large-space immersive experience device.

[0016] In a third aspect, the present application provides a smart terminal, which adopts the following technical solution: An intelligent terminal comprises a memory and a processor, wherein the memory stores a computer program which can be loaded by the processor and executes a control method of a large-space immersive experience device.

[0017] In summary, the present application includes at least one of the following beneficial technical effects: 1. The system pre-divides the experience batches of experiencers based on the information trigger time of each experiencer's wearable device, and the experiencer who generates the wear trigger information first will experience it first. When the experiencer puts on the wearable device and enters the activity area, the system will use the pre-set batch separation method to re-plan the experience time process of each batch of experiencers, thereby improving the experience efficiency of the experiencer's experience of XR devices; 2. The system will set a virtual wall feature in the scene screen. The virtual wall feature is located between the stranded person and the experiencer of the current round of features, so that the stranded person can only move forward to enter the next scene module and cannot move backward to meet the experiencer of the current round of features; in the scene screen of the display device of the stranded person, the system will project an evacuation scene screen unique to the stranded person, and create an evacuation digital channel in the evacuation scene screen. The experiencer can quickly enter the next scene module under the guidance of the system and along the evacuation digital channel; 3. If the experiencers of the current batch of features approach and touch the virtual wall features, the wearable vests worn by the current batch of features can vibrate at the corresponding collision position, thereby prompting the experiencers of the current batch of features to stay away from the virtual wall features. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 It is a method flow chart of a control method of a large space immersive experience device according to an embodiment of the present invention; Figure 2 is a method flow chart of a batch separation method according to an embodiment of the present invention; Figure 3 It is a method flow chart of a method for processing when the previous round of batch features still remain in the scene module where the current batch features are located after the waiting time according to an embodiment of the present invention; Figure 4 is a method flow chart of a guided evacuation method according to an embodiment of the present invention; Figure 5 This is a method flow of a method for processing when the current batch feature is close to a barrier wall during the evacuation of stranded personnel in an embodiment of the present invention. Figure 1 ; Figure 6 This is a method flow of a method for processing when the current batch feature is close to a barrier wall during the evacuation of stranded personnel in an embodiment of the present invention. Figure 2 . DETAILED DESCRIPTION

[0019] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0020] The embodiment of the present application discloses a control method for a large-space immersive experience device.

[0021] Reference Figure 1 , a control method for a large space immersive experience device comprises the following steps: Step S100: obtaining the wear trigger information, information trigger time and positioning information of the preset wearable device within the preset waiting area, where the wearable device includes a VR device and a wearable vest.

[0022] The waiting area is opposite to the activity area, and both are set up by technical personnel. The waiting area is used for those who have not yet participated in the experience device to wait in line. At this time, the experiencer can wear the wearable device in advance, but will not enter the scene screen. The activity area is the area for the experiencer to experience. After the experiencer enters the activity area from the waiting area, the experiencer connects to the virtual space through the wearable device for experience.

[0023] Wear trigger information refers to information triggered when the experiencer wears the wearable device on his body, which is used to indicate that the experiencer has worn the wearable device on his body. When the experiencer puts on the wearable device, the system can read the wear trigger information directly from the wearable device. In this embodiment, the wearable device is a VR device and a wearable vest. The VR device can be a VR helmet. The VR helmet is integrated with a display device at a position relative to the experiencer's eyes for projecting the virtual world so that the experiencer can see the virtual world. The wearable vest is worn on the experiencer, and the wearable vest can interact with the features in the scene picture.

[0024] The information trigger time refers to the time when the wear trigger information is triggered. The information trigger time can be directly obtained by the system from the wearable device when the wear trigger information is triggered.

[0025] The positioning information of the wearable device refers to the position of the wearable device within the activity area or waiting area. Since the wearable device is worn by the experiencer, the positioning information can also be used to determine the location of the experiencer. The wearable device is equipped with a positioning chip, and the system can directly obtain the current location of the wearable device and the experiencer through the positioning chip.

[0026] Step S101: Control a preset scanning device to scan a person and generate person feature data according to the wear trigger information.

[0027] Personal characteristic data refers to the characteristic data collected by the user through scanning equipment in the waiting area. The personal characteristic data is used in the virtual world. When the user puts on the wearable device, the camera in the waiting area will scan the user in all directions to obtain the personal characteristic data.

[0028] Step S102: Creating a digital human model based on the personnel characteristic data.

[0029] The digital human model is a virtual portrait model in the virtual world, which corresponds to the experiencer in the real world. The experiencer can control the digital human model in the virtual world to carry out activities in the virtual world. The digital human model is created by analyzing the personnel feature data collected in advance by scanning. After the digital human model is created, the digital human model is temporarily saved in the database, and the digital human model is not directly projected into the scene screen. The method of creating a digital human model from personnel feature data is common knowledge known to those skilled in the art and will not be elaborated here.

[0030] Step S103: Determine the personnel experience batch according to the information triggering time and the preset time batch table, and mark the digital human model according to the personnel experience batch.

[0031] The time batch table is a classification basis set by technical personnel to divide the experiencers into batches. The time batch table divides the experiencers within each specific time range into a batch, which will not be elaborated here.

[0032] The personal experience batch refers to the batch into which the current experiencer is divided after putting on the wearable device. The experiencer experiences the device in sequence according to the personal experience batch.

[0033] By querying the time batch table according to the information triggering time, it is possible to determine the personnel experience batch to which the experiencer at the information triggering time belongs.

[0034] Step S104: When the positioning information of the wearable device enters the preset activity area, the digital human model is projected into the preset scene screen, the digital human models of different personnel experience batches are separated by a preset batch separation method, and the scene screen is output to a preset display device.

[0035] When it is the turn of the experiencer in the waiting area to experience, the experiencer will be brought into the activity area, and the system will detect the positioning information of the wearable device to determine whether the experiencer has entered the activity area. When the experiencer is within the activity area, a scene screen will appear in the experiencer's display device, and the pre-created digital human model can be projected into the scene screen, and the digital human models of the same batch of experiencers can be seen by each other in the scene screen. Since when this batch of experiencers enters the virtual world, there may still be a previous batch of experiencers in the virtual world of the current scene, it is necessary to separate the two so that they do not interfere with each other. Here, the batch separation method is used for separation. The batch separation method is not described in detail here, and is described in detail in subsequent embodiments.

[0036] Reference Figure 2 , the batch separation method includes the following steps: In this embodiment, the activity area has multiple different scene modules, and experiencers in two scene modules do not interfere with each other.

[0037] Step S200: Divide the digital human model into the previous batch characteristics and the current batch characteristics according to the personnel experience batch.

[0038] The characteristics of the previous batch and the current batch both refer to the experiencers and their digital human models. The characteristics of the previous batch are the experiencers who have entered the activity area for a period of time, and the characteristics of the current batch are the experiencers who are about to enter the activity area for experience.

[0039] The characteristics of the previous batch and the current batch can be determined by dividing the batches of personnel experience. The digital human models of different batches are divided to facilitate the processing of digital human models of different batches without interfering with each other.

[0040] Step S201: Determine whether there is a previous round of batch features that has entered the next scene module based on the positioning information of the wearable device of the previous round of batch features and the preset scene module features.

[0041] The system detects the location information of the experiencers of the previous batch characteristics, compares the location information with the location of the next scene module characteristics, and determines whether the experiencers of the previous batch characteristics have entered the next scene module. The experiencers of the current batch characteristics can be arranged according to the situation of the experiencers of the previous batch characteristics entering the next scene module.

[0042] Step S202: If there is a previous batch feature that has entered the next scene module, the wearable device that controls the previous batch feature issues a countdown prompt.

[0043] If there is positioning information in the next scene module, it means that some experiencers in the previous batch of features have entered the next scene module, which means that most of the experiencers in the previous batch of features are about to complete the current scene module. At this time, the system will arrange the experiencers of the current batch of features to enter the activity area. In order to enable the experiencers of the previous batch of features to quickly enter the next scene module, the system will issue a countdown to remind the experiencers of the previous batch of features.

[0044] If there are no experiencers with the characteristics of the previous batch in the next scene module, it means that the experiencers with the characteristics of the previous batch are still experiencing the current scene module, and the experiencers with the characteristics of the current batch still need to wait in the waiting area.

[0045] Step S203: After a preset waiting time, the wearable device of the current batch of features is controlled to issue a location prompt and guide the current batch of features to enter the activity area.

[0046] The waiting time is the waiting time set by the technician from the start of the next scene module from the previous round of batch features to the preparation of the current batch features to enter the current scene module. This waiting time is mainly used to allow stranded personnel in the previous round of batch features to enter the next scene module.

[0047] Step S204: projecting the digital human model of the current batch characteristics onto the scene screen, and outputting the scene screen to the display device of the current batch characteristics.

[0048] After the experiencers of the current batch of characteristics enter the activity area, their corresponding digital human models will also be projected onto the current scene.

[0049] Reference Figure 3 After the waiting time, if there are still features from the previous batch remaining in the scene module where the features from the current batch are located, the system needs to perform targeted processing on the user. The processing method includes the following steps: Step S300: Determine the stranded persons based on the positioning information of the wearable devices with the characteristics of the previous batch and the scene module.

[0050] By obtaining the location information of the previous batch characteristics and comparing it with the location of the current scene module, the experiencers of the previous batch characteristics whose location information is still at the location of the current scene module will be set as stranded persons. Stranded persons are experiencers who should have entered the next scene module but have not yet entered. In order to ensure that stranded persons do not meet and interfere with experiencers of the current batch characteristics, stranded persons need to be processed.

[0051] Step S301: matching a corresponding digital human model according to the stranded personnel.

[0052] In addition to processing the stranded person in the real world, the digital human model corresponding to the stranded person in the virtual world also needs to be processed. By determining the information of the stranded person, the corresponding digital human model can be matched.

[0053] Step S302: Make the digital human model of the stranded personnel in the scene module where the current batch characteristics are located transparent.

[0054] In order to ensure that the current batch of experiencers will not see the digital human models of stranded people when they enter the activity area, the system will make the digital human models of stranded people transparent, and this operation will not affect the experience of stranded people in their scene images.

[0055] Step S303: guiding the stranded personnel to enter the next scene module using a preset evacuation guidance method.

[0056] After the digital human model is made transparent, the system will guide the stranded personnel through the guided evacuation method so that they can quickly enter the next scene module. The system will guide them in the real world and also guide them synchronously in the virtual world. The guided evacuation method will not be described here, but will be described in detail in subsequent embodiments.

[0057] Reference Figure 4 , the guided evacuation method includes the following steps: In this embodiment, a virtual wall feature is set between the stranded personnel in the scene screen and the experiencers of the current batch feature, and the virtual wall feature is used to prevent the stranded personnel from running in the wrong direction.

[0058] Step S400: Generate an evacuation route based on the positioning information of the wearable device of the stranded person and the preset entrance position of the next scene module.

[0059] The evacuation path refers to the route that stranded personnel need to move to evacuate to the next scenario module.

[0060] The entry position of the next scene module is a fixed position point in the scene, which will not be described here.

[0061] When the location of the stranded person is determined, the system can determine the shortest route between the two points based on the position in the scene screen corresponding to the current location of the stranded person and the entrance position of the next scene module, and the stranded person can move along the shortest route.

[0062] Step S401: creating an evacuation digital channel in a preset guidance scene picture according to the evacuation path, projecting the guidance scene picture onto the display device of the stranded personnel, and issuing guidance prompts to guide the stranded personnel to move along the evacuation digital channel.

[0063] In this embodiment, in order to enable the stranded personnel to concentrate on entering the next scene module without being attached to the current scene module, the system will replace the current scene picture with the guidance scene picture and project it on the display device of the stranded personnel. The guidance scene picture is a scene picture generated by the system for the stranded personnel to quickly enter the next scene module, and there is no other digital human model in it.

[0064] The evacuation digital channel is a channel generated by the system, which will be displayed in the guidance scene screen. The stranded personnel can see the evacuation digital channel in the guidance scene screen and move along the evacuation digital channel under the guidance of the system.

[0065] Step S402: Determine the position of the virtual wall according to the positioning information of the wearable device of the stranded person and the preset safety distance.

[0066] The safety distance is the distance that the technician sets to be maintained from stranded personnel when setting up the virtual wall feature.

[0067] By obtaining the real-time positioning information of the stranded person, and then extending the safety distance in the direction of the experiencers of the current batch of characteristics from the location of the positioning information, the position obtained at this time is the virtual wall position. The virtual wall position is set between the stranded person and the experiencers of the current batch of characteristics, which can separate the stranded person from the experiencers of the current batch of characteristics.

[0068] Step S403: Determine the evacuation speed of the stranded personnel according to the positioning information of the wearable device of the stranded personnel within a preset unit time.

[0069] The evacuation speed is the moving speed of the stranded personnel on the evacuation path. The evacuation speed can be determined by determining the change in the positioning information of the stranded personnel per unit time.

[0070] Step S404: projecting a preset virtual wall feature into the guidance scene screen according to the virtual wall position to isolate the stranded personnel from the current batch feature, and controlling the virtual wall feature to follow the stranded personnel along the evacuation path in the scene screen according to the evacuation speed.

[0071] After determining the position of the virtual wall according to the location of the stranded person, the system projects the virtual wall feature into the scene screen to isolate the stranded person and the current batch feature. Since the stranded person is blocked by the virtual wall feature behind him, the stranded person can only move along the evacuation path to the next scene module, and the virtual wall feature will move with the stranded person until the stranded person enters the next scene module.

[0072] Reference Figure 5 ,During the process of evacuating stranded personnel, when the current batch feature is close to the virtual wall feature, the processing method includes the following steps: Step S500: Determine whether the stranded person has left the scene module where the current batch feature is located based on the positioning information of the stranded person's wearable device and the preset next scene module position.

[0073] The positioning information of the stranded person is obtained and compared with the location of the next scene module. If the two are consistent, it means that the stranded person has left the scene module where the current batch feature is located. Otherwise, it means that the stranded person has not left.

[0074] When the experiencers of the current batch of features approach the virtual wall feature, whether the stranded personnel have left the current scene module will affect the system's control over the virtual wall feature, so it is necessary to make a judgment first.

[0075] Step S5011: If the stranded personnel have left the scene module where the current batch feature is located, the virtual wall feature is cancelled from the scene screen.

[0076] If the stranded personnel have left the current scene module, the virtual wall feature has lost its function. At this time, when the experiencers of the current batch of features approach the virtual wall feature, the system will directly remove the virtual wall feature, so that there is no virtual wall feature in the scene screen of the current scene module to interfere with the experiencers of the current batch of features.

[0077] Step S5012: If the stranded personnel have not left the scene module where the current batch feature is located, the current batch feature closest to the virtual wall is determined according to the position of the virtual wall and defined as a close person.

[0078] If the stranded person has not left the current scene module, the system cannot directly virtualize the wall feature because the stranded person may be evacuating in the evacuation path at this time.

[0079] In this embodiment, the system obtains the positioning information of each experiencer of the current batch of features and compares it with the position of the virtual wall, so as to determine the experiencer of the current batch of features who is closest to the virtual wall feature. This experiencer is the close person, and the close person is the person who is most likely to collide with the virtual wall feature.

[0080] When a nearby person is found, the system processes the relationship between the nearby person and the virtual wall features.

[0081] Step S503: Determine the approach distance according to the positioning information of the wearable device of the approaching person and the position of the virtual wall.

[0082] The approach distance refers to the distance between the approaching person and the virtual wall feature. The approach distance can be calculated based on the positioning information of the approaching person and the position of the virtual wall.

[0083] Step S504: When and only when the approach distance is 0, obtain the posture information of the approaching person from the positioning information of the wearable device of the approaching person.

[0084] If the approach distance is not 0, it means that the distance between the approaching person and the virtual wall feature is far, and the approaching person will not touch the virtual wall feature temporarily. At this time, there is no need to process the virtual wall feature.

[0085] If the approach distance is 0, it means that the approaching person has hit the virtual wall feature. At this time, the wearable vest worn by the approaching person can interact with the virtual wall.

[0086] The posture information of the approaching person refers to the body posture of the approaching person when the approaching person touches the virtual wall feature, and the posture information can be obtained by performing image recognition analysis on the approaching person through a camera. When the approaching person touches the virtual wall feature with different posture information, the body parts of the approaching person and the virtual wall feature touch different parts.

[0087] Step S505: Determine the collision trigger position of the wearable device according to the posture information of the approaching person and the position of the virtual wall.

[0088] The collision trigger position of the wearable device refers to the position where the wearable vest simulates a collision feeling when the approaching person touches the virtual wall feature. After the posture information of the approaching person is determined, the part where the approaching person's body overlaps with the virtual wall feature is the collision trigger position of the wearable device.

[0089] Step S506: Determine the direction of the retreat prompt issued by the scene screen to the approaching person according to the collision trigger position.

[0090] The retreat prompt direction is the retreat direction issued by the system through the wearable device in the scene screen to prompt the approaching person to move away from the virtual wall feature. The retreat prompt direction is the opposite direction of the collision trigger position.

[0091] Step S507: Control the wearable device to vibrate at the collision trigger position with a preset vibration intensity, and issue a retreat prompt according to the retreat prompt direction to prompt the approaching person to stay away from the virtual wall feature, and determine again whether the approach distance is 0 after a preset reaction time.

[0092] In this embodiment, when a person approaches and collides with a virtual wall feature, the vest will vibrate at the collision trigger position to prompt the person to give way. The vibration intensity is the intensity of vibration generated by the vest set by the technician. Vibrating the human body with this vibration intensity is not likely to cause harm to the human body but can make people feel a collision. It will not be described in detail here.

[0093] When the vest vibrates, the system will simultaneously send a prompt to the person approaching, telling them in which direction they need to retreat.

[0094] The reaction time is the time set by the technician for the wearable device to vibrate and give the nearby person the time to make the next retreat action. It will not be elaborated here.

[0095] After the reaction time, the system will confirm again whether the approaching person is away from the virtual wall feature to make the next operation.

[0096] Step S508: Currently, only when the approach distance is 0, the wearable device is controlled to continuously vibrate with a preset alarm vibration intensity and a preset continuous vibration time.

[0097] If the approach distance of the person is not 0 during reconfirmation, it means that the person has moved away from the virtual wall feature, and the vest will stop vibrating. If the approach distance of the person is still 0 during reconfirmation, it means that the person has not retreated.

[0098] The alarm vibration intensity is the intensity of vibration generated by the wearable device when the system forces the approaching person to retreat, as set by the technician. The alarm vibration intensity is greater than the vibration intensity when the approaching person first touches the virtual wall feature, and is not described here. The continuous vibration time is the duration of the wearable device vibrating at the alarm vibration intensity, and is not described here.

[0099] When the person approaching does not retreat, the system will control the vest to continue to vibrate to drive the person approaching away from the virtual wall feature.

[0100] Reference Figure 6 , during the evacuation of stranded personnel, the processing method when the current batch feature is close to the virtual wall feature also includes the following steps: Step S600: Obtain the number of collision triggers of the wearable device close to the person.

[0101] The number of collision triggers is the number of times the wearable device vibrates due to continuous collisions between a nearby person and the virtual wall features. The wearable device can automatically record the number of collision triggers and can be directly read by the system.

[0102] Step S601: If and only if the number of collision triggers is greater than the preset number of overtaking option triggers, the preset overtaking option is output to a display device near the person, an overtaking prompt is issued, and posture image information of the person near the person is obtained.

[0103] In this embodiment, for the approaching person who has collided with the virtual wall feature multiple times and shows that he wants to enter the next scene module, the system will provide a surpass option. The surpass option is an option screen for human-computer interaction with the experiencer in the scene screen, which is an option for the approaching person to enter the next scene module in advance. It can be projected in the form of a physical frame in the scene screen of the approaching person for the approaching person to choose.

[0104] The number of times the override option is triggered is the number of collisions set by the technician that can trigger the override option. The number of collisions is the number of times a nearby person collides with the virtual wall feature, which will not be described in detail here.

[0105] When the number of collision triggers is not greater than the number of overtaking option triggers, the system will not trigger the overtaking option. When the number of collision triggers is greater than the number of overtaking option triggers, the system will project the selection box corresponding to the overtaking option on the scene screen close to the person, which can only be seen by the close person, and decide the subsequent action based on the actual reaction of the close person.

[0106] The posture image information of the person approaching refers to the posture movement of the person approaching obtained by the camera. Specific posture movements can produce different interactive meanings in the scene screen of the virtual world, which are used to interact with the transcendence option.

[0107] Step S602: Based on the consistency between the posture image information and the agreed posture, a portal feature is generated at the virtual wall position in the scene image.

[0108] The consent gesture is a gesture action in the scene screen of the virtual world set by the technician, which is used to interact with the transcendence option, and will not be described in detail here. In this embodiment, the transcendence option has two selection items, consent or rejection. If any one of them is selected, the system will react according to the selection result of the experiencer.

[0109] When the surpass option appears, if the camera detects that the posture image information of the approaching person is inconsistent with the agreed posture, it means that the approaching person does not want to enter the next scene module in advance, and the approaching person can continue to stay in the current scene module and continue to experience.

[0110] If the camera detects that the posture image information of the approaching person is consistent with the consent posture, it means that the experiencer has selected consent in the transcendence option of the scene screen. After selecting consent, the system determines that the approaching person agrees to enter the next scene module in advance.

[0111] The portal feature is a virtual door generated by the system in the scene screen, which is used for the nearby person to pass through to enter the next scene module. The portal feature is set on the virtual wall feature, that is, the portal feature appears on the virtual wall feature. When the nearby person agrees to enter the next scene module in advance, the portal feature will be generated on the virtual wall feature for the nearby person to enter.

[0112] Step S603: Determine whether the nearby person has passed through the portal feature based on the positioning information of the wearable device of the nearby person and the position of the virtual wall.

[0113] By obtaining the positioning information of the nearby person and comparing the positioning information with the location of the virtual wall, it is determined whether the nearby person passes through the channel feature and whether he interacts with the portal feature.

[0114] Step S604: When the approaching person passes through the portal feature, the approaching person is marked as a stranded person, the digital human model of the stranded person is made transparent, the guidance scene picture replaces the scene picture where the current batch feature is located and is projected on the display device of the stranded person, and a guidance prompt is issued.

[0115] When the nearby person enters the evacuation path, the system will redefine the nearby person as a stranded person and classify his / her experience batch into the previous round of batch features. When a stranded person becomes a stranded person, the system will guide the experiencer to quickly enter the next scene module using the treatment method for stranded persons. The treatment method for stranded persons is to make the digital human model of the experiencer transparent and replace the scene screen where the current batch features are located with the guidance scene screen.

[0116] If the wearable device loses power and affects the device experience, the charging method of the wearable device includes the following steps: Step S700: Obtaining the remaining power information of the wearable device.

[0117] The system can directly obtain the remaining power information from the wearable device's system. When the remaining power is insufficient, the wearable device's system will shut down, making it impossible to continue interacting with the scene screen.

[0118] Step S701: Generate a device power mark based on the remaining power information, and project the device power mark onto the scene screen of the experiencer.

[0119] The device power mark is a shape mark generated by the system in the scene screen, which is used to let the experiencer know the current power status of the wearable device. The device power mark corresponds to the remaining power information one by one, and the remaining power information can be input into the preset power mark database for matching. The power mark database is a database pre-set by the technician, which contains the one-to-one correspondence between the remaining power information and the device power mark, which will not be described here.

[0120] Step S702: Based on the remaining power information being less than a preset reference charging power, a charging reminder is issued, and a preset backup battery logo is projected onto the backup battery placement position of the scene screen.

[0121] The benchmark charging power is the power level set by the technician for the wearable device to be used normally. When the remaining power information is less than the benchmark charging power, it will affect the normal use of the wearable device, which will not be elaborated here.

[0122] When the system detects that the remaining power information is less than the benchmark charging power, the system will send a charging reminder to the experiencer, prompting the experiencer to replace the battery.

[0123] In this embodiment, multiple backup battery placement locations for backup batteries are distributed around the scene module. When the wearable device is low on power, the experiencer can go there to replace the battery. In addition, in order to facilitate the experiencer to know the location of the backup battery placement location, the system will generate a backup battery mark at the backup battery placement location in the scene screen. The backup battery mark is a shape mark generated by the system in the scene screen to indicate the backup battery.

[0124] Step S703: Determine the charging distance between each backup battery placement location and the experiencer according to the backup battery placement location and the positioning information of the wearable device.

[0125] The charging distance refers to the distance that the user needs to move from the current location to the backup battery placement location. The charging distance can be determined by the backup battery placement location and the positioning information of the wearable device, which is the straight-line distance between the two.

[0126] Step S704: Arrange the charging distances in descending order to obtain the backup battery placement position corresponding to the minimum charging distance, and define it as the nearest charging position point.

[0127] Since there are multiple backup battery placement locations in the scene module, in order to recharge the wearable device more quickly, the system will prompt the nearest backup battery placement location. The nearest charging location is the backup battery placement location closest to the experiencer. When the distance between each backup battery placement location and the experiencer is determined, all charging distances are sorted to obtain the nearest charging location.

[0128] Step S705: matching a charging guidance path according to the nearest charging location point and the positioning information of the wearable device; The charging guidance path is the shortest path from the experiencer to the nearest charging location. The charging guidance path is generated by the system based on the positioning information of the nearest charging location and the wearable device.

[0129] Step S706: Prompt the user according to the charging guidance path to guide the user to go to the nearest charging location to replace the backup battery.

[0130] When the wearable device is low on battery, the system will prompt and guide the experiencer according to the charging guidance path, allowing the experiencer to move along the charging guidance path and recharge the wearable device in the shortest time.

[0131] In the embodiment, a wireless charging device is provided under the scene module for wirelessly charging the wearable device. The wireless charging principle here is electromagnetic induction charging, and the wearable device can be charged when the person stands on the ground. The method for handling the low battery of the wearable device when the experiencer goes to the nearest charging location includes the following steps: In this embodiment, a wireless charging device covering the entire scene module is installed underground in the scene module. The charging power of the wireless charging device is annular and stepped. The charging power in the center area of ​​the scene module is the smallest, and the charging power in the outermost part is the largest. The charging power in between is stepped, and the charging power in the annular area is the same. In addition, the charging power at any position on the ground of the scene module can be changed.

[0132] Step S800: Divide the ground of the scene module into a plurality of annular areas with radii that continuously change from small to large, and number the annular areas in sequence from inside to outside to obtain charging area numbers.

[0133] After each annular area of ​​the wireless charging device is numbered from the inside to the outside to obtain the charging area number, it is convenient to determine in which annular area with which charging area number the experiencer is located in the subsequent embodiments, so as to adjust the charging power of the charging area.

[0134] Step S801: controlling the charging power of the wireless charging device in the annular area to increase by a preset power increment according to the charging area number and determining the step charging power of the corresponding annular area.

[0135] The step charging power refers to the charging power of the wireless charging device in each annular area. In this embodiment, the charging power of the wireless charging device in the annular area changes in a stepped shape according to the charging area number, that is, the charging power of the wireless charging device in the center area with the smallest number is the smallest, and the charging power of the wireless charging device in the peripheral area with the largest number is the largest. The charging power difference between adjacent annular areas is the power increment. The power increment is a parameter set by the technician when designing the wireless charging device under the scene module, which will not be elaborated here.

[0136] The wireless charging device is controlled by using a step-charging power method to adapt to the situation when the experiencer is experiencing the device. Experiencers are mostly concentrated in the central area, and the step-charging power is relatively small at this time, which does not affect the normal use of the wearable device. When the wearable device is low in power, the experiencer moves to the outermost backup battery placement position. The further outward they move, the greater the step-charging power, making it less likely for the wearable device to be powered off.

[0137] Step S802: Determine the estimated usage time according to the remaining power information and the preset power consumption speed.

[0138] The power consumption rate refers to the power consumption speed of the wearable device itself when it is in use, which will not be elaborated here.

[0139] The estimated usage time is the time that the wearable device can continue to be used before it runs out of power. The estimated usage time is the quotient of the remaining power information and the power consumption rate.

[0140] Step S803: Determine the estimated arrival time based on the charging distance and the preset personnel moving speed.

[0141] The personnel movement speed is the maximum running speed that the experiencer can achieve when experiencing the equipment.

[0142] The estimated time to reach the destination refers to the time required for the user to move from the current location to the backup battery location. The estimated time to reach the destination is the quotient of the charging distance and the user's moving speed.

[0143] Step S804: Based on the estimated usage time being less than the estimated arrival time, the required charging power of the wireless charging device is matched according to the remaining power information.

[0144] If the estimated usage time is not less than the estimated arrival time, it means that the wearable device can reach the backup battery placement location for battery replacement before it is completely out of power.

[0145] If the estimated usage time is less than the estimated arrival time, it means that the wearable device will run out of power before reaching the backup battery placement location. Even if there is a wireless charging device to charge the wearable device at all times, the charging power is slower than the power consumption rate. At this time, the charging power of the wireless charging device needs to be corrected so that the power of the wearable device can support the backup battery placement location.

[0146] The required charging power refers to the power that can balance the charging speed and power consumption speed of the wearable device to keep the wearable device powered on. It is the power that corrects the step charging power of the wireless charging device.

[0147] The required charging power is inversely proportional to the remaining power information. The smaller the remaining power information, the greater the required charging power.

[0148] Step S805: Match the charging area number of the circular area where the experiencer is located according to the positioning information of the wearable device.

[0149] Based on the positioning information of the wearable device, the circular area where the experiencer is currently located can be known, and the charging area number of the circular area can be correspondingly assigned.

[0150] Step S806: Correct the step charging power corresponding to the charging area number according to the required charging power.

[0151] After the charging area number of the annular area is determined, the system can control the wireless charging device in the annular area corresponding to the charging area number to perform power correction according to the charging area number. When the experiencer appears in the annular area, the step charging power is corrected according to the required charging power.

[0152] Based on the same inventive concept, an embodiment of the present invention provides a control system for a large space immersive experience device, and applies a control method for the large space immersive experience device, including: The acquisition module is used to obtain the wear trigger information of the wearable device, the information trigger time, the positioning information of the wearable device, the posture image information of the person approaching, the number of collision triggers, and the remaining power information of the wearable device.

[0153] A memory is used to store a program of a control method for a large-space immersive experience device.

[0154] The program in the processor and the memory can be loaded and executed by the processor to realize a control method of a large-space immersive experience device.

[0155] Based on the same inventive concept, an embodiment of the present invention provides a smart terminal, including a memory and a processor, wherein the memory stores a computer program that can be loaded by the processor and executes a control method for a large-space immersive experience device.

[0156] The above is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should also be regarded as the protection scope of the present invention.

Claims

1. A control method for a large space immersive experience device, characterized in that: include: Obtaining the wear trigger information, information trigger time and positioning information of the preset wearable device within the preset waiting area, where the wearable device includes a VR device and a wearable vest; According to the wear trigger information, the preset scanning device is controlled to scan the person and generate the person feature data; Create a digital human model based on personnel characteristic data; Determine the personnel experience batch according to the information trigger time and the preset time batch table, and mark the digital human model according to the personnel experience batch; When the positioning information of the wearable device enters the preset activity area, the digital human model is projected into the preset scene screen, the digital human models of different personnel experience batches are separated by the preset batch separation method, and the scene screen is output to the preset display device.

2. The control method of a large space immersive experience device according to claim 1, characterized in that: The scene screen has multiple different scene modules, and the batch separation methods include: The digital human model is divided into the previous batch characteristics and the current batch characteristics according to the personnel experience batch; Determine whether there are previous batch features that have entered the next scene module based on the positioning information of the wearable device of the previous batch features and the preset scene module features; If there are previous batch features that have entered the next scene module, the wearable device that controls the previous batch features will issue a countdown prompt; After a preset waiting time, the wearable device controlling the current batch of features issues a location prompt and guides the current batch of features into the activity area; The digital human model of the current batch characteristics is projected onto the scene screen, and the scene screen is output to the display device of the current batch characteristics.

3. The control method of a large space immersive experience device according to claim 2, characterized in that: After the waiting time, if there are still features from the previous batch remaining in the scene module where the features from the current batch are located, the processing methods include: Determine the stranded personnel based on the positioning information and scenario modules of the wearable devices with the characteristics of the previous batch; Match the corresponding digital human model according to the stranded personnel; Make the digital human models of the stranded personnel in the scene module where the current batch features are located transparent; The stranded personnel are guided to enter the next scenario module using the preset guided evacuation method.

4. The control method of a large space immersive experience device according to claim 3, characterized in that: Guided evacuation methods include: Generate an evacuation route based on the positioning information of the wearable device of the stranded personnel and the preset entrance position of the next scene module; An evacuation digital channel is created in a preset guidance scene screen according to the evacuation path, the guidance scene screen is projected onto the display device of the stranded personnel, and guidance prompts are issued to guide the stranded personnel to move along the evacuation digital channel; Determine the location of the virtual wall based on the positioning information of the wearable device of the stranded person and the preset safety distance; Determine the evacuation speed of stranded personnel based on the positioning information of their wearable devices within a preset unit time; The preset virtual wall features are projected into the guidance scene screen according to the virtual wall positions to isolate the stranded personnel from the current batch features, and the virtual wall features are controlled to follow the stranded personnel along the evacuation path in the scene screen according to the evacuation speed.

5. The control method of a large space immersive experience device according to claim 4, characterized in that: During the evacuation of stranded personnel, the processing methods when the current batch feature is close to the virtual wall feature include: Determine whether the stranded person has left the scene module where the current batch of features is located based on the positioning information of the stranded person's wearable device and the preset next scene module position; If the stranded personnel have left the scene module where the current batch feature is located, the virtual wall feature will be cancelled from the scene screen; If the stranded person has not left the scene module where the current batch feature is located, the current batch feature closest to the virtual wall is determined according to the position of the virtual wall and defined as a close person; The approach distance is determined based on the positioning information of the wearable device of the person approaching and the position of the virtual wall; When and only when the approach distance is 0, the posture information of the approaching person is obtained from the positioning information of the wearable device of the approaching person; Determine the collision trigger position of the wearable device based on the posture information of the person approaching and the position of the virtual wall; Determine the direction of the retreat prompt issued by the scene screen to the approaching person according to the collision trigger position; The wearable device is controlled to vibrate at the collision trigger position with a preset vibration intensity, and a retreat prompt is issued according to the retreat prompt direction to prompt the approaching person to stay away from the virtual wall feature, and after a preset reaction time, it is determined again whether the approach distance is 0; Currently, only when the approach distance is 0, the wearable device is controlled to vibrate continuously with the preset alarm vibration intensity and the preset continuous vibration time.

6. The control method of a large space immersive experience device according to claim 5, characterized in that: Also includes: Get the number of collision triggers of wearable devices close to people; If and only if the number of collision triggers is greater than the preset number of overtaking option triggers, the preset overtaking option is output to a display device near the person, an overtaking prompt is issued, and posture image information of the person near the person is obtained; Based on the consistency between the posture image information and the agreed posture, a portal feature is generated at the virtual wall position in the scene screen; Determine whether the person near the door has passed through the portal feature based on the positioning information of the wearable device of the person near the door and the position of the virtual wall; When the approaching person passes through the portal feature, the approaching person will be marked as a stranded person, the digital human model of the stranded person will be made transparent, the guidance scene picture will replace the scene picture where the current batch feature is located and will be projected onto the display device of the stranded person, and a guidance prompt will be issued.

7. The control method of a large space immersive experience device according to claim 1, characterized in that: If the wearable device loses power and affects the device experience, the charging methods for the wearable device include: Get the remaining power information of the wearable device; Generate a device power mark based on the remaining power information and project the device power mark onto the experiencer's scene screen; Based on the remaining power information being less than a preset reference charging power, a charging reminder is issued, and a preset backup battery logo is projected onto the backup battery placement position of the scene screen; Determine the charging distance between each backup battery placement location and the experiencer based on the backup battery placement location and the positioning information of the wearable device; Arrange the charging distances in descending order to obtain the backup battery placement position corresponding to the minimum charging distance, and define it as the nearest charging position point; Match the charging guidance path according to the nearest charging location and the positioning information of the wearable device; Prompts are issued based on the charging guidance route to guide the experience to the nearest charging location to replace the backup battery.

8. The control method of a large space immersive experience device according to claim 7, characterized in that: A wireless charging device is installed underground in the scene module to charge the wearable device. The methods for dealing with low battery of the wearable device when the experiencer goes to the nearest charging location include: The ground of the scene module is divided into a plurality of annular areas with a radius that continuously changes from small to large, and the annular areas are numbered from the inside to the outside to obtain the charging area number; Control the charging power of the wireless charging device in the annular area to increase by a preset power increment according to the charging area number and determine the step charging power of the corresponding annular area; Determine the estimated usage time based on the remaining power information and the preset power consumption speed; Determine the estimated arrival time based on the charging distance and the preset personnel movement speed; Based on the estimated usage time being less than the estimated arrival time, the required charging power of the wireless charging device is matched according to the remaining power information; Match the charging area number of the circular area where the experiencer is located according to the positioning information of the wearable device; The step charging power corresponding to the charging area number is corrected according to the required charging power.

9. A control system for a large space immersive experience device, using a control method for a large space immersive experience device as claimed in any one of claims 1 to 8, characterized in that: include: An acquisition module is used to acquire the wear trigger information of the wearable device, the information trigger time, the positioning information of the wearable device, the posture image information of the person approaching, the number of collision triggers, and the remaining power information of the wearable device; A memory, used to store a program of a control method of a large-space immersive experience device; The program in the processor and the memory can be loaded and executed by the processor to realize a control method of a large-space immersive experience device.

10. An intelligent terminal, characterized in that: The invention comprises a memory and a processor, wherein the memory stores a computer program which can be loaded by the processor and executes a control method of a large space immersive experience device.

Images