Tracking mobile interaction method, cave automatic virtual environment system, equipment and medium

Abstract

The invention provides a tracking mobile interaction method, a cave automatic virtual environment system, equipment and a medium. The CAVE system comprises a real space, a virtual space, a wireless control device and projection equipment, wherein the real space comprises a single camera device; the method comprises the steps that target object information in a real space is obtained through a camera device, the target object information is updated to a virtual space, and if the first distance between the target position and the position of a virtual anchor point is smaller than or equal to a first preset distance threshold value, the virtual anchor point moves to the target position. Controlling the projection equipment to display a first virtual motion picture, wherein the first virtual motion picture comprises a virtual environment picture and a target motion picture; if the first distance is larger than the first preset distance threshold value, the projection equipment is controlled to display a second virtual motion picture, the second virtual motion picture comprises the target object and a picture enabling the virtual environment picture to move based on a control instruction of the wireless control device, and more natural and visual navigation experience can be provided.

Description

Technical Field

[0001] This application relates to the field of virtual simulation technology, specifically to a tracking motion interaction method, an automated virtual environment system for caves, equipment, and media. Background Technology

[0002] A Cave Automatic Virtual Environment (CAVE) is an immersive, multi-screen display and interactive environment that provides users with an immersive experience by displaying 3D virtual content on the surrounding walls. However, navigation in a CAVE system faces many challenges, such as the need to introduce expensive sensors for accurate tracking, resulting in high manufacturing costs; or the movement limitations caused by the large difference in scale between the physical space and the virtual environment in the CAVE system.

[0003] Existing tracking solutions rely on wearable devices or complex multi-camera setups, which increase operational limitations and system costs; other existing navigation methods, such as click-to-transfer technology or continuous walking, often struggle to balance immersion, user experience, and information acquisition efficiency. Summary of the Invention

[0004] This application addresses the problems of high manufacturing cost, low information acquisition rate, and poor user experience in existing CAVE navigation systems by proposing a tracking mobile interaction method, an automated virtual environment system for caves, equipment, and media.

[0005] In a first aspect, embodiments of this application provide a tracking and interaction method for mobile objects in a virtual environment, applied to an automated virtual environment system for caves. The system includes a real space, a virtual space, a wireless control device, and a projection device. The real space includes a single camera device. The method includes: acquiring target object information in the real space using the camera device and synchronously updating the target object information to the virtual space. The target object information includes the target object, its target position, and a target motion image. If a first distance between the target position and a preset virtual anchor point is less than or equal to a first preset distance threshold, the projection device is controlled to display a first virtual motion image of the virtual space. The first virtual motion image includes a pre-generated virtual environment image and the target motion image. The virtual anchor point is a reference point pre-created in the virtual space. If the first distance is greater than the first preset distance threshold, the projection device is controlled to display a second virtual motion image of the virtual space. The second virtual motion image includes the target object and a motion image controlled by the wireless control device, which controls the pre-generated virtual environment image to move.

[0006] Secondly, this application provides an automated virtual environment system for caves, comprising: a real space, a virtual space, a wireless control device, and a projection device. The real space includes a single camera device. An acquisition module is used to acquire target object information in the real space using the camera device and synchronously update the target object information to the virtual space. The target object information includes the target object, its target position, and a target motion image. A first display module is used to control the projection device to display a first virtual motion image of the virtual space if the first distance between the target position and the position of a preset virtual anchor point is less than or equal to a first preset distance threshold. The first virtual motion image includes a pre-generated virtual environment image and the target motion image. The virtual anchor point is a reference point pre-created in the virtual space. A second display module is used to control the projection device to display a second virtual motion image of the virtual space if the first distance between the target position and the position of the preset virtual anchor point is greater than the first preset distance threshold. The second virtual motion image includes a frame showing the pre-generated virtual environment image moving based on control commands from the wireless control device and the target object.

[0007] Thirdly, embodiments of this application provide an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, it implements the method described in the first aspect above.

[0008] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the method described in the first aspect above.

[0009] The technical solutions provided in this application embodiment have at least the following technical effects or advantages:

[0010] The tracking and interaction method in a virtual environment according to this application is applied to a cave automated virtual environment system. The system includes a real space, a virtual space, a wireless control device, and a projection device. The real space includes a single camera device. The camera device acquires target object information in the real space and synchronously updates the target object information to the virtual space. The target object information includes the target object, its location, and its movement. By using a single camera device to track the target object in real time and synchronizing the target object's location in the real space with its location in the virtual space, the target object can move naturally within the confined CAVE virtual space. This allows the target object to perform small-scale physical navigation in the virtual environment, significantly enhancing the immersion and natural interaction experience. Moreover, using a single camera device can effectively reduce the manufacturing cost of the CAVE system.

[0011] If the first distance between the target location and the preset virtual anchor point is less than or equal to a first preset distance threshold, the projection device is controlled to display a first virtual motion scene in the virtual space. The first virtual motion scene includes a pre-generated virtual environment scene and a target motion scene. The virtual anchor point is a reference point pre-created in the virtual space. If the first distance is greater than the first preset distance threshold, the projection device is controlled to display a second virtual motion scene in the virtual space. The second virtual motion scene includes the target object and control commands based on the wireless control device, causing the pre-generated virtual environment scene to move. By combining the interaction of the wireless control device, large-scale virtual environment exploration can be realized. Moreover, by introducing dynamic interactive guidance and setting virtual anchor points to assist target object navigation, when the user moves away from the virtual anchor point, the CAVE system displays the target object and control commands based on the wireless control device, causing the pre-generated virtual environment scene to move, supporting users to conduct large-scale scene exploration in the virtual space. When the user reaches the virtual anchor point, the CAVE system displays the pre-generated virtual environment scene and the target motion scene, supporting the target object to conduct detailed exploration of specific scene elements in the virtual space, which can bring higher attractiveness, stimulation and novelty to the target object, further improving the user's interactive experience.

[0012] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0013] Various other advantages and benefits will become apparent to those skilled in the art upon reading the following detailed description of preferred embodiments. The accompanying drawings are for illustrative purposes only and are not intended to limit the scope of this application. Furthermore, the same reference numerals denote the same parts throughout the drawings. In the drawings:

[0014] Figure 1 A flowchart of a method for tracking movement and interaction in a virtual environment, provided in an embodiment of this application, is shown.

[0015] Figure 2 This illustration shows an application scenario diagram of a tracking motion interaction method in a virtual environment provided by an embodiment of this application;

[0016] Figure 3 This illustration shows a structural schematic diagram of an automated virtual environment system for caves provided in an embodiment of this application;

[0017] Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of this application is shown. Detailed Implementation

[0018] Exemplary embodiments of this application will now be described in more detail with reference to the accompanying drawings. While exemplary embodiments of this application are shown in the drawings, it should be understood that this application may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided to enable a more thorough understanding of this application and to fully convey the scope of this application to those skilled in the art.

[0019] A Cave Automatic Virtual Environment (CAVE) is an immersive, multi-screen display and interactive environment that provides users with an immersive experience by displaying 3D virtual content on the surrounding walls. However, navigation in a CAVE system faces many challenges, such as the need to introduce expensive sensors for accurate tracking, resulting in high manufacturing costs; or the movement limitations caused by the large difference in scale between the physical space and the virtual environment in the CAVE system.

[0020] Existing tracking solutions rely on wearable devices or complex multi-camera setups, which increase operational limitations and system costs; other existing navigation methods, such as click-to-transfer technology or continuous walking, often struggle to balance immersion, user experience, and information acquisition efficiency.

[0021] Based on this, embodiments of this application provide a method for tracking mobile interaction in a virtual environment. The specific solution of this application embodiment will be described below with reference to the accompanying drawings.

[0022] See Figure 1 The flowchart illustrates a method for tracking mobile interaction in a virtual environment. This method is applied to an automated virtual environment system for caves. The system includes a real space, a virtual space, a wireless control device, and a projection device. The real space includes a single camera device. The method specifically includes the following steps:

[0023] Step 101: Use a camera device to acquire information about the target object in the real space and update the target object information to the virtual space synchronously. The target object information includes the target object, its location, and the target's motion.

[0024] In this embodiment, the camera device is used to capture information about target objects in the display space. The camera device can be a device that combines a traditional RGB camera and a depth sensor, capable of simultaneously capturing the color image (RGB) and depth information of the scene. For example, the camera device can be an RGBD camera, i.e., a color depth camera.

[0025] In one embodiment, a camera device can be pre-installed in the real space. The camera device can be located at a high position in the real space. Then, an effective detection range can be set according to actual needs so that the camera device can cover the walking area of ​​the target object in the entire real space. Then, the camera device is used to acquire the target object information in the real space and the target object information is synchronously updated to the virtual space. The target object information includes the target object, its target location, and the target movement image.

[0026] It should be noted that the camera device can be located at a high point in the real space, which can be the highest point in the real space above the ground, or a height of more than 2 meters above the ground. Those skilled in the art can set it according to actual needs, or adjust the set height according to actual needs. This application embodiment does not make specific limitations.

[0027] The detection range can be set by those skilled in the art according to actual needs, or it can be obtained by adjusting the set range according to actual needs. This application embodiment does not impose a specific limitation. For example, the detection range in this application embodiment can be 4.5 meters × 4.5 meters.

[0028] By using a camera device to acquire information about target objects in the real world and synchronously updating this information to the virtual space, the camera device can capture target objects and their motion states in the displayed scene in real time. This allows information in the virtual space to quickly reflect changes in the real world, providing immediate feedback. Moreover, the camera device can process data with low latency, significantly enhancing the user experience. Furthermore, using a single camera device effectively reduces the number of devices needed to track target objects, lowering the manufacturing cost of the CAVE system and significantly reducing implementation costs.

[0029] Based on the above implementation, in some modified implementations, the camera device may include a target recognition and tracking model and a depth sensor. The camera device is used to acquire target object information in the real space and synchronously update the target object information to the virtual space. Specifically, the target recognition and tracking model is used to identify the full skeleton of the target object in the real space in real time, and the head node of the target object is used as the tracking reference point to obtain the target object and its motion image. The depth sensor is used to obtain the three-dimensional coordinates of the head of the target object to obtain the target position. The target object, its target position and the target motion image are synchronously updated to the virtual space according to a preset refresh rate.

[0030] It should be noted that the target recognition and tracking model is a deep learning model for human pose recognition specifically provided in the software development kit (SDK) of this camera device. It can identify and track the entire skeleton of a target object in real time, detect key points (joints), and accurately locate these joints in three-dimensional space. For example, when the target object is a person, the target recognition and tracking model can be the Body34 model. The Body34 model can be tightly integrated with the camera device and can process data quickly, thus achieving low-latency skeleton tracking.

[0031] The preset refresh rate refers to the frequency at which target object information is updated from the real space to the virtual space. The preset refresh rate can be a refresh rate obtained experimentally in the field, a refresh rate set by those skilled in the art according to actual needs, or a refresh rate obtained by adjusting an already set refresh rate according to actual needs. This application embodiment does not impose specific limitations. For example, the preset refresh rate in this application embodiment can be 30 frames per second.

[0032] Through target recognition and tracking models, the body posture of target objects can be accurately identified, and joint positions and movement trajectories can be obtained. This precise posture information provides real data support for subsequent virtual space interactions. Using the head node as a tracking reference point ensures better positioning and tracking of target objects in dynamic environments, especially in cases of fast or complex movement, greatly improving the accuracy of target positioning. Furthermore, by using depth sensors to obtain the three-dimensional coordinates of the target object's head, precise positioning of the target object in three-dimensional space can be achieved, providing an important spatial reference for interaction with virtual objects in the virtual space and enhancing the robustness of target object recognition and tracking. Moreover, synchronously updating target object information to the virtual space according to a preset refresh rate can provide a smooth and immersive user experience, making the interaction between users and virtual objects more natural. In addition, as the target object's movement changes, the content in the virtual space can respond in real time, increasing the user's immersion and participation.

[0033] Based on the above implementation method, in some modified implementation methods, when updating the target object information to the virtual space, the update can be performed synchronously according to the proportion in the virtual space.

[0034] Updating the target object information synchronously according to the proportion in the virtual space means that in the virtual environment, the size, position, movement and other information of the target object maintain a certain proportional relationship with the actual situation in the real world.

[0035] By updating proportionally, virtual objects maintain consistency with real-world target objects in appearance and spatial relationships, enhancing user immersion and realism, and enabling target users to interact naturally with virtual objects in the virtual space. Furthermore, maintaining proportional relationships makes it easier for target objects in the virtual space to judge their own position and relative distance, thereby enabling more effective interaction.

[0036] Based on the above implementation, in some modified implementations, a vibration alert is issued when the second distance between the target location and the boundary of the real space is less than or equal to a second preset distance threshold.

[0037] Vibration alerts can effectively remind the target object to avoid collisions with the boundaries of the real space, reducing the risk of accidental injury. They can also help the target object better perceive its relationship with the boundary, improve its awareness of the surrounding environment, and enable users to react quickly and adjust their position or behavior. In addition, when the target object is experiencing virtual reality, it may experience anxiety due to spatial limitations. Vibration alerts can serve as a reminder to make the target object feel safe, thereby relaxing and enjoying the experience.

[0038] Step 102: Determine whether the first distance between the target location and the preset virtual anchor point is less than or equal to the first preset distance threshold. If the first distance between the target location and the preset virtual anchor point is less than or equal to the first preset distance threshold, proceed to step 103; if the first distance is greater than the first preset distance threshold, proceed to step 104.

[0039] The first preset distance threshold is a distance threshold used to determine whether the projection device displays a first virtual motion image or a second virtual motion image in the virtual space. The first preset distance threshold can be a distance threshold preset based on actual needs in the field, or it can be a distance threshold obtained by adjusting a preset distance threshold according to actual needs by those skilled in the art. This application embodiment does not impose specific limitations. For example, the first preset distance threshold in this application embodiment can be 10 cm, 20 cm, 30 cm, 50 cm, 1 m, 1.5 m, etc.

[0040] Step 103: Control the projection device to display the first virtual motion picture of the virtual space. The first virtual motion picture includes a pre-generated virtual environment picture and a target motion picture. The virtual anchor point is a reference point pre-created in the virtual space.

[0041] Step 104: Control the projection device to display the second virtual motion picture of the virtual space. The second virtual motion picture includes the target object and the control instructions based on the wireless control device to control the pre-generated virtual environment picture to move.

[0042] In this embodiment, the wireless control device refers to a device that controls the movement of a virtual environment screen within a virtual environment. For example, the wireless control device in this embodiment can be a wireless Bluetooth gamepad, where the left joystick controls the direction of movement and the right joystick controls the rotation angle.

[0043] Based on the above implementation, in some modified implementations, the pre-generated virtual environment screen is controlled to move according to the control command of the wireless control device. Specifically, this can be done by: obtaining the movement direction and / or rotation angle and / or movement speed in the control command, and controlling the pre-generated virtual environment screen to move according to the movement direction and / or rotation angle and / or movement speed.

[0044] It should be noted that the moving direction and / or rotation angle and / or moving speed can be preset by those skilled in the art according to actual needs, or they can be obtained by those skilled in the art after adjusting the preset moving direction and / or rotation angle and / or moving speed according to actual needs. The embodiments of this application do not make specific limitations.

[0045] Wireless control devices can receive input from the target object in real time and immediately feed it back into the virtual environment, allowing the target object to move and explore the virtual environment as naturally as in the real world, enhancing immersion. Moreover, wireless control devices eliminate the constraints of traditional wired controllers, allowing users to move freely in a larger space, increasing the flexibility of the user experience.

[0046] Based on the above implementation, in some modified implementations, the virtual anchor point may include text description and explanatory video. If the first distance between the target location and the preset virtual anchor point is less than or equal to a first preset distance threshold, the projection device can be controlled to display the text description and play the explanatory video.

[0047] Combining multimedia formats such as displaying text and explanatory videos can convey information more vividly, help the target audience better understand complex concepts and content, satisfy their curiosity, enhance the interactive experience, make the interaction between the target audience and the virtual environment more vivid, and enhance the overall immersive experience.

[0048] Based on the above implementation, in some modified implementations, a loss tolerance mechanism can be set, that is, if the camera device fails to acquire the target object information in the real space, the projection device is controlled to display a third virtual motion picture in the virtual space, which includes a pre-generated virtual environment picture.

[0049] By setting up a loss tolerance mechanism, the user experience can be prevented from being interrupted due to the loss of target object information. This ensures that the target object does not feel abrupt or lost during use. Even if the target object cannot be identified in the real space, the user can still continue to participate and explore in the virtual environment, thus maintaining immersion. Moreover, the loss tolerance mechanism improves the system's ability to resist interference from missing information, enhances the system's stability and reliability, reduces the impact of environmental changes, and improves user satisfaction.

[0050] Based on the above implementation, in some modified implementations, if the first distance between the target location and the location of the preset virtual anchor point is less than or equal to a first preset distance threshold, a prompt to enter the local roaming mode is issued; if the first distance is greater than the first preset distance threshold, a prompt to enter the global roaming mode is issued.

[0051] By dynamically adjusting the motion mode of the target object, i.e. switching between local roaming mode and global roaming mode, a seamless transition between efficient large-scale exploration and detailed observation is achieved. This allows users to experience a smoother experience during exploration, enhances immersion, reduces interruptions caused by mode switching, makes the projection device interface more intuitive, and enables users to easily understand how to operate it, thus improving the user-friendliness of the interaction.

[0052] The tracking and interaction method in a virtual environment according to this application is applied to a cave automated virtual environment system. The system includes a real space, a virtual space, a wireless control device, and a projection device. The real space includes a single camera device. The camera device acquires target object information in the real space and synchronously updates the target object information to the virtual space. The target object information includes the target object, its location, and its movement. By using a single camera device to track the target object in real time and synchronizing the target object's location in the real space with its location in the virtual space, the target object can move naturally within the confined CAVE virtual space. This allows the target object to perform small-scale physical navigation in the virtual environment, significantly enhancing the immersion and natural interaction experience. Moreover, using a single camera device can effectively reduce the manufacturing cost of the CAVE system.

[0053] If the first distance between the target location and the preset virtual anchor point is less than or equal to a first preset distance threshold, the projection device is controlled to display a first virtual motion scene in the virtual space. The first virtual motion scene includes a pre-generated virtual environment scene and a target motion scene. The virtual anchor point is a reference point pre-created in the virtual space. If the first distance is greater than the first preset distance threshold, the projection device is controlled to display a second virtual motion scene in the virtual space. The second virtual motion scene includes the target object and control commands based on the wireless control device, causing the pre-generated virtual environment scene to move. By combining the interaction of the wireless control device, large-scale virtual environment exploration can be realized. Moreover, by introducing dynamic interactive guidance and setting virtual anchor points to assist target object navigation, when the user moves away from the virtual anchor point, the CAVE system displays the target object and control commands based on the wireless control device, causing the pre-generated virtual environment scene to move, supporting users to conduct large-scale scene exploration in the virtual space. When the user reaches the virtual anchor point, the CAVE system displays the pre-generated virtual environment scene and the target motion scene, supporting the target object to conduct detailed exploration of specific scene elements in the virtual space, which can bring higher attractiveness, stimulation and novelty to the target object, further improving the user's interactive experience.

[0054] To verify the effectiveness of the tracking motion interaction method in the virtual environment of this application's embodiments, see [link to relevant documentation]. Figure 2 The following is a schematic diagram illustrating an application scenario of a motion tracking interaction method in a virtual environment:

[0055] Scene Construction: A virtual art gallery scene containing two cultural relics was built using Unity3D, as shown in the image as Relic 1 and Relic 2. The scene layout incorporates the 3.2m × 3.2m physical space of the CAVE system, ensuring that users can freely walk and observe.

[0056] Parameter settings: The wireless control device moves at a speed of 0.5 meters per second to ensure smooth navigation. The trigger range of the virtual anchor point is set to 0.5 meters to ensure that users can switch to partial roaming mode when approaching exhibits.

[0057] Visualization: Anchor points are marked with light beams in the virtual scene, and the user's path is dynamically rendered. Exhibit descriptions are presented as floating text and automatically playing audio to enhance immersion.

[0058] See Figure 3 This application also provides an automated virtual environment system for caves, which includes a real space, a virtual space, a wireless control device, and a projection device. The real space includes a single camera device. The system is used to execute the tracking and motion interaction method in the virtual environment described in the above embodiments. The system includes:

[0059] The acquisition module is used to acquire target object information in the real space using the camera device, and synchronously update the target object information to the virtual space. The target object information includes the target object, its target location, and the target motion image.

[0060] The first display module is configured to control the projection device to display a first virtual motion image of the virtual space if the first distance between the target position and the position of the preset virtual anchor point is less than or equal to a first preset distance threshold. The first virtual motion image includes a pre-generated virtual environment image and the target motion image. The virtual anchor point is a reference point pre-created in the virtual space.

[0061] The second display module is used to control the projection device to display a second virtual motion image of the virtual space if the first distance between the target location and the location of the preset virtual anchor point is greater than the first preset distance threshold. The second virtual motion image includes a screen that controls the pre-generated virtual environment screen to move based on the control instructions of the wireless control device and the target object.

[0062] The automatic virtual environment system for caves provided in this application embodiment is based on the same inventive concept as the tracking and movement interaction method in the virtual environment provided in the above embodiment, and has the same beneficial effects as the methods used, operated or implemented therein.

[0063] This application also provides an electronic device corresponding to the virtual environment tracking and interaction method provided in the foregoing embodiments. Please refer to... Figure 4 This illustrates a schematic diagram of an electronic device provided by some embodiments of this application. For example... Figure 4As shown, the electronic device 30 may include: a processor 300, a memory 301, a bus 302, and a communication interface 303. The processor 300, the communication interface 303, and the memory 301 are connected via the bus 302. The memory 301 stores a computer program that can run on the processor 300. When the processor 300 runs the computer program, it executes the tracking motion interaction method in the virtual environment provided in any of the foregoing embodiments of this application.

[0064] The memory 301 may include high-speed random access memory (RAM) or non-volatile memory, such as at least one disk storage device. Communication between this system network element and at least one other network element is achieved through at least one physical port 303 (which can be wired or wireless), such as the Internet, wide area network, local area network, or metropolitan area network.

[0065] Bus 302 can be an ISA bus, PCI bus, or EISA bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. The memory 301 is used to store programs. After receiving an execution instruction, the processor 300 executes the program. The tracking and movement interaction method in the virtual environment disclosed in any of the foregoing embodiments of this application can be applied to the processor 300, or implemented by the processor 300.

[0066] The processor 300 may be an integrated circuit with signal processing capabilities. In implementation, each step of the above method can be completed by the integrated logic circuitry in the hardware of the processor 300 or by instructions in software form. The processor 300 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), an off-the-shelf programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of this application can be directly embodied in the execution of a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software modules may reside in random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or other mature storage media in the art. The storage medium is located in memory 301. The processor 300 reads the information in memory 301 and, in conjunction with its hardware, completes the steps of the above method.

[0067] The electronic device provided in this application embodiment and the tracking motion interaction method in the virtual environment provided in this application embodiment are based on the same inventive concept and have the same beneficial effects as the methods they adopt, operate or implement.

[0068] This application also provides a computer-readable storage medium corresponding to the tracking motion interaction method in a virtual environment provided by the foregoing embodiments, wherein a computer program (i.e., a program product) is stored thereon, and the computer program, when run by a processor, executes the tracking motion interaction method in a virtual environment provided by any of the foregoing embodiments.

[0069] It should be noted that examples of the computer-readable storage medium may also include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other optical and magnetic storage media, which will not be elaborated here.

[0070] This application also provides a computer program product corresponding to the tracking motion interaction method in a virtual environment provided in the foregoing embodiments, including a computer program that is executed by a processor to implement the tracking motion interaction method in a virtual environment provided in the above embodiments.

[0071] The computer-readable storage medium and computer program product provided in the above embodiments of this application are based on the same inventive concept as the tracking mobile interaction method in the virtual environment provided in the embodiments of this application, and have the same beneficial effects as the methods adopted, run or implemented by the applications stored therein.

[0072] It should be noted that:

[0073] The algorithms and displays provided herein are not inherently related to any particular computer, virtual device, or other equipment. Various general-purpose devices can also be used in conjunction with the teachings herein. The required structure for constructing such devices is apparent from the above description. Furthermore, this application is not directed to any particular programming language. It should be understood that the content of this application described herein can be implemented using various programming languages, and the above description of specific languages ​​is for the purpose of disclosing the best mode of implementation of this application.

[0074] Numerous specific details are set forth in the specification provided herein. However, it will be understood that embodiments of this application may be practiced without these specific details. In some instances, well-known methods, structures, and techniques have not been shown in detail so as not to obscure the understanding of this specification.

[0075] Similarly, it should be understood that, in order to simplify this application and aid in understanding one or more of the various inventive aspects, in the above description of exemplary embodiments of this application, various features of this application are sometimes grouped together into a single embodiment, figure, or description thereof. However, this method of disclosure should not be construed as reflecting an intention that the claimed application requires more features than are expressly recited in each claim. Rather, as reflected in the following claims, inventive aspects lie in fewer than all features of a single foregoing disclosed embodiment. Therefore, the claims following the detailed description are hereby expressly incorporated into that detailed description, wherein each claim itself is a separate embodiment of this application.

[0076] Those skilled in the art will understand that modules in the device of the embodiments can be adaptively changed and placed in one or more devices different from that embodiment. Modules, units, or components in the embodiments can be combined into a single module, unit, or component, and further, they can be divided into multiple sub-modules, sub-units, or sub-components. Except where at least some of such features and / or processes or units are mutually exclusive, any combination can be used to combine all features disclosed in this specification (including the accompanying claims, abstract, and drawings) and all processes or units of any method or device so disclosed. Unless expressly stated otherwise, each feature disclosed in this specification (including the accompanying claims, abstract, and drawings) may be replaced by an alternative feature that serves the same, equivalent, or similar purpose.

[0077] Furthermore, those skilled in the art will understand that although some embodiments described herein include certain features but not others included in other embodiments, combinations of features from different embodiments are intended to be within the scope of this application and form different embodiments. For example, in the following claims, any of the claimed embodiments can be used in any combination.

[0078] The various component embodiments of this application can be implemented in hardware, or as software modules running on one or more processors, or a combination thereof. Those skilled in the art will understand that microprocessors or digital signal processors (DSPs) can be used in practice to implement some or all of the functions of some or all of the components in the virtual machine creation apparatus according to embodiments of this application. This application can also be implemented as a device or apparatus program (e.g., a computer program and computer program product) for performing part or all of the methods described herein. Such an implementation of this application can be stored on a computer-readable medium, or can be in the form of one or more signals. Such signals can be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.

[0079] It should be noted that the above embodiments are illustrative of this application and not restrictive, and that those skilled in the art can devise alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses should not be construed as limiting the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. This application can be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third, etc., does not indicate any order. These words can be interpreted as names.

[0080] The above description is merely a preferred embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A method for tracking movement and interaction in a virtual environment, characterized in that, An automated virtual environment system for caves, comprising a real space, a virtual space, a wireless control device, and a projection device, wherein the real space includes a single camera device; the method includes: The camera device is used to acquire target object information in the real space and the target object information is synchronously updated to the virtual space. The target object information includes the target object, its target location, and the target movement image. If the first distance between the target location and the location of the preset virtual anchor point is less than or equal to the first preset distance threshold, then the projection device is controlled to display the first virtual motion picture of the virtual space. The first virtual motion picture includes a pre-generated virtual environment picture and the target motion picture. The virtual anchor point is a reference point pre-created in the virtual space. If the first distance is greater than the first preset distance threshold, the projection device is controlled to display a second virtual motion image of the virtual space. The second virtual motion image includes the target object and a screen that moves based on the control instructions of the wireless control device and the pre-generated virtual environment image.

2. The method for tracking movement and interaction in a virtual environment according to claim 1, characterized in that, The camera device includes a target recognition and tracking model and a depth sensor. The step of using the camera device to acquire target object information in the real space and synchronously updating the target object information to the virtual space includes: The target recognition and tracking model is used to identify the full skeleton of the target object in the real space in real time, and the head node of the target object is used as the reference point for tracking to obtain the target object and its motion image; The three-dimensional coordinates of the head of the target object are obtained using the depth sensor to determine the target position; The target object, its location, and its motion are synchronously updated to the virtual space according to a preset refresh rate.

3. The method for tracking movement and interaction in a virtual environment according to claim 2, characterized in that, Also includes: A vibration alert is issued when the second distance between the target location and the boundary of the real space is less than or equal to a second preset distance threshold.

4. The method for tracking movement and interaction in a virtual environment according to claim 1, characterized in that, The control command based on the wireless control device, controlling the movement of the pre-generated virtual environment screen, includes: Obtain the movement direction and / or rotation angle and / or movement speed from the control command; Control the pre-generated virtual environment screen to move according to the movement direction and / or the rotation angle and / or the movement speed.

5. The method for tracking movement and interacting in a virtual environment according to claim 1, characterized in that, The virtual anchor point includes a text description and an explanatory video. If the first distance between the target location and the preset virtual anchor point is less than or equal to a first preset distance threshold, the method further includes: Control the projection device to display the text description and play the explanatory video.

6. The method for tracking movement and interacting in a virtual environment according to any one of claims 1-5, characterized in that, Also includes: If the camera device fails to acquire information about the target object in the real space, the projection device is controlled to display a third virtual motion image of the virtual space, which includes a pre-generated virtual environment image.

7. The method for tracking movement and interaction in a virtual environment according to any one of claims 1-5, characterized in that, The method further includes: If the first distance between the target location and the location of the preset virtual anchor point is less than or equal to the first preset distance threshold, a prompt to enter the local roaming mode will be issued. If the first distance is greater than the first preset distance threshold, a prompt to enter global roaming mode will be issued.

8. An automated virtual environment system for caves, characterized in that, include: The physical space, the virtual space, the wireless control device, and the projection device, wherein the physical space includes a single camera device; The acquisition module is used to acquire target object information in the real space using the camera device, and synchronously update the target object information to the virtual space. The target object information includes the target object, its target location, and the target motion image. The first display module is configured to control the projection device to display a first virtual motion image of the virtual space if the first distance between the target position and the position of the preset virtual anchor point is less than or equal to a first preset distance threshold. The first virtual motion image includes a pre-generated virtual environment image and the target motion image. The virtual anchor point is a reference point pre-created in the virtual space. The second display module is used to control the projection device to display a second virtual motion image of the virtual space if the first distance between the target location and the location of the preset virtual anchor point is greater than the first preset distance threshold. The second virtual motion image includes a screen that controls the pre-generated virtual environment screen to move based on the control instructions of the wireless control device and the target object.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the method according to any one of claims 1-7.

10. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the method described in any one of claims 1-7.

Images