Information interaction method and device, wearable display equipment, readable storage medium and program product
Through virtual reality technology and wearable display devices, virtual training scenarios are reproduced in animal training, and the problems of high training costs and difficulty in meeting diverse needs in the prior art are solved, achieving efficient and low-cost animal training effects.
Patent Information
- Application Number
- CN202510240616.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-28
- Publication Date
- 2025-06-06
AI Technical Summary
The existing animal training technology relies on professional trainers and specialized venues, which leads to high training costs and difficulty in meeting diverse needs, and lacks an information interaction method that can reduce training difficulty and improve efficiency.
The training scene is reproduced through virtual reality technology, and the wearable display device and motion capture device are used to transmit instructions to the animal, and the virtual reality scene is switched according to the animal's action information, increasing the number and complexity of virtual elements.
It realizes efficient training in a single open field, improves the richness and adaptability of the training scenario, reduces the training cost and difficulty, and improves the efficiency and effectiveness of animal training.
Smart Images
Figure CN120103981A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of animal training technology, and in particular to an information interaction method, apparatus, wearable display device, computer-readable storage medium, and computer program product. Background Art
[0002] Animal training is the process of teaching animals to perform specific behaviors or tasks. For example, pets can be trained to obey basic commands such as sit, shake hands, come, stop, and good living habits, and guide dogs can be trained to lead blind people to walk safely, and guide their owners to stop when encountering obstacles and turning to avoid danger.
[0003] At present, animal training mainly relies on professional trainers and specialized venues, which usually focus on specific types of task training, resulting in high training costs. With the increase and diversification of animal training needs, there is an urgent need for an information interaction method that can improve and reduce the difficulty of animal training and achieve efficient animal training. Summary of the invention
[0004] Based on this, it is necessary to provide an information interaction method, device, wearable display device, computer-readable storage medium and computer program product that can reduce the difficulty of executing animal training and achieve efficient animal training in response to the above-mentioned technical problems.
[0005] In a first aspect, the present application provides an information interaction method, comprising:
[0006] Displaying a first virtual reality scene, and showing a virtual object in the first virtual reality scene;
[0007] Outputting indication information associated with the virtual object, the indication information being used to instruct the worn object to perform an action, and acquiring the action information of the worn object based on a motion capture device associated with the wearable display device; when a deviation between the action information and preset action information corresponding to the indication information is within a preset range, switching the first virtual reality scene to a second virtual reality scene and displaying the second virtual reality scene; the number of virtual elements in the second virtual reality scene is greater than the number of virtual elements in the first virtual reality scene, and / or the movement trajectory of the virtual elements in the second virtual reality scene is different from the movement trajectory of the virtual elements in the first virtual reality scene.
[0008] In one of the embodiments, when a deviation between the action information and the preset action information corresponding to the indication information is within a preset range, switching the first virtual reality scene to a second virtual reality scene and displaying the second virtual reality scene includes:
[0009] When the deviation between the action information and the preset action information corresponding to the indication information is within a preset range, the number of first virtual elements displayed in the first virtual reality scene is increased to obtain and display a second virtual reality scene; the first virtual elements include at least one of: a virtual obstacle located on a preset viewpoint trajectory corresponding to the indication information, and a virtual interference object located around the preset viewpoint trajectory.
[0010] In one embodiment, after outputting the indication information of the virtual object and acquiring the motion information of the wearable object based on a motion capture device associated with the wearable display device, the method further comprises:
[0011] When a deviation between the action information and the preset action information corresponding to the indication information exceeds a preset range, the number of first virtual elements displayed in the first virtual reality scene is reduced, and a third virtual reality scene is obtained and displayed.
[0012] In one of the embodiments, when the deviation between the action information and the preset action information corresponding to the indication information is within a preset range, switching the first virtual reality scene to the second virtual reality scene and displaying the second virtual reality scene includes:
[0013] When a deviation between the action information and preset action information corresponding to the indication information is within a preset range, a movement trajectory of a second virtual element displayed in the first virtual reality scene is switched from a fixed movement trajectory to a random movement trajectory, and a second virtual reality scene is obtained and displayed; in the process of the second virtual element moving along the random movement trajectory, there is a moment when it moves toward a target line of sight direction corresponding to the indication information.
[0014] In one embodiment, the indication information includes destination information, and after outputting the indication information of the virtual object and acquiring motion information of the worn object based on a motion capture device associated with the wearable display device, the method further includes:
[0015] Based on the motion information, displaying the virtual object within a preset visual field of the wearer;
[0016] When the deviation between the action information and the preset action information corresponding to the indication information exceeds a preset range, or when the virtual object and other virtual elements are displayed overlapping in the first virtual reality scene, the auxiliary interaction device associated with the wearable display device is controlled to output an alarm message.
[0017] In one embodiment, the method further comprises:
[0018] In response to receiving a scene switching instruction, a fourth virtual reality scene is displayed, and virtual objects are shown in the fourth virtual reality scene; the combination of types of virtual elements in the fourth virtual reality scene is different from the combination of types of virtual elements in the first virtual reality scene.
[0019] In a second aspect, the present application further provides an information interaction device, which is applied to a wearable display device, comprising:
[0020] A first display module, configured to display a first virtual reality scene and present a virtual object in the first virtual reality scene;
[0021] an information acquisition module, configured to output indication information associated with the virtual object, the indication information being used to instruct the wearing object to perform an action, and to acquire the action information of the wearing object based on a motion capture device associated with the wearable display device;
[0022] A second display module is used to switch the first virtual reality scene to a second virtual reality scene and display the second virtual reality scene when a deviation between the action information and the preset action information corresponding to the indication information is within a preset range; the number of virtual elements in the second virtual reality scene is greater than the number of virtual elements in the first virtual reality scene, and / or the movement trajectory of the virtual elements in the second virtual reality scene is different from the movement trajectory of the virtual elements in the first virtual reality scene.
[0023] In a third aspect, the present application also provides a wearable display device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of any of the methods described above when executing the computer program.
[0024] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the steps of any of the methods described above when executed by a processor.
[0025] In a fifth aspect, the present application also provides a computer program product, including a computer program, which implements the steps of any of the methods described above when executed by a processor.
[0026] The above-mentioned information interaction method, device, wearable display device, computer-readable storage medium and computer program product reproduce the training scene through virtual reality technology, and display virtual objects in the virtual training scene to convey instructions to the animal, which can help to focus the attention of the animal during the training process and ensure the safety of the training; by increasing the number of virtual elements in the current virtual training scene and / or changing the movement trajectory of the virtual elements in the current virtual training scene when the animal completes the instructions in the current virtual training scene, and training again, it is possible to achieve that only an open field is required, the richness of the training scene perceived by the animal is improved, adaptive training and increased scene complexity are achieved, and the efficiency and effectiveness of animal training are improved. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.
[0028] Figure 1 An application environment diagram of an information interaction method in an embodiment;
[0029] Figure 2 is a flow chart of an information interaction method in an embodiment;
[0030] Figure 3 is a flow chart of an information interaction method in another embodiment;
[0031] Figure 4 A schematic diagram of a flow chart of an information interaction method in yet another embodiment;
[0032] Figure 5 is a flowchart of an information interaction method in yet another embodiment;
[0033] Figure 6 is a schematic diagram of wearing states of a wearable display device and a motion capture device and an auxiliary interaction device associated with the wearable display device in one embodiment;
[0034] Figure 7 is a structural block diagram of an information interaction device in an embodiment;
[0035] Figure 8 FIG. 4 is a diagram showing the internal structure of a wearable display device in one embodiment. DETAILED DESCRIPTION
[0036] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0037] The information interaction method provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown. Among them, the wearable display device 104 communicates with the server 102 through the network. The data storage system can store the display data of the wearable display device 104. The data storage system can be integrated on the server 102, or it can be placed on the cloud or other network servers. The wearable display device 104 can be, but is not limited to, virtual reality (VR) glasses, head-mounted displays, etc. that can be worn by animals. The wearable display device 104 can also communicate with an associated motion capture device. The motion capture device 108 can be an inertial sensor for wearing on the limbs of an animal. The motion capture device 108 can also be an image acquisition device.
[0038] In an exemplary embodiment, Figure 2 As shown, an information interaction method is provided, which is applied to Figure 1 The wearable display device 104 in the embodiment is used as an example to illustrate the method, which includes the following steps S202 to S206. Among them:
[0039] Step S202: displaying a first virtual reality scene and showing a virtual object in the first virtual reality scene.
[0040] The first virtual reality scene may be constructed based on real scenes such as real life scenes of animals, real training scenes, etc. The virtual elements in the first virtual reality scene may be reproduced images of people, animals and objects in the real scene.
[0041] For example, the user may wear the wearable display device 104 and the motion capture device associated with the wearable display device 104 on the animal to be trained, and control the wearable display device 104 to display the first virtual reality scene through the control terminal of the wearable display device 104. Specifically, the wearable display device 104 may obtain the display data of the first virtual reality scene from the server and display it in response to receiving the scene display instruction sent by the control terminal. The display data of the first virtual reality scene may include the display data of the virtual object and the display data of other virtual elements except the virtual object.
[0042] Step S204: output indication information associated with the virtual object, where the indication information is used to instruct the wearing object to perform an action, and obtain action information of the wearing object based on a motion capture device associated with the wearable display device.
[0043] The virtual object may be a virtual image of a user. The indication information associated with the virtual object refers to indication information generated based on the action and / or voice of the virtual object. The wearable display device may be connected to an associated motion capture device for communication.
[0044] Exemplarily, the wearable display device 104 can output instruction information corresponding to the target training item in response to the selection operation for the target training item. Specifically, the user can log in to the application interface for controlling the wearable display device 104 through the control terminal and select the target training item according to the training needs. When the user selects the handshake item, the virtual object can be driven to actively shake hands (for example, extend the left hand) in the direction of the wearer's line of sight, and play audio to call the wearer and issue handshake instructions. When the user selects the guided walking item, audio can be played to inform the wearer of the destination, and the virtual object can be driven to move following the movement of the wearer based on the path-finding algorithm.
[0045] Optionally, before outputting the instruction information of the virtual object, the display screen can also be switched from the first-person perspective to the third-person perspective, displaying the virtual image of the worn object in the virtual reality scene, driving the virtual object to output instruction information facing the virtual image of the worn object, and driving the virtual image of the worn object to display demonstration actions corresponding to the instruction information.
[0046] Step S206: When a deviation between the action information and the preset action information corresponding to the indication information is within a preset range, the first virtual reality scene is switched to the second virtual reality scene and the second virtual reality scene is displayed; the number of virtual elements in the second virtual reality scene is greater than the number of virtual elements in the first virtual reality scene, and / or the movement trajectory of the virtual elements in the second virtual reality scene is different from the movement trajectory of the virtual elements in the first virtual reality scene.
[0047] When the deviation between the action information of the wearing object and the preset action information corresponding to the indication information is within a preset range, it can be determined that the wearing object has performed the action according to the indication information. At this time, the number and / or movement trajectory of other virtual elements other than the virtual object in the first virtual reality scene can be changed to form a more complex training environment.
[0048] For example, multiple virtual reality scenes of complexity levels can be constructed based on the preset virtual reality scenes. In the current virtual reality scene (including: the first virtual reality scene), if the deviation between the action information of the wearing object and the preset action information corresponding to the indication information is within a preset range, the virtual reality scene of higher complexity level (including: the second virtual reality scene) is switched to, and the indication information is output again, until the wearing object performs actions according to the indication information in the virtual reality scenes of multiple complexity levels, it is determined that the wearing object has passed the current training item, and the user is notified to give a certain reward. For example, the number of virtual portraits, virtual vehicles, etc. displayed in the first virtual reality scene can be increased, and / or the dynamic virtual elements displayed in the first virtual reality scene can be changed to move according to a more random movement pattern or a more complex path.
[0049] Furthermore, the obtained motion information can be analyzed based on the AI (Artificial Intelligence) model to determine the training status of the wearer and provide feedback to the user, so that the user can adjust the training strategy.
[0050] In the above-mentioned information interaction method, the training scene is reproduced through virtual reality technology, and virtual objects are displayed in the virtual training scene to convey instructions to the animals, which can help to concentrate the attention of the animals during the training process and ensure the safety of the training; by increasing the number of virtual elements in the current virtual training scene and / or changing the movement trajectory of the virtual elements in the current virtual training scene when the animals complete the instructions in the current virtual training scene, and training again, it can be achieved that only an open field is required, the richness of the training scene perceived by the animals is improved, adaptive training and increased scene complexity are achieved, and the efficiency and effectiveness of animal training are improved.
[0051] In an exemplary embodiment, Figure 3 As shown, the above step S206 may include:
[0052] Step S2061, when the deviation between the action information and the preset action information corresponding to the indication information is within a preset range, increase the number of first virtual elements displayed in the first virtual reality scene, obtain the second virtual reality scene and display it; the first virtual elements include at least: a virtual obstacle located on the preset viewpoint trajectory corresponding to the indication information, and a virtual interference object located around the preset viewpoint trajectory.
[0053] The preset viewpoint track is used for when the wearing object performs actions according to the instruction information, the viewpoint of the wearing object will fall on the preset viewpoint track.
[0054] Specifically, the virtual obstacles located on the preset viewpoint track corresponding to the indication information may include but are not limited to virtual houses, virtual boxes, etc. The virtual interference objects may include but are not limited to virtual food, virtual animals that interact with the wearable object, etc.
[0055] For further information, please refer to Figure 3 , the above information interaction method may further include:
[0056] Step S2071: when the deviation between the action information and the preset action information corresponding to the indication information exceeds a preset range, the number of first virtual elements displayed in the first virtual reality scene is reduced to obtain and display a third virtual reality scene.
[0057] For example, in the current virtual reality scene (including: the first virtual reality scene), if the deviation between the action information of the wearer and the preset action information corresponding to the indication information exceeds the preset range, an alarm message (for example, a sound alarm message) can be output, and a virtual reality scene with a lower complexity level (including: the third virtual reality scene) can be switched to output the indication information again. For example, the virtual obstacles and virtual interferences displayed in the first virtual reality scene can be cleared. It can be understood that the first virtual scene, the second virtual scene and the third virtual scene are used to simulate different aspects and dynamic changes in the same real scene.
[0058] In this embodiment, by adding virtual obstacles and virtual interferences visible to the wearer in the current virtual training scene, the training difficulty of the current virtual training scene can be increased. Furthermore, by switching to a virtual training scene with lower complexity for retraining when training fails at the current training difficulty, it is easier for the animal to master skills and cope with a more complex virtual training scene again, further improving the effect of animal training.
[0059] In an exemplary embodiment, Figure 4 As shown, the above step S206 may further include:
[0060] Step S2062, when the deviation between the action information and the preset action information corresponding to the indication information is within a preset range, the movement trajectory of the second virtual element displayed in the first virtual reality scene is switched from a fixed movement trajectory to a random movement trajectory, and the second virtual reality scene is obtained and displayed; in the process of the second virtual element moving along the random movement trajectory, there is a moment when it moves toward the target line of sight direction corresponding to the indication information.
[0061] The target sight line direction is the sight line direction of the wearer when the wearer performs the correct action according to the instruction information.
[0062] The movement of the second virtual element along a random moving trajectory can be used to simulate emergencies in real scenes. Specifically, a virtual car can be driven to lose control while driving normally along a virtual road toward the direction of the wearer's sight. A virtual portrait can be driven to randomly change its moving direction and suddenly move toward the wearer's sight. A virtual animal can be driven to rush toward the wearer's sight when it enters the wearer's field of vision.
[0063] In this embodiment, by adding emergencies visible to the wearer in the current virtual training scene, the training difficulty of the current virtual training scene can be increased, which helps to train the animal's ability to respond to emergencies.
[0064] In practical applications, there is a need to train animals to protect the safety of people while guiding them to their destinations. In an exemplary embodiment, the indication information includes destination information, such as Figure 5 As shown, the above information interaction method may also include:
[0065] Step S2072: Based on the motion information, the virtual object is displayed within a preset field of view of the wearer.
[0066] Step S2073: When the deviation between the action information and the preset action information corresponding to the indication information exceeds a preset range, or when the virtual object and other virtual elements are displayed overlapping in the first virtual reality scene, control the auxiliary interaction device associated with the wearable display device to output an alarm message.
[0067] For example, if the wearer gives wrong guidance, the virtual object may overlap with the virtual car, virtual tree, etc. Specifically, the positional relationship between virtual elements in the virtual environment can be identified based on the collision detection algorithm, and whether the virtual object overlaps with other virtual elements can be determined in real time. Figure 6 , Figure 6 1 is a schematic diagram of a wearable display device and a motion capture device and an auxiliary interaction device associated with the wearable display device in an embodiment. The auxiliary interaction device 106 may be a collar capable of releasing electric current, which is worn on the neck of an animal. The auxiliary interaction device may also be a manipulator.
[0068] In this embodiment, by simulating a situation where the wearer gives wrong guidance, causing the person to be in danger, and giving a warning to the wearer, it can help train the animal to be more cautious and accurate when guiding the person, thereby achieving better protection of the safety of the person in actual applications.
[0069] In an exemplary embodiment, the above information interaction method may further include:
[0070] Step S209: In response to receiving the scene switching instruction, display a fourth virtual reality scene and present virtual objects in the fourth virtual reality scene; the combination of types of virtual elements in the fourth virtual reality scene is different from the combination of types of virtual elements in the first virtual reality scene.
[0071] The fourth virtual reality scene and the first virtual scene are used to simulate different real scenes. Different real scenes may include indoor, park, street and other scenes. The types of virtual elements corresponding to the indoor scene may include: virtual portraits, virtual rooms, virtual furniture, virtual toys, etc. The types of virtual elements corresponding to the park scene may include: virtual portraits, virtual plants, virtual animals, virtual facilities, etc. The types of virtual elements corresponding to the street scene may include: virtual portraits, virtual houses, virtual roads, virtual cars, etc.
[0072] In this embodiment, by introducing the scene switching function, it is possible to flexibly switch to a virtual training scene for simulating different real-life scenes according to training needs, thereby further improving the richness of the training scenes perceived by animals and helping to enhance the adaptability of animals to different real-life scenes.
[0073] To sum up, in the above-mentioned information interaction method, the training scene is reproduced through virtual reality technology, and virtual objects are displayed in the virtual training scene to convey instructions to the animals, which can help to concentrate the attention of the animals during the training process and ensure the safety of the training; by increasing the number of virtual elements in the current virtual training scene and / or changing the movement trajectory of the virtual elements in the current virtual training scene when the animals complete the instructions in the current virtual training scene, and training again, it can be achieved that only an open field is required, the richness of the training scene perceived by the animals is improved, adaptive training and increased scene complexity are achieved, and the efficiency and effectiveness of animal training are improved.
[0074] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.
[0075] Based on the same inventive concept, the embodiment of the present application also provides an information interaction device for implementing the above-mentioned information interaction method. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above-mentioned method, so the specific limitations in the one or more information interaction device embodiments provided below can refer to the limitations on the information interaction method above, and will not be repeated here.
[0076] In an exemplary embodiment, Figure 7 As shown, an information interaction device 300 is provided, comprising: a first display module 301, an information acquisition module 302, and a second display module 303, wherein:
[0077] The first display module 301 is used to display a first virtual reality scene and present virtual objects in the first virtual reality scene.
[0078] The information acquisition module 302 is used to output indication information associated with the virtual object, where the indication information is used to instruct the wearing object to perform an action, and to obtain the action information of the wearing object based on a motion capture device associated with the wearable display device.
[0079] The second display module 303 is used to switch the first virtual reality scene to the second virtual reality scene and display the second virtual reality scene when the deviation between the action information and the preset action information corresponding to the indication information is within a preset range; the number of virtual elements in the second virtual reality scene is greater than the number of virtual elements in the first virtual reality scene, and / or the movement trajectory of the virtual elements in the second virtual reality scene is different from the movement trajectory of the virtual elements in the first virtual reality scene.
[0080] In an exemplary embodiment, the second display module 303 is further used for:
[0081] When the deviation between the action information and the preset action information corresponding to the indication information is within a preset range, the number of first virtual elements displayed in the first virtual reality scene is increased to obtain and display the second virtual reality scene; the first virtual elements include at least one of: a virtual obstacle located on a preset viewpoint trajectory corresponding to the indication information, and a virtual interference object located around the preset viewpoint trajectory.
[0082] In an exemplary embodiment, the information interaction device 300 further includes:
[0083] The third display module is used to reduce the number of first virtual elements displayed in the first virtual reality scene when the deviation between the action information and the preset action information corresponding to the indication information exceeds a preset range, obtain the third virtual reality scene and display it.
[0084] In an exemplary embodiment, the second display module 303 is further used for:
[0085] When the deviation between the action information and the preset action information corresponding to the indication information is within a preset range, the movement trajectory of the second virtual element displayed in the first virtual reality scene is switched from a fixed movement trajectory to a random movement trajectory, and the second virtual reality scene is obtained and displayed; in the process of the second virtual element moving along the random movement trajectory, there is a moment when it moves toward the target line of sight direction corresponding to the indication information.
[0086] In an exemplary embodiment, the indication information may include destination information, and the information interaction device 300 further includes:
[0087] The auxiliary interaction module is used to display the virtual object within the preset field of view of the wearer based on the action information.
[0088] The auxiliary interaction module is also used to control the auxiliary interaction device associated with the wearable display device to output an alarm message when the deviation between the action information and the preset action information corresponding to the indication information exceeds a preset range, or when the virtual object and other virtual elements are displayed overlapping in the first virtual reality scene.
[0089] In an exemplary embodiment, the information interaction device 300 further includes:
[0090] The fourth display module is used to display a fourth virtual reality scene in response to receiving a scene switching instruction, and to show virtual objects in the fourth virtual reality scene; the combination of types of virtual elements in the fourth virtual reality scene is different from the combination of types of virtual elements in the first virtual reality scene.
[0091] Each module in the above-mentioned information interaction device can be implemented in whole or in part by software, hardware and a combination thereof. Each of the above-mentioned modules can be embedded in or independent of the processor in the wearable display device in the form of hardware, or can be stored in the memory in the wearable display device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.
[0092] In an exemplary embodiment, a wearable display device is provided, and its internal structure diagram can be as follows: Figure 8As shown. The wearable display device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface, the display unit and the input device are connected to the system bus through the input / output interface. The processor of the wearable display device is used to provide computing and control capabilities. The memory of the wearable display device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the wearable display device is used to exchange information between the processor and an external device. The communication interface of the wearable display device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through WIFI, a mobile cellular network, near field communication (NFC) or other technologies. When the computer program is executed by the processor, an information interaction method is implemented. The display unit of the wearable display device is used to form a visually visible picture, which can be a virtual reality imaging device.
[0093] Those skilled in the art will understand that Figure 8 The structure shown in the figure is only a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation on the wearable display device to which the scheme of the present application is applied. The specific wearable display device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0094] In an exemplary embodiment, a wearable display device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above-mentioned method embodiments when executing the computer program.
[0095] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.
[0096] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.
[0097] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.
[0098] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.
[0099] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.
[0100] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. An information interaction method, characterized in that: Applied to a wearable display device, the method comprises: Displaying a first virtual reality scene, and showing a virtual object in the first virtual reality scene; Outputting indication information associated with the virtual object, the indication information being used to instruct the wearing object to perform an action, and acquiring action information of the wearing object based on a motion capture device associated with the wearable display device; When a deviation between the action information and preset action information corresponding to the indication information is within a preset range, the first virtual reality scene is switched to a second virtual reality scene and the second virtual reality scene is displayed; the number of virtual elements in the second virtual reality scene is greater than the number of virtual elements in the first virtual reality scene, and / or the movement trajectory of the virtual elements in the second virtual reality scene is different from the movement trajectory of the virtual elements in the first virtual reality scene.
2. The method according to claim 1, characterized in that When a deviation between the action information and preset action information corresponding to the indication information is within a preset range, switching the first virtual reality scene to a second virtual reality scene and displaying the second virtual reality scene includes: When the deviation between the action information and the preset action information corresponding to the indication information is within a preset range, the number of first virtual elements displayed in the first virtual reality scene is increased to obtain and display a second virtual reality scene; the first virtual elements include at least one of: a virtual obstacle located on a preset viewpoint trajectory corresponding to the indication information, and a virtual interference object located around the preset viewpoint trajectory.
3. The method according to claim 2, characterized in that After outputting the indication information of the virtual object and acquiring the motion information of the worn object based on a motion capture device associated with the wearable display device, the method further comprises: When a deviation between the action information and the preset action information corresponding to the indication information exceeds a preset range, the number of first virtual elements displayed in the first virtual reality scene is reduced, and a third virtual reality scene is obtained and displayed.
4. The method according to claim 1, characterized in that: When the deviation between the action information and the preset action information corresponding to the indication information is within a preset range, switching the first virtual reality scene to the second virtual reality scene and displaying the second virtual reality scene includes: When a deviation between the action information and preset action information corresponding to the indication information is within a preset range, a movement trajectory of a second virtual element displayed in the first virtual reality scene is switched from a fixed movement trajectory to a random movement trajectory, and a second virtual reality scene is obtained and displayed; in the process of the second virtual element moving along the random movement trajectory, there is a moment when it moves toward a target line of sight direction corresponding to the indication information.
5. The method according to claim 1, characterized in that The indication information includes destination information, and after outputting the indication information of the virtual object, based on a motion capture device associated with the wearable display device, obtaining motion information of the wearable object, the method further includes: Based on the motion information, displaying the virtual object within a preset visual field of the wearer; When the deviation between the action information and the preset action information corresponding to the indication information exceeds a preset range, or when the virtual object and other virtual elements are displayed overlapping in the first virtual reality scene, the auxiliary interaction device associated with the wearable display device is controlled to output an alarm message.
6. The method according to claim 1, characterized in that The method further comprises: In response to receiving a scene switching instruction, a fourth virtual reality scene is displayed, and virtual objects are shown in the fourth virtual reality scene; the combination of types of virtual elements in the fourth virtual reality scene is different from the combination of types of virtual elements in the first virtual reality scene.
7. An information interaction device, characterized in that: Applied to a wearable display device, the device comprises: A first display module, configured to display a first virtual reality scene and present a virtual object in the first virtual reality scene; an information acquisition module, configured to output indication information associated with the virtual object, the indication information being used to instruct the wearing object to perform an action, and to acquire the action information of the wearing object based on a motion capture device associated with the wearable display device; A second display module is used to switch the first virtual reality scene to a second virtual reality scene and display the second virtual reality scene when a deviation between the action information and the preset action information corresponding to the indication information is within a preset range; the number of virtual elements in the second virtual reality scene is greater than the number of virtual elements in the first virtual reality scene, and / or the movement trajectory of the virtual elements in the second virtual reality scene is different from the movement trajectory of the virtual elements in the first virtual reality scene.
8. A wearable display device, comprising a memory and a processor, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.