Virtual museum guiding method, device and equipment and storage medium

Abstract

The invention relates to the technical field of information and virtual reality, and discloses a virtual museum guiding method, device and equipment and a storage medium, and the method comprises the steps: obtaining the current state of VR head display equipment, and obtaining virtual exhibits in a virtual museum when the current state of the VR head display equipment is a wearing state; displaying the virtual exhibit, and obtaining the movement amplitude of the head or the hand; determining a demonstration video of interaction between the demonstrator and the virtual exhibit based on the movement amplitude; replacing a background part in the demonstration video with a semitransparent background to obtain a demonstration video with the semitransparent background; playing the demonstration video with the semitransparent background, and after the demonstration video is played, capturing a gesture action of interaction between the user and the virtual exhibit; and when the gesture action is not the standard action, displaying the guide content of the virtual museum. According to the method, the interaction mode of displaying the virtual exhibits in the virtual museum to the user through the guide content is beneficial to improving the interaction efficiency of the user and the virtual exhibits.

Description

Technical Field

[0001] The present invention relates to the fields of information technology and virtual reality technology, and particularly to a virtual museum guiding method, device, equipment and storage medium. Background Art

[0002] A virtual museum is an online exhibition space created using digital technology. The virtual museum presents the collections, exhibitions, and cultural information in a physical museum to the audience in a digital form. The virtual museum breaks the limitation of physical space, making the dissemination of cultural resources more extensive and convenient, and providing a new way for the audience to explore and learn cultural heritage anytime and anywhere.

[0003] However, the process of obtaining the guiding content of the existing virtual museum is cumbersome, which is not conducive to improving the efficiency of obtaining the guiding content. The reason is that the existing technology mainly adopts the manual acquisition method to obtain the guiding content of the virtual museum, and the manual acquisition method will consume a large amount of human and time resources, increasing the acquisition time of the guiding content of the virtual museum. Moreover, most of the guiding content of the virtual museum is text and voice, which is not intuitive enough. Therefore, it is not conducive to improving the guiding content of the virtual museum. Summary of the Invention

[0004] The present invention provides a virtual museum guiding method, device, computer equipment and storage medium to solve the technical problem that the process of obtaining the guiding content of the existing virtual museum is cumbersome and not conducive to improving the efficiency of obtaining the guiding content.

[0005] In a first aspect, a virtual museum guiding method is provided, including: Obtain the current state of the VR headset device. When the current state of the VR headset device is the wearing state, obtain the permission level corresponding to the device identifier. When the permission level is higher than the preset level, obtain the virtual exhibits in the virtual museum; Display the virtual exhibits. Starting from the start display time of the virtual exhibits, obtain the movement amplitude of the head or hand within a preset time; Based on the movement amplitude, determine the demonstration video of the presenter interacting with the virtual exhibits; Replace the background part in the demonstration video with a semi-transparent background to obtain a demonstration video with a semi-transparent background; Play the demonstration video with a semi-transparent background. After the demonstration video with a semi-transparent background is played, capture the gesture actions of the user interacting with the virtual exhibits; When the gesture action is not a standard action, obtain the gesture animation based on a predefined method, select the gesture animation as the guiding content of the virtual museum, and display the guiding content of the virtual museum.

[0006] Further, for the display of the virtual exhibit, within a preset time from the start display time of the virtual exhibit, the movement amplitude of the head or hand is obtained, including: Display the virtual exhibit, obtain a recording instruction, execute the recording instruction, and record the start display time of the virtual exhibit; Within a preset time from the start display time of the virtual exhibit, obtain the movement amplitude of the head or hand.

[0007] Further, for determining the demonstration video of the presenter interacting with the virtual exhibit based on the movement amplitude, including: When the movement amplitude is less than the preset amplitude, access a preset file, and in the preset file, obtain multiple videos of the presenter interacting with the virtual exhibit; Obtain the score and play frequency corresponding to each video, multiply the score and play frequency corresponding to each video to obtain the evaluation value corresponding to each video, and select the video with the highest evaluation value as the demonstration video.

[0008] Further, for replacing the background part in the demonstration video with a semi-transparent background to obtain a demonstration video with a semi-transparent background, including: Input the demonstration video into an image processing tool, and process the demonstration video through the image processing tool to obtain the background part in the demonstration video; Obtain a replacement instruction, execute the replacement instruction, replace the background part in the demonstration video with a semi-transparent background, and obtain a demonstration video with a semi-transparent background.

[0009] Further, for playing the demonstration video with a semi-transparent background, and after the demonstration video with a semi-transparent background is played, capturing the gesture actions of the user interacting with the virtual exhibit, including: Play the demonstration video with a semi-transparent background, and after the demonstration video with a semi-transparent background is played, capture the actions of the user grasping the virtual exhibit, the user rotating the virtual exhibit, the user clicking on the virtual exhibit, and the user waving the virtual exhibit; Select the actions of the user grasping the virtual exhibit, the user rotating the virtual exhibit, the user clicking on the virtual exhibit, and the user waving the virtual exhibit as gesture actions.

[0010] Further, when the gesture action is not a standard action, obtain a gesture animation based on a predefined method, select the gesture animation as the guiding content of the virtual museum, and display the guiding content of the virtual museum, including: When the gesture action is not a standard action, obtain multiple pose data and model files corresponding to the standard action, load the hand model from the model file through a loading script, map the multiple pose data to the bones of the hand model to obtain a hand model carrying multiple pose data, and input the hand model carrying multiple pose data into a graphics rendering engine to obtain multiple frames of images simulating the standard action; Encode the multiple frames of images simulating the standard action in chronological order to generate a gesture animation, select the gesture animation as the guiding content of the virtual museum, and display the guiding content of the virtual museum.

[0011] Further, after obtaining the gesture animation based on a predefined method and selecting the gesture animation as the guiding content of the virtual museum and displaying the guiding content of the virtual museum when the gesture action is not a standard action, the virtual museum guiding method includes: Create a storage area, store the guiding content of the virtual museum in the storage area, and create an access interface for the storage area.

[0012] In a second aspect, a virtual museum guiding device is provided, including: A first acquisition module, configured to acquire the current state of the VR headset device. When the current state of the VR headset device is a wearing state, acquire the permission level corresponding to the device identifier. When the permission level is higher than a preset level, acquire virtual exhibits in the virtual museum; A second acquisition module, configured to display the virtual exhibits and acquire the movement amplitude of the head or hand within a preset time starting from the start display time of the virtual exhibits; A determination module, configured to determine a demonstration video of the presenter interacting with the virtual exhibits based on the movement amplitude; A replacement module, configured to replace the background part in the demonstration video with a semi-transparent background to obtain a demonstration video with a semi-transparent background; A playback module, configured to play the demonstration video with a semi-transparent background, and capture the gesture action of the user interacting with the virtual exhibits after the demonstration video with a semi-transparent background is played; A guiding module, configured to obtain a gesture animation based on a predefined method and select the gesture animation as the guiding content of the virtual museum and display the guiding content of the virtual museum when the gesture action is not a standard action.

[0013] In a third aspect, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the above virtual museum guiding method are implemented.

[0014] In a fourth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above-mentioned virtual museum guiding method are implemented.

[0015] This application provides a virtual museum guiding method, device, computer device, and storage medium. The current state of the VR headset device is obtained. When the current state of the VR headset device is the wearing state, the permission level corresponding to the device identifier is obtained. When the permission level is higher than the preset level, the virtual exhibits in the virtual museum are obtained; the virtual exhibits are displayed. From the start display time of the virtual exhibits, within a preset time, the movement amplitude of the head or hand is obtained; based on the movement amplitude, a demonstration video of the presenter interacting with the virtual exhibits is determined; the background part in the demonstration video is replaced with a semi-transparent background to obtain a demonstration video with a semi-transparent background; the demonstration video with a semi-transparent background is played. After the demonstration video with a semi-transparent background is played, the gesture actions of the user interacting with the virtual exhibits are captured; when the gesture actions are not standard actions, based on a predefined method, gesture animations are obtained, and the gesture animations are selected as the guiding content of the virtual museum, and the guiding content of the virtual museum is displayed. The beneficial effects are in two aspects. On the one hand, when the gesture actions are not standard actions, based on a predefined method, gesture animations are obtained, and the gesture animations are selected as the guiding content of the virtual museum, and the guiding content of the virtual museum is displayed. Since there is no need to manually obtain the guiding content of the virtual museum, the acquisition time of the guiding content of the virtual museum is reduced, which is beneficial to improving the acquisition efficiency of the guiding content of the virtual museum. On the other hand, the gesture animations are selected as the guiding content of the virtual museum. By simulating standard actions with gesture animations, it is beneficial to guide users to interact with virtual exhibits using standard actions, without the need for users to perform additional voice parsing or text reading. Therefore, compared with voice and text, gesture animations have a more intuitive expression advantage, so the guiding time of the virtual museum can be reduced, which is beneficial to improving the guiding efficiency of the virtual museum. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments of the present invention will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained based on these drawings.

[0017] Figure 1 It is a schematic diagram of an application environment of the virtual museum guiding method in an embodiment of the present invention; Figure 2 It is a flowchart of a virtual museum guiding method provided by an embodiment of the present invention; Figure 3Yes Figure 2 is a schematic flowchart of a specific implementation manner of step S23 in Figure 4 Yes Figure 2 is a schematic flowchart of a specific implementation manner of step S25 in Figure 5 Yes Figure 2 is a schematic flowchart of a specific implementation manner of step S26 in Figure 6 is a schematic structural diagram of a virtual museum guiding device in an embodiment of the present invention; Figure 7 is a schematic structural diagram of a computer device in an embodiment of the present invention. Specific implementation manner

[0018] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present invention.

[0019] Please refer to Figure 1 , Figure 1 is a schematic diagram of an application environment of a virtual museum guiding method in an embodiment of the present invention. The virtual museum guiding method provided by the embodiments of the present invention can be applied in an application environment such as Figure 1 , where the client communicates with the server through the network.

[0020] The server obtains the current state of the VR headset device through the client. When the current state of the VR headset device is the wearing state, it obtains the permission level corresponding to the device identifier. When the permission level is higher than the preset level, it obtains the virtual exhibits in the virtual museum; Displays the virtual exhibits. From the start display time of the virtual exhibits, within a preset time, it obtains the movement amplitude of the head or hand; Based on the movement amplitude, it determines the demonstration video of the interaction between the demonstrator and the virtual exhibits; Replaces the background part in the demonstration video with a semi-transparent background to obtain a demonstration video with a semi-transparent background; Plays the demonstration video with a semi-transparent background. After the demonstration video with a semi-transparent background is played, it captures the gesture actions of the user interacting with the virtual exhibits; When the gesture action is not a standard action, based on a predefined method, it obtains the gesture animation, selects the gesture animation as the guiding content of the virtual museum, and displays the guiding content of the virtual museum.

[0021] In the solution implemented by the above virtual museum guidance method, device, equipment and medium, the beneficial effects are in two aspects. On the one hand, when the gesture action is not a standard action, based on a predefined method, a gesture animation is obtained, and the gesture animation is selected as the guidance content of the virtual museum, and the guidance content of the virtual museum is displayed. Since there is no need to manually obtain the guidance content of the virtual museum, the acquisition time of the guidance content of the virtual museum is reduced, which is beneficial to improving the acquisition efficiency of the guidance content of the virtual museum. On the other hand, the gesture animation is selected as the guidance content of the virtual museum, and the standard action is simulated through the gesture animation, which is beneficial to guiding the user to interact with the virtual exhibits using the standard action, without the user having to perform additional voice parsing or text reading. Therefore, compared with voice and text, the gesture animation has a more intuitive expression advantage, so it can reduce the guidance time of the virtual museum, which is beneficial to improving the guidance efficiency of the virtual museum.

[0022] Among them, the device running the client is simply referred to as: client device.

[0023] Among them, the device running the server is simply referred to as: server device.

[0024] Among them, the client device includes but is not limited to VR headset devices, smart phones, personal computers, vehicle networking terminals, tablet computers and portable wearable devices.

[0025] Among them, the server device can be implemented by an independent server or a server cluster composed of multiple servers. The present invention will be described in detail below through specific embodiments. Please refer to Figure 2 , Figure 2 FIG. is a schematic flow chart of a virtual museum guidance method provided by an embodiment of the present invention, including the following steps: S21, obtain the current state of the VR headset device. When the current state of the VR headset device is the worn state, obtain the permission level corresponding to the device identifier. When the permission level is higher than the preset level, obtain the virtual exhibits in the virtual museum; Among them, VR (Virtual Reality) is the core technical basis in the VR headset device. The VR headset device uses computer technology to create a three-dimensional virtual environment completely different from the real world. The VR headset device is a device integrating a high-precision display screen, advanced sensors and a complex processing system.

[0026] Among them, the VR headset device presents a stereoscopic picture through special display technology, cooperates with precise sensors to track the user's head movements, and updates the virtual perspective in real time, so that the user seems to be in a real three-dimensional environment. The VR headset device not only requires a high degree of technical integration ability, but also requires powerful computing power to support a smooth virtual experience, and is an important carrier of virtual reality technology.

[0027] Exemplarily, obtain the current state of the VR headset device. When the current state of the VR headset device is the worn state, obtain the permission level corresponding to the device identifier. When the permission level is higher than the preset level, obtain the virtual exhibits in the virtual museum, including: Obtain the current state of the VR headset device. When the current state of the VR headset device is the worn state, display multiple virtual scene identifiers, and obtain the virtual scene identifier selected by the user from the multiple virtual scene identifiers; When the virtual scene identifier is the virtual museum, obtain the device identifier of the VR headset device, obtain the permission level corresponding to the device identifier. When the permission level is higher than the preset level, obtain the 3D file corresponding to the virtual exhibit, input the 3D file into the graphics processor in the VR headset device, and render the 3D file through the graphics processor to obtain the virtual exhibit in the virtual museum.

[0028] Among them, the virtual scene identifier is the identifier corresponding to the virtual scene.

[0029] Among them, different virtual scene identifiers correspond to the identifiers of different virtual scenes.

[0030] Among them, the virtual exhibit is an exhibit that exists in a virtual form. The virtual exhibit is not a physical object, but a digital display content created using digital technology.

[0031] Among them, the virtual exhibits include, but are not limited to, bronzes in virtual form, ceramics in virtual form, calligraphy and painting works in virtual form, rubbings of steles in virtual form, animal and plant specimens in virtual form, mineral fossils in virtual form, stone tools in virtual form, and jade articles in virtual form.

[0032] S22, display the virtual exhibit. From the start display time of the virtual exhibit, within a preset time, obtain the movement amplitude of the head or hand; Among them, when displaying the virtual exhibit, the virtual exhibit can be presented to the user in a more vivid and intuitive way, which not only enhances the user's immersion and participation, enables the user to more deeply understand the historical background and cultural connotation of the exhibit, but also improves the display efficiency and protection level of the exhibit.

[0033] Among them, the step of displaying the virtual exhibit and obtaining the movement amplitude of the head or hand within a preset time from the start display time of the virtual exhibit includes: Display the virtual exhibit, obtain the recording instruction, execute the recording instruction, and record the start display time of the virtual exhibit; From the start display time of the virtual exhibit, within a preset time, obtain the movement amplitude of the head or hand.

[0034] For ease of explanation, the following examples are given: For example, the start display time of the virtual exhibit is 2:30, and the preset time is 1 minute. Starting from 2:30, within 1 minute, obtain the movement amplitude of the head or hand, that is, within the time period from 2:30 to 2:31, obtain the movement amplitude of the head or hand.

[0035] For example, the start display time of the virtual exhibit is 2:40, and the preset time is 2 minutes.

[0036] Starting from 2:40, within 2 minutes, obtain the movement amplitude of the head or hand, that is, within the time period from 2:40 to 2:42, obtain the movement amplitude of the head or hand.

[0037] Among them, starting from the start display time of the virtual exhibit, within the preset time, obtain the movement amplitude of the head or hand, and the behavior pattern of the user can be understood.

[0038] S23. Based on the movement amplitude, determine the demonstration video of the presenter interacting with the virtual exhibit; Among them, if the movement amplitude is too small, it indicates that the user is confused or unfamiliar with the interaction method of the virtual exhibit. Because when the user performs interactive operations, the user will execute corresponding actions according to their own understanding and experience. If the user is confused about the interaction method of the virtual exhibit, the user will often show hesitant and uncertain behaviors, and such behaviors may be reflected as too small a movement amplitude in physical actions. Because the user may not be sure how to perform the next operation or may take a cautious and tentative action method for fear of making mistakes. Therefore, too small a movement amplitude can be used as an indication signal of the user's operation confusion or unfamiliarity.

[0039] Among them, when the movement amplitude is too small, obtain the demonstration video of the presenter interacting with the virtual exhibit. The demonstration video can intuitively display the correct operation methods and steps, helping the user quickly understand and master the operation skills.

[0040] S24. Replace the background part in the demonstration video with a semi-transparent background to obtain a demonstration video with a semi-transparent background; Among them, the operation of replacing the background part in the demonstration video with a semi-transparent background to obtain a demonstration video with a semi-transparent background includes: Input the demonstration video into an image processing tool, and process the demonstration video through the image processing tool to obtain the background part in the demonstration video; Obtain a replacement instruction, execute the replacement instruction, replace the background part in the demonstration video with a semi-transparent background, and obtain a demonstration video with a semi-transparent background.

[0041] Among them, the background part in the demonstration video is replaced with a semi-transparent background to obtain a demonstration video with a semi-transparent background. The semi-transparent background not only retains part of the visual information of the demonstration video but also makes it possible to overlay other elements or backgrounds on the demonstration video, enhancing the flexibility and editability of the demonstration video. At the same time, the semi-transparent background can also highlight the video content of the demonstration video, reduce interference, and help users focus on the key information in the video.

[0042] S25, play the demonstration video with a semi-transparent background. After the demonstration video with a semi-transparent background is played, capture the gesture actions of the user interacting with the virtual exhibit. Among them, when playing the demonstration video with a semi-transparent background, the user watches the demonstration video, and the user can learn the standard actions in the demonstration video with a semi-transparent background.

[0043] Among them, the VR headset device can, through the integrated sensors and tracking system, capture in real time the gesture actions of the user interacting with the virtual exhibit. By capturing the gesture actions of the user interacting with the virtual exhibit, it is possible to understand the confusion or demand points during the process of the user interacting with the virtual exhibit, so as to provide targeted guidance and help.

[0044] S26, when the gesture action is not a standard action, based on a predefined method, obtain a gesture animation, select the gesture animation as the guiding content of the virtual museum, and display the guiding content of the virtual museum.

[0045] Among them, obtaining a gesture animation, selecting the gesture animation as the guiding content of the virtual museum, and displaying the guiding content of the virtual museum, and showing the interaction method of the virtual exhibit in the virtual museum to the user through the guiding content is beneficial to improving the interaction efficiency between the user and the virtual exhibit.

[0046] Among them, after the gesture action is not a standard action, based on a predefined method, obtaining a gesture animation, selecting the gesture animation as the guiding content of the virtual museum, and displaying the guiding content of the virtual museum, the virtual museum guiding method includes: Create a storage area, store the guiding content of the virtual museum in the storage area, and create an access interface for the storage area.

[0047] Among them, accessing the guiding content of the virtual museum through the interface can achieve a quick response to the user's needs. When the user needs help, they can immediately obtain the guiding content of the virtual museum, which is beneficial to improving the user experience. In addition, the guiding content of the virtual museum can be called by different applications in a reusable manner, greatly improving the utilization rate of the guiding content of the virtual museum.

[0048] Exemplarily, after S25, the virtual museum guiding method includes: Step A, when the gesture action is a standard action, send a single vibration instruction to the haptic feedback module of the VR headset device, so that the haptic feedback module completes the vibration according to the single vibration instruction.

[0049] Wherein, after S25, S26 or Step A is executed.

[0050] Wherein, the haptic feedback module is a system component integrating hardware and software technologies, aiming to convey haptic information to the user by vibrating. For the convenience of explanation, the following is an example: When the haptic feedback module receives a single vibration instruction, it will parse the instruction parameters, drive the vibration motor, execute the vibration and stop after completion. The whole process is highly controllable, can accurately simulate various haptic effects, and provides an immersive interaction experience for the user.

[0051] In the embodiment of the present invention, the beneficial effects are in two aspects. On the one hand, when the gesture action is not a standard action, based on a predefined method, obtain the gesture animation, select the gesture animation as the guiding content of the virtual museum, and display the guiding content of the virtual museum. Since there is no need to manually obtain the guiding content of the virtual museum, the acquisition time of the guiding content of the virtual museum is reduced, which is beneficial to improving the acquisition efficiency of the guiding content of the virtual museum. On the other hand, select the gesture animation as the guiding content of the virtual museum, and simulate the standard action through the gesture animation, which is beneficial to guiding the user to interact with the virtual exhibits using the standard action, without the user having to perform additional voice parsing or text reading. Therefore, compared with voice and text, the gesture animation has a more intuitive expression advantage, so it can reduce the guiding time of the virtual museum and is beneficial to improving the guiding efficiency of the virtual museum.

[0052] Please refer to Figure 3 , Figure 3 is Figure 2 a schematic flowchart of a specific implementation manner of step S23 in S31, when the movement amplitude is less than the preset amplitude, access the preset file, and in the preset file, obtain multiple videos of the presenter interacting with the virtual exhibits; S32, obtain the score and playback frequency corresponding to each video, multiply the score and playback frequency corresponding to each video to obtain the evaluation value corresponding to each video, and select the video with the highest evaluation value as the demonstration video.

[0053] For the convenience of explanation, the following is an example: For example, the multiple videos are Video 1, Video 2, and Video 3 respectively; Obtain the score corresponding to Video 1 and the playback frequency of Video 1, multiply the score corresponding to Video 1 and the playback frequency of Video 1 to obtain the evaluation value corresponding to Video 1; Obtain the score corresponding to Video 2 and the playback frequency of Video 2, multiply the score corresponding to Video 2 and the playback frequency of Video 2 to obtain the evaluation value corresponding to Video 2; Obtain the score corresponding to Video 3 and the playback frequency of Video 3, multiply the score corresponding to Video 3 and the playback frequency of Video 3 to obtain the evaluation value corresponding to Video 3.

[0054] Among Video 1, Video 2, and Video 3, when the evaluation value corresponding to Video 1 is the highest, select Video 1 as the demonstration video; among Video 1, Video 2, and Video 3, when the evaluation value corresponding to Video 2 is the highest, select Video 2 as the demonstration video; among Video 1, Video 2, and Video 3, when the evaluation value corresponding to Video 3 is the highest, select Video 3 as the demonstration video.

[0055] In the embodiment of the present invention, selecting the video with the highest evaluation value as the demonstration video can ensure the reliability of the demonstration video.

[0056] Please refer to Figure 4 , Figure 4 is Figure 2 a schematic flowchart of a specific implementation manner of step S25 in S41, play the demonstration video with a semi-transparent background. After the demonstration video with a semi-transparent background is played, capture the actions of the user grabbing the virtual exhibit, the user rotating the virtual exhibit, the user clicking on the virtual exhibit, and the user waving the virtual exhibit; S42, select the actions of the user grabbing the virtual exhibit, the user rotating the virtual exhibit, the user clicking on the virtual exhibit, and the user waving the virtual exhibit as gesture actions.

[0057] Among them, selecting the actions of the user grabbing the virtual exhibit, the user rotating the virtual exhibit, the user clicking on the virtual exhibit, and the user waving the virtual exhibit as gesture actions. This design can simplify development and maintenance. By processing the actions of the user grabbing the virtual exhibit, the user rotating the virtual exhibit, the user clicking on the virtual exhibit, and the user waving the virtual exhibit through a unified framework, it reduces duplicate code and resource overhead and improves development efficiency.

[0058] In the embodiment of the present invention, capturing the actions of the user grabbing the virtual exhibit, the user rotating the virtual exhibit, the user clicking on the virtual exhibit, and the user waving the virtual exhibit can more accurately understand the user's needs and intentions, thereby providing more personalized and considerate services.

[0059] Please refer to Figure 5 , Figure 5 is Figure 2 a schematic flowchart of a specific implementation manner of step S26 in S51. When the gesture action is not a standard action, obtain multiple pose data and model files corresponding to the standard action. Load the hand model from the model file through a loading script, map the multiple pose data onto the bones of the hand model to obtain a hand model carrying multiple pose data, and input the hand model carrying multiple pose data into the graphics rendering engine to obtain multiple frames of images simulating the standard action. Among them, the hand model is a digital reproduction of the human hand structure and form. The hand model is usually created through 3D modeling technology and can simulate the bone structure, muscle distribution, skin texture, and joints of the hand.

[0060] Among them, the hand models carrying different pose data correspond to different images simulating the standard action.

[0061] For the convenience of explanation, take the action of the hand rotating a virtual exhibit in the standard action as an example, as follows: The multiple pose data are respectively pose data 1, pose data 2, pose data 3, pose data 4, pose data 5, pose data 5, pose data 6, and pose data 7. Input the hand model carrying pose data 1 into the graphics rendering engine to generate the first frame of the image simulating the standard action. The first frame of the image simulating the standard action is used to simulate the hand in the standard action holding the virtual exhibit, with the front of the virtual exhibit facing forward.

[0062] Input the hand model carrying pose data 2 into the graphics rendering engine to generate the second frame of the image simulating the standard action. The second frame of the image simulating the standard action is used to simulate the hand in the standard action starting to rotate, and the virtual exhibit rotates 30 degrees.

[0063] Input the hand model carrying pose data 3 into the graphics rendering engine to generate the third frame of the image simulating the standard action. The third frame of the image simulating the standard action is used to simulate the hand in the standard action continuing to rotate, and the product rotates 60 degrees.

[0064] Input the hand model carrying pose data 4 into the graphics rendering engine to generate the fourth frame of the image simulating the standard action. The fourth frame of the image simulating the standard action is used to simulate the hand in the standard action continuing to rotate, and the product rotates 90 degrees.

[0065] Input the hand model carrying pose data 5 into the graphics rendering engine to generate the fifth frame of the image simulating the standard action. The fifth frame of the image simulating the standard action is used to simulate the hand in the standard action continuing to rotate, and the product rotates 120 degrees.

[0066] Input the hand model carrying the pose data 6 into the graphics rendering engine to generate the 6th frame of the simulated standard action image. The 6th frame of the simulated standard action image is used to simulate the continuous rotation of the hand in the standard action, and the product rotates 160 degrees.

[0067] Input the hand model carrying the pose data 7 into the graphics rendering engine to generate the 7th frame of the simulated standard action image. The 7th frame of the simulated standard action image is used to simulate the continuous rotation of the hand in the standard action, and the product rotates 180 degrees. At this time, the back of the virtual exhibit faces forward.

[0068] Among them, pose data 1, pose data 2, pose data 3, pose data 4, pose data 5, pose data 5, pose data 6, and pose data 7 are different pose data.

[0069] For the convenience of explanation, take the action of the hand grasping the virtual exhibit in the standard action as an example, as follows: The multiple pose data are respectively pose data A, pose data B, pose data C, and pose data D; Input the hand model carrying the pose data A into the graphics rendering engine to generate the A - th frame of the simulated standard action image. The A - th frame of the simulated standard action image is used to simulate the hand opening in the standard action, and the virtual exhibit is stationary.

[0070] Input the hand model carrying the pose data B into the graphics rendering engine to generate the B - th frame of the simulated standard action image. The B - th frame of the simulated standard action image is used to simulate the hand starting to close and approaching the virtual exhibit.

[0071] Input the hand model carrying the pose data C into the graphics rendering engine to generate the C - th frame of the simulated standard action image. The C - th frame of the simulated standard action image is used to simulate the hand partially closing and touching the virtual exhibit.

[0072] Input the hand model carrying the pose data D into the graphics rendering engine to generate the D - th frame of the simulated standard action image. The D - th frame of the simulated standard action image is used to simulate the hand completely closing and grasping the virtual exhibit.

[0073] Among them, pose data A, pose data B, pose data C, and pose data D are different pose data.

[0074] S52. According to the chronological order, encode the multiple frames of the simulated standard action images to generate a gesture animation, select the gesture animation as the guiding content of the virtual museum, and display the guiding content of the virtual museum.

[0075] In an embodiment of the present invention, multiple frames of pictures simulating standard actions are encoded in chronological order to generate a gesture animation. The gesture animation is selected as the guiding content of the virtual museum, and the guiding content of the virtual museum is displayed. Since there is no need to manually obtain the guiding content of the virtual museum, the acquisition time of the guiding content of the virtual museum is reduced, which is beneficial to improving the acquisition efficiency of the guiding content of the virtual museum.

[0076] Please refer to Figure 6 , Figure 6 which is a schematic structural diagram of a virtual museum guiding device in an embodiment of the present invention. As Figure 6 shown, the virtual museum guiding device includes a first acquisition module 101, a second acquisition module 102, a determination module 103, a replacement module 104, a playback module 105, and a guiding module 106. The detailed description of each functional module is as follows: The first acquisition module 101 is used to acquire the current state of the VR headset device. When the current state of the VR headset device is the wearing state, it acquires the permission level corresponding to the device identifier. When the permission level is higher than the preset level, it acquires the virtual exhibits in the virtual museum; The second acquisition module 102 is used to display the virtual exhibits and acquire the movement amplitude of the head or hand within a preset time starting from the start display time of the virtual exhibits. The determination module 103 is used to determine a demonstration video of the presenter interacting with the virtual exhibit based on the movement amplitude. The replacement module 104 is used to replace the background part in the demonstration video with a semi-transparent background to obtain a demonstration video with a semi-transparent background. The playback module 105 is used to play the demonstration video with a semi-transparent background. After the demonstration video with a semi-transparent background is played, it captures the gesture actions of the user interacting with the virtual exhibit. The guiding module 106 is used to, when the gesture action is not a standard action, obtain a gesture animation based on a predefined method, select the gesture animation as the guiding content of the virtual museum, and display the guiding content of the virtual museum.

[0077] In an embodiment, the second acquisition module 102 includes: A first acquisition subunit, which is used to display the virtual exhibits, obtain a recording instruction, execute the recording instruction, and record the start display time of the virtual exhibits; A second acquisition subunit, which is used to acquire the movement amplitude of the head or hand within a preset time starting from the start display time of the virtual exhibits.

[0078] In an embodiment, the determination module 103 includes: An access subunit, configured to access a preset file when the movement amplitude is less than a preset amplitude, and in the preset file, obtain multiple videos in which a presenter interacts with virtual exhibits; A third acquisition subunit, configured to acquire the score and play frequency corresponding to each video, multiply the score and play frequency corresponding to each video, obtain the evaluation value corresponding to each video, and select the video with the highest evaluation value as the demonstration video.

[0079] In one embodiment, the replacement module 104 includes: An input subunit, configured to input the demonstration video into an image processing tool, and process the demonstration video through the image processing tool to obtain the background part in the demonstration video; A replacement subunit, configured to obtain a replacement instruction, execute the replacement instruction, replace the background part in the demonstration video with a semi-transparent background, and obtain a demonstration video with a semi-transparent background.

[0080] In one embodiment, the playback module 105 includes: A playback subunit, configured to play the demonstration video with a semi-transparent background, and after the demonstration video with a semi-transparent background is played, capture the actions of the user grasping the virtual exhibit, the user rotating the virtual exhibit, the user clicking on the virtual exhibit, and the user waving the virtual exhibit; A selection subunit, configured to select the actions of the user grasping the virtual exhibit, the user rotating the virtual exhibit, the user clicking on the virtual exhibit, and the user waving the virtual exhibit as gesture actions.

[0081] In one embodiment, the guidance module 106 includes: A fourth acquisition subunit, configured to, when the gesture action is not a standard action, acquire multiple pose data and model files corresponding to the standard action, load a hand model from the model file through a loading script, map the multiple pose data to the bones of the hand model, obtain a hand model carrying the multiple pose data, and input the hand model carrying the multiple pose data into a graphics rendering engine to obtain multiple frames of pictures simulating the standard action; A display subunit, configured to encode the multiple frames of pictures simulating the standard action in chronological order to generate a gesture animation, select the gesture animation as the guidance content of the virtual museum, and display the guidance content of the virtual museum.

[0082] In one embodiment, the virtual museum guidance device further includes: A creation module, configured to create a storage area, store the guidance content of the virtual museum in the storage area, and create an access interface for the storage area.

[0083] In the embodiments of the present invention, the beneficial effects are in two aspects. On the one hand, when the gesture action is not a standard action, based on a predefined method, a gesture animation is obtained, and the gesture animation is selected as the guiding content of the virtual museum, and the guiding content of the virtual museum is displayed. Since there is no need to manually obtain the guiding content of the virtual museum, the acquisition time of the guiding content of the virtual museum is reduced, which is beneficial to improving the acquisition efficiency of the guiding content of the virtual museum. On the other hand, the gesture animation is selected as the guiding content of the virtual museum. By simulating the standard action through the gesture animation, it is beneficial to guide the user to interact with the virtual exhibits using the standard action, without the user having to perform additional voice parsing or text reading. Therefore, compared with voice and text, the gesture animation has a more intuitive expression advantage, so it can reduce the guiding time of the virtual museum and is beneficial to improving the guiding efficiency of the virtual museum.

[0084] For the specific limitations of the virtual museum guiding device, reference can be made to the limitations of the virtual museum guiding method in the above text, which will not be elaborated here.

[0085] Each module in the above virtual museum guiding device can be implemented in whole or in part by software, hardware, and their combination. The above modules can be embedded in the processor of the computer device in hardware form or be independent of it, or can be stored in the memory of the computer device in software form, so as to facilitate the processor to call and execute the operations corresponding to the above modules.

[0086] Please refer to Figure 7 , Figure 7 is a schematic structural diagram of a computer device in an embodiment of the present invention. In one embodiment, a computer device is provided. The computer device is a server device or a client device, and its internal structure diagram can be as Figure 7 shown. The computer device includes a processor, a memory, a network interface, a display screen, and an input device connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the computer device is used to communicate with external devices.

[0087] When the computer program is executed by the processor, the following steps can be implemented: Obtain the current state of the VR headset device. When the current state of the VR headset device is the wearing state, obtain the permission level corresponding to the device identifier. When the permission level is higher than the preset level, obtain the virtual exhibits in the virtual museum; Display the virtual exhibits. From the start display time of the virtual exhibits, within a preset time, obtain the movement amplitude of the head or hand; Determine a demonstration video in which the demonstrator interacts with the virtual exhibit based on the movement amplitude; Replace the background part in the demonstration video with a semi-transparent background to obtain a demonstration video with a semi-transparent background; Play the demonstration video with a semi-transparent background. After the demonstration video with a semi-transparent background is played, capture the gesture actions of the user interacting with the virtual exhibit; When the gesture action is not a standard action, obtain a gesture animation based on a predefined method, select the gesture animation as the guiding content of the virtual museum, and display the guiding content of the virtual museum.

[0088] In some embodiments, a processor is used to implement: Display the virtual exhibit, obtain a recording instruction, execute the recording instruction, and record the start display time of the virtual exhibit; Starting from the start display time of the virtual exhibit, obtain the movement amplitude of the head or hand within a preset time.

[0089] In some embodiments, a processor is used to implement: When the movement amplitude is less than the preset amplitude, access a preset file, and in the preset file, obtain multiple videos in which the demonstrator interacts with the virtual exhibit; Obtain the score and playback frequency corresponding to each video, multiply the score and playback frequency corresponding to each video to obtain the evaluation value corresponding to each video, and select the video with the highest evaluation value as the demonstration video.

[0090] In some embodiments, a processor is used to implement: Input the demonstration video into an image processing tool, and process the demonstration video through the image processing tool to obtain the background part in the demonstration video; Obtain a replacement instruction, execute the replacement instruction, and replace the background part in the demonstration video with a semi-transparent background to obtain a demonstration video with a semi-transparent background.

[0091] In some embodiments, a processor is used to implement: Play the demonstration video with a semi-transparent background. After the demonstration video with a semi-transparent background is played, capture the actions of the user grasping the virtual exhibit, the user rotating the virtual exhibit, the user clicking on the virtual exhibit, and the user waving the virtual exhibit; Select the actions of the user grasping the virtual exhibit, the user rotating the virtual exhibit, the user clicking on the virtual exhibit, and the user waving the virtual exhibit as gesture actions.

[0092] In some embodiments, a processor is used to implement: When the gesture action is not a standard action, obtain multiple pose data and model files corresponding to the standard action, load the hand model from the model file through a loading script, map the multiple pose data onto the bones of the hand model to obtain a hand model carrying multiple pose data, and input the hand model carrying multiple pose data into the graphics rendering engine to obtain multiple frames of images simulating the standard action; Encode the multiple frames of images simulating the standard action in chronological order to generate a gesture animation, select the gesture animation as the guiding content of the virtual museum, and display the guiding content of the virtual museum.

[0093] In some embodiments, a processor is used to implement: Create a storage area, store the guiding content of the virtual museum in the storage area, and create an access interface for the storage area.

[0094] The embodiments of the present application provide a computer-readable storage medium storing a computer program, which when executed by a processor can implement the steps in the above-mentioned various method embodiments.

[0095] Obtain the current state of the VR headset device. When the current state of the VR headset device is the wearing state, obtain the permission level corresponding to the device identifier. When the permission level is higher than the preset level, obtain the virtual exhibits in the virtual museum; Display the virtual exhibits. Starting from the start display time of the virtual exhibits, obtain the movement amplitude of the head or hand within a preset time; Based on the movement amplitude, determine a demonstration video of the presenter interacting with the virtual exhibits; Replace the background part in the demonstration video with a semi-transparent background to obtain a demonstration video with a semi-transparent background; Play the demonstration video with a semi-transparent background. After the demonstration video with a semi-transparent background is played, capture the gesture actions of the user interacting with the virtual exhibits; When the gesture action is not a standard action, obtain a gesture animation based on a predefined method, select the gesture animation as the guiding content of the virtual museum, and display the guiding content of the virtual museum.

[0096] It should be noted that the functions or steps that the above computer-readable storage medium or computer device can implement can be referred to the relevant descriptions of the foregoing method embodiments. To avoid repetition, they will not be described one by one here.

[0097] The above-mentioned processor may be a general-purpose processor, including a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), and a Network Processor (NP); it may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, and discrete hardware components.

[0098] The above description and the accompanying drawings fully illustrate the embodiments of the present disclosure, enabling those skilled in the art to practice them. In this article, each embodiment may focus on the differences from other embodiments, and the same or similar parts among the various embodiments may be referred to each other. For the methods disclosed in the embodiments, if they correspond to the method parts disclosed in the embodiments, the relevant parts may refer to the descriptions in the method parts.

[0099] Those skilled in the art can realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed in this article can be implemented by electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are executed in a hardware or software manner may depend on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods for each specific application to implement the described functions, but such implementation should not be considered to exceed the scope of the embodiments of the present disclosure. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, devices, and units described above can refer to the corresponding processes in the foregoing method embodiments, and will not be elaborated herein.

[0100] In the embodiments disclosed herein, the device embodiments described above are merely illustrative. For example, the division of units may be only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some sub-samples may be ignored or not executed. Additionally, the couplings or direct couplings or communication connections shown or discussed among each other may be through some interfaces. The indirect couplings or communication connections of devices or units may be in electrical, mechanical, or other forms. The units described as separate components may or may not be physically separated. The components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the units may be selected according to actual needs to implement this embodiment. Additionally, in the embodiments of the present disclosure, the various functional units may be integrated in one processing unit, or each unit may exist physically alone, or two or more units may be integrated in one unit.

[0101] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architectures, functions, and operations of systems, methods, and computer programs according to embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, a program segment, or a part of code, and the module, program segment, or part of code contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions marked in the block may occur in a different order from that marked in the accompanying drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the accompanying drawings, the operations or steps corresponding to different blocks may also occur in a different order from that disclosed in the description. Sometimes, there is no specific order between different operations or steps. For example, two consecutive operations or steps may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. Each block in the block diagram and / or flowchart, as well as the combination of blocks in the block diagram and / or flowchart, may be implemented by a dedicated hardware-based system for performing the specified functions or actions, or may be implemented by a combination of dedicated hardware and computer instructions.

Claims

1. A virtual museum guiding method, characterized in that, Including: Obtain the current state of the VR headset device. When the current state of the VR headset device is the worn state, obtain the permission level corresponding to the device identifier. When the permission level is higher than the preset level, obtain the virtual exhibits in the virtual museum; Display the virtual exhibits. Starting from the start display time of the virtual exhibits, within a preset time, obtain the movement amplitude of the head or hand; Based on the movement amplitude, determine the demonstration video of the presenter interacting with the virtual exhibits; Replace the background part in the demonstration video with a semi-transparent background to obtain a demonstration video with a semi-transparent background; Play the demonstration video with a semi-transparent background. After the demonstration video with a semi-transparent background is played, capture the gesture actions of the user interacting with the virtual exhibits; When the gesture action is not a standard action, obtain the gesture animation based on a predefined method, select the gesture animation as the guiding content of the virtual museum, and display the guiding content of the virtual museum.

2. The virtual museum guiding method according to claim 1, characterized in that, The step of displaying the virtual exhibits, starting from the start display time of the virtual exhibits, within a preset time, obtaining the movement amplitude of the head or hand, includes: Display the virtual exhibits, obtain a recording instruction, execute the recording instruction, and record the start display time of the virtual exhibits; Starting from the start display time of the virtual exhibits, within a preset time, obtain the movement amplitude of the head or hand.

3. The virtual museum guiding method according to claim 1, wherein The step of determining the demonstration video of the presenter interacting with the virtual exhibits based on the movement amplitude includes: When the movement amplitude is less than the preset amplitude, access a preset file, and in the preset file, obtain multiple videos of the presenter interacting with the virtual exhibits; Obtain the score and playback frequency corresponding to each video, multiply the score and playback frequency corresponding to each video to obtain the evaluation value corresponding to each video, and select the video with the highest evaluation value as the demonstration video.

4. The virtual museum guiding method according to claim 1, wherein The step of replacing the background part in the demonstration video with a semi-transparent background to obtain a demonstration video with a semi-transparent background includes: Input the demonstration video into an image processing tool, and process the demonstration video through the image processing tool to obtain the background part in the demonstration video; Obtain a replacement instruction, execute the replacement instruction, replace the background part in the demonstration video with a semi-transparent background to obtain a demonstration video with a semi-transparent background.

5. The virtual museum guiding method according to claim 1, wherein The step of playing the demonstration video with a semi-transparent background, and after the demonstration video with a semi-transparent background is played, capturing the gesture actions of the user interacting with the virtual exhibits, includes: Play the demonstration video with a semi-transparent background. After the demonstration video with a semi-transparent background is played, capture the action of the user grasping the virtual exhibit, the action of the user rotating the virtual exhibit, the action of the user clicking on the virtual exhibit, and the action of the user waving the virtual exhibit; Select the action of the user grasping the virtual exhibit, the action of the user rotating the virtual exhibit, the action of the user clicking on the virtual exhibit, and the action of the user waving the virtual exhibit as the gesture action.

6. The virtual museum guiding method according to claim 1, wherein The step of when the gesture action is not a standard action, obtaining the gesture animation based on a predefined method, selecting the gesture animation as the guiding content of the virtual museum, and displaying the guiding content of the virtual museum, includes: When the gesture action is not a standard action, obtain multiple pose data and model files corresponding to the standard action, load the hand model from the model file through a loading script, map the multiple pose data to the bones of the hand model to obtain a hand model carrying multiple pose data, and input the hand model carrying multiple pose data into the graphics rendering engine to obtain multiple frames of pictures simulating the standard action; Encode the multiple frames of pictures simulating the standard action in chronological order to generate a gesture animation, select the gesture animation as the guiding content of the virtual museum, and display the guiding content of the virtual museum.

7. The virtual museum guiding method according to claim 1, wherein After obtaining the gesture animation based on a predefined method and selecting the gesture animation as the guiding content of the virtual museum and displaying the guiding content of the virtual museum when the gesture action is not a standard action, the virtual museum guiding method includes: Create a storage area, store the guiding content of the virtual museum in the storage area, and create an access interface for the storage area.

8. A virtual museum guiding device, characterized in that, including: A first acquisition module for acquiring the current state of the VR headset device. When the current state of the VR headset device is the wearing state, acquire the permission level corresponding to the device identifier. When the permission level is higher than the preset level, acquire the virtual exhibits in the virtual museum; A second acquisition module for displaying the virtual exhibits and acquiring the movement amplitude of the head or hand within a preset time starting from the start display time of the virtual exhibits; A determination module for determining a demonstration video of the presenter interacting with the virtual exhibit based on the movement amplitude; A replacement module for replacing the background part in the demonstration video with a semi-transparent background to obtain a demonstration video with a semi-transparent background; A playback module for playing the demonstration video with a semi-transparent background. After the demonstration video with a semi-transparent background is played, capture the gesture action of the user interacting with the virtual exhibit; A guiding module for obtaining a gesture animation based on a predefined method and selecting the gesture animation as the guiding content of the virtual museum and displaying the guiding content of the virtual museum when the gesture action is not a standard action.

9. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the virtual museum guiding method according to any one of claims 1 to 7.

10. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the steps of the virtual museum guiding method according to any one of claims 1 to 7.

Images