Method and system for carrying and watching based on VR

Abstract

The invention belongs to the technical field of VR (Virtual Reality), and discloses a method and a system for carrying and watching based on VR. The method comprises the following specific steps: S1, preparing materials; s2, making a VR scene; s3, creating and editing an explanation scheme; s4, loading and displaying by the playing end; s5, playing and controlling multi-scheme recording; s6, recording and pausing operation; and S7, user interaction. The invention provides a method and a system for making and displaying a VR speaking vehicle based on time sequence and event triggering, the making and displaying system is based on a VR picture scene, the operation is simple and flexible, the making of an explanation scheme is accelerated, the editing workload is reduced, the vehicle explanation scheme based on audio and action scripts has the advantages of flexible recording and displaying and interactivity, and the method and the system are suitable for popularization and application. Editing and editing are convenient during recording, the occupied space for storage of the coding script is small, the loading speed is high, a user can interrupt playing, convert the visual angle and click an anchor point at any time during displaying, and playing is automatically recovered after interaction is stopped for a short time.

Description

Technical Field

[0001] The present invention belongs to the field of VR virtual technology, and specifically relates to a method and system based on VR viewing. Background Art

[0002] The implementation of the car explanation solution in VR scenarios is divided into two steps: recording and playback. During recording, the narrator explains the audio while using the mouse to operate the VR picture to show a specific angle. The system records the audio and mouse trajectory and click time. During playback, the player loads the audio and synchronously loads the mouse trajectory and event file for playback, fully reproducing the narrator's audio and perspective.

[0003] Currently, the flexibility of recording is seriously insufficient. The recorder is usually required to explain and operate the mouse at the same time, which puts great pressure on the recorder. The explanation process needs to be completed in one go, which makes it difficult to recover once a mistake occurs during the recording process, and the fault tolerance is extremely poor. Moreover, since post-editing is impossible, once an error occurs, the entire explanation plan may need to be re-recorded, which undoubtedly greatly increases the time and labor costs of recording. Secondly, there are also major problems in mouse trajectory and event recording files. Such files are usually large in size, and in the Internet scenario, the loading speed is very slow during playback, which greatly affects the user's viewing experience. At the same time, the large file size will also occupy a large amount of network traffic. For users with poor network conditions, loading failures or playback jams may occur, further reducing the practicality and scalability of the explanation plan. Summary of the invention

[0004] The purpose of the present invention is to provide a method and system based on VR viewing to solve the problems raised in the above background technology.

[0005] In order to achieve the above-mentioned purpose, the present invention provides the following technical solution: a method and system based on VR viewing, the specific steps of the method are as follows:

[0006] S1: Material preparation: In the vehicle management material management page, add and upload text, pictures, videos and other materials;

[0007] S2: VR scene production: In the vehicle management scene production page, add VR pictures to create VR scenes, add anchor points and associate the anchor points with materials to complete VR scene editing;

[0008] S3: Create and edit explanation plan: Create a new explanation plan in the vehicle management explanation plan page, enter the plan name, and enter the editing page;

[0009] S4: Loading and displaying on the player: Open the player page, then load the explanation plan list, and automatically preload the audio file;

[0010] S5: Playback control for multiple program recording: the user selects a program and clicks play to create and save multiple explanation programs;

[0011] S6: Recording and Pause Operation: After recording is completed, the user clicks the Pause Explanation button;

[0012] S7: User interaction: The user interacts by moving the mouse and keyboard operations, and non-audio is checked during the mouse movement.

[0013] Preferably, the material preparation in S1 refers to adding text, pictures, videos and other materials in the vehicle management material management page; the recorded explanation audio can be uploaded on this page, or the explanation audio clip can be recorded in the vehicle management material management audio recording page and stored in the material library.

[0014] Preferably, the VR scene production in S2 refers to a series of fine operations on the scene production page of vehicle management, and a realistic VR scene is created by adding VR pictures. These VR pictures can be pictures of the car's exterior, interior, etc. taken from multiple angles, presenting a three-dimensional, real car display environment to the user. Then, anchor points are added. Anchor points can be understood as specific interaction points or focus points, and the anchor points are associated with rich materials. These materials may include text introductions, picture detail displays, video demonstrations, etc.

[0015] Preferably, the specific steps of creating and editing the explanation scheme in S3 are as follows:

[0016] Step 1: Create an explanation plan: On the Vehicle Management Explanation Plan page, create an explanation plan and enter the plan name;

[0017] Step 2: Edit the timeline: In the vehicle management explanation plan editing page, edit the timeline and select the explanation audio clip in the material library to add to the timeline;

[0018] Step 3: Recording script: Click to record script to enter the VR scene, click to play audio, and perform different operations in the VR scene accompanied by the explanation audio. The system automatically encodes the actions and saves them according to the timeline. After recording is completed, you can preview, save, and submit. The explanation plan will be saved on the server side. You can repeat this process to record multiple explanation plans.

[0019] Preferably, the loading and displaying of the playback end in S4 refers to first loading the VR image and anchor point information, building and displaying the VR scene, then loading the explanation plan and displaying the plan list name, and reading the audio in the plan for automatic loading when the playback end page is opened.

[0020] Preferably, step 1: click to play: the user selects a solution and clicks to play, and the player starts a timer to trigger a check event every 10 milliseconds:

[0021] Step 2: Control playback: accumulate the time progress variable t_sum and update the current event sequence number e_l ast, traverse and check the playback plan timeline to play the corresponding event, and perform different actions for different event types, such as audio playback, scene switching, etc.;

[0022] Step 3: Multiple program recording: Repeat the above steps to create and save multiple explanation programs to meet different needs or scenarios.

[0023] Preferably, the recording and pausing operation in S6 refers to when the user clicks the pause explanation button while watching the explanation, the player will respond quickly. First, the player will pause the timer to stop the accumulation of time to ensure that time will not continue to advance in the paused state. At the same time, the player will also pause the audio playback to stop the playback of the explanation audio immediately.

[0024] Preferably, the user interaction in S7 means that if the user moves the mouse, the player does not stop audio playback but checks events during the mouse movement and ignores non-audio events, and rechecks non-audio events after the mouse stops for 5 seconds to execute the playback logic, thereby realizing user interaction priority logic.

[0025] Preferably, based on the above method, the system is composed of a material management module, a VR scene editing module, an explanation scheme management module, a playback end control module, a multi-scheme recording and saving module, a user interaction module and an audio processing module.

[0026] The beneficial effects of the present invention are as follows:

[0027] 1. The present invention provides a method and system for producing and displaying VR car explanations based on timing and event triggering. The production and display system is based on VR picture scenes, and the production steps S1 to S2 are described. The operation is simple and flexible, which can effectively speed up the production of explanation plans and reduce editing workload. The encoding scheme of the scene display action is as described in step S3. Because key events are sparse in the entire explanation event line, there is no need to record them all the time, which can effectively reduce redundant information and reduce the volume of recorded files.

[0028] 2. As shown in steps S4 to S5 of the present invention, the player can read the timing information and key event codes in the recorded file with extremely high efficiency and accuracy. Through advanced algorithms and optimized processing procedures, the player can strictly ensure that the picture synchronization error is less than 10 milliseconds while playing the audio. This excellent performance allows users to have an extremely smooth and natural experience when watching the playback, as if they are in a real scene. Through step S6, during the commentary process, if the player detects user operation, it will pause the action display, but the audio playback will not stop, thereby improving the interactivity during playback. This design greatly improves the interactivity during playback, allowing users to have more control during the commentary process.

[0029] 3. The present invention has the advantages of flexible recording, display and interactivity through the car explanation solution based on audio and action scripts. During recording, audio clips and action scripts can be recorded and inserted into the timeline, which is more convenient for editing than recording videos and full-time mouse events. The encoded script storage occupies a small space and has a fast loading speed. It can be interactive during display. Users can interrupt playback, freely change viewing angles and click anchor points at any time while watching the explanation in the VR scene. The player will automatically resume playback after 5 seconds of stopping interaction. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 This is a flow chart of the VR viewing method of the present invention. DETAILED DESCRIPTION

[0031] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0032] like Figure 1 As shown, the embodiment of the present invention provides a method and system based on VR viewing, and the specific steps of the method are as follows:

[0033] S1: Material preparation: In the vehicle management material management page, add and upload text, pictures, videos and other materials;

[0034] S2: VR scene production: In the vehicle management scene production page, add VR pictures to create VR scenes, add anchor points and associate the anchor points with materials to complete VR scene editing;

[0035] S3: Create and edit explanation plan: Create a new explanation plan in the vehicle management explanation plan page, enter the plan name, and enter the editing page;

[0036] S4: Loading and displaying on the player: Open the player page, then load the explanation plan list, and automatically preload the audio file;

[0037] S5: Playback control for multiple program recording: the user selects a program and clicks play to create and save multiple explanation programs;

[0038] S6: Recording and Pause Operation: After recording is completed, the user clicks the Pause Explanation button;

[0039] S7: User interaction: The user interacts by moving the mouse and keyboard operations, and non-audio is checked during the mouse movement.

[0040] Among them, the material preparation in S1 refers to adding text, pictures, videos and other materials in the vehicle management material management page; you can upload the recorded explanation audio on this page, or record the explanation audio clip in the vehicle management material management recording audio page and save it in the material library.

[0041] The material management page of vehicle management provides users with a rich variety of material adding options. Users can easily add text materials and provide detailed instructions and introductions for various aspects of the vehicle through concise and clear text descriptions. The addition of picture materials can intuitively display the appearance, interior and various characteristic details of the vehicle, allowing users to have a clearer visual understanding of the vehicle. Video materials can dynamically present the performance and driving experience of the vehicle, bringing users a more vivid experience.

[0042] Among them, the VR scene production in S2 refers to a series of fine operations on the scene production page of vehicle management, and a realistic VR scene is created by adding VR pictures. These VR pictures can be pictures of the car's exterior, interior, etc. taken from multiple angles, presenting a three-dimensional, real car display environment to the user. Then, anchor points are added. Anchor points can be understood as specific interaction points or focus points, and the anchor points are associated with rich materials. These materials may include text introductions, picture details, video demonstrations, etc.

[0043] The VR pictures of the car exterior taken from multiple angles are like professional photographers capturing the beauty of the car's lines and the wonders of light and shadow from various unique perspectives, making the user feel as if they are standing next to the car and can fully appreciate the car's elegant posture. The VR pictures of the interior are like a caring tour guide, leading the user into the internal world of the car, showing every exquisite detail and every comfortable design, allowing the user to feel the luxury and warmth brought by the car, and presenting a three-dimensional and real car display environment for the user.

[0044] The specific steps for creating and editing the explanation scheme in S3 are as follows:

[0045] Step 1: Create an explanation plan: On the Vehicle Management Explanation Plan page, create an explanation plan and enter the plan name;

[0046] Step 2: Edit the timeline: In the vehicle management explanation plan editing page, edit the timeline and select the explanation audio clip in the material library to add to the timeline;

[0047] Step 3: Recording script: Click to record script to enter the VR scene, click to play audio, and perform different operations in the VR scene accompanied by the explanation audio. The system automatically encodes the actions and saves them according to the timeline. After recording is completed, you can preview, save, and submit. The explanation plan will be saved on the server side. You can repeat this process to record multiple explanation plans.

[0048] In short, the creation and editing process of S3's explanation plan is a creative and challenging process. Through the close cooperation of these three steps, users can create amazing car explanation plans and bring a new visual and auditory experience to the audience.

[0049] Among them, the playback end loading and display in S4 refers to that when the playback end page is opened, the VR image and anchor point information are first loaded, the VR scene is constructed and displayed, and then the explanation plan is loaded and the plan list name is displayed, and the audio in the plan is read and loaded automatically.

[0050] First, the system quickly loads VR images and anchor information. These VR images are like beautiful paintings, showing the exterior, interior and unique details of the car from all angles. Each image has been carefully selected and processed to ensure its clarity and realism.

[0051] The specific steps of playing and controlling the multi-scheme recording in S5 are as follows:

[0052] Step 1: Click to play: The user selects a solution and clicks to play. The player starts a timer and triggers a check event every 10 milliseconds:

[0053] Step 2: Control playback: accumulate the time progress variable t_sum and update the current event sequence number e_l ast, traverse and check the playback plan timeline to play the corresponding event, and perform different actions for different event types, such as audio playback, scene switching, etc.;

[0054] Step 3: Multiple program recording: Repeat the above steps to create and save multiple explanation programs to meet different needs or scenarios.

[0055] In short, the S5's playback control and multi-scheme recording function brings users the ultimate playback experience and rich creative space through precise playback control and powerful multi-scheme recording functions.

[0056] Among them, the recording and pausing operation in S6 refers to when the user clicks the pause explanation button while watching the explanation, the player will respond quickly. First, the player will pause the timer to stop the accumulation of time to ensure that time will not continue to advance in the paused state. At the same time, the player will also pause the audio playback, so that the playback of the explanation audio will also stop immediately.

[0057] If you click the Pause Explanation button, this simple action triggers a series of precise responses from the player. First, the player will pause the timer without hesitation, just like pressing the pause button of time. This action stops the accumulation of time instantly, ensuring that time will not continue to move forward in the paused state.

[0058] Among them, the user interaction in S7 means that if the user moves the mouse, the player does not stop audio playback but checks events during the mouse movement and ignores non-audio events. After the mouse stops for 5 seconds, it rechecks non-audio events and executes playback logic to implement user interaction priority logic.

[0059] When the mouse stops for 5 seconds, the system shows its intelligence again. At this time, the check event will recheck the non-audio event and execute the playback logic. This mechanism ensures that after the user completes an interactive operation, the system can return to the normal playback process in time and continue to present the complete explanation content to the user. This dynamic adjustment and response implements the logic of user interaction priority and fully respects the user's initiative and desire to explore during the viewing process.

[0060] Among them, the material management module: Function: Responsible for uploading, storing, classifying and retrieving vehicle management related materials (text, pictures, videos, etc.). Associated steps: S1 Material preparation VR scene editing module: Function: Provide VR scene production tools, support adding VR pictures, creating VR scenes, setting anchor points, and associating anchor points with materials to realize complex VR scene editing functions. Associated steps: S2 VR scene production explanation plan management module: Function: Manage the creation, editing, naming and saving of explanation plans. Allow users to enter the editing page for detailed settings. Associated steps: S3 Explanation plan creation and editing playback end control module: Function: Responsible for loading and displaying the explanation plan list, automatically preloading audio files, and controlling the playback process (such as play, pause, stop, etc.). Associated steps: S4 playback end loading and display, S5 playback control multi-plan recording, S6 recording and pause operation multi-plan recording and saving module: Function: When the user selects a plan and clicks to play, it can record the user's explanation process and allow the user to create and save multiple explanation plans. Related steps: S5 playback control multi-scheme recording user interaction module: Function: Process user interaction operations, such as movement and clicking through the mouse and keyboard, and detect and process non-audio events (such as checking during mouse movement). Related steps: S7 user interaction audio processing module (implicit in the playback control module): Function: Responsible for loading, playing, pausing, stopping and other processing of audio files to ensure the audio quality during the explanation process. Related steps: S4 playback loading and display, S6 recording and pausing operations.

[0061] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0062] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A method based on VR viewing, characterized in that: The specific steps of the VR viewing method are as follows: S1: Material preparation: In the vehicle management material management page, add and upload text, pictures, and video materials; S2: VR scene production: In the vehicle management scene production page, add VR pictures to create VR scenes, add anchor points and associate the anchor points with materials to complete VR scene editing; S3: Create and edit explanation plan: Create a new explanation plan in the vehicle management explanation plan page, enter the plan name, and enter the editing page; S4: Loading and displaying on the player: Open the player page, then load the explanation plan list, and automatically preload the audio file; S5: Playback control for multiple program recording: the user selects a program and clicks play to create and save multiple explanation programs; S6: Recording and Pause Operation: After recording is completed, the user clicks the Pause Explanation button; S7: User interaction: The user interacts by moving the mouse and keyboard operations, and non-audio is checked during the mouse movement.

2. The method based on VR viewing according to claim 1, characterized in that: The material preparation in S1 refers to adding text, pictures, and video materials in the vehicle management material management page; uploading the recorded explanation audio on the page, or recording the explanation audio clip in the vehicle management material management recording audio page and storing it in the material library.

3. The method based on VR viewing according to claim 1, characterized in that: The VR scene production in S2 refers to a series of detailed operations on the scene production page of vehicle management, creating a realistic VR scene by adding VR pictures. These VR pictures are pictures of the car's exterior and interior taken from multiple angles, presenting users with a three-dimensional, real car display environment. Then, add anchor points and associate the anchor points with rich materials.

4. The method based on VR viewing according to claim 1, characterized in that: The specific steps for creating and editing a solution in S3 are as follows: Step 1: Create an explanation plan: On the Vehicle Management Explanation Plan page, create an explanation plan and enter the plan name; Step 2: Edit the timeline: In the vehicle management explanation plan editing page, edit the timeline and select the explanation audio clip in the material library to add to the timeline; Step 3: Recording script: Click to record script to enter the VR scene, click to play audio, and perform different operations in the VR scene accompanied by the explanation audio. The system automatically encodes the actions and saves them according to the timeline. After recording is completed, you can preview, save, and submit. The explanation plan will be saved on the server side. You can repeat this process to record multiple explanation plans.

5. The method based on VR viewing according to claim 1, characterized in that: The loading and display of the playback end in S4 is specifically as follows: when the playback end page is opened, the VR image and anchor point information are first loaded, the VR scene is constructed and displayed, and then the explanation plan is loaded and the plan list name is displayed, and the audio in the plan is read and automatically loaded.

6. The method based on VR viewing according to claim 1, characterized in that: The specific steps of playing and controlling the multi-scheme recording in S5 are as follows: Step 1: Click to play: The user selects a solution and clicks to play. The player starts a timer and triggers a check event every 10 milliseconds: Step 2: Control playback: accumulate the time progress variable t_sum and update the current event sequence number e_last, traverse and check the playback plan timeline to play the corresponding event, and perform different actions for different event types, such as audio playback and scene switching; Step 3: Multi-scheme recording; Repeat the above steps to create and save multiple explanation plans to meet different needs or scenarios.

7. The method based on VR viewing according to claim 1, characterized in that: The recording and pausing operation in S6 refers to when the user clicks the Pause Explanation button while watching the explanation, the player will respond quickly. First, the player will pause the timer to stop the accumulation of time to ensure that time will not continue to advance in the paused state. At the same time, the player will also pause the audio playback to stop the playback of the explanation audio immediately.

8. The method based on VR viewing according to claim 1, characterized in that: The user interaction in S7 means that if the user moves the mouse, the player does not stop audio playback but checks events and ignores non-audio events during the mouse movement. After the mouse stops for 5 seconds, it rechecks non-audio events and executes the playback logic to implement user interaction priority logic.

9. A system based on VR viewing, characterized in that: Based on the above method, the system consists of a material management module, a VR scene editing module, an explanation plan management module, a playback control module, a multi-plan recording and saving module, and a user interaction module audio processing module.

Images