Content creation system supporting multi-platform panoramic VR

Abstract

The invention discloses a content creation system supporting multi-platform panoramic VR, and the system comprises a content creation module which is used for organizing scattered panoramic VR materials into a scene, carrying out the design of interactive hotspots, and packaging the materials into a resource package; the resource bundle module is used for bearing panoramic VR resource content and serving as input of the content export module; and the program generation module is used for converting the resource bundle into program files which can be operated on different platforms. According to the method, the creation efficiency is improved, a creator does not need to switch among a plurality of different creation tools, panoramic VR content creation for a plurality of platforms can be completed in a unified system, the creation period is greatly shortened, and manpower and time costs are reduced.

Description

Technical Field

[0001] The present invention belongs to the technical field of panoramic VR, and specifically relates to a content creation system for panoramic VR that supports multiple platforms. Background Art

[0002] With the rapid development of VR technology, the demand for VR content is increasing day by day. Among them, panoramic VR materials are widely used in multiple fields due to their high-efficiency generation method. Currently, there are various types of terminal devices on the user side, including PC web browsers, VR all-in-ones, mobile devices (Android, IOS), etc., and there may be software compatibility issues for VR all-in-ones of different brands.

[0003] Currently, panoramic VR content creation tools usually only target one of the above platforms. If you want to create panoramic VR content for multiple platforms, you need to use multiple different creation tools and technologies, which increases the complexity and cost of creation. The inherent reason for only supporting one platform is that different platforms have different development languages and compilation methods for executable programs.

[0004] Disadvantages of the existing technical solutions: First, the content creation efficiency is low: the same content needs to be repeatedly created and developed among multiple platforms. Second, another problem brought by repeated development is that the same content may be inconsistent among multiple platforms (because different platforms are created separately, and it is difficult to ensure exactly the same during the process), which affects the user experience. Summary of the Invention

[0005] In view of the above problems, the present invention is proposed to provide a content creation system for panoramic VR that supports multiple platforms to overcome or at least partially solve the above problems.

[0006] To achieve the above object, the present invention adopts the following technical solutions:

[0007] A content creation system for panoramic VR that supports multiple platforms, the system includes:

[0008] A content creation module, which is used to organize scattered panoramic VR materials into scenes, design interactive hotspots, and package them into resource packages;

[0009] A resource package module, which is used to carry panoramic VR resource content and serve as the input of the content export module;

[0010] A program generation module, which is used to convert the resource package into program files that can run on different platforms.

[0011] Optionally, the content creation module includes:

[0012] A material management unit, which imports materials for subsequent creation processes, and retrieves, classifies, and previews the imported materials;

[0013] A scene editing unit, through a visual scene editor, uses an algorithm to convert a panoramic image into a hexahedron graph and displays the three-dimensional space in the form of a hexahedron;

[0014] An interaction design unit adds various interaction forms in the three-dimensional space of the editor.

[0015] Optionally, the material management unit includes:

[0016] Material upload, through a visual file browsing box, uploads files from the local disk and external storage;

[0017] Material parsing, after the file is uploaded, starts file parsing. For image files, reads their pixel data, color mode, and resolution. For audio and video files, obtains their encoding format, frame rate, and sampling rate;

[0018] Material conversion, according to the parsed parameters, generates multi-level material files for adapting to different platforms or devices during packaging.

[0019] Optionally, the interaction design unit includes:

[0020] Determine the interaction position. In the three-dimensional space of the scene, use three axes as the coordinate system. Based on the spatial origin, represent the interaction position through coordinate system values. The coordinate system values are selected by the mouse and set in the editor to determine the position of the interaction hotspot;

[0021] Design interaction actions and support various interaction forms.

[0022] Optionally, the resource package module includes a resource package description file and resource material files. The resource package description file uses the xml format and describes the VR scene and interaction hotspots; the resource material files are uniformly saved in the root path of the resource package, and the resource material file names are generated using a globally unique algorithm.

[0023] Optionally, the program generation module includes:

[0024] A content parsing unit unpacks the resource package to obtain the resource package description file and resource material files,

[0025] A platform program unit is used to generate resource programs for different platforms;

[0026] A compilation unit, through compilation processing of a pre-written program template and resource file information, generates a resource program file.

[0027] Optionally, the content parsing unit includes:

[0028] Parse the resource package description file using the xml parsing method to read the scene configuration and interaction configuration;

[0029] Perform a legality check according to the configuration rules to prevent rendering anomalies caused by incorrect configuration items, and store the parsed file according to the structures of different platforms.

[0030] Optionally, the platform program unit includes:

[0031] Scene rendering, set the three-dimensional origin coordinates, render the three-dimensional space in the form of a cube centered on the origin, and render the images to the six faces of the cube by reading the parsed hexahedron image file paths;

[0032] Interactive hotspot rendering, obtain the interactive space coordinates according to the parsed interaction configuration, render the interactive hotspot icons based on the position of the origin coordinates, render different interactive icons according to different interaction actions, set interaction events for the interactive icons at the same time, and execute the interaction logic according to the parsed action attributes.

[0033] In summary, due to the adoption of the above technical solutions, the beneficial effects of the present invention are:

[0034] 1. This application greatly improves the creation efficiency. Creators do not need to switch between multiple different creation tools and can complete the creation of panoramic VR content for multiple platforms in a unified system, greatly shortening the creation cycle and reducing labor and time costs.

[0035] 2. This application increases the content consistency. Since the content is created once and there is no situation of repeated production, the content consistency of different platforms is good, and the user experience for multiple platforms will be better. Brief Description of the Drawings

[0036] Figure 1 It is a schematic flowchart of a content creation system supporting multi-platform panoramic VR provided by an embodiment of this application;

[0037] Figure 2 It is a schematic diagram of the overall structure of the content creation module in an embodiment of this application;

[0038] Figure 3 It is a schematic diagram of the resource package structure in an embodiment of this application;

[0039] Figure 4 It is a schematic flowchart of the program generation process in an embodiment of this application. Detailed Embodiments

[0040] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the present invention. Apparently, the described embodiments are some, but not all, of the embodiments of the present invention. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0041] Please refer to Figure 1 , this embodiment provides a content creation system that supports multi-platform panoramic VR. The system includes:

[0042] A content creation module, which is used to organize scattered panoramic VR materials into scenes, design interactive hotspots, and package them into resource packages.

[0043] Figure 2 Figure 12 is a schematic diagram of the overall structure of the content creation module. Through this module, platform resource packages are generated.

[0044] The content creation module includes:

[0045] A material management unit, which imports materials for subsequent creation processes, and retrieves, classifies, and previews the imported materials.

[0046] A scene editing unit, which uses a visual scene editor to convert a panoramic image into a hexahedron image through an algorithm and display the three-dimensional space in the form of a hexahedron.

[0047] An interaction design unit, which adds various interaction forms in the three-dimensional space of the editor. The interaction design is divided into two aspects: one is the determination of the interaction position, and the other is the design of the interaction action.

[0048] The material management unit includes:

[0049] Material upload, which uploads files in the local disk and external storage to the system through a visual file browsing box.

[0050] Material parsing, which starts file parsing after the file is uploaded. For image files, its pixel data, color mode, and resolution are read. For audio and video files, parameters such as its encoding format, frame rate, and sampling rate are obtained. The purpose of parsing is to obtain material parameters for preparation for conversion.

[0051] Material conversion, which generates multi-level material files according to the parsed parameters for self-adapting to different platforms or devices during packaging. For high-resolution pictures, multi-level resolutions are generated. Usually, high resolution is used for large-screen devices, and low resolution is used for small-screen devices.

[0052] The interaction design unit includes:

[0053] Determine the interaction position. In the three-dimensional space of the scene, use three axes as the coordinate system. Based on the spatial origin point, represent the interaction position through coordinate system values. The coordinate system values are selected by the mouse and set in the editor to determine the position where the interaction hot spot is located.

[0054] Design interaction actions and support multiple interaction forms. The meaning of an interaction action is the behavior after triggering the interaction. Support multiple interaction forms, such as rendering an image, playing a piece of music, jumping to another scene, etc. Rendering an image requires specifying the target image, rendering position, etc.

[0055] The resource package module is used to carry the panoramic VR resource content and serve as the input of the content export module.

[0056] Figure 3 It is a schematic diagram of the resource package structure. The resource package structure needs to support efficient storage in the content creation editor and efficient parsing when exporting to various platforms.

[0057] The resource package module includes a resource package description file and resource material files. The resource package description file uses the xml format and can be efficiently created, modified, and parsed on multiple platforms. The resource package description file describes the VR scene and interaction hot spots, both of which contain a series of attributes set in the editor, such as viewing direction, interaction coordinates, interaction actions, etc. For the attributes related to the material files, the relative path is used to describe the location of the file.

[0058] The resource material files are uniformly saved in the root path of the resource package. The resource material file names are generated using a globally unique algorithm to avoid the problem of material search caused by duplicate material names.

[0059] The program generation module is used to convert the resource package into program files that can run on different platforms.

[0060] Figure 4 It is a schematic diagram of the program generation process. The resource package produced by the content creation module is compiled into a resource program that can run on each target platform through a program template.

[0061] The program generation module includes:

[0062] The content parsing unit unpacks the resource package to obtain the resource package description file and resource material files.

[0063] The platform program unit is used to generate resource programs for different platforms. By implementing program templates for different platforms according to unified requirements, the generation of resource programs for different platforms is achieved. The core program of the program template is resource rendering, including scene rendering and interactive hotspot rendering. The resource program consists of two parts: one is the program logic, mainly the VR rendering here; the other is the static resource file, that is, the file parsed from the content. Different resource programs on the same platform only differ in the static resource files, and their program logics are the same. By pre-writing program templates for each platform and then combining different static resource files, the efficient generation of resource programs for multiple platforms can be realized.

[0064] The compilation unit processes the pre-written program template and resource file information through compilation on a specific platform to generate the resource program file for this platform, and this file can run on this platform.

[0065] The content parsing unit includes:

[0066] Use the xml parsing method to parse the resource package description file and read the scene configuration and interactive configuration.

[0067] Perform legality verification according to the configuration rules to prevent rendering anomalies caused by incorrect configuration items, and store the parsed files according to the structures of different platforms.

[0068] The platform program unit includes:

[0069] Scene rendering, set the three-dimensional origin coordinates, render the three-dimensional space in the form of a cube centered on the origin, and render the images into the six faces of the cube respectively by reading the paths of the hexahedron image files parsed out.

[0070] Interactive hotspot rendering, obtain the interactive space coordinates according to the parsed interactive configuration, render the interactive hotspot icons based on the position of the origin coordinates, render different interactive icons according to different interactive actions, set interactive events for the interactive icons at the same time, and execute the interactive logic according to the parsed action attributes. For example, for an interactive hotspot of the audio playback type, when the trigger event occurs, obtain the audio file location according to the material path, read the audio file stream, and set the system audio playback instance to play the audio.

[0071] This embodiment greatly improves the creation efficiency. Creators do not need to switch between multiple different creation tools and can complete the creation of panoramic VR content for multiple platforms in a unified system, greatly shortening the creation cycle and reducing the labor and time costs.

[0072] This embodiment improves the content consistency. Since the content is created once and there is no situation of repeated production, the content consistency of different platforms is good, and the user experience of multiple platforms is better.

[0073] The above content is a further detailed description of the present invention in combination with specific preferred embodiments. It cannot be determined that the specific implementation of the present invention is only limited to these descriptions. For those of ordinary skill in the technical field to which the present invention pertains, without departing from the concept of the present invention, several simple deductions or substitutions can be made, and all should be regarded as falling within the protection scope of the present invention.

Claims

1. A content creation system supporting multi-platform panoramic VR, characterized in that, The system includes: A content creation module, which is used to organize scattered panoramic VR materials into scenes, design interactive hotspots, and package them into resource packages; A resource package module, which is used to carry panoramic VR resource content and serve as the input of the content export module; A program generation module, which is used to convert the resource package into program files that can run on different platforms.

2. A content creation system for supporting multi-platform panoramic VR as claimed in claim 1, characterized in that The content creation module includes: A material management unit, which imports materials for subsequent creation processes, and retrieves, classifies, and previews the imported materials; A scene editing unit, which uses a visual scene editor to convert a panoramic image into a hexahedron image through an algorithm and displays the three-dimensional space in the form of a hexahedron; An interactive design unit, which adds various interactive forms in the three-dimensional space of the editor.

3. A content creation system for supporting multi-platform panoramic VR according to claim 2, characterized in that, The material management unit includes: Material upload, which uploads files in the local disk and external storage through a visual file browsing box; Material parsing, which starts file parsing after the file is uploaded. For image files, it reads their pixel data, color mode, and resolution. For audio and video files, it obtains their encoding format, frame rate, and sampling rate; Material conversion, which generates multi-level material files according to the parsed parameters to adapt to different platforms or devices during packaging.

4. A content creation system for supporting multi-platform panoramic VR as claimed in claim 2, characterized in that, The interactive design unit includes: Determining the interactive position. In the three-dimensional space of the scene, using three axes as the coordinate system, with the spatial origin as the reference, the interactive position is represented by coordinate system values. The coordinate system values are selected by the mouse and set in the editor to determine the position where the interactive hotspot is located; Designing interactive actions and supporting various interactive forms.

5. A content creation system for supporting multi-platform panoramic VR as claimed in claim 1, characterized in that, The resource package module includes a resource package description file and resource material files. The resource package description file uses the xml format, and the resource package description file describes the VR scene and interactive hotspots; the resource material files are uniformly stored in the root path of the resource package, and the resource material file names are generated using a globally unique algorithm.

6. A content creation system for supporting multi-platform panoramic VR according to claim 1, characterized in that, The program generation module includes: A content parsing unit, which decompresses the resource package to obtain the resource package description file and resource material files, A platform program unit, which is used to generate resource programs for different platforms; A compilation unit, which generates resource program files through compilation processing of a pre-written program template and resource file information.

7. A content creation system for supporting multi-platform panoramic VR according to claim 6, characterized in that, The content parsing unit includes: Parsing the resource package description file using the xml parsing method to read the scene configuration and interactive configuration; Performing legality verification according to the configuration rules to prevent rendering anomalies caused by incorrect configuration items, and storing the parsed files according to the structures of different platforms.

8. A content creation system for supporting multi-platform panoramic VR according to claim 6, characterized in that, The platform program unit includes: Scene rendering, which sets the three-dimensional origin coordinates, renders the three-dimensional space in the form of a cube centered on the origin, and renders the images into the six faces of the cube by reading the path of the parsed hexahedron image file; Interactive hotspot rendering, which obtains the interactive space coordinates according to the parsed interactive configuration, renders the interactive hotspot icons based on the position of the origin coordinates, renders different interactive icons according to different interactive actions, sets interactive events for the interactive icons at the same time, and executes the interactive logic according to the parsed action attributes.

Images