A method and system for viewing comics in VR

Abstract

The present invention relates to a method and system for watching comics in VR, which comprises building a comic player based on a first preset engine and placing the comic player in a virtual device; building a comic editing module based on a second preset engine to edit comic resources to generate configuration files and related resource files that are compatible with the comic player; and identifying and playing sequence files based on the comic player. The method realizes the improvement of the function of the existing virtual device playback mode and can perfectly display complex effects.

Description

Technical Field

[0001] The present invention belongs to the field of computer software technology, and in particular relates to a method and system for viewing comics in VR. Background Art

[0002] With the emergence of smart devices such as smartphones and virtual devices, people are provided with more ways to read. For example, when reading comics on smartphones and tablets, users need to slide the screen to read the comics page by page. With the development of technology, reading comics through VR glasses has become a more popular way of reading. When wearing VR glasses to read comics, people will be placed in a virtual space and interact with the comics in front of them. For example, they can click on the dialog box and the corresponding voice will be played. By adding dialogue voice, sound effects and music to the comics, the VR comic experience is made more immersive.

[0003] However, the existing virtual device playback functions are not perfect and cannot display more complex effects. Summary of the invention

[0004] In order to solve the problems of imperfect functions and unobtrusive effects in the prior art, the present invention provides a method and system for viewing comics in VR, which has the characteristics of more perfect functions and more prominent effects.

[0005] A method for viewing comics in VR according to a specific embodiment of the present invention includes:

[0006] Building a comic player based on the first preset engine, and placing the comic player in the virtual device;

[0007] Building a comics editing module based on the second preset engine to edit comics resources, so as to generate configuration files and related resource files adapted to the comics player;

[0008] The configuration file and the related resource files are identified and played based on the comic player.

[0009] Furthermore, constructing a comic player based on the first preset engine includes:

[0010] The comic player is constructed based on the LayaBox engine.

[0011] Furthermore, the step of constructing a comics editing module based on the second preset engine to edit comics resources includes:

[0012] The comic editing module is constructed based on the unity engine.

[0013] Furthermore, the step of constructing a comic editing module based on the second preset engine to edit comic resources further includes:

[0014] The comic playback resources are edited based on at least filters, stickers, small animations, subtitles, videos, sound effects, background sounds and 3D model materials to generate the configuration file and the related resource files.

[0015] Furthermore, the VR comic viewing method also includes building a server, and connecting the configuration file and the related resource files to the comic player through the server.

[0016] Furthermore, the VR comic reading method also includes caching the configuration file and the related resource file to a mobile phone player through a cache mechanism for calling and playing.

[0017] Furthermore, the identifying and playing the configuration file and the related resource file based on the comic player includes:

[0018] The sequence file is read, decapsulated, and decoded in sequence before being rendered and played.

[0019] A comic playing system provided according to a specific embodiment of the present invention includes: a comic player and a comic editing module;

[0020] The comic editing module edits the comic resources to generate configuration files and related resource files that are compatible with the comic player;

[0021] The comic player is used to identify and play the configuration file and the related resource file.

[0022] The beneficial effects of the present invention are as follows: by constructing a comic player based on a first preset engine and placing the comic player in a virtual device; by constructing a comic editing module based on a second preset engine to edit comic resources to generate configuration files and related resource files that are compatible with the comic player; and by identifying and playing the configuration files and related resource files based on the comic player, the function of the existing virtual device playback mode is improved, and complex effects can be displayed. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0024] Figure 1 is a flowchart of a method for reading comics in VR according to an exemplary embodiment;

[0025] Figure 2 It is a schematic diagram of a VR comic reading system provided according to an exemplary embodiment. DETAILED DESCRIPTION

[0026] To make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be described in detail below. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other implementation methods obtained by ordinary technicians in this field without creative work belong to the scope of protection of the present invention.

[0027] Reference Figure 1 As shown, an embodiment of the present invention provides a method for viewing comics in VR, including:

[0028] 101. Building a comic player based on the first preset engine, and placing the comic player in the virtual device;

[0029] The comic player supports both user-controllable and uncontrollable playback modes. When users watch videos wearing VR glasses, a virtual effect will be presented; otherwise, normal comic videos will be presented when played on devices such as smartphones and tablets.

[0030] 102. Constructing a comic editing module based on the second preset engine to edit comic resources, so as to generate a configuration file and related resource files adapted to the comic player;

[0031] The comic editing module supports the import of 3D models, editing and preview of videos, frame animations, filter effects, transition effects, etc. After editing and saving, a timing file and related resource files can be generated.

[0032] 103. Based on the comic player, the configuration file and related resource files are identified and played.

[0033] The generated timing file and corresponding resources are transmitted to the corresponding comic player, so that the comic player is used for playing.

[0034] In some specific embodiments of the present invention, constructing a comic player based on the first preset engine includes:

[0035] Build a comic player based on the LayaBox engine.

[0036] Building a comic editing module based on the second preset engine to edit comic resources includes:

[0037] Build a comic editing module based on the unity engine.

[0038] The VR comic player was developed using LayaBox's second-generation engine LayaAir, which supports both user-controlled and uncontrollable playback modes. LayaAir was used to develop the player not only because it is one of the world's highest-performance HTML5 engines and is suitable for 2D, 3D, and VR product development, but also because of its compatibility. LayaAIR supports the playback of images, sounds, animations, videos and other materials. After development, the files can be exported and integrated into Android\iOS applications, so that they can be called and played through Android or iOS web browsers.

[0039] The comics editing module is developed using Unity, a professional game development engine that can be used for game development, animation production, and VR / AR development. It supports the import of 3D models, editing and previewing of videos, frame animations, filter effects, transition effects, etc. After editing and saving, a configuration file and related resource files can be generated, and the files and corresponding resources will be transferred to the corresponding server. During the editing process, you can preview the editing effect.

[0040] In specific implementation, building a comic editing module based on the second preset engine to edit comic resources also includes:

[0041] The comics are edited at least based on filters, stickers, small animations, subtitles, videos, sound effects, background sounds and 3D model materials to generate configuration files and related resource files.

[0042] You can also build a server and connect the comic configuration files and resources to the comic player through the server. Upload the materials edited by the backend management system to the server. When the player plays, it obtains the configuration files and caches them through the interface, and obtains the playing materials in turn. The web server uses nginx, the development framework uses TP5, the database uses MYSQL, and the cache uses REDIS.

[0043] In some other specific embodiments of the present invention, identifying and playing configuration files and related resource files based on the comic player includes:

[0044] The sequence files are read, decapsulated, and decoded in turn before being rendered and played.

[0045] The data is decapsulated through the reading thread and sent to the frame buffer to store the undecoded audio and video packets. The data is then further decoded in the frame buffer and the decoded audio and video frames are stored in the display buffer. Finally, the audio and video are synchronized in the display buffer, and the final rendering and playback are performed.

[0046] Based on the same design idea, refer to Figure 2As shown, an embodiment of the present invention also provides a VR comic viewing system, including: a comic player and a comic editing module;

[0047] The comics editing module edits comics resources to generate configuration files and related resource files that are compatible with the comics player;

[0048] The comic player is used to identify and play sequence files.

[0049] In specific implementation, the comic player and comic editing module can cache the playback data by the server, and then perform corresponding playback.

[0050] The VR comic viewing method and system provided by the above-mentioned embodiments of the present invention can realize playback of complex effects and can be adapted to most smart devices.

[0051] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0052] In addition, each functional unit in each embodiment of the present invention may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0053] The storage medium mentioned above can be a read-only memory, a magnetic disk or an optical disk, etc.

[0054] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0055] The above description includes examples of one or more embodiments. Of course, it is impossible to describe all possible combinations of components or methods for the purpose of describing the above embodiments, but it should be recognized by those skilled in the art that the various embodiments may be further combined and arranged. Therefore, the embodiments described herein are intended to cover all such changes, modifications and variations that fall within the scope of protection of the appended claims. In addition, with respect to the term "comprising" used in the specification or claims, the word is covered in a manner similar to the term "including", as explained by "including" used as a transitional word in the claims. In addition, any term "or" used in the specification of the claims is intended to mean "non-exclusive or".

[0056] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A method of reading comics in VR. It is characterized in that include: Building a comic player based on the first preset engine, and placing the comic player in the virtual device; Building a comics editing module based on the second preset engine to edit comics resources, so as to generate configuration files and related resource files adapted to the comics player; The configuration file and the related resource files are cached to the mobile phone player through a cache mechanism for calling and playing; Based on the comic player, the configuration file and the related resource file are identified and played, including sequentially reading data, decapsulating, decoding, and rendering and playing the sequence file, including: decapsulating the data through a reading thread, and sending the decapsulated data to a frame buffer, storing undecoded audio and video packets, and then further decoding the data in the frame buffer, and storing the decoded audio and video frames in a display buffer, and finally synchronizing the audio and video in the display buffer, and finally rendering and playing; Wherein, the first preset engine includes a LayaBox engine, and the second preset engine includes a unity engine; The editing of comic resources by building a comic editing module based on the second preset engine also includes: editing comic playback resources based on at least filters, stickers, small animations, subtitles, videos, sound effects, background sounds and 3D model materials to generate the configuration file and the related resource files.

2. The method for viewing comics in VR according to claim 1, It is characterized in that The method also includes constructing a server, and connecting the configuration file and the related resource files to the comic player through the server.

3. A comics playback system, It is characterized in that A method for viewing comics in VR according to any one of claims 1 to 2, comprising: a comic player and a comic editing module; The comic editing module edits the comic resources to generate configuration files and related resource files that are compatible with the comic player; The comic player is used to identify and play the configuration file and the related resource file; Among them, the comic player is built based on a first preset engine, and the comic editing module is built based on a second preset engine; the first preset engine includes a LayaBox engine, and the second preset engine includes a unity engine; the comic editing module edits comic resources to generate configuration files and related resource files that are compatible with the comic player, including: editing comic playback resources based on at least filters, stickers, small animations, subtitles, videos, sound effects, background sounds and 3D model materials to generate the configuration files and related resource files.

Images