An information processing method and an electronic device

Abstract

The present application discloses an information processing method and an electronic device. The information processing method includes: obtaining a playback file to be processed, where the information in the playback file at least includes: the initial state information and state change information of the scene objects in the recorded target scene, and the material information required by the scene objects in the target scene; generating initial scene picture information of the target scene according to the initial state information of the scene objects in the target scene and the above-mentioned material information, and playing the generated initial scene picture information; generating subsequent scene picture information corresponding to the target scene after the initial scene picture information according to the initial scene picture information and the state change information, and playing the generated subsequent scene picture information.

Description

Technical Field

[0001] The present application relates to an information processing method and an electronic device. Background Art

[0002] Currently, most content playback is achieved based on video playback, that is, the scene content is recorded in video format, and then the content playback is realized by playing the generated video file.

[0003] In the above method, the video file usually requires a large storage space. Especially with the improvement of video clarity and the increase of time length, the storage space occupied by the video file will increase sharply, usually reaching the order of hundreds of megabytes or even gigabytes. Summary of the Invention

[0004] For this reason, the present application discloses the following technical solutions:

[0005] An information processing method, the method comprising:

[0006] Obtaining a playback file to be processed; the information in the playback file at least includes: the initial state information and state change information of the scene objects in the recorded target scene, and the material information required by the scene objects in the target scene;

[0007] Generating initial scene picture information of the target scene according to the initial state information of the scene objects in the target scene and the material information, and playing the initial scene picture information;

[0008] Generating subsequent scene picture information corresponding to the target scene after the initial scene picture information according to the initial scene picture information and the state change information, and playing the subsequent scene picture information.

[0009] Optionally, the material information includes a target map identifier corresponding to the target scene;

[0010] The generating the initial scene picture information of the target scene according to the initial state information of the scene objects in the target scene and the material information includes:

[0011] Obtaining, from the local end of the player for playing the playback file or from the network end, a first set of theme element templates of the scene theme to which the target scene belongs indicated by the target map identifier, and a first set of material resources corresponding to the first set of theme element templates;

[0012] Generate the initial object screen information of the scene objects in the target scene according to the initial state information, the first set of theme element templates, and the first set of material resources; the initial scene screen information of the target scene includes the initial object screen information of each scene object in the target scene.

[0013] Optionally, the material information includes the second set of theme element templates required for the target scene under the scene theme and the second set of material resources corresponding to the second set of theme element templates;

[0014] The generating the initial scene screen information of the target scene according to the initial state information of the scene objects in the target scene and the material information includes:

[0015] Obtain the second set of theme element templates and the second set of material resources from the playback file;

[0016] Generate the initial object screen information of the scene objects in the target scene according to the initial state information, the second set of theme element templates, and the second set of material resources; the initial scene screen information of the target scene includes the initial object screen information of each scene object in the target scene.

[0017] Optionally, generating the initial object screen information of the scene objects in the target scene according to the initial state information, the corresponding set of theme element templates, and the corresponding set of material resources includes:

[0018] Determine the target element template corresponding to the scene object in the target scene in the corresponding set of theme element templates;

[0019] For each scene object in the target scene, obtain the target resource corresponding to the target element template of the scene object in the corresponding set of material resources under the initial state information of the scene object;

[0020] Configure the obtained target resource as the object element required by the scene object according to the element configuration information indicated by the target element template;

[0021] Configure the object element as the object state indicated by the initial state information of the scene object, and generate the object screen information matching the object state to obtain the initial object screen information of the scene object;

[0022] Wherein, the corresponding set of theme element templates is the first set of theme element templates, the corresponding set of material resources is the first set of material resources, or the corresponding set of theme element templates is the second set of theme element templates, and the corresponding set of material resources is the second set of material resources.

[0023] Optionally, the status change information includes: change instructions corresponding to scene objects in the target scene at different time nodes; the change instructions are used to indicate the change content of the status change that occurs to the corresponding scene objects.

[0024] Generating the subsequent scene picture information corresponding to the target scene after the initial scene picture information according to the initial scene picture information and the status change information includes:

[0025] During the playback process after obtaining the initial scene picture information, obtaining the scene picture information corresponding to the previous adjacent time node of the target scene at the current time node, and the change instruction corresponding to the current time node; during the playback process, initially, the scene picture information corresponding to the previous adjacent time node is the initial scene picture information.

[0026] Adjusting the scene picture information corresponding to the previous adjacent time node according to the change instruction to obtain the scene picture information corresponding to the target scene at the current time node.

[0027] Optionally, the above method further includes:

[0028] Obtaining playback field-of-view indication information for the target scene; the playback field-of-view indication information is used to indicate the target playback perspective and / or target playback area required for playing the target scene.

[0029] Generating the subsequent scene picture information corresponding to the target scene after the initial scene picture information includes:

[0030] Generating subsequent scene picture information corresponding to the current playback progress of the target scene and matching the target playback perspective and / or the target playback area.

[0031] Optionally, the above method further includes:

[0032] Obtaining playback progress indication information for the target scene;

[0033] Jumping the target scene from the current playback progress to the target progress indicated by the playback progress indication information for playback.

[0034] Optionally, the information in the playback file further includes at least one of the following information: player version indication information, map identification verification information, status change verification information; before generating the initial scene picture information of the target scene, the method further includes:

[0035] Perform at least one of the following processes: determine whether the version of the player in use matches the version indicated by the player version indication information, determine whether the target map identifier matches the map identifier verification information, and determine whether the status change information matches the status change verification information;

[0036] If at least one determination result indicates a mismatch, end the processing of the playback file.

[0037] An information processing method, the method includes:

[0038] Obtain a recording instruction for a target scene;

[0039] Obtain the initial state information of the scene objects in the target scene;

[0040] Based on the detection of the state changes of the scene objects in the target scene, generate the state change information of the scene objects in the target scene;

[0041] Determine the material information required by the scene objects in the target scene;

[0042] Generate a playback file for the target scene, including the initial state information and state change information of the scene objects in the target scene, and the material information required by the scene objects in the target scene.

[0043] An electronic device, including:

[0044] A memory for storing at least a set of computer instruction sets;

[0045] A processor for implementing the information processing method as described in any one of the above by calling and executing the instruction sets stored in the memory.

[0046] As can be seen from the above solutions, the present application discloses an information processing method and an electronic device. The information processing method includes: obtaining a playback file to be processed, and the information in the playback file at least includes: the initial state information and state change information of the scene objects in the recorded target scene, and the material information required by the scene objects in the target scene; generating the initial scene picture information of the target scene according to the initial state information of the scene objects in the target scene and the above material information, and playing the generated initial scene picture information; generating the subsequent scene picture information corresponding to the target scene after the initial scene picture information according to the initial scene picture information and the state change information, and playing the generated subsequent scene picture information. Description of the Drawings

[0047] To more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the accompanying drawings required for the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only the embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other accompanying drawings can also be obtained based on the provided accompanying drawings.

[0048] Figure 1 It is a flowchart of an information processing method for scene content playback provided by the present application;

[0049] Figure 2 It is a simple example of the Maps file information provided by the present application;

[0050] Figure 3 It is a schematic diagram of the relationship among the playback file, the scene map, and the material resources provided by the present application;

[0051] Figure 4 It is an example of the bytecode structure of the instruction provided by the present application;

[0052] Figure 5 It is an example of the bytecode structure of the key frame provided by the present application;

[0053] Figure 6 It is an example of the bytecode structure of the playback file provided by the present application;

[0054] Figure 7(a) and Figure 7(b) are different examples of generating a meeting scene picture from the first perspective of the current participant provided by the present application;

[0055] Figure 8 It is an example of generating a meeting scene picture from a side view perspective provided by the present application;

[0056] Figure 9 It is another flowchart of the information processing method for scene content playback provided by the present application;

[0057] Figure 10 It is yet another flowchart of the information processing method for scene content playback provided by the present application;

[0058] Figure 11 It is a flowchart of the information processing method for scene content recording provided by the present application;

[0059] Figure 12 It is a schematic diagram of the execution timeline of the client, the server, and the player provided by the present application;

[0060] Figure 13 It is a schematic diagram of the timeline of each frame logic of the client and the server during the synchronization process provided by the present application;

[0061] Figure 14 It is a schematic diagram of the player provided by this application for real-time playback of the recorded file;

[0062] Figure 15 It is an exemplary processing flowchart during the content playback of the player provided by this application;

[0063] Figure 16 It is the composition structure diagram of the electronic device provided by this application. Specific embodiments

[0064] Next, the technical solutions in the embodiments of this application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are only a part of the embodiments of this application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of this application.

[0065] This application discloses an information processing method and an electronic device, which are used to provide a content playback method different from the traditional content playback method based on video recording and playback, so as to achieve technical effects such as reducing the storage space occupied by the playback file. The disclosed information processing method can be applied to, but is not limited to, electronic devices in numerous general or special computing device environments or configurations, such as: personal computers, server computers, handheld devices or portable devices, tablet devices, multi-processor devices, and so on. The electronic device has information processing capabilities and has a display screen or is externally connected to a display screen to perform scene content playback based on the playback file on its own display screen or the externally connected display screen.

[0066] Refer to Figure 1 As shown in the information processing method flowchart, the information processing method provided by the embodiments of this application may include the following processing procedures:

[0067] Step 101, obtain the playback file to be processed.

[0068] When it is necessary to play back the scene content in the target scene, specifically, the playback file generated by pre-recording the target scene can be obtained for content playback of the target scene.

[0069] Among them, the information in the playback file at least includes: the initial state information and state change information of the scene objects in the recorded target scene, and the material information required by the scene objects in the target scene.

[0070] Optionally, the scene objects in the target scene are represented in the form of virtual avatars. That is to say, the playback file uses the corresponding virtual avatars to represent each scene object involved in the target scene. The scene objects in the target scene may include at least one of foreground objects and background objects, and the number of foreground objects and background objects may be one or more respectively, without limitation, depending on the actual scene content of the target scene. Taking a meeting scene as an example, each participant can pre-select the virtual avatar they need and use the selected virtual avatar to represent scene objects such as the corresponding participants. During the recording of the scene content, by detecting the initial state information and state change information of the scene objects, the initial state information and state change information of the scene objects are recorded as the initial state information and state change information of the corresponding virtual avatars, and at the same time, the material information required by the scene objects in the target scene, that is, the virtual avatars, is recorded to generate a playback file.

[0071] The initial state information of the scene objects in the target scene included in the playback file may include, but is not limited to, the initial attributes of the scene objects, and some or all of the information such as the initial posture and behavior. The state change information of the scene objects may correspondingly include, but is not limited to, the change information of the attributes, postures, behaviors, etc. of the scene objects during the recording of the scene content.

[0072] In practical applications, the state change information in the playback file can be further expressed as: the change instructions corresponding to the scene objects in the recorded target scene at different time nodes; this change instruction can also be called a state change instruction, which is used to indicate the change content of the state change of the corresponding scene object. For example, in a chemical experiment, at a certain frame, student A moved a certain test tube. In practical applications, optionally, the frame sequence (such as frame number, etc.) corresponding to the time when the scene object undergoes a state change can be specifically used to represent the corresponding time node.

[0073] For example, for a certain participant in an AR / VR meeting scene, the initial state information of the scene object can refer to the initial attributes of the virtual avatar corresponding to the participant (such as the type of the virtual avatar, the type of clothing and accessories configured, the color), and the actual posture and behavior information of the participant at the beginning; the state change information can refer to the attribute change information of the virtual avatar corresponding to the participant and the posture / behavior change information of the participant during the recording of the AR / VR meeting scene. The initial posture / behavior information and posture / behavior change information of the participant will be recorded as the initial posture / behavior information and posture / behavior change information of their virtual avatar in the playback file, and can be specifically recorded as a change instruction that can be used to characterize the state change and change content of a certain scene object / virtual object at a certain time node. For example, at frame N, object X changes from the original uniform rightward movement to uniform upward movement.

[0074] The attributes of the virtual avatar, including but not limited to, the type of the virtual avatar (such as a character, a sphere, a police officer or an employee further classified from a professional perspective for a character, a child or an adult classified from an age perspective, a female or a male classified from a gender perspective, etc.), the type of clothing, the type of accessories, colors, textures, etc. configured for the virtual avatar.

[0075] Regarding the material information required for the scene object, the embodiments of the present application specifically give the definitions of the scene map and the material resources, which are as follows:

[0076] Material resources: Also known as the resource package (assets), it refers to the collection of all material resources used in the scene content demonstration based on the playback file, such as background images, icons, sound effects, models, colors, textures, etc. These resources generally occupy a storage space in the order of KB or MB.

[0077] Scene map: maps. This file is an initial configuration file. By combining the objects in the resource package, it provides a set of element templates for a series of object elements required by the scene object. For example, the background A image is at the coordinate P, and Icon_B is at the position P1 on the background A. There may also be information such as a movement vector to the right and a speed. Therefore, this file records the material ID and some configuration information. The storage of this file usually occupies a storage space in the order of KB.

[0078] The scene map file is the Maps file, which specifically describes the configuration information of the elements during initialization. The configuration information of each element can include but not limited to the resource ID, pose (such as position and rotation information), initial behavior, etc. For details, please refer to Figure 2 A simple example of the Maps file information shown. Various resources involved in the Maps file, such as pictures or sound effects (if any), can be packaged into corresponding resource packages. The Maps file is essentially a reference to the resources and can be stored in formats such as xml, yaml, json, binary, etc., but not limited to these. Therefore, the Maps file occupies a very small storage space, usually in the order of KB.

[0079] The playback file, on the basis of the provided scene map and material resources, mainly records the initial state information and state change information of all scene objects during the complete demonstration process. For example, at frame N, object X changes from the original uniform movement to the right to uniform movement upward. This file is very small, generally also within the order of KB. Please refer to Figure 3 , which provides a schematic diagram of the relationship among the playback file, the scene map and the material resources. The three can specifically be in a call / reference relationship in sequence.

[0080] In the embodiments of the present application, scenes are distinguished by themes. The theme of a scene can also be referred to as a theme type or theme style, including but not limited to conference themes, leisure themes, experimental themes (such as chemical experiments), planet operation simulation themes, etc., and the theme division can be carried out according to actual needs. Corresponding scene maps are provided for different themes respectively, that is, corresponding element template sets are provided for different themes respectively, and the material resources (resource packages) required for the corresponding scene maps / element template sets are provided.

[0081] In one embodiment, the material information in the playback file includes the target map identifier corresponding to the recorded target scene, simply referred to as MapID, which is used to indicate the first theme element template set corresponding to the scene theme to which the recorded target scene belongs. For example, the conference theme element template set corresponding to the conference theme to which the AR / VR conference scene belongs. In this embodiment, when playing back the content of the target scene based on the playback file, the theme element template set and related material resources of the scene theme to which the target scene belongs can be obtained based on MapID, and then some theme element templates and corresponding material resources required for the target scene can be determined therefrom for content playback.

[0082] In another embodiment, the material information in the playback file can directly include the second theme element template set required for the recorded target scene under its scene theme and the second material resource set corresponding to the second theme element template set. In this embodiment, the second theme element template set and the information of the second theme element template set can be directly read from the playback file as the theme element templates and corresponding material resources required in the target scene for subsequent content playback. It is easy to understand that the second theme element template set is specifically a partial theme element template set required for the target scene in the theme element template set corresponding to its scene theme, and the second material resource set is correspondingly a partial material resource set required for the target scene in the material resource set corresponding to the theme element template set corresponding to its scene theme.

[0083] Optionally, the information in the playback file in the embodiments of the present application is encoded in the form of a custom bytecode. The bytecode structure involved in the information of the playback file mainly includes:

[0084] (1) Bytecode structure of instructions

[0085] Among them, the instruction mainly refers to the state change instruction of the scene object, and the corresponding instruction information can include but is not limited to the instruction type, the ID of the scene object corresponding to the instruction (such as the object ID of the object targeted), the content of the state change indicated by the instruction (such as what changes occur in a certain frame), etc. See Figure 4An example of the bytecode structure of the instructions shown, where Cmd represents the instruction type, such as move (move), jump (jump), etc., ID represents the ID of the scene object corresponding to the instruction, and Params represents the instruction content, which can be specifically divided into the instruction size (Raw Data Size) and the changed content (Raw DataBytes). In practical applications, the type of RawDataSize can be optimized according to the content length of Params, and can be byte (uint8), uint16, uint32, etc.

[0086] Taking the move instruction as an example, assuming the value of the Move instruction is defined as 1000, the corresponding object Id = 1201512898, and at the 100th frame, the moving direction is changed to move upward (0, 1), then this instruction can be described based on the bytecode as follows:

[0087] [Move(uint16)][Id(uint32)][Params(byte[])] =>

[0088] [00000011 11101000][01000111 10011101 10100001 11000010][0000000000000000 00000000 00000010 00000000 00000001].

[0089] (2) Bytecode structure of key frames

[0090] Among them, a key frame refers to a frame in which the state of at least one scene object in the scene corresponding to the playback file has changed.

[0091] The bytecode structure of key frames includes, but is not limited to, the key frame index, each state change instruction corresponding to the key frame indicated by the key frame index, and the number of corresponding state change instructions. See Figure 5 An example of the bytecode structure of the key frame shown, where FrameIndex represents the key frame index, Figure 5 The "length X of the instruction set under the current FrameIndex" in it means that the key frame indicated by the current FrameIndex corresponds to X state change instructions, that is, the number of instructions is X, and the instruction information of each instruction is respectively represented in Figure 5 as: instruction information byte array 0, instruction information byte array 1, instruction information byte array..., instruction information byte array X - 1.

[0092] (3) Bytecode structure of the playback file

[0093] The playback file can specifically be represented as a set of information composed of the frame information of a series of key frames. For non-key frames, since the state of the scene object does not change at the corresponding time node, the scene information corresponding to the frame with the most recent state change in its previous frame can be maintained. Therefore, the relevant information of non-key frames does not need to be stored in the playback file, so as to further reduce the data volume of the playback file and save storage space.

[0094] The bytecode structure of the playback file can include the object IDs of each scene object in the recorded scene, the initial state information of the scene objects corresponding to each object ID, and the bytecode set formed by the key frame bytecodes of all key frames (corresponding to representing the state change information of the scene object). In addition, optionally, it can also include the target map identifier corresponding to the theme to which the recorded scene belongs. Here, the target map identifier is used to indicate the first theme element template set corresponding to the scene theme to which the recorded scene belongs, such as the meeting theme element template set corresponding to the meeting theme, but not limited to this. As an alternative to the target map identifier, the playback file can also directly include the second theme element template set required for the recorded scene under the corresponding scene theme and the second material resource set corresponding to the second theme element template set. This is not limited and can be determined according to actual needs. Optionally, the initial state information of the scene object in the playback file is allowed to be empty. In the case of being empty, the default configuration can be used.

[0095] See Figure 6 The bytecode structure example of the playback file shown, where MapID represents the target map identifier corresponding to the theme to which the recorded scene belongs, such as the map identifier corresponding to the meeting scene; the set of participant IDs represents the IDs of each scene object involved in the recorded scene, such as the IDs of each participant; the set of all key frame bytecodes represents the bytecode set formed by the key frame bytecodes of all key frames included in the playback file.

[0096] In practical applications, when recording the required target scene, the scene content information (such as the initial state information of the scene object, the state change information, and the required material information) can be encoded into bytecodes according to the above various bytecode structures to obtain a playback file in bytecode form. Subsequently, during the playback of the scene content based on the playback file, the bytecodes in the playback file can be decoded according to the encoding bytecode rules to obtain the required information, such as the initial state information and state change information of the scene object in the recorded target scene, and the material information required by the scene object in the target scene, etc., so as to realize the content playback of the recorded scene through the processing of these information.

[0097] Step 102: Generate the initial scene picture information of the target scene according to the initial state information of the scene object in the target scene and the above material information, and play the generated initial scene picture information.

[0098] For the implementation manner of the material information of the playback file including the target map identifier corresponding to the target scene, specifically, the first theme element template set of the scene theme to which the target scene belongs indicated by the target map identifier, and the first material resource set corresponding to the first theme element template set can be obtained from the local end of the player for playing the playback file or from the network end; and according to the initial state information of the scene objects in the playback file, the above-mentioned first theme element template set and the first material resource set, the initial object picture information of the scene objects in the target scene is generated, and the initial object picture information of each scene object in the target scene constitutes the initial scene picture information in the target scene.

[0099] In this implementation manner, the target map identifier of the theme to which the target scene belongs is given in the playback file, but the theme element templates and the corresponding material resources specifically required by the target scene under the theme are not directly given. Therefore, the first theme element template set and the first material resource set corresponding to the scene theme to which the target scene belongs can be obtained based on the target map identifier, specifically, according to the requirements, from the local end of the player or from the network end. On this basis, the theme element templates and related material resources required by the target scene can be further determined for content playback.

[0100] For the implementation manner of the material information of the playback file including the second theme element template set required by the target scene under the scene theme and the second material resource set corresponding to the second theme element template set, the above-mentioned second theme element template set and the second material resource set can be directly obtained from the playback file, and according to the initial state information of the scene objects in the playback file, the obtained second theme element template set and the second material resource set, the initial object picture information of the scene objects in the target scene is generated, and the initial object picture information of each scene object in the target scene constitutes the initial scene picture information in the target scene.

[0101] In the above two implementation manners of the information content included in the material information, the process of generating the initial object picture information of the scene objects in the target scene according to the initial state information of the scene objects in the playback file, the corresponding theme element template set and the corresponding material resource set can be further implemented as:

[0102] 11) Determine the target element template corresponding to the scene object in the target scene in the corresponding theme element template set.

[0103] 12) For each scene object in the target scene, obtain the target resource corresponding to the target element template of the scene object in the corresponding material resource set under the initial state information of the scene object.

[0104] Among them, for the previous implementation manner of the information content included in the material information, the corresponding set of theme element templates here is the first set of theme element templates mentioned above, and the corresponding set of material resources is the first set of material resources mentioned above. For the latter implementation manner of the information content included in the material information, the corresponding set of theme element templates here is the second set of theme element templates mentioned above, and the corresponding set of material resources is the second set of material resources mentioned above, depending on the actual application situation.

[0105] For the above two implementation manners, in step 11), specifically, according to the attribute information (such as object type, etc.) of the scene object indicated by the object ID of each scene object in the playback file, or according to the index information corresponding to the object ID of each scene object in the playback file (used to index the object ID to the corresponding element template in the corresponding set of theme element templates), determine the target element template corresponding to the scene object in the target scene in the corresponding set of theme element templates (the first set of theme element templates indicated by MapID or the second set of theme element templates included in the playback file).

[0106] After that, in step 12), for each scene object in the target scene, obtain the target resource corresponding to the target element template of the scene object in the corresponding set of material resources (the first set of material resources corresponding to the first set of theme element templates, or the second set of material resources included in the playback file) under the initial state information of the scene object.

[0107] Taking a certain participant in a meeting scene as an example of a scene object, specifically, according to the index ID corresponding to the participant ID, determine the target element template required by the participant from the corresponding set of theme element templates. For example, obtain a matching element configuration template for the human body composition of the participant, etc. Specifically, it may include, but is not limited to, the configuration information of each component part of the human body model corresponding to the corresponding human type (such as policeman, child, employee) and the relative position of each component part, as well as the relative position configuration information between the human body model and clothing, accessories, etc. Assuming that the initial state information of the participant as a scene object includes the attributes (such as personalized clothing, accessories), initial posture, initial behavior, etc. of the corresponding virtual image, then the model resources corresponding to the human body model and the resources corresponding to the clothing, accessories, etc. of each part can be further obtained from the corresponding set of material resources as the target resources required by the target object of the participant.

[0108] 13) Configure the obtained target resources as the object elements required by the scene object according to the element configuration information indicated by the target element template.

[0109] After that, the obtained target resources of each item can be configured according to the element configuration information indicated by the target element template to obtain the object elements required for the scene. For example, for the model resources of the human model obtained for the participants, as well as the resource information such as clothing and accessories, the various obtained resources can be matched and assembled according to the configuration information of each resource indicated by the target element template, such as the graphics of each part of the human body and the relative position relationship between the human body and clothing and accessories, to obtain the object elements required for the personalized virtual image of the participants.

[0110] 14) Configure the above object elements as the object state indicated by the initial state information of the scene object, and generate object picture information matching the above object state to obtain the initial object picture information of the above scene object.

[0111] On this basis, the object elements required for the scene object can be further configured as the object state indicated by the initial state information of the scene object. For example, the generated virtual image of the participant with the corresponding clothing, accessories, etc. can be adjusted to a state matching the initial posture (such as sitting, standing, turning, walking, etc.) and initial behavior (such as speaking, listening, drinking water, meeting information recording) of the participant. Then generate object picture information matching the above object state, and this object picture information is the initial object picture information of the scene object.

[0112] The initial object picture information of each scene object included in the target scene at the initial time constitutes the initial scene picture information of the target scene, and accordingly, the initial scene picture information can be played.

[0113] Optionally, the initial scene picture information can specifically be the first frame, i.e., the first-frame scene picture information, of the target scene.

[0114] Step 103: Generate subsequent scene picture information corresponding to the target scene after the initial scene picture information according to the above initial scene picture information and the state change information of the scene object in the target scene, and play the generated subsequent scene picture information.

[0115] After generating and playing the initial scene picture information of the target scene, subsequent scene picture information corresponding to the target scene after the initial scene picture information can be generated according to the playback progress, and each generated subsequent scene picture information can be played to achieve the content playback of the target scene.

[0116] This process can be further implemented as follows: during the playback process after obtaining the initial scene picture information according to the playback progress, obtain the scene picture information corresponding to the previous adjacent time node of the target scene at the current time node, as well as the change instruction corresponding to the current time node; and according to the change instruction corresponding to the current time node, adjust the scene picture information corresponding to its previous adjacent time node to obtain the scene picture information corresponding to the target scene at the current time node. It is easy to understand that initially, the scene picture information corresponding to the previous adjacent time node is the initial scene picture information of the target scene.

[0117] In practical applications, optionally, different frame sequences (such as frame numbers) corresponding to different frames can be used to represent different time nodes. Correspondingly, according to the playback progress, the scene picture information of each subsequent frame corresponding to the target scene after the initial scene picture can be generated frame by frame and played frame by frame.

[0118] Among them, for the current frame to be generated, if this frame does not belong to the key frame in the playback file, that is, this frame is a non-key frame, it means that the object state of the scene object in the target scene has not changed compared with its previous frame. Correspondingly, the scene picture information of its previous frame can be directly read as the scene picture information of this current frame for playback, that is, the scene picture information of the previous frame is maintained in the current frame. On the contrary, if the current frame to be generated belongs to the key frame in the playback file, specifically, the respective state change instructions corresponding to this key frame can be obtained from the playback file, and according to the instruction content of each state change instruction, the state of the corresponding scene object in the scene picture information of the previous frame of the current frame is adjusted, including but not limited to the state adjustment of attributes, postures, and / or behaviors. For example, adjusting the posture of the participant from sitting to standing up at a certain speed, or changing the moving direction of an object from moving to the right to moving upward, etc. Correspondingly, the adjusted scene picture information is obtained, and this adjusted scene picture information is the scene picture information of the current frame. It can be directly played, and then based on the scene picture information played in the current frame, the scene picture information of its next frame can be obtained and played until the end condition is met and the content playback ends.

[0119] The end condition can be but is not limited to completing the content playback of the target scene, or the user ending the content playback of the target scene based on an end operation (such as closing the file or the player).

[0120] In summary, the information processing method provided in this application records a playback file including the initial state information and state change information of the scene objects in the target scene, as well as the material information required by the scene objects in the target scene. For example, a playback file in bytecode form containing the above information is recorded and generated, and the content playback of the target scene is performed based on the recorded playback file, realizing a more lightweight scene content playback scheme. The storage space required for the playback file is relatively small, generally within the KB level. Compared with the traditional scene content playback scheme based on video recording and playback, the storage space required for the playback file is significantly reduced. Especially as the recording duration increases, it will not cause a sharp increase in the storage space occupied by the playback file. In this case, the advantages of the solution in this application are more prominent.

[0121] In an embodiment, optionally, the information processing method provided in this application may further include the following processing: obtaining the playback field-of-view indication information for the target scene.

[0122] Among them, the playback field-of-view indication information is used to indicate the target playback perspective and / or the target playback area required for playing the target scene.

[0123] When playing the target scene based on the playback file to achieve the content playback of the target scene, the player will provide a scene picture under a default perspective based on the playback file. Taking the AR / VR conference scene as an example, optionally, specifically, but not limited to, the top perspective can be configured as the default perspective. Correspondingly, by default, the conference scene picture under the top perspective can be generated and played based on the playback file. In this case, the entire venue and the virtual images of all participants in the venue and their state change information during the conference process (representing the state changes of the corresponding actual participants in terms of posture, behavior, etc.) will be comprehensively displayed in a top perspective manner.

[0124] Optionally, before or during the playback of the scene content of the target scene based on the playback file, the user (such as a certain participant) can configure the required target playback perspective and / or target playback area according to actual needs, and the player can correspondingly obtain the corresponding playback field-of-view indication information. It is easy to understand that this playback field-of-view indication information is correspondingly used to indicate the target playback perspective and / or the target playback area required for playing the target scene.

[0125] In response to obtaining the playback field-of-view indication information, the player switches to generating and playing the scene picture information of the target scene from the target playback perspective, and / or selectively generates and plays the scene picture information of the target scene in its target playback area (such as a certain sub-area included in the venue). Referring to FIGS. 7(a) and 7(b), two different examples of generating the conference scene picture from the first perspective of the current participant (different from the default perspectives such as the top perspective) are provided respectively. Figure 8An example of generating a meeting scene picture from the perspective of the side of the participants (which can also be called the outsider's perspective) is provided.

[0126] Among them, if the user performs the above configurations before playing the playback file, such as configuring the required target playback perspective and / or target playback area, correspondingly, when starting to play the playback file, the scene picture of the target scene can be generated and played based on the configured target playback perspective and / or target playback area; if the user performs the above configurations during the playback of the playback file, correspondingly, starting from the current playback progress, the subsequent scene picture information of the target scene corresponding to after the current playback progress and matching the target playback perspective and / or target playback area can be generated and played.

[0127] In the traditional scene content playback scheme based on video recording, during the playback of scene content, the perspective cannot be switched or the key area cannot be focused, lacking the ability of custom browsing. This application provides the above-mentioned scene content recording and playback scheme based on bytecode, and on this basis, further provides a flexible switching function of the scene picture matching the configured perspective / area, further enriching the playback function of the scene content, so as to better meet the user's custom browsing function of the playback content.

[0128] In an embodiment, optionally, referring to Figure 9 the flowchart of the information processing method shown, the information processing method provided by this application may further include the following processing:

[0129] Step 901, obtain the playback progress indication information of the target scene.

[0130] During the process of content playback of the target scene based on the playback file, the user can also adjust the playback progress of the target scene according to needs. Specifically, the user can trigger the playback progress indication information of the target scene through operations such as dragging the playback progress bar or configuring the progress information.

[0131] Step 902, jump the target scene from the current playback progress to the target progress indicated by the playback progress indication information for playback.

[0132] The player can correspondingly receive the above-mentioned playback progress indication information, and jump the target scene from the current playback progress to the target progress indicated by the playback progress indication information for playback.

[0133] Preferably, if the target progress indicated by the playback progress indication information is prior to the current playback progress, the scene picture information at the target progress generated during the previous playback can be directly read from the cache and played to improve the progress switching rate and better achieve seamless switching of the playback progress. However, it is not limited thereto. The initial scene picture information or the scene picture information at a certain progress before the target progress can also be used as the reference picture, and the state change instructions of each key frame between the progress corresponding to the reference picture and the target progress are used to adjust the state of the scene objects in the reference picture, so as to obtain the scene picture information at the target progress. There is no limitation on this.

[0134] If the target progress is after the current playback progress, that is, the scene picture information at the target progress does not exist in the cache, the scene picture information at the current playback progress can be used as the reference picture, and the state change instructions of each key frame between the progress corresponding to the reference picture and the target progress are used to adjust the state of the scene objects in the reference picture, so as to obtain the scene picture information at the target progress and play it, thereby realizing the progress switching of the target scene playback progress.

[0135] This embodiment provides a function for adjusting the playback progress of the playback file in bytecode form, which can effectively meet the user's demand for progress adjustment when playing the target scene.

[0136] In one embodiment, optionally, the playback file may further include at least one of the following information: player version indication information, map identifier verification information, and state change verification information.

[0137] Correspondingly, referring to Figure 10 the flowchart of the information processing method shown, before generating the initial scene picture information of the target scene, the information processing method provided by this application may further include the following processing:

[0138] Step 1001: Perform at least one of the following processes: determine whether the version of the player used matches the version indicated by the player version indication information in the playback file, determine whether the target map identifier in the playback file matches the map identifier verification information, and determine whether the state change information in the playback file matches the state change verification information; if at least one determination result indicates a mismatch, end the processing of the playback file, and if each determination result indicates a match, go to step 102 to trigger the processing flow of step 102 and its subsequent steps.

[0139] For the player version, in practical applications, the matching rule between the version of the player used and the version indicated by the player version indication information in the playback file can be preset. Specifically, but not limited to, the matching rule can be set such that the version of the player used is exactly the same as the version indicated by the player version indication information, or the version of the player used is compatible with the version indicated by the player version indication information. For example, the version of the player used is higher and covers all the functions of the version indicated by the player version indication information. If the version of the player used and the version indicated by the player version indication information in the playback file meet the above matching rule, it can be determined that the two match; otherwise, they do not match.

[0140] For the map identification verification information in the playback file, specifically but not limited to, after recording the target scene and generating the map identification required in the playback file, a digest algorithm such as MD5 can be used to process the map identification in the playback file to generate the digest information of the map identification. The generated digest information can be used as the map identification verification information and stored in the playback file. Subsequently, when it is necessary to perform content playback of the target scene based on the playback file, the target map identification in the playback file can be first processed using the same algorithm such as MD5, and the obtained operation result can be compared with the map identification verification information in the playback file. If the two are the same, it is determined that the target map identification in the playback file matches the map identification verification information, specifically indicating that the map identification in the playback file has not been tampered with; otherwise, they do not match, correspondingly indicating that the map identification in the playback file has been tampered with. In this case, the playback of the playback file can be refused.

[0141] Similarly, for the status change verification information in the playback file, specifically but not limited to, after recording the target scene and generating the status change information required in the playback file, a digest algorithm such as MD5 can be used to process the status change information in the playback file to generate the digest information of the status change information. The generated digest information can be used as the status change verification information and stored in the playback file. Subsequently, when it is necessary to perform content playback of the target scene based on the playback file, the status change information in the playback file can be first processed using the same algorithm such as MD5, and the obtained operation result can be compared with the status change verification information in the playback file. If the two are the same, it is determined that the status change information in the playback file matches the status change verification information, indicating that the status change information in the playback file has not been tampered with; otherwise, they do not match, correspondingly indicating that the status change information in the playback file has been tampered with. In this case, the playback of the playback file can be refused. When all the verification results indicate a match, step 102 can be executed to trigger the subsequent processing flow of the playback file to achieve content playback of the target scene based on the playback file.

[0142] In the traditional scenario content playback solution based on video recording, playback files (such as video files) are very easy to be stolen, and it is easy to randomly tamper with the content (add / delete / modify) and have serious copyright issues. In addition, it is easy to randomly reduce the bit rate and resolution of the playback file, resulting in a decrease in content quality during the dissemination process. In this embodiment, by including relevant verification information (such as map identifier verification information, status change verification information, etc.) in the playback file, and before performing scenario content playback based on the playback file, first verifying the relevant information in the playback file based on the verification information, it can effectively detect content tampering problems. After tampering with the information in the playback file, such as deleting or adding, it cannot pass the inspection, and thus cannot be played, thereby solving the above series of problems accordingly.

[0143] The present application also provides another information processing method, which is different from the information processing methods provided in the above embodiments for performing scenario content playback based on a playback file. The information processing method of this embodiment is used to record scenario content for a required target scenario.

[0144] See Figure 11 As shown in the flowchart of the information processing method, the information processing method of this embodiment may include:

[0145] Step 1101, obtain a recording instruction for the target scenario.

[0146] The user can, according to the need, trigger the recording instruction for the required target scenario by performing a recording operation on the target scenario on the client device, such as pressing the corresponding scenario recording button, etc.

[0147] Step 1102, obtain the initial state information of the scenario object in the target scenario.

[0148] The initial state information of the scenario object in the target scenario includes, but is not limited to, some or all of the initial attributes of the scenario object, as well as the initial posture, behavior and other information. Specifically, it can, but is not limited to, obtain the initial attributes of the scenario object configured by the user (such as configuring the type of the virtual image as a participant in the person, and configuring corresponding clothing, accessories, colors and other information for it), and detect the initial posture and behavior of the scenario object by using the corresponding posture / behavior sensing devices or tools, components, to obtain the initial state information of the scenario object.

[0149] Step 1103, generate the state change information of the scenario object in the target scenario based on the detection of the state change of the scenario object in the target scenario.

[0150] The state change information of the scenario object may correspondingly include, but is not limited to, the change information of the attributes, postures, behaviors, etc. of the scenario object during the scenario content recording process.

[0151] During the recording process, a corresponding attitude / behavior sensing device or tool, component can be used to detect the attitude and behavior changes of the scene object. In addition, optionally, the recording stage can also support various input methods, including but not limited to keyboard keys, gestures, voice commands, face capture, joystick directions of the handle, mouse clicks, double clicks, drag and drop, etc. This can provide a rich interactive experience for users during the recording of scene content. Combining the actual attitude / behavior sensing of the user and the interaction with the user (such as the interactive adjustment of the attributes / attitudes / behaviors of the virtual image by the user), the state change information of the scene object in the target scene is generated.

[0152] Step 1104: Determine the material information required by the scene object in the target scene.

[0153] Corresponding to the information processing method for scene content playback in the above text, in one embodiment, the material information required by the scene object in the target scene may include the target map identifier corresponding to the recorded target scene, simply referred to as MapID, which is used to indicate the first theme element template set corresponding to the scene theme to which the recorded target scene belongs. For example, the meeting theme element template set corresponding to the meeting theme to which the AR / VR meeting scene belongs. Subsequently, the material information required by the scene object in the target scene can be provided by referring to the corresponding first material resource set in the first theme element template set.

[0154] In this embodiment, the scene theme to which the target scene belongs can be determined first, such as the meeting theme, the planet operation simulation theme, etc. Then, the identifier of the first theme element template set corresponding to the scene theme to which the target scene belongs is obtained as the target map identifier and used as the material information required by the scene object in the target scene.

[0155] In another embodiment, the material information required by the scene object in the target scene may directly include the second theme element template set required by the recorded target scene under the scene theme and the second material resource set corresponding to the second theme element template set.

[0156] In this embodiment, the scene theme to which the target scene belongs can also be determined first. Then, according to the actual needs of the scene object in the target scene, some templates required by the scene object in the target scene under the scene theme are determined from the first theme element template set (i.e., maps) corresponding to the scene theme to which the target scene belongs, forming the second theme element template set. Further, some material resources required by the second theme element template set are determined from the first material resource set corresponding to the first theme element template set, forming the second material resource set. The determined second theme element template set and the second material resource set are used as the material information required by the scene object in the target scene.

[0157] Step 1105: Generate a playback file for the target scene, including the initial state information and state change information of the scene objects in the target scene, and the material information required by the scene objects in the target scene.

[0158] After that, according to the information obtained, a playback file of the target scene can be further generated. The playback file includes the initial state information and state change information of the scene objects in the target scene, as well as the material information required by the scene objects in the target scene, so as to support content playback of the target scene through the information processing method for scene content playback described above based on the information contained in the playback file.

[0159] Optionally, when recording the required target scene, the scene content information (such as the initial state information, state change information, and required material information of the scene objects) can be encoded into bytecodes according to various bytecode structures described above to obtain a playback file in bytecode form.

[0160] The recording process can be executed on a single client or completed collaboratively by multiple clients, without limitation, depending on the actual needs. For example, for the planet running simulation scene, the recording can be directly completed on a single client, while for multi-end interaction scenes such as VR / AR online meetings with multiple participants remotely participating, the VR / AR online meeting recording needs to be completed collaboratively by multiple clients of each participant. Each client is responsible for recording the information (such as attributes, postures, behaviors) of the participants at their own end during the meeting, and the final playback file can be obtained by integrating and processing the recording information of multiple clients.

[0161] Optionally, in the case of multi-client collaborative recording, a server can be added. The server is responsible for collecting the recording information of each client and integrating the recording information of each client according to the timeline. In this implementation, the multiple clients and the server can synchronize the same progress at the same frame rate, so that the execution logic timelines of different ends are consistent.

[0162] See Figure 12The execution timelines of the client, server, and player are shown. Here, C and Client represent the client, S and Server represent the server, and R and Replay represent the player. Each client can synchronize its recording information to the server in real time through the network interface (Net IO). Timeline represents the timeline, Simulation Run represents the simulation run, which can specifically represent the information generation and processing for a single unit frame during the recording process. Wait represents waiting, which can specifically represent the gap between frames. The client integrates the recording information synchronized by each client in real time according to the timeline and transmits the integration result to the client to support real-time playback following the recording progress on the client. During this process, the execution timelines of the client, server, and player can be consistent. ECS, which is Entity-Component-System, will be described below.

[0163] Figure 13 Further shows the timeline (Timeline(Per Frame Logic in Net Sync)) of the logic of each frame of the client and the server during the synchronization process. The upper half of the figure represents the processing logic of each frame of the client, and the lower half represents the processing logic of each frame of the server. Referring jointly to Figure 12 , the client specifically performs the required processing based on the ECS (Entity-Component-System) architecture to achieve the scene recording of its own end. The ECS architecture can provide a way of organizing code that reflects the superiority of composition over inheritance. This embodiment uses this architecture to more conveniently process key frames.

[0164] In this architecture, an Enitiy is an entity that represents an object with a unique ID; a Component is a component that provides various types of components, such as a MoveComponent(Dir, Speed) for movement and a PoseComponent(Position, Rotation) for pose, where Dir, Speed, Position, and Rotation represent direction, speed, position, and rotation respectively. A System is used to process key frames based on the required components. Taking the MoveSystem as an example, it can generate the state change instructions required for key frames by applying the Dir and Speed in the Move instruction (MoveComponent) to the PoseComponent. After the server collects the information of each client, it summarizes the instructions of the key frames in each client according to the time line and broadcasts the summary result to all clients, supporting real-time playback by the client along with the recording process. The playback content includes not only the scene content of the current client itself but also the scene content of other clients participating in the collaborative recording. For example, in a VR / AR conference recording scenario, the VR / AR conference images of each participant can be played back in real time along with the recording process.

[0165] Figure 14 The schematic diagram of the player for real-time playback of the recorded file is shown. Specifically, it can be played back according to the time line of each frame of logic (Timeline(Per Frame Logic in Replay)). For each frame, the player will read all the instructions corresponding to that frame and apply the S in the ECS to the corresponding C to generate and play the scene image based on this. In the case where a frame does not correspond to any instructions, the scene image of the previous frame is maintained. An exemplary processing flow chart during the playback of the player content is as Figure 15 shown.

[0166] In practical applications, in the case of multi-client collaborative recording, it is also possible not to introduce a server, but to have each client negotiate to select a certain client to undertake the integration and synchronization tasks of the multi-client recording information. This is not limited and can be determined according to the actual application situation.

[0167] This embodiment provides a lightweight scene content recording method different from the traditional video recording method. Specifically, it can record the scene content in the form of bytecode based on recording key frame information. The storage space required for the recorded playback file is relatively small, generally in the order of KB. Compared with the traditional technology's scene content recording solution based on video recording, it greatly reduces the storage space of the generated playback file. Especially as the recording duration increases, it will not cause a sharp increase in the storage space occupied by the playback file. In this case, the advantages of the solution of this application are more prominent.

[0168] In addition, traditional video recording methods cannot capture and record interactive scenarios such as AR / VR meetings, and accordingly cannot replay the interaction process of such scenarios. By providing the above-mentioned collaborative recording processing based on multiple clients, this application effectively solves this problem, enables the recording of the multi-end interaction process of interactive scenarios such as AR / VR meetings, and accordingly can replay the scenario content of the interaction process in time.

[0169] The following provides an application example of the method of this application.

[0170] In this example, Maps with different theme styles are pre-produced, and corresponding resource packs are provided for Maps with different theme styles to support obtaining different theme style material resources as needed during scenario recording. For example, if it is necessary to demonstrate celestial body motion in a video presentation, the resource pack used is some planet models, spaceships, cannonballs, explosion sound effects, etc. If it is a chemical experiment theme, then the resource pack contains some chemical instrument graphics, etc. Optionally, a plug-in for visual editing of Maps can be pre-developed to make Map production easier.

[0171] In addition, this example provides two application modes for the player, including the application mode during the recording stage and the application mode during the playback stage. Among them, in the application mode during the recording stage, the player supports as many input methods as possible, including but not limited to keyboard keys, gestures, voice commands, face capture, joystick directions of gamepads, mouse clicks, double clicks, drag and drop, etc. This can provide a richer interaction experience for users to obtain at least the state change information of the scene objects in the recording scene based on these interaction experiences, and then generate key frames and key frame instructions (state change instructions) based on this.

[0172] For example, in a demonstration of a chemical experiment, during the recording stage, student A moves some test tubes at frame F1, and student B moves a certain beaker at frame F2. Frames F1 and F2 belong to key frames, and their corresponding behaviors can be used as the basis for generating key frame instructions. In this experiment, multiple students can perform real-time synchronous operations through different clients, and generate a playback file by integrating the information recorded by each client. After the recording is completed, the generated playback file can be saved.

[0173] Another example is the usage scenario of AR / VR meetings. Currently, traditional video recording methods are used in conference software to record conference videos, and there may be risks of theft or leakage of some content in the conference playback videos. The method of this application solves this problem by adding relevant verification information to the playback file and verifying the file content before playback, and can add support for using interactive scenarios such as multi-end online meetings in AR / VR devices based on the multi-end recording method of this application.

[0174] Referring to FIGS. 7(a)-7(b) and Figure 8 the example of, the roles in the meeting scenario can be represented by cartoon characters, that is, cartoon characters are used as their virtual avatars. The roles participating in the meeting can wave, nod, and even have facial expressions. If the entire meeting process is recorded by the traditional video recording method, then a person can only record the meeting playback video seen from their own FOV (Field of View) angle, and the videos recorded by each person are different. In contrast, with the solution of the present application, the meeting scenarios recorded by all participants can be integrated and kept consistent. When the actions of the participants (nodding, waving, smiling) occur in a certain frame, they will be recorded in the form of key frames. Just like the practice of the above key frame recording method, these instructions will be recorded in the playback file. When playing back, this action can be played at the start of the corresponding frame, and when playing back, the perspective of any person can be switched, which can be the first-person perspective of the speaker, the perspective of the audience, or the perspective of an outsider to watch the meeting, which cannot be achieved by the video recording method.

[0175] The embodiment of the present application also discloses an electronic device, and the composition structure of the electronic device is as Figure 16 shown, including at least:

[0176] A memory 10 for storing a computer instruction set;

[0177] The computer instruction set can be implemented in the form of a computer program.

[0178] A processor 20 for implementing the information processing method for scene content playback and / or the information processing method for scene content recording disclosed in any of the above method embodiments by executing the computer instruction set.

[0179] The processor 20 can be a central processing unit (CPU), an application-specific integrated circuit (ASIC), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, etc.

[0180] The electronic device is equipped with a display device and / or has a display interface and can externally connect a display device.

[0181] Optionally, the electronic device further includes a camera component and / or is connected to an external camera component.

[0182] In addition, the electronic device may further include components such as a communication interface and a communication bus. The memory, the processor, and the communication interface complete communication with each other through the communication bus.

[0183] The communication interface is used for communication between the electronic device and other devices. The communication bus may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, etc. The communication bus may be divided into an address bus, a data bus, a control bus, etc.

[0184] In summary, compared with the traditional technology, the information processing method and the electronic device disclosed in this application have at least the following technical advantages:

[0185] a) The storage space occupied by the playback file is extremely small, usually in the order of KB, and generally only reaches the MB level in larger cases;

[0186] b) The playback file contains verification information. After randomly tampering with the file content, deleting, or adding, the playback file will fail the verification and cannot be played, thus solving the problem of random tampering with the playback file, and there is also no problem of reducing the bit rate and resolution resulting in affecting the playback quality;

[0187] c) During the playback process, according to the needs of the user, the user can focus on watching the key area or switch the display area, and can also shoot and record AR / VR scenes.

[0188] d) It is possible to record multi-terminal interaction scenarios, and the integrity and consistency of the playback content can be ensured on different interaction devices.

[0189] It should be noted that each embodiment in this specification is described in a progressive manner. Each embodiment focuses on the differences from other embodiments. The same or similar parts among the embodiments can be referred to each other.

[0190] For the convenience of description, when describing the above system or device, it is divided into various modules or units according to functions for description. Of course, when implementing this application, the functions of each unit can be realized in the same or multiple software and / or hardware.

[0191] As can be seen from the description of the above embodiments, those skilled in the art can clearly understand that this application can be implemented by means of software plus a necessary general hardware platform. Based on such an understanding, the technical solution of this application, in essence, or the part that makes a contribution to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments or some parts of the embodiments of this application.

[0192] Finally, it should also be noted that in this article, relational terms such as first, second, third, and fourth are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variation thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "including a..." does not exclude the existence of additional identical elements in the process, method, article or device including the said element.

[0193] The above are only the preferred embodiments of this application. It should be pointed out that for those of ordinary skill in the art, without departing from the principle of this application, several improvements and refinements can be made, and these improvements and refinements should also be regarded as the protection scope of this application.

Claims

1. An information processing method, the method comprising: Obtaining a playback file to be processed; The information in the playback file at least includes: the initial state information and state change information of the scene objects in the recorded target scene, and the material information required by the scene objects in the target scene; based on the material information, an element template set corresponding to the scene theme and the material resources corresponding to the element template set can be determined; Generating initial scene picture information of the target scene according to the initial state information of the scene objects in the target scene and the material information, and playing the initial scene picture information; Generating subsequent scene picture information corresponding to the target scene after the initial scene picture information according to the initial scene picture information and the state change information, and playing the subsequent scene picture information.

2. The method according to claim 1, wherein the material information includes a target map identifier corresponding to the target scene; The generating initial scene picture information of the target scene according to the initial state information of the scene objects in the target scene and the material information includes: Obtaining a first theme element template set of the scene theme to which the target scene belongs indicated by the target map identifier, and a first material resource set corresponding to the first theme element template set, from the local end of the player for playing the playback file or from the network end; Generating initial object picture information of the scene objects in the target scene according to the initial state information, the first theme element template set, and the first material resource set; the initial scene picture information of the target scene includes the initial object picture information of each scene object in the target scene.

3. The method according to claim 1, wherein the material information includes a second theme element template set required by the target scene under the scene theme and a second material resource set corresponding to the second theme element template set; The generating initial scene picture information of the target scene according to the initial state information of the scene objects in the target scene and the material information includes: Obtaining the second theme element template set and the second material resource set from the playback file; Generating initial object picture information of the scene objects in the target scene according to the initial state information, the second theme element template set, and the second material resource set; the initial scene picture information of the target scene includes the initial object picture information of each scene object in the target scene.

4. The method according to claim 2 or 3, wherein The generating initial object picture information of the scene objects in the target scene according to the initial state information, the corresponding theme element template set, and the corresponding material resource set includes: Determining a target element template corresponding to the scene object in the target scene in the corresponding theme element template set; For each scene object in the target scene, obtaining a target resource corresponding to the target element template of the scene object in the corresponding material resource set under the initial state information of the scene object; Configure the obtained target resources as the object elements required by the scene object according to the element configuration information indicated by the target element template; Configure the object element as the object state indicated by the initial state information of the scene object, and generate object picture information matching the object state to obtain the initial object picture information of the scene object; Wherein, the corresponding theme element template set is the first theme element template set, and the corresponding material resource set is the first material resource set, or the corresponding theme element template set is the second theme element template set, and the corresponding material resource set is the second material resource set.

5. The method according to claim 1, wherein the status change information includes: Change instructions corresponding to the scene object in the target scene at different time nodes; the change instructions are used to indicate the change content of the state change that occurs to the corresponding scene object; Generating the subsequent scene picture information corresponding to the target scene after the initial scene picture information according to the initial scene picture information and the state change information includes: Obtain the scene picture information corresponding to the previous adjacent time node of the target scene at the current time node during the playback after the initial scene picture information, and the change instruction corresponding to the current time node; during the playback, initially the scene picture information corresponding to the previous adjacent time node is the initial scene picture information; Adjust the scene picture information corresponding to the previous adjacent time node according to the change instruction to obtain the scene picture information corresponding to the target scene at the current time node.

6. The method according to claim 1, further comprising: Obtain the playback field-of-view indication information for the target scene; The playback field-of-view indication information is used to indicate the target playback perspective and / or the target playback area required for playing the target scene; Generating the subsequent scene picture information corresponding to the target scene after the initial scene picture information includes: Generate subsequent scene picture information corresponding to the current playback progress of the target scene and matching the target playback perspective and / or the target playback area.

7. The method according to claim 1, further comprising: Obtain the playback progress indication information for the target scene; Jump the target scene from the current playback progress to the target progress indicated by the playback progress indication information for playback.

8. The information in the playback file according to the method of claim 2 further includes at least one of the following information: player version indication information, map identifier verification information, status change verification information; before generating the initial scene picture information of the target scene, the method further includes: Perform at least one of the following processes: determine whether the version of the used player matches the version indicated by the player version indication information, determine whether the target map identifier matches the map identifier verification information, determine whether the state change information matches the status change verification information; If at least one determination result indicates a mismatch, end the processing of the playback file.

9. An information processing method, the method includes: Obtain a recording instruction for a target scenario; Obtain the initial state information of a scene object in the target scenario; Generate state change information of a scene object in the target scenario based on detecting the state change of the scene object in the target scenario; Determine the material information required by the scene object in the target scenario; Based on the material information, an element template set corresponding to the scene theme and the material resources corresponding to the element template set can be determined; Generate a playback file for the target scenario, including the initial state information and state change information of the scene object in the target scenario, and the material information required by the scene object in the target scenario.

10. An electronic device, comprising: A memory for storing at least a set of computer instruction sets; A processor for implementing the information processing method according to any one of claims 1-8 and / or implementing the information processing method according to claim 9 by calling and executing the instruction sets stored in the memory.

Images