Method, device, equipment and storage medium for generating recorded courses

Abstract

The present disclosure relates to a method, apparatus, device, and storage medium for generating a recorded course. The recorded course generation method includes: obtaining a target recorded video of a target object; obtaining interactive signaling generated by a virtual object corresponding to the target object in an initial virtual scene; combining the target recorded video and the interactive signaling to generate a recorded course, wherein the recorded course is loaded into a target virtual scene for interaction. The method provided by the present disclosure can modify the generated recorded course and replace the applied virtual scene.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a method, apparatus, device, and storage medium for generating recorded courses. Background Art

[0002] In virtual education scenarios, screen recording is usually used to generate recorded courses, or picture-in-picture is used to record the teacher video and display screen separately, and then directly synthesize them to generate recorded courses. However, the above method of generating recorded courses cannot modify the generated recorded courses, and the applicable virtual education scenarios are fixed. Summary of the Invention

[0003] In order to solve the above technical problems, the present disclosure provides a recorded course generation method, device, equipment and storage medium, which can modify the generated recorded course and replace the applied virtual scene.

[0004] According to one aspect of the present disclosure, a method for generating a recorded course is provided, comprising:

[0005] Get the target recorded video of the target object;

[0006] Acquire interactive signaling generated by a virtual object corresponding to the target object in an initial virtual scene;

[0007] The target recorded video and the interactive signaling are combined to generate a recorded course, wherein the recorded course is used to be loaded into a target virtual scene for interaction.

[0008] According to another aspect of the present disclosure, a device for generating a recorded course is provided, comprising:

[0009] A first acquisition module is used to acquire a target recorded video of a target object;

[0010] A second acquisition module is used to acquire the interactive signaling generated by the virtual object corresponding to the target object in the initial virtual scene;

[0011] A generation module is used to combine the target recorded video and the interactive signaling to generate a recorded course, wherein the recorded course is used to be loaded into a target virtual scene for interaction.

[0012] According to another aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory storing a program, wherein the program comprises instructions that, when executed by the processor, cause the processor to execute the above-mentioned recorded course generation method.

[0013] According to another aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable the computer to execute a method for generating a course based on recorded broadcasts.

[0014] According to another aspect of the present disclosure, a computer program product is provided, including a computer program, which implements the above-mentioned recorded course generation method when executed by a processor.

[0015] The technical solution provided by the embodiments of the present disclosure has the following advantages over the prior art:

[0016] The method for generating a recorded course includes: obtaining a target recorded video of a target object; obtaining interactive signaling generated by a virtual object corresponding to the target object in an initial virtual scene; and combining the target recorded video and the interactive signaling to generate a recorded course, wherein the recorded course is loaded into a target virtual scene for interaction. The method provided by the present disclosure allows the generated recorded course to be modified and the applied virtual scene to be replaced. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0018] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0019] Figure 1 A flow chart of a method for generating recorded courses provided in an embodiment of the present disclosure;

[0020] Figure 2 A schematic diagram of generating a recorded course provided in an embodiment of the present disclosure;

[0021] Figure 3 A schematic diagram of a virtual scene provided in an embodiment of the present disclosure;

[0022] Figure 4 A schematic diagram of a virtual scene provided in an embodiment of the present disclosure;

[0023] Figure 5 A schematic diagram of the structure of a device for generating recorded courses provided in an embodiment of the present disclosure;

[0024] Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0025] In order to more clearly understand the above-mentioned purposes, features and advantages of the present disclosure, embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein. Instead, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0026] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0027] The term "including" and its variations used in this document are open inclusions, that is, "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one other embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the description below. It should be noted that the concepts of "first", "second", etc. mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0028] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".

[0029] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0030] Before explaining the present disclosure, the key terms involved are first introduced, including:

[0031] Virtual scene / full-scale scene: This is the scene displayed (or provided) when the client of an application (such as an educational application) is running on a terminal. The virtual scene refers to an environment created for virtual objects to carry out activities (such as education and learning). For example, it can be a virtual teaching scene such as a virtual classroom or virtual class. The virtual scene can be a scene that simulates the real world, or it can be a fictional scene, or a scene that is half real and half fictional. It is understood that the virtual scene provided in the present disclosure is three-dimensional and can be understood as a three-dimensional virtual scene.

[0032] Virtual objects are objects controlled by a terminal within an application. For example, an educational application displays a realistic educational scene, such as a virtual classroom. Virtual objects are students and / or teachers controlled by the terminal within the educational application. Virtual objects can be 3D character poses, 3D virtual objects, or 3D virtual models.

[0033] In response to the above technical problems, the embodiments of the present disclosure provide a method for generating recorded courses, which obtains recorded teacher lecture videos and recorded interactive signaling in the initial virtual classroom scenario corresponding to the teacher lecture videos, wherein the recorded videos and recorded interactive signaling can be carried out in multiple channels at different stages and different terminals. For example, the first channel records the teacher lecture video, and the complete lecture video can be automatically synthesized through multiple video segments recorded at multiple terminals, and a timestamp is added to each recorded video; the second channel records the interactive signaling, and the interactive signaling is timestamped during the generation process. Subsequently, the recorded video and interactive signaling are combined according to the timestamp to generate a recorded course, ensuring that the teacher's teaching content and the interactive signaling of the virtual classroom are synchronized. In addition, the generated recorded courses can also be applied in different virtual classroom scenarios. The recorded courses can be understood as virtual classroom templates, which can be used by different clients to conduct learning and interaction through the virtual classroom templates in the selected target virtual classroom scenario. This will be explained in detail through at least one of the following embodiments.

[0034] Figure 1 A flow chart of a recorded course generation method provided in an embodiment of the present disclosure is provided. The recorded course generation method is applied to a server or terminal. In a first feasible application scenario, server A records the video, server B records the interactive signaling, and the terminal obtains the recorded video and interactive signaling from server A and server B respectively, and generates a recorded course based on the recorded video and interactive signaling. In another feasible application scenario, the server or terminal records the video and records the interactive signaling by itself, and then generates a recorded course based on the recorded video and interactive signaling. The scenarios to which the present disclosure is applicable are not limited to the above-mentioned feasible scenarios, and other feasible scenarios will not be elaborated here. The following embodiments are described by taking the first feasible application scenario as an example, specifically including the following: Figure 1 The following steps S110 to S130 are shown:

[0035] S110: Obtain a target recorded video of the target object.

[0036] The target recorded video is at least one recorded video in a complete recorded video; the target recorded video includes at least one first interactive information; the first interactive information includes the password information issued by the target object.

[0037] It is understandable that server A records the audio and video stream of the target object. The target object can be understood as a teacher. Specifically, a full-body video of the teacher during class can be recorded, or a half-body video of the teacher during class can be recorded. Server A records the video of the teacher in class and sends it to the cloud server, that is, cloud recording is performed, which does not occupy the memory of server A. The recorded course is recorded as the target course. The recorded video records the process of the teacher explaining the target course. For example, the target course is a Chinese class. A complete Chinese class can be recorded in multiple times. Each time, only a section of the explanation video can be recorded, or the entire explanation video can be recorded directly at once, or a section of the explanation video can be recorded repeatedly. The specific video recording method can be determined by the user. Among them, the target recorded video obtained by the terminal from the cloud server can be at least one recorded video in the complete recorded video. For example, the terminal obtains one of the three recorded videos recorded by the cloud server. The three recorded videos can be combined to form a complete recorded video explaining a course. Each recorded video can be recorded by a sequential name identifier, for example, recorded video upper, recorded video middle, and recorded video lower. The terminal can obtain each recorded video in sequence according to the order of the name identifier, or directly obtain all recorded videos.

[0038] It is understandable that the target recorded video includes at least one first interactive information. The first interactive information can be the command information issued by the target object, that is, each utterance of the relevant instructions issued by the target object when explaining the target course is recorded as a first interactive information. For example, in the target recorded video, the target object raises a question during the lecture and issues the command "Students, please speak actively", or issues the command "Everyone gather in the classroom", or issues the command "Disband and take a ten-minute break", etc. The utterance "Students, please speak actively" is recorded as a first interactive information, and "Everyone gather in the classroom" is recorded as another first interactive information.

[0039] Optionally, the identifier of the first interactive information includes a time identifier and / or a sequence number identifier.

[0040] Optionally, after obtaining the target recorded video, determining the time stamp of each first interactive information in the target recorded video is specifically achieved by the following steps:

[0041] Divide the target recorded video into multiple time periods according to the preset frequency and the total length of the target recorded video; record the time period of each first interactive information in the at least one first interactive information as the time identifier of the first interactive information; or, mark the at least one first interactive information included in the target recorded video with time identifiers in chronological order.

[0042] It can be understood that after obtaining the target recorded video, a millisecond timestamp is written in the Supplemental Enhancement Information (SEI) of the target recorded video according to the highly compressed digital video codec standard (H.264 / MPEG-4AVC). The preset frequency is 3 times per second. By writing 3 timestamps per second, the target recorded video is divided into multiple time periods. The multiple time periods are recorded as T1 to Tn in chronological order. The time period in which the first interactive information is located is recorded as the time identifier of the first interactive information. For example, the first interactive information 1 is in the T1 time period, and the time identifier of the first interactive information 1 is T1. For another example, the first interactive information 1 is in the T1, T2 and T3 time periods. In this case, the time identifier of the first interactive information 1 is recorded as T1. That is, if the first interactive information occupies multiple time periods, the first time period of the multiple time periods is recorded as the time identifier of the first interactive information. Alternatively, instead of dividing the time periods, each first interactive message in the recorded video can be directly identified and time-stamped according to the chronological order of appearance of each first interactive message. That is, the time of the first appearance of the identified speech containing the command in the recorded video is recorded as the time stamp of the command. For example, if the target recorded video is 10 seconds long and the first interactive message 1 first appears at the 2nd second in the recorded video, then 2s is used as the time stamp of the first interactive message 1. Alternatively, each first interactive message in the recorded video can be identified and serially numbered according to the chronological order of appearance of each first interactive message. For example, if the first interactive message 1 is a command that first appears in the recorded video, the first interactive message 1 is serially numbered. Similarly, serial numbers are serially numbered according to the chronological order of appearance of the commands in the recorded video. It is understood that other marking methods for clarifying the order of appearance of each first interactive message are not limited.

[0043] It is understandable that after server A records the video, it can also write a millisecond timestamp in the additional enhanced information of the recorded video. In this case, when the terminal obtains the target recorded video, it directly obtains the millisecond timestamp of the target recorded video, and the terminal does not need to mark the target recorded video subsequently.

[0044] S120: Obtain interactive signaling generated by the virtual object corresponding to the target object in the initial virtual scene.

[0045] In which, the interactive signaling includes second interactive information corresponding to part of the first interactive information in the at least one first interactive information; the second interactive information includes the action information of the virtual object and the coordinate information of the virtual object in the initial virtual scene; the interactive signaling includes at least one of a call signaling, a disband signaling, a scene switching signaling and a speech signaling.

[0046] It is understandable that the user operates the virtual object in the initial virtual scene displayed by the client or generates a series of control instructions through other triggering operations. At the same time, the server B connected to the client records the completed control instruction messages according to the time series. The recorded control signaling message is the interactive signaling. Among them, the user can be the target object (teacher) or other users who operate the client according to the command information in the recorded video. A feasible application scenario is that the teacher can operate the client to generate a series of instructions corresponding to the command while recording the video. Based on the above example, based on the teacher's commands such as "Students, please speak up!", "Everyone, gather in the classroom!", and "Dismiss for a ten-minute break" issued in the target recorded video, a series of control commands are generated in the chronological order of the commands. For example, a speaking command corresponding to the command "Students, please speak up!", a call command corresponding to the command "Everyone, gather in the classroom!", and a dismiss command corresponding to the command "Dismiss for a ten-minute break." Each command may also be accompanied by a corresponding action performed by a virtual object. Subsequently, server B generates interaction signaling based on the time series recording of the completed command messages. The command "Students, please speak up!" is the first interaction information 1, and the speaking command and the action information of the virtual object are recorded as the second interaction information 1. In this scenario, the first interaction information 1 and the second interaction information 1 are in a one-to-one correspondence. It is understandable that the interaction signaling can also be obtained in multiple stages. Based on the above multiple recorded videos, the interaction signaling corresponding to each recorded video segment can be generated. The corresponding interaction signaling can be recorded for each recorded video segment, or the interaction signaling required for a course can be directly obtained based on the complete recorded video of a course. The specific method of recording the interaction signaling is not limited.

[0047] It is understandable that the terminal obtains interactive signaling from server B, and can obtain all interactive signaling required for a course, and can also obtain interactive signaling corresponding to each recorded video. The interactive signaling is generated by the virtual object corresponding to the target object in the initial virtual scene. The terminal does not limit the order of obtaining interactive signaling and recorded videos. The initial virtual scene can be a three-dimensional space, and the coordinate information is three-dimensional coordinates, wherein the interactive signaling includes at least one second interactive information, and the second interactive information and the first interactive information included in the recorded video are one-to-one corresponding. The interactive signaling can be understood as a series of communication commands or communication instructions. Each second interactive information represents an instruction. The second interactive information includes the virtual object, the action information of the virtual object and the coordinate information of the virtual object in the initial virtual scene. In addition, each instruction will record the millisecond timestamp of the instruction when it is generated, that is, based on the second interactive information, the time, person, place and action can be determined. In an application scenario, two target objects explain a course. There are two virtual objects in the initial virtual scene, and each target object corresponds to a virtual object. In this case, the action information and coordinate information of each virtual object need to be recorded. Different virtual objects can be clearly identified in a second interactive message, such as virtual object 1 and virtual object 2. The following embodiment is explained by taking a virtual object corresponding to a target object as an example. For example, the action information recorded in the second interactive message 1 is the teacher's virtual object walking from coordinates (0, 1, 1) to coordinates (1, 1, 1). That is to say, the teacher's virtual object may have sent a call signal to summon students while walking horizontally. The second interactive message 1 (call signal) corresponds to the first interactive message 1 including the command information "Everyone gather at the teacher's place". At this time, the virtual objects of the students in the same virtual scene as the teacher's virtual object can gather at coordinates (1, 1, 1) according to the call signal.

[0048] S130: Combine the target recorded video and the interactive signaling to generate a recorded course.

[0049] Optionally, the generation of the recorded course in S130 is specifically implemented by the following steps:

[0050] Based on the identifiers corresponding to the first interactive information and the second interactive information, the target recorded video and the interactive signaling are combined to generate a recorded course.

[0051] It is understandable that based on the above S110 and S120, the first interactive information and the second interactive information will be matched based on the identification of the interactive information, and then the target recorded video and interactive signaling will be combined to generate a recorded course based on the corresponding first interactive information and second interactive information.

[0052] Optionally, before generating a recorded course, you need to perform the following steps based on the target recorded video:

[0053] If the target recorded video is the current segment of the recorded video in the complete recorded video, the current segment of the recorded video and the previous segment of the recorded video are sorted; the sorted multiple segments of the recorded video and the interactive signaling are combined to generate a recorded course.

[0054] Understandably, the terminal determines whether the acquired target recorded video is a complete recorded video. If not, it means that the target recorded video includes at least one recorded video segment, and the number of recorded video segments included is less than the total number of segments that make up the complete recorded video. In this case, the target recorded video acquired by the terminal is recorded as the current recorded video segment, and the current recorded video segment and the previous recorded video segment are sorted according to the name identifier. The name identifier may include text identifiers such as "upper, middle, lower", or numerical identifiers in the form of "123". The previous recorded video segment refers to the other recorded videos in the complete recorded video previously acquired by the terminal except the current recorded video segment. For example, the complete recorded video segment There are three recorded videos, the current recorded video is the one with the name identified as "middle" among the three recorded videos, and the previous recorded video is the one with the name identified as "upper" among the three recorded videos. Sort the current recorded video and the previous recorded video according to the name identification. After sorting, you can continue to obtain the last recorded video with the name identified as "lower" and sort it again, that is, sort it once every time you obtain a recorded video, or after obtaining a recorded video with the name identified as "lower", sort the obtained three recorded videos according to the name identification, that is, sort them again after obtaining all the recorded videos. Finally, combine the sorted multiple recorded videos and interactive signaling to generate a recorded course. At this time, the interactive signaling refers to the complete interactive signaling required for a course. If the target recorded video obtained is a complete recorded video, there is no need to perform the sorting step. You can directly combine the complete recorded video and the complete interactive signaling to generate a recorded course.

[0055] It is understandable that there is another feasible implementation method. Every time a recorded video is obtained, the recorded video is combined with the corresponding interactive signaling to generate a recorded course. Finally, multiple recorded courses are combined in chronological order to obtain a complete recorded course.

[0056] For example, see Figure 2 , Figure 2 This is a schematic diagram of generating a recorded course provided in an embodiment of the present disclosure. Figure 2It includes a recorded video 210 and an interactive signaling 220. The recorded video 210 includes three recorded videos. The serial numbers of the three recorded videos are the first recorded video, the second recorded video and the third recorded video. Each recorded video is divided into multiple time periods according to a preset frequency. The multiple time periods are recorded as T1 to T8, that is, the three recorded videos are stamped with millisecond timestamps. The three recorded videos include multiple first interactive messages. Some time periods in T1 to T8 are also time identifiers of the first interactive messages that fall in the corresponding time periods. The interactive signaling 220 includes multiple second interactive messages, and the number of second interactive messages corresponds to the number of first interactive messages. If they do not correspond, the recorded video 210 or the interactive signaling 220 can be adjusted. Each second interactive message will also be stamped with a millisecond timestamp when it is generated, that is, each second interactive message will also have a time identifier. Figure 2 The black horizontal line in the middle indicates the duration. The total duration of the recorded video 210 and the interactive signaling 220 is substantially the same. Alternatively, the duration from the first first interactive information to the last first interactive information is substantially the same as the duration from the first second interactive information to the last second interactive information. Figure 2 As shown, in recorded video 210, T2 is the time stamp of the first interactive message 1. The command for the first interactive message 1 is "Students, please speak up!" The command for the second interactive message 1 corresponding to the first interactive message 1 in interactive signaling 220 is "Speak collectively." The time stamp of the second interactive message 1 corresponds to T2, and the method for timestamping the second interactive message can be the same as the method for timestamping the first interactive message. For another example, in recorded video 210, T7 is the time stamp of the first interactive message 3. The command for the first interactive message 2 is "Dismiss and take a ten-minute break." The command for the second interactive message 2 corresponding to the first interactive message 3 is "Dismiss the students."

[0057] Optionally, after obtaining the recorded course, you can also modify it. This can be achieved by following the steps below:

[0058] The recorded course is updated according to the obtained updated target recorded video; and / or, the recorded course is updated according to the obtained updated interactive signaling.

[0059] It is understandable that after the terminal generates a recorded course, it can also update the recorded video or interactive signaling, and generate a new recorded course based on the updated recorded video and / or updated interactive signaling. For example, if it is found that the first interactive information and the second interactive information do not correspond, or there is a deviation in the generated recorded course, the video can be re-recorded, or the interactive signaling can be re-recorded.

[0060] For example, see Figure 3 , Figure 3 A schematic diagram of a virtual scene provided in an embodiment of the present disclosure, Figure 3The display shows the interactive signaling generated by the virtual object in the initial virtual scene. The initial virtual scene 310 is a three-dimensional space that does not contain a scene model. The teacher's virtual object 311 is in the initial virtual scene 310. The target object generates a series of control instructions by controlling the virtual object 311, such as Figure 3 As shown in the initial virtual scene 320, the teacher controls the virtual object 311 to move and stretches out his hands, and clicks the call mark to generate a call instruction. Then the server generates a call signal according to the message of completing the call. The interactive instructions in the initial virtual scene need to be triggered in real time according to oral commands. The interactive instructions in subsequent recorded courses are automatically triggered and do not require manual operation.

[0061] The recorded course is loaded into the target virtual scene for interaction.

[0062] For example, see Figure 4 , Figure 4 A schematic diagram of a virtual scene provided in an embodiment of the present disclosure, Figure 4 What is displayed is the situation in the target virtual scene 410. After the terminal generates the recorded course, the target virtual scene 410 is selected. The target virtual scene can be regarded as a virtual scene model, such as Figure 4 As shown, the target virtual scene 410 is a virtual playground scene. The target virtual scene 410 includes a virtual object 311 and a recorded video 420. The recorded video 420 includes a target object 421. The target object 421 is the teacher in the real space. The virtual object 311 is a three-dimensional model of the teacher in the virtual playground scene. As shown in the target virtual scene 411, after the virtual objects 430 of multiple students enter the target virtual scene 410, the virtual object 311 is adjusted according to the target virtual scene 411. Figure 3 The recorded summoning signal moves on its own and stretches out its hands, and at the same time issues summoning instructions to the virtual objects 430 of multiple students. The virtual objects 430 of multiple students will move toward the virtual object 311 according to the summoning instructions. That is to say, after the virtual objects 430 of multiple students enter the target virtual scene 410, as time goes by, the interactive signaling in the recorded course will be automatically triggered in turn, and the recorded video 420 in the recorded course will play the corresponding words synchronously, that is, the teacher’s teaching content and the classroom interactive signaling are synchronized, and the students in class will participate in the interaction and learn the target course according to the set recorded course. It is understandable that the set recorded course can be used for different batches of students to interact with the target course at different stages, and different virtual scenes can also be automatically selected.

[0063] The disclosed embodiment provides a method for generating a recorded course, which is applied to a virtual education scene to obtain a teacher's target recorded video of a target course. The complete recorded video of the target course can be divided into multiple recorded videos, that is, the teacher can record a lecture video at different stages and times, which is flexible and easy to operate. The interactive signaling generated by the teacher's virtual object in the initial virtual scene is obtained. The instructions in the interactive signaling correspond one-to-one with the teacher's password in the recorded video. According to the timestamps of the password and the instruction, the recorded video and the interactive signaling are combined to generate a recorded course. The recorded course is a template of the target course in the virtual education scene, which is simple to operate and easy to implement. Subsequent students can automatically learn the target course based on the recorded course, and at the same time, they can watch the teacher's explanation video of the target course in the real space. The teacher's teaching content is synchronized with the classroom interactive signaling, and the teacher does not need to repeat the course for different students. The generated recorded course can be used for different batches of students to enter the virtual scene for learning and interaction at different time periods, further reducing the workload. Secondly, recorded video and interactive signaling are generated through different channels. The recorded video can be considered the first channel of data, and the interactive signaling can be considered the second channel of data. The two do not affect each other. The recorded video and / or interactive signaling can be replaced independently, and the recorded course can be updated accordingly. This makes the recorded course modifiable and facilitates the real-time nature of the recorded course. During the application of the recorded course, different scene models can also be loaded, that is, the virtual scene of the application can be replaced. The virtual scene is not fixed. The scene model can be considered the third channel of data. Each channel of data can be modified independently, which makes it widely applicable and highly feasible.

[0064] Based on the above embodiments, Figure 5 This is a structural diagram of a recorded course generation device provided by an embodiment of the present disclosure. The recorded course generation device 500 includes a first acquisition module 510, a second acquisition module 520, and a generation module 530, wherein:

[0065] A first acquisition module 510 is used to acquire a target recorded video of a target object;

[0066] A second acquisition module 520 is configured to acquire interaction signaling generated by the virtual object corresponding to the target object in the initial virtual scene;

[0067] The generation module 530 is used to combine the target recorded video and the interactive signaling to generate a recorded course, wherein the recorded course is used to be loaded into the target virtual scene for interaction.

[0068] Optionally, the target recorded video in the device 500 includes at least one first interaction information, and the interaction signaling includes second interaction information corresponding to part of the first interaction information in the at least one first interaction information.

[0069] Optionally, the generating module 530 is configured to:

[0070] Based on the identifiers corresponding to the first interactive information and the second interactive information, the target recorded video and the interactive signaling are combined to generate a recorded course.

[0071] Optionally, the identifier of the first interactive information includes a time identifier.

[0072] Optionally, the apparatus 500 is further configured to:

[0073] Divide the time periods into multiple time periods according to the preset frequency and the total duration of the target recorded video; record the time period of each first interactive information in the at least one first interactive information as the time identifier of the first interactive information; or

[0074] The at least one first interactive information included in the target recorded video is marked with a time mark in chronological order.

[0075] Optionally, the target recorded video in device 500 is at least one recorded video in a complete recorded video; the first interactive information includes the command information issued by the target object; the second interactive information includes the action information of the virtual object and the coordinate information of the virtual object in the initial virtual scene.

[0076] Optionally, the generating module 530 is configured to:

[0077] If the target recorded video is the current recorded video segment in the complete recorded video segment, the current recorded video segment and the previous recorded video segment are sorted;

[0078] The sorted multiple recorded videos and the interactive signaling are combined to generate a recorded course.

[0079] Optionally, the apparatus 500 is further configured to:

[0080] updating the recorded course according to the obtained updated target recorded video; and / or,

[0081] The recorded course is updated according to the obtained updated interactive signaling.

[0082] Optionally, the interactive signaling in the device 500 includes at least one of a call signaling, a dismissal signaling, a scene switching signaling, and a speech signaling.

[0083] The device provided in this embodiment has the same implementation principle and technical effects as those of the aforementioned method embodiment. For the sake of brief description, for matters not mentioned in the device embodiment, reference may be made to the corresponding contents in the aforementioned method embodiment.

[0084] The exemplary embodiments of the present disclosure further provide an electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor. The memory stores a computer program executable by the at least one processor, the computer program being configured to cause the electronic device to perform a method according to an exemplary embodiment of the present disclosure when executed by the at least one processor.

[0085] Exemplary embodiments of the present disclosure further provide a computer program product, including a computer program, wherein when the computer program is executed by a processor of a computer, it is used to cause the computer to perform the method according to the embodiment of the present disclosure.

[0086] refer to Figure 6 , a block diagram of an electronic device 600 that can serve as a server or client of the present disclosure will now be described, which is an example of a hardware device that can be applied to various aspects of the present disclosure. The electronic device is intended to represent various forms of digital electronic computer devices, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or required herein.

[0087] like Figure 6 As shown, electronic device 600 includes a computing unit 601, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 602 or a computer program loaded from a storage unit 608 into a random access memory (RAM) 603. Various programs and data required for the operation of device 600 can also be stored in RAM 603. Computing unit 601, ROM 602, and RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to bus 604.

[0088] Multiple components within electronic device 600 are connected to I / O interface 605, including an input unit 606, an output unit 607, a storage unit 608, and a communication unit 609. Input unit 606 can be any type of device capable of inputting information into electronic device 600. Input unit 606 can receive input numeric or character information and generate key input signals related to user settings and / or function control of the electronic device. Output unit 607 can be any type of device capable of presenting information and may include, but is not limited to, a display, a speaker, a video / audio output terminal, a vibrator, and / or a printer. Storage unit 608 may include, but is not limited to, a magnetic disk or an optical disk. Communication unit 609 allows electronic device 600 to exchange information / data with other devices via computer networks such as the Internet and / or various telecommunication networks and may include, but is not limited to, a modem, a network card, an infrared communication device, a wireless communication transceiver and / or a chipset, such as a Bluetooth™ device, a WiFi device, a WiMax device, a cellular communication device, and / or the like.

[0089] The computing unit 601 can be various general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 601 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 601 performs the various methods and processes described above. For example, in some embodiments, the learning situation diagnosis method or the training method of the recognition network can be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 608. In some embodiments, part or all of the computer program can be loaded and / or installed on the electronic device 600 via the ROM 602 and / or the communication unit 609. In some embodiments, the computing unit 601 can be configured to execute the recorded course generation method in any other appropriate manner (for example, by means of firmware).

[0090] The program code for implementing the method of the present disclosure can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device so that when the program code is executed by the processor or controller, the functions / operations specified in the flow chart and / or block diagram are implemented. The program code can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0091] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0092] As used in this disclosure, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and / or device (e.g., a magnetic disk, an optical disk, a memory, a programmable logic device (PLD)) for providing machine instructions and / or data to a programmable processor, including machine-readable media that receive machine instructions as machine-readable signals. The term "machine-readable signal" refers to any signal used to provide machine instructions and / or data to a programmable processor.

[0093] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0094] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0095] Computer systems may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The client and server relationship arises through computer programs running on the respective computers and having a client-server relationship to each other.

[0096] The foregoing description is intended only to provide specific embodiments of the present disclosure, intended to enable those skilled in the art to understand and implement the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not intended to be limited to the embodiments described herein, but rather to be construed in the broadest manner consistent with the principles and novel features disclosed herein.

Claims

1. A method for generating recorded courses, characterized in that: include: Acquire a target recorded video of a target object, wherein the target recorded video includes at least one first interactive information, and the first interactive information includes password information sent by the target object; Acquire interactive signaling generated by a virtual object corresponding to the target object in an initial virtual scene, wherein the interactive signaling is a control instruction recorded in a time series and corresponding to the command information; Combining the target recorded video and the interactive signaling to generate a recorded course, wherein the recorded course is used to load into a target virtual scene for interaction; The interactive signaling includes second interactive information corresponding to part of the first interactive information in the at least one first interactive information, and combining the target recorded video and the interactive signaling to generate a recorded course includes: Based on the identifiers corresponding to the first interaction information and the second interaction information, the target recorded video and the interaction signaling are combined to generate a recorded course; the second interaction information includes the action information of the virtual object and the three-dimensional coordinate information of the virtual object in the initial virtual scene; Among them, the interactive signaling includes a call signaling, and the interaction performed in the target virtual scene includes: the virtual object executes the action information according to the call signaling, and other virtual objects entering the target virtual scene move to the three-dimensional coordinate information according to the call signaling.

2. The method according to claim 1, characterized in that in, The identifier of the first interactive information includes a time identifier. After obtaining the target recorded video of the target object, the method further includes: Divide the time periods into multiple time periods according to the preset frequency and the total duration of the target recorded video; record the time period of each first interactive information in the at least one first interactive information as the time identifier of the first interactive information; or The at least one first interactive information included in the target recorded video is marked with a time mark in chronological order.

3. The method according to claim 1, characterized in that The target recorded video is at least one recorded video in a complete recorded video.

4. The method according to claim 3, characterized in that The step of combining the target recorded video with the interactive signaling to generate a recorded course includes: If the target recorded video is the current recorded video segment in the complete recorded video segment, the current recorded video segment and the previous recorded video segment are sorted; The sorted multiple recorded videos and the interactive signaling are combined to generate a recorded course.

5. The method according to claim 1, wherein After obtaining the recorded course, the method further includes: updating the recorded course according to the obtained updated target recorded video; and / or, The recorded course is updated according to the obtained updated interactive signaling.

6. The method according to claim 1, characterized in that The interactive signaling includes at least one of a dismissal signaling, a scene switching signaling and a speech signaling.

7. A device for generating recorded courses, characterized in that: include: A first acquisition module is configured to acquire a target recorded video of a target object, wherein the target recorded video includes at least one first interactive information, and the first interactive information includes a password information sent by the target object; A second acquisition module is configured to acquire an interactive signaling generated by a virtual object corresponding to the target object in an initial virtual scene, wherein the interactive signaling is a control instruction recorded in a time series and corresponding to the command information; A generation module, configured to combine the target recorded video and the interactive signaling to generate a recorded course, wherein the recorded course is loaded into a target virtual scene for interaction; The interactive signaling includes second interactive information corresponding to a portion of the first interactive information in the at least one first interactive information, and the generating module is configured to: Based on the identifiers corresponding to the first interaction information and the second interaction information, the target recorded video and the interaction signaling are combined to generate a recorded course; the second interaction information includes the action information of the virtual object and the three-dimensional coordinate information of the virtual object in the initial virtual scene; Among them, the interactive signaling includes a call signaling, and the interaction performed in the target virtual scene includes: the virtual object executes the action information according to the call signaling, and other virtual objects entering the target virtual scene move to the three-dimensional coordinate information according to the call signaling.

8. An electronic device, characterized in that: The electronic device comprises: processor; and Memory for storing programs, The program includes instructions, which, when executed by the processor, enable the processor to execute the recorded course generation method according to any one of claims 1 to 6.

9. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to enable the computer to execute the recorded course generation method according to any one of claims 1 to 6.

Images