Automatic synthesis method of step-by-step answer video

Abstract

The invention relates to a step-by-step answer video automatic synthesis method and a step-by-step answer video automatic synthesis system. Obtaining current question information, N pieces of current step video relation information corresponding to the current question information and a current answer video containing the N pieces of current step video information according to the question consultation request, synthesizing the current question information, the N pieces of current step video relation information and the current answer video into a message, and sending the message to the client; and matching the synthesis analysis results of the four key frames of the historical synthesis video with the message, if the matching succeeds, directly playing the historical synthesis video, otherwise, obtaining N video clips according to the N pieces of current step video information of the current answer video, and playing the N pieces of video clips according to the N pieces of current step video information. And synthesizing the N video clips at the client according to the N pieces of current step video relation information to obtain and play a current synthesized video. Therefore, the resource loss of the server is reduced, and the user experience is optimized while the pressure of the server is relieved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of computer, and in particular to a method and system for automatically synthesizing step-by-step answer videos. BACKGROUND

[0002] Traditional APP customer service systems can support basic intelligent reply functions and provide pre-recorded video answers for specific problems. When the problem is complex, multiple video answers in steps are returned, such as: first step, see video A; second step, see video B; third step, see video C, etc. The way of returning multiple video answers not only has poor user experience, but also has low reply efficiency.

[0003] In order to optimize user experience and improve reply efficiency, two common ways are currently used: 1. Artificially recording complete answer videos including each step corresponding to specific complex problems; 2. Merging video clips of each step into a complete answer video through technical means. Regardless of which way, the complete answer video composed of each step clip is finally returned to the user, which not only needs to occupy more server bandwidth and consume more user traffic, but also consumes computing resources and storage resources, and increases the pressure on the server. SUMMARY

[0004] The technical problem to be solved by the present application is to provide a method and system for automatically synthesizing step-by-step answer videos, which reduces server resource consumption, relieves server pressure, optimizes user experience, and improves reply efficiency.

[0005] In order to solve the above technical problems, the technical scheme adopted by the present application is:

[0006] In a first aspect, the present application provides a method for automatically synthesizing step-by-step answer videos, comprising:

[0007] The server receives a problem consultation request sent by the client, obtains current problem information, N current step video relationship information corresponding to the current problem information, and a current answer video containing N current step video information from the database according to the problem consultation request, and sends the current problem information, N current step video relationship information and the current answer video to the client as a message.

[0008] The client receives the message while obtaining a historical synthetic video, reads four key frames of the historical synthetic video, analyzes a second two-dimensional code of each key frame to obtain all synthetic analysis results containing a historical question ID, a historical step video type and a historical anti-duplicate identifier, matches all synthetic analysis results with the message, and if all the matching is successful, directly plays the historical synthetic video, and the four key frames are a synthetic first frame, a tail frame, a first intermediate frame and a second intermediate frame.

[0009] If the matching is not successful, a historical video segment is obtained, a segment first frame of the historical video segment is read, a first two-dimensional code of the segment first frame is analyzed to obtain a segment analysis result containing a video ID and a video title, the segment analysis result is matched with the message, if the segment analysis result matches the message successfully, the video segment is synthesized according to N current step video relationship information in the client to obtain and play a current synthetic video.

[0010] The application has the beneficial effects that when the server receives the question consultation request of the client, unlike the traditional way of directly returning the complete answer video composed of each step segment to the client, the current question information, N current step video relationship information corresponding to the current question information and the current answer video containing N current step video information are synthesized into a message form and sent to the client, the transmission efficiency is improved, the client uses the identification technology of four key frames, that is, the synthetic first frame, the tail frame, the first intermediate frame and the second intermediate frame to judge whether there is a historical synthetic video, which can realize fast identification and ensure the integrity and accuracy of the identified historical synthetic video, avoid unnecessary repeated video synthesis, realize stream saving and optimize user experience, if the historical synthetic video does not match the message, the video segment is obtained to be synthesized in the client, the server resource loss is reduced and the server pressure is relieved.

[0011] Optionally, the analyzing the second two-dimensional code of each key frame to obtain all synthetic analysis results and matching all synthetic analysis results with the message comprises:

[0012] When the key frame is the synthetic first frame, the second two-dimensional code of the synthetic first frame is analyzed to obtain a first synthetic analysis result containing a historical question ID, a historical step video type and a historical anti-duplicate identifier, in the first synthetic analysis result, the historical step video type is a guide video, and the historical anti-duplicate identifier is a text description corresponding to the first historical step video in the historical synthetic video.

[0013] When the key frame is the tail frame, the second two-dimensional code of the tail frame is parsed to obtain a second synthesis analysis result containing a historical question ID, a historical step video type, and a historical anti-duplication identifier, wherein the historical step video type is a final video, and the historical anti-duplication identifier is a textual description corresponding to all historical step videos in the historical synthesis video and a video ID corresponding to all historical step videos.

[0014] When the key frame is the first intermediate frame, the second two-dimensional code of the first intermediate frame is parsed to obtain a third synthesis analysis result containing a historical question ID, a historical step video type, and a historical anti-duplication identifier, wherein the historical step video type is an intermediate video or a guide video, and the historical anti-duplication identifier is a textual description corresponding to a first historical step video in the historical synthesis video or a video ID corresponding to the first historical step video in the historical synthesis video or a textual description corresponding to a second historical step video in the historical synthesis video.

[0015] When the key frame is the second intermediate frame, the second two-dimensional code of the second intermediate frame is parsed to obtain a fourth synthesis analysis result containing a historical question ID, a historical step video type, and a historical anti-duplication identifier, wherein the historical step video type is an intermediate video or a guide video, and the historical anti-duplication identifier is a textual description corresponding to a second historical step video in the historical synthesis video or a video ID corresponding to the second historical step video in the historical synthesis video or a textual description corresponding to a third historical step video in the historical synthesis video.

[0016] The first synthesis analysis result, the second synthesis analysis result, the third synthesis analysis result, and the fourth synthesis analysis result are matched with the message.

[0017] According to the above description, it can be known that the historical step video type and the historical anti-duplication identifier of the synthesis analysis result of different key frames are different, wherein the historical anti-duplication identifier of the second synthesis analysis result of the key frame being the tail frame is the textual description corresponding to all historical step videos and the video ID corresponding to all historical step videos, which guarantees the integrity and accuracy of the identified historical synthesis video, and the historical step video type and the historical anti-duplication identifier of the third synthesis analysis result and the fourth synthesis analysis result of the key frame being the first intermediate frame and the second intermediate frame have multiple cases, which are diversified and flexible configurations that fit the actual situation of the answer video composed of multiple steps, and further improve the accuracy of the identified historical synthesis video.

[0018] Optionally, the matching the first, second, third and fourth synthetic analysis results with the message comprises:

[0019] In the matching the first synthetic analysis result with the message, the historical problem ID in the first synthetic analysis result is matched with the current problem ID in the current problem information of the message. If the matching is successful, the text description corresponding to the first current step video is obtained from the N current step video relationship information and the N current step video information according to the current problem ID of the message. If the text description corresponding to the first current step video is consistent with the text description corresponding to the first historical step video in the historical synthetic video in the first synthetic analysis result, the first synthetic analysis result is matched with the message successfully. Otherwise, the first synthetic analysis result is not matched with the message successfully.

[0020] In the matching the second synthetic analysis result with the message, the historical problem ID in the second synthetic analysis result is matched with the current problem ID in the current problem information of the message. If the matching is successful, the text description corresponding to each current step video and the video ID corresponding to each current step video are obtained from the N current step video relationship information and the N current step video information according to the current problem ID of the message. If all the text descriptions corresponding to the current step videos and all the video IDs corresponding to the current step videos are consistent with all the text descriptions corresponding to the historical step videos and all the video IDs corresponding to the historical step videos in the historical synthetic video in the second synthetic analysis result, the second synthetic analysis result is matched with the message successfully. Otherwise, the second synthetic analysis result is not matched with the message successfully.

[0021] In the matching of the third synthetic analysis result and the message, the historical problem ID in the third synthetic analysis result is matched with the current problem ID in the current problem information of the message. If the matching is successful, the first historical step video corresponding text description and the first historical step video corresponding video ID and the second historical step video corresponding text description are obtained from the N current step video relationship information and the N current step video information according to the current problem ID of the message. If the first historical step video corresponding text description is consistent with the first historical step video corresponding text description in the historical synthetic video in the third synthetic analysis result, or if the first current step video corresponding video ID is consistent with the first historical step video corresponding video ID in the historical synthetic video in the third synthetic analysis result, or if the second current step video corresponding text description is consistent with the second historical step video corresponding text description in the historical synthetic video in the third synthetic analysis result, the third synthetic analysis result is matched with the message. Otherwise, the third synthetic analysis result is not matched with the message.

[0022] In the matching of the fourth synthetic analysis result and the message, the historical problem ID in the fourth synthetic analysis result is matched with the current problem ID in the current problem information of the message. If the matching is successful, the second current step video corresponding text description and the second current step video corresponding video ID and the third current step video corresponding text description are obtained from the N current step video relationship information and the N current step video information according to the current problem ID of the message. If the second current step video corresponding text description is consistent with the second historical step video corresponding text description in the historical synthetic video in the fourth synthetic analysis result, or if the second current step video corresponding video ID is consistent with the second historical step video corresponding video ID in the historical synthetic video in the fourth synthetic analysis result, or if the third current step video corresponding text description is consistent with the third historical step video corresponding text description in the historical synthetic video in the fourth synthetic analysis result, the fourth synthetic analysis result is matched with the message. Otherwise, the fourth synthetic analysis result is not matched with the message.

[0023] According to the above description, in the matching of the first synthetic analysis result, the second synthetic analysis result, the third synthetic analysis result and the fourth synthetic analysis result and the message, different synthetic analysis results have exclusive matching methods, and the matching of the historical problem ID and the current problem ID is preferentially performed. Further judgment is performed only when the matching is successful, which improves the identification accuracy and efficiency and realizes stream saving.

[0024] Optionally, if the matching is unsuccessful, N video clips are obtained according to N current step video information of the current answer video, and the N video clips are synthesized at the client according to N current step video relationship information.

[0025] If the matching is unsuccessful, a historical video clip is obtained, a first frame of the historical video clip is read, a first two-dimensional code of the first frame is analyzed, and a clip analysis result containing a video ID and a video title is obtained.

[0026] The video ID and the video title corresponding to all current step videos are obtained from N current step video relationship information and N current step video information.

[0027] The clip analysis result is matched with the message, and it is determined whether the video ID and the video title in the clip analysis result contain the video ID and the video title corresponding to all current step videos. If yes, the clip analysis result is matched with the message, the historical video clip is synthesized at the client according to N current step video relationship information, and if no, the clip analysis result is matched with the message, P video IDs and P video titles corresponding to P current step videos that are not contained in the clip analysis result are obtained, P video clip links are obtained from the current answer video according to the P video IDs and the P video titles corresponding to the P current step videos, P current video clips are downloaded from the Internet according to the P video clip links, and the P current video clips and N-P historical video clips are synthesized at the client according to N current step video relationship information.

[0028] According to the above description, when the video clips are synthesized, the historical video clips are obtained first, the analysis result of the historical video clips is matched with the message, and it is determined whether the historical video clips have been downloaded before. If all the historical video clips have been downloaded, the historical video clips downloaded before are directly used to synthesize the current synthesis video, so as to avoid repeated downloading, save flow, and improve synthesis efficiency. If the historical video clips have not been downloaded before or not all the historical video clips have been downloaded, corresponding clip links are directly obtained from the current answer video of the message for downloading, so as to obtain the current video clips and realize synthesis of the current synthesis video, ensure integrity of the current synthesis video, and optimize user experience.

[0029] Optionally, the N video clips are synthesized at the client according to N current step video relationship information.

[0030] acquire a history guide video, read a guide first frame of the history guide video, acquire a guide analysis result containing a current step serial number and a current step text description by analyzing a third two-dimensional code of the guide first frame;

[0031] acquire a current step serial number corresponding to all current step videos and a current step text description corresponding to all current step videos from N current step video relationship information and N current step video information;

[0032] match the guide analysis result with the message, determine whether the current step serial number and the current step text description in the guide analysis result contain the current step serial number corresponding to all current step videos and the current step text description corresponding to all current step videos, if yes, the guide analysis result is successfully matched with the message, and video segments under the current step serial number are synthesized with the history guide video according to N current step video relationship information in the client according to N current step video information of the current answer video, if no, the guide analysis result is unsuccessfully matched with the message, acquire L current step video information corresponding to L current step videos not contained in the guide analysis result from N current step video information of the current answer video, acquire L current guide videos corresponding to L current step video information according to L current step video information, and synthesize L current guide videos and N-L history guide videos with the video segments according to N current step video relationship information in the client.

[0033] According to the above description, it can be known that the guide analysis result of the history guide video is matched with the message, if all are successfully matched, it is indicated that the history guide video is downloaded before, the history guide video is directly synthesized with the history video segment, and repeated downloading is not needed, stream saving is realized, if not all are unsuccessfully matched, it is indicated that the history guide video is not downloaded before or not completely downloaded, current guide videos are downloaded, the current guide videos, the history guide video and the video segments are synthesized, the current synthesized video includes complete video segments and complete guide videos, the integrity of the current synthesized video is ensured, and user experience is optimized.

[0034] Optionally, the acquiring L current guide videos corresponding to the L current step video information comprises:

[0035] acquiring a background picture link, a video size and a current step text description corresponding to L current step videos from L current step video information;

[0036] According to the background picture link corresponding to the L current step videos, the corresponding background pictures are downloaded from the Internet to obtain L background pictures, and the L background pictures are adjusted according to the corresponding video size to obtain L adjusted background pictures, the L adjusted background pictures are taken as the guide pictures of the corresponding current step videos to obtain L guide pictures;

[0037] The L current step texts are converted into L step audios by the TTS engine to obtain L step audios;

[0038] Each guide picture and the corresponding step audio are synthesized by FFmpeg to obtain L current guide videos.

[0039] According to the above description, it can be known that the current step video information contains the background picture link, the video size and the current step text of the current step video, so as to obtain the guide picture and the step audio, realize the synthesis of the current guide video, and ensure the accuracy of the synthesized current guide video.

[0040] Optionally, the synthesizing of the L current guide videos, the N-L historical guide videos and the video clip according to the N current step video relationship information on the client comprises:

[0041] The current step serial number of each current step video is obtained from the N current step video relationship information, the video size of the current step video with the current step serial number 1 is taken as a reference size, and the L current guide videos, the N-L historical guide videos and the video clip are adjusted according to the reference size to obtain the adjusted L current guide videos, the adjusted N-L historical guide videos and the adjusted video clip;

[0042] The adjusted L current guide videos, the adjusted N-L historical guide videos and the adjusted video clip are synthesized on the client according to the current step serial number.

[0043] According to the above description, when the current guide video, the historical guide video and the video clip are synthesized, the video size of the current step video with the current step serial number 1 is taken as a reference size, so as to adjust the video size of the current guide video, the historical guide video and the video clip, ensure that the synthesized current synthesis video does not have the problem of non-uniform video size, ensure the quality of the current synthesis video, and optimize the user experience.

[0044] Optionally, the synthesizing of the adjusted L current guide videos, the adjusted N-L historical guide videos and the adjusted video clip on the client according to the current step serial number comprises:

[0045] The third two-dimensional code is positioned on the L current guide videos and the adjusted N-L historical guide videos respectively by using the quirc filter of FFmpeg, and the first two-dimensional code is positioned on the adjusted video segment, so as to obtain the position of the third two-dimensional code and the position of the first two-dimensional code;

[0046] The delogo filter is used to remove the two-dimensional code from the adjusted L current guide videos, the adjusted N-L historical guide videos and the adjusted video segment according to the position of the third two-dimensional code and the position of the first two-dimensional code, so as to obtain the removed L current guide videos, the removed N-L historical guide videos and the removed video segment;

[0047] The video ID, the video title and the current step text description are obtained from the N current step video information of the current answer video, the new first two-dimensional code is generated according to the video ID and the video title, the new third two-dimensional code is generated according to the current step text description and the current step serial number, the new first two-dimensional code is added to the removed video segment according to the position of the first two-dimensional code, and the new third two-dimensional code is added to the removed L current guide videos and the removed N-L historical guide videos according to the position of the third two-dimensional code, so as to obtain the added video segment, the added L current guide videos and the added N-L historical guide videos;

[0048] The added video segment, the added L current guide videos and the added N-L historical guide videos are synthesized on the client according to the current step serial number.

[0049] According to the above description, the two-dimensional code is removed from the current guide videos, the historical guide videos and the video segment, and then the new two-dimensional code is generated and added according to the exclusive two-dimensional code generation mode, so that the current guide videos, the historical guide videos and the video segment after adding the new two-dimensional code are finally synthesized, the effectiveness of the generated current synthesis video is ensured, and a basis is provided for subsequent anti-duplication.

[0050] In a second aspect, the present application provides an automatic synthesis system of a step-by-step answer video, which comprises a memory, a processor and a computer program stored in the memory and executable on the processor, and the processor implements the automatic synthesis method of the step-by-step answer video according to the first aspect when executing the computer program.

[0051] The technical effects of the automatic synthesis system of the step-by-step answer video provided in the second aspect are referred to the automatic synthesis method of the step-by-step answer video provided in the first aspect. BRIEF DESCRIPTION OF DRAWINGS

[0052] Figure 1A flow chart of a method for automatic synthesis of a step-by-step answer video provided in the embodiment;

[0053] Figure 2 A schematic diagram of the overall flow of a method for automatic synthesis of a step-by-step answer video provided in the embodiment;

[0054] Figure 3 A schematic diagram of the structure of a system for automatic synthesis of a step-by-step answer video provided in the embodiment.

[0055] [Explanation of reference signs]

[0056] 1. A system for automatic synthesis of a step-by-step answer video;

[0057] 2. A processor;

[0058] 3. A memory. DETAILED DESCRIPTION

[0059] In order to better understand the above technical solutions, exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that the present application can be more clearly, thoroughly understood, and the scope of the present application can be fully conveyed to those skilled in the art.

[0060] Embodiment 1

[0061] Please refer to Figures 1 to 2 The present application provides a multi-modal image segmentation method, comprising the steps of:

[0062] S1, the server receives the question consultation request sent by the client, acquires the current problem information, N current step video relationship information corresponding to the current problem information and current answer video containing N current step video information from the database according to the question consultation request, and sends the current problem information, N current step video relationship information and current answer video to the client as a message;

[0063] In the embodiment, the administrator pre-uploads the recorded video segments and fills in the information of the video segments, including but not limited to: video title, video content, video link, etc., to the database as a video record, and at the same time of saving to the database, the video ID, creation time of the video segment, and the video size including video width and video length and video duration automatically obtained from the metadata of the video segment are generated and saved to the video record. For the recorded video segment, the administrator also marks a first two-dimensional code in the lower right corner of the video segment, which is composed of the video ID and the video title. When the administrator adds a complex question in the customer service management platform, the administrator fills in the question ID, question name, keyword list, and generates a reply video step list according to the order of answering the question by selecting from the video record in the database. Each reply step fills in the current step text description, current step serial number, background picture link, video size, etc. of the current step video, establishes complete current step video relationship information for answering the question and the current answer video containing the current step video information. At the same time, the administrator also uploads the corresponding guide video of the video segment. The guide video also marks a third two-dimensional code in the lower right corner, which is composed of the current step serial number and the current step text description, and inserts a wildcard in the current step text description, so as to return personalized current step text description to different users.

[0064] When the user consults a question in the APP customer service interface of the client, the question classification is listed first to guide the user to select the question point that best meets his own needs, so as to generate a question consultation request according to the question point and send it to the server.

[0065] As shown in Figure 2 , the server receives the question consultation request sent by the client, obtains the current question information, N current step video relationship information corresponding to the current question information, and the current answer video containing N current step video information from the database according to the question consultation request, and encapsulates the current question information, N current step video relationship information and the current answer video in a JSON message, that is, a message is generated and sent to the client.

[0066] In a specific embodiment, the specific message is as follows:

[0067]

[0068]

[0069] S2, the client receives the message at the same time to obtain the historical synthesis video, reads four key frames of the historical synthesis video, analyzes the second two-dimensional code of each key frame, obtains all synthesis analysis results containing historical problem ID, historical step video type and historical anti-duplicate identifier, matches all synthesis analysis results with the message, if all are matched successfully, directly plays the historical synthesis video, the four key frames are: synthesis first frame, tail frame, first intermediate frame and second intermediate frame;

[0070] In the embodiment, as shown in Figure 2 the client receives the message at the same time to obtain the historical synthesis video, the historical synthesis video is the local historical synthesis video of the client, it should be pointed out that when the client synthesizes the video locally, the synthesized synthesis video is marked with the second two-dimensional code, the second two-dimensional code is composed of problem ID, video type and anti-duplicate identifier, wherein the video type includes: guide video, intermediate video and end video, the anti-duplicate identifier is different according to different video types, which will be described in subsequent steps. Read four key frames of the historical synthesis video, that is, read synthesis first frame, tail frame, first intermediate frame and second intermediate frame of the historical synthesis video, analyze the second two-dimensional code of each key frame, obtain all synthesis analysis results containing historical problem ID, historical step video type and historical anti-duplicate identifier, match all synthesis analysis results with the message, if all are matched successfully, it is explained that the answer video of the same problem consultation request has been synthesized before, so the historical synthesis video is directly played.

[0071] At this time, the analysis of the second two-dimensional code of each key frame in step S2 to obtain all synthesis analysis results, and matching all synthesis analysis results with the message include:

[0072] S21, when the key frame is the synthesis first frame, the second two-dimensional code of the synthesis first frame is analyzed to obtain the first synthesis analysis result containing historical problem ID, historical step video type and historical anti-duplicate identifier, in the first synthesis analysis result, the historical step video type is guide video, and the historical anti-duplicate identifier is the text description corresponding to the first historical step video in the historical synthesis video;

[0073] S22, when the key frame is the tail frame, the second two-dimensional code of the tail frame is analyzed to obtain the second synthesis analysis result containing historical problem ID, historical step video type and historical anti-duplicate identifier, in the second synthesis analysis result, the historical step video type is end video, and the historical anti-duplicate identifier is the text description corresponding to all historical step videos in the historical synthesis video and the video ID corresponding to all historical step videos;

[0074] S23, when the key frame is a first intermediate frame, a second two-dimensional code of the first intermediate frame is parsed to obtain a third synthesis analysis result containing a historical problem ID, a historical step video type and a historical anti-duplication identifier, in the third synthesis analysis result, the historical step video type is an intermediate video or a guide video, and the historical anti-duplication identifier is a textual description corresponding to a first historical step video in the historical synthesis video or a video ID corresponding to the first historical step video in the historical synthesis video or a textual description corresponding to a second historical step video in the historical synthesis video;

[0075] S24, when the key frame is a second intermediate frame, a second two-dimensional code of the second intermediate frame is parsed to obtain a fourth synthesis analysis result containing a historical problem ID, a historical step video type and a historical anti-duplication identifier, in the fourth synthesis analysis result, the historical step video type is an intermediate video or a guide video, and the historical anti-duplication identifier is a textual description corresponding to a second historical step video in the historical synthesis video or a video ID corresponding to the second historical step video in the historical synthesis video or a textual description corresponding to a third historical step video in the historical synthesis video;

[0076] S25, the first synthesis analysis result, the second synthesis analysis result, the third synthesis analysis result and the fourth synthesis analysis result are matched with the message.

[0077] In the embodiment, when the key frame is the first frame of synthesis, in the first synthesis analysis result obtained by the key frame, the historical step video type is a guide video, and the historical anti-duplication identifier is the text description corresponding to the first historical step video, that is, the current step text description of the current step video. Therefore, when the historical step video type is a guide video, the anti-duplication identifier is generated according to the text description corresponding to the first historical step video. When the key frame is the last frame, in the second synthesis analysis result obtained by the key frame, the historical step video type is an end video, and the historical anti-duplication identifier is the text description corresponding to all historical step videos and the video ID corresponding to all historical step videos, that is, the current step text description of all current step videos and the video ID of all current step videos, that is, the video ID of the video clip. Therefore, when the historical step video type is an end video, the anti-duplication identifier is generated according to the text description corresponding to all historical step videos and the video ID corresponding to all historical step videos. In fact, when N is less than or equal to 2, that is, the current answer video obtained by the message is composed of less than or equal to 2 current step video information, there is no need to obtain and analyze the first intermediate frame and the second intermediate frame. The following is a description of the case where N is greater than 2.

[0078] When the key frame is the first intermediate frame, in the third synthesis analysis result obtained by the key frame, the historical step video type can be an intermediate video or a guide video. The first intermediate frame is the frame at the Xth second, and the value of X is obtained by adding 1 to the video duration of the first current step video in the current answer video in the message, that is, the current step video with the current step number 1. It is considered that when the length of the text description of the first current step video is greater than the video duration thereof, the length of the text voice / step voice converted according to the text description exceeds the value of X. Therefore, the historical anti-duplication identifier is generated according to the text description of the first current step video, that is, the text description corresponding to the first historical step video in the historical synthesis video. When the length of the text description of the first current step video is less than the video duration thereof, the length of the text voice / step voice converted according to the text description can not exceed the value of X. Therefore, the historical anti-duplication identifier is generated according to the video ID of the first current step video, that is, the video ID corresponding to the first historical step video in the historical synthesis video. It can also be that the historical anti-duplication identifier is generated according to the text description of the second current step video, that is, the text description corresponding to the second historical step video in the historical synthesis video.

[0079] When the key frame is the second intermediate frame, in the fourth synthetic analysis result obtained by the key frame, the history step video type can be an intermediate video or a guide video, the second intermediate frame is a frame at Y seconds, and Y is obtained according to the video duration of the first current step video and the video duration of the second current step video in the current answer video in the message, that is, the video duration of the current step video with a current step number of 1 is added to the video duration of the current step video with a current step number of 2, and considering that when the text description length of the first current step video is greater than the video duration thereof or the text description length of the second current step video is greater than the video duration thereof, the sum of the text voice / step voice converted according to them and the video length of the first current step video will exceed the value of Y, therefore, the history anti-duplicate identifier at this time is generated according to the text description of the second current step video, that is, the text description corresponding to the second history step video in the history synthetic video; when the sum of the text voice / step voice converted according to them and the video length of the first current step video will not exceed the value of Y, the history anti-duplicate identifier at this time is generated according to the video ID of the second current step video, that is, the video ID corresponding to the second history step video in the history synthetic video, or according to the text description of the third current step video, that is, the text description corresponding to the third history step video in the history synthetic video.

[0080] At this time, step S25 includes:

[0081] S251, when matching the first synthetic analysis result with the message, matching the history problem ID in the first synthetic analysis result with the current problem ID in the current problem information of the message, if the matching is successful, obtaining the text description corresponding to the first current step video from the N current step video relationship information and the N current step video information according to the current problem ID of the message, if the text description corresponding to the first current step video is consistent with the text description corresponding to the first history step video in the history synthetic video in the first synthetic analysis result, the first synthetic analysis result matches the message successfully, otherwise, the first synthetic analysis result does not match the message successfully;

[0082] S252, in matching the second synthesis analysis result with the message, matching the historical problem ID in the second synthesis analysis result with the current problem ID in the current problem information of the message, if matching succeeds, according to the current problem ID of the message, obtaining the text description corresponding to each current step video and the video ID corresponding to each current step video from the N current step video relationship information and the N current step video information, if all the text descriptions corresponding to the current step video and all the video IDs corresponding to the current step video are consistent with all the text descriptions corresponding to the historical step video and all the video IDs corresponding to the historical step video in the historical synthesis video in the second synthesis analysis result, the second synthesis analysis result is matched with the message successfully, otherwise, the second synthesis analysis result is not matched with the message successfully;

[0083] S253, in matching the third synthesis analysis result with the message, matching the historical problem ID in the third synthesis analysis result with the current problem ID in the current problem information of the message, if matching succeeds, according to the current problem ID of the message, obtaining the text description corresponding to the first historical step video and the video ID corresponding to the first historical step video and the text description corresponding to the second historical step video from the N current step video relationship information and the N current step video information, if the text description corresponding to the first historical step video is consistent with the text description corresponding to the first historical step video in the historical synthesis video in the third synthesis analysis result, or, if the video ID corresponding to the first current step video is consistent with the video ID corresponding to the first historical step video in the historical synthesis video in the third synthesis analysis result, or, if the text description corresponding to the second current step video is consistent with the text description corresponding to the second historical step video in the historical synthesis video in the third synthesis analysis result, the third synthesis analysis result is matched with the message successfully, otherwise, the third synthesis analysis result is not matched with the message successfully;

[0084] S254. When matching the fourth composite parsing result with the message, the historical problem ID in the fourth composite parsing result is matched with the current problem ID in the current problem information of the message. If the match is successful, the text description corresponding to the second current step video, the video ID corresponding to the second current step video, and the text description corresponding to the third current step video are obtained from the N current step video relationship information and the N current step video information according to the current problem ID of the message. If the text description corresponding to the second current step video is consistent with the text description corresponding to the second historical step video in the historical composite video in the fourth composite parsing result, or if the video ID corresponding to the second current step video is consistent with the video ID corresponding to the second historical step video in the historical composite video in the fourth composite parsing result, or if the text description corresponding to the third current step video is consistent with the text description corresponding to the third historical step video in the historical composite video in the fourth composite parsing result, then the fourth composite parsing result matches the message successfully; otherwise, the fourth composite parsing result does not match the message successfully.

[0085] As described above, when matching the first, second, third, and fourth composite parsing results with the message, the first composite parsing result is prioritized. If the historical issue ID in the first composite parsing result does not match the current issue ID in the message's current issue information, the next historical composite video is directly retrieved. Only when the historical issue ID in the first composite parsing result matches the current issue ID in the message's current issue information will the second composite parsing result be matched with the message. Similarly, if the second composite parsing result fails to match the message, the next historical composite video is directly retrieved. Only when all historical steps in the second composite parsing result match... The text description corresponding to the step video and the video ID corresponding to all historical step videos must match the text description corresponding to the current step video and the video ID corresponding to all current step videos in the message. That is, the third synthesis parsing result will be matched with the message only when the match is successful. Moreover, when matching the third synthesis parsing result with the message, multiple cases of the third synthesis parsing result are taken into account. Similarly, if the third synthesis parsing result does not match the message, the next historical synthesis video is directly obtained. The fourth synthesis parsing result will be matched with the message only when the third synthesis parsing result matches the message successfully. Moreover, when matching the fourth synthesis parsing result with the message, multiple cases of the fourth synthesis parsing result are taken into account.

[0086] S3, if the matching is unsuccessful, obtaining N video clips according to N current step video information of the current answer video, synthesizing the N video clips according to N current step video relationship information in the client to obtain and play a current synthesis video.

[0087] In the embodiment, as shown in Figure 2 If the historical synthesis video does not match the message, i.e., the current synthesis video has not been synthesized before, N video clips are downloaded from the Internet according to corresponding video links in N current step video information of the current answer video, the N video clips are synthesized according to N current step video relationship information in the client to obtain and play a current synthesis video.

[0088] At this time, if the matching is unsuccessful in step S3, N video clips are obtained according to N current step video information of the current answer video, and the N video clips are synthesized according to N current step video relationship information.

[0089] S31, if the matching is unsuccessful, obtaining a historical video clip, reading a clip first frame of the historical video clip, and obtaining a clip analysis result containing a video ID and a video title by analyzing a first two-dimensional code of the clip first frame;

[0090] S32, obtaining video IDs corresponding to all current step videos and video titles corresponding to all current step videos from N current step video relationship information and N current step video information;

[0091] S33, matching the clip analysis result with the message to determine whether the video IDs and the video titles in the clip analysis result contain video IDs corresponding to all current step videos and video titles corresponding to all current step videos, if yes, the clip analysis result matches the message, and the historical video clip is synthesized according to N current step video relationship information in the client, if no, the clip analysis result does not match the message, obtaining video IDs corresponding to P current step videos and video titles corresponding to P current step videos that are not contained in the clip analysis result, obtaining P video clip links from the current answer video according to the video IDs corresponding to P current step videos and the video titles corresponding to P current step videos, downloading corresponding P current video clips from the Internet according to the P video clip links, and synthesizing the P current video clips and N-P historical video clips according to N current step video relationship information in the client.

[0092] In the embodiment, as shown in Figure 2As shown, the historical video clip is acquired, i.e., the historical video clip locally at the client, the first frame of the clip of the historical video clip is read, the first two-dimensional code of the first frame of the clip is parsed, a clip parsing result containing a video ID and a video title is obtained, the video IDs corresponding to all the current step videos and the video titles corresponding to all the current step videos are acquired from the N current step video relationship information and the N current step video information of the message, the clip parsing result is matched with the message, it is judged whether the video IDs and the video titles in the clip parsing result contain the video IDs corresponding to all the current step videos and the video titles corresponding to all the current step videos, if yes, it is indicated that the video clip required by the current answer video corresponding to the current question inquiry request has been downloaded before, the historical video clip can be directly synthesized according to the N current step video relationship information, otherwise, if the video IDs corresponding to all the current step videos and the video titles corresponding to all the current step videos are not contained in the clip parsing result, the corresponding video clip needs to be acquired, the video IDs corresponding to P current step videos not contained in the clip parsing result and the video titles corresponding to the P current step videos are acquired, the P video clip links are acquired from the current answer video according to the video IDs corresponding to the P current step videos and the video titles corresponding to the P current step videos, the corresponding P current video clips are downloaded from the Internet according to the P video clip links, and the P current video clips and N-P historical video clips are synthesized according to the N current step video relationship information, at this time, P can be equal to N.

[0093] At this time, the synthesis of the N video clips according to the N current step video relationship information in step S3 includes:

[0094] S34, a historical guide video is acquired, a guide first frame of the historical guide video is read, a guide parsing result containing a current step serial number and a current step text description is obtained by parsing a third two-dimensional code of the guide first frame;

[0095] S35, the current step serial numbers corresponding to all the current step videos and the current step text descriptions corresponding to all the current step videos are acquired from the N current step video relationship information and the N current step video information;

[0096] S36, match the guide analysis result with the message, judge whether the current step serial number and the current step text description in the guide analysis result contain all the current step serial numbers corresponding to all the current step videos and all the current step text descriptions corresponding to all the current step videos, if yes, the guide analysis result matches the message successfully, according to the N current step video information of the current answer video, the video segment under the current step serial number and the historical guide video are synthesized in the client according to the N current step video relationship information, if not, the guide analysis result does not match the message successfully, from the N current step video information of the current answer video, L current step video information corresponding to L current step videos not contained in the guide analysis result is obtained, according to the L current step video information, L current guide videos corresponding to the L current step video information are obtained, and the L current guide videos and N-L historical guide videos are synthesized with the video segment according to the N current step video relationship information in the client.

[0097] In the embodiment, as shown in Figure 2 the guide first frame of the historical guide video is read, the third two-dimensional code of the guide first frame is analyzed to obtain the guide analysis result containing the current step serial number and the current step text description, all the current step serial numbers corresponding to all the current step videos and all the current step text descriptions corresponding to all the current step videos are obtained from the N current step video relationship information of the message and the N current step video information of the current answer video, the guide analysis result is matched with the message, if the current step serial number and the current step text description in the guide analysis result contain all the current step serial numbers corresponding to all the current step videos and all the current step text descriptions corresponding to all the current step videos, it is indicated that the client has downloaded all the guide videos required by the current answer video of the problem consultation request before, therefore, according to the N current step video information of the current answer video, the video segment under the current step serial number and the corresponding historical guide video are synthesized according to the N current step video relationship information, if the current step serial number and the current step text description in the guide analysis result do not contain all the current step serial numbers corresponding to all the current step videos and all the current step text descriptions corresponding to all the current step videos, it is indicated that the client has not downloaded or has not completely downloaded the guide video before, therefore, from the N current step video information of the current answer video, L current step video information corresponding to L current step videos not contained in the guide analysis result is obtained, according to the L current step video information, L current guide videos corresponding to the L current step video information are obtained, and the L current guide videos and N-L historical guide videos are synthesized with the video segment according to the N current step video relationship information, at this time, L may be equal to N.

[0098] At this time, the L current guide videos corresponding to the L current step video information obtained in step S36 include:

[0099] S361, obtaining the background picture link, video size and current step text description corresponding to the L current step videos from the L current step video information;

[0100] S362, downloading the corresponding background pictures from the Internet according to the background picture links corresponding to the L current step videos to obtain L background pictures, adjusting the L background pictures according to the corresponding video sizes to obtain L adjusted background pictures, taking the L adjusted background pictures as the guide pictures of the corresponding current step videos to obtain L guide pictures;

[0101] S363, converting the current step text description corresponding to the L current step videos into L step audios through a TTS engine to obtain L step audios;

[0102] S364, synthesizing each guide picture with the corresponding step audio through FFmpeg to obtain L current guide videos.

[0103] In the embodiment, the background picture link, video size and current step text description corresponding to the L current step videos are obtained from the L current step videos, the corresponding background pictures are downloaded from the Internet according to the background picture links to obtain L background pictures, the L background pictures are adjusted according to the corresponding video sizes, that is, the generated guide videos and the corresponding video segments / current step videos are the same video size, the L adjusted background pictures are taken as the guide pictures of the corresponding high current step videos to obtain L guide pictures, the current step text description corresponding to the L current step videos is converted into L step audios through a TTS engine to obtain L step audios, and each guide picture is synthesized with the corresponding step audio through FFmpeg to obtain L current guide videos.

[0104] At this time, the L current guide videos and N-L historical guide videos and the video segment are synthesized according to N current step video relationship information in the client in step S36.

[0105] S365, obtaining the current step serial number of each current step video from N current step video relationship information, taking the video size of the current step video with the current step serial number 1 as a reference size, and adjusting the L current guide videos, N-L historical guide videos and video segment according to the reference size to obtain adjusted L current guide videos, adjusted N-L historical guide videos and adjusted video segment;

[0106] S366. According to the current step number, the adjusted L current guide videos, the adjusted NL historical guide videos, and the adjusted video clips are synthesized on the client.

[0107] In this embodiment, the video size of the current step video with current step number 1 is used as the reference size. The L current wizard videos, NL historical wizard videos and video segments are adjusted according to the reference size so that all current wizard videos, all historical wizard videos and video segments have the same video size. Then, the adjusted L current wizard videos, the adjusted NL historical wizard videos and the adjusted video segments are combined.

[0108] At this point, step S366 includes:

[0109] S3661. Using FFmpeg's quirc filter, locate the third QR code for L current guide videos and NL adjusted historical guide videos respectively, and locate the first QR code for the adjusted video segments to obtain the corresponding third QR code position and first QR code position.

[0110] S3662. Based on the positions of the third QR code and the first QR code, the delogo filter is used to remove the QR codes from the adjusted L current guide videos, the adjusted NL historical guide videos, and the adjusted video segments, respectively, to obtain the removed L current guide videos, the removed NL historical guide videos, and the removed video segments.

[0111] S3663. Obtain the video ID, video title, and current step text description from the N current step video information of the current answer video. Generate a new first QR code based on the video ID and video title. Generate a new third QR code based on the current step text description and the current step number. Add the new first QR code to the cleared video segment according to the position of the first QR code. At the same time, add the new third QR code to the L cleared current guide videos and NL cleared historical guide videos according to the position of the third QR code. This results in the added video segment, the added L current guide videos, and the added NL historical guide videos.

[0112] S3664. According to the current step number, the added video clips, the L current guide videos, and the NL historical guide videos are combined on the client.

[0113] In the embodiment, the third QR code is positioned on the L current guide videos and the adjusted N-L historical guide videos respectively by the quirc filter of FFmpeg, the first QR code is positioned on the adjusted video segment, the position of the third QR code and the position of the first QR code are obtained, the QR code is cleared according to the position of the third QR code and the position of the first QR code, the video ID, the video title and the current step text description are obtained from the N current step video information of the current answer video, the new first QR code is generated according to the video ID and the video title, the new third QR code is generated according to the current step text description and the current step serial number, the new first QR code and the new third QR code are re-added to the corresponding video segment, and the new third QR code is re-added to the L current guide videos and the N-L historical guide videos after clearing according to the position of the third QR code, and the added video segment, the L current guide videos and the N-L historical guide videos after clearing are synthesized on the client.

[0114] Embodiment two

[0115] Please refer to Figure 3 The application provides an automatic synthesis system 1 of a step-by-step answer video, comprising a memory 3, a processor 2, and a computer program stored on the memory 3 and capable of running on the processor 2, wherein the processor 2 implements the steps in embodiment one when executing the computer program.

[0116] Since the system / device for implementing the method of the above-mentioned embodiments of the application is described in the above-mentioned embodiments of the application, the specific structure and modifications of the system / device can be understood by those skilled in the art based on the method described in the above-mentioned embodiments of the application, and thus will not be described here. Any system / device used in the method of the above-mentioned embodiments of the application belongs to the scope of the application.

[0117] Those skilled in the art should understand that the embodiments of the application can be provided as a method, a system or a computer program product. Therefore, the application can be in the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the application can be in the form of a computer program product implemented on one or more computer usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer usable program code.

[0118] The application is described with reference to flowcharts and / or block diagrams of the method, device (system) and computer program product according to the embodiments of the application. It should be understood that each flow and / or block in the flowcharts and / or block diagrams, and the combination of the flows and / or blocks in the flowcharts and / or block diagrams can be implemented by computer program instructions.

[0119] It should be noted that the description using "comprises" or "comprising" etc. does not exclude the presence of elements or steps other than those listed in a claim. The words "a" or "an" preceding the disclosure of a plurality of elements or steps do not exclude the presence of more than one of them; further more, the use of the word "at least" preceding the disclosure of a feature in the description or claim does not exclude the presence of additional such features. It should further be noted that the disclosure of specific embodiments of the present application does not restrict the application of the specific combinations of features to these embodiments but that on the contrary, the specific combinations of features are applicable to each independent embodiments and embodiments where such features occur separately. The word "comprising" does not exclude the presence of elements or steps other than those listed in a claim. The word "a" or "an" preceding the disclosure of a plurality of elements or steps does not exclude the presence of more than one of them; further more, the use of the word at least preceding the disclosure of a feature in the description or claim does not exclude the presence of additional such features. It should be noted that the use of the term "preferably", "particularly", "having preferably", "preferably comprising", "particularly having" or "having particularly" preceding a feature in the description or claims does not exclude the presence of additional such features or the use of the feature in other embodiments. Although embodiments of the application have been described in the preceding detailed description, embodiments of the application are not limited to the embodiments disclosed herein. Many modifications and variations of the embodiments described herein will occur to those skilled in the art. For example, the features of the various embodiments can be combined, substituted, or deleted for other features or techniques disclosed herein. Accordingly, it is therefore intended that the application be covered by all of the following claims as reasonably encompassed within the scope of the application.

[0120] Furthermore, it is noted that the specific features, structures, materials or characteristics can be combined in any suitable manner in the present application without necessarily being limited to the combinations explicitly described herein. It will thus be appreciated that those features, structures, materials or characteristics that have previously been described and that are still known in the art can also be used, regardless of whether they have been explicitly described herein or in combination with other features, structures, materials or characteristics. Although embodiments of the application have been described in the preceding detailed description, embodiments of the application are not limited to the embodiments disclosed herein. Many modifications and variations of the embodiments described herein will occur to those skilled in the art. For example, the features of the various embodiments can be combined, substituted, or deleted for other features or techniques disclosed herein. Accordingly, it is therefore intended that the application be covered by all of the following claims as reasonably encompassed within the scope of the application.

[0121] Although preferred embodiments of the application have been described in the preceding detailed description, further modifications and improvements will occur to skilled persons that are not described in detail. The foregoing descriptions are intended to be illustrative and not restrictive. Changes can be made to the application without departing from the broad principles of the application. The scope of the application should, therefore, be determined not with reference to the description nor the drawings, but should be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.

[0122] Obviously, many modifications and variations of the present application are possible in light of the above teachings. It is therefore to be understood that within the scope of the application, the application can be practiced otherwise than as specifically described. Since modifications and variations of the application can be made without departing from its spirit and scope, it is intended that all such modifications and variations come within the scope of the claims and equivalence thereof.

Claims

1. A method for automatic synthesis of a step-by-step answer video, characterized in that, The method comprises the following steps: The server receives a question consultation request sent by a client, acquires current question information, N current step video relationship information corresponding to the current question information and a current answer video containing N current step video information from a database according to the question consultation request, and sends the current question information, N current step video relationship information and the current answer video to the client as a message; The client receives the message and acquires a historical synthesis video at the same time, reads four key frames of the historical synthesis video, analyzes a second two-dimensional code of each key frame to obtain all synthesis analysis results containing a historical question ID, a historical step video type and a historical anti-duplicate identifier, matches all synthesis analysis results with the message, and directly plays the historical synthesis video if all the matching is successful, wherein the four key frames are a synthesis first frame, a tail frame, a first intermediate frame and a second intermediate frame; If the matching is unsuccessful, N video clips are acquired according to N current step video information of the current answer video, and N video clips are synthesized on the client according to N current step video relationship information to obtain and play a current synthesis video.

2. The method for automatic synthesis of a step-by-step answer video of claim 1, wherein, The method of analyzing the second two-dimensional code of each key frame to obtain all synthesis analysis results and matching all synthesis analysis results with the message comprises the following steps: When the key frame is the synthesis first frame, the second two-dimensional code of the synthesis first frame is analyzed to obtain a first synthesis analysis result containing a historical question ID, a historical step video type and a historical anti-duplicate identifier, wherein in the first synthesis analysis result, the historical step video type is a guide video, and the historical anti-duplicate identifier is a textual description corresponding to a first historical step video in the historical synthesis video; When the key frame is the tail frame, the second two-dimensional code of the tail frame is analyzed to obtain a second synthesis analysis result containing a historical question ID, a historical step video type and a historical anti-duplicate identifier, wherein in the second synthesis analysis result, the historical step video type is a tail video, and the historical anti-duplicate identifier is a textual description corresponding to all historical step videos in the historical synthesis video and a video ID corresponding to all historical step videos; When the key frame is the first intermediate frame, the second two-dimensional code of the first intermediate frame is analyzed to obtain a third synthesis analysis result containing a historical question ID, a historical step video type and a historical anti-duplicate identifier, wherein in the third synthesis analysis result, the historical step video type is an intermediate video or a guide video, and the historical anti-duplicate identifier is a textual description corresponding to a first historical step video in the historical synthesis video, a video ID corresponding to the first historical step video in the historical synthesis video or a textual description corresponding to a second historical step video in the historical synthesis video; When the key frame is a second intermediate frame, a second two-dimensional code of the second intermediate frame is parsed to obtain a fourth synthesis parsing result containing a historical problem ID, a historical step video type, and a historical anti-duplicate identifier, wherein the historical step video type is an intermediate video or a guide video, and the historical anti-duplicate identifier is a textual description corresponding to a second historical step video in the historical synthesis video or a video ID corresponding to the second historical step video in the historical synthesis video or a textual description corresponding to a third historical step video in the historical synthesis video; The first synthesis parsing result, the second synthesis parsing result, the third synthesis parsing result, and the fourth synthesis parsing result are matched with the message.

3. The method for automatic synthesis of a step-by-step answer video of claim 2, wherein, The matching of the first synthesis parsing result, the second synthesis parsing result, the third synthesis parsing result, and the fourth synthesis parsing result with the message comprises: When the first synthesis parsing result is matched with the message, a historical problem ID in the first synthesis parsing result is matched with a current problem ID in current problem information of the message, if the matching is successful, a textual description corresponding to a first current step video is obtained from N current step video relationship information and N current step video information according to the current problem ID of the message, if the textual description corresponding to the first current step video is consistent with a textual description corresponding to a first historical step video in the historical synthesis video in the first synthesis parsing result, the first synthesis parsing result is matched with the message successfully, otherwise, the first synthesis parsing result is not matched with the message successfully; When the second synthesis parsing result is matched with the message, a historical problem ID in the second synthesis parsing result is matched with a current problem ID in current problem information of the message, if the matching is successful, a textual description corresponding to each current step video and a video ID corresponding to each current step video are obtained from N current step video relationship information and N current step video information according to the current problem ID of the message, if all the textual descriptions corresponding to the current step videos and all the video IDs corresponding to the current step videos are consistent with all the textual descriptions corresponding to the historical step videos and all the video IDs corresponding to the historical step videos in the second synthesis parsing result, the second synthesis parsing result is matched with the message successfully, otherwise, the second synthesis parsing result is not matched with the message successfully; In the matching of the third synthetic analysis result and the message, the historical problem ID in the third synthetic analysis result is matched with the current problem ID in the current problem information of the message. If the matching is successful, the first historical step video corresponding text description and the first historical step video corresponding video ID and the second historical step video corresponding text description are obtained from the N current step video relationship information and the N current step video information according to the current problem ID of the message. If the first historical step video corresponding text description is consistent with the first historical step video corresponding text description in the historical synthetic video in the third synthetic analysis result, or if the first current step video corresponding video ID is consistent with the first historical step video corresponding video ID in the historical synthetic video in the third synthetic analysis result, or if the second current step video corresponding text description is consistent with the second historical step video corresponding text description in the historical synthetic video in the third synthetic analysis result, the third synthetic analysis result is matched with the message successfully. Otherwise, the third synthetic analysis result is not matched with the message successfully. In the matching of the fourth synthetic analysis result and the message, the historical problem ID in the fourth synthetic analysis result is matched with the current problem ID in the current problem information of the message. If the matching is successful, the second current step video corresponding text description and the second current step video corresponding video ID and the third current step video corresponding text description are obtained from the N current step video relationship information and the N current step video information according to the current problem ID of the message. If the second current step video corresponding text description is consistent with the second historical step video corresponding text description in the historical synthetic video in the fourth synthetic analysis result, or if the second current step video corresponding video ID is consistent with the second historical step video corresponding video ID in the historical synthetic video in the fourth synthetic analysis result, or if the third current step video corresponding text description is consistent with the third historical step video corresponding text description in the historical synthetic video in the fourth synthetic analysis result, the fourth synthetic analysis result is matched with the message successfully. Otherwise, the fourth synthetic analysis result is not matched with the message successfully.

4. The method for automatic synthesis of a step-by-step answer video of claim 1, wherein, If the matching is not successful, N video clips are obtained according to the N current step video information of the current answer video, and the N video clips are synthesized according to the N current step video relationship information on the client, which includes: If the matching is not successful, a historical video clip is obtained, a first frame of the clip is read, a first two-dimensional code of the first frame is analyzed to obtain a clip analysis result containing a video ID and a video title; From the N current step video relationship information and the N current step video information, the video ID corresponding to all current step videos and the video title corresponding to all current step videos are obtained; The segment analysis result is matched with the message, and it is judged whether the video ID and the video title in the segment analysis result contain the video ID corresponding to all current step videos and the video title corresponding to all current step videos. If yes, the segment analysis result is successfully matched with the message, and the historical video segments are synthesized according to N current step video relationship information in the client. If no, the segment analysis result is unsuccessfully matched with the message, P video IDs corresponding to P current step videos and P video titles corresponding to P current step videos not contained in the segment analysis result are obtained, P video segment links are obtained from the current answer video according to the P video IDs corresponding to P current step videos and the P video titles corresponding to P current step videos, and P current video segments corresponding to the P video segment links are downloaded from the Internet according to the P video segment links. P current video segments and N-P historical video segments are synthesized according to N current step video relationship information in the client.

5. The method for automatic synthesis of a step-by-step answer video of claim 1, wherein, The N video segments are synthesized according to N current step video relationship information in the client, including: A historical guide video is obtained, a guide first frame of the historical guide video is read, a guide analysis result containing a current step serial number and a current step text description is obtained by analyzing a third two-dimensional code of the guide first frame; Current step serial numbers corresponding to all current step videos and current step text descriptions corresponding to all current step videos are obtained from N current step video relationship information and N current step video information; The guide analysis result is matched with the message, and it is judged whether the current step serial number and the current step text description in the guide analysis result contain the current step serial number corresponding to all current step videos and the current step text description corresponding to all current step videos. If yes, the guide analysis result is successfully matched with the message, and the video segment under the current step serial number is synthesized with the historical guide video according to N current step video relationship information of the current answer video in the client. If no, the guide analysis result is unsuccessfully matched with the message, L current step video information corresponding to L current step videos not contained in the guide analysis result is obtained from N current step video information of the current answer video, L current guide videos corresponding to the L current step video information are obtained according to the L current step video information, and the video segment is synthesized with L current guide videos and N-L historical guide videos according to N current step video relationship information in the client.

6. The method for automatic synthesis of a step answer video of claim 5, wherein, The L current guide videos corresponding to the L current step video information are obtained, including: Background image links, video sizes and current step text descriptions corresponding to L current step videos are obtained from L current step video information; According to the background image link corresponding to the L current step videos, download the corresponding background images from the Internet to obtain L background images, and adjust the L background images according to the corresponding video size to obtain L adjusted background images, and take the L adjusted background images as the guide pictures of the corresponding current step videos to obtain L guide pictures; Convert the L current step text descriptions corresponding to the L current step videos into corresponding L step audios through a TTS engine to obtain L step audios; Synthesize each guide picture and the corresponding step audio through FFmpeg to obtain L current guide videos.

7. The method for automatic synthesis of a step answer video of claim 5, wherein, The synthesizing of the L current guide videos and the N-L historical guide videos and the video clip according to the N current step video relationship information on the client includes: Obtain the current step serial number of each current step video from the N current step video relationship information, take the video size of the current step video with the current step serial number 1 as a reference size, and adjust the L current guide videos, the N-L historical guide videos, and the video clip according to the reference size to obtain adjusted L current guide videos, adjusted N-L historical guide videos, and an adjusted video clip; Synthesize the adjusted L current guide videos, the adjusted N-L historical guide videos, and the adjusted video clip according to the current step serial number on the client.

8. The method for automatic synthesis of a step answer video of claim 7, wherein, The synthesizing of the adjusted L current guide videos, the adjusted N-L historical guide videos, and the adjusted video clip according to the current step serial number on the client includes: Locate the third two-dimensional code of the L current guide videos and the adjusted N-L historical guide videos and the first two-dimensional code of the adjusted video clip through the quirc filter of FFmpeg respectively to obtain the positions of the corresponding third two-dimensional code and the first two-dimensional code; Remove the two-dimensional code from the adjusted L current guide videos, the adjusted N-L historical guide videos, and the adjusted video clip through the delogo filter according to the positions of the third two-dimensional code and the first two-dimensional code to obtain the removed L current guide videos, the removed N-L historical guide videos, and the removed video clip; Obtain the video ID, the video title, and the current step text description from the N current step video information of the current answer video, generate a new first two-dimensional code according to the video ID and the video title, generate a new third two-dimensional code according to the current step text description and the current step serial number, add the new first two-dimensional code to the removed video clip according to the position of the first two-dimensional code, and add the new third two-dimensional code to the removed L current guide videos and the removed N-L historical guide videos according to the position of the third two-dimensional code to obtain the added video clip, the added L current guide videos, and the added N-L historical guide videos; According to the current step number, the added L current guide videos and the added N-L historical guide videos are synthesized at the client.

9. A system for automatic synthesis of a step-by-step answer video, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, The processor implements the method of any one of claims 1-8 when executing the computer program.

Images