Video picture splicing method, device, terminal and storage medium

Abstract

The embodiment of the present application discloses a video screen splicing method, device, terminal and storage medium, the method comprising: determining the overlap area between each video screen according to the motion state of the target object in the video screen; wherein the target object is an object that appears together in each video screen; generating a splicing line for each video screen in the overlap area according to the shape of the target object and the target position of the target object in the video screen; splicing each video screen according to the splicing line to obtain a first target video screen; in response to the target object changing in the first target video screen, superimposing the current image of the first area where the target object is located to the overlap area to obtain a second target video screen when the splicing line remains unchanged; wherein the first area is within the range of the overlap area. The embodiment of the present application can greatly save the computing resources required for video screen splicing and improve the splicing effect.

Description

Technical Field

[0001] The present application relates to the field of computers, and in particular to a video picture splicing method, device, terminal and storage medium. Background Art

[0002] To obtain panoramic video images in larger scenes, such as large conference scenes, large classroom scenes, etc., you can stitch the video images obtained by multiple cameras. In order to improve the stitching synthesis effect, the overlapping areas between different video images are usually color fused, or the different video images are synthesized by dynamically planning the stitching lines.

[0003] However, the first processing method will cause defects such as ghosting and color aberration in the spliced ​​video images, and the second processing method will cause the spliced ​​video images to have a low output frame rate and poor image quality due to the program occupying more computing resources. Therefore, the existing technology has defects and needs to be improved and developed. Summary of the invention

[0004] The embodiments of the present application provide a video picture stitching method, device, terminal and storage medium, which can greatly save the computing resources required for video picture stitching and improve the stitching effect.

[0005] In a first aspect, an embodiment of the present application provides a video picture stitching method, comprising:

[0006] Determine the overlap area between each of the video frames according to the motion state of the target object in the video frame; wherein the target object is an object that appears in each of the video frames;

[0007] Generating a stitching line of each video frame in the overlapped area according to the shape of the target object and the target position of the target object in the video frame;

[0008] splicing each of the video images according to the splicing line to obtain a first target video image;

[0009] In response to a change in the target object in the first target video picture, the current image of the first area where the target object is located is superimposed on the overlapping area to obtain a second target video picture while the stitching line remains unchanged; wherein the first area is within the range of the overlapping area.

[0010] Optionally, superimposing the current image of the first area where the target object is located on the overlapped area to obtain a second target video picture includes:

[0011] Acquire a static image of the overlapped area in the first target video screen;

[0012] In response to a change in the target object in the first target video picture, acquiring the current image;

[0013] The current image is rendered and superimposed on the static image to obtain the second target video picture.

[0014] Optionally, the method further includes: establishing a monitoring buffer area, wherein the monitoring buffer area is used to receive whether the target object changes in the first target video picture.

[0015] Optionally, determining the overlapped area between each of the video frames according to the motion state of the target object in the video frame includes:

[0016] Determine at least one preset area corresponding to the target object that meets a first preset condition as a candidate overlap area; wherein the first preset condition includes that the frequency of the motion state changing within a unit time is less than a preset threshold;

[0017] In response to the number of candidate overlapped regions being multiple, one overlapped region is determined from the multiple candidate overlapped regions according to positions of the multiple candidate overlapped regions in the video picture.

[0018] Optionally, generating a stitching line of each video frame in the overlapped area according to the shape of the target object and the target position of the target object in the video frame includes:

[0019] Determine a candidate position that satisfies a second preset condition as the target position; wherein the second preset condition includes that the target object remains stationary at the candidate position for a period of time greater than a preset threshold;

[0020] At the target position, the stitching line is generated to avoid the shape of the target object.

[0021] Optionally, before stitching each of the video pictures according to the stitching line to obtain the first target video picture, the method further includes:

[0022] For each video frame including the stitching line, cropping is performed along the track of the stitching line;

[0023] Each of the cropped video frames is spliced ​​together to obtain the first target video frame.

[0024] Optionally, the method further includes: sending the first target video picture and the second target video picture to a display device to display the first target video picture and the second target video picture.

[0025] In a second aspect, an embodiment of the present application further provides a video picture splicing device, comprising:

[0026] An overlap region determination module, used to determine the overlap region between each of the video frames according to the motion state of the target object in the video frame; wherein the target object is an object that appears in each of the video frames;

[0027] A stitching line generating module, used for generating a stitching line of each video screen in the overlapped area according to the shape of the target object and the target position of the target object in the video screen;

[0028] A first target video picture acquisition module, used for splicing each of the video pictures according to the splicing line to obtain a first target video picture;

[0029] The second target video picture acquisition module is used to respond to the change of the target object in the first target video picture, and to superimpose the current image of the first area where the target object is located on the overlapping area while the stitching line remains unchanged, so as to obtain a second target video picture; wherein the first area is within the range of the overlapping area.

[0030] Optionally, the second target video picture acquisition module is further used for:

[0031] Acquire a static image of the overlapped area in the first target video screen;

[0032] In response to a change in the target object in the first target video picture, acquiring the current image;

[0033] The current image is rendered and superimposed on the static image to obtain the second target video picture.

[0034] Optionally, the device further includes: a monitoring buffer area establishment module, which is used to establish a monitoring buffer area, and the monitoring buffer area is used to receive whether the target object changes in the first target video picture.

[0035] Optionally, the overlap area determination module is further used to:

[0036] Determine at least one preset area corresponding to the target object that meets a first preset condition as a candidate overlap area; wherein the first preset condition includes that the frequency of the motion state changing within a unit time is less than a preset threshold;

[0037] In response to the number of candidate overlapped regions being multiple, one overlapped region is determined from the multiple candidate overlapped regions according to positions of the multiple candidate overlapped regions in the video picture.

[0038] Optionally, the splicing line generation module is further used for:

[0039] Determine a candidate position that satisfies a second preset condition as the target position; wherein the second preset condition includes that the target object remains stationary at the candidate position for a period of time greater than a preset threshold;

[0040] At the target position, the stitching line is generated to avoid the shape of the target object.

[0041] Optionally, the device further comprises:

[0042] A video frame cropping module, used for cropping each video frame including the stitching line along the track of the stitching line;

[0043] The target video picture splicing module splices each of the cropped video pictures to obtain the first target video picture.

[0044] Optionally, the apparatus further includes: a sending module, configured to send the first target video picture and the second target video picture to a display device, so as to display the first target video picture and the second target video picture.

[0045] In a third aspect, an embodiment of the present application further provides a terminal capable of executing the operations in any of the above-mentioned video screen stitching methods.

[0046] In a fourth aspect, an embodiment of the present application further provides a storage medium, wherein the storage medium is used to store a computer program, and the computer program is loaded by a processor to execute any of the above-mentioned video screen stitching methods.

[0047] The embodiments of the present application disclose a video screen stitching method, device, terminal and storage medium, the method comprising: determining the overlapping area between each of the video screens according to the motion state of the target object in the video screen; wherein the target object is an object that appears together in each of the video screens; generating a stitching line for each of the video screens in the overlapping area according to the shape of the target object and the target position of the target object in the video screen; stitching each of the video screens according to the stitching line to obtain a first target video screen; in response to the target object changing in the first target video screen, while the stitching line remains unchanged, superimposing the current image of the first area where the target object is located on the overlapping area to obtain a second target video screen; wherein the first area is within the range of the overlapping area.

[0048] As can be seen from the above, the embodiment of the present application first accurately determines the overlapping area between the splicing of the video screens through the motion state of the target object, and then dynamically plans the splicing line according to the changes of the overlapping area and the target object to ensure that the splicing line remains unchanged in the future. And after detecting the change of the target object, the changed image in the area can be directly rendered and superimposed on the video screen. The whole processing process is simple to operate, and there is no need to dynamically re-plan the splicing line, which can greatly save the computing resources occupied in the splicing process, does not affect the frame rate and image quality of the subsequent output splicing video screen, and significantly improves the effect of video screen splicing synthesis. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0050] Figure 1 It is a flowchart of a video picture splicing method provided in an embodiment of the present application;

[0051] Figure 2 is another flowchart of the video image splicing method provided in an embodiment of the present application;

[0052] Figure 3 is a schematic diagram of displaying a first target video screen provided by an embodiment of the present application;

[0053] Figure 4 is a schematic diagram of displaying a second target video screen provided by an embodiment of the present application;

[0054] Figure 5 is a structural schematic diagram of a video picture splicing device provided in an embodiment of the present application;

[0055] Figure 6 It is a schematic diagram of the structure of the terminal provided in the embodiment of the present application. DETAILED DESCRIPTION

[0056] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0057] In the description of the present application, it should be understood that the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the present application, "at least two" means two or more, unless otherwise clearly and specifically defined.

[0058] The disclosure below provides many different embodiments or examples to realize the different structures of the present application. In order to simplify the disclosure of the present application, the parts and settings of specific examples are described below. Of course, they are only examples, and the purpose is not to limit the present application. In addition, the present application can repeat reference numbers and / or reference letters in different examples, and this repetition is for the purpose of simplification and clarity, and does not indicate the relationship between the various embodiments and / or settings discussed in itself. In addition, the examples of various specific processes and materials provided by the present application, but those of ordinary skill in the art can be aware of the application of other processes and / or the use of other materials. In the above-mentioned embodiments, the description of each embodiment has its own emphasis, and the part that is not described in detail in a certain embodiment can refer to the relevant description of other embodiments.

[0059] The video image stitching method provided in the embodiment of the present application can be applied to any terminal with an image processing function or a video stitching function, and the embodiments of the present application will not be listed one by one. The following is a detailed description of the device, the terminal and the storage medium. It should be noted that the description order of the following embodiments is not intended to limit the preferred order of the embodiments.

[0060] The present invention is described in detail below with reference to the accompanying drawings and specific embodiments. Figures 1 to 4 .

[0061] See also Figure 1 and Figure 2 , Figure 1 is a flow chart of a video image stitching method provided in an embodiment of the present application, Figure 2 is another flow chart of the video picture splicing method provided by the embodiment of the present application. Among them, the embodiment of the present application may include:

[0062] Step 110: Determine the overlap area between each of the video frames according to the motion state of the target object in the video frame.

[0063] The video picture may be image data captured by a video capture terminal (eg, a camera, a video recorder, etc.) and displayed on a display interface of a display terminal (eg, a display, an LCD screen, etc.).

[0064] The target object may be an object that appears in each video screen. Taking a conference scene as an example, the target object may be a conference table, a chair, or a potted plant or a water cup on the conference table. The motion state of the target object may include stationary, moving, and data related to stationary and moving, such as the duration of the stationary state, the speed in the moving state, and other information. This embodiment does not limit the target object and the types of the target object's motion state.

[0065] The overlap area refers to the overlapping area where any number of video images are spliced. Figure 3 and Figure 4 The overlap area 31 shown in FIG. 1 is the overlap area generated by splicing two video images.

[0066] Optionally, step 110 may further include:

[0067] Determine at least one preset area corresponding to the target object 33 that meets a first preset condition as a candidate overlap area 31; wherein the first preset condition includes that the frequency of the motion state changing within a unit time is less than a preset threshold;

[0068] In response to the fact that there are multiple candidate overlap regions 31 , one overlap region 31 is determined from the multiple candidate overlap regions 31 according to positions of the multiple candidate overlap regions 31 in the video picture.

[0069] The change in the motion state of the target object 33 may be a state switch between stillness and movement, such as the target object 33 being moved to another position, the target object 33 being still after the movement ends, etc. Accordingly, the change in the motion state of the target object 33 may also be a change in the target object 33 itself while being still or moving, such as steam coming out of a still water cup, the speed at which a chair is moved slowing down, etc.

[0070] It can be understood that in order to ensure that less computing resources are needed to process the overlapped area 31 in the future, the overlapped area 31 is preferably an area where the frequency of the motion state change of the target object 33 is small. For example, at least one preset area corresponding to the target object 33 that meets the first preset condition can be determined as a candidate overlapped area 31. Among them, the first preset condition can include that the frequency of the motion state change within a unit time is less than a preset threshold. For example, the unit time can be 1 minute, and the preset threshold can be 1, that is, in the current video screen, if the target object 33 satisfies the condition that the motion state changes less than 1 time within 1 minute, then at least one area corresponding to the target object 33 is determined as a candidate overlapped area 31.

[0071] It should be noted that the size of the candidate overlap region 31 may depend on the size of the overlapping portion of each video screen, or may be manually delineated. In addition, the number of candidate overlap regions 31 that meet the first preset condition may be one or more, which is not limited in this embodiment.

[0072] When there are multiple candidate overlap regions 31, one overlap region 31 may be determined from the multiple candidate overlap regions 31 according to the positions of the multiple candidate overlap regions 31 in the video screen. For example, a user input may be received to select the most suitable overlap region 31. For example, a candidate overlap region 31 that is relatively central to the entire video screen after splicing may be selected as the overlap region 31. For another example, a candidate overlap region 31 that has the lowest frequency of changes in the motion state of the target object 33 may be selected as the overlap region 31.

[0073] Therefore, the overlap area 31 can be reasonably and accurately selected according to the change of the motion state of the target object 33 to ensure that the dynamic information of the video screen in the subsequent overlap area 31 is less, thereby greatly saving the computing resources required for video screen stitching.

[0074] Step 120 : generating a stitching line 32 of each video frame in the overlapped area 31 according to the shape of the target object 33 and the target position of the target object 33 in the video frame.

[0075] In the embodiment of the present application, the shape of the target object 33 may refer to the shape of the target object 33 displayed in the video screen. Among them, the target position may be the current position of the target object 33 when the system generates the stitching line 32. It can be understood that the embodiment of the present application can avoid the shape of the target object 33 at the target position by dynamically planning the stitching line 32 through the shape and target position of the target object 33, so as to improve the panoramic video after stitching to have a better visual effect.

[0076] Optionally, step 120 may further include:

[0077] Determine a candidate position that satisfies a second preset condition as the target position; wherein the second preset condition includes that the target object 33 remains stationary at the candidate position for a period of time greater than a preset threshold;

[0078] At the target position, the stitching line 32 is generated in a shape that avoids the target object 33 .

[0079] Before determining the target position of the target object 33, it may be determined whether the candidate position of the target object 33 satisfies the second preset condition. The second preset condition may include that the target object 33 remains stationary at the candidate position for a period longer than a preset threshold. For example, the preset threshold may be 30 minutes, 1 hour, etc. When the target object 33 remains stationary at the candidate position for a period longer than 30 minutes, the candidate position satisfies the second preset condition, and the candidate position is determined as the target position of the target object 33.

[0080] In some embodiments, a stitching line 32 of a shape that avoids the target object 33 may be generated at the target position. Figure 3 and Figure 4 As shown, the system can dynamically plan the stitching line 32 for the target object 33 through the image processing algorithm, and the stitching line 32 can perfectly avoid the shape of the target object 33. Since the stitching line 32 is the basis for cropping the video screen, the target object 33 can appear completely in the corresponding video screen without being cut by the stitching line 32, thereby improving the effect of subsequent video screen stitching.

[0081] Step 130 : splice each of the video frames according to the splicing line 32 to obtain a first target video frame.

[0082] Before step 130, the embodiment of the present application may further include:

[0083] For each video frame including the stitching line 32, cropping is performed along the track of the stitching line 32;

[0084] Each of the cropped video frames is spliced ​​together to obtain the first target video frame.

[0085] Specifically, Figure 3 As shown, the system can use image processing technology to crop the video screen along the track of the splicing line 32 based on the splicing line 32, and then splice the cropped video screen with the splicing line 32 as the boundary, and use the spliced ​​video screen as the first target video screen. It can be understood that the first target video screen is the spliced ​​target video.

[0086] Step 140 , in response to the target object 33 changing in the first target video picture, the current image 41 of the first area where the target object 33 is located is superimposed on the overlap area 31 while the stitching line 32 remains unchanged, so as to obtain a second target video picture.

[0087] The change of the target object 33 in the first target video frame may refer to a change in the type of the target object 33. Figure 3 and Figure 4As shown, in this conference scene, the target object 33 is a potted plant placed on the conference table. When the type of the target object 33 changes from the potted plant to a kettle, the image rendering of the kettle can be superimposed on the corresponding area of ​​the first target video screen through image processing technology. For example, the image rendering of the kettle can be superimposed on the video frame corresponding to the first target video screen, and finally the first target video screen can be updated to the second target video screen.

[0088] More details about step 140 can be found in Figure 2 and its related description.

[0089] Optionally, the embodiment of the present application may further include:

[0090] The first target video picture and the second target video picture are sent to a display device to display the first target video picture and the second target video picture.

[0091] It can be understood that the first target video picture and the second target video picture are both obtained after splicing through image processing technology in the system background. Therefore, the system can send the spliced ​​first target video picture and the second target video picture to the display device for display, for example, it can send it to a terminal device such as a monitor or LCD screen for display.

[0092] As can be seen from the above, the embodiment of the present application can first accurately determine the overlap area 31 of the splicing between the video images through the motion state of the target object 33, and then dynamically plan the splicing line 32 according to the changes of the overlap area 31 and the target object 33 to ensure that the splicing line 32 remains unchanged in the future. And after detecting the change of the target object 33, the changed image in the area can be directly rendered and superimposed on the video image. The whole processing process is simple to operate, and there is no need to re-dynamically plan the splicing line 32, which can greatly save the computing resources occupied in the splicing process, does not affect the frame rate and image quality of the subsequent output spliced ​​video image, and significantly improves the effect of video image splicing synthesis.

[0093] See also Figure 2 , Figure 2 It is another flowchart of the video picture splicing method provided in an embodiment of the present application.

[0094] like Figure 2 As shown, the embodiments of the present application may include:

[0095] Acquire a static image of the overlapped area 31 in the first target video frame;

[0096] In response to a change in the target object 33 in the first target video picture, acquiring the current image 41;

[0097] The current image 41 is rendered and superimposed on the static image to obtain the second target video picture.

[0098] Specifically, a static image of the overlapped area 31 in the first target video screen can be obtained by screenshot, and the static image is superimposed on the first target video screen as a base map. It can be understood that since the overlapped area 31 is selected after the motion state of the target object 33 meets the first preset condition, there is no or only little motion information in the overlapped area 31 in the first target video screen, and even if the static image of the overlapped area 31 is displayed together with the dynamic video screen of other areas, it will not affect the overall display effect of the first target video screen.

[0099] Optionally, the embodiment of the present application may further include:

[0100] A monitoring buffer area is established, and the monitoring buffer area is used to receive whether the target object 33 changes in the first target video picture.

[0101] It is understandable that even if there is no or only a small amount of motion information in the overlap area 31 most of the time, it is still necessary to monitor the changes of the target object 33 in the overlap area 31 in real time to ensure the accuracy of the output video picture. Among them, a separate monitoring buffer area can be established to monitor the changes of the target object 33 in the first video picture. As shown in the example in step 140, when the type of the target object 33 changes from a potted plant to a kettle, the monitoring buffer area can obtain the change and send corresponding processing instructions to the system. For example, the processing instructions may include a screenshot operation of the kettle, and an operation of superimposing and rendering the screenshot of the kettle to the overlap area 31.

[0102] It should be noted that when the current image 41 is superimposed and rendered onto the overlapping area 31 , the system can process the current image 41 through relevant image processing techniques, such as scaling and rotating the current image 41 , so that the current image 41 does not exceed the scope of the overlapping area 31 and does not pass through the stitching line 32 .

[0103] From the above, it can be seen that when stitching video images, the embodiment of the present application can render and superimpose the static image of the current area on the static image of the overlapping area 31 without changing the stitching line 32, thereby occupying fewer computing resources to stitch the video images, so as to stitch together a target video image with a higher frame rate and picture quality.

[0104] See also Figure 5 , Figure 5 It is a structural schematic diagram of a video picture splicing device provided in an embodiment of the present application.

[0105] like Figure 5As shown, the video picture splicing device may include an overlap region determining module 51 , a splicing line generating module 52 , a first target video picture acquiring module 53 and a second target video picture acquiring module 54 .

[0106] In some embodiments, the overlap region determination module 51 may be used to determine the overlap region between each of the video frames according to the motion state of the target object 33 in the video frame; wherein the target object 33 is an object that appears in each of the video frames;

[0107] In some embodiments, the stitching line generation module 52 may be used to generate the stitching line 32 of each video frame in the overlapped area according to the shape of the target object 33 and the target position of the target object 33 in the video frame;

[0108] In some embodiments, the first target video picture acquisition module 53 may be used to splice each of the video pictures according to the splicing line 32 to obtain a first target video picture;

[0109] In some embodiments, the second target video picture acquisition module 54 can be used to respond to the change of the target object 33 in the first target video picture, while the stitching line 32 remains unchanged, to superimpose the current image of the first area where the target object 33 is located on the overlapping area to obtain a second target video picture; wherein the first area is within the range of the overlapping area.

[0110] In some embodiments, the second target video picture acquisition module 54 is further used to:

[0111] Acquire a static image of the overlapped area in the first target video screen;

[0112] In response to a change in the target object 33 in the first target video picture, acquiring the current image;

[0113] The current image is rendered and superimposed on the static image to obtain the second target video picture.

[0114] In some embodiments, the device further includes: a monitoring buffer area establishment module, which is used to establish a monitoring buffer area, and the monitoring buffer area is used to receive whether the target object 33 changes in the first target video picture.

[0115] In some embodiments, the overlap region determination module 51 is further configured to:

[0116] Determine at least one preset area corresponding to the target object 33 that meets a first preset condition as a candidate overlap area; wherein the first preset condition includes that the frequency of the motion state changing within a unit time is less than a preset threshold;

[0117] In response to the number of candidate overlapped regions being multiple, one overlapped region is determined from the multiple candidate overlapped regions according to positions of the multiple candidate overlapped regions in the video picture.

[0118] In some embodiments, the splicing line generation module 52 is further used to:

[0119] Determine a candidate position that satisfies a second preset condition as the target position; wherein the second preset condition includes that the target object 33 remains stationary at the candidate position for a period of time greater than a preset threshold;

[0120] At the target position, the stitching line 32 is generated in a shape that avoids the target object 33 .

[0121] In some embodiments, the apparatus further comprises:

[0122] A video frame cropping module, used for cropping each video frame including the stitching line 32 along the track of the stitching line 32;

[0123] The target video picture splicing module splices each of the cropped video pictures to obtain the first target video picture.

[0124] In some embodiments, the apparatus further includes: a sending module, configured to send the first target video picture and the second target video picture to a display device, so as to display the first target video picture and the second target video picture.

[0125] In specific implementation, the above modules can be implemented as independent entities, or can be arbitrarily combined and implemented as the same or several entities. The specific implementation of the above modules can be found in the previous method embodiments, which will not be repeated here.

[0126] Therefore, in the video screen splicing device of this embodiment, when splicing video screens, the overlap area determination module 51 can be used to determine the overlap area between each of the video screens according to the motion state of the target object 33 in the video screen; wherein the target object 33 is an object that appears together in each of the video screens; then, the splicing line generation module 52 can be used to generate the splicing line 32 of each of the video screens in the overlap area according to the shape of the target object 33 and the target position of the target object 33 in the video screen; then, the first target video screen acquisition module 53 can be used to splice each of the video screens according to the splicing line 32 to obtain a first target video screen; finally, the second target video screen acquisition module 54 can be used to respond to the target object 33 in the first target video screen. Changes, when the splicing line 32 remains unchanged, superimpose the current image of the first area where the target object 33 is located on the overlap area to obtain a second target video screen; wherein, the first area is within the range of the overlap area.

[0127] From the above, it can be seen that the embodiment of the present application can reasonably and accurately select the overlapping area according to the changes in the motion state of the target object 33 to ensure that the dynamic information of the video screen in the subsequent overlapping area is less, thereby greatly saving the computing resources required for video screen stitching.

[0128] In addition, when stitching video images, the embodiment of the present application can render and superimpose the static image of the current area onto the static image of the overlapping area without changing the stitching line 32, thereby occupying fewer computing resources to stitch the video images to synthesize a target video image with a higher frame rate and picture quality.

[0129] like Figure 6 As shown, the terminal may include a radio frequency (RF) circuit 601, a memory 602 including one or more computer-readable storage media, an input unit 603, a display unit 604, a sensor 605, an audio circuit 606, a wireless fidelity (Wi-Fi) module 607, a processor 608 including one or more processing cores, and a power supply 609. Those skilled in the art will appreciate that Figure 6 The terminal structure shown in the figure does not constitute a limitation on the terminal, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0130] The RF circuit 601 can be used for receiving and sending signals during information transmission or calls. In particular, after receiving the downlink information of the base station, it is handed over to one or more processors 608 for processing; in addition, the data related to the uplink is sent to the base station. Usually, the RF circuit 601 includes but is not limited to an antenna, at least one amplifier, a tuner, one or more oscillators, a subscriber identity module (Subscriber Identity Module, SIM) card, a transceiver, a coupler, a low noise amplifier (Low Noise Amplifier, LNA), a duplexer, etc. In addition, the RF circuit 601 can also communicate with the network and other devices through wireless communication. The wireless communication can use any communication standard or protocol, including but not limited to Global System of Mobile communication (Global System of Mobile communication, GSM), General Packet Radio Service (General Packet Radio Service, GPRS), Code Division Multiple Access (Code Division Multiple Access, CDMA), Wideband Code Division Multiple Access (Wideband Code Division Multiple Access, WCDMA), Long Term Evolution (Long Term Evolution, LTE), email, Short Messaging Service (SMS), etc.

[0131] The memory 602 can be used to store software programs and modules. The processor 608 executes various functional applications and data processing by running the software programs and modules stored in the memory 602. The memory 602 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the terminal (such as audio data, a phone book, etc.), etc. In addition, the memory 602 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices. Accordingly, the memory 602 may also include a memory controller to provide the processor 608 and the input unit 603 with access to the memory 602.

[0132] The input unit 603 can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Specifically, in a specific embodiment, the input unit 603 may include a touch-sensitive surface and other input devices. The touch-sensitive surface, also known as a touch display screen or a touch pad, can collect the user's touch operations on or near it (such as the user's operation on or near the touch-sensitive surface using any suitable object or accessory such as a finger, a stylus, etc.), and drive the corresponding connection device according to a pre-set program. Optionally, the touch-sensitive surface may include a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 608, and can receive and execute the command sent by the processor 608. In addition, the touch-sensitive surface can be implemented using multiple types such as resistive, capacitive, infrared and surface acoustic waves. In addition to the touch-sensitive surface, the input unit 603 may also include other input devices. Specifically, other input devices may include, but are not limited to, one or more of a physical keyboard, function keys (such as a volume control key, a switch key, etc.), a trackball, a mouse, a joystick, and the like.

[0133] The display unit 604 can be used to display information input by the user or information provided to the user and various graphical user interfaces of the terminal, which can be composed of graphics, text, icons, videos and any combination thereof. The display unit 604 may include a display screen, and optionally, the display screen may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), etc. Further, the touch-sensitive surface may cover the display screen, and when the touch-sensitive surface detects a touch operation on or near it, it is transmitted to the processor 608 to determine the type of touch event, and then the processor 608 provides a corresponding visual output on the display screen according to the type of touch event.

[0134] The terminal may also include at least one sensor 605, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display screen according to the brightness of the ambient light, and the proximity sensor may turn off the display screen and / or backlight when the terminal is moved to the ear. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration at various positions (generally three axes), and can detect the magnitude and position of gravity when stationary. It can be used for applications that identify the posture of the mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that can be configured in the terminal, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be repeated here.

[0135] The audio circuit 606, the speaker, and the microphone can provide an audio interface between the user and the terminal. The audio circuit 606 can transmit the electrical signal converted from the received audio data to the speaker, which is converted into a sound signal for output; on the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 606 and converted into audio data, and then the audio data is processed by the output processor 608 and sent to, for example, another terminal through the RF circuit 601, or the audio data is output to the memory 602 for further processing. The audio circuit 606 may also include an earplug jack to provide communication between an external headset and the terminal.

[0136] WiFi is a short-range wireless transmission technology. The terminal can help users send and receive emails, browse web pages, and access streaming media through the WiFi module 607. It provides users with wireless broadband Internet access. Figure 5 A WiFi module 607 is shown, but it is understandable that it is not an essential component of the terminal and can be omitted as required without changing the essence of the invention.

[0137] The processor 608 is the control center of the terminal. It uses various interfaces and lines to connect various parts of the entire mobile phone. By running or executing software programs and / or modules stored in the memory 602, and calling data stored in the memory 602, it executes various functions of the terminal and processes data, thereby monitoring the mobile phone as a whole. Optionally, the processor 608 may include one or more processing cores; preferably, the processor 608 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 608. Specifically, in the embodiment of the present application, after the processor receives the control instruction input by the user, it controls the drive device in the camera device to perform the corresponding operation.

[0138] The terminal also includes a power supply 609 (such as a battery) for supplying power to each component. Preferably, the power supply can be logically connected to the processor 608 through a power management system, so that the power management system can manage charging, discharging, and power consumption management. The power supply 609 can also include any components such as one or more DC or AC power supplies, recharging systems, power failure detection circuits, power converters or inverters, and power status indicators.

[0139] Although not shown, the terminal may also include a camera, a Bluetooth module, etc., which will not be described in detail herein. Specifically in this embodiment, the processor 608 in the terminal will load the executable files corresponding to the processes of one or more applications into the memory 602 according to the following instructions, and the processor 608 will run the applications stored in the memory 602 to implement various functions.

[0140] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant description of other embodiments. The embodiments described above are only some embodiments of the present invention, not all embodiments. Based on the embodiments in the present invention, all other embodiments obtained by those skilled in the art without making creative work, except for such designs mentioned in the embodiments of the present application that are consistent with the embodiments of the present application, belong to the scope of protection of the present invention.

[0141] The above is a detailed introduction to an action synthesis method and terminal provided in an embodiment of the present application. Specific examples are used in this article to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the technical scheme and core ideas of the present invention. Ordinary technicians in this field should understand that they can still modify the technical schemes recorded in the aforementioned embodiments, or replace some of the technical features therein with equivalents; and these modifications or replacements do not make the essence of the corresponding technical scheme deviate from the scope of the technical schemes of the embodiments of the present invention.

Claims

1. A video image splicing method, characterized in that: include: Determine the overlap area between each of the video frames according to the motion state of the target object in the video frame; wherein the target object is an object that appears in each of the video frames; Generating a stitching line of each video frame in the overlapped area according to the shape of the target object and the target position of the target object in the video frame; splicing each of the video images according to the splicing line to obtain a first target video image; In response to a change in the target object in the first target video picture, the current image of the first area where the target object is located is superimposed on the overlapped area to obtain a second target video picture when the stitching line remains unchanged; wherein the first area is within the range of the overlapped area; The step of superimposing the current image of the first area where the target object is located onto the overlapped area to obtain a second target video image includes: Acquire a static image of the overlapped area in the first target video screen; In response to a change in the target object in the first target video picture, acquiring the current image; The current image is rendered and superimposed on the static image to obtain the second target video picture.

2. The method according to claim 1, characterized in that The method further includes: establishing a monitoring buffer area, wherein the monitoring buffer area is used to receive whether the target object changes in the first target video picture.

3. The method according to claim 1, characterized in that Determining the overlapped area between each of the video frames according to the motion state of the target object in the video frame includes: Determine at least one preset area corresponding to the target object that meets a first preset condition as a candidate overlap area; wherein the first preset condition includes that the frequency of the motion state changing within a unit time is less than a preset threshold; In response to the number of candidate overlapped regions being multiple, one overlapped region is determined from the multiple candidate overlapped regions according to positions of the multiple candidate overlapped regions in the video picture.

4. The method according to claim 1, characterized in that: Generating a stitching line of each video screen in the overlapped area according to the shape of the target object and the target position of the target object in the video screen includes: Determine a candidate position that satisfies a second preset condition as the target position; wherein the second preset condition includes that the target object remains stationary at the candidate position for a period of time greater than a preset threshold; At the target position, the stitching line is generated to avoid the shape of the target object.

5. The method according to claim 1, characterized in that Before splicing each of the video images according to the splicing line to obtain the first target video image, the method further includes: For each video frame including the stitching line, cropping is performed along the track of the stitching line; Each of the cropped video frames is spliced ​​together to obtain the first target video frame.

6. The method according to claim 1, characterized in that The method further includes: sending the first target video picture and the second target video picture to a display device to display the first target video picture and the second target video picture.

7. A video image splicing device, characterized in that: include: An overlap region determination module, used to determine the overlap region between each of the video frames according to the motion state of the target object in the video frame; wherein the target object is an object that appears in each of the video frames; A stitching line generating module, used for generating a stitching line of each video screen in the overlapped area according to the shape of the target object and the target position of the target object in the video screen; A first target video picture acquisition module, used for splicing each of the video pictures according to the splicing line to obtain a first target video picture; A second target video picture acquisition module is used for, in response to a change of the target object in the first target video picture, superimposing a current image of the first area where the target object is located on the overlap area while the stitching line remains unchanged, so as to obtain a second target video picture; wherein the first area is within the range of the overlap area; The second target video picture acquisition module is also used for: Acquire a static image of the overlapped area in the first target video screen; In response to a change in the target object in the first target video picture, acquiring the current image; The current image is rendered and superimposed on the static image to obtain the second target video picture.

8. A terminal, characterized in that: It comprises a processor and a memory, wherein the memory stores a plurality of instructions, and the processor loads the instructions to execute the operations in the video picture splicing method according to any one of claims 1 to 6.

9. A storage medium, characterized in that: The storage medium is used to store a computer program, and the computer program is loaded by a processor to execute the video picture splicing method according to any one of claims 1 to 6.

Images