A video processing method, electronic device and medium

Abstract

The application relates to the technical field of video processing, and discloses a video processing method, an electronic device and a medium. The video processing method comprises the following steps: a first processing device acquires multiple sets of recording data from multiple recording devices, wherein the multiple recording devices belong to a same recording group; the first processing device belongs to a device in the recording group; a first interface of the first processing device displays the multiple sets of recording data; in response to a first operation of a user, the first processing device pre-processes the multiple sets of recording data to generate a material segment set; a second interface of the first processing device displays each material segment in the material segment set; and in response to a second operation of the user, a third interface of the first processing device displays a synthesized video. Based on the above scheme, the recording data does not need to be transferred to an additional special synthesis device, thereby saving the operation process. Moreover, based on the material segments, the user's later synthesis steps can be greatly simplified, so that ordinary non-professional users can also select material segments to synthesize videos.

Description

[0001] This application is a divisional application, the original application's application number is 202210803438.8, the original application's filing date is 2022.07.07, and the original application's invention name is "a video processing method, electronic device and medium". The entire contents of the original application are incorporated herein by reference. TECHNICAL FIELD

[0002] The present application relates to the technical field of video processing, in particular to a video processing method, an electronic device and a medium. BACKGROUND

[0003] With the popularity of electronic devices with camera functions, users often use mobile phones, cameras and other electronic devices to record videos in various scenes, such as recording wedding ceremonies, celebrations, concerts and other scenes. However, a single electronic device can usually only record at a single fixed angle, and the lens is single. If the photographer is too far away from the target, the sound pickup effect will be poor, and if the distance is too close, it will be difficult to obtain a suitable angle of view. Therefore, it is difficult to obtain ideal video recording data with a single electronic device.

[0004] To obtain better video recording data, some commonly used methods are to use two or more cameras and other electronic devices to record the same scene from multiple angles and multiple directions at the same time to obtain more comprehensive sound and picture materials. For example, as shown in Figure 1 , camera A is needed to shoot close-up scenes, camera B is needed to shoot long-range scenes, and microphone C is needed to record sounds. In post-production, different shooting pictures and recorded sounds are selected to synthesize videos according to actual needs.

[0005] However, the above scheme generally requires manual arrangement of photographers in advance, and the shooting positions and scene types are divided to complete material collection, and all the shooting materials need to be collected on professional video processing equipment for video editing and other operations to synthesize videos. The entire process is complex, and the above method is mostly suitable for professional camera teams and is difficult to apply to ordinary users for shooting of daily life scenes. SUMMARY

[0006] To solve the technical problem that the entire process of the video processing and synthesis method is complex, and mostly only suitable for professional camera teams and difficult to apply to ordinary users for shooting of daily life scenes, the embodiments of the present application provide a video processing method, an electronic device and a medium.

[0007] In a first aspect, the present application provides a video processing method, which comprises:

[0008] The first processing device obtains a plurality of sets of recording data from a plurality of recording devices, wherein the plurality of recording devices belong to a same recording group; the first processing device belongs to the devices in the recording group; a first interface of the first processing device displays the plurality of sets of recording data; in response to a first operation of a user, the first processing device pre-processes the plurality of sets of recording data to generate a set of material clips, a second interface of the first processing device displays each material clip in the set of material clips; and in response to a second operation of the user, a third interface of the first processing device displays a synthesized video.

[0009] It can be understood that in the embodiments of the present application, the recording data generated by each electronic device in the recording group can be aggregated on any one or several electronic devices in the recording group for video synthesis processing, so that the recording data does not need to be transferred to an additional dedicated synthesis device, saving the operation process and facilitating operation.

[0010] In addition, the electronic device as the receiving device can pre-process all video data to generate material clips of various scenes corresponding to different targets and material tags corresponding to the material clips, so that the user's post-synthesis step in the video synthesis application can be greatly simplified, and ordinary non-professional users can also select material clips to synthesize videos by themselves. In the embodiments of the present application, there can be multiple receiving devices in the plurality of electronic devices, and then multiple users can synthesize videos according to their own needs.

[0011] In a possible implementation, the above method further includes that the first operation is an operation of triggering a pre-processing control of the first interface.

[0012] It can be understood that the first interface in the embodiments of the present application can be the material display interface mentioned in the embodiments of the present application.

[0013] In a possible implementation, when the pre-processing control is clicked, a selection submenu can be displayed in the material display interface, and the selection submenu can display a clip generation control, a subtitle generation control and a barrage generation control; when the clip generation control, the subtitle generation control and the barrage generation control are selected and the pre-processing control is clicked, the electronic device can pre-process all recording data in the recording group material folder to generate different scenes of material clips corresponding to each target person respectively, subtitle clips corresponding to each material clip, and barrage clips corresponding to non-target persons.

[0014] In a possible implementation, the second interface includes a track area, and the second operation is an operation of the user selecting at least one material clip in each material clip to a corresponding position of the track area and triggering a preview control.

[0015] It can be understood that the first interface in the embodiments of the present application can be the interface corresponding to the timeline tab in the video processing interface in the embodiments of the present application.

[0016] It can be understood that when the user clicks the preview control, the electronic device can perform video synthesis according to the material segments of the track area and the positions corresponding to the material segments.

[0017] In a possible implementation, the track area includes a video track, an audio track, a subtitle track, and a barrage track.

[0018] The video track includes a plurality of video tracks of different shots.

[0019] It can be understood that the plurality of video tracks can include tracks of various shots, such as a long shot track, a close-up shot track, and a close-up shot track, etc. It is convenient to better perform video synthesis and superimpose videos of multiple shots, for example, a long shot video and a close-up shot video can be superimposed in the same time period to present the superimposed video effect.

[0020] In a possible implementation, the preview area of the third interface displays the synthesized video.

[0021] It can be understood that the third interface in the embodiments of the present application can be the interface corresponding to the preview tab in the video processing interface mentioned in the embodiments of the present application.

[0022] The interface corresponding to the preview tab includes a preview area, and the preview area can be used to display and play the synthesized video.

[0023] In a possible implementation, the preview area includes one or more display areas, and each display area displays a corresponding synthesized video according to the material segments of the corresponding track area.

[0024] It can be understood that in some embodiments, the preview area of the electronic device can also display a plurality of display areas in split screen, and each display area can select different pictures according to user demand.

[0025] In some embodiments, the preview area can include a first display area and a second display area. When the user clicks the first display area, the user can edit the preview content of the first display area, that is, make any adjustment such as adding, reducing, or moving the material segments of the track area corresponding to the first display area. When the user clicks the second display area, the user can edit the preview content of the second display area, that is, make any adjustment such as adding, reducing, or moving the material segments of the track area corresponding to the second display area. In this way, the user can compare multiple preview video effects to select a suitable synthesized video.

[0026] In a possible implementation, the preview area includes a plurality of display areas, a part of the plurality of display areas display the synthesized video, and another part of the plurality of display areas display the material segments selected by the user.

[0027] It can be understood that in some embodiments, the preview area of the electronic device can also display multiple display areas in split screen mode, and some display areas can be used to preview the synthesized video, and other display areas can be used to magnify the user-selected material segment for the user to watch.

[0028] In a possible implementation, the video of the same time point in the synthesized video includes video of at least one view.

[0029] It can be understood that in some embodiments, the synthesized video displayed in the preview area can be superimposition of videos of multiple views, for example, superimposition of long shot video and close-up video, etc. In this way, the video content can be enriched.

[0030] In a possible implementation, in response to a third operation of the user, the synthesized video is switched from the first synthesized video to the second synthesized video.

[0031] It can be understood that in some embodiments, the panoramic video can be automatically displayed in the preview area or each display area, and a selection switching function is added to the video synthesis interface, for example, the panoramic video of a certain time period can be switched to the close-up video, etc.

[0032] In some embodiments, the first synthesized video can be a panoramic video, that is, the panoramic video can be automatically displayed in the preview area. The video synthesis interface is provided with a switching control, when the user clicks the switching control, the video synthesis interface can pop up other view videos existing in the current corresponding time period, for example, there are long shot target X1 video and close-up target X1 video, when the user clicks the corresponding other view video, the other view video of the time period, that is, the second synthesized video, will replace the panoramic video.

[0033] It can be understood that in some embodiments, the first synthesized video can be the current synthesized video, when the user clicks the switching control, the video synthesis interface can pop up each view video existing in the current corresponding time period, when the user clicks the corresponding view video, the other view video of the time period, that is, the second synthesized video, will replace the current synthesized video.

[0034] In a possible implementation, the third operation is an operation of clicking the switching control on the third interface.

[0035] In a possible implementation, the first processing device, in response to a fourth operation of the user on the target material segment, prompts the region position corresponding to the target material segment in the track area.

[0036] It can be understood that in the embodiments of the present application, the first processor device can display the corresponding position of the target material segment in the track area according to the time mark information of the target material segment. In this way, it is convenient for the user to drag the material label to the corresponding track area.

[0037] In a possible implementation, the fourth operation is a click operation.

[0038] In a possible implementation, the region position corresponding to the target material segment is prompted in the track region, including:

[0039] The region position corresponding to the target material segment is highlighted in the track region.

[0040] It can be understood that, in the embodiments of the present application, the prompt manner of the region position corresponding to the target material segment in the track region can be any manner such as highlighting or color highlighting.

[0041] In a possible implementation, the first processing device receives time mark information and recording content labels corresponding to the recording data sent by the plurality of recording devices.

[0042] It can be understood that, in the embodiments of the present application, the recording content labels corresponding to the recording data can be labels obtained by each electronic device identifying the data recorded by itself, or can be labels freely selected by the user through the group interface operation of the electronic device. The time mark information corresponding to each recording data can be obtained by each electronic device recording the time of the data recorded by itself.

[0043] In a possible implementation, the first processing device identifies the plurality of groups of recording data to obtain the recording content labels of each group of recording data.

[0044] It can be understood that, in some embodiments, the recording content labels corresponding to the recording data can be labels obtained by the receiving device uniformly identifying the recording data after obtaining the recording data.

[0045] In a possible implementation, the first processing device identifies the plurality of groups of recording data to obtain the time mark information corresponding to the plurality of groups of recording data.

[0046] It can be understood that, in some embodiments, the electronic devices in the recording group can also not obtain the time mark information, but the receiving device can align the time points by identifying the audio and video content of different recording data after receiving each recording data, so as to obtain uniform time mark information.

[0047] In a possible implementation, the time mark information includes the start time and / or end time and / or special mark time corresponding to each recording data.

[0048] It can be understood that during the recording process, the electronic device can automatically record the start time and end time of the recording. The user can mark a special time point during the recording of the video when recording a key part or a moment that the user wants to record, to obtain a special marked time. The special time point marking method can be various, for example, through a voice instruction method, the user can send a "mark" voice instruction, and the electronic device can mark the current time point when the voice instruction is recognized. It can also be any other implementable method.

[0049] In a possible implementation, the recording content label includes a scene label and a recording category label.

[0050] In a possible implementation, the scene label includes a long shot label, a medium shot label, a close-up label, and a close-up label.

[0051] The recording category label includes a video label and an audio label.

[0052] In a possible implementation, the material segment set includes video material segments of different scenes corresponding to each target respectively, audio material segments corresponding to each target respectively, material labels corresponding to the video material segments and the audio material segments respectively, time mark information, and subtitle information included in the plurality of sets of recording data.

[0053] In a possible implementation, the material segment set further includes barrage information corresponding to audio of non-targets included in the plurality of sets of recording data, and time mark information corresponding to the barrage information.

[0054] In a possible implementation, the plurality of sets of recording data are preprocessed to generate the material segment set, including:

[0055] The video data in each set of recording data is processed to obtain video material segments of different scenes corresponding to each target respectively, and material labels and time mark information corresponding to the video material segments.

[0056] The audio data in each set of recording data, and the audio stream data in the video data of each set of recording data are audio processed to obtain audio segments corresponding to each target respectively, and material labels, time mark information, and subtitle information corresponding to the audio segments.

[0057] It can be understood that in the embodiments of the present application, the manner of audio processing of the audio data can include pre-processing the data using a multi-channel joint processing algorithm, wherein the multi-channel joint processing algorithm can include a multi-channel noise reduction algorithm, a speech separation algorithm, and a speech recognition algorithm, etc. In some embodiments, the manner of audio processing of each data can be to first perform noise reduction processing on the data by a multi-channel noise reduction algorithm, and then perform separation processing on the data obtained after noise reduction processing by a speech separation algorithm, to obtain audio clips corresponding to each target respectively, and obtain the material tags, time mark information and subtitle information corresponding to the audio clips.

[0058] In the embodiments of the present application, the manner of processing the video data can include processing each recording data using a pedestrian re-identification algorithm to obtain video material clips of different scenes corresponding to each target respectively. Then the material tags and time mark information corresponding to the video material clips are obtained.

[0059] It can be understood that in some embodiments, when the synthesized video is played, the corresponding audio can be played when the picture switches to the picture corresponding to the scene.

[0060] It can be understood that the synthesized video mentioned in the embodiments of the present application includes video stream data and audio stream data, that is, the corresponding audio can be played at the same time as the video picture is played.

[0061] In some embodiments, after previewing the video, the electronic device can play the synthesized video in response to the user's play operation. Wherein, the electronic device can play in any implementable form based on the user's selection, for example, it can be played at any play speed, etc.

[0062] In a possible implementation, the plurality of recording devices includes a first processing device.

[0063] It can be understood that in the embodiments of the present application, any device in the recording group, for example, the first processing device, can only receive video data sent by other devices for processing without recording, or can both record and receive video data sent by other devices for processing.

[0064] In a possible implementation, the devices in the recording group include first type devices, or first type devices and second type devices.

[0065] The first type device is a device with wireless network function, the first type devices are connected to the same wireless network, and the first processing device is a first type device.

[0066] The second type device is a device without wireless network function but with Bluetooth function, and the second type device is connected to the first type device through the Bluetooth function.

[0067] In a possible implementation, the first processing device sends the recording data acquired by the first processing device to a second processing device in the recording group.

[0068] It can be understood that in the embodiments of the present application, the first processing device can also send the acquired recording data to other receiving devices in the recording group.

[0069] In a second aspect, the embodiments of the present application provide an electronic device, comprising: a data transceiver module, configured to acquire a plurality of sets of recording data from a plurality of recording devices, wherein the plurality of recording devices belong to a same recording group; a first processing device belongs to a device in the recording group; a data processing module, configured to, in response to a first operation of a user, pre-process the plurality of sets of recording data to generate a set of material segments; and the data processing module is configured to, in response to a second operation of the user, generate a synthesized video based on a material segment selected by the user.

[0070] In a possible implementation, the electronic device further comprises a data acquisition module, and the data acquisition module is configured to acquire the recording data.

[0071] In a possible implementation, the electronic device further comprises a center control module, and the center control module is configured to, in response to a group creation operation of a user, create a recording group.

[0072] In a possible implementation, the center control module is further configured to, in response to a join existing group operation of the user, control the electronic device to join an existing recording group.

[0073] In a third aspect, the present application provides an electronic device, comprising: a memory, configured to store instructions executed by one or more processors of the electronic device; and a processor, which is one of the one or more processors of the electronic device, and is configured to execute the video processing method mentioned in the present application.

[0074] In a fourth aspect, the present application provides a readable storage medium, characterized in that the readable medium stores instructions, and the instructions, when executed on an electronic device, cause the electronic device to execute the video processing method mentioned in the present application.

[0075] In a fifth aspect, the present application provides a computer program product, characterized in that the computer program product comprises instructions, and the instructions, when executed on an electronic device, cause the electronic device to execute the video processing method mentioned in the present application. BRIEF DESCRIPTION OF DRAWINGS

[0076] Figure 1 According to some embodiments of the present application, a recording scene schematic diagram is shown;

[0077] Figure 2 According to some embodiments of the present application, a schematic diagram of a video shooting method is shown;

[0078] Figure 3 According to some embodiments of the present application, a recording scene schematic diagram is shown;

[0079] Figure 4a According to some embodiments of the present application, a video project interface schematic diagram of an electronic device is shown;

[0080] Figure 4b According to some embodiments of the present application, a group selection interface schematic diagram of an electronic device is shown;

[0081] Figure 4c According to some embodiments of the present application, a new group interface schematic diagram of an electronic device is shown;

[0082] Figure 4d According to some embodiments of the present application, a WIFI setting interface schematic diagram of an electronic device is shown;

[0083] Figure 4e According to some embodiments of the present application, a group interface schematic diagram of an electronic device is shown;

[0084] Figure 4f According to some embodiments of the present application, a group interface schematic diagram of an electronic device is shown;

[0085] Figure 4g According to some embodiments of the present application, a video project interface schematic diagram of an electronic device is shown;

[0086] Figure 4h According to some embodiments of the present application, a material display interface schematic diagram of an electronic device is shown;

[0087] Figure 4i According to some embodiments of the present application, a video processing interface schematic diagram of an electronic device is shown;

[0088] Figure 4j According to some embodiments of the present application, a video processing interface schematic diagram of an electronic device is shown;

[0089] Figure 4k According to some embodiments of the present application, a video processing interface schematic diagram of an electronic device is shown;

[0090] Figure 4l According to some embodiments of the present application, a group interface schematic diagram of an electronic device is shown;

[0091] Figure 4m According to some embodiments of the present application, a video processing interface schematic diagram of an electronic device is shown;

[0092] Figure 4n According to some embodiments of the present application, a schematic diagram of a video processing interface of an electronic device is shown;

[0093] Figure 4o According to some embodiments of the present application, a schematic diagram of a video processing interface of an electronic device is shown;

[0094] Figure 4p According to some embodiments of the present application, a schematic diagram of a video processing interface of an electronic device is shown;

[0095] Figure 4q According to some embodiments of the present application, a schematic diagram of a video processing interface of an electronic device is shown;

[0096] FIG. 4r shows a schematic diagram of a video processing interface of an electronic device according to some embodiments of the present application;

[0097] Figure 5 According to some embodiments of the present application, a schematic diagram of a structure of an electronic device is shown;

[0098] Figure 6 According to some embodiments of the present application, a schematic diagram of a video processing method is shown;

[0099] Figure 7 According to some embodiments of the present application, a schematic diagram of a connection of a plurality of electronic devices is shown;

[0100] Figure 8 According to some embodiments of the present application, a schematic diagram of an existing group interface of an electronic device is shown;

[0101] Figure 9 According to some embodiments of the present application, a schematic diagram of a recording interface of an electronic device is shown;

[0102] Figure 10 According to some embodiments of the present application, a schematic diagram of data transmission between electronic device A1, electronic device B1 and electronic device C1 in a recording group is shown;

[0103] Figure 11 According to some embodiments of the present application, a schematic diagram of a video processing interface of an electronic device is shown;

[0104] Figure 12 According to some embodiments of the present application, a schematic diagram of a structure of an electronic device is shown. DETAILED DESCRIPTION

[0105] Illustrative embodiments of the present application include, but are not limited to, a video processing method, an electronic device and a medium.

[0106] As described above, in the prior art, the video shooting scheme is complex in operation, and can only be applied to professional camera teams, and is difficult to be applied to ordinary users for shooting daily life scenes.

[0107] To solve the above problems, some embodiments provide a video shooting method, as shown in the following table: Figure 2 As shown in the table, the shooting method comprises: forming a local area network by a plurality of electronic devices, wherein the plurality of electronic devices can comprise a control terminal for sending a control instruction, a teleprompter for playing a subtitle during shooting of video files by all other shooting terminals, and a plurality of shooting terminals for shooting videos, such as a first shooting terminal, a second shooting terminal, a third shooting terminal, and a fourth shooting terminal. The plurality of electronic devices can form a local area network by being connected under the same WiFi or by being connected to each other through Bluetooth, and the control terminal can send a clock instruction for unified shooting time to other shooting terminals through built-in online management software, so as to ensure that all shooting terminals shoot at the same time, and the teleprompter plays a subtitle during shooting of video files by all other shooting terminals. Finally, all the video files shot by the shooting terminals are manually copied and collected on a professional video editing device for synthesis processing.

[0108] The above scheme can realize simultaneous shooting of video files by the control terminal and other shooting terminals through online connection of the control terminal and other shooting terminals. In this way, manual arrangement is reduced to a certain extent, and the operation process is simplified.

[0109] However, in the above shooting process, if any shooting terminal delays the start of shooting due to failure to receive a shooting instruction or other reasons, the shooting data cannot be aligned with the data shot by other shooting terminals, affecting subsequent video editing and synthesis.

[0110] In addition, when synthesizing the video, all the shot video files still need to be collected on another video editing device through manual copying, and all the collected audio and video materials need to be preprocessed, edited, spliced, and other complex operations by professional operators. In addition, the specific content of the video data can be known only after all the video data are watched during video processing. Therefore, a lot of time is also needed in the process of selecting materials for video synthesis. In summary, the above scheme still has the problems of complex scheme and difficulty in being applied to ordinary users.

[0111] To solve the above problems, the embodiment of the present application provides a video processing method, comprising: a plurality of electronic devices establish a recording group by connecting in the same wireless network or by Bluetooth connection and the like; after the recording group is established, any electronic device in the plurality of electronic devices can perform audio and / or video recording to obtain recording data, and each electronic device can obtain time mark information corresponding to the recording data and recording content labels; then the recording data and the corresponding time mark information and recording content labels are stored correspondingly, and the recording data and the corresponding time mark information and recording content labels are sent to a receiving device in the plurality of devices. It can be understood that each electronic device in the recording group can become a receiving device.

[0112] The receiving device can obtain the recording data and the corresponding time mark information and recording content labels sent by other devices in the recording group; and pre-process each recording data based on the obtained time mark information and recording content labels of each recording data to generate a material segment set, wherein the material segment set can include material segments of different scenes corresponding to each target in the recording data respectively, and material labels and time mark information corresponding to the material segments. And the receiving device can send the material segment set to a video application program in the receiving device. And display the material segments in the video application program in the video synthesis interface, and display the material segments in the video synthesis interface after sorting the material segments according to a unified time axis based on the time mark information of each material segment. Then the receiving device synthesizes the corresponding video based on the material segments selected by the user.

[0113] It can be understood that in some embodiments, the plurality of devices can also record respectively to obtain recording data, and then establish a recording group. The non-receiving devices of the plurality of devices send the recording data to the receiving device in the plurality of devices, the receiving device receives the recording data sent by other non-receiving devices, and pre-processes each recording data received and the recording data obtained by the receiving device itself to obtain a material segment set.

[0114] It can be understood that the electronic devices in the recording group can be divided into two categories. The first category of devices are mobile phones, tablet computers and the like with wireless network function, wherein the devices with wireless network function can refer to devices with WiFi function or mobile communication and the like wireless network function. The first category of devices can join or create a recording group by connecting in the same wireless network. The second category of devices are microphones, Bluetooth earphones and the like without wireless network function but with Bluetooth function. Among them, the second category of devices can join the recording group through the first category of devices as relay nodes.

[0115] It can be understood that, since the receiving device in the recording group in the embodiment of the present application needs to perform video synthesis through the video application program, in some embodiments, only the electronic device that can install the video application program can become the receiving device. The way to become the receiving device can be that each electronic device selects to become the receiving device in the recording group, or each electronic device sends a pop-up window to ask the user during recording, and selects based on the user's determination.

[0116] It can be understood that, in some embodiments, the electronic devices in the recording group can also transmit the recording data to the cloud, so that any electronic device in the recording group can download each recording data from the cloud to perform video synthesis.

[0117] It can be understood that, in the embodiment of the present application, the recording data generated by each electronic device in the recording group can be aggregated on any one or several electronic devices in the recording group for video synthesis processing, so that it is not necessary to transfer the recording data to an additional dedicated synthesis device, saving the operation process and facilitating the operation.

[0118] It can be understood that the above-mentioned time mark information can include the recording start time and / or the recording end time recorded by the electronic device. The time mark information is used to align the time of each video data or audio data for facilitating post-editing and synthesis. It can be understood that, in some embodiments, the recording start time and the recording end time in the time mark information can be standard network time.

[0119] In this way, if the shooting of any electronic device is interrupted or not unified with other electronic devices, so that a non-full-time period video is obtained, in the later video processing, the non-full-time period video can still be aligned with the video of the corresponding time period in the other complete video according to the time mark information of the non-full-time period video, i.e., the recording start time and the recording end time.

[0120] In some embodiments, the time mark information can also include a special time point mark. For example, the user can perform a special time point mark when recording a key part or an important time point that the user wants to record during recording the video. The way of the special time point mark can be various, for example, through a voice instruction mode, the user can send a voice instruction of "mark", and the electronic device can perform a special mark on the current time point when recognizing the voice instruction. It can be understood that the above-mentioned way of performing a special time point mark through a voice instruction is only an example, and in the embodiment of the present application, the way of performing a special time point mark can also be a key mode or any other implementable mode.

[0121] In some embodiments, the electronic devices in the recording group can also not acquire the time mark information, but receive the devices to acquire the unified time mark information by identifying the audio and video content of different recording data to realize the alignment of time points after receiving each recording data. For example, the starting time of the longest time recording data can be set as 00:00, and then the ending time is determined according to the time length of the longest time recording data. In this way, by identifying the audio or video of the recording data, the starting time or ending time of other recording data is determined, for example, the 00:06 time point of the longest time recording data of the starting time point of the recording data E is aligned, then the starting time of the recording data E can be set as 00:06, and then the ending time is determined according to the time length of the recording data E.

[0122] It can be understood that the recording content label described above can include a category label reflecting the recording category and a scene label reflecting the main shooting scene in the video data, etc. Among them, the category label can include a video or audio label; the scene label can include one or several of medium shot, close-up and long shot, close-up label, etc. Among them, different scenes can be understood as different content or different scenes. Different scenes can be different corresponding lens pictures, for example, close-up can refer to a picture in which the target object occupies more than half of the picture frame when the target object is represented. Medium shot can refer to a picture that can describe most of the area of the target object, for example, a picture of the upper part of the knee of a person, and the viewing distance is slightly farther than close-up, which is beneficial to display the shape and action of the person. Long shot can refer to a picture that includes distant scenery and target objects, which can be used to show the spatial background or environmental atmosphere of the target object activity. Close-up can refer to a detail picture of the target object. In some embodiments, in different scenes, the proportion of the same object in the picture is different. For example, the proportion of the same person in close-up, close-up, medium shot and long shot decreases in turn.

[0123] It can be understood that the recording content label described above can be a label freely selected by the user through the relevant interface operation of the electronic device, so that the user can record according to the label.

[0124] In some embodiments, the recording content label described above can also be used to identify the data recorded by each electronic device, or the label obtained by unified identification of each recording data after the recording data is obtained by the receiving device. For example, each electronic device can determine whether the recording data is audio data or video data according to the content of the recording data to obtain the category label of the recording data. Each electronic device can determine the scene label of the video data according to the size of the target element in the recorded video data, for example, when the size of the target person in the video data is greater than a set value, it can be determined that the video data is close-up data, and the corresponding scene label is close-up label; when the size of the target object in the video data is less than a set value, it can be determined that the video data is long shot data, and the corresponding scene label is long shot label, wherein the target object can be a target person, or a target object, etc.

[0125] In some embodiments, the recording content label described above can also be used to identify the data recorded by each electronic device, or the label obtained by unified identification of each recording data after the recording data is obtained by the receiving device. For example, each electronic device can determine whether the recording data is audio data or video data according to the content of the recording data to obtain the category label of the recording data. Each electronic device can determine the scene label of the video data according to the size of the target element in the recorded video data, for example, when the size of the target person in the video data is greater than a set value, it can be determined that the video data is close-up data, and the corresponding scene label is close-up label; when the size of the target object in the video data is less than a set value, it can be determined that the video data is long shot data, and the corresponding scene label is long shot label, wherein the target object can be a target person, or a target object, etc.

[0126] It can be understood that through the recording content label, the recording content of each recording data can be directly obtained, without the need to watch all video data to know the specific content of the video data, which facilitates subsequent video processing.

[0127] It can be understood that the above-mentioned pre-processing of all video data based on the time mark information and the recording content label of each recording data can generate material segments including segments corresponding to different scenes and different targets, and the material segment label is a label marking the content of the material segment. For example, the material segment can include a medium shot segment corresponding to target X1 and a long shot segment corresponding to target X2, and the corresponding material segment label can be medium shot target X1 and long shot target X2.

[0128] In some embodiments, the electronic device can pre-process all video data based on the time mark information and the video recording label of each video data to generate material segments and labels corresponding to the material segments; which can include:

[0129] The electronic device can preliminarily classify the recording data based on the recording content label, for example, the recording data can be divided into an audio set and a video set according to the category label;

[0130] The audio processing is performed on each data in the audio set to obtain corresponding sound material segments of different target persons, and the label and time mark information corresponding to the sound material segments are generated. For example, the material segments in the audio set can include sound material segments corresponding to target X1 and sound material segments corresponding to target X2, and the corresponding material labels can be target X1 audio and target X2 audio, respectively.

[0131] The manner of audio processing each data in the audio set can include pre-processing the data using a multi-channel joint processing algorithm, wherein the multi-channel joint processing algorithm can include a multi-channel noise reduction algorithm, a speech separation algorithm, and a speech recognition algorithm. In some embodiments, the manner of audio processing each data can be to first perform noise reduction processing on the data by a multi-channel noise reduction algorithm, and then perform separation processing on the data obtained after noise reduction processing by a speech separation algorithm to obtain the speech corresponding to each target person or non-target person.

[0132] In some embodiments, when the recorded video is played, the corresponding audio can be played when the screen switches to the screen corresponding to the scene. For example, when the playing screen of the video is a close-up screen of target X1, the sound can automatically switch to the sound of target X1, and the sounds of other targets can be considered as noise and reduced or removed, for example, the sound of target X2 and / or the environmental sound can be reduced or removed.

[0133] Then, according to the scene label of each data in the video data set, each data in the video set can be divided into a long shot sub-set, a close-up sub-set, and a close-up sub-set. Then, each recording data in each sub-set is identified and extracted to obtain material segments corresponding to different target objects in each sub-set and material labels. For example, the long shot sub-set in the video set can include material segments corresponding to target X1 and material segments corresponding to target X2, and the material labels can be long shot target X1 video and long shot target X2 video.

[0134] In the embodiments of the present application, the manner of processing each recording data in the video set can include processing each recording data using a pedestrian re-identification algorithm to obtain material segments corresponding to different target persons in each sub-set. It can be understood that in the embodiments of the present application, if a same material segment includes multiple target persons, the material segment can belong to the material segments corresponding to multiple target persons, respectively. For example, a material segment includes target X1 and target X2, and the material segment belongs to the material segment corresponding to target X1 and the material segment corresponding to target X2.

[0135] It can be understood that the video synthesis interface in the video application program can display the above-mentioned material segments so as to facilitate the user to select the material segments for video synthesis.

[0136] In the embodiment of the present application, the electronic device as the receiving device can preprocess all the video data according to the time mark information of each video data and the recording content label, generate various scene material segments corresponding to different targets and the material labels corresponding to the material segments, so that the post-synthesis step of the user in the video synthesis application program can be greatly simplified, and even the ordinary non-professional user can also select the material segments for video synthesis. In the embodiment of the present application, there can be multiple receiving devices in multiple electronic devices, and then multiple users can synthesize videos according to their own needs.

[0137] The above-mentioned video processing method in the present application can be applied in any scene where the video recording using the electronic device is needed, such as the wedding, the celebration, the concert, the competition site and the like. The following will take the recording of the speech site by the electronic device A, the electronic device B and the electronic device C as an example to describe the video processing scheme of the present application.

[0138] As shown in Figure 3 , the electronic device A1, the electronic device B1, the electronic device C1 and the electronic device D1 record the speech site, the speech person includes the target X1 and the target X2, the electronic device A1, the electronic device B1 and the electronic device C1 can all be mobile phones, and the electronic device D1 can be a microphone. The electronic device A1, the electronic device B1 and the electronic device C1 are simultaneously connected to the wireless network with the account name of "PH888". In some embodiments, the electronic device D1 can not have the wireless network function, but have the Bluetooth function, and the electronic device D1 can be connected to the electronic device B1 through the Bluetooth, so as to transmit the recorded audio data to other devices in the wireless network.

[0139] At this time, the electronic device A1, the electronic device B1, the electronic device C1 and the electronic device D1 first perform networking. For example, in some embodiments, as shown in Figure 4a , the user can open the video synthesis application program through the electronic device A1, and when the new video project control 4011 in the video project interface 401 of the video synthesis application program is clicked, the electronic device A1 will jump to the group selection interface 402 as shown in Figure 4b , the group selection interface 402 can display the new group control 4021 and the search existing group control 4022. When the new group control is clicked, it will jump to the new group interface 403 as shown in Figure 4c , and when the search existing group control 4022 is clicked, the existing groups will be displayed.

[0140] In some embodiments, the way of creating a new recording group can also be any implementable way of creating a group, such as scanning a two-dimensional code, creating a group face to face, inputting the same password, and the like.

[0141] The new group creation interface 403 can display a WIFI control 4031 and the name of the current wireless network to which the electronic device A1 is connected. When the WIFI control 4031 is clicked, the electronic device A1 will jump to the WIFI setting interface 002 as shown in Figure 4d The new group creation interface 403 can also display the icons and names of the electronic devices connected to the wireless network with the account name "PH888", for example, the icons 4032, 4033 and 4034 and the corresponding names PHA, PHB and PHC of the electronic devices A1, B1 and C1 respectively. The new group creation interface 403 can also display the icons and names of other electronic devices connected to the electronic devices through Bluetooth, for example, the icon 4035 and the corresponding name PHD of the electronic device D1 connected to the electronic device B1. The new group creation interface 403 can also display a group name control 4036 and a new group control 4037. When the group name control 4036 is clicked, the group name can be changed and set, for example, the group name is set to "recording group 1". When the new group control 4037 is clicked, a recording group can be created.

[0142] When the user clicks the new group control 4037, the electronic device A1 can display the group interface 404 as shown in Figure 4e The group interface can display the icons of the electronic devices A1, B1, C1 and D1, which are the icons 4032, 4032, 4034 and 4035 respectively. The group interface 404 can also display a label row, such as a close-up label row 4044, a medium shot label row 4045, a long shot label row 4046, an audio label row 4047, and the like. In addition, the group interface 404 can display a receiving device row 4048 and a start recording control 4049. Figure 4fAs shown, each user can select the recording content label by dragging the icon corresponding to his or her electronic device or other electronic device to the corresponding label row, and each user can also record according to the recording content label of each electronic device. In addition, the receiving device can also be determined by dragging the electronic device to the receiving device row 4048. For example, user A is the owner of electronic device A1, and user A can drag the icon 4041 corresponding to electronic device A1 to the close-up label row 4044 and the receiving device row 4048, respectively, drag the icon 4042 corresponding to electronic device B1 to the long shot label row 4046, drag the icon 4042 corresponding to electronic device C1 to the audio label row 4047, and drag the icon 4042 corresponding to electronic device D1 to the audio label row 4047.

[0143] It can be understood that in some embodiments, electronic device A1, electronic device B1, and electronic device C1 can all display any interface shown in FIG. 4B. Electronic device D1 cannot display the interface shown in FIG. 4B because it has no display, and therefore, electronic device D1 can control the recording process through the connected relay electronic device electronic device B1. For example, recording can be started synchronously with electronic device B1. Figures 4a-4q Figures 4a-4q It can be understood that in some embodiments, electronic device A1, electronic device B1, and electronic device C1 can all display any interface shown in FIG. 4B. Electronic device D1 cannot display the interface shown in FIG. 4B because it has no display, and therefore, electronic device D1 can control the recording process through the connected relay electronic device electronic device B1. For example, recording can be started synchronously with electronic device B1.

[0144] When each user clicks the start recording control on the corresponding electronic device, the camera or microphone of the electronic device itself can be controlled to start recording according to the selected recording category label. For example, user A clicks the start recording control 4049 of electronic device A1, and electronic device A1 can control the camera or microphone of electronic device A1 to start recording according to the selected recording category label. For example, when the recording content label selected by electronic device A1 is the audio label, electronic device A1 can control the microphone of electronic device A1 to start recording, and when the recording content label selected by electronic device A1 is the medium shot label, the long shot label, or other video category label, electronic device A1 can control the camera of electronic device A1 to start recording. The recording start time and recording end time are recorded, and the recorded content can be stored in correspondence with the recording content label corresponding to the label row where electronic device A1 is located.

[0145] In some embodiments, when user A clicks the start recording control 4049 of electronic device A1, electronic device A1 can not record, but as a receiving device, electronic device A1 can receive the recording data and corresponding recording content label and time mark information sent by electronic device B1, electronic device C1, and electronic device D1. In some embodiments, when user A clicks the start recording control 4049 of electronic device A1, electronic device A1 can also control electronic device B1, electronic device C1, and electronic device D1 to start recording.​

[0146] It can be understood that in some embodiments, the user can exist in part of the time without shooting based on the selected scene, for example, the user may select the long shot tag, but in the shooting process, the user shoots the close-up for part of the time. At this time, the receiving device A1 will also extract the material fragments of different scenes corresponding to the sub-set when identifying and extracting each recording data in each sub-set. For example, the receiving device A1 will also extract the close-up material fragments corresponding to different target people when identifying and extracting each recording data in the long shot sub-set. The label of the material fragment can be close-up target X1 or close-up target X2.

[0147] In some embodiments, an electronic device can record more than two contents or scenes. For example, the electronic device A1 can record a long shot video and a close-up video at the same time, and the like.

[0148] In addition, in some embodiments, as shown in the example of FIG. 4B, the recording group 1 material folder 4012 corresponding to the current recording group can be displayed in the video project interface 401 of the electronic device A1. When the recording group 1 material folder 4012 is clicked, the electronic device can display a material display interface 405 as shown in FIG. 4C, in which the recording data recorded by the electronic device itself and the recording data received by other electronic devices can be displayed, for example, the close-up 1 recording data recorded by the electronic device A1, the long shot 1 recording data recorded by the electronic device B1, and the audio 1 recording data recorded by the electronic device C1 and the audio 2 recording data recorded by the electronic device D1. Figure 4g Figure 4h

[0149] It can be understood that in some embodiments, if the electronic device A1 also receives the recording data of other recording groups, the video project interface 401 of the electronic device A1 can also display the material folders corresponding to the other recording groups.

[0150] ​​The preprocessing control 4051 can also be displayed in the material display interface 405. When the preprocessing control 4051 is clicked, a selection submenu 4052 can be displayed in the material display interface 405. The selection submenu 4052 can display a clip generation control 4053, a subtitle generation control 4054, and a bullet screen generation control 4055. The clip generation control 4053 is used to generate different scene material clips corresponding to each target person based on the video recording data. The subtitle generation control 4054 is used to generate a subtitle clip corresponding to each material clip based on the audio and the audio of the target person in the video recording data. The bullet screen generation control 4055 is used to generate a corresponding subtitle clip based on the audio of a non-target person in the audio and video recording data. The subtitle clip corresponding to the audio of the non-target person can be displayed as a bullet screen in the video.

[0151] When the clip generation control 4053, the subtitle generation control 4054, and the bullet screen generation control 4055 are selected, and the preprocessing control 4051 is clicked, the electronic device can preprocess all recording data in the recording group 1 material folder 4012 to generate different scene material clips corresponding to each target person, subtitle clips corresponding to each material clip, and bullet screen clips corresponding to non-target persons.

[0152] When the preprocessing control 4051 is clicked, the electronic device A1 can display a video processing interface 406 as shown in Figure 4i The video processing interface can include a material tab 4061, a timeline tab 4062, and a preview tab 4063. When the material tab 4061 is clicked, the electronic device A1 will display each material clip preprocessed by the electronic device A1 as shown in Figure 4i When the timeline tab 4062 is clicked, the electronic device A1 will display a material clip arrangement area 4064, a timeline 4065, and a track area as shown in Figure 4j The track area can include a video track 4066, an audio track 4067, a subtitle track 4068, and a bullet screen track 4069. The materials displayed in the material clip arrangement area 4062 can be directly dragged to the corresponding track area to complete video editing and synthesis.

[0153] When the preview tab 4063 is clicked, the synthesized video can be previewed in the preview area 4060 as shown in Figure 4k The video can include corresponding subtitles and bullet screens.

[0154] It can be understood that in some embodiments, when the synthesized video is played, when the picture switches to the picture corresponding to the scene, the corresponding audio can be played. For example, when the playing picture of the video is the close-up picture of target X1, the sound can be automatically switched to the sound of target X1, and the sounds of other targets can be considered as noise and reduced or removed, for example, the sound of target X2 and / or the environmental sound can be reduced or removed.

[0155] It can be understood that in some embodiments, each video-type material segment in the material segment set has a corresponding audio segment and a subtitle segment. When the user drags the video-type material segment to the video track 4066, the electronic device can automatically identify the audio segment and the subtitle segment corresponding to the video-type material segment and automatically place the audio segment and the subtitle segment corresponding to the video-type material segment in the corresponding positions of the corresponding track area.

[0156] For example, as shown in Figure 4k , when the user drags the close-up material segment of target X2 to the video track 4066, the electronic device places the audio segment of target X2 in the same time period of the close-up material segment of target X2 in the corresponding area of the audio track 4067, and places the subtitle segment of target X2 in the same time period in the corresponding area of the subtitle track 4068.

[0157] It can be understood that in some embodiments, in order to better synthesize the video, there can be multiple video tracks in the track area, which can include various types of tracks, such as long shot tracks, close-up tracks, and close-up tracks, etc. For example, as shown in Figure 4l , the video track in the track area includes a long shot track 4071 and a close-up track 4072. In this way, the superposition of videos of multiple types can be realized, for example, the long shot video 4081 and the close-up video 4082 in Figure 4l can be superimposed in the same time period, presenting the superimposed video effect as shown in Figure 4l .

[0158] It can be understood that in some embodiments, the preview area of the electronic device can also display multiple display areas in split screen, and each display area can select different pictures according to user needs. For example, as shown in Figure 4m , the preview area 4060 can include a first display area 4091 and a second display area 4092. When the user clicks the first display area 4091, the user can edit the preview content of the first display area 4091, for example, as shown in Figure 4m , the first display area displays the barrage information "good" by dragging the barrage information "good" to the barrage track; as shown in Figure 4nAs shown, when a user clicks on the second display area 4092, they can edit the preview content in the second display area 4092. For example, if they drag the bullet message "666" to the bullet message track, the preview video in the second display area 4092 will display the bullet message "666". This allows users to compare the effects of multiple preview videos and select the appropriate composite video.

[0159] It will be appreciated that in some embodiments, corresponding save selection controls 4093 and delete selection controls 4094 may be provided below the first display area 4091, and corresponding save selection controls 4095 and delete selection controls 4096 may be provided below the second display area 4091. Clicking the save selection control saves the video in the corresponding display area, and clicking the delete selection control deletes the video in the current display area, allowing the preview content in the display area to be edited again.

[0160] It can be understood that in some embodiments, the first display area 4091 can also be used to preview the synthesized video, and the second display area 4092 can be used to magnify the material clip selected by the user for easy viewing by the user.

[0161] It is understood that in some embodiments, such as Figure 4o As shown, the second display area 4092 can be displayed in an overlapping manner with the first display area 4091. Specifically, the first display area 4091 can display the preview composite video, and the second display area 4092 can be used to display a close-up video of the target person, such as a close-up video of the target X1.

[0162] In some embodiments, the panoramic video can be automatically displayed in the preview area or each display area, and a selection switching function is added to the video synthesis interface, for example, the panoramic video of a certain time period can be switched to a close-up video. Figure 4p As shown, the preview area 4060 automatically displays the panoramic video. A switching control 4097 is set on the video synthesis interface 406. When the user clicks the switching control 4097, the video synthesis interface 406 can pop up videos of other scenes in the current corresponding time period. For example, there is a close-up target X1 video and a close-up target X1 video. When the user clicks on the corresponding other scene videos, the other scene videos in the time period will replace the panoramic video. For example, when the user clicks on the close-up target X1 video, the panoramic video of the time period will be replaced by the other scene videos. Figure 4q As shown, it will switch to a close-up video of target X1.

[0163] It can be understood that in some embodiments, the current synthesized video can also be displayed in the preview area 4060, and when the user clicks the switching control 4097, the videos of each scene existing in the current time period can be popped up on the video synthesis interface 406, and when the user clicks the video of the corresponding scene, the videos of other scenes in the time period will replace the current synthesized video.

[0164] It can be understood that the setting mode of the video synthesis interface 606 in the embodiments of the present application is only an example, and the setting mode of the video synthesis interface 606 in the embodiments of the present application can be any combination of the above-mentioned multiple schemes. For example, as shown in FIG. 6c, in the embodiments of the present application, the video synthesis interface can include a first display area 4091, a second display area 4092, a save selection control 4093 corresponding to the first display area 4091, a delete selection control 4094, and a switching control 4097. The lower part of the second display area 4091 can be provided with a corresponding save selection control 4095, a delete selection control 4096, and a corresponding switching control 4098. When the save selection control is clicked, the video of the corresponding display area can be saved, and when the delete selection control is clicked, the video of the corresponding display area can be deleted, and the preview content of the display area can be edited again. When the user clicks the switching control, the display content of the display area corresponding to a certain time period can be replaced with other material segments. Figure 4R

[0165] Before the video processing method provided in the embodiments of the present application is described in detail, the electronic device provided in the embodiments of the present application is first briefly introduced. As shown in FIG. 7a, the electronic device can include a data acquisition module, a data transceiver module, a central control module, an audio processing module, a video processing module, a user interaction module, and an audio / video synthesis module. Figure 5

[0166] The user interaction module is configured to detect user operations and send execution instructions corresponding to the user operations to the central control module.

[0167] The central control module can be configured to execute the received instructions. For example, the user interaction module can detect some user operations of creating a recording group and send a group creation instruction to the central control module. The central control module can create a group. The user interaction module can detect some user operations of joining a recording group and send a group joining instruction to the central control module. The central control module can control the electronic device to join the group.

[0168] ​​The data collection module can be used to control the microphone and the camera to record audio or video respectively, to obtain video data collected by the camera of the electronic device and audio data collected by the microphone, and to obtain recording content tags and time mark information corresponding to the recording data. The audio data, the corresponding recording content tags and the time mark information are sent to the audio processing module for audio processing, and the video data, the corresponding recording content tags and the time mark information are sent to the video processing module for video processing.

[0169] The data transceiving module can be used to obtain video data and audio data from other electronic devices in the recording group and recording content tags and time mark information corresponding to the data when the electronic device is a receiving device, and to send the video data and the audio data and the recording content tags and the time mark information corresponding to the data to other electronic devices in the recording group through a WIFI or other wireless communication module when the electronic device is a sending device.

[0170] The data processing module is configured to preprocess all the recording data based on the time mark information and the recording content tags of the recording data, and to generate a material set including material segments and material tags corresponding to the material segments.

[0171] The data processing module can include a classification module, an audio processing module and a video processing module.

[0172] The classification module is configured to preliminarily classify the recording data based on the recording content tags, for example, to divide the recording data into an audio set and a video set according to the category tags.

[0173] The audio processing module is configured to perform audio processing on each data in the audio set to obtain corresponding voice material segments of different target persons, and to generate tags corresponding to the voice material segments.

[0174] The video processing module is configured to divide each data in the video set into a long shot sub-set, a close-up sub-set and a close-up sub-set according to the scene tags of each recording data in the video data set. Then, each recording data in each sub-set is identified and extracted to obtain material segments corresponding to different target objects in each sub-set and material tags.

[0175] The sending module obtains the material segments processed by the audio processing module and the video processing module, and sends the material set including all the material segments to a video synthesis application program.

[0176] The audio-video synthesis module is configured to display a video synthesis interface in response to a user operation, and to synthesize a corresponding video based on material segments selected by the user in the video synthesis interface.

[0177] The video processing method provided by the embodiments of the present application will be described in detail below in combination with the electronic device described above. Among them, Figure 6 A flowchart of a video processing method according to an embodiment of the present application is shown. The video processing method provided by the embodiments of the present application can be executed by the electronic device described above, and the video processing method comprises:

[0178] 601: In response to a user operation, a recording group is created.

[0179] It can be understood that the electronic device can respond to some user operations for creating a recording group to achieve creating a group, or respond to some user operations for joining a recording group to achieve joining an existing group.

[0180] It can be understood that the electronic devices that can join the recording group can be divided into two categories. The first category of devices are mobile phones, tablet computers and other devices with wireless network functions, which can join or create a recording group by connecting to the same wireless network. The second category of devices are microphones, Bluetooth headsets and other devices that do not have wireless network functions but have Bluetooth functions. Among them, the second category of devices can join the recording group through the first category of devices as relay nodes, that is, the second category of devices can join the recording group by connecting to the first category of devices through Bluetooth.

[0181] In some embodiments, the electronic device can obtain the names of other electronic devices connected to the same wireless network as the device. And create a temporary recording group based on the user's selection of each electronic device connected to the same wireless network.

[0182] For example, as shown in Figure 7 , it is assumed that electronic device A1, electronic device B1 and electronic device C1 all have wireless network functions, and are connected to the wireless network with the account name "PH888" at the same time as shown in Figure 3 , electronic device D1 does not have wireless network function but has Bluetooth function and is connected to electronic device D1 through Bluetooth. Among them, electronic device A1, electronic device B1 and electronic device C1 can be mobile phones or microphones.

[0183] At this time, electronic device A1, electronic device B1, electronic device C1 and electronic device D1 first perform networking. For example, as shown in Figure 4a , the user can open the video synthesis application through electronic device A1. When the new video item control 4011 in the video item interface 401 of the video synthesis application is clicked, the electronic device A1 will jump to, for example, Figure 4bThe group selection interface 402 shown in FIG. 4 may display a create group control 4021 and a search existing group control 4022. When the create group control is clicked, the user is redirected to the create group interface 403. When the search existing group control 4022 is clicked, existing groups are displayed.

[0184] The new group interface 403 can display the WIFI control 4031 and the name of the current wireless network connected to the electronic device A1; when the WIFI control 4031 is clicked, the electronic device A1 will jump to the Figure 4d The WIFI setting interface 002. The new group interface 403 can also display the icons and names of the electronic devices connected to the wireless network with the account name "PH888", for example, it can include icons 4032, 4033 and 4034 corresponding to electronic device A1, electronic device B1 and electronic device C1, and the corresponding names PHA, PHB and PHC respectively; the new group interface 403 can also display the icons and names corresponding to other electronic devices connected to each electronic device via Bluetooth, such as the icon 4035 corresponding to electronic device D1 connected to electronic device B1 and the corresponding name PHD. The new group interface 403 can also display the group name control 4036 and the new group control 4037. When clicking the group name control 4036, the group name can be changed and set. For example, the group name can be set to "Recording Group 1". When clicking the new group control 4037, a new recording group can be created, that is, networking can be carried out.

[0185] It can be understood that FIG4 in the embodiment of the present application illustrates the method of creating a recording group by taking the electronic device A1 as an example of newly creating a recording group. In some embodiments, the electronic device A1 may also actively join an already created group.

[0186] For example, Figure 4b As shown, the search existing group control 4022 can be displayed in the group selection interface 402. When the new group control is clicked, when the user clicks the search existing group control 4022, the electronic device A1 can jump to Figure 8 The existing group interface 801 shown can display the created groups under the wireless network to which the current electronic device A1 is connected, such as recording group 1. The user can join the created group "recording group 1" by clicking the "join" control 8011.

[0187] It can be understood that in the embodiment of the present application, the above-mentioned method of creating a group and the interface of the electronic device are only examples, and the present application can also adopt any other feasible method of creating a group and interface setting method.

[0188] 602: Perform audio or video recording to obtain recording data, and obtain recording content tags corresponding to the recording data and time mark information.

[0189] It can be understood that the recording content tags described above can include category tags reflecting the recording category and scene tags reflecting the main shooting scene in the video data, etc. Among them, the category tags can include video tags or audio tags; the scene tags can include medium shot tags, close-up tags, long shot tags, and close-up tags, etc.

[0190] It can be understood that there can be various ways to obtain recording content tags in the embodiments of the present application, which will be introduced as follows:

[0191] In an implementable manner, the user can independently select the corresponding recording content tags on the group interface corresponding to the recording group. For example, when the user clicks the new group control 4037, the electronic device A1 can display the group interface 404 as shown in Figure 4e . Among them, the group interface can display the icons corresponding to the electronic device A1, the electronic device B1, the electronic device C1 and the electronic device D1, which are icon 4032, icon 4022, icon 4034 and icon 4035 respectively. The group interface 404 can also display the tag line, such as close-up tag line 4044, medium shot tag line 4045, long shot tag line 4046, audio tag line 4047, etc., in addition to the receiving device line 4048 and the start recording control 4049. As shown in Figure 4f , the user can drag the icon corresponding to the electronic device to the corresponding tag line to select the recording content tag corresponding to the recording data, and drag the electronic device to the receiving device line 4048 to become a receiving device. For example, the user can drag the icon 4041 corresponding to the electronic device A1 to the close-up tag line 4044 and the receiving device line 4048 respectively, drag the icon 4042 corresponding to the electronic device B1 to the long shot tag line 4046, drag the icon 4042 corresponding to the electronic device C1 to the audio tag line 4047, and drag the icon 4042 corresponding to the electronic device D1 to the audio tag line 4047.

[0192] When the user clicks the start recording control 4049, the electronic device A1 can call the camera or microphone to start recording according to the selected recording content tags. For example, when the recording content tag of the electronic device A1 is the audio tag, the electronic device A1 can call the microphone to start recording, and when the recording content tag selected by the electronic device A1 is the medium shot tag, the long shot tag, etc. Video category tags, the electronic device A1 can call the camera to start recording. And record the start time and end time of recording. And the recorded content can be stored in correspondence with the recording content tag corresponding to the tag line where the electronic device A1 is located.

[0193] In some embodiments, the electronic device can perform feature extraction or recognition on the recording data to generate recording content labels corresponding to the recording data after obtaining the recording data.

[0194] For example, the electronic device can use a neural network model or related algorithm to recognize the recording data to determine whether the recording data is audio data or video data, to generate corresponding audio labels or video labels. And recognize the video data to determine the scene label corresponding to the video data.

[0195] It can be understood that the above-mentioned time mark information can include recording start time and recording end time. The time mark information is used to align the time of each video data or audio data to facilitate post-editing and synthesis. For example, if any electronic device captures a non-full time period video due to interruption, the recording start time and the recording end time of the non-full time period video can still be obtained during post-video processing. In this way, the non-full time period video can be aligned with the video of the corresponding time period in other complete videos.

[0196] In some embodiments, the electronic device can record the start time and end time of the recording when recording, wherein the recording start time and end time recorded by the electronic device can be aligned with the network time.

[0197] 603: In the case of the electronic device as a receiving device, the recording data sent by other devices in the recording group and the corresponding time mark information and recording content labels are obtained.

[0198] It can be understood that in the embodiments of the present application, there can be many ways for the electronic device to become a receiving device. In one implementable way, as shown in the foregoing Figure 4f The group interface 404 of the electronic device can display a receiving device row 4048, and the user can drag the icon corresponding to the electronic device to the receiving device row 4048 to make the electronic device become a receiving device. It can be understood that there can be any number of electronic devices in the recording group to become receiving devices.

[0199] In some embodiments, the electronic device can also only choose to become a receiving device to receive the recording data sent by other devices in the recording group, without selecting other label rows and without recording video and audio by itself.

[0200] It can be understood that in some other embodiments, the electronic device can send a selection window of whether to become a receiving device to the recording interface after detecting the end of recording, and determine whether the electronic device becomes a receiving device based on the user's selection. For example, as Figure 9As shown, when the user selects the "Yes" control 9012 in the selection window 9011 of the recording interface 901 of the electronic device A1, the electronic device A1 will become a receiving device, which can be used to receive the recording data of other electronic devices in the recording group and the corresponding time mark information and recording content label.

[0201] When the user selects the "No" control 9013 in the selection window 9011 of the recording interface 901 of the electronic device A1, the electronic device A1 will become a sending device, which will actively send the recording data and the corresponding time mark information and recording content label to the receiving device after the recording is completed.

[0202] Figure 10 A schematic diagram of data transmission among the electronic device A1, the electronic device B1 and the electronic device C1 in the recording group is shown. It can be understood that each video data can include video stream data and audio stream data. As shown, Figure 10 As shown, the electronic device A1 is a receiving device, the electronic device B1, the electronic device C1 and the electronic device D1 are sending devices, the electronic device B1 can receive the video data recorded by the electronic device D1 through Bluetooth, and can send the received video data recorded by the electronic device D1 and the video data recorded by itself to the electronic device A1 through a wireless network, the electronic device C1 can send the recorded audio data to the electronic device A1 through a wireless network, the electronic device D1 can send the recorded audio data to the electronic device A1 through Bluetooth, and the electronic device A1 can perform video processing on the received data to obtain a synthesized video, as in embodiments 604-607 of the present application.

[0203] 604: Preprocess all recording data based on the time mark information and recording content label of each recording data to generate a material set, which includes material segments and the material tags and time mark information corresponding to the material segments.

[0204] It can be understood that in the embodiments of the present application, all video data can be preprocessed based on the time mark information and recording content label of each recording data to generate material segments and the material tags and time mark information corresponding to the material segments. The material segments can include segments corresponding to different shots and different target persons, and the material tags are labels marking the content of the material segments. For example, the material segments can include a medium shot corresponding to target X1 and a long shot corresponding to target X2, and the corresponding material tags can be medium shot target X1 and long shot target X2.

[0205] The time mark information corresponding to the material segments can include the start time and end time corresponding to the material segments.

[0206] The electronic device pre-processes all the video data based on the time mark information and the video recording label of each video data, generates the material segments and the material labels corresponding to the material segments; and can include:

[0207] The electronic device can preliminarily classify the recording data based on the recording content label, for example, can classify the recording data into an audio set and a video set according to the category label;

[0208] The audio processing is performed on each data in the audio set to obtain the corresponding sound material segments of different target persons, and the labels corresponding to the sound material segments are generated. For example, the material segments in the audio set can include the sound material segments corresponding to target X1 and the sound material segments corresponding to target X2, and the corresponding material labels can be target X1 audio and target X2 audio, respectively.

[0209] In the embodiments of the present application, the electronic device can also convert the audio content of the target person in each sound material segment into subtitles through a voice recognition algorithm. It can be understood that in the embodiments of the present application, the audio of non-target persons in the audio data can also be converted into bullet screens in the synthesized video. For example, in a speech recording scene, the video recorded includes the video and audio of target X1 and target X2, but also contains some audio of the audience on the scene. Therefore, the audio data corresponding to the audience on the scene can be converted into corresponding bullet screens displayed in the synthesized video.

[0210] In addition, the electronic device can divide each data in the video set into a long shot sub-set, a close-up sub-set, a close-up sub-set, and the like according to the scene label of each recording data in the video data set. Then, each recording data in each sub-set is identified and extracted to obtain the material segments corresponding to different target objects in each sub-set and the material labels. For example, the long shot sub-set in the video set can include the material segments corresponding to target X1 and the material segments corresponding to target X2, and the material labels can be long shot target X1 video and long shot target X2 video.

[0211] It can be understood that in some embodiments, the user may exist in part of the time without shooting based on the selected scene, for example, the user may select the long shot as the scene label, but in the shooting process, the user shoots the close-up in part of the time. At this time, the electronic device will also extract the material segments of different scenes corresponding to the sub-set when identifying and extracting each recording data in each sub-set. For example, the electronic device will also extract the close-up material segments corresponding to different target persons when identifying and extracting each recording data in the long shot sub-set. The label of the material segment can be close-up target X1 or close-up target X2.

[0212] It can be understood that in the embodiments of the present application, the method of performing audio processing on each data may include pre-processing the data using a multi-channel joint processing algorithm, wherein the multi-channel joint processing algorithm may include algorithms such as a multi-channel noise reduction algorithm, a speech separation algorithm, and a speech recognition algorithm. In some implementations, the method of performing audio processing on each data may be to first perform noise reduction processing on the data using a multi-channel noise reduction algorithm, and then perform separation processing on the data obtained after the noise reduction processing using a speech separation algorithm to obtain the voice corresponding to each target person or non-target person, and then perform speech recognition processing on the voice corresponding to each target person or non-target task using a speech recognition algorithm to obtain subtitles or barrages corresponding to each voice.

[0213] In an embodiment of the present application, the method for processing each recorded data in the video frequency set may include using a pedestrian re-identification algorithm to process each recorded data to obtain material clips corresponding to different targets in each subset, and generate material tags and time stamp information corresponding to the material clips.

[0214] The following describes how electronic device A1 pre-processes its own recorded content and the recorded content received from other electronic devices in the recording group to obtain material clips and corresponding material tags in the scenario where the aforementioned electronic devices A1, B1, C1, and D1 are recording a speech.

[0215] In some embodiments, as Figure 4g As shown, in the video project interface 401, the recording group material folders corresponding to each recording group can be displayed. For example, the recording group 1 material folder 4012 corresponding to the current recording group is displayed. When the recording group 1 material folder 4012 is clicked, the electronic device can display the following: Figure 4h The material display interface 405 shown in the figure can display the recording data recorded by the electronic device itself and the recording data received from other electronic devices. For example, the close-up 1 recording data recorded by the electronic device A1, the long-view 1 recording data recorded by the electronic device B1, the audio 1 recording data recorded by the electronic device C1, and the close-up 2 recording data recorded by the electronic device D1 can be displayed.

[0216] The preprocessing control 4051 can also be displayed in the material display interface 405. When the preprocessing control 4051 is clicked, a selection submenu 4052 can be displayed in the material display interface 405. The selection submenu 4052 can display a clip generation control 4053, a subtitle generation control 4054, and a bullet screen generation control 4055. The clip generation control 4053 is used to generate different scene material clips corresponding to each target person based on the video recording data. The subtitle generation control 4054 is used to generate a subtitle clip corresponding to each material clip based on the audio and the audio of the target person in the video recording data. The bullet screen generation control 4055 is used to generate a corresponding subtitle clip based on the audio of a non-target person in the audio and video recording data. The subtitle clip corresponding to the audio of the non-target person can be displayed as a bullet screen in the video.

[0217] When the clip generation control 4053, the subtitle generation control 4054, and the bullet screen generation control 4055 are selected, and the preprocessing control 4051 is clicked, the electronic device can preprocess all recording data in the recording group 1 material folder 4012 to generate different scene material clips corresponding to each target person, subtitle clips corresponding to each material clip, and bullet screen clips corresponding to non-target persons.

[0218] In an implementable manner, the preprocessing manner can be that the electronic device A1 can first store the long-range video recorded by the electronic device B1 and the close-range video recorded by the electronic device A1 and the electronic device D1 into a video set, and store the audio sent by the electronic device C1 into an audio set.

[0219] Then, according to the scene labels of each data in the video data set, each data in the video set is divided into a long-range sub-set and a close-range sub-set. Each recording data in each sub-set is identified and extracted to obtain material clips corresponding to different targets in each sub-set. For example, the long-range sub-set can include a long-range material clip corresponding to target X2. The long-range material clip corresponding to target X2 can have a material label of “long-range target X2”. The close-range sub-set can include close-range material clips corresponding to target X1 and target X2. The close-range material clips corresponding to target X1 and target X2 can have material labels of close-range target X1 and close-range target X2. In addition, the electronic device A1 can also perform audio processing on the audio stream in each video material clip to obtain sound material clips corresponding to target A and target X2 in each video material clip.

[0220] The electronic device A1 can also perform audio processing on each data in the audio set to obtain sound material clips corresponding to target A and target X2, and corresponding material labels “target X1 audio” and “target X2 audio”.

[0221] When the preprocessing control 4051 is clicked, the electronic device A1 can display a video processing interface 406 as shown in Figure 4i The video processing interface can include a material tab 4061, a timeline tab 4062, and a preview tab 4063. When the material tab 4061 is clicked, the electronic device A1 displays the preprocessed material segments of the electronic device A1 as shown in Figure 4i

[0222] 605: Synthesize a corresponding video based on the user-selected material segments.

[0223] It can be understood that in the embodiments of the present application, the electronic device can synthesize a corresponding video based on the user-selected material segments in the video synthesis interface, and preview and play in the preview area.

[0224] It can be understood that the video previewed and played in the preview area can include subtitles corresponding to the target person.

[0225] It can be understood that in the embodiments of the present application, the video previewed and played in the preview area can include a barrage corresponding to a non-target person. For example, in a live recording scene, the recorded video includes the video and audio of the target X1 and the target X2, but also contains some audio of the on-site audience. Therefore, the audio data corresponding to the on-site audience can be converted into corresponding barrage and displayed in the synthesized video.

[0226] As shown in Figure 4j When the user clicks the timeline tab 4062 in the video synthesis interface 406, the electronic device A1 displays a material segment arrangement area 4064, a timeline 4065, and a track area, which can include a video track 4066, an audio track 4067, a subtitle track 4068, a barrage track 4069, etc. In some embodiments, in order to better synthesize the video, the video track in the track area can be multiple, for example, including a long shot track for placing long shot videos and other tracks for placing videos other than long shots. In this way, the superposition of videos of multiple shot types can be realized, for example, any long shot video and close-up video can be superimposed in the same time period to present the superimposed video effect.

[0227] When the preview tab 4063 is clicked, the synthesized video can be previewed in the preview area 4060 as shown in Figure 4k The video can include corresponding subtitles and barrages.

[0228] It can be understood that in the embodiments of the present application, in order to make it more convenient for the user to drag the material tag to the corresponding track area, when the user clicks any target material segment, the electronic device can display the corresponding position of the target material segment in the track area according to the time mark information of the target material segment. For example, as shown in Figure 11 ​As shown, the time mark information of the material segment corresponding to the audio target X1 is 00:05-00:10, and when the audio target X1 is clicked, the region of the audio track region corresponding to the time axis 00:05-00:10 will be highlighted or prompted in a highlighted color to remind the user of the corresponding position of the material segment of the audio target X1.

[0229] In some embodiments, the position of the material segment can be arranged according to the time mark information and the time axis below. The user can directly drag the material displayed in the material segment arrangement region to the corresponding track region to complete video editing and synthesis.

[0230] Based on the above scheme, the recording data generated by each electronic device in the recording group can be aggregated on any electronic device in the recording group for video synthesis processing, so that the recording data does not need to be transferred to an additional dedicated synthesis device, saving the operation process. In addition, the electronic device can preprocess all video data according to the time mark information and recording content label of each video data, generate material segments and labels corresponding to the material segments, so that the post-processing step can be greatly simplified, and non-professional users can also select material segments to synthesize videos.

[0231] The embodiment of the present application provides an electronic device, comprising: a memory for storing instructions executed by one or more processors of the electronic device, and the processor is one of the one or more processors of the electronic device, used to execute the above-mentioned video processing method.

[0232] The embodiment of the present application provides a readable storage medium, the readable medium stores instructions, the instructions are executed on the electronic device to make the electronic device execute the above-mentioned video processing method.

[0233] The embodiment of the present application provides a computer program product, comprising instructions, the instructions are executed on the electronic device to make the electronic device execute the above-mentioned video processing method.

[0234] The hardware structure of the electronic device provided by the embodiment of the present application will be described below taking the mobile phone 10 as an example.

[0235] As shown in the figure, Figure 12 The mobile phone 10 can include a processor 110, a power module 140, a memory 180, a mobile communication module 130, a wireless communication module 120, a sensor module 190, an audio module 150, a camera 170, an interface module 160, a key 101 and a display screen 102.

[0236] It is understood that the structure illustrated by the embodiments does not constitute a specific limitation on the mobile phone 10. In other embodiments of the present application, the mobile phone 10 can include more or fewer components than those shown, or combine some components, or split some components, or different arrangement of components. The components shown can be implemented in hardware, software or a combination of software and hardware.

[0237] The processor 110 can include one or more processing units, for example, can include a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processor (DSP), a micro-programmed control unit (MCU), an artificial intelligence (AI) processor, or a field programmable gate array (FPGA) processing module or processing circuit, etc. Among them, different processing units can be independent devices, or can be integrated in one or more processors. The storage unit can be provided in the processor 110 for storing instructions and data. In some embodiments, the storage unit in the processor 110 is a cache memory 180.

[0238] It can be understood that the video processing method in the embodiments of the present application can be executed by the processor 110.

[0239] The power module 140 can include a power supply, a power management component, etc. The power supply can be a battery. The power management component is used to manage the charging of the power supply and the power supply to other modules. In some embodiments, the power management component includes a charging management module and a power management module. The charging management module is used to receive charging input from the charger; the power management module is used to connect the power supply, the charging management module and the processor 110. The power management module receives the input of the power supply and / or the charging management module, and supplies power to the processor 110, the display screen 102, the camera 170, and the wireless communication module 120, etc.

[0240] The mobile communication module 130 can include, but is not limited to, an antenna, a power amplifier, a filter, an LNA (Low noise amplify), and the like. The mobile communication module 130 can provide a solution including 2G / 3G / 4G / 5G wireless communication applied to the mobile phone 10. The mobile communication module 130 can receive electromagnetic waves by the antenna, and perform filtering, amplification, and the like on the received electromagnetic waves, and transmit to the modem processor for demodulation. The mobile communication module 130 can also amplify the signal modulated by the modem processor, and radiate as electromagnetic waves through the antenna. In some embodiments, at least part of the function modules of the mobile communication module 130 can be disposed in the processor 110. In some embodiments, at least part of the function modules of the mobile communication module 130 can be disposed in the same device as at least part of the modules of the processor 110.

[0241] The wireless communication module 120 can include an antenna, and realize the transceiving of electromagnetic waves via the antenna. The wireless communication module 120 can provide a solution including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, and the like, which are wireless communication applied to the mobile phone 10. The mobile phone 10 can communicate with the network and other devices through the wireless communication technology.

[0242] It can be understood that, in the embodiments of the present application, when the electronic device is a receiving device, the video data and the audio data from other electronic devices in the recording group received by the wireless communication module, and the recording content label and the time mark information corresponding to each data can be received. And when the electronic device is a sending device, the video data and the audio data, and the recording content label and the time mark information corresponding to each data can be sent to other electronic devices in the recording group through the wireless communication module.

[0243] In some embodiments, the mobile communication module 130 and the wireless communication module 120 of the mobile phone 10 can also be located in the same module.

[0244] The display screen 102 is configured to display a human-computer interaction interface, an image, a video, etc. The display screen 102 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diodes (QLED), etc.

[0245] The sensor module 190 can include a proximity light sensor, a pressure sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc.

[0246] It can be understood that the ambient light sensor in the embodiments of the present application can be used to acquire illumination state information and send the illumination state information to the processor.

[0247] The audio module 150 is configured to convert digital audio information into an analog audio signal output, or convert an analog audio input into a digital audio signal. The audio module 150 can also be configured to encode and decode an audio signal. In some embodiments, the audio module 150 can be disposed in the processor 110, or some functional modules of the audio module 150 can be disposed in the processor 110. In some embodiments, the audio module 150 can include a speaker, a receiver, a microphone, and a headset jack.

[0248] The camera 170 is configured to capture a still image or a video. An object generates an optical image through a lens and projects the optical image onto a photosensitive element. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to an ISP (Image Signal Processing) to convert the electrical signal into a digital image signal. The mobile phone 10 can realize a shooting function through the ISP, the camera 170, a video codec, a GPU (Graphic Processing Unit), the display screen 102, and an application processor, etc.

[0249] The interface module 160 includes an external memory interface, a universal serial bus (USB) interface, and a subscriber identification module (SIM) card interface, etc. The external memory interface can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile phone 10. The external memory card communicates with the processor 110 through the external memory interface to realize data storage functions. The universal serial bus interface is used for communication between the mobile phone 10 and other electronic devices. The subscriber identification module card interface is used to communicate with the SIM card installed in the mobile phone 10, such as reading the phone number stored in the SIM card, or writing the phone number into the SIM card.

[0250] In some embodiments, the mobile phone 10 further includes a key 101, a motor, and an indicator, etc. The key 101 can include a volume key, a power on / off key, etc. The motor is used to generate a vibration effect of the mobile phone 10, such as generating a vibration when the mobile phone 10 of the user is called to prompt the user to answer the call. The indicator can include a laser indicator, a radio frequency indicator, an LED indicator, etc.

[0251] Embodiments of the mechanisms disclosed herein can be implemented in hardware, software, firmware, or any combination thereof. Embodiments of the application can be implemented as computer programs or program code executing on programmable systems comprising at least one processor, a storage system (including volatile and non-volatile memory and / or storage elements), at least one input device, and at least one output device.

[0252] Program code can be applied to input instructions to perform the functions described herein and generate output information. The output information can be applied to one or more output devices, in known fashion. For purposes of this application, a processing system includes any system that has a processor, such as a digital signal processor (DSP), a microcontroller, an application specific integrated circuit (ASIC), or a microprocessor.

[0253] The program code can be implemented in a high level procedural or object oriented programming language to communicate with a processing system. The program code can be implemented in assembly or machine language, if desired. In fact, the mechanisms described herein are not limited in scope to any particular programming language. In any case, the language can be a compiled or interpreted language.

[0254] In some cases, the disclosed embodiments can be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments can also be implemented as instructions carried by or stored on a transitory or non-transitory machine-readable (e.g., computer-readable) medium, which can be read and executed by one or more processors. For example, the instructions can be downloaded from a network or by way of another computer readable medium. Thus, a machine-readable medium can include any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computer), including without limitation floppy disks, optical disks, optical disks, compact discs, read-only memory (CD-ROMs), magnetic disks, read-only memory (ROM), random access memory (RAM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), magnetic or optical cards, flash memory, or a tangible, machine-readable storage used in the transmission of information over the Internet with a propagated signal in electronic, electromagnetic, or optical form, such as carrier waves, infrared signals digital signals, etc. Accordingly, a machine-readable medium includes any type of medium suitable for storing or transmitting electronic instructions or information in a form readable by a machine (e.g., a computer).

[0255] In the drawings, some of the structural or methodological features can be shown in particular arrangements and / or orders. However, it should be understood that such particular arrangements and / or orders can not be required. Instead, these features can be arranged in a different manner and / or order than shown in the illustrative figures, in some embodiments. Additionally, the inclusion of a structural or methodological feature in a particular figure is not meant to imply that such feature is required in all embodiments, and in some embodiments, these features can not be included or can be combined with other features.

[0256] It should be noted that each unit / module mentioned in the device embodiments of the present application is a logical unit / module, in physical, one logical unit / module can be one physical unit / module, also can be a part of one physical unit / module, also can be realized in combination of multiple physical unit / modules, the physical realization of these logical units / modules is not the most important, the combination of the functions realized by these logical units / modules is the key to solve the technical problems proposed in the present application. In addition, in order to highlight the innovative part of the present application, the above-mentioned device embodiments of the present application do not introduce the units / modules which are not closely related to solving the technical problems proposed in the present application, which does not mean that the above-mentioned device embodiments do not have other units / modules.

[0257] In the embodiments of the present application provided above, the method provided by the embodiments of the present application is introduced from the perspective of an electronic device (for example, a mobile phone) as an execution subject. To implement each function in the method provided by the embodiments of the present application, the electronic device can include a hardware structure and / or a software module, and each function is implemented in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether a certain function in the above functions is implemented in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application of the technical solution and the design constraint conditions.

[0258] In the above embodiments, according to the context, the term "when" or "after" can be interpreted as meaning "if" or "after" or "in response to determining" or "in response to detecting". Similarly, according to the context, the phrase "upon determining" or "if detecting (the stated condition or event)" can be interpreted as meaning "if determining" or "in response to determining" or "upon detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)".

[0259] It should be noted that the relational terms herein such as first and second and the like can be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any such actual relationship or order between such entities or actions. Moreover, the terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without more limitations, an element defined by the statement "comprising a" does not exclude the existence of additional identical elements in the process, method, article, or apparatus that includes the element.

[0260] In this specification, the reference to "one embodiment" or "some embodiments" etc. means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the application. Thus, the appearances of the phrases "in one embodiment", "in some embodiments", "in other embodiments", "in additional embodiments", etc. in various places in the specification are not necessarily all referring to the same embodiment, unless otherwise be clear from the context.

[0261] In the embodiments of the present application, "and / or" is only a kind of description of the association relationship of associated objects, which means that there can be three kinds of relationships, for example, A and / or B can represent the following three cases: A exists alone, A and B exist simultaneously, and B exists alone.In addition, the character " / " in this paper generally represents that the front and rear associated objects are a kind of "or" relationship.

[0262] Although the present application has been illustrated and described with reference to certain preferred embodiments thereof, it should be understood by those skilled in the art that various changes in form and details can be made therein without departing from the scope of the present application.

Claims

1. A video processing method, applied to a first electronic device, characterized in that: The method comprises: Establishing a communication connection with the second electronic device and the third electronic device; Displaying a first user interface, and displaying a record button on the first user interface; receiving a first operation of the user on the record button, controlling the second electronic device to record a second video, and controlling the third electronic device to record a third video, wherein the second video and the third video are recorded in the same time period; receiving the second video and the third video; Displaying a second user interface, displaying the track, the preview window, and the second video on the second user interface; receiving a user drag on the second video, displaying the second video on the track, displaying a preview of the second video on the preview window, and displaying a second control on the second user interface; Upon receiving a second operation on the second control by the user, displaying the third video existing in the time period corresponding to the second video; receiving a third operation from the user on the third video, A preview screen of the third video is displayed on the preview window.

2. The method according to claim 1, characterized in that The method further includes receiving a fourth operation of the user on the first user interface, and changing the shooting scene of the second electronic device in response to the fourth operation.

3. The method according to claim 1 or 2, characterized in that The method also includes, when the track displays the second video, only playing the audio corresponding to the second video; after receiving the user's fifth operation on the second control, replacing the second video of the track with the third video, only playing the audio corresponding to the third video, wherein the second video and the third video are recorded in the same time period.

4. The method according to any one of claims 1 or 2, characterized in that The method further includes, in response to a sixth operation of the user on the second video, prompting a region position corresponding to the second video on the track.

5. The method according to any one of claims 1 or 2, characterized in that The receiving the second video and the third video includes: receiving time stamp information corresponding to the second video and the third video.

6. The method according to any one of claims 1 or 2, characterized in that The receiving the second video and the third video includes: receiving recording content tags corresponding to the second video and the third video.

7. The method according to claim 5, characterized in that The method also includes the first electronic device identifying the second video and the third video, and acquiring time stamp information corresponding to the second video and the third video.

8. The method according to claim 6, characterized in that The method also includes the first electronic device identifying the second video and the third video, and obtaining recording content tags corresponding to the second video and the third video.

9. The method according to claim 5 or 7, characterized in that The time mark information includes a start time and / or an end time and / or a special mark time.

10. The method according to any one of claims 6 or 8, characterized in that The recording content tag includes a scene tag and a recording category tag.

11. The method according to claim 10, characterized in that The scene tags include a distant view tag, a medium view tag, a close view tag, and a close-up tag, and the recording category tags include a video tag and an audio tag.

12. The method according to claim 1 or 2, characterized in that The method further includes receiving a control instruction sent by the second electronic device, and controlling the third electronic device to record a fourth video.

13. The method according to claim 12, characterized in that When the third electronic device records the fourth video, the second electronic device records the fifth video, and the fourth video and the fifth video are recorded in the same time period.

14. The method according to any one of claims 1 or 2, characterized in that The first electronic device, the second electronic device, and the third electronic device are connected to the same wireless network.

15. The method according to any one of claims 1 or 2, characterized in that A seventh operation of receiving user input is performed, and the received second video and the received third video are pre-processed to generate a material segment set.

16. The method according to any one of claims 1 or 2, characterized in that The preview window is used to display the synthesized video.

17. A first electronic device, characterized in that include: One or more processors, a memory, wherein the memory stores instructions, and when the instructions are executed by the one or more processors, the first electronic device executes the video processing method according to any one of claims 1 to 16.

18. A readable storage medium, characterized in that: The readable medium stores instructions, which, when executed on a first electronic device, enable the first electronic device to execute the video processing method according to any one of claims 1 to 16.

19. A computer program product, characterized in that The apparatus comprises instructions, which, when executed on a first electronic device, cause the first electronic device to execute the video processing method according to any one of claims 1 to 16.

20. A system, characterized in that: The system includes a first electronic device, a second electronic device and a third electronic device, The first electronic device is configured to establish a communication connection with the second electronic device and the third electronic device; The first electronic device is configured to display a first user interface, wherein a recording button is displayed on the first user interface; The first electronic device is configured to receive a first operation of the user on the record button, control the second electronic device to record a second video, and control the third electronic device to record a third video, wherein the second video and the third video are recorded in the same time period; The second electronic device is configured to send the second video to the first electronic device; The third electronic device is configured to send the third video to the first electronic device; The first electronic device is configured to receive the second video and the third video; The first electronic device is configured to display a second user interface, wherein the track, the preview window, and the second video are displayed on the second user interface; The first electronic device is configured to receive a user drag on the second video, display the second video on the track, display a preview of the second video on the preview window, and display a second control on the second user interface; The first electronic device is configured to receive a second operation of the user on the second control and display the third video that exists in the time period corresponding to the second video; The first electronic device is configured to receive a third operation from a user on the third video and display a preview image of the third video on the preview window.

21. The system according to claim 20, wherein: The first electronic device is further configured to receive a fourth operation from the user on the first user interface, and change the shooting angle of the second electronic device in response to the fourth operation.

22. The system according to claim 20 or 21, characterized in that The first electronic device is also used to, when the second video is displayed on the track, only play the audio corresponding to the second video; after receiving the user's fifth operation on the second control, replacing the second video of the track with the third video, only play the audio corresponding to the third video, wherein the second video and the third video are recorded in the same time period.

23. The system according to claim 20 or 21, characterized in that The first electronic device is further configured to, in response to a sixth operation of the user on the second video, prompt an area location corresponding to the second video on the track.

24. The system according to claim 20 or 21, characterized in that The first electronic device is further configured to receive the second video and the third video, including: the first electronic device receiving time stamp information corresponding to the second video and the third video.

25. The system according to claim 20 or 21, characterized in that The first electronic device is further configured to receive the second video and the third video, including: the first electronic device receiving recording content tags corresponding to the second video and the third video.

26. The system according to claim 24, wherein: The first electronic device is further configured to identify the second video and the third video, and obtain time stamp information corresponding to the second video and the third video.

27. The system according to claim 25, wherein: The first electronic device is further configured to identify the second video and the third video, and obtain recording content tags corresponding to the second video and the third video.

28. The system according to claim 24 or 26, characterized in that The time mark information includes a start time and / or an end time and / or a special mark time.

29. The system according to any one of claims 25 or 27, characterized in that The recording content tag includes a scene tag and a recording category tag.

30. The system according to claim 29, wherein: The scene tags include a distant view tag, a medium view tag, a close view tag, and a close-up tag, and the recording category tags include a video tag and an audio tag.

31. The system according to claim 20 or 21, characterized in that The first electronic device is further configured to receive a control instruction sent by the second electronic device, and control the third electronic device to record a fourth video.

32. The system according to claim 31, wherein: When the third electronic device records the fourth video, the second electronic device records the fifth video, and the fourth video and the fifth video are recorded in the same time period.

33. The system according to claim 20 or 21, characterized in that The first electronic device, the second electronic device, and the third electronic device are connected to the same wireless network.

34. The system according to any one of claims 20 or 21, characterized in that The first electronic device is further configured to receive a seventh operation input by a user, pre-process the received second video and the third video, and generate a set of material segments.

35. The system according to any one of claims 20 or 21, characterized in that The preview window is used to display the synthesized video.

Images