Personalized intelligent editing production system and method for video images of competitors

Abstract

The invention discloses a competitor video image personalized intelligent editing production system and method, and belongs to the competitor image processing field, the system comprises a video acquisition terminal, a cloud storage server, a cloud editing server, an enterprise terminal and a user terminal; the method comprises the following steps of: intelligently matching massive competition video materials through a set video editing template and feature data of players, accurately matching to obtain a multi-camera high-definition video of each player, combining public information data of a competition with personalized data of the players, and displaying in the modes of image-text, subtitle, animation and stunt; and the match video images of the players are individually edited in a large-batch, high-speed, multi-version and personalized manner, so that the players can conveniently and quickly preview, download and share the match highlight moments belonging to the players in time. According to the invention, the problem that the player video cannot be quickly retrieved and cannot be edited for players after the multi-camera high-definition video materials of the large-scale event are collected in a live broadcasting or recording manner is solved.

Description

Technical Field

[0001] The present invention relates to the field of video processing technology, and in particular to a system and method for producing personalized intelligent editing of contestant video images. Background Art

[0002] Event video editing refers to the professional editing and production of on-site video footage of an event to create video content that is entertaining, commemorative or promotional.

[0003] Personalized video editing of competitions means producing personal video clips for the contestants to capture and highlight their wonderful moments in the competition. This service combines modern video technology and personalized content creation to meet the contestants' needs for personalized souvenirs. With the popularity of competitions, more and more contestants want to have personalized videos that record their own competition process. Although the current video editing technology has developed to maturity, there are still some shortcomings, such as: First, events usually last for several hours and involve a large number of participants, so the amount of video footage shot is extremely large, posing a huge challenge to editing.

[0004] Second, it takes a lot of time and manpower to filter out the highlights and important moments from a large amount of video material.

[0005] Third, it is difficult to quickly and accurately collect user feedback and make corresponding adjustments to video clips.

[0006] Fourth, it is difficult to generate personalized event videos for each person within the effective time.

[0007] Therefore, how to efficiently and intelligently edit the original materials and generate personalized excellent video highlights for each player is an urgent problem to be solved. Summary of the invention

[0008] The technical problem to be solved by the present invention is to provide a system and method for producing personalized intelligent editing of contestant video images, which can quickly and automatically generate wonderful videos that meet the personalized needs of users.

[0009] In order to solve the above technical problems, the technical solution adopted by the present invention is: A personalized intelligent editing and production system for contestant video images, the system comprising a video acquisition terminal, a cloud storage server, a cloud editing server, an enterprise terminal and a user terminal; The video acquisition terminal is used to acquire original video materials of the event, including real-time live upload of video for synchronous acquisition of event video materials and local video upload for asynchronous acquisition and upload of event video materials; The cloud storage server is used to store the event video materials, special effects materials, video editing templates and programs collected by the video collection terminal; The cloud editing server is used for interaction between the user end and the cloud storage server and between the enterprise end and the cloud storage server; the cloud editing server is also used to match and synthesize the personalized competition video of the contestants according to the video editing template according to the parameter data set by the enterprise end and after calibration by the user end, and transmit the generated personalized competition video to the cloud storage server; The enterprise end includes intelligent editing and storage space management; the intelligent editing first creates a video editing template for video editing and stores the video editing template in the cloud storage server, and then intelligently matches the video editing template with the event video material to synthesize a personalized event video; the storage space management is used to manage the created video editing template data, the original video material data, and the edited personalized event video data; The user terminal logs in through multiple terminals, and queries and previews the synthesized personalized event video according to the event data and the competition data of the contestants, performs self-calibration on the synthesized personalized event video, and can download and share the event video image data accessible in the cloud storage server.

[0010] A further improvement of the technical solution of the present invention is that: the video acquisition terminal is provided with multiple acquisition ports; when uploading in real-time video broadcast mode, multiple cameras can upload at the same time; when uploading in local video mode, multiple local videos can also be uploaded at the same time.

[0011] A method for producing personalized intelligent editing of contestant video images comprises the following steps: Step 1: The video acquisition terminal uploads the event video material to the cloud storage server through real-time live video upload or local video upload; Step 2: The enterprise uses the cloud editing server to intelligently match the event video materials in the massive cloud storage server with the characteristic data of the contestants through the set video editing template, and can accurately match the multi-camera high-definition video materials of each contestant, and combine the public information data of the event with the personalized data of the contestants, and display them in the form of pictures, subtitles, animations, and special effects; large-scale, high-speed, multi-version, and personalized intelligent editing of the contestants' personalized event videos; Step 3: The enterprise stores the personalized event videos in a cloud storage server and manages the storage space of the cloud storage server; Step 4: After the contestants register and log in through the user end, they can search for events, preview, self-calibrate, download and share their own personalized event videos.

[0012] A further improvement of the technical solution of the present invention is that: in step 1, it specifically includes: a real-time live video broadcast or a local video upload corresponding to an input end of a cloud storage server; Multiple live video uploads include multiple live video sources from different sampling points during the event; live video uploads can be placed in various suitable geographical locations; The multiple local video uploads include at least various post-match video data, video data collected during the game, and player's personal video data.

[0013] A further improvement of the technical solution of the present invention is that: in step 2, the intelligent editing includes creating a video editing template and synthesizing a video according to template matching; Step 2.1, create a video editing template: A video editing template consists of multiple scene templates. You can freely create a scene template by setting the video duration, audio effects, video processing parameter settings, adding video materials, adding transition effects, adding special effects, and adding text effects; Step 2.2, match and synthesize video by template: match the correspondence between contestants and video materials according to the characteristics of contestants, and synthesize special effects according to the transition effects and speed effects set in the video editing template; upload synthesized subtitles according to the synthesized subtitle settings and timing results, and finally display the subtitles in the video; and combine the geographic location information with the event video through picture-in-picture geographic location display.

[0014] A further improvement of the technical solution of the present invention is that: in step 2.1, each scene template can freely set different parameters; the scene template can be set by oneself, and it is also possible to share one's own video editing template or use a video editing template shared by anyone.

[0015] A further improvement of the technical solution of the present invention is that in step 2.1, it specifically includes: When creating a scene template, limit the total duration of the scene in seconds and appropriately trim the video data that exceeds the total duration. When creating a scene template, select appropriate audio data and add it to the template. Use different audio effects for different scenes, so that different scenes have different styles, and finally form a harmonious editing video style. When adding text effects, the text includes the geographical location information of the event venue and the competition data of the contestants.

[0016] A further improvement of the technical solution of the present invention is that: in step 2.2, it specifically includes: selecting different matching methods according to different features provided by the contestants, including face matching, number matching, timing matching and positioning matching; The face matching is to locate the video clip with the face of the contestant in the video according to the face photo of the contestant; The number matching is to locate the video clip with the contestant's number plate in the video according to the contestant's number plate; The timing match is to extract video clips from the complete game video based on the players' timing data after the game; The positioning matching is to use the positioning device carried by the contestants to obtain real-time positioning information and match it with the geographical location information of the event video collection point, and the two are matched to find the video segment where the contestants appear in the camera; Filter out video clips with different contestants through contestant feature matching, and use the video clips as the video source of a certain scene; Use the text data determined when creating the video clip template to synthesize it into the corresponding video clip, perform synthetic subtitle setting processing according to the subtitle setting of the video clip template, including subtitle font size, color and duration, and then synthesize the set subtitle effect into the video source of the scene; Based on the contestants' competition location information, the contestants' competition progress is displayed on the map in real time and synthesized into the video in the form of picture-in-picture.

[0017] A further improvement of the technical solution of the present invention is that in step 3, the storage space management specifically includes: (1) Video material space management: the cloud editing server controls the cloud storage server, finds the storage location of the corresponding video material, and then manages its space; (2) Template storage management: control the cloud storage server through the cloud editing server, find the storage location of the corresponding template, and then manage its space; (3) Film management: The cloud editing server controls the cloud storage server, finds the storage location of the corresponding film, and then manages its space.

[0018] A further improvement of the technical solution of the present invention is that in step 4, it specifically includes: After the contestants register through the client, they log in using the registered account; After logging in through the client, the contestants select the corresponding event and enter the page for previewing, downloading and sharing the finished films related to the event; Participants can preview their own personalized competition videos according to the competition items and player numbers; they can download their personalized competition videos from the cloud storage server; through the sharing function, they can directly send their personalized competition videos to anyone they want; Before downloading personalized event videos, users can calibrate the timing data according to the actual situation and change the correspondence between the timing data and the video frames in the generated video.

[0019] Due to the adoption of the above technical solution, the technical progress achieved by the present invention is: 1. The present invention uploads video materials to a cloud storage server through real-time live video upload or asynchronous local video upload. After the enterprise creates a video editing template, the cloud editing server automatically edits the synthesized video and stores it in the cloud storage server. After registering and logging in through the user end, the contestants can download their personalized event videos. This intelligent editing method can greatly reduce the time and labor required for manual editing and improve the efficiency of video production.

[0020] 2. The present invention can personalize the generated video according to the user's personal needs, thereby better meeting the user's needs for personalized event video content.

[0021] 3. The present invention reduces the technical and equipment thresholds for personalized event video editing. Users can easily obtain high-quality personalized event videos without having professional video editing skills and equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art are briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work. Figure 1 It is a structural block diagram of a system for producing personalized intelligent video clips of contestants provided in an embodiment of the present invention; Figure 2 is a block diagram of a storage space management structure in an embodiment of the present invention; Figure 3 It is a structural block diagram of intelligent editing in an embodiment of the present invention. DETAILED DESCRIPTION

[0023] It should be noted that the terms "including" and "having" and any variations thereof in the specification and claims of the present invention and the above-mentioned drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or apparatus comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or apparatus.

[0024] The present invention is further described in detail below with reference to the accompanying drawings and embodiments: like Figure 1 As shown, a system for personalized intelligent editing and production of contestant video images includes a video acquisition terminal, a cloud storage server, a cloud editing server, an enterprise terminal and a user terminal. When the system is working, multiple input terminals of the cloud storage server are usually connected to multiple video acquisition uploads and multiple local video uploads. The output terminal of the cloud storage server is connected to the cloud editing server.

[0025] The video acquisition terminal is used to acquire original video materials of the event, including real-time live upload of video materials for synchronous acquisition of event video materials and local video upload for asynchronous acquisition and upload of event video materials; The cloud storage server is used to store the event video materials, special effects materials, video editing templates and programs collected by the video collection terminal; The cloud editing server is used for the interaction between the user end and the cloud storage server and between the enterprise end and the cloud storage server. The cloud editing server is also used to match and synthesize the personalized competition video of the contestants according to the video editing template according to the parameter data set by the enterprise end and after calibration by the user end, and transmit the generated personalized competition video to the cloud storage server. The enterprise side includes intelligent editing and storage space management. Through these two functions, the cloud editing server can be controlled to process the data in the cloud storage server. Intelligent editing first creates a video editing template for video editing and stores the video editing template in the cloud storage server. Secondly, it intelligently matches the video editing template with the event video material to synthesize personalized event videos. Storage space management is used to manage the created video editing template data, original video material data, and edited personalized event video data. The user end logs in through multiple terminals, and queries and previews the synthesized personalized event video based on the event data and the competition data of the contestants, self-calibrates the synthesized personalized event video, and can download and share the event video image data accessible in the cloud storage server.

[0026] Furthermore, the video acquisition terminal is provided with a plurality of acquisition ports; when uploading in the real-time video live broadcast mode, a plurality of cameras can upload at the same time; when uploading in the local video mode, a plurality of local videos can also be uploaded at the same time.

[0027] A method for producing personalized intelligent editing of contestant video images, using a system for producing personalized intelligent editing of contestant video images, comprises the following steps: Step 1: The video acquisition terminal uploads the event video material to the cloud storage server through real-time live video upload or local video upload; Specifically, one live video upload or one local video upload corresponds to the input of a cloud storage server; multiple live video uploads include multiple live video sources at different sampling points in an event (such as a marathon); live video uploads can be placed in various suitable geographical locations; multiple local video uploads include at least various post-match video data, video data collected during the game, and personal video data of the players. The sources of video data are diverse and free.

[0028] Real-time live video upload, by obtaining the diversion address of the corresponding folder of the cloud storage server, the address is bound to the live video data, and when the event video is live, the video data is transmitted in real time to the corresponding folder of the cloud storage. Local video upload, directly transfer the local video to the corresponding cloud storage server folder.

[0029] Step 2: The enterprise uses the cloud editing server to intelligently match the event video materials in the massive cloud storage server with the characteristic data of the contestants through the set video editing template, and can accurately match the multi-camera high-definition video materials of each contestant, and combine the public information data of the event with the personalized data of the contestants, and display them in the form of pictures, subtitles, animations, and special effects; large-scale, high-speed, multi-version, and personalized intelligent editing of the contestants' personalized event videos; Specifically include: Intelligent editing includes creating video editing templates and synthesizing videos according to template matching; Step 2.1, create a video editing template: A video editing template consists of multiple scene templates. You can freely create a scene template by setting the video duration, audio effects, video processing parameter settings, adding video materials, adding transition effects, adding special effects, and adding text effects; The process of creating a clip template is to create scene templates multiple times, and then form an appropriate clip template by sorting different scene templates. Each scene template can freely set different parameters; scene templates can be set by yourself, and you can also share your own video clip templates or use video clip templates shared by anyone. Specifically include: Set video duration: When creating a scene for a template, limit the total duration of the scene in seconds and appropriately trim the video data that exceeds the total duration.

[0030] Set audio effects: When creating a scene for a template, select appropriate audio data and add it to the template. Use different audio effects for different scenes to give different scenes different styles, ultimately forming a harmonious editing video style.

[0031] Add text and effects: When participating in a marathon, the text includes the geographical location of the event venue and the running data of the participants, including pace, running kilometers, and rankings. If participating in other competitions, the text information can be adjusted according to the actual situation.

[0032] Step 2.2, match and synthesize video by template: match the correspondence between contestants and video materials according to the characteristics of contestants, and synthesize special effects according to the transition effects and speed effects set in the video editing template; upload synthesized subtitles according to the synthesized subtitle settings and timing results, and finally display the subtitles in the video; and combine the geographic location information with the event video through picture-in-picture geographic location display.

[0033] Specifically include: Figure 3 As shown, the synthetic video is matched according to the template, and batch synthetic event clip videos are generated based on the created video clip template.

[0034] (1) Player feature matching: Different matching methods can be selected based on the different features provided by the contestants, including face matching, number matching, timing matching, and positioning matching.

[0035] Face matching: Based on the contestant’s face photo, locate the video clip with that person’s face in the video.

[0036] Number matching: Based on the contestant’s number plate, locate the video clip with the number plate in the video.

[0037] Timing Matches: Video clips taken from full match videos based on the timing data of the players after the match.

[0038] Positioning and matching: Use the positioning devices carried by the contestants to obtain real-time positioning information and match it with the geographic location information of the event video collection points. The two are matched to find the video segments where the contestants appear in the camera.

[0039] Video clips with different players are screened out through player feature matching, and the video clips are used as video sources for a certain scene.

[0040] (2) Synthetic special effects: Synthesize special effects based on the transition effects and speed effects set in the template.

[0041] (3) Synthesized subtitles: Use the text data determined when creating the editing template and synthesize it into the corresponding video clip. Perform synthetic subtitle settings according to the template's subtitle settings, including subtitle font size, color, and duration, and then upload the set subtitle effects and timing results to the video source of the scene, and finally display the subtitles in the video.

[0042] (4) Real-time display of geographic location: Based on the contestants’ location information, the contestants’ progress in the game is displayed in real time on the map and integrated into the video in the form of picture-in-picture.

[0043] Step 3: The enterprise stores the personalized event videos in a cloud storage server and manages the storage space of the cloud storage server; like Figure 2 As shown in the figure, storage space management specifically includes: (1) Video material space management: the cloud editing server controls the cloud storage server, finds the storage location of the corresponding video material, and then manages its space; (2) Template storage management: control the cloud storage server through the cloud editing server, find the storage location of the corresponding template, and then manage its space; (3) Film management: The cloud editing server controls the cloud storage server, finds the storage location of the corresponding film, and then manages its space.

[0044] Step 4: After the contestants register and log in through the user end, they can search for events, preview, self-calibrate, download and share their own personalized event videos.

[0045] Specifically include: After the contestants register through the user terminal, they log in using the registered account; the user terminal can be used from multiple terminals, such as WeChat applet, web page or APP.

[0046] Event search: After logging in through the client, contestants select the corresponding event and enter the page for previewing, downloading and sharing the film related to the event; Preview, download and share: Contestants can preview their own personalized competition videos according to their competition items and numbers; they can download their personalized competition videos from the cloud storage server; and they can send their personalized competition videos directly to anyone they want through the sharing function; Self-calibration: Before downloading personalized event videos, users can calibrate the timing data according to the actual situation and change the correspondence between the timing data and video frames in the generated video.

[0047] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A personalized intelligent editing and production system for contestant video images, characterized by: The system includes a video acquisition terminal, a cloud storage server, a cloud editing server, an enterprise terminal and a user terminal; The video acquisition terminal is used to acquire original video materials of the event, including real-time live upload of video for synchronous acquisition of event video materials and local video upload for asynchronous acquisition and upload of event video materials; The cloud storage server is used to store the event video materials, special effects materials, video editing templates and programs collected by the video collection terminal; The cloud clipping server is used for interaction between the user end and the cloud storage server and interaction between the enterprise end and the cloud storage server; The cloud editing server is also used to match and synthesize the personalized competition video of the contestants according to the parameter data set by the enterprise end and after calibration by the user end according to the video editing template, and transmit the generated personalized competition video to the cloud storage server; The enterprise end includes intelligent editing and storage space management; the intelligent editing first establishes a video editing template for video editing and stores the video editing template in a cloud storage server, and then intelligently matches the video editing template with the event video material to synthesize a personalized event video; The storage space management is used to manage the created video editing template data, the original video material data, and the edited personalized event video data; The user terminal logs in through multiple terminals, and queries and previews the synthesized personalized event video according to the event data and the competition data of the contestants, performs self-calibration on the synthesized personalized event video, and can download and share the event video image data accessible in the cloud storage server.

2. The personalized intelligent editing and production system for contestant video images according to claim 1 is characterized by: The video acquisition terminal is provided with multiple acquisition ports; when uploading in real-time live video mode, multiple cameras can upload at the same time; When uploading as local videos, multiple local videos can be uploaded at the same time.

3. A method for producing a personalized intelligent editing of a contestant's video image, using a personalized intelligent editing and producing system for a contestant's video image as claimed in any one of claims 1 to 2, characterized in that: The following steps are involved: Step 1: The video acquisition terminal uploads the event video material to the cloud storage server through real-time live video upload or local video upload; Step 2: The enterprise uses the cloud editing server to intelligently match the event video materials in the massive cloud storage server with the set video editing template and the characteristic data of the contestants. It can accurately match the multi-camera high-definition video materials of each contestant, and combine the public information data of the event with the personalized data of the contestants to display them in the form of pictures, texts, subtitles, animations, and special effects. Personalized competition videos of contestants can be edited intelligently in large quantities, at high speed, in multiple versions and in a personalized way; Step 3: The enterprise stores the personalized event videos in a cloud storage server and manages the storage space of the cloud storage server; Step 4: After the contestants register and log in through the user end, they can search for events, preview, self-calibrate, download and share their own personalized event videos.

4. The method for producing personalized intelligent editing of contestant video images according to claim 3, characterized in that: In step 1, it specifically includes: a live video broadcast or a local video upload corresponding to an input end of a cloud storage server; Multiple live video uploads include multiple live video sources from different sampling points during the event; live video uploads can be placed in various suitable geographical locations; The multiple local video uploads include at least various post-match video data, video data collected during the game, and player's personal video data.

5. The method for producing personalized intelligent editing of contestant video images according to claim 3, characterized in that: In step 2, the intelligent editing includes creating a video editing template and synthesizing a video according to template matching; Step 2.1, create a video editing template: A video editing template consists of multiple scene templates. You can freely create a scene template by setting the video duration, audio effects, video processing parameter settings, adding video materials, adding transition effects, adding special effects, and adding text effects; Step 2.2, match and synthesize video by template: match the correspondence between contestants and video materials according to the characteristics of contestants, and synthesize special effects according to the transition effects and speed effects set in the video editing template; upload synthesized subtitles according to the synthesized subtitle settings and timing results, and finally display the subtitles in the video; and combine the geographic location information with the event video through picture-in-picture geographic location display.

6. The method for producing personalized intelligent editing of contestant video images according to claim 5, characterized in that: In step 2.1, each scene template can be freely set with different parameters; the scene template can be set by yourself, and you can also share your own video editing template or use the video editing template shared by anyone.

7. The method for producing personalized intelligent editing of contestant video images according to claim 5, characterized in that: In step 2.1, it specifically includes: When creating a scene template, limit the total duration of the scene in seconds and appropriately trim the video data that exceeds the total duration. When creating a scene template, select appropriate audio data and add it to the template. Use different audio effects for different scenes, so that different scenes have different styles, and finally form a harmonious editing video style. When adding text effects, the text includes the geographical location information of the event venue and the competition data of the contestants.

8. The method for producing personalized intelligent editing of contestant video images according to claim 5, characterized in that: In step 2.2, it specifically includes: selecting different matching methods according to different features provided by the contestants, including face matching, number matching, timing matching and positioning matching; The face matching is to locate the video clip with the face of the contestant in the video according to the face photo of the contestant; The number matching is to locate the video clip with the contestant's number plate in the video according to the contestant's number plate; The timing match is to extract video clips from the complete game video based on the players' timing data after the game; The positioning matching is to use the positioning device carried by the contestants to obtain real-time positioning information and match it with the geographical location information of the event video collection point, and the two are matched to find the video segment where the contestants appear in the camera; Filter out video clips with different contestants through contestant feature matching, and use the video clips as the video source of a certain scene; Use the text data determined when creating the video clip template to synthesize it into the corresponding video clip, perform synthetic subtitle setting processing according to the subtitle setting of the video clip template, including subtitle font size, color and duration, and then synthesize the set subtitle effect into the video source of the scene; Based on the contestants' competition location information, the contestants' competition progress is displayed on the map in real time and synthesized into the video in the form of picture-in-picture.

9. The method for producing personalized intelligent video clips of contestants according to claim 3, characterized in that: In step 3, the storage space management specifically includes: (1) Video material space management: the cloud editing server controls the cloud storage server, finds the storage location of the corresponding video material, and then manages its space; (2) Template storage management: control the cloud storage server through the cloud editing server, find the storage location of the corresponding template, and then manage its space; (3) Film management: The cloud editing server controls the cloud storage server, finds the storage location of the corresponding film, and then manages its space.

10. The method for producing personalized intelligent editing of contestant video images according to claim 3, characterized in that: In step 4, specifically including: After the contestants register through the client, they log in using the registered account; After logging in through the client, the contestants select the corresponding event and enter the page for previewing, downloading and sharing the finished films related to the event; Participants can preview their own personalized competition videos according to the competition items and player numbers; they can download their personalized competition videos from the cloud storage server; and they can send their personalized competition videos directly to anyone they want through the sharing function; Before downloading personalized event videos, users can calibrate the timing data according to the actual situation and change the correspondence between the timing data and the video frames in the generated video.

Images