Method and system for playing video background generated by client

Abstract

The invention provides a method and system for generating a video background by a playing client, and the method comprises the steps: taking a green screen as a background to shoot a seat video when a recording client operates, removing the green screen from the video, compressing the video, and uploading the seat video to a server; the server stores the processing parameters, the background resources and the environment parameters of the video background; the server transmits the seat video to the playing client; the playing client prestores background resources and environment parameters of a video background, or downloads the background resources and the environment parameters of the video background from the server when playing the seat video; and when the playing client runs, synthesizing the selected background resources, the environment parameters and the seat video received from the server into a call video with a background, and playing the synthesized call video with the background by the playing client. According to the invention, the environment parameters, background resources and the like are stored in the server side or the playing client side, so that the resource occupation of the recording client side is reduced, the size of the seat video is reduced, and the transmission speed is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of video communication, and in particular to a method and system for generating a video background on a client side of a user during a video conversation. Background Art

[0002] With the development of video communication technology, more and more companies and organizations use video calls to communicate with customers. In order to improve the professionalism and affinity of video services, a background wall is usually placed behind the agent. However, traditional physical background walls are not only costly, but also difficult to replace quickly. In addition, as part of the video content, the complexity of the traditional background will affect the speed of video upload and download, and when the network status is not good, it will affect the viewer's visual effect.

[0003] The present invention provides a method for synthesizing a video background on a user side client to save costs and achieve better effects. Summary of the invention

[0004] The present invention provides a method and system for generating a video background by a playback client, so as to solve the defects in the prior art.

[0005] The system for generating a video background by a playback client of the present invention comprises: a recording client, a server, and a playback client, wherein:

[0006] When the recording client is running, the seat video is shot using the green screen as the video background. After the green screen is removed from the seat video, the seat video is compressed according to the processing parameters and uploaded to the server.

[0007] The server stores processing parameters, background resources and environmental parameters of the video background; the server transmits the seat video to the playback client;

[0008] The background resources and environment parameters of the video background pre-stored on the playback client, or the background resources and environment parameters of the video background downloaded from the server when playing the seat video;

[0009] When the playback client is running, the selected background resources and environmental parameters are combined with the seat video received from the server to form a call video with background, and the playback client plays the combined call video with background.

[0010] In an optional implementation, the playback client includes a first client and a second client;

[0011] When the first client is running, the green screen background is removed from the seat video received from the server according to the processing parameters, and the selected first background resource, the first environmental parameter and the seat video are synthesized into a call video with background, and the playback client plays the synthesized first call video with background;

[0012] When the second client is running, the green screen background is removed from the seat video received from the server according to the processing parameters, and the selected second background resources, second environmental parameters and the seat video are synthesized into a call video with background. The playback client plays the synthesized second call video with background.

[0013] A method for generating a video background by a playback client according to the present invention is applied to a system for generating a video background by a playback client, and the method comprises:

[0014] Background resource pre-storage: the playback client and / or server pre-stores background resources and environment parameters of the video background;

[0015] The recording client uses a green screen as the background to shoot the seat video. After removing the green screen from the seat video, the filmed seat video is compressed according to the processing parameters and transmitted to the server.

[0016] The playback client retrieves the stored background resources and environmental parameters or downloads the selected background resources and environmental parameters from the server, and synthesizes them with the seat video received from the server into a call video with background; the playback client plays the synthesized call video.

[0017] Another method for generating a video background by a playback client according to the present invention is applied to a system for generating a video background by a playback client, and the method comprises:

[0018] Background resource pre-storage: the playback client and / or server pre-stores background resources and environment parameters of the video background;

[0019] The recording client uses a green screen as the background to shoot the seat video, compresses the filmed seat video according to the processing parameters, and transmits the seat video to the server;

[0020] After the server removes the green screen from the seat video, it sends the seat video to the playback client according to the request of the playback client;

[0021] The playback client retrieves the stored background resources and environmental parameters or downloads the selected background resources and environmental parameters from the server, and synthesizes them with the seat video received from the server into a call video with background; the playback client plays the synthesized call video.

[0022] In an optional implementation, the environmental parameters include: background depth, light source direction, brightness, etc.

[0023] In an optional implementation, the background resource is a picture or a video.

[0024] The method and system for generating a video background by a client of the present invention store environmental parameters, background resources, etc. on a server or a playback client, thereby reducing resource usage of the recording client, reducing the size of the seat video, and improving the transmission speed; the synthesis of the final playback video is distributed to the playback client, so that the playback client can select appropriate background resources based on the network status and machine configuration of the playback client, thereby ultimately improving the customer experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 A schematic diagram of a system for generating a video background by a playback client according to the present invention;

[0026] Figure 2 Another schematic diagram of a system for generating a video background by a playback client according to the present invention;

[0027] Figure 3 A flowchart of a method for generating a video background by a playback client according to the present invention;

[0028] Figure 4 Another flow chart of the method for generating a video background by a playback client according to the present invention. DETAILED DESCRIPTION

[0029] In order to clearly describe the system and method for generating a video background by a playback client according to the present invention, further description will be given in conjunction with the accompanying drawings.

[0030] like Figure 1 A system for generating a video background by a playback client is shown, comprising: a recording client, a server, and a playback client.

[0031] The recording customer's device is installed with a terminal APP with recording function. After the APP is started, the camera is used to shoot a video of the speaker with a green screen as the background. After removing the green screen, the video is compressed according to the selected video resolution s, frame rate f and other processing parameters to form a video stream and send it to the server.

[0032] The client's device is equipped with a terminal APP with playback function. After the APP is started, it downloads the video background resource package and environment parameter package according to user needs for selection during video conversation. The resource package is a collection of background images or background videos, and the environment parameter package is a collection of environment parameters, including: background depth parameter d, ambient light type t, light source matrix m, brightness matrix x, background number b, etc.

[0033] When the client's APP plays a video, it initiates a video session request to the server. During the session establishment process, it initiates an interface call request to the server to select background resources and environmental parameters from the server, or select background resources and environmental parameters from the downloaded video background resource package and environmental parameter package.

[0034] After the video session is linked, the playing client's APP receives the video stream, synthesizes the selected background resources and environmental parameters with the received video stream to form a video stream with background.

[0035] Play the video with background on the client's APP.

[0036] The above steps are the process of adding background processing to the video stream of the seat. The playback client can also use a natural background according to the needs of the specific scene without any background synthesis processing.

[0037] like Figure 2 The system shown in the figure generates a video background by a playback client, including: a recording client, a server, a first playback client, and a second playback client.

[0038] The processing of the recording client is the same as the above example, and the first and second playback clients play the video in the same way. The difference is that the background resource selected by the first playback client from the server is background image A, and the selected environmental parameter is preset parameter C, or the background resource selected from the downloaded video background resource package and environmental parameter package is background image A, and the selected environmental parameter is preset parameter C; the background resource selected by the second playback client from the server is background image B, and the selected environmental parameter is preset parameter D, or the background resource selected from the downloaded video background resource package and environmental parameter package is background image B, and the selected environmental parameter is preset parameter D.

[0039] When the first background resource is different from the second background resource, the first playback client's APP and the second playback client's APP generate video streams with different backgrounds, and respectively play videos with different backgrounds to the users.

[0040] When the first environmental parameter is different from the second environmental parameter, the first playback client's APP and the second playback client's APP generate video streams of different environments and respectively play videos with different environments to the user, for example, different brightness and different background depth.

[0041] like Figure 3 A method for generating a video background by a playback client is shown, which is applied to any of the above-mentioned systems for generating a video background by a playback client, and the method includes:

[0042] Background resource pre-storage: the playback client and / or server pre-stores background resources and environment parameters of the video background;

[0043] The recording client uses a green screen as the background to shoot the seat video. After removing the green screen from the seat video, the filmed seat video is compressed according to the processing parameters and transmitted to the server.

[0044] The playback client retrieves the stored background resources and environmental parameters or downloads the selected background resources and environmental parameters from the server, and synthesizes them with the seat video received from the server into a call video with background; the playback client plays the synthesized call video.

[0045] like Figure 4 Another method for generating a video background by a playback client is shown, which is applied to any of the above-mentioned systems for generating a video background by a playback client, and the method includes:

[0046] Background resource pre-storage: the playback client and / or server pre-stores background resources and environment parameters of the video background;

[0047] The recording client uses a green screen as the background to shoot the seat video, compresses the filmed seat video according to the processing parameters, and transmits the seat video to the server;

[0048] After the server removes the green screen from the seat video, it sends the seat video to the playback client according to the request of the playback client;

[0049] The playback client retrieves the stored background resources and environmental parameters or downloads the selected background resources and environmental parameters from the server, and synthesizes them with the seat video received from the server into a call video with background; the playback client plays the synthesized call video.

[0050] These background resources can be background images or videos, which can be pre-downloaded to the client for storage, or dynamically matched and selected and downloaded based on client needs, classification characteristics of service objects, personal preferences, and the context of the current session. Background resources can be reused multiple times on the client.

[0051] In order to improve transmission efficiency, the playback client can set up a network monitoring module to detect the network status and make resolution requests to the server based on the network status; accordingly, the server sets up a network adaptation module to adjust the resolution of the seat video according to the resolution request.

[0052] As shown in the following table, under the same environmental parameters and background conditions, the existing recording client is used to generate the seat video. Figure 3 The playback client generates the seat video method shown in the figure. Figure 4 The traffic detection value between the server and any playback client when the playback client generates the seat video mode.

[0053] Record the average traffic value of the client and server Average traffic value of the server and the playback client Remark How the recording client generates videos (before optimization) 833KB / s 654KB / s The recording client generates the video and removes the green screen, and the playback client synthesizes the background (after optimization) 527KB / s 398KB / s

[0054] It can be seen from the above table that the present invention Figure 3 , Figure 4 When the playback client generates the seat video method shown, the flow detection value between the server and any playback client is significantly smaller than the flow detection value when the existing recording client generates the seat video method.

[0055] Figure 3 After the recording client removes the green screen from the seat video, the traffic for transmitting the seat video to the server is significantly smaller than the traffic for removing the green screen from the seat video on the server.

[0056] The environmental parameters in the above example are: background depth 2.1 meters, light source direction 45 degrees, brightness 750 lux; the background image is the same.

[0057] The method and system for generating a video background by a playback client described in the present invention store environmental parameters, background resources, etc. on a server or a playback client, thereby reducing resource usage of a recording client, reducing the size of a seat video, and improving transmission speed; the synthesis of the final playback video is distributed to the playback client, so that the playback client can select appropriate background resources based on the network status and machine configuration of the playback client, thereby ultimately improving customer experience.

[0058] The method and system for generating a video background by a playback client of the present invention are optimally applied to a dedicated network link, which can reduce network jitter and delay, and ensure high security, high availability and low delay of the session service. When applied to the Internet, a network monitoring module is set on the client and / or a network adaptation module is set on the server, providing an Internet acceleration function. It supports adjusting the resolution according to the bandwidth of both parties in the session. For example, the agent end is in the corporate office, the network condition is good, and 720P resolution is used. The client is outdoors, using a mobile signal, the network status is limited, and 360P resolution is used. The system automatically detects the network service status and selects resolutions of different gears. The server supports real-time high-speed conversion and docking according to the different resolutions of the terminal.

[0059] The method and system for generating a video background by a playback client of the present invention significantly reduces the size of the transmission file when the green screen removal is allocated to the recording client; and reduces the resource occupation of the recording client when the green screen removal is allocated to the server.

[0060] The method and system for generating a video background by a playback client according to the present invention have the following advantages:

[0061] 1. Client synthesis: The video background is synthesized on the client, saving computing resources on the server.

[0062] 2. Transmission optimization: Transmit videos with background removed to reduce transmission volume and save bandwidth.

[0063] 3. Network adaptability: low transmission bandwidth requirements, improved service quality and stability.

[0064] 4. Background replacement: support replacing video background image or video at any time.

[0065] 5. Dynamic background support: The client can pre-store dynamic video background to achieve dynamic background effect.

[0066] 6. Personalized background: In a multi-party video conversation, different backgrounds can be selected based on user preferences.

[0067] 7. Real-time transmission of environmental parameters: The preset environmental parameters can be transmitted to the client in real time for video synthesis to improve the authenticity of the synthesis effect.

[0068] The present invention synthesizes the video background by the client, which not only saves the computing resources of the server, but also reduces the demand for transmission bandwidth, and improves the service quality and stability of video communication. At the same time, it supports the selection of dynamic background and personalized background, providing users with a better video call experience.

Claims

1. A system for generating a video background by a playback client, comprising: Recording client, server, and playback client, among which, When the recording client is running, the seat video is shot using a green screen as a video background, the seat video is processed to remove the green screen, the seat video is compressed according to the processing parameters, and the seat video is uploaded to the server; The server stores processing parameters, background resources and environmental parameters of the video background; the server transmits the seat video to the playback client; The playback client pre-stores or pre-downloads the background resources and the environment parameters of the video background, or downloads the background resources and the environment parameters of the video background from the server when playing the seat video; When the playback client is running, the selected background resources and environmental parameters are combined with the seat video received from the server to form a call video with background, and the playback client plays the combined call video with background.

2. The system for generating video background by a playback client according to claim 1, characterized in that: The playback client includes a network monitoring module for detecting the network status and making a resolution request to the client according to the network status; the server includes a network adaptation module for adjusting the resolution of the seat video according to the resolution request.

3. The system for generating video background by a playback client according to claim 1, characterized in that: The background resource is a picture or a video.

4. The system for generating video background by a playback client according to claim 1, characterized in that: The environmental parameters include: background depth, light source direction, and brightness.

5. The system for generating video background by a playback client according to claim 1, characterized in that: After the recording client uses the green screen as the video background to shoot the seat video, it compresses the seat video according to the processing parameters and uploads the seat video to the server; After the server removes the green screen from the seat video, it sends the seat video to the playback client according to the request of the playback client.

6. The system for generating a video background by a playback client according to any one of claims 1 to 5, characterized in that: The playback client includes a first client and a second client; When the first client is running, the green screen background is removed from the seat video received from the server according to the processing parameters, and the selected first background resource, the first environmental parameter and the seat video are synthesized into a call video with background, and the playback client plays the synthesized first call video with background; When the second client is running, the green screen background is removed from the seat video received from the server according to the processing parameters, and the selected second background resources, second environmental parameters and the seat video are synthesized into a call video with background. The playback client plays the synthesized second call video with background.

7. A method for generating a video background by a playback client, applied to a system for generating a video background by a playback client, characterized in that: The method comprises: Background resource pre-storage: the playback client and / or server pre-stores background resources and environment parameters of the video background; The recording client uses a green screen as the background to shoot the seat video. After removing the green screen from the seat video, the filmed seat video is compressed according to the processing parameters and transmitted to the server. The playback client retrieves the stored or pre-downloaded background resources and environmental parameters or downloads the selected background resources and environmental parameters from the server, and synthesizes them with the seat video received from the server into a call video with background; the playback client plays the synthesized call video.

8. A method for generating a video background by a playback client, applied to a system for generating a video background by a playback client, characterized in that: The method comprises: Background resource pre-storage: the playback client and / or server pre-stores background resources and environment parameters of the video background; The recording client uses a green screen as the background to shoot the seat video, compresses the filmed seat video according to the processing parameters, and transmits the seat video to the server; After the server removes the green screen from the seat video, it sends the seat video to the playback client according to the request of the playback client; The playback client retrieves the stored or pre-downloaded background resources and environmental parameters or downloads the selected background resources and environmental parameters from the server, and synthesizes them with the seat video received from the server into a call video with background; the playback client plays the synthesized call video.

9. The method for generating a video background by a client according to claim 7 or 8, characterized in that: The environmental parameters include: background depth, light source direction, and brightness; the background resource is a picture or a video.

10. The method for generating a video background by a client according to claim 7 or 8, characterized in that: The playback client includes a network monitoring module for detecting the network status and making a resolution request to the server according to the network status; the server includes a network adaptation module for adjusting the resolution of the seat video according to the resolution request.

Images