Method and system for adding entertainment content in video call

Abstract

The invention discloses a method and system for adding entertainment content in a video call, and the method comprises the steps: S1, enabling a user to initiate a call, and carrying out the call to build a video call; s2, in the call process, waiting for an entertainment content embedding starting instruction of each terminal of the video call, and starting a video call entertainment content embedding process; s3, identifying the type of a video call entertainment content embedding process, and processing to generate an entertainment content embedding streaming media material; and S4, embedding the entertainment content embedded streaming media material into an audio and video media stream of a corresponding video call party, and putting the audio and video media stream on a corresponding terminal screen. According to the method, a technical architecture related to a new call service is utilized, the specific entertainment content embedded streaming media material is embedded into the audio and video media stream of the corresponding video call party, and the audio and video media stream is displayed on the screen of the corresponding terminal in a mixed superposition manner, so that the two call parties do not need to be based on any social software and game software; and abundant interactive entertainment behaviors can be carried out.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of wireless communication, in particular to a method and system for adding entertainment content in video call. BACKGROUND

[0002] At present, common multi-party interactive entertainment and music playing are based on the functions of various mobile phone APPs and social software, and the basic call cannot provide interactive entertainment for both parties of the call. The entertainment interactive needs of both parties of the call exist widely in daily life. For example, two children want to eat KFC and McDonald's respectively, and they cannot reach an agreement. At this time, they can decide through the game of rock-paper-scissors. However, such an interactive game that can provide users with rich experience cannot be realized in the current basic call mode, and cannot be performed with the called party when making a call. There are some technical solutions for fusing objects in video call in the prior art, for example, a Chinese patent application with publication number CN117676065A discloses a video call method and electronic device. In the process of video call between the electronic device and another electronic device, the electronic device can fuse the image of the user-specified fusion object into the video image collected by the camera of the other electronic device based on the received user operation, and display the fused video image. The image of the fusion object is in the video image collected by the camera of the other electronic device. In this way, the electronic device can fuse the user-specified object into the video image based on the user demand, thereby realizing online interaction between users in video call and improving the practicability of video call and the user experience. The defect of the technical solution is that the fused object is specified by the user, which is not flexible enough, cannot make good use of resources, and has poor interactivity. In view of the above problems, it is necessary to research and design a method and system for embedding interactive entertainment in basic call, so that both parties of the call can perform various rich interactive entertainment behaviors in the video call framework without any social software and game software, which will be conducive to improving the user experience effect of both parties of the call. SUMMARY

[0003] The present application provides a method for adding entertainment content in video call, which comprises the following steps:

[0004] S1, a user initiates a call to establish a video call;

[0005] S2, in the process of the call, waiting for an entertainment content embedding start instruction of each terminal of the video call, and if an entertainment content embedding start instruction of the calling terminal and the called terminal is received, starting an entertainment content embedding process of the video call;

[0006] S3, identifying the type of the entertainment content embedding process of the video call, calling a corresponding software plug-in, performing operation processing, and generating entertainment content embedding streaming media materials;

[0007] S4, embedding the entertainment content embedded streaming material into the audio and video media stream of the corresponding video call party and playing on the corresponding terminal screen.

[0008] As a further illustration of the present application, the entertainment content embedded streaming material includes pictures, animations or background music.

[0009] Further, the entertainment content embedding start instruction is a mobile phone key instruction and / or a voice instruction.

[0010] Further, in step S2, the key operation instruction during the call of each party of the video call is detected in real time, and the entertainment content setting of the corresponding terminal is compared through preset key information to realize key start;

[0011] Alternatively, the voice keywords during the call of each party of the video call are detected in real time, and the entertainment content embedding is started by capturing the keywords in the voice data of each party of the video call in real time to realize voice start.

[0012] Alternatively, the sound melody during the call of each party of the video call is detected in real time, and the background play and audio reverberation function of the song accompaniment are automatically started.

[0013] Further, in step S4, the specific requirements of the identified entertainment content are superimposed and mixed with the video call images and audio of both parties, and played on the terminal screens of the calling parties.

[0014] Further, the related game pictures or animations are superimposed on the shooting real scene of the video call terminal camera to prompt the user to perform corresponding entertainment content interactive operation.

[0015] On the other hand, the present application also provides a system for adding entertainment content in video call, which comprises an interactive game component, an interactive entertainment driving platform, a touch screen event listening and reporting module, a service database, a call media stream RTP processing module and a voice recognition server.

[0016] The interactive game component has a plurality of game plug-ins, including picture, animation, background music and other material files related to the game, and a game rule operation processing logic module.

[0017] The interactive entertainment driving platform is used to provide a general audio and video animation playing interface to the upper game component, and provide a general and standard user game behavior to the upper game module.

[0018] The touch screen event monitoring reporting module is used for receiving a user UI behavior monitoring request issued by a lower layer driving module, issuing a call party touch screen event monitoring sip-info message, and reporting the monitoring result to the upper layer game processing module;

[0019] The service database is used for storing and providing query service subscription information and user related attributes;

[0020] The call media stream RTP processing module is used for processing picture, animation and music playing requests issued by the upper layer game module, superimposing and mixing the materials with the video call images and audios of both parties according to the specific requirements of the game module, and playing on the terminal screens of the call parties.

[0021] The voice recognition server is used for capturing keywords or sound melodies in the voice data of both parties in real time, starting background music playing in real time when the preset keywords are captured, and automatically starting background playing of song accompaniment and audio reverberation functions when the melody of a birthday song is captured.

[0022] The beneficial effects of the present application are as follows:

[0023] The present application uses a new technical framework related to the basic call service, embeds specific entertainment content into the stream media materials, and embeds the stream media materials into the audio and video media streams of the corresponding video call parties, so that the specific entertainment content is displayed on the screens of the corresponding terminals in a mixed and superimposed manner. The call parties do not need to be based on any social software and game software, and can only carry out rich interactive entertainment behaviors in the video call framework. For the terminal users, the music and game experience can be directly enjoyed in the basic call, without relying on social software. The experience of the basic call is greatly enhanced. For the operators, the present application provides a breakthrough channel for entering the Internet entertainment game market, and meets the demand of the operators for using the absolute advantage of the basic call service to seek new business growth points. BRIEF DESCRIPTION OF DRAWINGS

[0024] Figure 1 The method flowchart for adding entertainment content in the video call of the present application is shown in the figure. DETAILED DESCRIPTION

[0025] The embodiments of the present application will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only some of the embodiments of the present application, but not all the embodiments.

[0026] In the description of the present application, it should be understood that the terms "upper", "lower", "front", "back", "left", "right", "top", "bottom", "inner", "outer", "first", "second" and the like indicate the orientation or position or order relationship shown in the drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the devices or elements referred to must have a particular orientation, be constructed and operated in a particular orientation, and therefore cannot be understood as a limitation on the present application.

[0027] The method for adding entertainment content in a video call of the present application comprises the following steps:

[0028] S1, a user initiates a call to establish a video call;

[0029] S2, during the call, waiting for an entertainment content embedding start instruction of a terminal of each party of the video call, if an entertainment content embedding start instruction of a calling terminal or a called terminal is received, starting an entertainment content embedding process of the video call;

[0030] S3, identifying the type of the entertainment content embedding process of the video call, calling a corresponding software plug-in, performing operation processing, and generating entertainment content embedding streaming media materials;

[0031] S4, embedding the entertainment content embedding streaming media materials into the audio and video media stream of the corresponding party of the video call, and displaying on the screen of the corresponding terminal.

[0032] The present application uses a new call service related technical architecture, embeds specific entertainment content embedding streaming media materials into the audio and video media stream of the corresponding party of the video call, and displays on the screen of the corresponding terminal in a mixed and superimposed manner, so that the calling parties can perform rich interactive entertainment behaviors in the framework of the video call without any social software and game software; for the terminal user, it can directly enjoy music and game experience in the basic call, without relying on social software. The experience of the basic call is greatly enhanced; for the operator, it provides a breakthrough channel to enter the Internet entertainment game market, and meets the demand of the operator to seek new business growth points by using the absolute advantage of the basic call service.

[0033] Specifically, the entertainment content embedding streaming media materials include pictures, animations or background music, for example, specific pictures or animations can be mixed and superimposed on the basis of the video image of the camera real-time video image of the calling party to perform video display, and specific background music can be mixed and superimposed on the basis of the communication audio stream of the calling party to perform audio play, so as to achieve specific entertainment interactive effect in the video call.

[0034] In practical applications, the entertainment content embedding start instruction is a mobile phone key instruction and / or a voice instruction, that is, the start of the entertainment interactive function can be realized through mobile phone key operation on the call terminal in the call process, or the start of the entertainment interactive function can be realized through voice recognition function. In a feasible manner, in step S2, the key operation instruction in the call process of each party in the video call is detected in real time, and the entertainment content of the corresponding terminal is set through preset key information comparison to realize key start. As for the start mode of the voice instruction, there can be multiple detection and recognition start modes, for example, the voice keywords in the call process of each party in the video call are detected in real time, and the entertainment content embedding is started through the way of capturing the keywords in the voice data of each party in the video call to realize voice start; or the sound melody in the call process of each party in the video call is detected in real time, and the background playing of song accompaniment and audio reverberation function are automatically started.

[0035] The above-mentioned entertainment interactive mode in the call is described by taking actual application example scenario 1 as an example, and the main process is as follows:

[0036] S1. The call party B has a birthday, and the call party A cannot be present and makes a telephone blessing;

[0037] S2. In the video call, the call party A sings a birthday blessing song for the call party B, and the call party A starts the corresponding song accompaniment and lyric subtitle mode through the key or voice mode;

[0038] S3. The call party A can hear the song accompaniment and singing voice, as well as the effect after reverberation, for the call party B; and the atmosphere of singing is improved;

[0039] S4. In addition to the basic call opposite video on the terminal screen picture, a birthday cake and other blessing special effects can also be presented.

[0040] As described above, to realize the entertainment interactive effect of the call parties or multiple parties, in step S4, the specific needs of the identified entertainment content are superimposed and mixed with the video call images and audio of the two parties, and then the entertainment interactive effect is realized by logically putting the two parties or multiple parties on the terminal screen.

[0041] In some embodiments, related game pictures or animations can be superimposed on the shooting real scene of the video call terminal camera to prompt the user to perform corresponding entertainment content interactive operation and realize the game entertainment interactive effect.

[0042] The above-mentioned game entertainment interactive mode in the call is described by taking actual application example scenario 2 as an example, and the main process is as follows:

[0043] S1. A small game participated by each party in the call is embedded in the basic call;

[0044] S2. The parties ABC are in a video call;

[0045] S3. Party A starts a card game - Dou Dizhu;

[0046] S4. The system built-in game module deals cards to the three parties in the call, and game pictures and animations are respectively presented to the mobile phone screens of the three parties in the call;

[0047] S5. The three parties ABC complete game operation in the basic call and obtain game experience.

[0048] To realize the method of adding entertainment content in a video call, the system for adding entertainment content in a video call comprises an interactive game component, an interactive entertainment driving platform, a touch screen event monitoring reporting module, a service database, a call media stream RTP processing module and a voice recognition server.

[0049] The interactive game component has a plurality of game plug-ins, including picture, animation, background music and other material files related to the game, and a game rule operation processing logic module.

[0050] The interactive entertainment driving platform is used to provide a general audio and video animation playing interface to the upper game component, and provide a general and standard user game behavior to the upper game module.

[0051] The touch screen event monitoring reporting module is used to receive a user UI behavior monitoring request issued by the upper driving module, issue a call party touch screen event monitoring sip-info message, and report the monitoring result to the upper game processing module.

[0052] The service database is used to store and provide query service subscription information and user related attributes.

[0053] The call media stream RTP processing module is used to process picture, animation and music playing requests issued by the upper game module, superimpose and mix the materials with the video call images and audios of both parties according to the specific needs of the game module, and put them on the terminal screens of the call parties.

[0054] The voice recognition server is used to capture keywords or sound melodies in the voice data of the call parties in real time, start background music playing in real time when the preset keywords are captured, and automatically start background playing of song accompaniment and audio reverberation function when the melody of a birthday song is captured.

[0055] The above only describes the preferred embodiments of the present application, but cannot be understood as a limitation on the claims. The present application is not limited to the above embodiments, and the specific structure allows changes. In general, all changes made within the protection scope of the independent claims of the present application are within the protection scope of the present application.

Claims

1. A method of adding entertainment content in a video call, characterized by, The method comprises the following steps: S1, a user initiates a call to establish a video call; S2, during the call, waiting for a video call terminal entertainment content embedding start instruction, if a called terminal entertainment content embedding start instruction is received, a video call entertainment content embedding process is started; S3, identifying the type of the video call entertainment content embedding process, calling a corresponding software plug-in, performing calculation processing, and generating entertainment content embedding streaming media materials; S4, embedding the entertainment content embedding streaming media materials into the audio and video media stream of the corresponding video call party and playing on the corresponding terminal screen.

2. The method of adding entertainment content to a video call of claim 1, wherein: The entertainment content embedding streaming media materials include pictures, animations, or background music.

3. The method of incorporating entertainment content in a video call of claim 1, wherein: The entertainment content embedding start instruction is a mobile phone key instruction and / or a voice instruction.

4. The method of adding entertainment content to a video call of claim 3, wherein: In step S2, real-time detection of key operation instructions during the call of the video call parties, comparison of the key information with the entertainment content settings of the corresponding terminal through a preset key information, and realization of key start; Or, real-time detection of voice keywords during the call of the video call parties, and realization of voice start through real-time capture of keywords in the voice data of the video call parties to start entertainment content embedding; Or, real-time detection of sound melodies during the call of the video call parties, and automatic start of background playing of song accompaniment and audio reverberation function.

5. The method of incorporating entertainment content in a video call of claim 1, wherein: In step S4, the specific requirements of the identified entertainment content are used to superimpose and mix the materials with the video call images and audio of both parties, and play on the terminal screens of the call parties.

6. The method of adding entertainment content to a video call of claim 5, wherein: On the shooting real scene of the video call terminal camera, relevant game pictures or animations are superimposed to prompt the user to perform corresponding entertainment content interactive operation.

7. A system for adding entertainment content in a video call, characterized by: The interactive game component, the interactive entertainment driving platform, the touch screen event listening and reporting module, the service database, the call media stream RTP processing module, and the voice recognition server are included. The interactive game component has a plurality of game plug-ins, including picture, animation, background music, and other material files related to the game, and a game rule calculation processing logic module. The interactive entertainment driving platform provides a general audio and video animation playing interface to the upper game component, and provides a general and standard user game behavior to the upper game module. The touch screen event listening and reporting module receives the user UI behavior monitoring request issued by the upper driving module, issues the call party touch screen event monitoring sip-info message, and reports the listening result to the upper game processing module. The service database is used to store and provide query service subscription information and user related attributes. The call media stream RTP processing module processes the picture, animation, and music playing request issued by the upper game module, superimposes and mixes the materials with the video call images and audio of both parties according to the specific requirements of the game module, and plays on the terminal screens of the call parties. The voice recognition server is used to capture keywords or sound melodies in the voice data of the call parties in real time. When the preset keywords are captured, the background music playing is started in real time. When the melody of the birthday song is captured, the background playing of song accompaniment and the audio reverberation function are automatically started.

Images