Video ringback tone real-time modification method, system, device and storage medium

Abstract

The present application discloses a method, system, device, and storage medium for real-time modification of video ringback rings. The real-time modification method for video ringback rings includes: performing object association preprocessing on a video ringback ring to be played, wherein the object is determined based on the pixel values ​​of each pixel point of adjacent video frames of the video ringback ring; sending the video ringback ring after the object association preprocessing to a terminal, wherein the video ringback ring after the object association preprocessing includes information for instructing to edit the object; receiving an editing operation sent by the terminal; based on the editing operation, editing the video ringback ring to be played, and sending the edited video ringback ring to the terminal. The present application belongs to the field of video ringback rings. Users can perform personalized editing operations on video ringback rings, thereby enhancing user participation, improving user experience, and increasing viewers' stickiness to watching video content, which is conducive to the spread of video ringback rings.

Description

Technical Field

[0001] The present application relates to the field of video ringback tone, and in particular to a method, system, device and storage medium for real-time modification of video ringback tone. Background Art

[0002] With the continuous development of communication technology, video ringback tone services have emerged. After a calling terminal initiates a communication request to a called terminal, the video ringback tone platform pushes the video ringback tone subscribed by the called terminal to the calling terminal, and the calling terminal plays the video ringback tone. However, the calling terminal's fixed method for playing the video ringback tone may result in the played video ringback tone not meeting the calling user's preferences, thus affecting the user's experience with video ringback tone.

[0003] In existing technologies, users are limited by the playback logic of video ringback rings. If they are dissatisfied, they can either hang up the phone and not watch the video, or turn off the playback function. In other words, users have no choice but to choose not to watch the video. Furthermore, existing video playback technology does not consider the situation where users are dissatisfied with only a single frame, resulting in a poor user experience with video ringback rings. Summary of the Invention

[0004] The main purpose of this application is to provide a method, system, device and storage medium for real-time modification of video ringback tone, aiming to solve the technical problem of poor user experience of video ringback tone.

[0005] To achieve the above objectives, the present application provides a method for real-time modification of video ringback tone, which includes:

[0006] Performing object association preprocessing on the video ringback tone to be played, wherein the object is determined according to the pixel value of each pixel point of adjacent video frames of the video ringback tone;

[0007] Sending a video ringback tone after object association preprocessing to the terminal, wherein the video ringback tone after object association preprocessing includes information for instructing to edit the object;

[0008] receiving an editing operation sent by the terminal;

[0009] Based on the editing operation, the video ringback ring to be played is edited, and the edited video ringback ring is sent to the terminal.

[0010] Optionally, the step of performing object association preprocessing on the video ringback tone to be played includes:

[0011] Performing image segmentation processing on the video ringback tone to be played to obtain a video frame in the video ringback tone to be played and RGB color values ​​of pixel blocks of the video frame;

[0012] Determining an object unit in the video ringback tone to be played based on the RGB color value of the pixel block and the displacement of an associated pixel block, wherein the associated pixel block is a continuous portion of identical pixel blocks in the video frame, and the displacement of the associated pixel block is a difference in displacement between the associated pixel block in the previous and next video frames;

[0013] The object unit is subjected to key association processing to obtain a video ring back tone to be played after association pre-processing.

[0014] Optionally, the step of performing image segmentation processing on the video ringback tone to be played to obtain a video frame in the video ringback tone to be played and RGB color values ​​of pixel blocks of the video frame includes:

[0015] Cutting the video ringback tone to be played to obtain the video frame;

[0016] Segmenting each of the video frames according to the preset pixel block size to obtain each pixel block of the video frame;

[0017] The RGB color value of each pixel block is obtained by calculation.

[0018] Optionally, the step of determining the object unit in the video ringback tone to be played based on the RGB color value of the pixel block and the displacement of the associated pixel block includes:

[0019] Selecting a first video frame and a second adjacent video frame;

[0020] Comparing the first video frame and the second video frame, and marking pixel blocks having the same RGB color values ​​in the first video frame and the second video frame;

[0021] An object unit in the video ringback tone to be played is determined based on the mark and the displacement of the associated pixel block.

[0022] Optionally, the step of editing the video ringback tone to be played based on the editing operation includes:

[0023] receiving response information from the terminal to the editing operation, wherein the response information includes an operation point number of the editing operation, wherein the operation point number is obtained by binary encoding the pixel block where the object is located;

[0024] The video ringback tone to be played is edited based on the operation point sequence number.

[0025] Optionally, after the step of sending the video ringback tone after object association preprocessing to the terminal, the method includes:

[0026] Obtaining a pixel frame of the terminal operation interface;

[0027] Based on the pixel frame of the terminal operation interface, an operation page corresponding to the pixel frame of the operation interface is generated, so that the platform end can synchronize the editing operation sent by the terminal based on the operation page and edit the video ringtone to be played, wherein the operation page and the display interface of the terminal are in different layers.

[0028] Optionally, when the content of the video ringback tone to be played after the association pre-processing is edited, the video ringback tone is in a playing state.

[0029] The present application also provides a real-time video ringback tone modification system, which includes:

[0030] An association module, configured to perform object association preprocessing on the video ringback tone to be played, wherein the object is determined based on the pixel values ​​of each pixel point of adjacent video frames of the video ringback tone;

[0031] A sending module, configured to send a video ringback ring after object association preprocessing to a terminal, wherein the video ringback ring after object association preprocessing includes information for instructing to edit the object;

[0032] A receiving module, configured to receive an editing operation sent by the terminal;

[0033] The editing module is used to edit the video ringback ring to be played based on the editing operation, and send the edited video ringback ring to the terminal.

[0034] The present application also provides a video ring back tone real-time modification device, the video ring back tone real-time modification device comprising: a memory, a processor, and a program stored in the memory for implementing the video ring back tone real-time modification method.

[0035] The memory is used to store a program for implementing a method for real-time modification of a video ringback tone;

[0036] The processor is used to execute a program for implementing the method for real-time modification of video color ring back tone, so as to implement the steps of the method for real-time modification of video color ring back tone.

[0037] The present application also provides a storage medium, on which is stored a program for implementing a method for real-time modification of video ringback tone. The program for implementing a method for real-time modification of video ringback tone is executed by a processor to implement the steps of the method for real-time modification of video ringback tone.

[0038] The present application provides a method, system, device, and storage medium for real-time modification of a video ringback tone. Compared with the prior art in which a user can only turn off the playback of a video ringback tone when he or she is dissatisfied with the video ringback tone, in the present application, the video ringback tone to be played is pre-processed with object association, wherein the object is determined based on the pixel values ​​of each pixel point of the adjacent video frames of the video ringback tone; the video ringback tone after the object association pre-processing is sent to the terminal, wherein the video ringback tone after the object association pre-processing includes information for instructing to edit the object; the editing operation sent by the terminal is received; based on the editing operation, the video ringback tone to be played is edited, and the edited video ringback tone is sent to the terminal. That is, in the present application, based on editing the video ringback tone to be played after the association pre-processing, the user can perform personalized editing operations on the video ringback tone, thereby enhancing the user's sense of participation, improving the user experience, and increasing the viewer's stickiness to watching the video ringback tone content. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The accompanying drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the specification, are used to explain the principles of the present application. In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following is a brief introduction to the drawings required for the embodiments or the description of the prior art. Obviously, for those of ordinary skill in the art, other drawings can be obtained based on these drawings without inventive work.

[0040] Figure 1 This is a schematic diagram of the device structure of the hardware operating environment involved in the embodiment of the present application;

[0041] Figure 2 This is a flowchart of the first embodiment of the method for real-time modification of video ringback tone of the present application;

[0042] Figure 3 This is a flow chart of the second embodiment of the method for real-time modification of video ringback tone of the present application;

[0043] Figure 4 This is a schematic diagram of the synchronization of terminal and platform operations for the real-time modification method of video ringback tone in this application;

[0044] Figure 5 This is a schematic diagram of a terminal video ringback tone content deletion control for the real-time modification method of the video ringback tone in this application;

[0045] Figure 6 A schematic diagram of adding controls to the terminal video ringback tone content for the real-time modification method of the video ringback tone in this application.

[0046] The realization of the objectives, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0047] It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application.

[0048] like Figure 1 As shown, Figure 1 It is a schematic diagram of the terminal structure of the hardware operating environment involved in the embodiment of the present application.

[0049] The terminal in the embodiment of the present application can be a PC, or it can be a smart phone, tablet computer, e-book reader, MP3 (Moving Picture Experts Group Audio Layer III, Moving Picture Experts Compression Standard Audio Layer 3) player, MP4 (Moving Picture Experts Group Audio Layer IV, Moving Picture Experts Compression Standard Audio Layer 4) player, portable computer and other portable terminal devices with display function.

[0050] like Figure 1 As shown, the terminal may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002. Among them, the communication bus 1002 is used to realize the connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keyboard), and the user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also be a storage system independent of the aforementioned processor 1001.

[0051] Optionally, the terminal may also include a camera, an RF (Radio Frequency) circuit, a sensor, an audio circuit, a WiFi module, and the like. Among them, sensors include light sensors, motion sensors, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display screen according to the brightness of the ambient light, and the proximity sensor may turn off the display screen and / or backlight when the mobile terminal is moved to the ear. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the posture of the mobile terminal (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; of course, the mobile terminal can also be configured with other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which will not be repeated here.

[0052] Those skilled in the art will understand that Figure 1 The terminal structure shown in the figure does not constitute a limitation to the terminal, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0053] like Figure 1 As shown, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a video ringback tone real-time modification program.

[0054] exist Figure 1 In the terminal shown, the network interface 1004 is mainly used to connect to the background server and communicate data with the background server; the user interface 1003 is mainly used to connect to the client (user end) and communicate data with the client; and the processor 1001 can be used to call the video ringback tone real-time modification program stored in the memory 1005.

[0055] Reference Figure 2 The embodiment of the present application provides a method for modifying a video ringback tone in real time, the method comprising:

[0056] Step S100, performing object association preprocessing on the video ringback tone to be played, wherein the object is determined based on the pixel values ​​of each pixel point of adjacent video frames of the video ringback tone;

[0057] Step S200, sending a video ringback tone after object association preprocessing to a terminal, wherein the video ringback tone after object association preprocessing includes information for indicating that the object is to be edited;

[0058] Step S300, receiving an editing operation sent by the terminal;

[0059] Step S400: based on the editing operation, edit the video ringback tone to be played, and send the edited video ringback tone to the terminal.

[0060] In this embodiment, the specific application scenario may be:

[0061] After the calling terminal initiates a communication request with the called terminal, the video ringback tone platform pushes the video ringback tone subscribed by the called user to the calling terminal, which then plays the ringback tone. However, the fixed method used by the calling terminal to play the ringback tone may result in the played ringback tone not matching the calling user's preferences. If dissatisfied, the user may either hang up the call without watching or turn off the playback function. In other words, if the user is dissatisfied, they have no choice but to reject the ringback tone. Furthermore, existing video playback technology fails to consider situations where the user is dissatisfied with only a single frame, resulting in a poor user experience with the ringback tone.

[0062] The specific steps are as follows:

[0063] Step S100, performing object association preprocessing on the video ringback tone to be played, wherein the object is determined based on the pixel values ​​of each pixel point of adjacent video frames of the video ringback tone;

[0064] In this embodiment, video ringback tone (RBT) is a special service under VOLTE (Voice over Long-Term Evolution). When a user makes a voice or video call on a VOLTE network, the video content displayed before the call is connected is the RBT. Users of RBT can create or upload personalized video content or select from the operator's video library. Different video content can also be set for different callers.

[0065] When the calling terminal plays the video ringback ring set by the called terminal and sends a modification intention signal to the communication terminal, the video ringback ring to be played is the video ringback ring set by the called terminal. For example, if A calls B, A's phone is playing the video ringback ring set by B. If A wants to modify the video ringback ring set by B, he sends the modification intention signal through the control on his phone. The communication terminal then sends B's video ringback ring as the video to be modified to the platform.

[0066] The terminal is a communication terminal, which can be a mobile phone or a landline phone, etc. It is currently commonly used on mobile phones.

[0067] Among them, the video ringback tone platform is connected to the terminal for communication, and the communication interface can adopt the current network communication method, which can be a communication protocol of TLS (Transport Layer Security), UDP (User Datagram Protocol), TCP (Transmission Control Protocol), etc., which is not specifically limited here.

[0068] In this embodiment, the association preprocessing is to associate the target object in the video ringback ring to be played with a key, so that the user can perform personalized editing on the video ringback ring to be played. The object association preprocessing of the video ringback ring to be played can be performed before the calling user calls, that is, after the called user sets the video ringback ring, the platform side performs association preprocessing on the video ringback ring; the object association preprocessing of the video ringback ring to be played can also be performed after the calling user calls, after the platform side confirms the information that the calling user wants to edit the video ringback ring to be played, and the platform side performs association preprocessing on the video ringback ring.

[0069] Specifically, the step S100 includes the following steps S110-S130:

[0070] Step S110, performing image segmentation processing on the video ringback tone to be played to obtain a video frame in the video ringback tone to be played and RGB color values ​​of pixel blocks of the video frame;

[0071] RGB is a commonly used method for expressing color information, using the brightness of the three primary colors (red, green, and blue) to quantitatively represent color. The RGB model, also known as the additive color mixing model, combines the three RGB colors to create color mixing, making it suitable for displays such as monitors.

[0072] RGB can be thought of as a unit cube in a three-dimensional rectangular coordinate color system. Any color in the RGB color space can be represented by a point in that three-dimensional space. In RGB color space, when the brightness of any primary color is zero, that is, at the origin, it appears as black. When all three primary colors reach their maximum brightness, they appear as white. The diagonal line connecting black and white is a gray color created by mixing the three primary colors with equal brightness; this line is called the gray line.

[0073] In this embodiment, an image segmentation algorithm is used to perform image segmentation processing on the video ringback tone to be played, and a preset RGB model is used to determine the RGB color values ​​of the pixel blocks of the video frame.

[0074] It should be noted that the image segmentation process for the video ringback tone to be played is a known prior art and will not be described in detail here.

[0075] The preset RGB model has the function of determining the RGB color value of the pixel block of the video frame for subsequent association preprocessing of the video ringback tone to be played. The preset RGB model is set on the video ringback tone platform. Specifically, the preset RGB model is trained by first obtaining pixel block training samples and RGB labels of the pixel block training samples;

[0076] Inputting the pixel block training sample into the preset to-be-trained model to obtain an RGB result;

[0077] Calculate the difference between the predicted RGB result and the RGB label of the pixel block training sample to obtain an error result;

[0078] Based on the error result, determining whether the error result meets an error standard indicated by a preset error threshold range;

[0079] If the training error result does not meet the error standard indicated by the preset error threshold range, the pixel block training sample is input into the preset model to be trained to obtain an RGB result, and the training is stopped until the training error result meets the error standard indicated by the preset error threshold range to obtain the preset RGB model.

[0080] Specifically, the step S110 includes the following steps S111-S113:

[0081] Step S111, cutting the video ringback tone to be played to obtain the video frame;

[0082] In this embodiment, the content of the video ringtone to be played is cut according to a preset frame rate to obtain video frames, wherein the preset frame rate can be set on the platform side. In this embodiment, a frame rate of 20 frames / second is selected for cutting, that is, 1 second of video content is cut into 20 pictures, that is, 20 video frames.

[0083] For example, the video ringback tone to be played contains 15 seconds of content, which is cut at a frame rate of 20 frames per second into 300 video frames, that is, 300 pictures.

[0084] Step S112, dividing each of the video frames according to the preset pixel block size to obtain each pixel block of the video frame;

[0085] In this embodiment, each video frame is segmented according to a preset pixel size, and each video frame is segmented into pixel blocks of a preset pixel size, wherein the preset pixel size can be set on the platform side. In this embodiment, a pixel size of 100*100 is selected, that is, each video frame is segmented into video frames with a length of 100 pixels and a width of 100 pixels, for a total of 10,000 pixel blocks.

[0086] Step S113: Calculate and obtain the RGB color value of each pixel block.

[0087] It should be noted that the RGB color value of each pixel block is calculated using an RGB color value calculation formula. The RGB color value calculation formula is a known prior art and will not be described in detail here.

[0088] Step S120: determining an object unit in the video ringback tone to be played based on the RGB color value of the pixel block and the displacement of an associated pixel block, wherein the associated pixel block is a continuous portion of identical pixel blocks in the video frame, and the displacement of the associated pixel block is a difference in displacement between the associated pixel block in the previous and next video frames.

[0089] In this embodiment, an object unit is an object in the video ringback tone content to be played. In this application, the object unit is determined by the RGB color value of the pixel block in each video frame. For example, if the video ringback tone content to be played includes "sun", "mountain", and "waterfall", the "sun", "mountain", and "waterfall" are object units.

[0090] Specifically, the step S120 includes the following steps S121-S123:

[0091] Step S121, selecting a first video frame and a second adjacent video frame;

[0092] In this embodiment, two preceding and following video frames are selected, wherein the first video frame and the second video frame may be any two adjacent video frames in all video frames.

[0093] For example, the video ringback tone to be played contains 15 seconds of content, which is cut at a frame rate of 20 frames / second into 300 video frames. The first video frame and the second video frame can be the 4th and 5th video frames in the 300 video frames, or any two adjacent video frames.

[0094] Step S122: comparing the first video frame and the second video frame, and marking pixel blocks having the same RGB color values ​​in the first video frame and the second video frame;

[0095] In this embodiment, identical portions of the RGB three-values ​​of the first and second video frames are compared, and the displacement difference of the identical portions between the two preceding and following images is marked. The comparison method is as follows: based on the pixel size, that is, the number of pixel blocks in each video frame, the RGB color values ​​of the pixel blocks of the first and second video frames are marked. For example, if the pixel size is 100*100 and the number of pixel blocks in each video frame is 10,000, the RGB color values ​​of the pixel blocks of the first and second video frames are marked to obtain the identical RGB color values ​​of the 10,000 pixel blocks of the first and second video frames. The displacement of each pair of identical pixel blocks between the two frames is then observed. For example, if the original 3rd frame becomes the 5th frame, the displacement is two frames to the right.

[0096] Step S123: determining the object unit in the video ringback tone to be played based on the mark and the displacement of the associated pixel block.

[0097] In this embodiment, the parts with the same RGB values ​​and the same displacement in the two pictures are circled, and whether to set them as an object unit is determined based on whether the pixel blocks are adjacent.

[0098] For example, the pixel block of the "sun" in the first video frame is in the upper left corner, and the pixel block of the "sun" in the second video frame is in the upper right corner. The pixel block composition of the "sun" in the first video frame and the second video frame is the same, and only the displacement changes, that is, it is determined that the "sun" is set as an object unit.

[0099] Step S130 , performing key association processing on the object unit to obtain a video ringback tone to be played after association pre-processing.

[0100] In this embodiment, the object unit is subjected to key association processing, that is, when the user presses a key to select the object unit of the video ringback tone to be played on the communication terminal, the selection of the entire object unit will be confirmed.

[0101] For example, in the video ringtone to be played, "sun" and "waterfall" are object units. When the user clicks any pixel in the object unit of "sun" on the mobile phone, the entire "sun" is selected and confirmed, and the dynamic playback is stopped. If the "waterfall" is not selected, the dynamic playback is maintained.

[0102] Step S200, sending a video ringback tone after object association preprocessing to a terminal, wherein the video ringback tone after object association preprocessing includes information for indicating that the object is to be edited;

[0103] In this embodiment, the video ringback tone that has been pre-processed for object association is sent to the terminal after the calling user makes a call. After the platform confirms the information that the calling user wants to edit the video ringback tone to be played, the platform sends the video ringback tone that has been pre-processed for object association to the terminal.

[0104] In this embodiment, the information used to indicate the editing of the object is to prompt the user of the editable objects in the video ringtone to be played. The specific form of expression can be to highlight the editable objects in the video ringtone, for example, the editing objects in the video ringtone have a border line, etc., or it can be a text prompt, such as displaying prompt information in a pop-up window, etc., which is not specifically limited here.

[0105] For example, the content of the video ringback tone to be played includes "sun", "mountain" and "waterfall", among which "sun", "mountain" and "waterfall" have border lines. Calling user A clicks on the border line of "sun" to edit the "sun" in the video ringback tone to be played.

[0106] Step S300, receiving an editing operation sent by the terminal;

[0107] In this embodiment, the CRBT platform receives playback feedback from the calling user's communication terminal and prompts the mobile terminal to open a modification control. After the terminal user agrees, the CRBT platform issues the modification control. The CRBT platform communicates with the calling mobile terminal to determine whether the video CRBT is playing properly. If the terminal reports that the video CRBT is playing properly, the platform issues the modification control to the calling user and changes the video CRBT to editable mode, allowing the user to modify video content elements or change the video playback text.

[0108] In this embodiment, the main editing methods for video ringback tones are image replacement, video segment deletion, personal segment recording, text editing and modification, and coding, among which the editing instructions are specific operation processes.

[0109] Specifically, during the playback of a video ringtone, if the user wants to insert a certain element into the content of the video ringtone, a key combination cutout replacement function is provided. The user can use the cutout replacement tool to cut out the video ringtone image and insert videos, pictures, etc. into the cutout part for playback. The specific implementation is as follows: Based on the pre-encoding processing of the video content by the video ringtone platform, the entire part of the video has been associated with keys. Therefore, when the user selects a point with a key association during the cutout operation, the area associated with this point will automatically pop up without interrupting the playback of the video content.

[0110] For example, the content of the video ringback tone to be played includes "sun", "mountain" and "waterfall". Calling user A removes the "sun" from the video ringback tone to be played on the mobile phone, and the mobile phone terminal sends the removal operation to the video ringback tone platform.

[0111] In another embodiment, the editing method of the video ringback tone to be played also includes a video segment deletion method, such as Figure 5 As shown, when the video ringback tone is converted to editable mode, the video ringback tone is sent to open the scroll bar, and the user can delete the video length and part of the video content; when the user deletes, the main screen will continue to play, and the scroll bar at the bottom of the screen is for the user to directly delete.

[0112] Personal clip recording increases the way, such as Figure 6 As shown, a video ringback tone clip addition button is set in the upper right corner of the video ringback tone. By clicking the add button, the user jumps to the video addition page, and can record a video content in real time to add it, or add it by uploading video content locally. During the addition process, the main screen continues to play.

[0113] Text editing and modification method: if the viewer wants to add text information during video playback, just press the corresponding control button to operate.

[0114] Step S400: based on the editing operation, edit the video ringback tone to be played, and send the edited video ringback tone to the terminal;

[0115] The video ringback ring to be played is in a playing state, that is, the target object is edited in the video ringback ring to be played, and the video ringback ring to be played is still playing.

[0116] For example, the content of the video ringtone to be played includes "sun", "mountain" and "waterfall". Caller A edits the "sun" in the video ringtone to be played and wants to remove the "sun". A selects "sun" and the "sun" area pops up automatically. After confirming the removal, the content of the video ringtone to be played only includes "mountain" and "waterfall". Among them, when A edits the "sun", the "mountain" and "waterfall" in the video ringtone to be played are still playing dynamically.

[0117] In this embodiment, for video ringback tone content, personalized operations can be performed on the video based on the viewing user's personal preferences, thereby enhancing the user's sense of participation and improving the user experience.

[0118] In this embodiment, when the user completes all modifications, the ringback tone platform sends the edited video ringback tone to the mobile terminal for the terminal user to preview. When the preview is completed, the ringback tone platform will play the video content over the video content before editing.

[0119] Specifically, the step S400 includes the following steps S410-S420:

[0120] Step S410: receiving response information from the terminal to the editing operation, wherein the response information includes an operation point number of the editing operation, wherein the operation point number is obtained by binary encoding the pixel block where the object is located;

[0121] In this embodiment, the terminal generates response information corresponding to the editing operation based on the editing operation performed by the user at the terminal, and sends the response information to the ringback tone platform. The response information includes the operation point number of the editing operation, wherein the operation point number is obtained by binary encoding the pixel block where the object is located by the user at the terminal. Figure 4 As shown in the second figure, the user's editing operation is recorded on the operation page of the terminal to obtain the operation point sequence number.

[0122] Step S420: Edit the video ringback tone to be played based on the operation point sequence number.

[0123] In this embodiment, if Figure 4 As shown in the third figure, during the operation, the mobile terminal synchronizes the operation position information serial number box to the ringtone platform through the interface. The ringtone platform receives the operation information and performs the same operation. The editing information transmission adopts the coordinate axis method, which is more accurate and fast.

[0124] For example, when a user edits a video ringtone on a mobile phone terminal, the mobile phone terminal synchronizes the user's editing operation to the platform end, and the platform end edits the video based on the user's editing operation in real time, allowing the user to observe the effect of the modification in real time.

[0125] In the method for real-time modification of a video ring back tone provided in this embodiment, in step S400, before the step of receiving the editing operation sent by the terminal, the method includes the following steps B100-B200:

[0126] Step B100, obtaining a pixel frame of the terminal operation interface;

[0127] Step B200, based on the pixel frame of the terminal operation interface, generates an operation page corresponding to the pixel frame of the operation interface, so that the platform end can synchronize the editing operation sent by the terminal based on the operation page and edit the video ringtone to be played, wherein the operation page and the display interface of the terminal are in different layers.

[0128] In this embodiment, if Figure 4As shown in the first figure, before the synchronization operation, the operation page of the mobile terminal is divided into a preset number of pixels, and the pixels are numbered. At the same time, the ringtone platform mode generates an operation page, and the same number of pixels / frames are also divided. Among them, the preset number of pixels can be set on the platform side. In this embodiment, a pixel size of 100*100 and a number of 10,000 pixels are selected.

[0129] When the mobile terminal detects the user's operation behavior, it transmits the operation point sequence number to the video ringback tone platform. The ringback tone platform receives the operation display of the mobile terminal, simulates the user operation, and finally generates a new video ringback tone based on the user operation.

[0130] The present application provides a method, system, device, and storage medium for real-time modification of a video ringback tone. Compared with the prior art in which a user can only turn off the playback of a video ringback tone when he or she is dissatisfied with the video ringback tone, in the present application, the video ringback tone to be played is pre-processed with object association, wherein the object is determined based on the pixel values ​​of each pixel point of the adjacent video frames of the video ringback tone; the video ringback tone after the object association pre-processing is sent to the terminal, wherein the video ringback tone after the object association pre-processing includes information for instructing to edit the object; the editing operation sent by the terminal is received; based on the editing operation, the video ringback tone to be played is edited, and the edited video ringback tone is sent to the terminal. That is, in the present application, based on editing the video ringback tone to be played after the association pre-processing, the user can perform personalized editing operations on the video ringback tone, thereby enhancing the user's sense of participation, improving the user experience, and increasing the viewer's stickiness to watching the video ringback tone content.

[0131] Based on the above first embodiment, this application also provides another embodiment, referring to Figure 3 , provides a method for real-time modification of video ringback tone, applied to a terminal, the method for real-time modification of video ringback tone comprising:

[0132] Step A100: receiving the user's modification information, obtaining the video ringback ring to be played, and sending the video ringback ring to be played to the platform end, so that the platform end can perform association preprocessing on the video ringback ring to be played;

[0133] In this embodiment, when the calling user communicates with the called user, it is determined whether the called user has activated the video ringback tone service. If activated, the video ringback tone set by the called user is received to obtain the video ringback tone to be played.

[0134] For example, A calls B, and B has activated the video ringback tone service. The video ringback tone set by B is played on A's mobile phone terminal and displayed on the terminal display, that is, the video ringback tone set by B is played on A's mobile phone.

[0135] Among them, the video ringback tone platform is connected to the terminal for communication, and the communication interface can adopt the current network communication method, which can be the communication protocol of TLS, UDP, TCP, etc., which is not specifically limited here.

[0136] In this embodiment, after the terminal confirms the user's intention to modify the video ringback tone to be played, the terminal sends the video ringback tone to be played to the platform end. Specifically, the terminal displays the modification selection control. After the user clicks the modification selection control, the terminal receives and sends the confirmation information to the terminal display. After the user chooses to confirm the modification, the video ringback tone to be played is sent to the platform end.

[0137] For example, A calls B, and the video ringtone set by B is playing on A's mobile phone. A wants to edit and modify the video ringtone, so he clicks the modify button on the mobile phone screen. The screen displays a confirmation message. After A clicks confirm, the terminal sends the video ringtone to the platform.

[0138] Step A200: Acquire the user's editing operation, synchronize the editing operation to the platform end, so that the platform end edits the associated pre-processed video ringback tone to be played based on the editing operation, and obtains the edited video ringback tone to be played;

[0139] In this embodiment, if Figure 4 As shown in the first figure, before the synchronization operation, the operation page of the mobile terminal is divided into a preset number of pixels, and the pixels are numbered. At the same time, the ringtone platform mode generates an operation page, and the same number of pixels / frames are also divided. Among them, the preset number of pixels can be set on the platform side. In this embodiment, a pixel size of 100*100 and a number of 10,000 pixels are selected.

[0140] When the mobile terminal detects the user's operation behavior, it transmits the operation point sequence number to the video ringback tone platform. The ringback tone platform receives the operation display of the mobile terminal, simulates the user operation, and finally generates a new video ringback tone based on the user operation.

[0141] Step A300: receiving and displaying the edited video ringback tone to be played sent by the platform;

[0142] In this embodiment, after the platform edits the video ringback ring to be played, the video ringback ring to be played is sent to the terminal, so that the user can observe the effect of the modification in real time.

[0143] In this embodiment, when the user completes all modifications, the ringback tone platform sends the modified video ringback tone to the mobile terminal for the terminal user to preview. After the preview is completed, the ringback tone platform will overwrite the video content before editing with the new video content for playback, directly replacing the playback channel with the edited video, thereby increasing the viewer's stickiness to watching the video content and improving the user experience.

[0144] In the present application, after receiving the user's confirmation to modify the video ringtone, the platform performs image segmentation on the video ringtone to be played based on the RGB model, determines the object units in the content of the video ringtone to be played, and completes the association preprocessing of the video ringtone to be played; the video ringtone platform receives the user's editing operation synchronized in real time by the terminal, and edits the video ringtone to be played accordingly. During the editing operation, the object units that are not selected for editing continue to play; the edited video ringtone is sent to the terminal, and the user's edited video ringtone to be played is displayed for preview. When the preview is completed, the ringtone platform will overwrite the video content before editing with the video content for playback.

[0145] In this application, when a user watches other people's video ringtones, he can edit the video ringtones and spread the video ringtones after the operation. This is a new short video social method that uses editing instead of directly replacing the playback channel of the video, enhancing user participation and improving user experience. It not only increases the viewer's stickiness to watching video content, but also is conducive to the spread of video ringtones.

[0146] The present application also provides a real-time video ringback tone modification system, which includes:

[0147] An association module, configured to perform object association preprocessing on the video ringback tone to be played, wherein the object is determined based on the pixel values ​​of each pixel point of adjacent video frames of the video ringback tone;

[0148] A sending module, configured to send a video ringback ring after object association preprocessing to a terminal, wherein the video ringback ring after object association preprocessing includes information for instructing to edit the object;

[0149] A receiving module, configured to receive an editing operation sent by the terminal;

[0150] The editing module is used to edit the video ringback ring to be played based on the editing operation, and send the edited video ringback ring to the terminal.

[0151] The specific implementation of the video ringback tone real-time modification system of the present application is basically the same as the embodiments of the above-mentioned video ringback tone real-time modification method, and will not be repeated here.

[0152] The present application also provides a video ring back tone real-time modification device, the video ring back tone real-time modification device comprising: a memory, a processor, and a program stored in the memory for implementing the video ring back tone real-time modification method.

[0153] The memory is used to store a program for implementing a method for real-time modification of a video ringback tone;

[0154] The processor is used to execute a program for implementing the method for real-time modification of video color ring back tone, so as to implement the steps of the method for real-time modification of video color ring back tone.

[0155] The specific implementation of the video ringback tone real-time modification device of the present application is basically the same as the embodiments of the above-mentioned video ringback tone real-time modification method, and will not be repeated here.

[0156] The present application also provides a storage medium, on which is stored a program for implementing a method for real-time modification of video ringback tone. The program for implementing a method for real-time modification of video ringback tone is executed by a processor to implement the steps of the method for real-time modification of video ringback tone.

[0157] The specific implementation of the storage medium of the present application is basically the same as the embodiments of the above-mentioned method for real-time modification of video ringback tone, and will not be repeated here.

[0158] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0159] The serial numbers of the above embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0160] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0161] The above are only preferred embodiments of the present application and do not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A method for real-time modification of video ringback tone, characterized in that: The method for real-time modification of video ringback tone includes: During the video ringback ring playback process, the video ringback ring to be played is subjected to object association preprocessing, wherein the object is determined based on the pixel values ​​of each pixel point of adjacent video frames of the video ringback ring; wherein the association preprocessing is to associate the target object in the video ringback ring to be played with a key; Sending a video ringback tone after object association preprocessing to the terminal, wherein the video ringback tone after object association preprocessing includes information for instructing to edit the object; Receiving the editing operation sent by the terminal; wherein the CRBT platform receives playback feedback from the calling user's communication terminal and initiates a prompt to open the modification control to the mobile terminal. After the terminal user agrees, the CRBT platform issues the modification control to receive the editing operation sent by the terminal; Based on the editing operation, the video ringback ring to be played is edited, and the edited video ringback ring is sent to the terminal.

2. The method for real-time modification of video ringback tone according to claim 1, wherein: The step of performing object association preprocessing on the video ringback tone to be played includes: Performing image segmentation processing on the video ringback tone to be played to obtain a video frame in the video ringback tone to be played and RGB color values ​​of pixel blocks of the video frame; Determining an object unit in the video ringback tone to be played based on the RGB color value of the pixel block and the displacement of an associated pixel block, wherein the associated pixel block is a continuous portion of identical pixel blocks in the video frame, and the displacement of the associated pixel block is a difference in displacement between the associated pixel block in the previous and next video frames; The object unit is subjected to key association processing to obtain a video ring back tone to be played after association pre-processing.

3. The method for real-time modification of video ringback tone according to claim 2, wherein: The step of performing image segmentation processing on the video ringback tone to be played to obtain a video frame in the video ringback tone to be played and RGB color values ​​of pixel blocks of the video frame comprises: Cutting the video ringback tone to be played to obtain the video frame; Segmenting each of the video frames according to the preset pixel block size to obtain each pixel block of the video frame; The RGB color value of each pixel block is calculated.

4. The method for real-time modification of video ringback tone according to claim 2, wherein: The step of determining the object unit in the video ringback tone to be played based on the RGB color value of the pixel block and the displacement of the associated pixel block includes: Selecting a first video frame and a second adjacent video frame; Comparing the first video frame and the second video frame, and marking pixel blocks having the same RGB color values ​​in the first video frame and the second video frame; An object unit in the video ringback tone to be played is determined based on the mark and the displacement of the associated pixel block.

5. The method for real-time modification of video ringback tone according to claim 1, wherein: The step of editing the video ringback tone to be played based on the editing operation includes: receiving response information from the terminal to the editing operation, wherein the response information includes an operation point number of the editing operation, wherein the operation point number is obtained by binary encoding the pixel block where the object is located; The video ringback tone to be played is edited based on the operation point sequence number.

6. The method for real-time modification of video ringback tone according to claim 1, wherein: After the step of sending the video ringback tone after object association preprocessing to the terminal, the method includes: Obtaining a pixel frame of the terminal operation interface; Based on the pixel frame of the terminal operation interface, an operation page corresponding to the pixel frame of the operation interface is generated, so that the platform end can synchronize the editing operation sent by the terminal based on the operation page and edit the video ringtone to be played, wherein the operation page and the display interface of the terminal are in different layers.

7. The method for real-time modification of video ringback tone according to claim 1, wherein: When the content of the video ringback tone to be played after the association pre-processing is edited, the video ringback tone is in a playing state.

8. A real-time video ringback tone modification system, characterized in that: The video ring back tone real-time modification system includes: An association module is configured to perform object association preprocessing on the video ringback ring to be played during the video ringback ring playback process, wherein the object is determined based on the pixel values ​​of each pixel point of adjacent video frames of the video ringback ring; wherein the association preprocessing is to associate the target object in the video ringback ring to be played with a key; A sending module, configured to send a video ringback ring after object association preprocessing to a terminal, wherein the video ringback ring after object association preprocessing includes information for instructing to edit the object; A receiving module, configured to receive the editing operation sent by the terminal; wherein the CRBT platform receives playback feedback from the calling user's communication terminal and initiates a prompt to open the modification control to the mobile terminal. After the terminal user agrees, the CRBT platform issues the modification control to receive the editing operation sent by the terminal; The editing module is used to edit the video ringback ring to be played based on the editing operation, and send the edited video ringback ring to the terminal.

9. A real-time video ringback tone modification device, characterized in that: The video ring back tone real-time modification device includes: a memory, a processor, and a program stored in the memory for implementing the video ring back tone real-time modification method. The memory is used to store a program for implementing a method for real-time modification of a video ringback tone; The processor is configured to execute a program for implementing the method for real-time modification of video ringback tone, so as to implement the steps of the method for real-time modification of video ringback tone as claimed in any one of claims 1 to 7.

10. A storage medium, characterized in that: The storage medium stores a program for implementing a method for real-time modification of a video ringback tone, and the program for implementing a method for real-time modification of a video ringback tone is executed by a processor to implement the steps of the method for real-time modification of a video ringback tone as claimed in any one of claims 1 to 7.

Images