Video ringback tone recommendation method, device, storage medium and apparatus
Through the categories distinguished by pixel change amplitude, the tone determined by color preference information and the multi-dimensional recommendation of video key content recognition, the problem of inaccurate video ringtone recommendation in the prior art is solved, and the efficiency and accuracy of recommendation are improved.
Patent Information
- Application Number
- CN202210996187.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-08-18
- Publication Date
- 2024-12-13
- Estimated Expiration
- 2042-08-18
AI Technical Summary
The existing video ringtone recommendation method requires manual regular maintenance, which is time-consuming and labor-intensive, and due to the single recommendation dimension, the recommendation is inaccurate.
By selecting the recommended category based on pixel change amplitude from the ring ring category, determining the recommended tone based on color preference information, and identifying the recommended content based on the video key content of the video ring ring, and recommending the video ring ring based on multi-dimensionality.
It realizes automated classification and content recognition, improves the efficiency and accuracy of video ringtone recommendations, and reduces the need for manual processing.
Smart Images

Figure CN115412636B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of communication service technology, and in particular to a method, device, storage medium and apparatus for recommending video ringback tone. Background Art
[0002] Currently, when recommending video ringback rings, it is usually necessary to manually classify the video ringback rings and then recommend the classified video ringback rings to users. In actual applications, the above method requires regular manual maintenance, which is time-consuming and labor-intensive. In addition, the recommendation dimension is single, which leads to inaccurate recommendations. Summary of the Invention
[0003] The main purpose of the present invention is to provide a video ringback tone recommendation method, device, storage medium and apparatus, aiming to solve the technical problems that the existing video ringback tone recommendation method requires manual regular maintenance, is time-consuming and labor-intensive, and has inaccurate recommendations due to the single recommendation dimension.
[0004] To achieve the above object, the present invention provides a method for recommending a video ringback tone, which comprises the following steps:
[0005] Selecting a recommended category from the color ring back tone categories, wherein the color ring back tone categories are distinguished based on the pixel change amplitude of the video color ring back tone;
[0006] Determining recommended hues based on color preference information;
[0007] Selecting recommended content based on ringback tone content, wherein the ringback tone content is based on video key content identification of the video ringback tone;
[0008] A video ringback tone is recommended based on the recommended category, the recommended tone, and the recommended content.
[0009] Optionally, before the step of selecting a recommended category from the CRBT categories, the method further includes:
[0010] Get the number of pixels of each frame in the video ringback tone;
[0011] Determining a pixel change amplitude according to the number of pixels;
[0012] The color ring back tone category is determined according to the pixel change amplitude.
[0013] Optionally, the step of determining the pixel change amplitude according to the number of pixels includes:
[0014] Determine an average pixel change reference value based on the number of pixels;
[0015] The pixel change amplitude is determined by a preset discrete model according to the pixel change average reference value.
[0016] Optionally, before the step of selecting recommended content according to the ringback tone content, the method further includes:
[0017] Get the key content of the video in the video ringback tone;
[0018] Determine the frame ratio and duration ratio of the key video content in the video ringback tone;
[0019] The content of the ring back tone is identified according to the frame ratio and the duration ratio.
[0020] Optionally, the step of determining the frame ratio and duration ratio of the key video content in the video ringback tone includes:
[0021] Obtaining the number of pixels of the key content of the video in each frame image, and counting the total number of pixels of each frame image;
[0022] Counting the number of frames containing the key content of the video and determining the total number of frames of the video ringback tone;
[0023] Determine a frame ratio of the key video content in the video ringback tone based on the number of pixels, the total number of pixels, the number of frames, and the total number of frames;
[0024] The duration ratio of the key video content in the video ringback tone is determined according to the number of frames and the total number of frames.
[0025] Optionally, the step of determining a recommended color tone according to the color preference information includes:
[0026] Construct a pairwise comparison matrix based on color preference information;
[0027] A weight value of each color is determined based on the pairwise comparison matrix, and a recommended color tone is determined according to the weight value.
[0028] Optionally, after the step of recommending a video ringback tone based on the recommended category, the recommended tone, and the recommended content, the method further includes:
[0029] When the recommended video ringback tone is triggered, recommending the recommended video ringback tone to non-triggering users;
[0030] If confirmation information based on the recommended video ringback tone is received from the non-triggered user, the recommended video ringback tone is set as the non-triggered video ringback tone.
[0031] In addition, to achieve the above-mentioned purpose, the present invention also proposes a video ringback tone recommendation device, which includes a memory, a processor, and a video ringback tone recommendation program stored in the memory and executable on the processor, wherein the video ringback tone recommendation program is configured to implement the video ringback tone recommendation method described above.
[0032] In addition, to achieve the above object, the present invention further provides a storage medium, on which a video ringback tone recommendation program is stored. When the video ringback tone recommendation program is executed by a processor, the video ringback tone recommendation method described above is implemented.
[0033] In addition, to achieve the above-mentioned purpose, the present invention also proposes a video ringback tone recommendation device, which includes: a category recommendation module, a tone recommendation module, a content recommendation module and a ringback tone recommendation module;
[0034] The category recommendation module is used to select a recommended category from the CRBT categories, where the CRBT categories are distinguished based on the pixel change amplitude of the video CRBT;
[0035] The color tone recommendation module is used to determine the recommended color tone according to the color preference information;
[0036] The content recommendation module is used to select recommended content based on the ringback tone content, wherein the ringback tone content is based on the video key content identification of the video ringback tone;
[0037] The CRBT recommendation module is configured to recommend video CRBTs based on the recommendation category, the recommended tone, and the recommended content.
[0038] The present invention discloses selecting a recommended category from ringback tone categories, distinguishing the ringback tone categories based on the pixel change amplitude of the video ringback tone, determining the recommended hue based on color preference information, selecting recommended content from the ringback tone content, identifying the ringback tone content based on the video key content of the video ringback tone, and recommending the video ringback tone based on the recommended category, recommended hue, and recommended content. Since the present invention can automatically classify and identify the content of video ringback tones, no manual processing is required, thereby improving the efficiency of video ringback tone recommendations, and since the present invention recommends video ringback tones to users from multiple dimensions, it can improve the accuracy of video ringback tones recommendations. BRIEF DESCRIPTION OF THE DRAWINGS
[0039] Figure 1 1 is a schematic structural diagram of a video ringback tone recommendation device in a hardware operating environment according to an embodiment of the present invention;
[0040] Figure 2 This is a flow chart of a first embodiment of a method for recommending a video ringback tone according to the present invention;
[0041] Figure 3 This is a flow chart of a second embodiment of the method for recommending a video ringback tone according to the present invention;
[0042] Figure 4 This is a flow chart of a third embodiment of a method for recommending a video ringback tone according to the present invention;
[0043] Figure 5This is a flow chart of a fourth embodiment of a method for recommending a video ringback tone according to the present invention;
[0044] Figure 6 This is a schematic diagram of a calling user recommending a ring back tone to a called user according to a method for recommending a video ring back tone according to an embodiment of the present invention;
[0045] Figure 7 This is a structural block diagram of the first embodiment of the video ringback tone recommendation device of the present invention.
[0046] The purpose, features and advantages of the present invention will be further described with reference to the accompanying drawings and in conjunction with the embodiments. DETAILED DESCRIPTION
[0047] It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.
[0048] Reference Figure 1 , Figure 1 This is a schematic diagram of the structure of a video ringback tone recommendation device in the hardware operating environment involved in an embodiment of the present invention.
[0049] like Figure 1 As shown, the video ringback tone recommendation device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used to implement communication between these components. The user interface 1003 may include a display screen. Optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. In the present invention, the wired interface of the user interface 1003 may be a USB interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a wireless fidelity (Wi-Fi) interface). The memory 1005 may be a high-speed random access memory (RAM) or a non-volatile memory (NVM), such as a disk storage. The memory 1005 may also be a storage device independent of the processor 1001.
[0050] Those skilled in the art will understand that Figure 1 The structure shown in the figure does not constitute a limitation on the video ringback tone recommendation device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.
[0051] like Figure 1As shown, the memory 1005 identified as a computer storage medium may include an operating system, a network communication module, a user interface module, and a video ringback tone recommendation program.
[0052] exist Figure 1 In the video ringback tone recommendation device shown, the network interface 1004 is mainly used to connect to the background server and communicate data with the background server; the user interface 1003 is mainly used to connect to the user device; the video ringback tone recommendation device calls the video ringback tone recommendation program stored in the memory 1005 through the processor 1001 and executes the video ringback tone recommendation method provided by the embodiment of the present invention.
[0053] Based on the above hardware structure, an embodiment of the video ringback tone recommendation method of the present invention is proposed.
[0054] Reference Figure 2 , Figure 2 This is a flow chart of the first embodiment of the video ringback tone recommendation method of the present invention, which provides the first embodiment of the video ringback tone recommendation method of the present invention.
[0055] In the first embodiment, the video ringback tone recommendation method includes the following steps:
[0056] Step S10: selecting a recommended category from the CRBT categories, wherein the CRBT categories are differentiated based on the pixel change amplitude of the video CRBT.
[0057] It should be understood that the execution subject of the method of this embodiment can be a video ringback tone recommendation device with data processing, network communication and program running functions, such as a server, etc., or other electronic devices that can achieve the same or similar functions. This embodiment does not limit this.
[0058] It should be noted that the ringtone category may be at least one of action, adventure, comedy, drama, fantasy, horror, romance, history, sports, technology, entertainment, and work.
[0059] It is understandable that selecting a recommended category from the ringback tone category may be to obtain a user portrait, match the user portrait with the ringback tone category, and determine the recommended category based on the matching result.
[0060] It should be understood that determining the recommended category according to the matching result may be taking the category of the successfully matched ringback tone as the recommended category.
[0061] It should be noted that the pixel change amplitude may be the pixel change difference rhythm between frames of the video ringback tone, and the pixel change difference rhythm may be used to classify the video ringback tone content. For example, the pixel change difference rhythm of the action category and the entertainment category is completely different.
[0062] It is understood that distinguishing the CRBT category based on the pixel change amplitude of the video CRBT can be performed by searching a preset category table for the CRBT category corresponding to the pixel change amplitude to obtain the CRBT category. The preset category table includes a correspondence between the pixel change amplitude and the CRBT category, and the correspondence between the pixel change amplitude and the CRBT category can be pre-set.
[0063] Step S20: Determine a recommended color tone according to the color preference information.
[0064] It should be understood that different users prefer different video tones. For example, in historical video ringback rings, most video ringback rings are gray, but some users particularly dislike gray. Therefore, when recommending video ringback rings, the recommended tones can also be determined based on color preference information.
[0065] It should be noted that the color preference information is used to indicate the user's preference for each color. The higher the preference, the more the user likes the color.
[0066] It is understandable that determining the recommended hue according to the color preference information may be to sort the hues according to the color preference information and determine the recommended hue according to the sorting result.
[0067] Step S30: selecting recommended content according to the CRBT content, wherein the CRBT content is based on the video key content identification of the video CRBT.
[0068] It should be noted that the ringback tone content may be the content that has been identified in the video ringback tone.
[0069] It should be understood that selecting recommended content from the CRBT content may be to match the CRBT content with the user's preferred CRBT content, and using the successfully matched CRBT content as the recommended content.
[0070] It should be noted that the key content of the video can be the most eye-catching content in the video ringtone. For example, if the video ringtone is a basketball game clip, when a basketball goal is scored, the camera is zoomed in, which is the most eye-catching. The goal scene can be used as the key content of the video.
[0071] It is understandable that the key content of the video can be obtained by analyzing the video ringback tone.
[0072] It should be understood that the video key content based on video ringback tone identification can be to use the video key content with the largest duration as the ringback tone content. For example, the video ringback tone is a basketball game clip, and the video key picture can be a goal picture and a running picture. Among them, the goal picture accounts for 3S in duration and the running picture accounts for 1S in duration, then the goal picture will be used as the ringback tone content.
[0073] Step S40: recommending a video ringback tone based on the recommended category, the recommended tone, and the recommended content.
[0074] It should be understood that recommending video ringtones based on recommended categories, recommended tones, and recommended content can be by first screening out video ringtones of recommended categories, then selecting video ringtones of recommended tones from the recommended categories, then selecting video ringtones of recommended content from the recommended tones, and then recommending the video ringtones to the user.
[0075] Alternatively, the video ringback rings in the ringback ring library may be filtered simultaneously from three dimensions: recommended category, recommended tone, and recommended content, and the filtered video ringback rings may be recommended to the user. This embodiment does not impose any limitation on this.
[0076] In a first embodiment, a method is disclosed for selecting a recommended category from a ringback tone category, distinguishing the ringback tone category based on the pixel change amplitude of a video ringback tone, determining a recommended hue based on color preference information, selecting recommended content from the ringback tone content, identifying the ringback tone content based on the video key content of the video ringback tone, and recommending a video ringback tone based on the recommended category, recommended hue, and recommended content. Since the present embodiment can automatically classify and identify the content of video ringback tones, no manual processing is required, thereby improving the efficiency of video ringback tone recommendations. Moreover, since the present embodiment recommends video ringback tones to users from multiple dimensions, the accuracy of video ringback tones recommendations can be improved.
[0077] Reference Figure 3 , Figure 3 This is a flow chart of the second embodiment of the video ringback tone recommendation method of the present invention, based on the above Figure 2 The first embodiment shown provides a second embodiment of the video ringback tone recommendation method of the present invention.
[0078] In the second embodiment, before step S10, the method further includes:
[0079] Step S01: Obtain the number of pixels of each frame image in the video ring back tone.
[0080] It should be understood that, in order to improve the accuracy of CRBT classification, in this embodiment, the number of pixels of each frame image in the video CRBT is also introduced to calculate the pixel variation amplitude of the video CRBT.
[0081] It should be noted that the video ring back tone may be a video ring back tone in a ring back tone library, wherein the ring back tone library may be pre-set.
[0082] Step S02: determining the pixel change amplitude according to the pixel number.
[0083] It can be understood that determining the pixel change amplitude according to the number of pixels may be performed by comparing the number of pixels of each frame image and determining the pixel change amplitude according to the pixel comparison result.
[0084] It should be understood that in order to improve the accuracy of the pixel change amplitude, the pixel change amplitude can be determined based on the number of pixels. It can also be determined by determining the pixel ratio of each time period based on the number of pixels and the frame time of each frame image, and then determining the average pixel change reference value based on the pixel ratio, and then using the average pixel change reference value as the pixel change amplitude of the video ringtone.
[0085] In the specific implementation, K(1...s) video ringback tones are obtained from the ringback tones library, K(1) is the first video ringback tones in the ringback tones library, the total duration of the video ringback tones K(1) is K(1)t seconds, and the page of the video ringback tones K(1) is captured to obtain K(1)t1...K(1)t m There are m frames in total. The first frame image K(1)t1 has a frame time of t1 and a pixel number of Img1. The second frame image K(1)t2 has a frame time of t2 and a pixel number of Img2. Similarly, the mth frame image K(1)t m The frame time is t m , the number of pixels is Img m .
[0086] It should be understood that determining the pixel ratio of each time period based on the frame time and the number of pixels may be performed by calculating the pixel ratio of each time period using a preset pixel ratio formula based on the frame time and the number of pixels, wherein the preset pixel ratio formula is as follows:
[0087]
[0088] In the formula, number n-1 is the pixel ratio of the time period (n, n-1), n represents the frame number, n is any value in [1, m], m is the total number of frames of the video ringtone, t n is the frame time of the nth frame image, Img n The number of pixels in the frame time of the n-th frame image.
[0089] It is understandable that determining the pixel change average reference value according to the pixel ratio may be calculating the pixel change average reference value according to the pixel ratio using a preset average value formula, wherein the preset average value formula is as follows:
[0090]
[0091] Where average_number is the average reference value of pixel change, number n is the pixel ratio of the time period (n+1,n), n represents the frame number, and m is the total number of frames of the video ringtone.
[0092] Step S03: determining the color ring tone category according to the pixel change amplitude.
[0093] It should be understood that classifying video RBTs based on pixel variation amplitude and obtaining the RBT category can be performed by searching a preset category table for the RBT category corresponding to the pixel variation amplitude to obtain the RBT category. The preset category table includes a correspondence between pixel variation amplitudes and RBT categories, and the correspondence between pixel variation amplitudes and RBT categories can be pre-set.
[0094] It should be noted that the ringtone category may be at least one of action, adventure, comedy, drama, fantasy, horror, romance, history, sports, technology, entertainment, and work.
[0095] In the second embodiment, the method of obtaining the number of pixels of each frame image in the video ring back tone is disclosed, and the pixel variation range of the video ring back tone is determined based on the pixel number, and the video ring back tone is classified based on the pixel variation range to obtain the ring back tone category. Since the present embodiment also introduces the frame time and the number of pixels of each frame image in the video ring back tone to calculate the pixel variation range of the video ring back tone, the accuracy of the pixel variation range can be improved, and thus the accuracy of the ring back tone classification can be improved.
[0096] In the second embodiment, before step S10, the method further includes:
[0097] Step S04: Obtain key video content in the video ringback tone.
[0098] It should be understood that in order to ensure the accuracy of ringback tone content recognition, in this embodiment, the key content of the video is first determined, and then the content of the video ringback tone is recognized based on the frame ratio and duration ratio of the key content in the video ringback tone.
[0099] It should be noted that the key content of the video can be the most eye-catching content in the video ringtone. For example, if the video ringtone is a basketball game clip, when a basketball goal is scored, the camera is zoomed in, which is the most eye-catching. The goal scene can be used as the key content of the video.
[0100] It is understandable that the key content of the video can be obtained by analyzing the video ringback tone.
[0101] Step S05: Determine the frame ratio and duration ratio of the key video content in the video ringback tone.
[0102] It should be understood that when performing content recognition, the input data is input in the format of {video ringback tone ID, frame ID, frame dwell time ID}, and the output data is output in the format of {video ringback tone ID, video key content, frame ratio, duration ratio}.
[0103] Step S06: identifying the content of the ring back tone according to the frame ratio and the duration ratio.
[0104] In a specific implementation, after identifying the ringtone content based on the frame ratio and the duration ratio, {video ringtone 1, basketball, 20, 10}, {video ringtone 1, football, 18, 8}, and {video ringtone 1, football, 16, 6} can be output. By comparison, it can be seen that the ringtone content of the video ringtone is mainly basketball.
[0105] In the second embodiment, it is disclosed to obtain the key content of the video in the video ringback tone, determine the frame ratio and duration ratio of the key content of the video in the video ringback tone, and identify the ringback tone content based on the frame ratio and duration ratio; because this embodiment first determines the key content of the video, and then performs content recognition on the video ringback tone based on the frame ratio and duration ratio of the key content of the video in the video ringback tone, it can ensure the accuracy of the ringback tone content recognition.
[0106] In the second embodiment, step S20 includes:
[0107] Step S201: constructing a pairwise comparison matrix based on color preference information.
[0108] It should be understood that comparing all colors together may result in subjective comparison results, which in turn may lead to inaccurate recommended hues. Therefore, to overcome the above drawbacks, this embodiment does not compare all hues together, but instead compares them pairwise. A pairwise comparison matrix is constructed based on the comparison results, and the recommended hue is determined based on the pairwise comparison matrix.
[0109] In a specific implementation, the user's color preference information is represented by different scales and meanings shown in Table 1.
[0110] Table 1 Scale meaning table
[0111] scale meaning 1 Indicates that the two indicators have the same importance 3 Indicates that compared with the two indicators, the former is slightly more important than the latter 5 Indicates that compared with the two indicators, the former is obviously more important 7 Indicates two indicators, the former is more important than the latter 2,4,6,8 Indicates that the two indicators are the middle value of the judgment results
[0112] The pairwise comparison matrix is constructed by the above scale, as shown in Table 2. The horizontal coordinate of the matrix is {a1, a2, a3...ai}, and the vertical coordinate is {a1, a2, a3...a j}, i, j elements represent the calculation index factors that need to be considered, and the element a of the matrix ij It represents the comparison result of the i-th factor relative to the j-th factor. This value is given using the Roman numeral 1-9 scale.
[0113] In Table 2, for example, if the user's preference for purple over blue is 4:1, then the user's preference for blue over purple is 1:4.
[0114] Table 2 Pairwise comparison matrix
[0115] red blue Purple green orange color blue yellow red 1 1 / 2 4 1 / 3 1 / 6 8 1 / 5 blue 2 1 1 / 6 1 / 5 1 / 3 5 1 / 2 Purple 1 / 4 6 1 7 1 / 2 1 / 6 2 green 3 5 1 / 7 1 1 / 2 3 1 / 6 orange color 6 3 2 2 1 4 4 blue 1 / 8 1 / 5 6 1 / 3 1 / 4 1 9 yellow 5 2 1 / 2 6 1 / 4 1 / 9 1
[0116] Step S202: determining a weight value for each color based on the pairwise comparison matrix, and determining a recommended color tone according to the weight value.
[0117] It is understandable that determining the weight value of each color based on the pairwise comparison matrix can be performed by calculating the weight value of each color based on the pairwise comparison matrix using a preset weight value formula, wherein the preset weight value formula can be as follows:
[0118]
[0119] Where Fright(i,j) is the weight value of color i, and j represents the total number of color indicators included in the collection. For example, there are 16 color indicators included in the collection.
[0120] It should be understood that determining the recommended hue according to the weight value may be to sort the colors according to the weight value and determine the recommended hue according to the sorting result.
[0121] In a second embodiment, a pairwise comparison matrix is constructed based on color preference information, a weight value of each color is determined based on the pairwise comparison matrix, and a recommended color tone is determined based on the weight value. Since this embodiment does not compare all tones together, but compares them pairwise, and constructs a pairwise comparison matrix based on the comparison results, and then determines the recommended color tone based on the pairwise comparison matrix, it avoids the possibility of non-objective comparison results and thus improves the accuracy of the recommended color tone.
[0122] Reference Figure 4 , Figure 4 This is a flow chart of a third embodiment of a method for recommending a video ringback tone according to the present invention. Based on the above embodiments, the third embodiment of the method for recommending a video ringback tone according to the present invention is proposed.
[0123] In the third embodiment, step S02 includes:
[0124] Step S021: determining an average pixel change reference value according to the number of pixels.
[0125] It should be understood that due to factors such as the different devices used to capture video ringback rings, the resulting video ringback ring quality may vary. Simply using the average pixel change reference value as the pixel change amplitude of the video ringback ring may result in inaccurate pixel change amplitude. Therefore, to overcome this limitation, in this embodiment, after determining the average pixel change reference value, it is necessary to perform discretization on the average pixel change reference value to obtain the pixel change amplitude of the video ringback ring.
[0126] Step S022: determining the pixel change amplitude through a preset discrete model according to the pixel change average reference value.
[0127] It is understood that the preset discrete model can be as follows:
[0128]
[0129] In the formula, res is the pixel change amplitude, average_number is the average reference value of pixel change, number n is the pixel ratio of the time period (n+1,n), n represents the frame number, and m is the total number of frames of the video ringtone.
[0130] In the third embodiment, it is disclosed that an average pixel change reference value is determined according to the number of pixel points, and a pixel change amplitude is determined according to the average pixel change reference value through a preset discrete model; because this embodiment also performs discrete processing on the average pixel change reference value after determining the average pixel change reference value to obtain the pixel change amplitude of the video ringtone, it is possible to avoid inaccurate pixel change amplitude caused by different quality of the video ringtone, thereby improving the reliability of the pixel change amplitude.
[0131] In the third embodiment, step S05 includes:
[0132] Step S051: obtaining the number of pixels of the key content of the video in each frame image, and counting the total number of pixels of each frame image.
[0133] It should be understood that in order to ensure the accuracy of the frame ratio and duration ratio, in this embodiment, the frame ratio of the key video content in the video ringtone is determined based on the number of pixels of the key video content in each frame image and the total number of pixels of each frame image, and the duration ratio of the key video content in the video ringtone is determined based on the number of frames and the total number of frames.
[0134] It is understandable that by analyzing each frame of image, the number of pixels of the key content of the video in each frame of image can be obtained.
[0135] Step S052: Count the number of frames containing the key content of the video, and determine the total number of frames of the video ringback tone.
[0136] It should be understood that counting the number of frames containing key video content may be counting the number of frames containing key video content based on the number of pixels.
[0137] Step S053: Determine the frame ratio of the key video content in the video ringtone based on the number of pixels, the total number of pixels, the number of frames, and the total number of frames.
[0138] It should be understood that determining the frame ratio of the key video content in the video ringback tone based on the number of pixels, the total number of pixels, the number of frames, and the total number of frames may be calculating the frame ratio of the key video content in the video ringback tone based on the number of pixels, the total number of pixels, the number of frames, and the total number of frames using a preset frame ratio formula, wherein the preset frame ratio formula is as follows:
[0139]
[0140] Where, result is the frame ratio of the key content of the video in the video ringtone, Count k Pixel is the number of pixels of the key content of the video in each frame image. all is the total number of pixels in each frame, x is the number of frames containing key content of the video, and y is the total number of frames.
[0141] Step S054: Determine the duration ratio of the key video content in the video ringback tone according to the number of frames and the total number of frames.
[0142] It is understandable that determining the duration ratio of the key video content in the video ringback tone based on the number of frames and the total number of frames can be comparing the number of frames with the total number of frames to obtain the duration ratio of the key video content in the video ringback tone.
[0143] In the third embodiment, the method of obtaining the number of pixels of the key video content in each frame image, counting the total number of pixels of each frame image, counting the number of frames containing the key video content, and determining the total number of frames of the video ringtone is disclosed. The frame ratio of the key video content in the video ringtone is determined based on the number of pixels, the total number of pixels, the number of frames and the total number of frames, and the duration ratio of the key video content in the video ringtone is determined according to the number of frames and the total number of frames. Since this embodiment also determines the frame ratio of the key video content in the video ringtone according to the number of pixels of the key video content in each frame image and the total number of pixels of each frame image, and determines the duration ratio of the key video content in the video ringtone according to the number of frames and the total number of frames, the accuracy of the frame ratio and the duration ratio can be ensured.
[0144] Reference Figure 5 , Figure 5 This is a flow chart of a fourth embodiment of a method for recommending a video ringback tone according to the present invention. Based on the above embodiments, the fourth embodiment of the method for recommending a video ringback tone according to the present invention is proposed.
[0145] In the fourth embodiment, after step S40, the method further includes:
[0146] Step S50: When the recommended video ringback tone is triggered, the recommended video ringback tone is recommended to non-triggered users.
[0147] It should be understood that in actual applications, there are scenarios where the calling user wants to recommend a video ringback tone to the called user. At this time, in order to achieve the recommendation of the video ringback tone, in this embodiment, after the calling user triggers the recommended video ringback tone, the recommended video ringback tone is recommended to the called user. If the called user receives confirmation information based on the recommended video ringback tone, the recommended video ringback tone is set as the video ringback tone of the called user.
[0148] In a specific implementation, the user who triggers the recommended video ringback tone may be a calling user, and the non-triggering user may be a called user corresponding to the calling user.
[0149] Step S60: If confirmation information based on the recommended video ringback tone is received from the non-triggered user, the recommended video ringback tone is set as the non-triggered video ringback tone.
[0150] For easier understanding, refer to Figure 6 This is for illustration only, but does not limit this solution. Figure 6 Schematic diagram of recommending ringback tone from the calling user to the called user. In the figure, video ringback tone recommendation includes the following steps: 1. Displaying the recommended ringback tone information to caller A. This step will determine the ID of the recommended ringback tone and the information of the recommended ringback tone (such as scene information, etc.), and display the recommended ringback tone information to caller A; 2. After the user selects one of the recommended ringback tones, the recommendation is confirmed through a pop-up window, and the ID and scene information of the selected ringback tone are sent to the ringback tone server; 3. The ringback tone server analyzes the scene and resource information and uses SSE technology to push the information to the called party B. SSE is a one-way channel that can only send information to the server and the terminal. The reason for not using WebSocket is that maintaining a real-time dual-channel connection has a very high performance overhead. Using a one-way channel to ensure performance can also achieve the specified effect. 4. Callee B receives the ringback tone resource ID recommended by caller A. The reason for transmitting through the resource ID is to ensure network overhead and security. After callee B receives the resource ID, a "Preview" button is displayed. If callee B does not click "Preview", the ringback tone server will not be requested for the specific ringback tone resource, thus reducing one network request. 5. Callee B clicks "Preview", which recommends the ringback tone server to pull the specific video ringback tone resource. After the pull is completed, the video ringback tone is played on the page. 6. Callee B can play the video ringback tone silently by answering the phone, or play it without answering the phone. If satisfied, he can click "Set" to set the resource ID and personal information to the ringback tone server. The ringback tone platform will set the ringback tone and notify the result via SMS.
[0151] The fourth embodiment recommends the recommended video ringback tone to the non-triggered user when the recommended video ringback tone is triggered. If confirmation information based on the recommended video ringback tone is received from the non-triggered user, the recommended video ringback tone is set as the non-triggered video ringback tone, thereby meeting the calling user's need to recommend a ringback tone to the called user and improving the user experience.
[0152] In addition, an embodiment of the present invention further provides a storage medium, on which a video ringback tone recommendation program is stored. When the video ringback tone recommendation program is executed by a processor, the video ringback tone recommendation method described above is implemented.
[0153] In addition, refer to Figure 7The embodiment of the present invention further provides a video ringback tone recommendation device, which includes: a category recommendation module 10, a tone recommendation module 20, a content recommendation module 30 and a ringback tone recommendation module 40;
[0154] The category recommendation module 10 is used to select a recommended category from the CRBT categories, where the CRBT categories are differentiated based on the pixel variation amplitude of the video CRBT.
[0155] It should be noted that the ringtone category may be at least one of action, adventure, comedy, drama, fantasy, horror, romance, history, sports, technology, entertainment, and work.
[0156] It is understandable that selecting a recommended category from the ringback tone category may be to obtain a user portrait, match the user portrait with the ringback tone category, and determine the recommended category based on the matching result.
[0157] It should be understood that determining the recommended category according to the matching result may be taking the category of the successfully matched ringback tone as the recommended category.
[0158] It should be noted that the pixel change amplitude may be the pixel change difference rhythm between frames of the video ringback tone, and the pixel change difference rhythm may be used to classify the video ringback tone content. For example, the pixel change difference rhythm of the action category and the entertainment category is completely different.
[0159] It is understood that distinguishing the CRBT category based on the pixel change amplitude of the video CRBT can be performed by searching a preset category table for the CRBT category corresponding to the pixel change amplitude to obtain the CRBT category. The preset category table includes a correspondence between the pixel change amplitude and the CRBT category, and the correspondence between the pixel change amplitude and the CRBT category can be pre-set.
[0160] The color tone recommendation module 20 is configured to determine a recommended color tone according to the color preference information.
[0161] It should be understood that different users prefer different video tones. For example, in historical video ringback rings, most video ringback rings are gray, but some users particularly dislike gray. Therefore, when recommending video ringback rings, the recommended tones can also be determined based on color preference information.
[0162] It should be noted that the color preference information is used to indicate the user's preference for each color. The higher the preference, the more the user likes the color.
[0163] It is understandable that determining the recommended hue according to the color preference information may be to sort the hues according to the color preference information and determine the recommended hue according to the sorting result.
[0164] The content recommendation module 30 is configured to select recommended content based on the CRBT content, wherein the CRBT content is based on the video key content recognition of the video CRBT.
[0165] It should be noted that the ringback tone content may be the content that has been identified in the video ringback tone.
[0166] It should be understood that selecting recommended content from the CRBT content may be to match the CRBT content with the user's preferred CRBT content, and using the successfully matched CRBT content as the recommended content.
[0167] It should be noted that the key content of the video can be the most eye-catching content in the video ringtone. For example, if the video ringtone is a basketball game clip, when a basketball goal is scored, the camera is zoomed in, which is the most eye-catching. The goal scene can be used as the key content of the video.
[0168] It is understandable that the key content of the video can be obtained by analyzing the video ringback tone.
[0169] It should be understood that the video key content based on video ringback tone identification can be to use the video key content with the largest duration as the ringback tone content. For example, the video ringback tone is a basketball game clip, and the video key picture can be a goal picture and a running picture. Among them, the goal picture accounts for 3S in duration and the running picture accounts for 1S in duration, then the goal picture will be used as the ringback tone content.
[0170] The CRBT recommendation module 40 is configured to recommend video CRBTs based on the recommendation category, the recommended tone, and the recommended content.
[0171] It should be understood that recommending video ringtones based on recommended categories, recommended tones, and recommended content can be by first screening out video ringtones of recommended categories, then selecting video ringtones of recommended tones from the recommended categories, then selecting video ringtones of recommended content from the recommended tones, and then recommending the video ringtones to the user.
[0172] Alternatively, the video ringback rings in the ringback ring library may be filtered simultaneously from three dimensions: recommended category, recommended tone, and recommended content, and the filtered video ringback rings may be recommended to the user. This embodiment does not impose any limitation on this.
[0173] In this embodiment, a recommended category is selected from ringback tone categories, the ringback tone categories are distinguished based on the pixel change amplitude of the video ringback tone, the recommended color tone is determined based on color preference information, recommended content is selected from the ringback tone content, the ringback tone content is based on the video key content identification of the video ringback tone, and the video ringback tone is recommended based on the recommended category, recommended color tone and recommended content. Since the video ringback tone can be automatically classified and the content identified in this embodiment, no manual processing is required, thereby improving the efficiency of video ringback tone recommendation. Moreover, since the present embodiment recommends video ringback tone to users from multiple dimensions, the accuracy of video ringback tone recommendation can be improved.
[0174] Other embodiments or specific implementations of the video ringback tone recommendation device of the present invention can refer to the above-mentioned method embodiments and will not be described in detail here.
[0175] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or system comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or system. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or system comprising the element.
[0176] The serial numbers of the above embodiments of the present invention are for description only and do not represent the advantages or disadvantages of the embodiments.
[0177] Through the description of the above embodiments, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, or of course by hardware, but in many cases the former is a better embodiment. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as a read-only memory image (ROM) / random access memory (RAM), a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal device (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present invention.
[0178] The above are only preferred embodiments of the present invention and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention description and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.
Claims
1. A video ringback tone recommendation method, It is characterized in that The video ringback tone recommendation method comprises the following steps: Selecting a recommended category from the color ring back tone categories, wherein the color ring back tone categories are distinguished based on the pixel change amplitude of the video color ring back tone; Determining recommended hues based on color preference information; Selecting recommended content based on the content of the ringback tone, wherein the ringback tone content is based on the video key content identification of the video ringback tone; Recommending a video ringback tone based on the recommended category, the recommended tone, and the recommended content; The step of determining the recommended color tone according to the color preference information includes: Constructing a pairwise comparison matrix according to the color preference information, wherein the pairwise comparison matrix is constructed based on the pairwise comparison results between the hues; A weight value of each color is determined based on the pairwise comparison matrix, and a recommended color tone is determined according to the weight value.
2. The video ringback tone recommendation method according to claim 1, It is characterized in that Before the step of selecting a recommended category from the color ringback tone category, the method further includes: Get the number of pixels of each frame in the video ringback tone; Determine the pixel change amplitude according to the pixel number; The color ring tone category is determined according to the pixel change amplitude.
3. The video ringback tone recommendation method according to claim 2, It is characterized in that The step of determining the pixel change amplitude according to the pixel number comprises: Determine an average pixel change reference value according to the pixel count; The pixel change amplitude is determined by a preset discrete model according to the pixel change average reference value.
4. The video ringback tone recommendation method according to claim 1, It is characterized in that Before the step of selecting recommended content according to the color ring back tone content, the method further includes: Get the key content of the video in the video ringback tone; Determine the frame ratio and duration ratio of the key video content in the video ringback tone; The color ring back tone content is identified according to the frame ratio and the duration ratio.
5. The video ringback tone recommendation method according to claim 4, It is characterized in that The step of determining the frame ratio and duration ratio of the key video content in the video ringback tone includes: Obtaining the number of pixels of the key content of the video in each frame image, and counting the total number of pixels of each frame image; Counting the number of frames containing the key content of the video, and determining the total number of frames of the video ringback tone; Determine the frame ratio of the key video content in the video ringback tone based on the number of pixels, the total number of pixels, the number of frames, and the total number of frames; The duration ratio of the key content of the video in the video ringback tone is determined according to the number of frames and the total number of frames.
6. The video ringback tone recommendation method according to any one of claims 1 to 5, It is characterized in that After the step of recommending video ringback tone based on the recommendation category, the recommended tone and the recommended content, the method further includes: When the recommended video ringback tone is triggered, recommending the recommended video ringback tone to non-triggered users; If confirmation information based on the recommended video ringback tone is received from the non-triggered user, the recommended video ringback tone is set as the non-triggered video ringback tone.
7. A video ringback tone recommendation device, It is characterized in that The video ringback tone recommendation device comprises: a memory, a processor, and a video ringback tone recommendation program stored in the memory and executable on the processor. When the video ringback tone recommendation program is executed by the processor, the video ringback tone recommendation method according to any one of claims 1 to 6 is implemented.
8. A storage medium, It is characterized in that The storage medium stores a video ring back tone recommendation program, and when the video ring back tone recommendation program is executed by the processor, the video ring back tone recommendation method according to any one of claims 1 to 6 is implemented.
9. A video ringback tone recommendation device, It is characterized in that The video ringback tone recommendation device comprises: a category recommendation module, a tone recommendation module, a content recommendation module and a ringback tone recommendation module; The category recommendation module is used to select a recommended category from the color ringback tone categories, and the color ringback tone categories are distinguished based on the pixel change amplitude of the video color ringback tone; The color tone recommendation module is used to determine the recommended color tone according to the color preference information; The content recommendation module is used to select recommended content according to the color ring back tone content, and the color ring back tone content is based on the video key content recognition of the video color ring back tone; The color ring back tone recommendation module is used to recommend a video color ring back tone based on the recommendation category, the recommended tone and the recommended content; Among them, the hue recommendation module is also used to construct a pairwise comparison matrix according to the color preference information, wherein the pairwise comparison matrix is constructed based on the pairwise comparison results between the hues; determine the weight value of each color based on the pairwise comparison matrix, and determine the recommended hue according to the weight value.
Citation Information
Patent Citations
Information recommendation method and device, and electronic equipment
CN108052650A
Video recommendation method and device and terminal equipment
CN110418200A
Video classification method and device, storage medium and electronic equipment
CN113762034A
