Color printing information generation method, device, equipment and computer program product

Abstract

The present invention discloses a color printing information generation method, device, equipment and computer program product, and relates to the field of communication technology. The color printing information generation method comprises the following steps: obtaining the video ringback tone information of the user; and generating the color printing information of the user based on the video ringback tone information. The color printing information generation method provided by the present invention eliminates the step of editing or customizing the color printing information when the user orders the color printing service, thereby eliminating the limiting factors of editing the color printing information, so as to facilitate the promotion of the color printing service.

Description

Technical Field

[0001] The present invention relates to the field of communication technology, and in particular to a method, device, equipment and computer program product for generating color printing information. Background Art

[0002] The color printing service is that when the calling terminal dials the called terminal, before the call is connected, during the call, and after hanging up, the system automatically pushes the color printing information pre-set by the called party, such as mood, jokes, customer care, anti-harassment / false / fraud calls, etc., to the calling terminal in the form of USSD (Unstructured Supplementary Service Data) or flash message, so that the calling terminal or the called terminal can display personalized mobile color printing information to achieve the purpose of showing personality, information transmission, and anti-fraud.

[0003] However, when users order color printing services, there are many restrictions on the editing of color printing information.

[0004] The above contents are only used to assist in understanding the technical solution of the present invention and do not constitute an admission that the above contents are prior art. Summary of the invention

[0005] The main purpose of the present invention is to provide a method, device, equipment and computer program product for generating color printing information, aiming to solve the technical problem that there are many limiting factors in color printing information editing when users order color printing services.

[0006] To achieve the above object, in a first aspect, the present invention provides a method for generating color printing information, comprising:

[0007] Get the user's video ringback tone information;

[0008] Based on the video ringback tone information, color printing information of the user is generated.

[0009] In one embodiment, generating the color printing information of the user based on the video ringback tone information includes:

[0010] The video ring back tone information is input into a pre-trained color printing information generation network to obtain the color printing information output by the color printing information generation network.

[0011] In one embodiment, before inputting the video ring back tone information into a pre-trained color printing information generation network to obtain the color printing information output by the color printing information generation network, the method further includes:

[0012] Obtaining a training sample set and a pre-built adversarial generative network; wherein each group of training samples in the training sample set includes a video ringback tone sample and a color printing information sample of the same user sample; the adversarial generative network includes a generative network and a discriminative network;

[0013] Input the video ring back tone sample into the generation network to obtain a color printing generation sample corresponding to the video ring back tone sample;

[0014] Using the discriminant network, the authenticity of the color printing information sample and the color printing generation sample in each group of training samples is discriminated to obtain corresponding discrimination results;

[0015] Based on the discrimination results and the color printing generation samples corresponding to each group of training samples, adversarial training is performed on the adversarial generation network, and the trained generation network is determined as a color printing information generation network.

[0016] In one embodiment, the color printing information generation network includes an image feature extractor and a decoder;

[0017] The step of inputting the video ringback tone information into a pre-trained color printing information generation network to obtain the color printing information output by the color printing information generation network comprises:

[0018] Inputting the video ring back tone information into the image feature extractor to obtain an image feature vector output by the image feature extractor;

[0019] The image feature vector is input into the decoder to obtain the color printing information output by the decoder.

[0020] In one embodiment, the color printing information generation network further includes a noise feature extractor;

[0021] Before inputting the image feature vector into the decoder to obtain the color printing information output by the decoder, the method further includes:

[0022] Inputting the random noise corresponding to the video ring back tone information into the noise feature extractor to obtain a noise feature vector output by the noise feature extractor;

[0023] The step of inputting the image feature vector into the decoder to obtain color printing information output by the decoder includes:

[0024] The image feature vector and the noise feature vector are input into the decoder to obtain color printing information output by the decoder.

[0025] In one embodiment, generating the color printing information of the user based on the video ringback tone information includes:

[0026] Extracting a preset number of video frame images from the video ringback tone information;

[0027] Based on the preset number of video frame images, the color printing information of the user is generated.

[0028] In one embodiment, after generating the color printing information of the user based on the video ring back tone information, the method further includes:

[0029] Sending the color printing information to the user's terminal device and receiving the user's selection operation;

[0030] If the selection operation is a determination operation, the color printing information is determined as the customized color printing information of the user.

[0031] In a second aspect, the present invention further provides a color printing information generating device, comprising:

[0032] The ring back tone acquisition module is used to obtain the user's video ring back tone information;

[0033] A color printing generation module is used to generate the color printing information of the user based on the video ringback tone information.

[0034] In a third aspect, the present invention further provides a color printing information generating device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the above method.

[0035] In a fourth aspect, the present invention further provides a computer program product, comprising an executable program code, wherein the program code performs the method as described above when executed by a processor.

[0036] A color printing information generation method proposed in an embodiment of the present invention generates color printing information belonging to the user through video ringback tone information customized by the user, eliminating the step of editing or customizing the color printing information when the user orders the color printing service, thereby eliminating the limiting factors for editing the color printing information and facilitating the promotion of the color printing service. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] Figure 1 It is a flowchart of the first embodiment of the method for generating color printing information of the present invention;

[0038] Figure 2 It is a flow chart of the second embodiment of the method for generating color printing information of the present invention;

[0039] Figure 3 A schematic diagram of the composition of a color printing information generation network according to an embodiment of a color printing information generation method of the present invention;

[0040] Figure 4It is a flowchart of a third embodiment of the method for generating color printing information of the present invention;

[0041] Figure 5 A schematic diagram of the composition of a discrimination network of an embodiment of a method for generating color printing information of the present invention;

[0042] Figure 6 It is a flowchart of a fourth embodiment of the method for generating color printing information of the present invention;

[0043] Figure 7 It is a flowchart of a fifth embodiment of the method for generating color printing information of the present invention;

[0044] Figure 8 It is a schematic diagram of the functional modules of the color printing information generating device of the present invention;

[0045] Fig. 9 The figure is a schematic diagram of the structure of an electronic device recommended for the color printing information generating method of the present invention.

[0046] The realization of the purpose, functional features and advantages of the present invention will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0047] It should be understood that the specific embodiments described herein are only used to explain the present invention, and are not used to limit the present invention.

[0048] In the related art, the color printing service is a value-added service that the communication service provider transmits additional information during the user's call. During the call between the calling and called users, the system automatically pushes the color printing information pre-set by the user, such as mood, jokes, customer care, anti-harassment / false / fraud calls, etc., to the terminal of the other party who is talking to the user, so that the user of the other terminal can see the color printing information after the call ends, so as to achieve the purpose of showing personality, sharing mood, and delivering business information. If the user of the calling terminal subscribes to the color printing service, when the calling terminal dials the called terminal, before the call is connected, during the call, or after hanging up, the system automatically pushes the color printing information pre-set by the called party, such as mood, jokes, customer care, anti-harassment / false / fraud calls, etc., to the called terminal in the form of USSD or flash message, so that the called terminal can display personalized mobile color printing information. Similarly, if the user of the called terminal subscribes to the color printing service, when the calling terminal calls the called terminal, before the call is connected, during the call or after hanging up, the system automatically pushes the color printing information pre-set by the called terminal to the calling terminal, so that the calling terminal can display the personalized mobile color printing information.

[0049] However, when users customize and edit their own personalized color printing information, there are many limiting factors, such as time factors. Some users think that editing is a waste of time, or they are limited by their personality factors. For example, some users have difficulty in choosing and find it difficult to edit the color printing information they want. Therefore, the editing of color printing information limits the promotion of color printing business.

[0050] To this end, an embodiment of the present invention provides a color printing information generation method, which generates color printing information belonging to the user through video ringback tone information customized by the user, eliminates the step of user editing or customizing color printing information, and is conducive to the promotion of color printing services.

[0051] The inventive concept of the present application is further described below in conjunction with some specific embodiments.

[0052] The embodiment of the present invention provides a first embodiment of a method for generating color printing information. Figure 1 , Figure 1 It is a flowchart of the first embodiment of the method for generating color printing information of the present invention.

[0053] In this embodiment, the method includes the following steps:

[0054] Step S101: Obtain the user's video ringback tone information.

[0055] Video ringback tone is a short video content service provided by communication service providers. After a user subscribes to the video ringback tone service, when other users use a calling terminal that supports the video ringback tone function to initiate an audio or video call to the called terminal of the user that has the video ringback tone function in the VoLTE (Voice over Long-Term Evolution) network, the system plays the video ringback tone information customized by the user to the calling terminal to improve the call waiting experience of other users.

[0056] The video ring back tone information can be a video customized or edited by the user according to his / her own preferences or needs, that is, the original video file selected from the system platform of the communication service provider or uploaded to the system platform when the called user customizes the video ring back tone service. The video ring back tone information includes multiple frames of images and audio data matching the multiple frames of images.

[0057] In an embodiment of the present invention, after a user logs into the cloud of a communication service provider through a terminal device such as a mobile phone, tablet or computer and enters the color printing ordering service interface, the cloud can be triggered to automatically call the video ringback tone information ordered by the user stored in the background database based on the corresponding instructions entered by the user in the color printing ordering service interface.

[0058] For example, a virtual button "Automatically Generate Color Print" may be displayed on the color print ordering service interface. The user may enter a get command by clicking the virtual button "Automatically Generate Color Print", and the terminal device may send the get command to the cloud. In response to the received get command, the cloud automatically calls the video ringback tone data ordered by the user stored in the background database.

[0059] It is understandable that when a user orders a color printing service, a "Confirm Order" virtual button can be set on the color printing ordering service interface, and the user can input a get command by clicking the "Confirm Order" virtual button on the terminal device, and the terminal device sends the get command to the cloud. Thus, after the user confirms to order the color printing service, the video ringback tone data ordered by the user stored in the background database is automatically called.

[0060] Step S102: Generate user's color printing information based on the video ringback tone information.

[0061] After the cloud platform obtains the video ringback tone data ordered by the user, the cloud platform can generate the user's color printing information based on the video ringback tone information. After the color printing information customizes the color printing service for the user, when the called terminal is dialed by the calling terminal of other users, before the call is connected, during the call or after hanging up, the mood information, joke information, customer care information, anti-harassment / false / fraud call prompt information and other text information or graphic information are pushed to the calling terminal in the form of USSD or flash message.

[0062] In this step, since the video ringback tone information customized by each user can reflect the user's personal preferences or needs to a certain extent, the color printing service also promotes personalized information for users to other users to achieve the purpose of displaying personality, information transmission, fraud prevention, etc. Therefore, in this embodiment, based on the personalized video ringback tone information customized by the user himself, the color printing information belonging to the user can be generated. The color printing information has the style of the user's video ringback tone information, so that the user's personal preferences or needs can be reflected, and the user does not need to edit it himself, which can save the user's time in editing the color printing information, or reduce the difficulty of the user in editing the color printing information, thereby reducing the limiting factors when editing the color printing information as much as possible, so as to promote the color printing service.

[0063] In this embodiment, step S102 can generate color printed information in text or graphic form based on image information such as video frames of video ringback tone information, and can also generate color printed information in text or graphic form based on playback text information of video ringback tone information. It can also obtain color printed information in text or graphic form based on the inherent rules of existing color printed information. This embodiment does not impose any restrictions on this.

[0064] Based on the first embodiment of the color printing information generation method of the present invention, a second embodiment of the color printing information generation method of the present invention is proposed. Figure 2 , Figure 2 It is a schematic diagram of the process of the color printing information generating method of the present invention.

[0065] In this embodiment, the method includes the following steps:

[0066] Step S201: Obtain the user's video ringback tone information.

[0067] Step S201 may refer to step S101 and will not be described in detail here.

[0068] Step S202: input the video ringback tone information into a pre-trained color printing information generation network to obtain color printing information output by the color printing information generation network.

[0069] The color printing information generation network automatically outputs the color printing information according to the input video ring back tone information.

[0070] Since the input video ringback tone information has the user's personal style, the output color printing information reflects the user's personal preferences or needs. The color printing information generation network does not require the user to edit it, which can save the user's time in editing the color printing information, or reduce the difficulty of editing the color printing information for the user, thereby reducing the limiting factors when editing the color printing information as much as possible, which is conducive to the promotion of the color printing business.

[0071] See also Figure 3 ,In this embodiment, the color printing information generation network includes an ,image feature extractor and a decoder.

[0072] At this time, step S202 includes:

[0073] Step A10: input the video ringback tone information into the image feature extractor to obtain the image feature vector output by the image feature extractor.

[0074] In this embodiment, the image feature extractor includes a deep convolutional neural network inceptionV3 model and two fully connected layers. The image size input to the image feature extractor is a normalized result image of 299×299 size. The image is preprocessed using a pre-trained deep convolutional neural network inceptionV3 model to extract the feature representation of the image, encode the image into a vector of fixed length, and use the last convolutional layer of the inceptionV3 model as the output, outputting a vector of shape (8, 8, 2048), and compressing it into a vector of (64, 2048). Subsequently, the (64, 2048) vector is input into the two CNN fully connected layers in the image feature extractor. The activation function of the CNN fully connected layer is set to the ReLU function, and the output of the last CNN fully connected layer is an image feature vector of (None, 64, 512).

[0075] Step A20: input the image feature vector into the decoder to obtain color printing information output by the decoder.

[0076] In this embodiment, the decoder is an LSTM (Long Short-Term Memory) decoder. The decoder includes at least two LSTM layers and a fully connected layer. Each LSTM layer contains 512 LSTM neurons, and the activation function is set to the ReLU function. The image feature vector (None, 64, 512) is input to the LSTM layer, and the LSTM layer outputs a vector with a shape of (None, 64, 512). The vector (None, 64, 512) is input to the fully connected layer. The number of fully connected neurons in the fully connected layer is flashSMS_vocab_size, and the activation function is set to the softmax function. The shape of the output data of this layer is (None, flashSMS_vocab_size), thereby converting the output shape of the vector (None, 64, 512) into the dimension of the final output, that is, the color printing information. Among them, the color printing information can be text information.

[0077] Therefore, in this embodiment, the video ringback tone information is input into the trained generation network to generate color printing information in text form. Thus, based on the personalized video ringback tone subscribed by the user, the personalized color printing information belonging to the user is generated, so that the generated color printing information is more consistent with the user's actual selection, thereby saving the user's time in editing text and reducing the difficulty of promoting the color printing service.

[0078] Furthermore, in this embodiment, the color printing information generation network also includes a noise feature extractor. The noise feature extractor extracts a noise feature vector from the noise through LSTM (Long Short-Term Memory) neurons.

[0079] At this time, before step A20, the following steps are also included:

[0080] The random noise corresponding to the video ring back tone information is input into the noise feature extractor to obtain a noise feature vector output by the noise feature extractor.

[0081] The random noise can be noise data randomly selected from the noise of the normal distribution, making the color printing information generation network more robust. At this time, when the color printing information generation network is obtained through the adversarial generation network GAN, a condition is added on the basis of the adversarial generation network GAN: random noise. Thus, the adversarial generation network GAN becomes a conditional generation adversarial network. The use of this additional conditional variable: random noise has a guiding role in the generation of the generator data of the adversarial generation network GAN.

[0082] Step A20 adapts to become:

[0083] The image feature vector and the noise feature vector are input into the decoder to obtain the color printing information output by the decoder.

[0084] In this embodiment, the decoder is guided and supervised to generate color printing information through noise characteristics, so that the color printing information generated by the color printing information generation network is more consistent with the actual selection of the user.

[0085] Based on the second embodiment of the color printing information generation method of the present invention, a third embodiment of the color printing information generation method of the present invention is proposed. Figure 4 , Figure 4 It is a flowchart diagram of the third embodiment of the method for generating color printing information of the present invention.

[0086] In this embodiment, the color printing information generation network can be trained in the following manner, that is, before step S101 or step S201, the method further includes:

[0087] Step S301, obtaining a training sample set and a pre-constructed generative adversarial network; wherein each group of training samples in the training sample set includes a video ringback tone sample and a color printing information sample of the same user sample; and the generative adversarial network includes a generative network and a discriminative network.

[0088] In this step, a sample set can be collected from the existing video ringback tone data and color printing data of the communication service provider. Each group of training samples in the sample set includes a video ringback tone sample and a color printing information sample of the same user sample. Among them, a color printing information sample of a ringback tone style that actually matches the video ringback tone sample ordered by the user can be added with an identifier, and the identifier is marked as 1.

[0089] A preset number of video frame images can be extracted from the video ring back tone sample, and the preset number of video frame images are normalized to obtain a normalized result image of 299×299 size. The specific steps can refer to step S202 and step S203 of the above embodiment, which will not be repeated here.

[0090] In addition, the color printing information samples need to be cleaned and the text serialized. Specifically, the letter case in the color printing information samples is unified, such as converting uppercase letters to lowercase letters. Each word in the color printing information sample can also be converted into an integer sequence. At the same time, the length M of the longest sample among all the color printing information samples is taken as the encoding sequence length of the color printing information sample. And the length of each color printing information sample is padded to M.

[0091] In this way, the color printing information sample X can be expressed as in,

[0092] Among them, the sample set collected from the existing video ringback tone data and color printing data of the communication service provider can be divided into a training sample set and a test set. For example, 90% of the sample set is divided into a training set and 10% is divided into a test set. The training sample set is used to train the color printing information generation network, and the test set is used to test the color printing information generation network.

[0093] Step S302: Input the video ring back tone sample into the generation network to obtain the color printing generation sample corresponding to the video ring back tone sample.

[0094] The color printing generation samples matching the video ring back tone information generated by the generator are collected. The color printing generation samples may be added with an identifier, and the identifier is marked as 0.

[0095] The color printing generated sample can still be processed by text serialization. The specific processing steps can refer to the text serialization processing steps of the color printing information sample, which will not be repeated here.

[0096] Step S303: using a discriminant network, the authenticity of the color printing information samples and the color printing generation samples in each group of training samples is discriminated to obtain corresponding discrimination results.

[0097] In this embodiment, the color printing generation sample matching the video ring back tone sample output by the generation network is connected with the input video ring back tone sample and input into the discrimination network together. Figure 5 In this embodiment, the discriminant network may be composed of a first branch network, a second branch network and a fully connected neural network.

[0098] The first layer of the first branch network is the word embedding layer. The input of the word embedding layer is set to the color printing generation sample, and the output is set to a fixed-shape 128-dimensional vector.

[0099] The second and third layers of the first branch network are two hidden layers, each of which has 64 LSTM neurons, and the activation function of each layer is set to the Relu function.

[0100] The second branch network includes an image feature extractor and two fully connected layers. First, the normalized result image of the video ringtone sample with a size of 299×299 is input into the image feature extractor, which can be a pre-trained deep convolutional neural network inceptionV3 model. The deep convolutional neural network inceptionV3 model preprocesses the normalized result image, extracts the feature representation of the image, encodes the image into a vector of fixed length, and uses the last convolution layer of the inceptionV3 model as the output, outputting a vector with a shape of (8, 8, 2048), and compressing it into a vector of (64, 2048). Then the vector of (64, 2048) is input into two CNN fully connected layers, and the output vector is a vector with a shape of (None, 64, 512).

[0101] The fully connected neural network includes a merging layer and two fully connected layers, of which the last fully connected layer is the output layer.

[0102] The output results of the first branch network and the second branch network: the 128-dimensional vector and the (None, 64, 512) vector are merged and concatenated to form a new vector.

[0103] The first fully connected layer contains 16 neurons, and the activation function is set to the ReLU function.

[0104] The sixth output layer contains 1 Dense neuron, and the activation function can be set to the sigmoid function. The discrimination result of the output layer is 1 or 0, where true is 1 and false is 0.

[0105] Step S304: Based on the discrimination results and color printing generation samples corresponding to each group of training samples, adversarial training is performed on the adversarial generation network, and the trained generation network is determined as the color printing information generation network.

[0106] In this step, the discriminant network learns to give a higher score to the video ringback tone ordered by the user and the corresponding color print generation sample of the real matching video ringback tone style, and gives a lower score to the video ringback tone ordered by the user and the corresponding generated color print generation sample of the matching video ringback tone style, thereby updating the parameters of the discriminant network. It can be understood that the goal of the generative network learning is to make the generated color print generation sample of the matching video ringback tone as close as possible to the real color print information sample of the matching video ringback tone style, thereby maximizing the score output by the discriminant network (true is 1, false is 0). The output score can be regarded as a reward to update the model parameters of the generative network.

[0107] For example, first initialize the model parameters of the generator network and the discriminator network. In each training cycle, first fix the parameters of the generator and train the discriminator. Then fix the parameters of the discriminator and train the generator until the discriminator cannot distinguish whether the color-printed text corresponding to the video ringback tone ordered by the called party is real or generated by the generator. After convergence, export the model weights, and the trained generator can generate color-printed text content corresponding to the style of the called party's video ringback tone in real time.

[0108] In this embodiment, the number of training rounds can be set to 1000, the batch size can be set to 100 (batch_size = 100), the categorical crossentropy multi-class cross entropy function is selected as the loss function, that is, the objective function, and the gradient descent optimization algorithm, such as the adam optimizer, is used to improve the learning speed of the traditional gradient descent (optimizer = 'adam'). The adversarial generative network can find the optimal weight value that minimizes the objective function through gradient descent, and the adversarial generative network will autonomously learn the weight value through training.

[0109] In this step, the output result of the discriminant network is sent to the objective function to obtain the corresponding weight value.

[0110] Among them, the objective function can be expressed as:

[0111]

[0112] Among them, L is the objective function, N is the total number of training samples in the sample set, θ is the model parameter of the generated network, and c i is the i-th video ringback tone, x i c i The corresponding i-th color printing sample, D(c i ,x i ) is the output value of the discriminant network. When D(c i ,x i ) is 1, the model parameters are updated to increase P θ (x i |c i ), when D(c i ,x i ) is 0, the model parameters are updated to reduce P θ (x i |c i ), P θ (x i |c i ) is used to generate the network based on c i The corresponding generated x i The probability that the discriminant network is correct.

[0113] The model of the generation network is updated during the training process, and after the training is completed, the trained generation network is determined as the color printing information generation network.

[0114] In this embodiment, the color printing information generation network trained through the above steps can generate color printing information matching the style according to the input video ringback tone information, thereby accurately recommending appropriate color printing content to users, improving users' experience of color printing services and the color printing subscription rate, and facilitating the promotion of color printing services.

[0115] Based on the first to third embodiments of the color printing information generation method of the present invention, a fourth embodiment of the color printing information generation method of the present invention is proposed. Figure 6 , Figure 6 It is a schematic diagram of the process of the color printing information generating method of the present invention.

[0116] In this embodiment, the method includes the following steps:

[0117] Step S401: Obtain the user's video ringback tone information.

[0118] Step S402: extract a preset number of video frame images from the video ringback tone information.

[0119] The video ring back tone information is a video, including multiple video frame images. Extracting a preset number of video frame images from all the video frame images of the video ring back tone information can be a random extraction to reduce the amount of calculation and increase the calculation speed of the generation network. It can also be extracted based on preset rules, such as extracting video frame images with displayed subtitles, or extracting video frame images with specific elements, such as a virtual character, a special effect, etc. Extracting a preset number of video frame images based on preset rules can make the generated color printing information more compatible with the video ring back tone information of the user. This embodiment does not limit the specific rules for extracting video frame images.

[0120] Step S403: Generate the color printing information of the user based on a preset number of video frame images.

[0121] Specifically, in this step, all video frame images can be normalized to obtain normalized result images.

[0122] A corresponding number of frames are extracted from the video ringback tone ordered by the user, and the image shape of each video frame is converted to 299 × 299. At the same time, in order to ensure that the data is in the same range, the data needs to be standardized, and each pixel of each video frame image is proportionally compressed to the range of 0 to 1, and then the pixel value of each frame image is subtracted from the pixel value of the global mean image to achieve normalization.

[0123] The pixel value of the global mean image is obtained by calculating the mean of the pixel values ​​of each position of each frame image sample in the training sample set during the training process of the color printing information generation network. The image pixel values ​​of all processed video frame images will be normalized to image data with a mean of 0 and a variance of 1. At this time, the video frame image of the video ringtone can be expressed as: C = {c1, c2, ..., cN}, where cN is the feature vector at the spatial position N.

[0124] Then, based on the normalized result image, the user's color printing information is generated.

[0125] Specifically, the video ringback tone information, that is, the normalized result image, is input into a pre-trained color printing information generation network to obtain the color printing information output by the color printing information generation network.

[0126] Based on the first to fourth embodiments of the color printing information generation method of the present invention, a fifth embodiment of the color printing information generation method of the present invention is proposed. Figure 7 , Figure 7The figure is a flow chart of the color printing information generation method of the present invention. The color printing information generation method is applied to the cloud platform of a communication service provider.

[0127] In this embodiment, the method includes the following steps:

[0128] Step S501: The cloud platform obtains the user's video ringback tone information.

[0129] Step S502: The cloud platform generates color printing information for the user based on the video ringback tone information.

[0130] Step S503: The cloud platform sends the color printing information to the user's terminal device and receives the user's selection operation.

[0131] The user's terminal device may be the terminal device used by the user to log in to the cloud platform of the communication service provider. After receiving the color printing information sent by the cloud platform, the terminal device displays the color printing information on the display interface of the terminal device. It is understandable that the terminal device may be a tablet, computer or other terminal device used by the user to log in to the system cloud platform of the communication service provider. In addition, when the user logs in to the system cloud platform of the communication service provider through a tablet, computer or other device, the cloud platform may also send the generated color printing information to the user's personal mobile terminal, such as a smart phone, through SMS notification or other forms.

[0132] The terminal device may have a display screen. When a user logs in to the system platform of a communication service provider through a terminal device and orders a color printing service, the user may select a corresponding automatic generation operation to generate color printing information. After the system platform generates the color printing information based on the video ringback tone information of the user stored in the background, it sends it to the terminal device. After receiving the color printing information, the terminal device displays the color printing information on the display interface of the terminal device. A virtual button of "OK" and a virtual button of "Cancel" or a virtual button of "Regenerate" are displayed on the display interface. The user may select the above virtual buttons by clicking the mouse or clicking the touch screen, thereby sending the corresponding selection operation to the system platform.

[0133] Step S504: If the selected operation is a confirmation operation, the cloud platform determines the color printing information as the user's customized color printing information.

[0134] In this embodiment, if the user is satisfied with the color printing information generated by the system platform, the user can select the above-mentioned "OK" virtual button by clicking the mouse or the touch screen, so as to order the color printing information as his / her own customized color printing information.

[0135] If the user is not satisfied with the color printing information generated by the system platform, the user can select the above-mentioned "Cancel" virtual button by clicking the mouse or touching the touch screen, thereby canceling the color printing information that is customized for the user. Alternatively, the user can select the above-mentioned "Regenerate" virtual button by clicking the mouse or touching the touch screen, thereby sending a regeneration instruction to the system platform. The system platform regenerates new color printing information and resends it to the user's terminal device for the user to select.

[0136] After the user decides to order the color printing service based on the generated color printing information, when the user's personal mobile terminal dials the called terminal of other users, before the call is connected, during the call, or after hanging up, the system automatically pushes the color printing information generated by the caller to the called terminal in the form of USSD or flash message, so that the called terminal can display the generated color printing information. Similarly, when the calling terminal of other users dials the personal mobile terminal of the user, before the call is connected, during the call, or after hanging up, the system automatically pushes the generated color printing information to the calling terminal, so that the calling terminal can display the generated color printing information.

[0137] In this embodiment, by giving the user the choice, the user's ordering experience can be improved.

[0138] It is understandable that in other embodiments, the color printing generation method can be applied to the user's terminal device. After the user logs in to the cloud of the communication service provider through a terminal device such as a mobile phone, tablet or computer and enters the color printing ordering service interface, the cloud can be triggered to automatically call the video ringback tone information ordered by the user stored in the background database based on the corresponding instructions entered by the user in the color printing ordering service interface. The cloud platform sends the called video ringback tone information to the terminal device where the user is logged in at this time. The terminal device executes the color printing information generation method described in any of the aforementioned embodiments based on the received video ringback tone information, thereby generating color printing information. The specific steps of the color printing information generation method are not repeated here. At this time, after the color printing information is generated, the terminal device can directly display the color printing information on the display interface to receive the user's selection operation.

[0139] In addition, see Figure 8 The embodiment of the present invention further provides a color printing information generating device, comprising:

[0140] The color ring back tone acquisition module 10 is used to obtain the video color ring back tone information of the user;

[0141] The color printing generating module 20 is used to generate the color printing information of the user based on the video ring back tone information.

[0142] In one embodiment, the color printing generation module 20 is further used to input the video ringback tone information into a pre-trained color printing information generation network to obtain the color printing information output by the color printing information generation network.

[0143] In one embodiment, the color printing information generating device further includes:

[0144] Obtaining a training sample set and a pre-built adversarial generative network; wherein each group of training samples in the training sample set includes a video ringback tone sample and a color printing information sample of the same user sample; the adversarial generative network includes a generative network and a discriminative network;

[0145] Input the video ring back tone sample into the generation network to obtain a color printing generation sample corresponding to the video ring back tone sample;

[0146] Using the discriminant network, the authenticity of the color printing information sample and the color printing generation sample in each group of training samples is discriminated to obtain corresponding discrimination results;

[0147] Based on the discrimination results and the color printing generation samples corresponding to each group of training samples, adversarial training is performed on the adversarial generation network, and the trained generation network is determined as a color printing information generation network.

[0148] In one embodiment, the color printing information generation network includes an image feature extractor and a decoder; the color printing generation module 20 is also used to input the video ringback tone information into the image feature extractor to obtain the image feature vector output by the image feature extractor; and input the image feature vector into the decoder to obtain the color printing information output by the decoder.

[0149] In one embodiment, the color printing information generation network further includes a noise feature extractor;

[0150] The color printing generation module 20 is also used to input the random noise corresponding to the video ringback tone information into the noise feature extractor to obtain the noise feature vector output by the noise feature extractor; input the image feature vector and the noise feature vector into the decoder to obtain the color printing information output by the decoder.

[0151] In one embodiment, the color printing information generating device further includes:

[0152] A video frame image extraction module, used to extract a preset number of video frame images from the video ringback tone information;

[0153] The processing module is used to generate color printing information of the user based on a preset number of video frame images.

[0154] In one embodiment, the color printing information generating device further includes:

[0155] An information receiving and sending module, used for sending the color printing information to the terminal device of the user and receiving the selection operation of the user;

[0156] The color printing ordering determination module is used to determine the color printing information as the customized color printing information of the user if the selection operation is a determination operation.

[0157] Other embodiments or specific implementations of the color printing information generating device of the present invention can refer to the above-mentioned method embodiments, which will not be described in detail here.

[0158] Reference Fig. 9 , Fig. 9 The diagram is a schematic diagram of a recommended device structure for a method for generating color printing information according to an embodiment of the present invention.

[0159] The color printing information generating device comprises: at least one processor 301, a memory 302 and a color printing information generating program stored in the memory and executable on the processor, wherein the color printing information generating program is configured to implement the steps of the color printing information generating method as described above.

[0160] The processor 301 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 301 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 301 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 301 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen.

[0161] The memory 302 may include one or more computer-readable storage media, which may be non-transitory. The memory 302 may also include a high-speed random access memory and a non-volatile memory, such as one or more disk storage devices and flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 302 is used to store at least one instruction, which is executed by the processor 301 to implement the color printing information generation method provided in the method embodiment of the present application.

[0162] The blockchain-based key processing device also includes: a communication interface 303. The processor 301, the memory 302 and the communication interface 303 can be connected via a bus or a signal line. Each peripheral device can be connected to the communication interface 303 via a bus, a signal line or a circuit board.

[0163] The communication interface 303 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 301 and the memory 302. In some embodiments, the processor 301, the memory 302, and the communication interface 303 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 301, the memory 302, and the communication interface 303 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0164] Those skilled in the art will understand that Figure 1 The structure shown in the figure does not constitute a limitation on the color printing information generating device, and may include more or less components than those shown in the figure, or combine certain components, or arrange the components differently.

[0165] In addition, an embodiment of the present invention further proposes a computer program product, on which a program code is stored, and when the program code is executed by a processor, the steps of the color printing information generation method as described above are implemented. Therefore, it will not be described in detail here. In addition, the description of the beneficial effects of adopting the same method will not be described in detail. For technical details not disclosed in the computer program product embodiment involved in this application, please refer to the description of the method embodiment of this application. As an example, the program instructions can be deployed to be executed on one computing device, or on multiple computing devices located at one location, or on multiple computing devices distributed at multiple locations and interconnected by a communication network.

[0166] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by instructing the relevant hardware through a computer program, and the above-mentioned program can be stored in a computer-readable storage medium, and when the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, the above-mentioned storage medium can be a disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM), etc.

[0167] It should also be noted that the device embodiments described above are merely schematic, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. In addition, in the accompanying drawings of the device embodiments provided by the present invention, the connection relationship between the modules indicates that there is a communication connection between them, which may be specifically implemented as one or more communication buses or signal lines. A person of ordinary skill in the art may understand and implement it without paying any creative effort.

[0168] Through the description of the above implementation mode, the technicians in the field can clearly understand that the present invention can be implemented by means of software plus necessary general hardware, and of course, it can also be implemented by special hardware including special integrated circuits, special CPUs, special memories, special components, etc. In general, all functions completed by computer programs can be easily implemented by corresponding hardware, and the specific hardware structure used to implement the same function can also be various, such as analog circuits, digital circuits or special circuits. However, for the present invention, software program implementation is a better implementation mode in more cases. Based on such an understanding, the technical solution of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a readable storage medium, such as a computer floppy disk, a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a disk or an optical disk, etc., including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform the methods of various embodiments of the present invention.

[0169] The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.

Claims

1. A method for generating color printing information, characterized in that: include: Get the user's video ringback tone information; Based on the video ringback tone information, generating color printing information of the user; The color printing information is text information; The step of generating the color printing information of the user based on the video color ringback tone information includes: Inputting the video ringback tone information into a pre-trained color printing information generation network to obtain the color printing information output by the color printing information generation network; the color printing information generation network includes an image feature extractor and a decoder; The step of inputting the video ringback tone information into a pre-trained color printing information generation network to obtain the color printing information output by the color printing information generation network comprises: Inputting the video ring back tone information into the image feature extractor to obtain an image feature vector output by the image feature extractor; The image feature vector is input into the decoder to obtain the color printing information output by the decoder.

2. The color printing information generating method according to claim 1, characterized in that: Before inputting the video ring back tone information into a pre-trained color printing information generation network to obtain the color printing information output by the color printing information generation network, the method further includes: Obtaining a training sample set and a pre-built adversarial generative network; wherein each group of training samples in the training sample set includes a video ringback tone sample and a color printing information sample of the same user sample; the adversarial generative network includes a generative network and a discriminative network; Input the video ring back tone sample into the generation network to obtain a color printing generation sample corresponding to the video ring back tone sample; Using the discriminant network, the authenticity of the color printing information sample and the color printing generation sample in each group of training samples is discriminated to obtain corresponding discrimination results; Based on the discrimination results and the color printing generation samples corresponding to each group of training samples, adversarial training is performed on the adversarial generation network, and the trained generation network is determined as a color printing information generation network.

3. The color printing information generating method according to claim 1, characterized in that: The color printing information generation network also includes a noise feature extractor; Before inputting the image feature vector into the decoder to obtain the color printing information output by the decoder, the method further includes: Inputting the random noise corresponding to the video ring back tone information into the noise feature extractor to obtain a noise feature vector output by the noise feature extractor; The step of inputting the image feature vector into the decoder to obtain color printing information output by the decoder includes: The image feature vector and the noise feature vector are input into the decoder to obtain color printing information output by the decoder.

4. The color printing information generating method according to claim 1, characterized in that: The step of generating the color printing information of the user based on the video color ringback tone information includes: Extracting a preset number of video frame images from the video ringback tone information; Based on the preset number of video frame images, the color printing information of the user is generated.

5. The color printing information generating method according to claim 1, characterized in that: After generating the color printing information of the user based on the video ring back tone information, the method further includes: Sending the color printing information to the user's terminal device and receiving the user's selection operation; If the selection operation is a determination operation, the color printing information is determined as the customized color printing information of the user.

6. A color printing information generating device, characterized in that: include: The ring back tone acquisition module is used to obtain the user's video ring back tone information; A color printing generation module, used to generate color printing information of the user based on the video ringback tone information; The color printing information is text information; The color printing generation module is used to input the video ring back tone information into a pre-trained color printing information generation network to obtain the color printing information output by the color printing information generation network; The color printing information generation network includes an image feature extractor and a decoder; The color printing generation module is used to input the video ringback tone information into the image feature extractor to obtain the image feature vector output by the image feature extractor; and input the image feature vector into the decoder to obtain the color printing information output by the decoder.

7. A color printing information generating device, characterized in that: The method comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the method according to any one of claims 1 to 5.

8. A computer program product, characterized in that The method comprises an executable program code, wherein the program code performs the method according to any one of claims 1 to 5 when executed by a processor.

Images