User generated content processing method and device and storage medium

By generating and recording three-dimensional interactive videos on the client and sending them to the server, the problem of high pressure on server processing is solved, and the processing effect and format uniformity of user-generated content is improved.

CN118972662APending Publication Date: 2024-11-15腾安基金销售(深圳)有限公司
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202310896844.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-07-20
Publication Date
2024-11-15

AI Technical Summary

Technical Problem

In the prior art, since the server needs to render three-dimensional interactive image and create user-generated content on multiple terminals, the server processing pressure is high, affecting the processing effect of user-generated content.

Method used

By receiving input information on the client, a dynamic three-dimensional virtual image that is consistent with the action of the target object is generated, and a video recording function is called for video recording, the target video is obtained, and the video is sent to the server for user-generated content creation, reducing the server's Handle pressure.

Benefits of technology

It effectively reduces the processing pressure of the server, improves the processing effect of user-generated content, and solves the problem of inconsistent video formats generated by different terminals, and improves the format consistency of user-generated content.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118972662A_ABST
    Figure CN118972662A_ABST
Patent Text Reader

Abstract

The invention discloses a user generated content processing method and device and a storage medium, when input information initiated by a target object and used for making user generated content is received through a client, a first dynamic three-dimensional virtual image consistent with the action of the target object is generated in the client according to the input information; and calling a video recording function in the client, carrying out video recording on the first dynamic three-dimensional virtual image to obtain a first target video, then sending the first target video to a server, enabling the server to generate user generation content according to the first target video, and then receiving the user generation content sent by the server. According to the embodiment of the invention, the processing pressure of the server can be reduced, so that the processing effect of the server on the user-generated content can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a method, device and storage medium for processing user-generated content. Background Art

[0002] With the development of 3D technology, more users tend to create user-generated content including 3D interactive images. Among them, because the server has better configuration and better resources, and the server is more controllable, the relevant technology renders the 3D interactive image in the server to obtain the rendering result, and then creates the user-generated content based on the rendering result, and then sends the user-generated content to the user side for display, and the user side decides whether to publish the user-generated content. However, this processing method in the relevant technology will greatly increase the processing pressure of the server, thereby affecting the processing effect of the server on the user-generated content. Summary of the invention

[0003] The following is a summary of the subject matter described in detail herein. This summary is not intended to limit the scope of the claims.

[0004] The embodiments of the present application provide a method, device and storage medium for processing user-generated content, which can reduce the processing pressure of a server, thereby improving the processing effect of the server on the user-generated content.

[0005] On the one hand, an embodiment of the present application provides a method for processing user-generated content, comprising the following steps:

[0006] receiving, through the client, input information initiated by the target object for producing user-generated content;

[0007] In the client, a first dynamic three-dimensional virtual image consistent with the action of the target object is generated according to the input information;

[0008] Calling a video recording function in the client to record the first dynamic three-dimensional virtual image to obtain a first target video;

[0009] Sending the first target video to a server, so that the server generates the user-generated content according to the first target video;

[0010] The user generated content sent by the server is received.

[0011] On the other hand, an embodiment of the present application further provides a device for processing user-generated content, including:

[0012] An information receiving unit, used to receive input information initiated by a target object for producing user-generated content through a client;

[0013] An image generation unit, configured to generate, in the client, a first dynamic three-dimensional virtual image consistent with the action of the target object according to the input information;

[0014] A video recording unit, configured to call a video recording function in the client to record the first dynamic three-dimensional virtual image to obtain a first target video;

[0015] a video sending unit, configured to send the first target video to a server, so that the server generates the user generated content according to the first target video;

[0016] The first content receiving unit is configured to receive the user generated content sent by the server.

[0017] Optionally, the input information includes somatosensory input information; and the image generation unit is further used for:

[0018] Calling a browser startup function to start the browser in a headless mode, and rendering a target three-dimensional virtual image in a to-be-rendered page of the browser;

[0019] A first dynamic three-dimensional virtual image consistent with the action of the target object is generated according to the somatosensory input information and the target three-dimensional virtual image.

[0020] Optionally, the image generation unit is further used for:

[0021] Detecting idle pages in the browser;

[0022] When it is detected that there is an open idle page in the browser, content is loaded into the opened idle page to obtain a page to be rendered;

[0023] Rendering a target three-dimensional virtual image in the to-be-rendered page.

[0024] Optionally, the image generation unit is further used for:

[0025] Detecting idle pages in the browser;

[0026] When it is detected that there is no idle page opened in the browser, calling a page creation function to create a blank page in the browser;

[0027] Loading content into the blank page to obtain the page to be rendered;

[0028] The target three-dimensional virtual image is rendered in the page to be rendered.

[0029] Optionally, the image generation unit is further used for:

[0030] Obtaining the 3D model parameters of the next target 3D virtual image to be rendered according to the somatosensory input information and the 3D model parameters of the currently rendered target 3D virtual image;

[0031] Determining, according to the 3D model parameters of the currently rendered target 3D virtual image and the 3D model parameters of the next target 3D virtual image to be rendered, a difference parameter and a difference parameter amount between the currently rendered target 3D virtual image and the next target 3D virtual image to be rendered;

[0032] When the difference parameter amount is not greater than a preset parameter amount threshold, the 3D model parameters of the currently rendered target 3D virtual image are adjusted according to the difference parameter to generate a first dynamic 3D virtual image consistent with the target object action.

[0033] Optionally, the image generation unit is further used for:

[0034] When the difference parameter amount is greater than the preset parameter amount threshold, the target 3D virtual image is re-rendered according to the 3D model parameters of the next target 3D virtual image to be rendered to obtain a first dynamic 3D virtual image consistent with the target object action.

[0035] Optionally, the image generation unit is further used for:

[0036] Acquire the motion parameters of the target object according to the somatosensory input information;

[0037] The three-dimensional model parameters of the next target three-dimensional virtual image to be rendered are calculated according to the action parameters and the three-dimensional model parameters of the currently rendered target three-dimensional virtual image.

[0038] Optionally, the video recording unit is further used for:

[0039] Calling a video recording function in the client to perform video recording based on a binary large object format on the first dynamic three-dimensional virtual image to obtain a candidate video;

[0040] The video format conversion function in the client is called to perform text string-based format conversion on the candidate video to obtain a first target video.

[0041] Optionally, the input information includes somatosensory input information; and the video sending unit is further used for:

[0042] Acquire audio data of the target object according to the somatosensory input information;

[0043] The first target video and the audio data are sent to a server, so that the server performs audio and video synthesis according to the first target video and the audio data to obtain the user-generated content.

[0044] Optionally, the image generation unit is further used for:

[0045] Detecting the rendering capability supported by the client;

[0046] When the rendering capability supported by the client meets the preset rendering condition, a first dynamic three-dimensional virtual image consistent with the action of the target object is generated according to the input information.

[0047] Optionally, the user-generated content processing device further includes:

[0048] A capability detection unit, used to detect the rendering capability supported by the client;

[0049] an information sending unit, configured to send the input information to the server when the rendering capability supported by the client does not meet the preset rendering condition, so that the server generates the user-generated content according to the input information, wherein the user-generated content is generated by the server according to a second target video, the second target video is obtained by the server calling a video recording function to record a second dynamic three-dimensional virtual image, the second dynamic three-dimensional virtual image is generated by the server according to the input information, and the second dynamic three-dimensional virtual image is consistent with the action of the target object;

[0050] The second content receiving unit is configured to receive the user generated content sent by the server.

[0051] On the other hand, an embodiment of the present application further provides a device for processing user-generated content, including:

[0052] at least one processor;

[0053] at least one memory for storing at least one program;

[0054] When at least one of the programs is executed by at least one of the processors, the method for processing user-generated content as described above is implemented.

[0055] On the other hand, an embodiment of the present application further provides a computer-readable storage medium, which stores a computer program executable by a processor. When the computer program executable by the processor is executed by the processor, it is used to implement the method for processing user-generated content as described above.

[0056] On the other hand, an embodiment of the present application also provides a computer program product, including a computer program or computer instructions, wherein the computer program or the computer instructions are stored in a computer-readable storage medium, and a processor of the user-generated content processing device reads the computer program or the computer instructions from the computer-readable storage medium, and the processor executes the computer program or the computer instructions, so that the user-generated content processing device performs the user-generated content processing method as described above.

[0057] The embodiment of the present application at least includes the following beneficial effects: when receiving input information for making user-generated content initiated by the target object through the client, a first dynamic three-dimensional virtual image consistent with the action of the target object is generated in the client according to the input information, and then the video recording function in the client is called to record the first dynamic three-dimensional virtual image to obtain the first target video. Since the generation of the first dynamic three-dimensional virtual image and the recording of the first target video are both completed in the client, the client can share part of the work of the server, thereby reducing the processing pressure of the server on the user-generated content; after obtaining the first target video in the client, the first target video is sent to the server, so that the server can use its better configuration and better resources to generate user-generated content according to the first target video, thereby completing the creation process of the user-generated content in the server. That is to say, the embodiment of the present application transfers the rendering of the three-dimensional interactive image and the creation of the user-generated content completed by the server in the related technology to the client, so the client can be used to reduce the processing pressure of the server on the user-generated content, thereby improving the processing effect of the server on the user-generated content.

[0058] Other features and advantages of the present application will be described in the following description, and partly become apparent from the description, or understood by practicing the present application. The purpose and other advantages of the present application can be realized and obtained through the structures particularly pointed out in the description and the drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] The accompanying drawings are used to provide further understanding of the technical solution of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the technical solution of the present application and do not constitute a limitation on the technical solution of the present application.

[0060] Figure 1 It is a schematic diagram of an implementation environment provided by an embodiment of the present application;

[0061] Figure 2 is a schematic diagram of another implementation environment provided by an embodiment of the present application;

[0062] Figure 3is a flowchart of a method for processing user-generated content provided in an embodiment of the present application;

[0063] Figure 4 is an optional schematic diagram of a target three-dimensional virtual image provided in an embodiment of the present application;

[0064] Figure 5 is an optional flow chart of a server processing a first target video provided in an embodiment of the present application;

[0065] Figure 6 This is an optional flow chart of calling a browser startup function to open a browser provided in an embodiment of the present application;

[0066] Figure 7 This is a schematic diagram of an optional process of rendering and recording the first target video provided in an embodiment of the present application;

[0067] Figure 8 This is a schematic diagram of an optional process of generating a first target video by client rendering provided in an embodiment of the present application;

[0068] Fig. 9 This is an optional flowchart of a simplified production process of user-generated content provided in an embodiment of the present application;

[0069] Fig.10 This is an optional flow chart of the overall production process of user-generated content provided in the embodiment of the present application;

[0070] Fig.11 This is an optional schematic diagram of the rendering capability detection content provided in the embodiment of the present application;

[0071] Fig.12 This is an optional flow chart of UGC rendering performed by a server provided in an embodiment of the present application;

[0072] Fig.13 This is an optional flowchart of a rendering process initiated by clients with different rendering capabilities provided in an embodiment of the present application;

[0073] Fig.14 is an overall flow chart of a method for processing user-generated content provided by a specific example;

[0074] Fig.15 is a schematic diagram of a device for processing user-generated content provided in an embodiment of the present application;

[0075] Fig.16 It is a schematic diagram of another device for processing user-generated content provided in an embodiment of the present application. DETAILED DESCRIPTION

[0076] The present application is further described below in conjunction with the accompanying drawings and specific embodiments. The described embodiments should not be regarded as limiting the present application, and all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present application.

[0077] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0078] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0079] Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations.

[0080] 1) Cloud Technology refers to a hosting technology that unifies hardware, software, network and other resources within a wide area network or local area network to achieve data computing, storage, processing and sharing. Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, application technology, etc. based on the cloud computing business model. It can form a resource pool and be used on demand, which is flexible and convenient. Cloud computing technology will become an important support. The backend services of the technical network system require a large amount of computing and storage resources, such as video websites, image websites, e-commerce platform websites and more portal websites. With the rapid development and application of the Internet industry, in the future, each item may have its own identification mark, which needs to be transmitted to the backend system for logical processing. Data of different levels will be processed separately. All kinds of industry data require strong system backing support, which can only be achieved through cloud computing.

[0081] 2) User Generated Content (UGC) refers to digital content created, shared or published by users, such as photos, videos, audio, articles and comments. User-generated content can come from social media platforms, blogs, forums or online games, etc., and is created and published by ordinary users rather than professional content creators or media organizations.

[0082] At present, when users are producing user-generated content including three-dimensional interactive images, since the user-generated content is used for promotion and dissemination, the three-dimensional interactive image cannot be simply displayed on the user's client, and the three-dimensional interactive image needs to be recorded as a video for sharing and publishing. In the related art, the user can render the three-dimensional interactive image and record the video through a specific client or browser, thereby obtaining the corresponding user-generated content, and then display the user-generated content in the user's client or browser. When the client is used to render the three-dimensional interactive image and record the video, the conventional method is to render the three-dimensional interactive image through the three-dimensional rendering framework in the client, and then use the interface method of the three-dimensional rendering framework to call the camera to collect the picture of the three-dimensional interactive image, generate the corresponding video, and then obtain the corresponding user-generated content according to the generated video. However, since the configuration and resources of the terminal are generally not too high, the video of the three-dimensional interactive image obtained by this method is generally just a carousel of the picture sequence, and there are problems such as low video picture quality and poor picture carousel effect. When a browser is used to render a 3D interactive image and record a video, the conventional method is to render the 3D interactive image through WebGL in the browser, and then call the MediaRecorder underlying interface and the Canvas.captureStream() underlying interface of HTML5 to record the video of the 3D interactive image, generate the corresponding video, and then obtain the corresponding user-generated content based on the generated video. However, this method depends on the version of the browser. Since different versions of browsers have different support for the MediaRecorder underlying interface, different versions of browsers will have compatibility issues with the MediaRecorder underlying interface, thereby affecting the recording effect of the 3D interactive image. In addition, the video formats of the videos generated by different models of terminals may be different, so the formats of the user-generated content generated by different models of terminals may be different. Therefore, this method also has the problem of inconsistent formats of generated user-generated content.

[0083] In order to solve these problems, the related art proposes that the web terminal in the server can be used to render the three-dimensional interactive image and record the video. Since the server has better configuration and better resources than the terminal, and the server is more controllable, the web terminal in the server is used to render the three-dimensional interactive image and record the video, which can effectively solve the problems existing when the client or browser is used to render the three-dimensional interactive image and record the video. However, in actual use, the server needs to respond to multiple terminals to generate user-generated content for multiple terminals. When multiple terminals request the server to generate user-generated content for each terminal, since various processes such as rendering the three-dimensional interactive image and video recording need to be completed in the web terminal of the server, the processing pressure of the server will be greatly increased, thereby affecting the processing effect of the server on the user-generated content.

[0084] In order to reduce the processing pressure of the server and improve the processing effect of the server on user-generated content, the embodiments of the present application provide a method for processing user-generated content, a processing device for user-generated content, a computer-readable storage medium and a computer program product. When input information for producing user-generated content initiated by a target object is received through a client, a first dynamic three-dimensional virtual image consistent with the action of the target object is generated in the client according to the input information, and then a video recording function in the client is called to record the first dynamic three-dimensional virtual image to obtain a first target video. Since the generation of the first dynamic three-dimensional virtual image and the recording of the first target video are both completed in the client, the client can share part of the work of the server, thereby reducing the processing pressure of the server on the user-generated content; after the first target video is obtained in the client, the first target video is sent to the server, so that the server can use its better configuration and better resources to generate user-generated content according to the first target video, thereby completing the creation process of the user-generated content in the server. That is to say, the embodiment of the present application transfers the rendering of three-dimensional interactive images and the creation of user-generated content, which are performed by the server in the related art, to the client, so the client can be used to reduce the processing pressure of the server on the user-generated content, thereby improving the processing effect of the server on the user-generated content. In addition, after the first target video is obtained in the client, the first target video will be sent to the server for subsequent creation and processing of the user-generated content. Therefore, even if the video formats of the first target videos generated by different clients are different, after the server creates the user-generated content, the user-generated content with a unified format can be obtained. Therefore, the compatibility problem of the underlying interface of MediaRecorder due to different browser versions when the browser is used to create user-generated content in the related art can be overcome, and the problem of inconsistent format of the user-generated content obtained due to different terminal models when the client is used to create user-generated content in the related art can be overcome.

[0085] Reference Figure 1 , Figure 1 1 is a schematic diagram of an implementation environment provided by an embodiment of the present application. The implementation environment may include a first user terminal 110 and a first processing server 120, and the first user terminal 110 and the first processing server 120 may be directly or indirectly connected via wired or wireless communication. The first user terminal 110 and the first processing server 120 may be nodes in a blockchain, which is not specifically limited in this embodiment.

[0086] The first user terminal 110 may include but is not limited to a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart watch, an intelligent voice interaction device, a smart home appliance, a vehicle terminal, an aircraft, etc. Optionally, the first user terminal 110 may be installed with a client for producing user-generated content, through which a first dynamic three-dimensional virtual image consistent with the user's action may be generated, and a video of the first dynamic three-dimensional virtual image may be recorded to obtain a first target video.

[0087] The first processing server 120 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. The first processing server 120 may generate user-generated content required by the user based on the first target video sent by the first user terminal 110.

[0088] Reference Figure 1 As shown, in an application scenario, it is assumed that the first user terminal 110 is a computer, and the first user terminal 110 is installed with a client 111 that can be used to produce user-generated content. When the user produces user-generated content through the client 111 in the first user terminal 110, the first user terminal 110 will receive input information initiated by the user for producing user-generated content through the client 111, wherein the input information may include user action parameters and audio data, etc. At this time, the first user terminal 110 will generate a first dynamic three-dimensional virtual image consistent with the user action in the client 111 according to the user's action parameters in the input information, and then call the video recording function in the client 111 to record the first dynamic three-dimensional virtual image to obtain a first target video. Then, the first user terminal 110 will record the first target video. The target video and the user's audio data in the input information are sent to the first processing server 120, so that the first processing server 120 can add the audio data to the first target video to generate the user-generated content. After the first processing server 120 generates the user-generated content based on the first target video and the audio data, the first processing server 120 will send the user-generated content to the first user terminal 110. After the first user terminal 110 receives the user-generated content, the first user terminal 110 will display the user-generated content through the client 111. At this time, the user can decide whether to save and publish the user-generated content.

[0089] Reference Figure 2 , Figure 22 is a schematic diagram of another implementation environment provided by an embodiment of the present application. The implementation environment may include a second user terminal 210, a second processing server 220 and a data server 230, and the second user terminal 210 may be directly or indirectly connected to the second processing server 220 and the data server 230 respectively through wired or wireless communication. Among them, the second user terminal 210, the second processing server 220 and the data server 230 may be nodes in the blockchain, and this embodiment does not specifically limit this.

[0090] The second user terminal 210 may include but is not limited to a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart watch, an intelligent voice interaction device, a smart home appliance, a vehicle terminal, an aircraft, etc. Optionally, the second user terminal 210 may be installed with a client for producing user-generated content, through which a first dynamic three-dimensional virtual image consistent with the user's action may be generated, and a video recording of the first dynamic three-dimensional virtual image may be performed to obtain a first target video.

[0091] The second processing server 220 and the data server 230 can be independent physical servers, or server clusters or distributed systems composed of multiple physical servers, or cloud servers that provide basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN networks, and big data and artificial intelligence platforms. Among them, the second processing server 220 can generate user-generated content required by the user based on the first target video sent by the second user terminal 210. The data server 230 can pre-store a variety of types of three-dimensional images, such as three-dimensional images of human types, three-dimensional images of animal types, and cartoonized three-dimensional images. The data server 230 can respond to the three-dimensional image request information sent by the second user terminal 210 and send the corresponding three-dimensional image to the second user terminal 210, so that the second user terminal 210 can generate a first dynamic three-dimensional virtual image consistent with the user's action based on the three-dimensional image.

[0092] Reference Figure 2As shown, in another application scenario, it is assumed that the second user terminal 210 is a computer, and the second user terminal 210 is installed with a client 211 that can be used to produce user-generated content. When the user produces user-generated content through the client 211 in the second user terminal 210, the second user terminal 210 will receive input information initiated by the user for producing user-generated content through the client 211, wherein the input information may include the user's action parameters and audio data, image request information for selecting a three-dimensional image, etc. At this time, the second user terminal 210 can first obtain the corresponding three-dimensional image from the data server 230 according to the image request information, and then generate a first dynamic three-dimensional virtual image consistent with the user's action in the client 211 according to the three-dimensional image and the user's action parameters in the input information, and call the video recording function in the client 211 to perform video recording on the first dynamic three-dimensional virtual image. , obtain the first target video, then, the second user terminal 210 sends the first target video and the user's audio data in the input information to the second processing server 220, so that the second processing server 220 can add the audio data to the first target video, thereby generating the user-generated content. After the second processing server 220 generates the user-generated content according to the first target video and the audio data, the second processing server 220 will send the user-generated content to the second user terminal 210. After the second user terminal 210 receives the user-generated content, the second user terminal 210 will display the user-generated content through the client 211. At this time, the user can decide whether to save and publish the user-generated content.

[0093] It should be noted that in each specific implementation of the present application, when it comes to the need to perform relevant processing based on the attribute information or attribute information set of the target object (such as a user, etc.) and other data related to the characteristics of the target object, the permission or consent of the target object will be obtained first, and the collection, use and processing of these data will comply with relevant laws, regulations and standards. In addition, when the embodiment of the present application needs to obtain the attribute information of the target object, the separate permission or separate consent of the target object will be obtained through a pop-up window or by jumping to a confirmation page. After clearly obtaining the separate permission or separate consent of the target object, the relevant data of the target object necessary for the embodiment of the present application to operate normally is obtained.

[0094] Figure 3 1 is a flowchart of a method for processing user-generated content provided in an embodiment of the present application. The method for processing user-generated content can be executed by a terminal, or by a terminal and a server. In the embodiment of the present application, the method is executed by a terminal as an example for explanation. Figure 3 The method for processing user-generated content may include but is not limited to steps 310 to 350.

[0095] Step 310: receiving input information initiated by the target object for producing user-generated content through the client.

[0096] In one embodiment, the input information may be data required for making the UGC of the target object, or may be the target object's demand for making the UGC. Since there are many types of digital content of UGC, including photos, videos, audio, articles, and comments, the input information may include type information of the UGC required by the target object, and the type information may be used to determine the type of digital content of the UGC. For example, the input information may carry video type information, which indicates that the target object initiates the production of the video type of UGC. In addition, the input information may also include at least one of the action data, posture data, image data, image data, audio data, or video clip data required for making the UGC. For example, when the UGC is a video, the input information may also include the action data, posture data, image data, image data, or video clip data required for making the UGC video, so that the action data, posture data, image data, or video clip data may be used to limit the effect of making the generated UGC, such as generating a UGC video consistent with the action data initiated by the target object, or generating a UGC video consistent with the image data initiated by the target object. In addition, the input information may also include multiple data, so that the UGC may be generated through a plurality of different types of input information, so that the generated UGC may be more in line with the needs of the target object.

[0097] In one embodiment, the input information may be data pre-stored in the client, or data generated instantly by the client and transmitted in real time. For example, the input information may be video picture data containing the action of the target object obtained by shooting a terminal on which the client is installed. In addition, the input information may be data generated by a client that initiates the input information, or data generated by a terminal on which a non-current client is installed. For example, the input information may be action feature data obtained by extracting and processing video picture data containing the action of the target object after shooting the video picture data using the client's camera device. The embodiments of the present application do not specifically limit this.

[0098] Step 320: In the client, a first dynamic three-dimensional virtual image consistent with the action of the target object is generated according to the input information.

[0099] In one embodiment, after receiving the input information initiated by the target object through the client, the input information can be stored in the client, wherein the input information can include the action data or posture data of the target object, so the client can use the input information to generate a first dynamic three-dimensional virtual image consistent with the action of the target object. After receiving the input information initiated by the target object, the client generates the corresponding first dynamic three-dimensional virtual image locally, rather than directly inputting the information to the server, so that the server generates the corresponding first dynamic three-dimensional virtual image using the input information, thereby completing the task of generating the first dynamic three-dimensional virtual image locally through the client, which can share part of the task work for the server and reduce the processing pressure of the server on the user-generated content. At the same time, since the first dynamic three-dimensional virtual image is generated in the client, it can help to query the generation progress of the first dynamic three-dimensional virtual image in real time through the client, and it is also convenient to timely confirm whether the first dynamic three-dimensional virtual image meets the needs of the target object, and timely regenerate the first dynamic three-dimensional virtual image locally on the client, without the need for the server to generate the first dynamic three-dimensional virtual image and then return it to the client for confirmation, thereby improving the production and processing efficiency of UGC.

[0100] In one embodiment, the input information may include business scenario information of the current rendering to generate the first dynamic three-dimensional virtual image. For example, the first dynamic three-dimensional virtual image may be applied to interactive 2.5D games, interactive 3D games, interactive 3D scenes, cartoon 3D scenes and other interactive image 3D display scenes. Different business scenarios have different requirements for the first dynamic three-dimensional virtual image. Therefore, in the process of generating the first dynamic three-dimensional virtual image according to the input information, it is necessary to consider the business scenario information in the input information and set the rendering logic, so that different first dynamic three-dimensional virtual images can be written and rendered according to different business scenarios to meet the user's usage requirements.

[0101] In one embodiment, the input information may include the action data or posture data of the target object, so the client can identify the target object from the input information, and can extract the action features of the target object from the input information. For example, the target object (i.e., the person object) can be identified from the input information using object recognition technology, and then the action features of the target object can be extracted. Then, after obtaining the action features of the target object, the action features in the input information can be identified, the motion trajectory of each action feature can be determined, and then the motion trajectory of each action feature can be converted into the motion trajectory of the action feature corresponding to the first dynamic three-dimensional virtual image. For example, the action of the target object can be identified from the input information using motion recognition technology, and then the action of the target object in the input information can be reproduced with the first dynamic three-dimensional virtual image, so that the action state of the target object in the input information can be applied to the first dynamic three-dimensional virtual image, and the first dynamic three-dimensional virtual image consistent with the action of the target object is generated.

[0102] In one embodiment, the action feature information of the target object carried in the input information is used to construct the action feature information of the first dynamic three-dimensional virtual image, so that the action of the first dynamic three-dimensional virtual image is consistent with the action of the target object. Since the first dynamic three-dimensional virtual image can be constructed by the action features of the target object, the action features of the target object are generally human joints, such as the top of the head, heels, elbows and other landmarks. In the embodiment of the present application, the action features of the first dynamic three-dimensional virtual image can be adjusted according to its own image characteristics. Therefore, the position of the action features of the first dynamic three-dimensional virtual image can be the same as or different from the position of the action features of the target object. When the position of the action features of the first dynamic three-dimensional virtual image is different from the position of the action features of the target object, the corresponding action features can be used for replacement, and the motion trajectory between the two action features can be estimated to enable the first dynamic three-dimensional virtual image to replace the target object in the input information with the corresponding action. The embodiment of the present application does not specifically limit this.

[0103] For example, refer to Figure 4 , Figure 4 An optional schematic diagram of the target three-dimensional virtual image 400 of the embodiment of the present application is shown. It can be seen that the target three-dimensional virtual image 400 is a three-dimensional image, and the target three-dimensional virtual image 400 can be rotated to view different perspectives by performing corresponding operations on the client (such as performing a swiping operation on the target three-dimensional virtual image 400 on the client). Figure 4 The schematic diagram on the left side of the figure shows a front view of the target three-dimensional virtual image 400, and by performing a rotation operation on the client, the target three-dimensional virtual image 400 can be viewed from different perspectives, such as Figure 4 The schematic diagram on the right side of the middle diagram shows a schematic diagram of the target three-dimensional virtual image 400 after the viewing angle is rotated. Figure 4 The target three-dimensional virtual image 400 shown in the left schematic diagram can be used as the currently rendered target three-dimensional virtual image 400. Figure 4 The target three-dimensional virtual image 400 shown in the schematic diagram on the right side of the figure can be understood as the next target three-dimensional virtual image 400 to be rendered. The three-dimensional model parameters of the target three-dimensional virtual image 400 currently rendered and the input information (such as the input information of the target object performing a turning action) are used to determine the three-dimensional model parameters of the next target three-dimensional virtual image 400 to be rendered, and then the three-dimensional model parameters of the currently rendered target three-dimensional virtual image 400 are adjusted to generate the next target three-dimensional virtual image 400 to be rendered that is consistent with the target object after performing the turning action ( Figure 4In addition, the action characteristics of the target three-dimensional virtual image 400 are adjusted according to its own image characteristics, and the action characteristics of the target three-dimensional virtual image 400 may be the same as or different from the action characteristics of the target object. Figure 4 As shown, the target three-dimensional virtual image 400 lacks some action features such as elbows and knees compared to the target object (character), while the target three-dimensional virtual image 400 can have the same action features as the target object (character), such as the top of the head, heels and wrists, etc. Therefore, the corresponding action features can be used for replacement, and the motion trajectory between the two action features can be estimated to enable the target three-dimensional virtual image 400 to replace the target object in the input information with the corresponding action.

[0104] Step 330: Call the video recording function in the client to record the first dynamic three-dimensional virtual image to obtain a first target video.

[0105] In one embodiment, after the client receives input information initiated by the target object and generates a first dynamic three-dimensional virtual image using the input information, the client can call a video recording function in the client to record the first dynamic three-dimensional virtual image generated by the client to obtain a first target video. The video recording function stored in the client can be one or more functions for performing video recording of the first dynamic three-dimensional virtual image. The video recording function can be used to control the browser (such as a Headless Chrome browser or a Chrome browser) and drive the 3D renderer (such as a WebGL renderer) in the browser to perform three-dimensional rendering and recording on the first dynamic three-dimensional virtual image to generate a first target video. The first target video can refer to the dynamic motion process generated by rendering the first dynamic three-dimensional virtual image according to the motion trajectory of each action feature of the target object in the input information. The picture displayed in the first target video can be the picture of the first dynamic three-dimensional virtual image replacing the target object in the input information, that is, the action of the first dynamic three-dimensional virtual image is consistent with the action of the target object. Therefore, using the client to perform the task of producing the first target video of the first dynamic three-dimensional virtual image can help to view the first target video corresponding to the first dynamic three-dimensional virtual image in real time on the client, so as to adjust the input information in time to correct the first dynamic three-dimensional virtual image or the first target video, and decide whether to use the first dynamic three-dimensional virtual image and the first target video to generate UGC. At the same time, since the recording of the first target video is generated in the client, the client can share part of the work of the server, thereby reducing the pressure of the server on user-generated content, so that the server can use its better configuration and better resources to generate user-generated content according to the first target video.

[0106] Step 340: Send the first target video to the server, so that the server generates user-generated content according to the first target video.

[0107] In one embodiment, after receiving the input information initiated by the target object, a first dynamic three-dimensional virtual image consistent with the action of the target object is generated in the client according to the input information, and then the video recording function in the client is called to record the first dynamic three-dimensional virtual image to obtain the first target video. Since the generation of the first dynamic three-dimensional virtual image and the recording of the first target video are both completed in the client, the client can share part of the work of the server, thereby reducing the processing pressure of the server on user-generated content; after obtaining the first target video in the client, the terminal sends the first target video to the server, so that the server can use its better configuration and better resources to generate user-generated content according to the first target video, thereby completing the creation of user-generated content in the server. That is to say, the embodiment of the present application transfers the rendering of the three-dimensional interactive image and the creation of user-generated content completed by the server in the related technology to the client, so the client can be used to reduce the processing pressure of the server on user-generated content, thereby improving the processing effect of the server on user-generated content.

[0108] In one embodiment, after obtaining the first target video, the first target video can be sent to the server via an HTTP POST request, so that the server can receive the first target video through the POST request. The embodiment of the present application does not specifically limit the method for sending the first target video to the server.

[0109] In one embodiment, the server may pre-build a web service, receive the first target video through the web service, and then pre-process the first target video for UGC synthesis, and then use the pre-processed first target video to generate user-generated content. After the server generates the user-generated content, the user-generated content is sent to the client. Among them, the pre-processing of the first target video for UGC synthesis may be to convert the data format of the first target video. For example, since different clients use different video recording interfaces (such as the underlying MediaRecorder interface and Canvas.captureStream interface based on HTML5), and the compatibility of different video recording interfaces is different, the support of different clients is different, which leads to different data formats of the first target videos generated by different clients (such as the data format of the first target video generated by the client recording of the IOS system can be MP4 data format, and the data format of the first target video generated by the client recording of the Android system can be WEBM data format). Therefore, after converting the data format of the first target video to MP4 data format, the video file after the data format conversion is used to synthesize the user-generated content. By converting the data format of the first target video in advance, the inconsistency and compatibility problems of recording by different clients can be solved.

[0110] For example, refer to Figure 5 , Figure 5 An optional flow chart of the server processing the first target video provided by the embodiment of the present application is shown. It can be seen that the server can first execute step 501 to build a web service, then execute step 502 to receive the first target video through the web service in a POST request, and then execute step 503 to pre-process the first target video for UGC production, so that step 504 can be executed to generate video materials for producing UGC, and then step 505 can be executed to use these video materials to produce UGC works, and after the UGC works are generated, the UGC works are returned to the client.

[0111] Step 350: Receive user-generated content sent by the server.

[0112] In one embodiment, after the server generates user-generated content using the first target video sent by the client, the server may return the first target video to the client, so that after receiving the user-generated content, the client may display the user-generated content in the client for the user to confirm whether the user-generated content meets the needs.

[0113] In one embodiment, input information for producing user-generated content can be uploaded through an activity page displayed on a client. After uploading the input information through the activity page, the target three-dimensional virtual image, the first dynamic three-dimensional virtual image, or the first target video can be viewed on the activity page, and the user-generated content sent by the server can be viewed on the activity page, and the user-generated content can be published to the public network or downloaded and saved locally.

[0114] In one embodiment, in the process of generating a first dynamic three-dimensional virtual image consistent with the action of the target object according to the input information, the following steps may be included: first, calling the browser startup function to start the browser in headless mode, and rendering the target three-dimensional virtual image in the browser's to-be-rendered page; then, generating a first dynamic three-dimensional virtual image consistent with the action of the target object according to the somatosensory input information and the target three-dimensional virtual image. Wherein, the input information includes somatosensory input information, and the somatosensory input information may be data used to characterize the action state of the target object. For example, the somatosensory input information may be the motion trajectory of each action feature of the target object, or may be the posture information of the target object at each time node. It should be noted that the browser startup function may be a Puppeteer function, such as the function puppeteer.launch(), and the browser startup function may be used to start a headless browser. A headless browser refers to a browser without a graphical user interface. A headless browser can access a web page by rendering a page in memory and then sending the result back to the requesting client without displaying the web page on the screen, so that the target three-dimensional virtual image can be rendered in the background without being directly displayed on the client interface, without occupying the client interface area, and thus without affecting the interaction between the user and the client. Since the headless browser started by using the browser startup function is equivalent to running a browser on the server for three-dimensional rendering, the headless browser started by using the browser startup function has the advantage of being controllable like the server environment, thereby reducing the differences in the first target video generated due to different clients, and can solve the compatibility issues caused by different clients and the problem of inconsistent data formats of the recorded first target video, thereby improving the user experience.

[0115] In one embodiment, the browser startup function may be one function or multiple functions. For example, the browser startup function may include the function puppeteer.launch(), the function browser.newPage(), and the function page.goto(); wherein the function puppeteer.launch() may be used to open a headless browser, the function browser.newPage() may open a new page in the headless browser for use, and the function page.goto() may load a template rendering page, i.e., a page to be rendered, from the page opened in the headless browser. The browser startup function may be a function in Puppeteer, which is a Node.js library for controlling and operating a Headless Chrome browser or a Chrome browser. Puppeteer can provide API tools for automating web page operations, generating web page screenshots, performing web page tests and other tasks. By calling Puppeteer functions, user operations in the browser can be simulated, such as clicking links, filling out forms, uploading files, etc., so that the built-in 3D renderer WebGL of the OpenGL-based browser can be further called in the Puppeteer headless browser. The WebGL renderer can be used to draw and render 3D graphics on the web page, such as the first dynamic 3D virtual image. Further, Babylon is a 3D graphics engine based on WebGL, which can use the Babylon framework to run WebGL to perform 3D rendering of the first dynamic 3D virtual image, which can improve the visual effect of 3D graphics rendering. It should be noted that rendering the 3D model based on some client methods (such as computer client-based methods) can improve the rendering effect of the 3D model, but it is not convenient to deploy in the server, and it cannot support cross-platform applications. Therefore, Web3D technology can be used to achieve cross-platform recording and display of the model. Among them, Web3D technology refers to the technology that applies three-dimensional graphics technology to the Web. It can combine 3D graphics and Web technology, allowing users to browse and operate virtual scenes on the Web in a more realistic and intuitive way. Web3D technology allows users to directly access and browse 3D content through a Web browser without installing any additional plug-ins or software, thereby improving the convenience of recording, accessing and browsing three-dimensional graphics.

[0116] For example, refer to Figure 6 , Figure 6An optional flow diagram of calling a browser startup function to open a browser in an embodiment of the present application is shown. It can be seen that a timeout logic can be set on the client, and the client can first execute step 601, call the function puppeteer.launch() in the client, and then implement step 602, open the Chrome browser, and then execute step 603, call the function browser.newPage() to create a new blank page in the Chrome browser. If the opening time of the Chrome browser exceeds the preset timing time, it can be considered that the calling browser startup function has timed out, and step 605 can be executed to close the Chrome browser to save resources. At the same time, after creating a new blank page, step 604 can be executed to start the console for detection, receive the recording signal (i.e., the audio signal transmitted by the target object) and receive it and convert it into audio data, and then perform related operations, such as closing the browser. For example, when the audio data recording is completed, the console can be used to notify the browser that the recording is completed, thereby executing the browser closing operation; in addition, when the audio data recording fails, the console can also be used to notify the browser that the recording fails, so that the Puppeteer function can be used to re-control the browser for audio recording, restart the browser or close the browser.

[0117] In one embodiment, the target three-dimensional virtual image is a three-dimensional virtual image constructed based on the somatosensory input information of the target object. It can be understood that the target three-dimensional virtual image is a static three-dimensional virtual image, and the actions displayed by the target three-dimensional virtual image may be consistent with or inconsistent with any action of the target object, that is, the target three-dimensional virtual image may be a basic three-dimensional virtual image of a first dynamic three-dimensional virtual image that is consistent with the action of the target object, or the target three-dimensional virtual image is a partial three-dimensional virtual image in the first dynamic three-dimensional virtual image. For example, the first dynamic three-dimensional virtual image is dynamic, and the target three-dimensional virtual image is static, and the target three-dimensional virtual image may be a three-dimensional virtual image corresponding to the first dynamic three-dimensional virtual image at a certain moment.

[0118] In one embodiment, in the process of rendering the target three-dimensional virtual image in the page to be rendered of the browser, the following steps may be included: first, the idle page in the browser is detected; when it is detected that there is an open idle page in the browser, the content of the opened idle page is loaded to obtain the page to be rendered; then, the target three-dimensional virtual image is rendered in the page to be rendered. By performing idle detection on the page opened by the browser, and calling the function page.goto() on the opened idle page, the template rendering page is loaded on the idle page to obtain the page to be rendered, so that the three-dimensional rendering is performed by reusing the opened browser and the opened idle page, without frequently switching the browser or the page, thereby improving resource utilization. At the same time, since there is no need to create a new idle page, the page creation time is saved, and the rendering efficiency of the target three-dimensional virtual image is improved. It should be noted that the resources of the template rendering page are pre-cached. When the function page.goto() is called, the relevant cache resources of the template rendering page can be reused without deleting the cache resources, and further, the relevant resources of the template rendering page do not need to be regenerated, thereby improving the rendering performance and rendering efficiency of the headless browser.

[0119] In one embodiment, the idle pages in the browser are detected. If the number of idle pages in the current browser exceeds a preset value, the idle pages can be closed; or the opening time of the idle pages in the browser is calculated. If the opening time of the idle pages exceeds the preset time, the idle pages can be closed; or, if the rendering task of the target three-dimensional virtual image is completed in the page to be rendered, the idle pages can be closed. For example, the browser can provide 100 pages to perform the rendering task of the target three-dimensional virtual image at the same time. If the number of pages opened in the browser exceeds 100, some idle pages can be closed. In addition, when the browser is opened, if no blank page or idle page is detected within the preset timing time, it can be considered that the browser has timed out and no operation has been performed, and the browser can be closed to save resources.

[0120] In one embodiment, the process of rendering the target three-dimensional virtual image in the page to be rendered of the browser may further include the following steps: firstly, detecting the idle page in the browser; when detecting that there is no idle page opened in the browser, calling the page creation function to create a blank page in the browser; then, loading the content of the blank page to obtain the page to be rendered; then, rendering the target three-dimensional virtual image in the page to be rendered. The page creation function may be the function browser.newPage(), which can create a new blank page in the current browser by using the function browser.newPage(), and then calling the function page.goto() in the newly created blank page, so that the template rendering page is loaded in the blank page to obtain the page to be rendered, so that the target three-dimensional virtual image can be rendered using the page to be rendered. Since the rendering task of the target three-dimensional virtual image to be executed by the browser changes in real time, and the idle pages opened in the browser will be cleared regularly, in order to avoid the browser performance redundancy caused by sufficient rendering performance of the browser but insufficient number of idle pages, the page creation function can be called to create a blank page and load content into the blank page to render the target three-dimensional virtual image, thereby increasing the number of rendering processes of the browser, improving resource utilization, and reducing the waiting time for idle pages, thereby improving the rendering efficiency of the target three-dimensional virtual image.

[0121] In one embodiment, in the process of generating a first dynamic three-dimensional virtual image consistent with the action of the target object based on somatosensory input information and the target three-dimensional virtual image, the following steps may be included: first, based on the somatosensory input information and the three-dimensional model parameters of the currently rendered target three-dimensional virtual image, the three-dimensional model parameters of the next target three-dimensional virtual image to be rendered are obtained; then, based on the three-dimensional model parameters of the currently rendered target three-dimensional virtual image and the three-dimensional model parameters of the next target three-dimensional virtual image to be rendered, the difference parameters and the difference parameter amount between the currently rendered target three-dimensional virtual image and the next target three-dimensional virtual image to be rendered are determined; when the difference parameter amount is not greater than a preset parameter amount threshold, the three-dimensional model parameters of the currently rendered target three-dimensional virtual image are adjusted according to the difference parameters to generate a first dynamic three-dimensional virtual image consistent with the action of the target object. The somatosensory input information may include multiple motion features of the target object, and the somatosensory input information may also include the motion trajectory of each motion feature, so that the three-dimensional model parameters of the currently rendered target three-dimensional virtual image can be adjusted through the somatosensory input information to determine the three-dimensional model parameters of the target three-dimensional virtual image at the next moment, that is, the three-dimensional model parameters of the next target three-dimensional virtual image to be rendered, wherein the three-dimensional model parameters may refer to the posture data of the target three-dimensional virtual image, for example, the position data of each motion feature (such as head, elbow, knee, wrist and knee, etc.) of the target three-dimensional virtual image, etc., which can determine the motion posture data of the target three-dimensional virtual image. Then, by comparing the three-dimensional model parameters of the currently rendered target three-dimensional virtual image and the next target three-dimensional virtual image to be rendered, the difference parameters and the corresponding difference parameter amount between the two are determined, that is, whether the currently rendered target three-dimensional virtual object can be reused, and the proportion of the currently rendered target three-dimensional virtual object that can be reused is determined. If the difference parameter amount is less than or equal to the preset parameter amount threshold, it means that the action posture of the currently rendered target three-dimensional virtual object and the action posture of the next rendered target three-dimensional virtual object are slightly different, and the target three-dimensional virtual object can be modified and reused on the basis of the currently rendered target three-dimensional virtual object. Therefore, the difference parameters (i.e., the action features in the next rendered target three-dimensional virtual object that are different from the action features of the currently rendered target three-dimensional virtual object) and the corresponding difference parameter amounts can be used to adjust the three-dimensional model parameters of the currently rendered target three-dimensional virtual image, so as to generate a first dynamic three-dimensional virtual image consistent with the action of the target object by reusing the three-dimensional model parameters of the rendered target three-dimensional virtual image. Since the three-dimensional model parameters of the rendered three-dimensional model are reused, there is no need to repeatedly load the rendered three-dimensional model, which can take into account both rendering efficiency and rendering quality, improve rendering efficiency while ensuring rendering quality, reduce data processing volume, and alleviate rendering pressure.

[0122] In one embodiment, in the process of generating a first dynamic three-dimensional virtual image consistent with the target object action according to the somatosensory input information and the target three-dimensional virtual image, the following steps may also be included: when the difference parameter amount is greater than the preset parameter amount threshold, the target three-dimensional virtual image is re-rendered according to the three-dimensional model parameters of the next target three-dimensional virtual image to be rendered, so as to obtain the first dynamic three-dimensional virtual image consistent with the target object action. The difference parameter amount is used to judge the difference between the next target three-dimensional virtual image to be rendered and the currently rendered target three-dimensional virtual image. If the difference parameter amount is greater than the preset parameter amount threshold, it means that the action posture of the currently rendered target three-dimensional virtual object and the action posture of the next rendered target three-dimensional virtual object are greatly different. For example, when the target three-dimensional virtual object performs a turning action, it is difficult to modify and reuse it based on the currently rendered target three-dimensional virtual object, so it is necessary to regenerate and render the target three-dimensional virtual image. Therefore, the target three-dimensional virtual image is re-rendered using the three-dimensional model parameters of the next target three-dimensional virtual image to be rendered, so that the action of the obtained first dynamic three-dimensional virtual image can be consistent with the action of the target object, thereby ensuring the accuracy and aesthetics of the first dynamic three-dimensional virtual image and improving the user experience.

[0123] In one embodiment, when obtaining the 3D model parameters of the next target 3D virtual image to be rendered based on the somatosensory input information and the 3D model parameters of the currently rendered target 3D virtual image, the following steps may be included: first, the action parameters of the target object are obtained based on the somatosensory input information; then, the 3D model parameters of the next target 3D virtual image to be rendered are calculated based on the action parameters and the 3D model parameters of the currently rendered target 3D virtual image. The somatosensory input information may include the action posture of the target object, and the action of the target object in the somatosensory input information is obtained through motion recognition technology, and then the action parameters of the target object are captured. The action parameters may refer to the relevant data of the action features of the target object (such as human joints), or may refer to the motion trajectory data of each action feature of the target object. Since the action parameters of the target object can reflect the action posture of the target object, when the action posture of the currently rendered target three-dimensional virtual object is significantly different from the action posture of the next rendered target three-dimensional virtual object, the action parameters of the target object and the three-dimensional model parameters of the currently rendered target three-dimensional virtual image can be used to re-determine the three-dimensional model parameters of the next target three-dimensional virtual image to be rendered, that is, determine the action posture of the next target three-dimensional virtual image to be rendered, and the action posture of the next target three-dimensional virtual image to be rendered is consistent with the action posture of the target object.

[0124] In one embodiment, in the process of calling the video recording function in the client to record the first dynamic three-dimensional virtual image and obtain the first target video, the following steps may be included: first, calling the video recording function in the client to record the first dynamic three-dimensional virtual image based on the binary large object format to obtain a candidate video; then, calling the video format conversion function in the client to convert the candidate video into a format based on a text string to obtain the first target video. The binary large object format may be a Blob format, which is a binary data type. The Blob format can be suitable for the storage of text and binary data. Since Blob format objects are usually used to process large files, such as images, audio and video files, etc., the video recording function in the client may be called to use the video recording interface of the Babylon framework to record the first dynamic three-dimensional virtual image based on the Blob format to obtain a candidate video in the Blob format. Then, the video format conversion function is called again to convert the candidate video in the Blob format into the first target video in the Base64 format. The Base64 format is a binary to text encoding method, that is, a format based on a text string. The Base64 format can convert binary data into an ASCII character set, which is convenient for uploading or storing data. At the same time, since the video interfaces of different clients are different, the data formats of the recorded videos may be different. Therefore, the video format conversion function can convert candidate videos of different data formats into a first target video of a unified data format, which facilitates the server to perform subsequent video data processing and improves the processing efficiency of user-generated content.

[0125] For example, refer to Figure 7 , Figure 7 It is an optional process diagram of rendering and recording of the first target video provided by an embodiment of the present application. It can be seen that after opening the page to be rendered in the Chrome browser, step 701 can be executed to render the first dynamic three-dimensional virtual image; after rendering to obtain the first dynamic three-dimensional virtual image, step 702 can be executed to record the video of the first dynamic three-dimensional virtual image to obtain a candidate video, and then, step 703 is executed to convert the candidate video into Base64 format to generate the first target video. After the first target video is generated, step 704 can be executed to send the first target video to the server so that the server can perform subsequent user-generated content production processing on the first target video. At the same time, a signal can also be sent to execute step 705 on the client to call the function console to record audio data. When the audio data recording is completed or there is no need to record audio data, step 706 can be executed to close the Chrome browser to save resources.

[0126] For example, refer to Figure 8 , Figure 8 It is an optional process diagram of client rendering to generate the first target video provided by an embodiment of the present application. It can be seen that step 801 can be executed first to call the function puppeteer.launch() in the client, and then step 802 can be executed to open the Chrome browser. After opening the Chrome browser, step 803 can be executed to call the function browser.newPage() to create a new blank page in the Chrome browser. If the opening time of the Chrome browser exceeds the preset timing time, it can be considered that the call to the browser startup function has timed out, and step 805 can be executed to close the Chrome browser to save resources. After opening the page to be rendered in the Chrome browser, step 806 can be executed to render the first dynamic three-dimensional virtual image; after rendering the first dynamic three-dimensional virtual image, step 807 can be executed to record the first dynamic three-dimensional virtual image to obtain a candidate video, and then step 808 can be executed to convert the candidate video into Base64 format to generate the first target video. After generating the first target video, step 809 can be executed to send the first target video to the server so that the server can perform subsequent user-generated content production processing on the first target video. At the same time, a signal can be sent to execute step 804 on the client to call the console function to record audio data, or the audio data can be recorded after calling the browser.newPage() function to create a new blank page; when the audio data recording is completed or there is no need to record audio data, the Chrome browser can be closed to save resources.

[0127] In one embodiment, when sending the first target video to the server so that the server generates user-generated content according to the first target video, the following steps may be included: first, the audio data of the target object is obtained according to the somatosensory input information; then, the first target video and the audio data are sent to the server so that the server performs audio and video synthesis according to the first target video and the audio data to obtain the user-generated content. The client that initiates the rendering can be determined according to the somatosensory input information, and then the audio data initiated by the target object is received through the client, wherein the audio data can be generated by the following steps: after receiving the somatosensory input information, the client calls the browser startup function to open the browser, and then calls the audio recording function in the browser to perform audio detection and recording, and when an audio signal is detected, the audio signal is received as the audio data of the target object. Therefore, after obtaining the audio data and the first target video, the audio data and the first target data can be sent to the server so that the server uses the first target video and the audio data to perform audio and video synthesis to generate user-generated content, and by combining video and audio, the richness of the user-generated content is improved, and the user experience is improved.

[0128] For example, refer to Fig. 9 , Fig. 9 It is an optional flow chart of a simplified production process of user-generated content provided by an embodiment of the present application. It can be seen that the target object initiates a request to produce user-generated content through the client, and the client executes step 901 to generate a first dynamic three-dimensional virtual image, and then executes step 902 through the client to record the first dynamic three-dimensional virtual image to generate a first target video; at the same time, the client can also execute step 903 while executing step 901 to open the activity page. After opening the activity page, the client can execute step 904 to record audio data. After obtaining the audio data and the first target video, both can be sent to the server, and the server synthesizes the audio data and the first target video to produce user-generated content, and returns the user-generated content to the client. Therefore, 905 can be executed on the client to obtain and view the produced user-generated content, and the target object can also determine whether to publish the UGC work.

[0129] For example, refer to Fig.10 , Fig.10It is an optional flow chart of the overall production process of user-generated content provided by the embodiment of the present application. It can be seen that the overall production process of user-generated content is divided into the rendering process of the client and the synthesis process of the server. After receiving the input information, the client can execute step 1001 to call the function puppeteer.launch(), so as to realize the opening of the Chrome browser in step 1002, and then execute step 1003 to create a new blank page in the Chrome browser. If the opening time of the Chrome browser exceeds the preset timing time, it can be considered that the call to the browser startup function has timed out, and step 1005 can be executed to close the Chrome browser to save resources. After opening the page to be rendered in the Chrome browser, step 1006 can be executed to render the first dynamic three-dimensional virtual image; after rendering the first dynamic three-dimensional virtual image, step 1007 can be executed to record the video of the first dynamic three-dimensional virtual image to obtain a candidate video, and then the candidate video is converted into Base64 format to generate a first target video. After obtaining the first target video, the client can send the first target video to the server through a POST request. The server may pre-execute step 1010 to build a web service, and then the server executes step 1011 to receive the first target video sent by the client through the web server. Then, after receiving the first target video, the server executes step 1012 to pre-process the first target video for UGC production, and then the server executes step 1013 to generate video material for producing UGC from the pre-processed first target video. After the server obtains the UGC video material, it may execute step 1014 to generate a UGC work using the video material. After generating the UGC work, the server sends the UGC work to the client. After receiving the UGC work, the client executes step 1015 to display the UGC work on the client.

[0130] In one embodiment, in the process of generating a first dynamic three-dimensional virtual image consistent with the action of the target object according to the input information, the following steps may be included: first, the rendering capability supported by the client is detected; then, when the rendering capability supported by the client meets the preset rendering conditions, the first dynamic three-dimensional virtual image consistent with the action of the target object is generated according to the input information. Since the server has better configuration and better resources, and the server is more controllable, the relevant technology renders the three-dimensional interactive image in the server to obtain the rendering result, and then creates the user-generated content according to the rendering result, and then sends the user-generated content to the user side for display, and the user side decides whether to publish the user-generated content. However, this processing method in the relevant technology will greatly increase the processing pressure of the server, thereby affecting the processing effect of the server on the user-generated content. If the three-dimensional interactive image is rendered by the client, and the video material generated by the three-dimensional interactive image is used in the client to generate the user-generated content, that is, the entire generation process of the user-generated content is implemented in the client, it will be affected by the hardware configuration and resource limitations of the client, resulting in low effect of the user-generated content. Therefore, by combining the server-generated user content and the client-generated user content, the rendering capabilities supported by the client are judged to determine whether the rendering capabilities of the client meet the preset rendering conditions. When the rendering capabilities supported by the client meet the preset rendering conditions, it can be considered that the client can be used to generate pre-data of user-generated content that meets the quality requirements, and then these pre-data are sent to the server for production and processing, thereby alleviating the data processing pressure on the server.

[0131] In one embodiment, referring to Fig.11 , Fig.11 An optional schematic diagram of the rendering capability detection content provided by the embodiment of the present application is shown. It can be seen that the rendering capability may include at least one of the following parameters: client operating system, browser version, client version, client performance, HTML MediaRecorder support, and HTMLCanvas.captureStream() support; accordingly, the rendering condition may be a specific restriction requirement on the rendering capability, for example, requiring the client's browser version to be the latest version, or requiring the client to support HTMLMediaRecorder, etc., which is not specifically limited in the embodiment of the present application.

[0132] In one embodiment, the method for processing user-generated content further includes: firstly detecting the rendering capability supported by the client; when the rendering capability supported by the client does not meet the preset rendering condition, sending input information to the server, so that the server generates user-generated content according to the input information, wherein the user-generated content is generated by the server according to the second target video, the second target video is obtained by the server calling the video recording function to record the second dynamic three-dimensional virtual image, the second dynamic three-dimensional virtual image is generated by the server according to the input information, and the second dynamic three-dimensional virtual image is consistent with the action of the target object; then, receiving the user-generated content sent by the server. By judging whether the rendering capability supported by the client meets the preset rendering condition, if the rendering capability supported by the client does not meet the preset rendering condition, it can be considered that it is difficult to render the three-dimensional virtual image and the target video and other user-generated content pre-data that meet the requirements using the client, therefore, after receiving the input information initiated by the target object, the client forwards the input information to the server, and the server processes the input information to generate user-generated content, thereby ensuring the production quality and production efficiency of the user-generated content.

[0133] In one embodiment, after receiving the input information, the server can generate a second dynamic virtual image consistent with the target object according to the input information. Since the input information can include the action data or posture data of the target object, the server can identify the target object from the input information, and then extract the action features of the target object from the input information. For example, the target object (i.e., the character object) can be identified from the input information using object recognition technology, and then the action features of the target object can be extracted. It should be noted that the input information can include the action features of the target object. Then, after obtaining the action features of the target object, the action features in the input information can be identified, the motion trajectory of each action feature can be determined, and then the motion trajectory of each action feature can be converted into the motion trajectory of the action feature corresponding to the second dynamic three-dimensional virtual image. For example, the action of the target object can be identified from the input information using motion recognition technology, and then the action of the target object in the input information can be reproduced with the second dynamic three-dimensional virtual image, so that the action state of the target object in the input information can be applied to the second dynamic three-dimensional virtual image, and a second dynamic three-dimensional virtual image consistent with the action of the target object can be generated.

[0134] In one embodiment, the action feature information of the target object carried in the input information is used to construct the action feature information of the second dynamic three-dimensional virtual image, so that the action of the second dynamic three-dimensional virtual image is consistent with the action of the target object. Since the second dynamic three-dimensional virtual image can be constructed by the action features of the target object, the action features of the target object are generally human joints, such as the top of the head, heels, elbows and other landmarks. In the embodiment of the present application, the action features of the second dynamic three-dimensional virtual image can be adjusted according to its own image characteristics. Therefore, the position of the action features of the second dynamic three-dimensional virtual image can be the same as or different from the position of the action features of the target object. When the position of the action features of the second dynamic three-dimensional virtual image is different from the position of the action features of the target object, the corresponding action features can be used for replacement, and the motion trajectory between the two action features can be estimated to enable the second dynamic three-dimensional virtual image to replace the target object in the input information with the corresponding action. The embodiment of the present application does not specifically limit this.

[0135] In one embodiment, the second dynamic three-dimensional virtual image can be used in 3D display scenes of interactive images such as interactive 2.5D games, interactive 3D games, interactive 3D scenes, cartoon 3D scenes, etc., and the embodiment of the present application does not make specific limitations on this.

[0136] In one embodiment, after rendering and generating the second dynamic three-dimensional virtual image, the server may call a video recording function to record the second dynamic three-dimensional virtual image to obtain a second target video. It should be noted that the video recording function called by the server may be stored in the server, and the video recording function called by the client may be stored in the client. Among them, the video recording function stored in the server may be one or more functions for performing video recording of the second dynamic three-dimensional virtual image. The video recording function may be used to control the browser (such as a Headless Chrome browser or a Chrome browser) and drive the 3D renderer (such as a WebGL renderer) in the browser to perform three-dimensional rendering and recording of the second dynamic three-dimensional virtual image to generate a second target video. The second target video may refer to the dynamic motion process generated by rendering the second dynamic three-dimensional virtual image according to the motion trajectory of each action feature of the target object in the input information. The picture displayed in the second target video may be the picture of the second dynamic three-dimensional virtual image replacing the target object in the input information, that is, the action of the second dynamic three-dimensional virtual image is consistent with the action of the target object. Since some clients with insufficient rendering capabilities render (capture pictures) the first dynamic three-dimensional virtual image or the second dynamic three-dimensional virtual image through the "camera" of the 3D rendering framework interface method and output picture sequence frames, and some clients with insufficient rendering capabilities find it difficult to support high-frequency picture acquisition, the quality of the three-dimensional video image generated by rendering is too low, and only a video of carousel images can be generated, and the image carousel effect is poor; therefore, using the server to execute the task of producing the second target video of the second dynamic three-dimensional virtual image can generate a three-dimensional video with better image quality when the client's rendering capability is insufficient.

[0137] In one embodiment, in the process of generating a second dynamic three-dimensional virtual image consistent with the action of the target object according to the input information, the following steps may be included: the server first calls the browser startup function to start the browser in headless mode, and renders the target three-dimensional virtual image in the browser's to-be-rendered page; then, based on the somatosensory input information and the target three-dimensional virtual image, a first dynamic three-dimensional virtual image consistent with the action of the target object is generated. Wherein, the input information includes somatosensory input information, and the somatosensory input information may be data used to characterize the action state of the target object. For example, the somatosensory input information may be the motion trajectory of each action feature of the target object, or may be the posture information of the target object at each time node. It should be noted that the browser startup function may be a Puppeteer function, such as the function puppeteer.launch(), and the browser startup function may be used to start a headless browser. A headless browser refers to a browser without a graphical user interface. A headless browser may access a web page by rendering the page in memory and then sending the result back to the request server without displaying the web page on the screen, so that the target three-dimensional virtual image may be rendered in the background. By calling the Puppeteer function on the server to start the browser, and then using the Babylon framework to use the WebGL renderer for rendering, the rendering effect of complex three-dimensional images can be improved. Compared with executing the rendering process on the client, executing the rendering process on the server has the advantage of a controllable environment, which can reduce the differences in the target videos generated due to different clients, and avoid compatibility issues caused by different clients and inconsistent data formats of the target videos generated by recording.

[0138] In one embodiment, the server can call a video recording function to perform video recording based on a binary large object format on the second dynamic three-dimensional virtual image to obtain a candidate video; then, call a video format conversion function to perform a text string format conversion on the candidate video to obtain a second target video; the server can also directly perform video recording based on a text string format on the second dynamic three-dimensional virtual image to obtain the second target video, thereby eliminating the need to convert the video format.

[0139] In one embodiment, after receiving the somatosensory input information, the server generates an audio recording signal for calling an audio recording function according to the somatosensory input information, and sends the signal to the client, so that the client calls the audio recording function and records the audio data of the target object. For example, the audio recording duration is determined according to the data volume of the somatosensory input information, or the audio type or content that needs to be recorded and the audio information that matches the somatosensory input information are sorted and merged into an audio recording signal, and a prompt is sent to the target object through the client to record the matching audio data, so that the audio data matches the target video, thereby improving the quality of the user-generated content. After the client obtains the audio data, the audio data can be sent to the server, so that the server can use the second target video and the audio data to perform audio and video synthesis to generate user-generated content. By combining video and audio, the richness of the user-generated content is improved, and the user experience is improved.

[0140] In one embodiment, referring to Fig.12 , Fig.12An optional flow chart of UGC rendering performed by the server provided in an embodiment of the present application is shown. It can be seen that after receiving the input information, the server executes step 1201 in the server and calls the function puppeteer.launch(), so that step 1202 can be executed to open the Chrome browser, and then step 1203 is executed to call the function browser.newPage() to create a new blank page in the Chrome browser. If the opening time of the Chrome browser exceeds the preset timing time, it can be considered that the call to the browser startup function has timed out, and step 1205 can be executed to close the Chrome browser to save resources. After opening the page to be rendered in the Chrome browser, step 1206 can be executed to render the second dynamic three-dimensional virtual image; after rendering the second dynamic three-dimensional virtual image, step 1207 can be executed to record the second dynamic three-dimensional virtual image to obtain a candidate video, and then step 1208 is executed to convert the candidate video into Base64 format to generate a second target video. After the second target video is generated, a signal can be sent to execute step 1205 in the client, calling the function console to record the audio data, or calling the function browser.newPage() to create a new blank page to record the audio data in the client; when the audio data recording is completed or there is no need to record the audio data, the Chrome browser can be closed to save resources. After obtaining the second target video, step 1210 is then executed to pre-process the second target video for UGC production, and then step 1211 is executed to generate the video material for UGC production from the pre-processed second target video, so that step 1212 can be executed to use these video materials to produce UGC works, and after the UGC works are generated, the UGC works are returned to the client.

[0141] In one embodiment, referring to Fig.13 , Fig.13An optional flow diagram of a rendering process initiated by a client with different rendering capabilities provided in an embodiment of the present application is shown. It can be seen that the client can receive input information initiated by the target object in the active page, and can obtain audio data through the displayed active page. Therefore, after the client executes step 1301 and opens the active page, step 1302 can be executed to detect and judge the rendering capabilities supported by the client. When the rendering capabilities supported by the client meet the preset rendering conditions, step 1305 can be executed to execute the rendering process of the three-dimensional virtual image in the client to obtain the target video of the three-dimensional virtual image, and then the video format of the target video is converted and uploaded to the server, and the server executes step 1306 to use the target video to perform the production and synthesis process of user-generated content until the user-generated content is obtained; when the rendering capability supported by the client does not meet the preset rendering conditions, the input information can be forwarded to the server after receiving the input information, and the server executes step 1303 to execute the rendering process of the three-dimensional virtual image to obtain the target video of the three-dimensional virtual image, and continue to execute step 1304 to use the target video to perform the production and synthesis process of user-generated content until the user-generated content is obtained. It should be noted that the synthesis process executed by the server in step 1304 and the synthesis process executed by the server in step 1306 may be the same or different.

[0142] The following is a detailed description of the method for processing user-generated content provided in the embodiments of the present application using specific examples.

[0143] Reference Fig.14 As shown, Fig.14 is an overall flow chart of a method for processing user-generated content provided by a specific example. Fig.14 In the method for processing the user-generated content, the method may include but is not limited to steps 1401 to 1413.

[0144] Step 1401: Determine whether a triggering operation for triggering the production of user-generated content is detected, if so, execute step 1402, if not, execute step 1401.

[0145] In this step, the triggering operation for triggering the production of user-generated content may be a touch operation, a voice operation, or a somatosensory operation, etc., which is not specifically limited here. For example, when the triggering operation is a touch operation, the user may touch (such as click or slide) the production button in the interface displayed by the terminal to trigger the production of user-generated content; when the triggering operation is a voice operation, the terminal may obtain the user's voice command through a microphone or other sound pickup device to trigger the production of user-generated content; when the touch operation is a somatosensory operation, the terminal may capture the user's somatosensory action through a camera or other shooting device to trigger the production of user-generated content.

[0146] Step 1402: receiving input information initiated by the user for producing user-generated content through the client, and detecting the rendering capability supported by the client.

[0147] In this step, the input information may include somatosensory input information, wherein the somatosensory input information may include the user's motion parameters and audio data.

[0148] Step 1403: Determine whether the rendering capability supported by the client meets the preset rendering conditions. If so, execute step 1404; if not, execute step 1412.

[0149] Step 1404: Call the browser startup function to start the browser in headless mode, and detect the idle pages in the browser.

[0150] Step 1405: Determine whether there is an idle page opened in the browser. If so, execute step 1406; if not, execute step 1407.

[0151] Step 1406 : Load the content of the opened idle page to obtain the page to be rendered, then render the target three-dimensional virtual image in the page to be rendered, and then execute step 1408 .

[0152] Step 1407: Call the page creation function to create a blank page in the browser, and load the content into the blank page to obtain a page to be rendered, then render the target three-dimensional virtual image in the page to be rendered, and then execute step 1408.

[0153] Step 1408: Generate a first dynamic three-dimensional virtual image consistent with the user's action based on the target three-dimensional virtual image and the somatosensory input information in the input information.

[0154] In this step, in the process of generating a first dynamic three-dimensional virtual image according to the somatosensory input information and the target three-dimensional virtual image, the three-dimensional model parameters of the next target three-dimensional virtual image to be rendered can be obtained according to the somatosensory input information and the three-dimensional model parameters of the currently rendered target three-dimensional virtual image, and then the difference parameters and the difference parameter amount between the currently rendered target three-dimensional virtual image and the next target three-dimensional virtual image to be rendered can be determined according to the three-dimensional model parameters of the currently rendered target three-dimensional virtual image and the three-dimensional model parameters of the next target three-dimensional virtual image to be rendered. When the difference parameter amount is not greater than the preset parameter amount threshold, it means that the next target three-dimensional virtual image to be rendered has a relatively small degree of change compared with the currently rendered target three-dimensional virtual image. Therefore, the currently rendered target three-dimensional virtual image can be rendered. Most of the parameters of the virtual image are reused, so as to save the rendering time of the next target three-dimensional virtual image to be rendered and improve the rendering efficiency. Therefore, the three-dimensional model parameters of the currently rendered target three-dimensional virtual image can be adjusted according to the difference parameters to generate a first dynamic three-dimensional virtual image consistent with the user action; when the difference parameter amount is greater than the preset parameter amount threshold, it means that the next target three-dimensional virtual image to be rendered has a larger degree of change compared with the currently rendered target three-dimensional virtual image, and the rendering efficiency cannot be improved by reusing most of the parameters of the currently rendered target three-dimensional virtual image. Therefore, it is necessary to re-render the target three-dimensional virtual image according to the three-dimensional model parameters of the next target three-dimensional virtual image to be rendered to obtain the first dynamic three-dimensional virtual image consistent with the user action.

[0155] Among them, in the process of obtaining the three-dimensional model parameters of the next target three-dimensional virtual image to be rendered based on the somatosensory input information and the three-dimensional model parameters of the currently rendered target three-dimensional virtual image, the user's action parameters can be first obtained based on the somatosensory input information, and then the three-dimensional model parameters of the next target three-dimensional virtual image to be rendered can be calculated based on the action parameters and the three-dimensional model parameters of the currently rendered target three-dimensional virtual image.

[0156] Step 1409: Call the video recording function in the client to perform video recording based on the binary large object format on the first dynamic three-dimensional virtual image to obtain a candidate video.

[0157] Step 1410: Call the video format conversion function in the client to perform text string-based format conversion on the candidate video to obtain a first target video.

[0158] Step 1411: Acquire the user's audio data according to the somatosensory input information, and then send the first target video and audio data to the server, so that the server performs audio and video synthesis according to the first target video and audio data to obtain user-generated content, and then execute step 1413.

[0159] Step 1412: Send the input information to the server, so that the server generates user-generated content according to the input information, and then execute step 1413.

[0160] In this step, the input information may include somatosensory input information, wherein the somatosensory input information may include user action parameters and audio data. When the server generates user-generated content according to the input information, it may first generate a second dynamic three-dimensional virtual image consistent with the user action according to the user action parameters in the somatosensory input information, then call a video recording function to record the second dynamic three-dimensional virtual image to obtain a second target video, and then add the user's audio data to the second target video to generate user-generated content.

[0161] Step 1413: receiving the user generated content sent by the server, and displaying the user generated content sent by the server.

[0162] In this embodiment, through the method for processing user-generated content including the previous steps 1401 to 1413, by determining whether the rendering capabilities supported by the client meet the preset rendering conditions, it is possible to choose to cooperate between the client and the server to realize the production of user-generated content, or to choose to realize the production of user-generated content by the server, thereby effectively adapting the rendering capabilities supported by the client in the terminal, which can not only improve the production quality of user-generated content, but also improve the flexibility of producing user-generated content.

[0163] Among them, when the method of cooperating between the client and the server is selected to realize the production of user-generated content, when the input information for producing user-generated content initiated by the target object is received through the client, a first dynamic three-dimensional virtual image consistent with the action of the target object is first generated in the client according to the input information, and then the video recording function in the client is called to record the video of the first dynamic three-dimensional virtual image to obtain the first target video. Since the generation of the first dynamic three-dimensional virtual image and the recording of the first target video are both completed in the client, the client can share part of the work of the server, thereby reducing the processing pressure of the server on the user-generated content; after obtaining the first target video in the client, the first target video is sent to the server, so that the server can use its better configuration and better resources to generate user-generated content according to the first target video, so that the creation of the user-generated content can be completed in the server. That is to say, the embodiment of the present application transfers the rendering of the three-dimensional interactive image and the creation of the user-generated content completed by the server in the related technology to the client, so the client can be used to reduce the processing pressure of the server on the user-generated content, thereby improving the processing effect of the server on the user-generated content. In addition, after the first target video is obtained in the client, the first target video will be sent to the server for subsequent creation and processing of user-generated content. Therefore, even if the video formats of the first target videos generated by different clients are different, after the server creates and processes the user-generated content, user-generated content with a unified format can be obtained. Therefore, the compatibility problem of the underlying interface of MediaRecorder due to different browser versions when the browser is used to create user-generated content in the related art can be overcome, and the problem of inconsistent format of the user-generated content due to different terminal models when the client is used to create user-generated content in the related art can be overcome.

[0164] The following are some practical examples to illustrate the application scenarios of the embodiments of the present application.

[0165] It should be noted that the method for processing user-generated content provided in the embodiments of the present application can be applied to different application scenarios such as producing and promoting user-generated content, producing and testing user-generated content, etc. The following will be explained using the scenarios of producing and promoting user-generated content and producing and testing user-generated content as examples.

[0166] Scene 1

[0167] The method for processing user-generated content provided in the embodiment of the present application can be applied to the scenario of producing and promoting user-generated content. For example, assuming that a user produces and promotes user-generated content through a client in a terminal, the terminal will receive input information initiated by the user for producing user-generated content through the client, wherein the input information may include user action parameters and audio data, etc. At this time, the terminal will generate a first dynamic three-dimensional virtual image consistent with the user action in the client according to the user action parameters in the input information, and then call the video recording function in the client to record the first dynamic three-dimensional virtual image to obtain a first target video. Then, the terminal sends the first target video and the user's audio data in the input information to the server. After the server receives the first target video and audio data, the server adds the audio data to the first target video to generate the user-generated content, and then sends the user-generated content to the terminal. After the terminal receives the user-generated content, the terminal will display the user-generated content through the client, and the terminal will save and promote the user-generated content in response to the user's publishing operation on the user-generated content.

[0168] Scene 2

[0169] The method for processing user-generated content provided in the embodiment of the present application can also be applied to the scenario of producing and testing user-generated content. For example, assuming that a tester produces and tests user-generated content through a client in a terminal, the terminal will receive input information initiated by the tester for producing user-generated content through the client, wherein the input information may include action parameters and audio data of the tester, etc. At this time, the terminal will generate a first dynamic three-dimensional virtual image consistent with the tester's action in the client according to the action parameters of the tester in the input information, and then call the video recording function in the client to record the first dynamic three-dimensional virtual image to obtain a first target video. Then, the terminal sends the first target video and the audio data of the user in the input information to the server. After the server receives the first target video and the audio data, the server adds the audio data to the first target video to generate the user-generated content, and then sends the user-generated content to the terminal. After the terminal receives the user-generated content, the terminal will display the user-generated content through the client. At this time, the tester can perform test analysis based on the user-generated content displayed by the client to determine whether the display effect of the user-generated content reaches the expected effect.

[0170] It is to be understood that, although the steps in the above-mentioned various flow charts are shown in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in the present embodiment, the execution of these steps does not have a strict order restriction, and these steps can be performed in other orders. Moreover, at least a portion of the steps in the above-mentioned flow charts can include a plurality of steps or a plurality of stages, and these steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of the steps or stages in other steps or other steps.

[0171] Reference Fig.15 The embodiment of the present application further discloses a user-generated content processing device. The user-generated content processing device 1500 can implement the user-generated content processing method in the previous embodiment. The user-generated content processing device 1500 includes:

[0172] The information receiving unit 1510 is used to receive input information for making user-generated content initiated by a target object through a client;

[0173] The image generation unit 1520 is used to generate a first dynamic three-dimensional virtual image consistent with the target object's action in the client according to the input information;

[0174] The video recording unit 1530 is used to call the video recording function in the client to record the first dynamic three-dimensional virtual image to obtain a first target video;

[0175] The video sending unit 1540 is configured to send the first target video to the server, so that the server generates user-generated content according to the first target video;

[0176] The first content receiving unit 1550 is configured to receive user generated content sent by the server.

[0177] In one embodiment, the input information includes somatosensory input information; the image generation unit 1520 is further used to:

[0178] Calling a browser startup function to start the browser in headless mode, and rendering a target three-dimensional virtual image in a to-be-rendered page of the browser;

[0179] A first dynamic three-dimensional virtual image consistent with the target object's action is generated according to the somatosensory input information and the target three-dimensional virtual image.

[0180] In one embodiment, the image generation unit 1520 is further configured to:

[0181] Detect idle pages in the browser;

[0182] When it is detected that there is an idle page opened in the browser, the content of the opened idle page is loaded to obtain a page to be rendered;

[0183] Rendering a target three-dimensional virtual image in the page to be rendered.

[0184] In one embodiment, the image generation unit 1520 is further configured to:

[0185] Detect idle pages in the browser;

[0186] When it is detected that there is no idle page opened in the browser, the page creation function is called to create a blank page in the browser;

[0187] Load the content of the blank page to obtain the page to be rendered;

[0188] Rendering a target three-dimensional virtual image in the page to be rendered.

[0189] In one embodiment, the image generation unit 1520 is further configured to:

[0190] Obtaining the 3D model parameters of the next target 3D virtual image to be rendered according to the somatosensory input information and the 3D model parameters of the currently rendered target 3D virtual image;

[0191] Determine, according to the 3D model parameters of the currently rendered target 3D virtual image and the 3D model parameters of the next target 3D virtual image to be rendered, the difference parameters and the difference parameter amounts between the currently rendered target 3D virtual image and the next target 3D virtual image to be rendered;

[0192] When the difference parameter amount is not greater than the preset parameter amount threshold, the 3D model parameters of the currently rendered target 3D virtual image are adjusted according to the difference parameters to generate a first dynamic 3D virtual image consistent with the target object action.

[0193] In one embodiment, the image generation unit 1520 is further configured to:

[0194] When the difference parameter amount is greater than the preset parameter amount threshold, the target 3D virtual image is re-rendered according to the 3D model parameters of the next target 3D virtual image to be rendered to obtain a first dynamic 3D virtual image consistent with the target object action.

[0195] In one embodiment, the image generation unit 1520 is further configured to:

[0196] Obtaining action parameters of the target object according to the somatosensory input information;

[0197] The three-dimensional model parameters of the next target three-dimensional virtual image to be rendered are calculated according to the action parameters and the three-dimensional model parameters of the currently rendered target three-dimensional virtual image.

[0198] In one embodiment, the video recording unit 1530 is further configured to:

[0199] Calling a video recording function in the client to perform video recording based on a binary large object format on the first dynamic three-dimensional virtual image to obtain a candidate video;

[0200] The video format conversion function in the client is called to perform text string-based format conversion on the candidate video to obtain the first target video.

[0201] In one embodiment, the input information includes somatosensory input information; the video sending unit 1540 is further used to:

[0202] Acquire audio data of the target object according to the somatosensory input information;

[0203] The first target video and audio data are sent to the server, so that the server performs audio and video synthesis according to the first target video and audio data to obtain user-generated content.

[0204] In one embodiment, the image generation unit 1520 is further configured to:

[0205] Detect the rendering capabilities supported by the client;

[0206] When the rendering capability supported by the client meets the preset rendering conditions, a first dynamic three-dimensional virtual image consistent with the action of the target object is generated according to the input information.

[0207] In one embodiment, the user-generated content processing device 1500 further includes:

[0208] A capability detection unit, used to detect the rendering capability supported by the client;

[0209] an information sending unit, configured to send input information to a server when the rendering capability supported by the client does not meet a preset rendering condition, so that the server generates user-generated content according to the input information, wherein the user-generated content is generated by the server according to a second target video, the second target video is obtained by the server calling a video recording function to record a second dynamic three-dimensional virtual image, the second dynamic three-dimensional virtual image is generated by the server according to the input information, and the second dynamic three-dimensional virtual image is consistent with an action of the target object;

[0210] The second content receiving unit is used to receive user-generated content sent by the server.

[0211] It should be noted that since the user-generated content processing device 1500 of this embodiment can implement the user-generated content processing method of the previous embodiment, the user-generated content processing device 1500 of this embodiment and the user-generated content processing method of the previous embodiment have the same technical principles and the same beneficial effects, and in order to avoid duplication of content, they will not be repeated here.

[0212] Reference Fig.16 The embodiment of the present application further discloses a user-generated content processing device, the user-generated content processing device 1600 includes:

[0213] at least one processor 1601;

[0214] At least one memory 1602, used to store at least one program;

[0215] When at least one program is executed by at least one processor 1601 , the above method for processing user-generated content is implemented.

[0216] The embodiment of the present application further discloses a computer-readable storage medium, which stores a computer program executable by a processor. When the computer program executable by the processor is executed by the processor, it is used to implement the method for processing user-generated content as described above.

[0217] An embodiment of the present application also discloses a computer program product, including a computer program or computer instructions, wherein the computer program or computer instructions are stored in a computer-readable storage medium, and a processor of a user-generated content processing device reads the computer program or computer instructions from the computer-readable storage medium, and the processor executes the computer program or computer instructions, so that the user-generated content processing device performs the user-generated content processing method as described above.

[0218] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein, for example. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0219] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0220] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0221] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0222] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0223] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store program codes.

[0224] The step numbers in the above method embodiment are only provided for the convenience of explanation and description, and no limitation is imposed on the order of the steps. The execution order of each step in the embodiment can be adaptively adjusted according to the understanding of those skilled in the art.

Claims

1. A method for processing user-generated content, It is characterized in that The following steps are involved: receiving, through the client, input information initiated by the target object for producing user-generated content; In the client, a first dynamic three-dimensional virtual image consistent with the action of the target object is generated according to the input information; Calling a video recording function in the client to record the first dynamic three-dimensional virtual image to obtain a first target video; Sending the first target video to a server, so that the server generates the user-generated content according to the first target video; The user generated content sent by the server is received.

2. The method according to claim 1, It is characterized in that The input information includes somatosensory input information; and generating a first dynamic three-dimensional virtual image consistent with the action of the target object according to the input information includes: Calling a browser startup function to start the browser in a headless mode, and rendering a target three-dimensional virtual image in a to-be-rendered page of the browser; A first dynamic three-dimensional virtual image consistent with the action of the target object is generated according to the somatosensory input information and the target three-dimensional virtual image.

3. The method according to claim 2, It is characterized in that The rendering of the target three-dimensional virtual image in the to-be-rendered page of the browser includes: Detecting idle pages in the browser; When it is detected that there is an open idle page in the browser, content is loaded into the opened idle page to obtain a page to be rendered; Rendering a target three-dimensional virtual image in the to-be-rendered page.

4. The method according to claim 2, It is characterized in that The rendering of the target three-dimensional virtual image in the to-be-rendered page of the browser includes: Detecting idle pages in the browser; When it is detected that there is no idle page opened in the browser, calling a page creation function to create a blank page in the browser; Loading content into the blank page to obtain the page to be rendered; The target three-dimensional virtual image is rendered in the page to be rendered.

5. The method according to claim 2, It is characterized in that The step of generating a first dynamic three-dimensional virtual image consistent with the action of the target object according to the somatosensory input information and the target three-dimensional virtual image comprises: Obtaining the 3D model parameters of the next target 3D virtual image to be rendered according to the somatosensory input information and the 3D model parameters of the currently rendered target 3D virtual image; Determining, according to the 3D model parameters of the currently rendered target 3D virtual image and the 3D model parameters of the next target 3D virtual image to be rendered, a difference parameter and a difference parameter amount between the currently rendered target 3D virtual image and the next target 3D virtual image to be rendered; When the difference parameter amount is not greater than a preset parameter amount threshold, the 3D model parameters of the currently rendered target 3D virtual image are adjusted according to the difference parameter to generate a first dynamic 3D virtual image consistent with the target object action.

6. The method according to claim 5, It is characterized in that The step of generating a first dynamic three-dimensional virtual image consistent with the action of the target object according to the somatosensory input information and the target three-dimensional virtual image further includes: When the difference parameter amount is greater than the preset parameter amount threshold, the target 3D virtual image is re-rendered according to the 3D model parameters of the next target 3D virtual image to be rendered to obtain a first dynamic 3D virtual image consistent with the target object action.

7. The method according to claim 5, It is characterized in that The step of obtaining the 3D model parameters of the next target 3D virtual image to be rendered according to the somatosensory input information and the 3D model parameters of the currently rendered target 3D virtual image comprises: Acquire the motion parameters of the target object according to the somatosensory input information; The three-dimensional model parameters of the next target three-dimensional virtual image to be rendered are calculated according to the action parameters and the three-dimensional model parameters of the currently rendered target three-dimensional virtual image.

8. The method according to claim 1, It is characterized in that The calling of the video recording function in the client to record the first dynamic three-dimensional virtual image to obtain a first target video includes: Calling a video recording function in the client to perform video recording based on a binary large object format on the first dynamic three-dimensional virtual image to obtain a candidate video; The video format conversion function in the client is called to perform text string-based format conversion on the candidate video to obtain a first target video.

9. The method according to claim 1, It is characterized in that The input information includes somatosensory input information; and sending the first target video to a server so that the server generates the user-generated content according to the first target video, comprising: Acquire audio data of the target object according to the somatosensory input information; The first target video and the audio data are sent to a server, so that the server performs audio and video synthesis according to the first target video and the audio data to obtain the user-generated content.

10. The method according to claim 1, It is characterized in that The step of generating a first dynamic three-dimensional virtual image consistent with the action of the target object according to the input information includes: Detecting the rendering capability supported by the client; When the rendering capability supported by the client meets the preset rendering condition, a first dynamic three-dimensional virtual image consistent with the action of the target object is generated according to the input information.

11. The method according to claim 1, It is characterized in that The method further comprises: Detecting the rendering capability supported by the client; When the rendering capability supported by the client does not meet the preset rendering condition, the input information is sent to the server, so that the server generates the user-generated content according to the input information, wherein the user-generated content is generated by the server according to a second target video, the second target video is obtained by the server calling a video recording function to record a second dynamic three-dimensional virtual image, the second dynamic three-dimensional virtual image is generated by the server according to the input information, and the second dynamic three-dimensional virtual image is consistent with the action of the target object; The user generated content sent by the server is received.

12. A device for processing user-generated content, It is characterized in that include: An information receiving unit, used to receive input information initiated by a target object for producing user-generated content through a client; An image generation unit, configured to generate, in the client, a first dynamic three-dimensional virtual image consistent with the action of the target object according to the input information; A video recording unit, configured to call a video recording function in the client to record the first dynamic three-dimensional virtual image to obtain a first target video; a video sending unit, configured to send the first target video to a server, so that the server generates the user generated content according to the first target video; The first content receiving unit is configured to receive the user generated content sent by the server.

13. A device for processing user-generated content, It is characterized in that include: at least one processor; at least one memory for storing at least one program; When at least one of the programs is executed by at least one of the processors, the method for processing user-generated content according to any one of claims 1 to 11 is implemented.

14. A computer-readable storage medium, It is characterized in that A computer program executable by a processor is stored therein, and when the computer program executable by the processor is executed by the processor, it is used to implement the method for processing user-generated content as described in any one of claims 1 to 11.

15. A computer program product comprising a computer program or computer instructions, It is characterized in that The computer program or the computer instructions are stored in a computer-readable storage medium, and the processor of the user-generated content processing device reads the computer program or the computer instructions from the computer-readable storage medium. The processor executes the computer program or the computer instructions, so that the user-generated content processing device performs the user-generated content processing method as described in any one of claims 1 to 11.

Citation Information

Cited By

  • Algorithm and system for matching tail action of digital animal image through voice

    CN120492942A