Virtual image adjusting method and device
The server receives and processes the audience's virtual image adjustment request, adjusts the virtual image in real time and pushes new live streams, solving the problem that the virtual image cannot be adjusted in real time in the existing technology, and significantly improving the audience's interactive experience and the attractiveness of live broadcasts.
Patent Information
- Application Number
- CN202411647508.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-15
- Publication Date
- 2025-02-14
AI Technical Summary
The existing live broadcast technology cannot dynamically adjust the virtual image in real time during the live broadcast process according to the audience's personalized needs, resulting in poor live broadcast effect and insufficient interactive experience and sense of participation of the audience.
Receive virtual image adjustment requests sent by the audience terminal through the server, obtain virtual image and target resources based on the virtual image identification and target resource identification, adjust the virtual image and generate a new virtual image, synthesize a new live stream and push it to the audience terminal, and realize virtualization Real-time image adjustment.
During the live broadcast process, the virtual image is dynamically adjusted according to the audience's personalized needs. Each audience can instantly see their customized virtual image, which enhances the audience's interactive experience and sense of participation, and enhances the fun and attractiveness of the live broadcast. .
Smart Images

Figure CN119450107A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of live broadcast technology, and in particular to a virtual image adjustment method, apparatus, computer equipment, computer-readable storage medium, and computer program product. Background Art
[0002] With the rapid popularization of internet technology, live streaming is gaining increasing acceptance and popularity. Live streaming involves the following: a live streaming platform, a host terminal, and a viewer terminal. The host terminal can provide multimedia content (e.g., video and audio) to the viewer terminal via the live streaming platform, and can also receive multimedia content (e.g., bullet comments and gifts) from the viewer terminal via the live streaming platform, thus achieving a live and interactive experience.
[0003] During a live broadcast, the host can display either their real or virtual image. For example, the host can set up an avatar before the live broadcast and use the set avatar for the live broadcast. Once viewers enter the live broadcast room, they can see the live broadcast of the avatar.
[0004] However, virtual images cannot meet the real-time personalized needs of different audiences during live broadcasts, resulting in poor live broadcast effects.
[0005] It should be noted that the above content is not necessarily prior art, nor is it intended to limit the scope of patent protection of this application. Summary of the Invention
[0006] The embodiments of the present application provide a virtual image adjustment method, apparatus, computer device, computer-readable storage medium, and computer program product to solve or alleviate one or more of the technical problems raised above.
[0007] One aspect of an embodiment of the present application provides a virtual image adjustment method for a server, the method comprising: receiving a virtual image adjustment request sent by a viewer terminal, wherein the virtual image adjustment request includes a virtual image identifier and a target resource identifier; Acquire the virtual image and the target resource according to the virtual image identifier and the target resource identifier; adjusting the virtual image according to the target resource to generate a new virtual image; A new live stream is synthesized based on the new avatar, and the new live stream is pushed to the viewer terminal to display the new avatar through the viewer terminal.
[0008] Optionally, the avatar includes a avatar model and a visual component, wherein the visual component is mounted on the avatar model, and the visual component includes one or more of clothing, accessories, and props.
[0009] Optionally, the target resource corresponds to a target visual component; Correspondingly, adjusting the virtual image according to the target resource to generate a new virtual image includes: Determining a mounting position of the target visual component on the avatar model; Determining whether there is an existing visual component at the mounting location; In the case where the original visual component exists at the mounting position, removing the original visual component and loading the target visual component into the mounting position; In a case where the original vision component does not exist at the mounting position, the target vision component is loaded into the mounting position.
[0010] Optionally, the virtual image adjustment request further includes account information, and the account information includes an account identifier; Correspondingly, obtaining the virtual image and the target resource according to the virtual image identifier and the target resource identifier includes: Obtaining account permissions based on the account identifier; Determining whether the account permissions include avatar adjustment permissions; In the case where the virtual image adjustment permission is included, searching for the target resource in a preset virtual image resource library according to the target resource identifier; If the target resource is not found, sending a resource failure notification to the viewer terminal; When the target resource is found, the target resource is obtained from the virtual image database.
[0011] Optionally, the account information also includes adjustment operation records; Correspondingly, synthesizing a new live stream based on the new avatar includes: Inputting the adjustment operation record and the new virtual image into a pre-trained virtual image review model to obtain a review result for the new virtual image; If the review result is passed, synthesizing the new live stream based on the new avatar; If the review result is failure, the virtual image adjustment permission is removed from the account permissions, and a permission warning notification is sent to the viewer terminal.
[0012] Another aspect of an embodiment of the present application provides a method for adjusting a virtual image, used in a viewer terminal, the method comprising: Displaying a live broadcast interface, wherein the live broadcast interface is used to display a virtual image; In response to an adjustment operation on the virtual avatar, generating a virtual avatar adjustment request, the virtual avatar adjustment request including a virtual avatar identifier and a target resource identifier, the virtual avatar identifier corresponding to the virtual avatar, the target resource identifier corresponding to a target resource for adjusting the virtual avatar, the target resource being specified by the adjustment operation; Sending the virtual image adjustment request to a server, the server being configured to: adjust the virtual image based on the virtual image adjustment request to generate a new virtual image; and synthesize a new live stream based on the new virtual image; Receive the new live stream sent by the server, and display the new virtual image on the live interface based on the new live stream.
[0013] Optionally, the live broadcast interface includes a virtual image adjustment area, wherein the virtual image adjustment area is configured with a plurality of adjustment controls, and one adjustment control corresponds to one resource; Correspondingly, in response to the adjustment operation on the virtual image, generating a virtual image adjustment request includes: In response to selecting one of the adjustment controls, determining a target resource and obtaining a target resource identifier; Based on the virtual image, obtaining a virtual image identifier; The virtual avatar adjustment request is generated based on the virtual avatar identifier and the target resource identifier.
[0014] Another aspect of an embodiment of the present application provides a virtual image adjustment device for a server, the device comprising: A receiving module, configured to receive a virtual image adjustment request sent by a viewer terminal, wherein the virtual image adjustment request includes a virtual image identifier and a target resource identifier; An acquisition module, configured to acquire the virtual image and the target resource according to the virtual image identifier and the target resource identifier; A generating module, configured to adjust the virtual image according to the target resource to generate a new virtual image; The push module is used to synthesize a new live stream based on the new virtual image and push the new live stream to the audience terminal to display the new virtual image through the audience terminal.
[0015] Another aspect of an embodiment of the present application provides a virtual image adjustment device for a viewer terminal, the device comprising: A display module, configured to display a live broadcast interface, wherein the live broadcast interface is configured to display a virtual image; a response module, configured to generate a virtual image adjustment request in response to an adjustment operation on the virtual image, the virtual image adjustment request including a virtual image identifier and a target resource identifier, the virtual image identifier corresponding to the virtual image, the target resource identifier corresponding to a target resource for adjusting the virtual image, the target resource being specified by the adjustment operation; a sending module, configured to send the virtual image adjustment request to a server, wherein the server is configured to: adjust the virtual image based on the virtual image adjustment request to generate a new virtual image; and synthesize a new live stream based on the new virtual image; A display module is used to receive the new live broadcast stream sent by the server and display the new virtual image on the live broadcast interface based on the new live broadcast stream.
[0016] Another aspect of an embodiment of the present application provides a computer device, including: at least one processor; and a memory communicatively coupled to the at least one processor; Wherein: the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method described above.
[0017] Another aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a processor, the method described above is implemented.
[0018] Another aspect of an embodiment of the present application provides a computer program product, including a computer program, which implements the above-mentioned method when executed by a processor.
[0019] The above technical solution adopted in the embodiments of the present application may have the following advantages: The server receives a virtual image adjustment request sent by the audience terminal, and the virtual image adjustment request carries a virtual image identifier and a target resource identifier. According to the virtual image identifier and the target resource identifier, the virtual image and the target resource are obtained. The virtual image is adjusted according to the target resource to generate a new virtual image. A new live stream is synthesized based on the new virtual image, and the new live stream is pushed to the audience terminal to display the new virtual image through the audience terminal. It can be seen that the embodiment of the present application can dynamically adjust the virtual image according to the personalized needs of the audience in real time during the live broadcast process. Each audience member can instantly see their customized virtual image, achieving a display effect of thousands of faces for thousands of people, significantly improving the audience's interactive experience and sense of participation in the live broadcast, and meeting the audience's needs for personalized and diversified display of virtual images, thereby greatly enhancing the fun and appeal of the live broadcast. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] The accompanying drawings illustrate exemplary embodiments and constitute a part of the specification. Together with the description of the specification, they serve to explain exemplary implementation of the embodiments. The illustrated embodiments are for illustrative purposes only and do not limit the scope of the claims. Throughout the drawings, the same reference numerals designate similar, but not necessarily identical, elements.
[0021] Figure 1 A diagram schematically illustrates an operating environment of a virtual image adjustment method according to the first embodiment of the present application; Figure 2 The flowchart of the virtual image adjustment method according to the first embodiment of the present application is schematically shown; Figure 3 Schematically shows Figure 2 Flowchart of sub-steps of step S202; Figure 4 Schematically shows Figure 2 Flowchart of sub-steps of step S204; Figure 5 Schematically shows Figure 2 Flowchart of sub-steps of step S206; Figure 6 The flowchart of the virtual image adjustment method according to the second embodiment of the present application is schematically shown; Figure 7 Schematically shows Figure 6 Flowchart of sub-steps of step S602; Figure 8 is an example diagram of an application of the virtual image adjustment method according to an embodiment of the present application; Figure 9 Schematically shows a block diagram of a virtual image adjustment device according to a third embodiment of the present application; Figure 10 A block diagram schematically shows a virtual image adjustment device according to a fourth embodiment of the present application; and Figure 11 The following schematically shows a hardware architecture diagram of a computer device according to the fifth embodiment of the present application. DETAILED DESCRIPTION
[0022] In order to make the purpose, technical solutions and advantages of this application more clear, the present application is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.
[0023] It should be noted that the descriptions of "first", "second", etc. in the embodiments of the present application are for descriptive purposes only and should not be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" or "second" may explicitly or implicitly include at least one of such features. In addition, the technical solutions between the various embodiments can be combined with each other, but this must be based on the fact that they can be implemented by ordinary technicians in this field. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by this application.
[0024] In the description of this application, it should be understood that the numerical labels before the steps do not indicate the order in which the steps are executed. They are only used to facilitate the description of this application and to distinguish each step. Therefore, they cannot be understood as limitations on this application.
[0025] To facilitate those skilled in the art to understand the technical solutions provided in the embodiments of the present application, the following describes the relevant technologies: With the rapid popularization of internet technology, live streaming is gaining increasing acceptance and popularity. Live streaming involves the following: a live streaming platform, a host terminal, and a viewer terminal. The host terminal can provide multimedia content (e.g., video and audio) to the viewer terminal via the live streaming platform, and can also receive multimedia content (e.g., bullet comments and gifts) from the viewer terminal via the live streaming platform, thus achieving a live and interactive experience.
[0026] During a live broadcast, the host can display either their real or virtual image. For example, the host can set up an avatar before the live broadcast and use the set avatar for the live broadcast. Once viewers enter the live broadcast room, they can see the live broadcast of the avatar.
[0027] However, the applicant has learned that in related live streaming technologies, hosts can use a fixed avatar or set their avatar by selecting from a limited number of preset options. These options may include several predefined outfits or accessories, which limit the selection and do not support personalized customization of the avatar. Related avatar adjustment technologies primarily rely on static switching (i.e., pre-set switching methods), making it difficult to achieve real-time personalized adjustments during live streaming. For example, some live streaming platforms may allow hosts to select avatar clothing, accessories, etc. before the live broadcast begins. However, during the live broadcast, they are unable to meet the real-time personalized and diverse needs of different viewers. As a result, viewers entering the same live broadcast room all see the same avatar, thus limiting the personalized experience of viewers and lacking a sense of participation and interaction, especially in live broadcast scenarios involving multiple participants.
[0028] To this end, the embodiment of the present application provides a virtual image adjustment technology solution. In this technology solution: (1) During the live broadcast process, the virtual image can be adjusted in real time according to the personalized needs of different viewers, thereby achieving a display effect of thousands of faces for thousands of people. Specifically, the audience can choose different clothes, accessories, etc. at any time during the live broadcast and see the changes in the virtual image in real time. (2) Through the efficient processing of the server and the real-time display of the audience terminal, the dynamic adjustment of the virtual image is achieved, so that each viewer can see their customized virtual image. (3) The audience's interactive experience and sense of participation in the virtual image live broadcast are significantly improved, meeting the audience's needs for personalized and diversified display of virtual images, thereby greatly enhancing the fun and attractiveness of the live broadcast. (4) In a live broadcast scene with multiple participants, multiple viewers are allowed to personalize the virtual image at the same time, and data is processed efficiently to avoid delays, ensuring that each viewer can see the updated virtual image that matches their choice in real time. See below for details.
[0029] Finally, for ease of understanding, an exemplary operating environment is provided below.
[0030] like Figure 1 As shown, the operating environment diagram includes: service platform 2, host terminals (4A, 4B, ..., 4M), and viewer terminals (6A, 6B, ..., 6N). In the live broadcast scenario, the host terminals (4A, 4B, ..., 4M) log in to service platform 2, which then pushes live broadcast data to viewer terminals (6A, 6B, ..., 6N) in real time.
[0031] Service platform 2 can provide live broadcast service, which can be a single server, a server cluster or a cloud computing service center.
[0032] The host terminals (4A, 4B, ..., 4M) are used to generate live broadcast data in real time and stream the live broadcast data. The live broadcast data may include audio or video data. The host terminals can be electronic devices such as smartphones and tablets. Alternatively, the host terminals can be virtual computing instances within the service platform 2.
[0033] The viewer terminals (6A, 6B, ..., 6N) can be configured to receive live broadcast data from the host terminal in real time. The viewer terminals (6A, 6B, ..., 6N) can be any type of computing device, such as a smartphone, tablet, laptop, smart TV, or in-car terminal. The viewer terminals (6A, 6B, ..., 6N) can have a built-in browser or dedicated program to receive the live broadcast data and output content to the user. The content can include video, audio, commentary, text data, and / or the like.
[0034] The viewer terminal (6A, 6B, ..., 6N) may include a player. The player outputs (e.g., displays, presents) content to the user. The content may include video, audio, comments, text data, and / or the like. The viewer terminal (6A, 6B, ..., 6N) may include an interface, which may include an input element (touch screen). For example, the input element may be configured to receive user instructions, which may cause the viewer terminal (6A, 6B, ..., 6N) to perform various operations, such as sending a barrage, entering a comment, sending a gift, etc.
[0035] The host terminals (4A, 4B, ..., 4M), the viewer terminals (6A, 6B, ..., 6N), and the service platform 2 may be connected via a network. The network may include various network devices, such as routers, switches, multiplexers, hubs, modems, bridges, repeaters, firewalls, and / or proxy devices. The network may include physical links, such as coaxial cable links, twisted-pair cable links, optical fiber links, combinations thereof, and / or the like. The network may also include wireless links, such as cellular links, satellite links, Wi-Fi links, and / or the like.
[0036] It should be noted that the number of host terminals and viewer terminals in the figure is only illustrative and is not intended to limit the scope of patent protection of this application. Depending on the actual situation, there can be any number of host terminals and viewer terminals.
[0037] The technical solutions of the present application are described below through a number of embodiments. It should be noted that these embodiments can be implemented in a variety of different forms and should not be construed as being limited to the embodiments described herein.
[0038] Example 1 Figure 2 The flowchart of the virtual image adjustment method according to the first embodiment of the present application is schematically shown.
[0039] like Figure 2 As shown, the virtual image adjustment method can be used in a server (service platform 2), and can specifically include steps S200 to S206, wherein: Step S200: receiving a virtual image adjustment request sent by a viewer terminal, wherein the virtual image adjustment request includes a virtual image identifier and a target resource identifier.
[0040] Step S202: Acquire the virtual image and the target resource according to the virtual image identifier and the target resource identifier.
[0041] Step S204: adjusting the virtual image according to the target resource to generate a new virtual image.
[0042] Step S206: synthesize a new live stream based on the new avatar, and push the new live stream to the viewer terminal to display the new avatar through the viewer terminal.
[0043] The virtual image adjustment method provided in this embodiment is that the server receives a virtual image adjustment request sent by the audience terminal, and the virtual image adjustment request carries a virtual image identifier and a target resource identifier. According to the virtual image identifier and the target resource identifier, the virtual image and the target resource are obtained. The virtual image is adjusted according to the target resource to generate a new virtual image. A new live stream is synthesized based on the new virtual image, and the new live stream is pushed to the audience terminal to display the new virtual image through the audience terminal. It can be seen that the embodiment of the present application can dynamically adjust the virtual image according to the personalized needs of the audience in real time during the live broadcast process. Each audience member can instantly see their customized virtual image, achieve a display effect of thousands of faces for thousands of people, significantly enhance the audience's interactive experience and sense of participation in the live broadcast, meet the audience's needs for personalized and diversified display of virtual images, and thus greatly enhance the fun and appeal of the live broadcast.
[0044] The following combination Figure 2 , each step in steps S200~S206 and other optional steps are described in detail.
[0045] Step S200 , receiving a virtual image adjustment request sent by a viewer terminal, wherein the virtual image adjustment request includes a virtual image identifier and a target resource identifier.
[0046] A virtual avatar is a virtual appearance created through digital technology and can be 3D or 2D, such as a human, animal, cartoon, or other creative appearance. The host can use real-time capture technology (such as facial capture, motion capture) or artificial intelligence (AI) to drive the avatar's interaction with the audience. A viewer terminal (such as 6A) can display the avatar through the live broadcast interface and receive adjustment commands from the audience (such as touch screen operation, text, or voice input), generating a avatar adjustment request. The viewer terminal can send the avatar adjustment request to the server. The avatar adjustment request can include an avatar identifier and a target resource identifier. The avatar identifier corresponds to the avatar to be adjusted, and the target resource identifier corresponds to the target resource (i.e., the avatar resource selected by the viewer) that can be used to adjust the avatar. In an optional embodiment, the avatar can include an avatar model and visual components. The visual components can be attached to the avatar model and can include clothing (such as a top, pants, shoes), accessories (such as glasses, hats, watches), props (such as weapons, magic wands, and pets), etc.
[0047] Step S202, obtaining the virtual image and the target resource according to the virtual image identifier and the target resource identifier.
[0048] Exemplarily, the virtual image to be adjusted can be quickly determined based on the virtual image identifier (ID). Based on the target resource identifier (ID), the corresponding target resource can be quickly called. The target resource can correspond to a target visual component, which is used to update the virtual image's clothing, accessories, or props. Of course, the target resource can also correspond to the target parameters of the virtual image model, which can be used to adjust the virtual image model's expression, skeleton, texture, etc. Furthermore, before obtaining the virtual image and target resource based on the virtual image adjustment request, the server can also verify the legitimacy of the request to improve system stability, implement permission control, and prevent illegal or malicious requests. An exemplary solution is provided below.
[0049] In an optional embodiment, the virtual image adjustment request may further include account information, where the account is the account used by the viewer to log in to the live broadcast room. The account information may include an account ID. Figure 3 As shown, step S202 may include: Step S300: Acquire account authority according to the account identifier.
[0050] Step S302: Determine whether the account permissions include virtual image adjustment permissions.
[0051] Step S304: in the case where the virtual image adjustment permission is included, searching for the target resource in a preset virtual image resource library according to the target resource identifier.
[0052] Step S306: If the target resource is not found, a resource failure notification is sent to the viewer terminal.
[0053] Step S308: When the target resource is found, the target resource is obtained from the virtual image database.
[0054] Exemplarily, the account identifier is obtained by parsing the virtual image adjustment request. Based on the account identifier, the corresponding account permissions are queried. It is determined whether the queried account permissions include the virtual image adjustment permission. If the virtual image adjustment permission is included, the validity of the target resource can be further verified. Specifically, the target resource can be searched in a preset virtual image resource library based on the target resource identifier. If the target resource is not found, a resource expiration notification can be generated and sent to the viewer terminal to prompt the viewer that the selected resource (such as clothing, accessories, props) has been removed from the shelf. If the target resource is found, the corresponding target resource can be called from the virtual image resource library.
[0055] In this embodiment, the security and accuracy of the virtual image adjustment operation can be ensured through permission verification and resource validity check, thereby improving the stability of the system and the live broadcast experience.
[0056] Step S204 , adjusting the virtual image according to the target resource to generate a new virtual image.
[0057] For example, a target resource (such as a target visual component) can be applied to the avatar model to modify, add to, or replace the avatar, thereby generating a new avatar. An example solution is provided below.
[0058] In an optional embodiment, if Figure 4 As shown, step S204 may include: Step S400: determining the mounting position of the target visual component on the virtual image model.
[0059] Step S402: Determine whether there is an existing visual component at the mounting location.
[0060] Step S404 : if the original visual component exists at the mounting position, remove the original visual component and load the target visual component to the mounting position.
[0061] Step S406 : If the original visual component does not exist at the mounting position, the target visual component is loaded into the mounting position.
[0062] The mounting location is the specific location where the target visual component is attached to the avatar model. This can be determined based on the avatar model's skeletal structure, design, and actual needs. For example, a hat can be mounted on the avatar model's head, a scarf can be mounted on the avatar model's neck, and so on. For example, before loading the target visual component, the server can first determine the target visual component's mounting location on the avatar model and verify whether the mounting location already contains a visual component (the original visual component). If the mounting location already contains a visual component, the original visual component is removed and the target visual component is then rendered and loaded into the mounting location in real time. If the mounting location does not contain a visual component, the target visual component can be directly rendered and loaded into the mounting location in real time (additional processing). For example, if an avatar is wearing hat A during a live broadcast and a viewer selects hat B for the avatar during the live broadcast, the server, after obtaining the avatar resource corresponding to hat B, detects that hat A already exists at the mounting location corresponding to hat B (the avatar model's head), and then removes hat A and loads hat B into the mounting location, generating the avatar wearing hat B. This can avoid visual conflicts, ensure that the avatar seen by the audience meets expectations, simplify resource management, and reduce system burden. If it is detected that the avatar model's head does not have conflicting visual components, hat B can be directly rendered and loaded into the avatar's head in real time.
[0063] In this embodiment, by checking whether the mounting location already has a conflicting visual component, the correct rendering and loading of the target visual component on the virtual image model can be ensured, ensuring that a new virtual image matching the selection is provided to the audience, effectively optimizing the live broadcast effect.
[0064] Step S206: synthesize a new live stream based on the new avatar, and push the new live stream to the viewer terminal to display the new avatar through the viewer terminal.
[0065] For example, the live stream can be encoded and processed in real time based on the new avatar, resulting in a new live stream with the updated avatar. The server can push the new live stream to the viewer terminal via the network. Upon receiving the new live stream, the viewer terminal can decode it in real time and display it on the live interface (i.e., display the new avatar in real time), ensuring smooth and real-time streaming. Viewers can immediately see the updated avatar and engage in further interaction, such as sending comments or changing clothing, accessories, or props.
[0066] In practical applications, viewers' personalized adjustments to avatars can create inappropriate or illegal avatars, such as counterfeit or copyright-infringing avatars. These customized avatars can be displayed to others during live broadcasts (e.g., in live broadcasts), making the spread of these illegal avatars complex and difficult to control. Therefore, the server can also review new avatars to filter out non-compliant ones and enhance content security. An example solution is provided below.
[0067] In an optional embodiment, the account information may also include adjustment behavior records, which correspond to specific adjustment operations of the viewer, such as which visual component to select, which parameters of the avatar model to adjust, etc. Figure 5 As shown, step S206 may include: Step S500: Input the adjustment operation record and the new virtual image into a pre-trained virtual image review model to obtain a review result for the new virtual image.
[0068] Step S502: If the review result is passed, synthesize the new live stream based on the new virtual image.
[0069] Step S504: If the review result is failure, remove the virtual image adjustment permission from the account permissions, and send a permission warning notification to the viewer terminal.
[0070] Exemplarily, the server can input the adjustment operation records and the new virtual image into a pre-trained virtual image review model to obtain the review results for the new virtual image. If the review passes, a new live stream can be synthesized based on the new virtual image. If the review fails, it means that the new virtual image is non-compliant. The virtual image review model can also analyze the adjustment operation records to determine which adjustment operations are illegal operations and whether to blacklist the corresponding account. If the review fails, the virtual image adjustment permission can be removed from the account permissions, and a permission warning notification can be sent to the viewer terminal to remind the viewer that the virtual image adjustment permission is no longer available and cannot be adjusted.
[0071] In this embodiment, the server can centrally review updated avatars, preventing viewers from uploading inappropriate content or violating avatar rules, effectively mitigating security risks. Leveraging the server's computing power, it can run complex AI review models to monitor the generated results for harmful content in real time. Having the server responsible for updating avatars reduces the risk of viewers tampering with them locally and prevents malicious users from generating illegal content through reverse engineering or hacking their device code.
[0072] This embodiment also reduces the performance burden on viewer terminals by updating the avatar via the server, improving the live streaming experience on low-end devices. The server handles the computation and rendering tasks, while the viewer terminal only needs to receive and display the final result. This reduces the performance requirements on the viewer terminal, allowing even low-end devices to smoothly use the avatar adjustment function. Moving the complex avatar update logic to the server reduces the amount of code and resource usage on the viewer terminal, making the application smaller and faster to install and update.
[0073] Example 2 Figure 6 The flowchart of the virtual image adjustment method according to the second embodiment of the present application is schematically shown.
[0074] like Figure 6 As shown, the virtual image adjustment method can be used in a viewer terminal, and specifically may include steps S600 to S606, wherein: Step S600: displaying a live broadcast interface, wherein the live broadcast interface is used to display a virtual image.
[0075] Step S602: In response to the adjustment operation for the virtual avatar, a virtual avatar adjustment request is generated. The virtual avatar adjustment request includes a virtual avatar identifier and a target resource identifier, wherein the virtual avatar identifier corresponds to the virtual avatar and the target resource identifier corresponds to the target resource for adjusting the virtual avatar, wherein the target resource is specified by the adjustment operation.
[0076] Step S604: Send the virtual image adjustment request to a server, where the server is configured to: adjust the virtual image based on the virtual image adjustment request to generate a new virtual image; and synthesize a new live stream based on the new virtual image.
[0077] Step S606: Receive the new live stream sent by the server, and display the new virtual image on the live interface based on the new live stream.
[0078] This embodiment provides a method for adjusting a virtual avatar. The viewer terminal displays a live broadcast interface for displaying a virtual avatar. The viewer can input adjustment operations for the virtual avatar, and the viewer terminal can accordingly generate a virtual avatar adjustment request and send it to the server. The virtual avatar adjustment request includes a virtual avatar identifier and a target resource identifier. The virtual avatar identifier corresponds to the virtual avatar, and the target resource identifier corresponds to the target resource for adjusting the virtual avatar. The target resource is specified by the viewer's adjustment operation. The server adjusts the virtual avatar based on the virtual avatar adjustment request to generate a new virtual avatar, and synthesizes a new live broadcast stream based on the new virtual avatar, which is then sent to the viewer terminal. The viewer terminal receives the new live broadcast stream and decodes it in real time, displaying the new virtual avatar in real time during the live broadcast. As can be seen, this embodiment of the application can dynamically adjust the virtual avatar in real time according to the viewer's personalized needs during the live broadcast. Each viewer can instantly see their customized virtual avatar, achieving a personalized display effect, significantly enhancing the viewer's interactive experience and sense of participation in the live broadcast, and meeting the viewer's demand for personalized and diversified virtual avatar displays, thereby greatly enhancing the fun and appeal of the live broadcast.
[0079] In an optional embodiment, the live streaming interface may include an avatar adjustment area. This area may float above the live streaming screen (avatar) or be displayed independently of the live streaming screen (avatar) and elsewhere in the live streaming interface. The avatar adjustment area may be configured with multiple adjustment controls, each corresponding to a resource. These adjustment controls may include options, sliders, numeric input boxes, and so on. Resources may include clothing, accessories, or props.
[0080] like Figure 7 As shown, step S602 may include: Step S700 : In response to selecting one of the adjustment controls, a target resource is determined and a target resource identifier is obtained.
[0081] Step S702: Acquire a virtual image identifier based on the virtual image.
[0082] Step S704: Generate the virtual image adjustment request based on the virtual image identifier and the target resource identifier.
[0083] For example, a viewer can select an adjustment control in the avatar adjustment area, determine the target resource corresponding to the selected adjustment control, and obtain the target resource identifier. Based on the avatar displayed on the live broadcast interface, the avatar identifier is obtained. Based on the avatar identifier and the target resource identifier, a avatar adjustment request is generated.
[0084] In this embodiment, the visual adjustment controls are used to simplify the viewer's operation process, making personalized adjustment of the virtual image more intuitive and convenient, thereby enhancing the live interactive experience.
[0085] In some embodiments, the viewer terminal can also generate a virtual image adjustment request in combination with account information (account identification and adjustment operation records) so that the server can review the viewer's authority, resource validity and updated virtual image, effectively improving security.
[0086] In order to make this application easier to understand, the following Figure 8 An exemplary application is provided.
[0087] S1: A viewer enters the live studio. Their terminal requests a live stream from the server. The server pulls the live stream from the host's terminal and returns it to the viewer. The live stream carries an avatar. The viewer's terminal decodes the live stream and displays the avatar in the studio.
[0088] S2: The viewer performs an avatar adjustment operation (such as clicking on the avatar to change the outfit), and the viewer terminal sends a user (viewer) outfit change request to the server. The request carries at least the avatar identifier and the identifier of the selected clothing or accessories (target resource identifier).
[0089] S3: The server generates an updated virtual anchor video stream (a new live stream) based on the user's request to change the suit. The video stream carries the updated virtual image (the user-defined virtual image).
[0090] S4: The viewer terminal pulls the new live stream from the server to display the customized avatar to the viewer through the viewer terminal.
[0091] Two examples are provided below.
[0092] Example 1: User A chooses a red dress for their avatar. The system processes the changes in real time and displays the updated avatar on User A's client. Meanwhile, User B chooses a blue tracksuit in the same livestream. The system updates User B's main avatar accordingly. Although User A and User B are watching the livestream in the same room, they see different avatars.
[0093] Example 2: During a live broadcast, user C chooses a new hat for their avatar. The system then adds the new hat to the avatar and sends the live stream of the avatar with the new hat to user C's client. User C can see the changed avatar in real time.
[0094] In this exemplary application: (1) During the live broadcast, the virtual image can be adjusted in real time according to the personalized needs of different viewers, thereby achieving a display effect of thousands of faces for each person. Specifically, the audience can choose different clothes, accessories, etc. at any time during the live broadcast and see the changes in the virtual image in real time. (2) Through the efficient processing of the server and the real-time display of the audience terminal, the dynamic adjustment of the virtual image is achieved, so that each viewer can see their customized virtual image. (3) The audience's interactive experience and sense of participation in the virtual image live broadcast are significantly improved, meeting the audience's needs for personalized and diversified display of virtual images, thereby greatly enhancing the fun and appeal of the live broadcast. (4) In a live broadcast scene with multiple participants, multiple viewers are allowed to personalize the virtual image at the same time, and data is processed efficiently to avoid delays, ensuring that each viewer can see the updated virtual image that matches their choice in real time.
[0095] Example 3 Figure 9 The block diagram of the virtual image adjustment device according to the third embodiment of the present application is schematically shown. The device can be used in a server and can also be divided into one or more program modules. One or more program modules are stored in a storage medium and executed by one or more processors to complete the embodiment of the present application. The program module referred to in the embodiment of the present application refers to a series of computer program instruction segments that can complete specific functions. The following description will specifically introduce the functions of each program module in this embodiment. Figure 9 As shown, the apparatus 1000 may include: a receiving module 1100, an acquiring module 1200, a generating module 1300, and a pushing module 1400, wherein: The receiving module 1100 is configured to receive a virtual image adjustment request sent by a viewer terminal, wherein the virtual image adjustment request includes a virtual image identifier and a target resource identifier; An acquisition module 1200 is configured to acquire a virtual image and a target resource according to the virtual image identifier and the target resource identifier; A generating module 1300 is configured to adjust the virtual image according to the target resource to generate a new virtual image; The push module 1400 is configured to synthesize a new live stream based on the new avatar, and push the new live stream to the viewer terminal so as to display the new avatar through the viewer terminal.
[0096] As an optional embodiment, the virtual image includes a virtual image model and a visual component, wherein the visual component is mounted on the virtual image model, and the visual component includes one or more of clothing, accessories, and props.
[0097] As an optional embodiment, the target resource corresponds to a target visual component; Correspondingly, adjusting the virtual image according to the target resource to generate a new virtual image includes: Determining a mounting position of the target visual component on the avatar model; Determining whether there is an existing visual component at the mounting location; In the case where the original visual component exists at the mounting position, removing the original visual component and loading the target visual component into the mounting position; In a case where the original vision component does not exist at the mounting position, the target vision component is loaded into the mounting position.
[0098] As an optional embodiment, the virtual image adjustment request further includes account information, and the account information includes an account identifier; Correspondingly, obtaining the virtual image and the target resource according to the virtual image identifier and the target resource identifier includes: Obtaining account permissions based on the account identifier; Determining whether the account permissions include avatar adjustment permissions; In the case where the virtual image adjustment permission is included, searching for the target resource in a preset virtual image resource library according to the target resource identifier; If the target resource is not found, sending a resource failure notification to the viewer terminal; When the target resource is found, the target resource is obtained from the virtual image database.
[0099] As an optional embodiment, the account information further includes adjustment operation records; Correspondingly, synthesizing a new live stream based on the new avatar includes: Inputting the adjustment operation record and the new virtual image into a pre-trained virtual image review model to obtain a review result for the new virtual image; If the review result is passed, synthesizing the new live stream based on the new avatar; If the review result is failure, the virtual image adjustment permission is removed from the account permissions, and a permission warning notification is sent to the viewer terminal.
[0100] Example 4 Figure 10The block diagram of the virtual image adjustment device according to the fourth embodiment of the present application is schematically shown. The device can be used in the audience terminal and can also be divided into one or more program modules. One or more program modules are stored in a storage medium and executed by one or more processors to complete the embodiment of the present application. The program module referred to in the embodiment of the present application refers to a series of computer program instruction segments that can perform specific functions. The following description will specifically introduce the functions of each program module in this embodiment. Figure 10 As shown, the apparatus 2000 may include: a display module 2100, a response module 2200, a sending module 2300 and a presentation module 2400, wherein: The display module 2100 is used to display a live broadcast interface, wherein the live broadcast interface is used to display a virtual image; A response module 2200 is configured to generate a virtual image adjustment request in response to an adjustment operation on the virtual image, the virtual image adjustment request including a virtual image identifier and a target resource identifier, the virtual image identifier corresponding to the virtual image, the target resource identifier corresponding to a target resource for adjusting the virtual image, the target resource being specified by the adjustment operation; The sending module 2300 is configured to send the virtual image adjustment request to a server, wherein the server is configured to: adjust the virtual image based on the virtual image adjustment request to generate a new virtual image; and synthesize a new live stream based on the new virtual image; The display module 2400 is used to receive the new live broadcast stream sent by the server and display the new virtual image on the live broadcast interface based on the new live broadcast stream.
[0101] As an optional embodiment, the live broadcast interface includes a virtual image adjustment area, and the virtual image adjustment area is configured with multiple adjustment controls, and each adjustment control corresponds to a resource; Correspondingly, in response to the adjustment operation on the virtual image, generating a virtual image adjustment request includes: In response to selecting one of the adjustment controls, determining a target resource and obtaining a target resource identifier; Based on the virtual image, obtaining a virtual image identifier; The virtual avatar adjustment request is generated based on the virtual avatar identifier and the target resource identifier.
[0102] Example 5 Figure 11The following schematically shows a hardware architecture diagram of a computer device 10000 suitable for implementing a virtual image adjustment method according to the fifth embodiment of the present application. In some embodiments, the computer device 10000 may be a terminal device such as a smartphone, a wearable device, a tablet computer, a personal computer, a vehicle-mounted terminal, a game console, a virtual device, a workbench, a digital assistant, a set-top box, a robot, etc. In other embodiments, the computer device 10000 may be a rack server, a blade server, a tower server, or a cabinet server (including an independent server or a server cluster composed of multiple servers), etc. Figure 11 As shown, the computer device 10000 includes but is not limited to: a memory 10010, a processor 10020, and a network interface 10030 that can communicate with each other via a system bus. Memory 10010 includes at least one type of computer-readable storage medium, including flash memory, a hard disk, a multimedia card, card-type memory (e.g., SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, a magnetic disk, an optical disk, and the like. In some embodiments, memory 10010 may be an internal storage module of computer device 10000, such as a hard disk or memory of computer device 10000. In other embodiments, memory 10010 may also be an external storage device of computer device 10000, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash memory card, and the like equipped on computer device 10000. Of course, memory 10010 may also include both internal storage modules and external storage devices of computer device 10000. In this embodiment, the memory 10010 is generally used to store the operating system and various application software installed on the computer device 10000, such as the program code of the avatar adjustment method, etc. In addition, the memory 10010 can also be used to temporarily store various data that has been output or will be output.
[0103] In some embodiments, processor 10020 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other chips. Processor 10020 is typically used to control the overall operation of computer device 10000, such as performing control and processing related to data exchange or communication with computer device 10000. In this embodiment, processor 10020 is used to execute program code stored in memory 10010 or process data.
[0104] Network interface 10030 may include a wireless network interface or a wired network interface. Network interface 10030 is typically used to establish a communication link between computer device 10000 and other computer devices. For example, network interface 10030 is used to connect computer device 10000 to an external terminal via a network, establishing a data transmission channel and a communication link between computer device 10000 and the external terminal. The network may be a wireless or wired network such as an intranet, the Internet, the Global System of Mobile Communications (GSM), Wideband Code Division Multiple Access (WCDMA), a 4G network, a 5G network, Bluetooth, or Wi-Fi.
[0105] It should be pointed out that Figure 11 Only a computer device having components 10010 - 10030 is shown, but it should be understood that implementing all of the shown components is not a requirement, and more or fewer components may alternatively be implemented.
[0106] In this embodiment, the virtual image adjustment method stored in the memory 10010 can also be divided into one or more program modules and executed by one or more processors (such as processor 10020) to complete the embodiment of the present application.
[0107] Example 6 An embodiment of the present application also provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the steps of the virtual image adjustment method in the embodiment are implemented.
[0108] In this embodiment, computer-readable storage media include flash memory, hard disks, multimedia cards, card-type memories (e.g., SD or DX memories), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, magnetic disks, optical disks, and the like. In some embodiments, the computer-readable storage medium may be an internal storage unit of a computer device, such as the computer device's hard disk or memory. In other embodiments, the computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash memory card, and the like. Of course, the computer-readable storage medium may also include both the internal storage unit and external storage devices of the computer device. In this embodiment, the computer-readable storage medium is typically used to store the operating system and various application software installed on the computer device, such as the program code of the avatar adjustment method described in the embodiment. Furthermore, the computer-readable storage medium may also be used to temporarily store various types of data that has been output or is about to be output.
[0109] Example 7 An embodiment of the present application further provides a computer program product, including a computer program, which implements the method in the above embodiment when executed by a processor.
[0110] Obviously, those skilled in the art should understand that the modules or steps of the above-mentioned embodiments of the present application can be implemented using general-purpose computer devices. They can be concentrated on a single computer device or distributed on a network composed of multiple computer devices. Alternatively, they can be implemented using program codes executable by the computer device, so that they can be stored in a storage device and executed by the computer device. In some cases, the steps shown or described can be performed in a different order than herein, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the embodiments of the present application are not limited to any specific combination of hardware and software.
[0111] It should be noted that the above are only preferred embodiments of the present application and do not limit the scope of patent protection of the present application. Any equivalent structure or equivalent process transformation made using the contents of the description and drawings of this application, or directly or indirectly applied in other related technical fields, are also included in the scope of patent protection of the present application.
Claims
1. A method for adjusting a virtual image, characterized in that: For a server, the method comprises: Receiving a virtual image adjustment request sent by a viewer terminal, wherein the virtual image adjustment request includes a virtual image identifier and a target resource identifier; Acquire the virtual image and the target resource according to the virtual image identifier and the target resource identifier; Adjust the virtual image according to the target resource to generate a new virtual image; A new live stream is synthesized based on the new virtual image, and the new live stream is pushed to the audience terminal to display the new virtual image through the audience terminal.
2. The method according to claim 1, characterized in that The virtual image includes a virtual image model and a visual component, wherein the visual component is mounted on the virtual image model, and the visual component includes one or more of clothing, accessories and props.
3. The method according to claim 2, characterized in that The target resource corresponds to a target visual component; Correspondingly, adjusting the virtual image according to the target resource to generate a new virtual image includes: Determining a mounting position of the target visual component on the avatar model; Determining whether there is an existing visual component at the mounting location; In the case where the original visual component exists at the mounting position, removing the original visual component, and loading the target visual component to the mounting position; In a case where the original visual component does not exist at the mounting position, the target visual component is loaded into the mounting position.
4. The method according to claim 1, characterized in that: The virtual image adjustment request further includes account information, and the account information includes an account identifier; Correspondingly, acquiring the virtual image and the target resource according to the virtual image identifier and the target resource identifier includes: Obtaining account permissions according to the account identifier; Determining whether the account permissions include avatar adjustment permissions; In the case where the virtual image adjustment authority is included, searching for the target resource in a preset virtual image resource library according to the target resource identifier; If the target resource is not found, sending a resource failure notification to the viewer terminal; When the target resource is found, the target resource is acquired from the virtual image database.
5. The method according to claim 4, characterized in that The account information also includes adjustment operation records; Correspondingly, synthesizing a new live stream based on the new virtual image includes: Inputting the adjustment operation record and the new virtual image into a pre-trained virtual image review model to obtain a review result for the new virtual image; If the review result is passed, synthesizing the new live stream based on the new avatar; In the case where the review result is failure, the virtual image adjustment permission is removed from the account permissions, and a permission warning notification is sent to the viewer terminal.
6. A method for adjusting a virtual image, characterized in that: For audience terminals, including: Displaying a live broadcast interface, wherein the live broadcast interface is used to display a virtual image; In response to an adjustment operation on the virtual image, a virtual image adjustment request is generated, the virtual image adjustment request including a virtual image identifier and a target resource identifier, the virtual image identifier corresponds to the virtual image, the target resource identifier corresponds to a target resource for adjusting the virtual image, and the target resource is specified by the adjustment operation; The virtual image adjustment request is sent to a server, wherein the server is used to: adjust the virtual image based on the virtual image adjustment request to generate a new virtual image; and synthesize a new live stream based on the new virtual image; The new live broadcast stream sent by the server is received, and the new virtual image is displayed on the live broadcast interface based on the new live broadcast stream.
7. The method according to claim 6, characterized in that The live broadcast interface includes a virtual image adjustment area, wherein the virtual image adjustment area is configured with a plurality of adjustment controls, and one adjustment control corresponds to one resource; Correspondingly, in response to the adjustment operation on the virtual image, generating a virtual image adjustment request includes: In response to selecting one of the adjustment controls, determining a target resource and obtaining a target resource identifier; Based on the virtual image, obtaining a virtual image identifier; The virtual image adjustment request is generated based on the virtual image identifier and the target resource identifier.
8. A virtual image adjustment device, characterized in that: For a server, the device comprises: A receiving module, configured to receive a virtual image adjustment request sent by a viewer terminal, wherein the virtual image adjustment request includes a virtual image identifier and a target resource identifier; An acquisition module, used for acquiring the virtual image and the target resource according to the virtual image identifier and the target resource identifier; A generating module, used for adjusting the virtual image according to the target resource to generate a new virtual image; The push module is used to synthesize a new live stream based on the new virtual image, and push the new live stream to the audience terminal to display the new virtual image through the audience terminal.
9. A virtual image adjustment device, characterized in that: For a viewer terminal, the device comprises: A display module, used to display a live broadcast interface, wherein the live broadcast interface is used to display a virtual image; a response module, configured to generate a virtual image adjustment request in response to an adjustment operation on the virtual image, wherein the virtual image adjustment request includes a virtual image identifier and a target resource identifier, wherein the virtual image identifier corresponds to the virtual image, and the target resource identifier corresponds to a target resource for adjusting the virtual image, and the target resource is specified by the adjustment operation; A sending module, configured to send the virtual image adjustment request to a server, wherein the server is configured to: adjust the virtual image based on the virtual image adjustment request to generate a new virtual image; and synthesize a new live stream based on the new virtual image; A display module is used to receive the new live broadcast stream sent by the server, and display the new virtual image on the live broadcast interface based on the new live broadcast stream.
10. A computer device, characterized in that: include: at least one processor; and a memory communicatively connected to the at least one processor; wherein: The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 7.
11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a processor, the method according to any one of claims 1 to 7 is implemented.
12. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to claims 1 to 7 are implemented.