Live video display method and device
By introducing flexible configurations of motion capture and surface capture technologies and control equipment in live broadcast scenarios, multiple control mode switching is provided, which solves the problem of single operation mode of virtual image and improves the diversity and user experience of virtual character control.
Patent Information
- Application Number
- CN202211538639.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-02
- Publication Date
- 2025-07-18
- Estimated Expiration
- 2042-12-02
AI Technical Summary
In the prior art, the operation mode of virtual images in live broadcast scenarios is single and lacks a diversified driving method.
Through the automatic switching and flexible configuration of motion capture and surface capture technology with keyboard, mouse and other control devices, diversified virtual image driving and scene interaction are achieved, and the switching of device control mode, action control mode and semi-automatic control mode is provided.
It enriches the control methods of virtual characters in live broadcast scenarios, realizes switching of different control modes, and improves the user's viewing experience.
Smart Images

Figure CN116016963B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of computer technology, and particularly to a method for displaying live broadcast images. This application also relates to a live broadcast image display device, a computing device, and a computer-readable storage medium. Background Art
[0002] With the continuous development of computer technology, network live broadcast technology is also constantly improving; in order to enrich the live broadcast form, a real anchor can manipulate a virtual character to complete the live broadcast, thereby improving the viewing experience of the viewing users.
[0003] However, the current ways for an anchor to drive a virtual image in a live broadcast room can only achieve the driving of the virtual image by capturing the actions or facial expressions of the real anchor, or only achieve the driving of the virtual image based on associated devices such as keyboards and mice, resulting in a relatively single operation method for the virtual image at that time.
[0004] Therefore, how to enrich the operation methods for virtual images in live broadcast scenarios has become a technical problem that needs to be solved urgently by those skilled in the art. Summary of the Invention
[0005] In view of this, embodiments of this application provide a method for displaying live broadcast images. This application also relates to a live broadcast image display device, a computing device, and a computer-readable storage medium to solve the problem of the lack of diversified virtual character driving methods in the prior art.
[0006] According to the first aspect of the embodiments of this application, a method for displaying live broadcast images is provided, including:
[0007] Display an initial virtual image generated by a target virtual character based on a first control mode in a target live broadcast room;
[0008] Receive a control mode switching request generated based on a preset trigger condition, where the control mode switching request includes switching information;
[0009] Switch the first control mode to a second control mode based on the switching information, where the first control mode and the second control mode include a device control mode or an action control mode or a semi-automatic control mode;
[0010] Obtain character data according to the second control mode, and map the character data to the target virtual character to obtain a target virtual image;
[0011] Display the target virtual image in the target live broadcast room.
[0012] According to the second aspect of the embodiments of this application, a live broadcast image display device is provided, including:
[0013] The first display module is configured to display an initial virtual image generated by a target virtual character based on a first control mode in a target live broadcast room;
[0014] The receiving module is configured to receive a control mode switching request, where the control mode switching request includes switching information;
[0015] The switching module is configured to switch the first control mode to a second control mode based on the switching information, where the first control mode and the second control mode include a device control mode or an action control mode or a semi-automatic control mode;
[0016] The mapping module is configured to obtain character data according to the second control mode and map the character data to the target virtual character to obtain a target virtual image;
[0017] The second display module is configured to display the target virtual image in the target live broadcast room.
[0018] According to a third aspect of an embodiment of the present application, a computing device is provided, including a memory, a processor, and computer instructions stored on the memory and executable on the processor. When the processor executes the computer instructions, the steps of the live broadcast image display method are implemented.
[0019] According to a fourth aspect of an embodiment of the present application, a computer-readable storage medium is provided, which stores computer instructions. When the computer instructions are executed by a processor, the steps of the live broadcast image display method are implemented.
[0020] The live broadcast image display method provided by the present application displays an initial virtual image generated by a target virtual character based on a first control mode in a target live broadcast room; receives a control mode switching request generated based on a preset trigger condition, where the control mode switching request includes switching information; switches the first control mode to a second control mode based on the switching information, where the first control mode and the second control mode include a device control mode or an action control mode or a semi-automatic control mode; obtains character data according to the second control mode and maps the character data to the target virtual character to obtain a target virtual image; and displays the target virtual image in the target live broadcast room.
[0021] An embodiment of the present application realizes that when an initial virtual image generated based on a first control mode is displayed in a target live broadcast room, it can be switched to a second control mode based on a control mode switching request and display the target virtual image in the second control mode, thereby enriching the control methods of virtual characters. Description of the Drawings
[0022] Figure 1 It is a schematic diagram of a scenario of a live video display method provided by an embodiment of the present application;
[0023] Figure 2a It is a flowchart of a live video display method provided by an embodiment of the present application;
[0024] Figure 2b It is a schematic diagram of a process for detecting a camera device provided by an embodiment of the present application;
[0025] Figure 3 It is a processing flowchart of a live video display method applied to a game scenario provided by an embodiment of the present application;
[0026] Figure 4 It is a schematic structural diagram of a live video display device provided by an embodiment of the present application;
[0027] Figure 5 It is a structural block diagram of a computing device provided by an embodiment of the present application. Detailed implementation manners
[0028] In the following description, many specific details are set forth in order to provide a thorough understanding of the present application. However, the present application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the connotation of the present application. Therefore, the present application is not limited by the specific implementations disclosed below.
[0029] The terms used in one or more embodiments of the present application are for the purpose of describing specific embodiments only and are not intended to limit one or more embodiments of the present application. The singular forms "a", "the" and "said" used in one or more embodiments of the present application and the appended claims are also intended to include the plural forms unless the context clearly dictates otherwise. It should also be understood that the term "and / or" used in one or more embodiments of the present application refers to and includes any or all possible combinations of one or more of the associated listed items.
[0030] It should be understood that although the terms first, second, etc. may be used in one or more embodiments of the present application to describe various information, such information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of one or more embodiments of the present application, the first may also be referred to as the second, and similarly, the second may also be referred to as the first. Depending on the context, the word "if" as used herein may be interpreted as "when" or "while" or "in response to determining".
[0031] First, the noun terms related to one or more embodiments of the present application are explained.
[0032] Motion capture: Record the limb movements of the observed object (person, object, or animal) through various technical means.
[0033] Face capture: Record the facial movements of the observed object (person, object, or animal) through various technical means.
[0034] Currently, virtual live broadcasts mainly use motion capture / face capture technology in virtual scenarios for live broadcasts, lacking diverse virtual character driving methods.
[0035] The solution of this application realizes more diverse virtual character driving and scene interaction through the automatic switching and flexible configuration of motion capture, face capture methods and operations of control devices such as keyboards and mice.
[0036] In this application, a method for displaying a live broadcast screen is provided. This application also relates to a device for displaying a live broadcast screen, a computing device, and a computer-readable storage medium, which will be described in detail one by one in the following embodiments.
[0037] Figure 1 The following shows a schematic diagram of a scenario of a method for displaying a live broadcast screen according to an embodiment of this application:
[0038] It should be noted that the method for displaying a live broadcast screen of this application can be applied to a multi-anchor live broadcast scenario, and each anchor can control the virtual character in the virtual scenario through the anchor client. Among them, the multi-anchor live broadcast scenario refers to a scenario where multiple anchors can interact in the same virtual scenario.
[0039] The target anchor opens the target live broadcast room, where the target live broadcast room can display the virtual character of the target anchor; there can be three control modes for the virtual character in the target live broadcast room:
[0040] Control mode 1 is the device-only control mode. If the target anchor uses the computer side for live broadcast, the virtual character can be controlled based on control devices such as a mouse and a keyboard. For example, the virtual character can be moved based on the W, A, S, and D keys on the keyboard, the perspective of the virtual character in the virtual scenario can be changed by sliding the mouse, the space bar is used to jump, holding down the shift key to run fast, the C key to crouch, the F key to pick up items for interaction, etc.; if the target anchor uses the mobile phone side for live broadcast, the virtual character can be controlled based on virtual devices such as a virtual joystick, a virtual sub-joystick, and icon buttons; the control of the virtual character can include the control of the virtual character itself, such as controlling the virtual character to move forward, jump, etc.; it can also include the control of the virtual character to interact with virtual objects in the virtual scenario, such as interacting with other virtual characters in the virtual scenario, interacting with props in the virtual scenario, etc.
[0041] Control mode 2 is the action-only control mode, which can be enabled if the target host uses a client including an image acquisition device; in this mode, the host image of the target host is collected by the image acquisition device, and the virtual drive data is parsed from the host image; the virtual character is controlled based on the virtual drive data.
[0042] Control mode 3 is a semi-automatic control mode. If the default mode of the target live room of the target live broadcast is the device control mode and the action control mode is enabled, the virtual character can be switched and controlled between the device control mode and the action control mode based on the needs of the target host during the live broadcast, so as to enrich the control method of the virtual character in the live broadcast scenario, that is, some parts of the virtual character can be driven by the motion capture data without the need to control the device operation; there is a mode switching button on the host client interface, and the action control mode can be turned on or off by touching the mode switching button.
[0043] Specifically, if the current target host operates the virtual character based on the control device, when the target host stops operating, the motion capture data of the target host can be automatically collected for controlling the virtual character; if the virtual character is controlled based on the action control mode, the target host can directly operate the virtual character based on the control device, that is, it can be directly switched from the action control mode to the device control mode; further, different control modes can be adopted according to different parts of the virtual character for control, such as the face of the virtual character is controlled by the face capture control method for movement, and the upper body of the virtual character is controlled by the device control method for movement, etc.
[0044] In an embodiment of the present application, when the initial virtual screen generated based on the device control mode is displayed in the target live room, the target virtual screen can be displayed based on the control model switching request, thus enriching the control method of the virtual character and realizing the switching of different control modes of the virtual character; the virtual character drive data is collected according to the character part type information, increasing the control methods for different parts of the virtual character, thereby further enriching the control method of the virtual character.
[0045] Figure 2a The flowchart of a live screen display method provided by an embodiment of the present application is shown, which specifically includes the following steps:
[0046] Step 202: Display the initial virtual screen of the target virtual character generated based on the first control mode in the target live room.
[0047] Among them, the target live broadcast room refers to the live broadcast room created by the live broadcast platform based on the live broadcast request of the target anchor; the target virtual character refers to the virtual character corresponding to the target anchor that can be displayed in the target live broadcast room; the first control mode refers to one of the virtual character control methods that the target live broadcast room can adopt. In practical applications, the first control mode can be a device control mode, an action control mode, or a semi-automatic control mode. The device control mode refers to the mode of controlling the virtual character based on the device control data triggered by the target anchor. In this control mode, the target anchor can operate the target virtual character based on the control device. The control device can be a physical device such as a mouse, keyboard, or microphone, or a virtual device such as a virtual joystick or virtual button, and no specific limitation is applied. The action control mode refers to the mode of controlling the virtual character based on the motion capture data of the target anchor. The semi-automatic control mode refers to the mode of controlling the virtual character based on the motion capture data and / or device control data corresponding to the target anchor. The initial virtual screen refers to the screen generated by the target anchor by controlling the virtual character.
[0048] Specifically, the target virtual character corresponding to the target anchor in the target live broadcast room is displayed in the target live broadcast room. The target virtual character can be controlled based on the first control mode to generate an initial virtual screen.
[0049] Step 204: Receive a control mode switching request generated based on a preset trigger condition, where the control mode switching request contains switching information.
[0050] Among them, the preset trigger condition refers to the condition that can trigger the switching of the control mode of the target live broadcast room. Specifically, the preset trigger condition can be an anchor trigger condition, a control device trigger condition, or a character part trigger condition. The anchor trigger condition refers to the condition under which the target anchor in the target live broadcast room can generate a mode switching request by triggering the mode switching control of the target live broadcast room. The control device trigger condition refers to the condition under which, when the control mode corresponding to the virtual character is not the device control mode, the target anchor generates a mode switching request by triggering the control device. The character part trigger condition refers to the condition of triggering a mode switching request according to the character part type information of the virtual character.
[0051] The control mode switching request refers to the request for switching the control mode of the target virtual character. The control mode switching request can be generated by the target anchor switching the mode by himself, or can be generated when receiving the control information of other control modes. The switching information refers to the information that can uniquely represent the second control mode. For example, the switching information is the mode identifier, mode name, etc. of the action control mode.
[0052] Specifically, when the initial virtual screen is displayed in the target live room, a control mode switching request generated according to a preset trigger condition can be received. For example, according to the condition of the host's action control mode for opening the target live room, a control mode switching request for switching the control mode from the device control mode to the action control mode is generated.
[0053] Step 206: Switch the first control mode to the second control mode based on the switching information, where the first control mode and the second control mode include a device control mode, an action control mode, or a semi-automatic control mode.
[0054] Among them, the second control mode refers to a virtual character control method different from the first control mode that can be adopted in the target live room. The second control mode can be a device control mode, an action control mode, or a semi-automatic control mode; for example, it is determined that the first control mode is the device control mode and the second control mode is the action control mode, etc.
[0055] Specifically, parse the control mode switching request to determine the switching information; determine the second control mode according to the switching information, and switch the control mode of the target live room from the first control mode to the second control mode.
[0056] Step 208: Obtain the role data according to the second control mode, and map the role data to the target virtual character to obtain the target virtual screen.
[0057] Among them, the role data refers to the data used to drive the target virtual character. For example, in the device control mode, the role control information of the target virtual character is used to drive the target virtual character to generate a corresponding virtual screen. In the action control mode, the role driving information of the target virtual character is used to drive the target virtual character to generate a corresponding virtual screen; the target virtual screen refers to the virtual screen obtained based on the role data and the target virtual character.
[0058] Specifically, obtain the role data corresponding to the mode according to the second control mode, and map the role data to the target virtual character, so as to obtain the target virtual screen in the second control mode.
[0059] Step 210: Display the target virtual screen in the target live room.
[0060] Specifically, after obtaining the target virtual screen corresponding to the preset virtual screen or the virtual character driving data, directly display the preset virtual screen or the target virtual screen; in practical applications, the control modes corresponding to different character parts can be different. Therefore, if the preset virtual screen and the target virtual screen are received, the preset virtual screen or the target virtual screen needs to be fused and displayed.
[0061] Further, in the case where the first control mode is the device control mode and the second control mode is the action control mode, the steps of switching the control mode and generating the corresponding virtual screen are as follows:
[0062] Display the initial virtual screen generated by the target virtual character based on the device control mode in the target live broadcast room;
[0063] Receive a control mode switching request, where the control mode switching request carries character part type information;
[0064] Collect the virtual character drive data corresponding to the target anchor according to the character part type information;
[0065] Map the virtual character drive data to the target virtual character according to the character part type information to obtain the target virtual screen;
[0066] Display the target virtual screen in the target live broadcast room.
[0067] Specifically, the target anchor can set the control mode of the virtual character based on requirements in the target live broadcast room; in the case where the control mode of the target live broadcast room is the device control mode by the target anchor's device or the default control mode of the target live broadcast room is the device control mode, the initial virtual screen generated based on the device control mode can be displayed in the target live broadcast room.
[0068] In a specific embodiment of the present application, the teaching anchor opens the virtual classroom live broadcast room and sets the control mode of the virtual teacher to the device control mode; the teaching anchor can control the movement of the virtual teacher in the virtual classroom live broadcast room by moving the mouse, so as to display the virtual animation generated by controlling the virtual teacher with the mouse for the virtual teacher in the virtual classroom live broadcast room.
[0069] Further, before displaying the initial virtual screen in the target live broadcast room, it is necessary to first generate the initial virtual screen based on the character information corresponding to the target virtual character.
[0070] Specifically, before displaying the initial virtual screen generated by the target virtual character based on the device control mode in the target live broadcast room, it may further include:
[0071] Receive a character control request for the target virtual character, and determine device control information and control part type information based on the character control request;
[0072] Map the device control information to the target virtual character based on the control part type information to obtain the initial virtual screen.
[0073] Among them, the role control request refers to a request generated when the target host controls a virtual role through a control device; the role control request includes device control information and control part type information; the device control information refers to the control information for the target virtual role. For example, the device control information is to make the virtual teacher raise the right hand; the control part type information refers to the type of part of the virtual role that the role control request needs to control, such as the upper body, lower body, head, etc. of the virtual teacher.
[0074] Specifically, after the host client receives a role control request for a target virtual role, it parses the role control request to determine the device control information and the control part type information; based on the control part type information, it can determine which part of the target virtual role needs to be adjusted, and based on the device control information, it can determine the adjustment form of the part of the target virtual role.
[0075] In a specific embodiment of the present application, the host client used by the teaching host to start a live broadcast receives a virtual role control request for the virtual teacher; parsing the virtual role control request obtains the device control information as raising the right arm by the virtual teacher, and obtains the control part type information as the arm part; mapping the device control information to the arm part of the virtual teacher to obtain an initial virtual image.
[0076] An initial virtual image is generated based on the device control information and the control part type information, so as to be displayed in the target live broadcast room on the screen where the target host controls the virtual role based on the control device.
[0077] Furthermore, the role part type information refers to the role part type information of the target virtual role, such as head information, hand information, upper body information, etc.
[0078] Specifically, the host client receives a control mode switching request, and the control mode switching request includes the role part type information for the target virtual role; in practical applications, the control mode switching request can be generated by the target host by triggering a mode button in the client interface. For example, the target host clicks the semi-automatic control mode opening button on the host client interface to generate a control mode switching request; the control mode switching request can be automatically switched when receiving control information of other modes. For example, when the target host controls the virtual role based on the control device and receives the host face drive data collected by the camera, a control mode switching request can be generated based on the host face drive data, so as to facilitate replacing the virtual role face animation generated based on the control information of the control device with the current virtual role animation obtained by face capture in the target live broadcast room later.
[0079] In a specific embodiment of the present application, the teaching host turns on the semi-automatic control mode in the virtual classroom live broadcast room; when controlling the virtual teacher based on the control device, if the motion capture data of the teaching teacher is received, a control mode switching request can be generated based on it, so that subsequent adjustments to the current device control can be made to action control based on the control mode switching request.
[0080] By receiving the control mode switching request, subsequent adjustments to the virtual animation can be made based on the control mode switching request.
[0081] Further, after receiving the control mode switching request, the role part type information can be determined based on the control mode switching request. The role part type information refers to the corresponding information of the role parts of the target virtual role. For example, the role part type information is head information, hand information, etc.; based on the role part type information, data used to drive the target virtual role in the new control mode can be collected.
[0082] Among them, the virtual role driving data refers to the data used to drive the target virtual role to generate a virtual image. For example, the virtual role driving data is pick-up item data, blink data, etc.
[0083] Specifically, by parsing the received control mode switching request to obtain the role part type information, that is, determining which parts of the target virtual role need to switch the control mode; further collecting the virtual role driving data corresponding to the target host based on the role part type information to drive the role parts of the target virtual role.
[0084] In practical applications, the method of collecting the virtual role driving data corresponding to the target host according to the role part type information may include:
[0085] Start the target acquisition device and collect the host image of the target host based on the target acquisition device;
[0086] Obtain the virtual role driving data in the host image based on the role part type information.
[0087] Among them, the target acquisition device refers to a device that can collect the image of the target host. For example, the target acquisition device is an image acquisition device configured on the host client, or an image acquisition device having a transmission connection with the host client, etc.; the host image refers to the image of the target host collected by the target acquisition device, such as the host video, host photo, etc.
[0088] Further, the method of obtaining the virtual role driving data in the host image based on the role part type information may include:
[0089] Parse the host image to obtain the host action information;
[0090] Extract virtual character driving data from the host action information according to the character part type information.
[0091] Among them, the host action information refers to the action information of the target host parsed from the host image, such as the action information of the host waving or making a fist in the host video.
[0092] Specifically, obtain the host image collected by the target acquisition device; input the host image into the action information acquisition model to obtain the host action information output by the action information acquisition model; determine the target virtual character at the target character part based on the character part type information, and collect the host action information corresponding to the target character part in the host action information as virtual character driving data.
[0093] In a specific embodiment of the present application, in response to a control mode switching request, start the image acquisition device having a data transmission connection with the host client; obtain the host video of the target host collected by the image acquisition device; extract the host action information in the host video, and determine the target character part of the virtual teacher according to the character part type information; screen the host action information corresponding to the target character part in the host action information as virtual character driving data.
[0094] In practical applications, before displaying the initial virtual screen generated by the target virtual character based on the first control mode in the target live room, it further includes:
[0095] Detect the camera device corresponding to the target live room and the on state of the camera device;
[0096] When it is determined that the target camera device is in the on state, determine that the first control mode is the action control mode.
[0097] That is, it is possible to determine whether the action control mode can be enabled by detecting whether the host client is connected to or has the camera device enabled; as Figure 2b shown, Figure 2b is a schematic flow chart of detecting a camera device provided by an embodiment of the present application. The specific detection method includes steps S1 to S7:
[0098] Step S1: The target host enters the target live room.
[0099] Step S2: Load the virtual scene information and virtual character information of the target live room.
[0100] Step S3: Detect whether there is a usable camera device in the host client where the target host is located and the number of corresponding camera devices; if there are multiple camera devices, execute step S4, if there is only one camera device, execute step S5; if there is no usable camera device, execute step S6.
[0101] Step s4: Select a default camera device from multiple camera devices, and continue to execute Step s5.
[0102] Step s5: The target live broadcast room automatically enables the action control mode.
[0103] Step s6: The action control mode is in the closed state, and a prompt indicates that the action control mode fails to be enabled.
[0104] Step s7: In the action control mode, based on the virtual character driving data collected by the default camera, control the virtual character to enable the target host to control the target virtual character to interact in the virtual scene.
[0105] Collect the host image of the target host through the target acquisition device to control the virtual character based on the host image; determine the virtual character driving data in the host image based on the character part type information for subsequent driving of the target virtual character based on the virtual character driving data.
[0106] Furthermore, after determining the virtual character driving data, the character parts of the target virtual character can be driven according to the virtual character driving data to obtain the target virtual screen.
[0107] Among them, the target virtual screen refers to obtaining a virtual screen based on the virtual character data and the target virtual character.
[0108] Specifically, after obtaining the virtual character driving data corresponding to the character part type information, the virtual character driving data can be mapped to the virtual character part corresponding to the character part type information based on the character part type information, that is, the virtual character driving data is mapped to the target virtual character, so as to obtain the target virtual screen for virtual character control based on the virtual character driving data.
[0109] In practical applications, the method of mapping the virtual character driving data to the target virtual character according to the character part type information to obtain the target virtual screen may include:
[0110] Determine the target character part of the target virtual character according to the character part type information;
[0111] Determine the character part attribute information corresponding to the target character part;
[0112] Adjust the character part attribute information based on the virtual character driving data to obtain the target virtual screen.
[0113] Among them, the target character part refers to the character part determined in the target virtual character according to the character part type information; the character part attribute information refers to the attribute information corresponding to each target character part. For example, the attribute information corresponding to the arm part is horizontal abduction, 90-degree downward bend, and so on.
[0114] Specifically, according to the character part type information in the control mode switching request, determine the target character part in the target virtual character, such as the head, hand, etc.; obtain the character database corresponding to the target character part, and screen the character part attribute information corresponding to the target character part in the character database. The character part attribute information includes character attribute values, such as part height values, part angle values, etc.; determine the character drive values included in the virtual character drive data, and replace the character attribute values based on the character drive values to obtain the target virtual screen.
[0115] In a specific embodiment of the present application, determine the character hand and the character head in the virtual parts corresponding to the virtual teacher according to the character part type information "hand" and "head"; collect the hand attribute values corresponding to the character hand and the head attribute values corresponding to the character head in the database corresponding to the virtual teacher; replace the hand attribute values according to the drive hand attribute values in the virtual character data, and replace the head values according to the drive head attribute values to obtain the target virtual screen.
[0116] In practical applications, each virtual character can have corresponding character states in the virtual scene, such as dancing state, walking state, item picking state, etc.; in different character state cases, different character parts can be controlled in different control modes to ensure the stability of the virtual screen.
[0117] Specifically, before collecting the virtual character drive data corresponding to the target anchor according to the character part type information, it may further include:
[0118] Obtain the current character state of the target virtual character;
[0119] Based on the current character state, determine the static part information and dynamic part information in the character part type information.
[0120] Among them, the current character state refers to the character state of the target virtual character in the target live room. For example, the current character state is a dancing state, a flying state, etc.; based on the current character state, the character part type information can be divided into static part information and dynamic part information; the static part information refers to the character parts that can be static for the target virtual character in the current character state; the dynamic part information refers to the character parts that can be dynamic for the target virtual character in the current character state; for example, when the virtual character is in a sitting character state, the lower body part can be a static part, and the upper body part can be a dynamic part. When the virtual character is in a dancing character state, the face can be a static part, and the upper body can be a dynamic part, etc.
[0121] Specifically, obtain the current character state of the target virtual character in the target live room. The current character state can be set by the target anchor himself or set by default in the target live room; in practical applications, when the virtual character is in a dynamic state, when mapping the collected action data or facial data of the anchor to the virtual character, the obtained virtual screen stability is poor, affecting the user viewing experience. Therefore, according to the current character state information, the character part type information can be classified to determine the static part information and the dynamic part information.
[0122] To solve the problem of poor virtual screen stability mentioned above, the present application processes the parts corresponding to the static part information and the parts corresponding to the dynamic part information respectively; specifically: the parts corresponding to the static part information can be driven by the action data or facial data of the anchor, and the parts corresponding to the dynamic part information are displayed based on the preset virtual screen.
[0123] Specifically, when the character part information includes static part information, the method for collecting the virtual character driving data corresponding to the target anchor according to the character part type information may include:
[0124] Determine the static parts of the target virtual character according to the static part information;
[0125] Collect the virtual character driving data corresponding to the target anchor based on the static parts.
[0126] Among them, the static part refers to the part that can be static for the target virtual character in the current character state.
[0127] In practical applications, the character part type information may only include static part information, may only include dynamic part information, or both static part information and dynamic part information; for example, if the current state of the virtual character is a standing state, the character part type information may only include static part information. If the current state of the virtual character is a dancing state, the character part type information may only include dynamic part information.
[0128] In a specific embodiment of the present application, when the current role state of the virtual teacher is obtained as the standing state and the target role part type information includes head part information and upper body part information, it is determined that both the head part information and the upper body part information are static part information; further, according to each static part information, the face capture data and motion capture data of the target anchor, that is, the teaching teacher, corresponding to the virtual teacher are collected, and the virtual character driving data is determined based on the face capture data and the motion capture data.
[0129] Specifically, in the case where the role part information includes dynamic part information, the method for collecting the virtual character driving data corresponding to the target anchor according to the role part type information may include:
[0130] Determine the dynamic parts of the target virtual character according to the dynamic part information;
[0131] Based on the dynamic parts, obtain the preset virtual character animations corresponding to the target anchor.
[0132] Among them, the dynamic part refers to the part of the target virtual character that is dynamic in the current role state; the preset virtual character animation refers to the virtual character dynamics corresponding to the dynamic part, which is a virtual character animation generated in advance for the dynamic part; when displaying the preset virtual character animation, no manipulation by the target anchor is required.
[0133] In a specific embodiment of the present application, the current role state of the virtual teacher is obtained as the dancing state, and the target role part type information includes upper body part information and lower body part information; according to the dancing state, it is determined that both the upper body part information and the lower body part information are dynamic part information; further, the preset virtual character animations corresponding to each dynamic part information are obtained.
[0134] In a preferred embodiment of the present application, the preset virtual character animations and / or virtual character driving data corresponding to the role part type information can be determined based on a preset role state list; as shown in Table 1 below:
[0135] Table 1
[0136]
[0137]
[0138] The information on the types of character parts corresponding to the virtual character includes facial information, head information, upper body information, and lower body information; when the virtual character is in a standing state, the facial information, head information, and upper body information are determined as static part information, that is, the motion capture data corresponding to the target anchor can be collected and mapped to the virtual character, and the lower body information is determined as dynamic part information, that is, the preset virtual screen corresponding to the lower body information can be collected;
[0139] When the virtual character is in a walking state, the facial information and head information are determined as static part information, and the upper body information and lower body information are determined as dynamic part information;
[0140] When the virtual character is in a sitting state, the facial information, head information, and upper body information are determined as static part information, and the lower body information is determined as dynamic part information;
[0141] When the virtual character is in a state of picking up an item, the facial information is determined as static part information, and the head information, upper body information, and lower body information are determined as dynamic part information. After the state of picking up an item ends, motion capture can be performed in the state of holding an item, that is, the standing state while holding an item;
[0142] When the virtual character is in a flying state, the facial information is determined as static part information, and the lower body information, head information, and upper body information are determined as dynamic part information. For example, during the flying process, the facial expression of the anchor obtained through face capture is displayed;
[0143] When the virtual character is in a dancing state, the facial information is determined as static part information, and the lower body information, head information, and upper body information are determined as dynamic part information. For example, during the dancing process, the facial expression of the anchor obtained through face capture is displayed;
[0144] In this embodiment, since the target anchor in the live broadcast room is usually in a sitting action for the live broadcast, the actions of the lower body are all displayed by preset animations. If motion capture of the lower body is required in actual applications, the above Table 1 can be adjusted based on the requirements.
[0145] It should be noted that after obtaining the virtual character drive data corresponding to the static part information, the virtual character drive data needs to be mapped to the target virtual character according to the static part information to obtain the target virtual screen; and after obtaining the preset virtual screen corresponding to the dynamic part information, the preset virtual screen can be directly displayed in the target live broadcast room subsequently.
[0146] Further, in addition to determining whether to use the action control mode for the character part based on the current character state, a part mode switching control can also be configured on the host client interface, such as a hand motion capture control, a head motion capture control, etc.; the target host can turn on or off the action control mode for the corresponding part based on the part mode switching control. For example, turn on hand motion capture, turn off head motion capture, and display the corresponding preset virtual animation of the head at the same time.
[0147] The above solution describes the steps of controlling a virtual character by switching from the device control mode to the action control mode. In actual applications, it is also possible to switch from the action control mode to the device control mode to control the virtual character, thus enriching the control method of the virtual character and facilitating the target host to control the virtual character.
[0148] Specifically, the method further includes:
[0149] Display a first virtual image of the target virtual character generated based on the action control mode in the target live room;
[0150] Receive a control mode switching request, where the control mode switching request carries character part type information and character control information;
[0151] Map the character control information to the target virtual character based on the character part type information to obtain a second virtual image;
[0152] Display the second virtual image in the target live room.
[0153] Among them, the first virtual image refers to the image generated by operating the virtual character through motion capture data; the character control information refers to the control information sent based on the control device. For example, the character control information is to move the target virtual character forward two steps; the second virtual image refers to the image generated by operating the virtual character based on the character part type information and the character control information.
[0154] In actual applications, the control mode switching request can be triggered by the target host or generated after receiving the character information; that is, in the case where the control mode is in the semi-automatic mode, it is possible to switch from the action control mode to the device control mode through the received character information, or switch from the device control mode to the action control mode through the received motion capture data, or simultaneously control different parts of the target virtual character by the action control mode and the device control mode respectively, thus enriching the virtual character control method and improving the user experience.
[0155] After generating the target virtual image or the second virtual image on the host client, the target virtual image or the second virtual image can be pushed to the server in the form of a live stream; the viewer client entering the target live room pulls the live stream from the server, so as to realize the viewing of the content of the target live room.
[0156] When the control mode of the target virtual character in the target live room is the action control mode, it can also be switched from the action control mode to the semi-automatic control mode for control. Specifically, when the first control mode is the action control mode and the second control mode is the semi-automatic control mode, the initial virtual image generated by the target virtual character based on the first control mode is displayed in the target live room, including:
[0157] Display the first virtual image generated by the target virtual character based on the action control mode in the target live room;
[0158] Receive a control mode switching request, where the control mode switching request carries target character part type information and target character control information;
[0159] Determine the other character part type information corresponding to the target virtual character based on the target character part type information;
[0160] Collect the target virtual character drive data corresponding to the target host based on the other character part type information;
[0161] Map the character control information to the target character part of the target virtual character based on the target character part type information, and map the target virtual character drive data to the other character parts of the target virtual character based on the other character part type information to obtain a second virtual image;
[0162] Display the second virtual image in the target live room.
[0163] Specifically, when in the action control mode, parse the received control mode switching request to determine the target character part type information, where the target character part type information refers to the type information of the target character part of the target virtual character. For example, if it is determined that the head of the target virtual character is the target part, the type information corresponding to the head is the target character part type information; determine that the target character part corresponding to the target character part type information is the part that needs to be controlled by the control device; determine the other character part type information of the target virtual character based on the target character part type information, where the other character part type information refers to the type information corresponding to the other character parts of the target virtual character except the target character part. For example, if it is determined that the target character part of the target virtual character is the head, its other character parts are the upper body and the lower body, that is, the type information corresponding to the upper body and the lower body is the other character part type information.
[0164] After determining the target character part and other character parts, map the character control information to the target character part of the target virtual character according to the target character part type information, collect the target virtual character drive data according to the other character part type information, and map the target virtual character drive data to the other character parts of the target virtual character to generate a second virtual screen, so as to realize that the target virtual character can be controlled by the action control mode and the device control mode simultaneously in the semi-automatic control mode.
[0165] In a specific embodiment of the present application, a live broadcast screen for controlling a virtual teacher based on the action control mode is displayed in the teaching live broadcast room; a control mode switching request for the teaching live broadcast room is received, and the control mode switching request includes upper body character type information and corresponding character control information; determine other head type information of the virtual teacher according to the upper body character part type information; collect the target virtual character drive data of the target anchor according to the head type information, that is, collect the face capture data of the target anchor; map the character control data to the upper body part of the virtual teacher, and map the face capture data to the face part of the virtual teacher, while the lower body part of the virtual teacher is displayed by a preset virtual animation, so as to realize the switching of the control mode of the virtual teacher from the only action control mode to the semi-automatic control mode.
[0166] The live broadcast screen display method provided by the present application displays an initial virtual screen generated by a target virtual character based on a first control mode in a target live broadcast room; receives a control mode switching request generated based on a preset trigger condition, wherein the control mode switching request includes switching information; switches the first control mode to a second control mode based on the switching information, wherein the first control mode and the second control mode include a device control mode or an action control mode or a semi-automatic control mode; obtains character data according to the second control mode, and maps the character data to the target virtual character to obtain a target virtual screen; displays the target virtual screen in the target live broadcast room.
[0167] An embodiment of the present application realizes that when an initial virtual screen generated based on a first control mode is displayed in a target live broadcast room, it can be switched to a second control mode based on a control mode switching request, and the target virtual screen in the second control mode is displayed, thereby enriching the control methods of virtual characters.
[0168] The following combines the attached Figure 3 , taking the application of the live broadcast screen display method provided by the present application in a game scene as an example, to further illustrate the live broadcast screen display method. Among them, Figure 3The figure shows a processing flowchart of a live broadcast screen display method applied to a game scenario provided by an embodiment of the present application, which specifically includes the following steps:
[0169] Step 302: Determine the target virtual character corresponding to the target anchor in the target game live broadcast room.
[0170] Step 304: Receive a character control request for the target virtual character, and determine device control information and control part type information based on the character control request.
[0171] Step 306: Map the device control information to the target virtual character based on the control part type information to obtain an initial virtual screen.
[0172] Step 308: Display the initial virtual screen of the target virtual character in the target live broadcast room.
[0173] Step 310: Receive a first control mode switching request, where the first control mode switching request carries character part type information.
[0174] Step 312: In response to the first control mode switching request, start the target acquisition device, and acquire the anchor image of the target anchor based on the target acquisition device.
[0175] Step 314: Obtain the anchor action information in the anchor image, and extract virtual character drive data from the anchor action information according to the character part type information.
[0176] Step 316: Obtain the current character state of the target virtual character, and determine the static part information and dynamic part information in the character part type information based on the current character state.
[0177] Step 318: Determine the virtual character drive data corresponding to the target anchor according to the static part information, and determine the preset virtual character animation corresponding to the target anchor according to the dynamic part information.
[0178] Step 320: Determine the static part of the target virtual character according to the static part information, and determine the part attribute information corresponding to the static part.
[0179] Step 322: Adjust the character part attribute information based on the virtual character drive data to obtain a virtual screen.
[0180] Step 324: Integrate the virtual screen and the preset virtual character animation to obtain a target virtual screen, and display it in the target game live broadcast room.
[0181] Step 326: Receive a second control mode switching request, where the second control mode switching request carries character part type information and character control information.
[0182] Step 328: Map the character control information to the target virtual character based on the character part type information to obtain a second virtual screen.
[0183] Step 330: Display the second virtual screen in the target game live broadcast room.
[0184] The live broadcast screen display method provided by this application displays an initial virtual screen generated by a target virtual character based on a device control mode in a target live broadcast room; receives a control mode switching request, where the control mode switching request carries character part type information; collects virtual character drive data corresponding to a target anchor according to the character part type information; maps the virtual character drive data to the target virtual character according to the character part type information to obtain a target virtual screen; and displays the target virtual screen in the target live broadcast room.
[0185] In an embodiment of this application, when an initial virtual screen generated based on a device control mode is displayed in a target live broadcast room, the target virtual screen can be displayed based on a control model switching request, thereby enriching the control methods of virtual characters and realizing the switching of different control modes of virtual characters; collecting virtual character drive data according to character part type information increases the control methods of different parts of virtual characters, thereby further enriching the control methods of virtual characters.
[0186] Corresponding to the above method embodiment, this application also provides an embodiment of a live broadcast screen display device. Figure 4 The structural schematic diagram of a live broadcast screen display device provided by an embodiment of this application is shown. As Figure 4 shown, the device includes:
[0187] A first display module 402, configured to display an initial virtual screen generated by a target virtual character based on a first control mode in a target live broadcast room;
[0188] A receiving module 404, configured to receive a control mode switching request generated based on a preset trigger condition, where the control mode switching request includes switching information;
[0189] An acquisition module 406, configured to switch the first control mode to a second control mode based on the switching information, where the first control mode and the second control mode include a device control mode or an action control mode or a semi-automatic control mode;
[0190] A mapping module 408, configured to obtain character data according to the second control mode and map the character data to the target virtual character to obtain a target virtual screen;
[0191] The second display module 410 is configured to display the target virtual image in the target live broadcast room.
[0192] Optionally, the preset trigger condition includes: a host trigger condition, a control device trigger condition, and a character part trigger condition.
[0193] Optionally, the device further includes an action control sub-module, and the action control sub-module is configured to:
[0194] Display an initial virtual image generated by the target virtual character based on the device control mode in the target live broadcast room;
[0195] Receive a control mode switching request, where the control mode switching request carries character part type information;
[0196] Collect virtual character drive data corresponding to the target host according to the character part type information;
[0197] Map the virtual character drive data to the target virtual character according to the character part type information to obtain a target virtual image;
[0198] Display the target virtual image in the target live broadcast room.
[0199] Optionally, the device further includes a device control sub-module, and the device control sub-module is configured to:
[0200] Display a first virtual image generated by the target virtual character based on the action control mode in the target live broadcast room;
[0201] Receive a control mode switching request, where the control mode switching request carries character part type information and character control information;
[0202] Map the character control information to the target virtual character based on the character part type information to obtain a second virtual image;
[0203] Display the second virtual image in the target live broadcast room.
[0204] Optionally, the device further includes a semi-automatic control sub-module, and the semi-automatic control sub-module is configured to:
[0205] Display a first virtual image generated by the target virtual character based on the action control mode in the target live broadcast room;
[0206] Receive a control mode switching request, where the control mode switching request carries target character part type information and target character control information;
[0207] Determine other character part type information corresponding to the target virtual character based on the target character part type information;
[0208] Collect target virtual character drive data corresponding to the target anchor according to the other character part type information;
[0209] Map the character control information to the target character part of the target virtual character based on the target character part type information, and map the target virtual character drive data to other character parts of the target virtual character based on the other character part type information to obtain a second virtual screen;
[0210] Display the second virtual screen in the target live broadcast room.
[0211] Optionally, the device further includes a mapping sub-module, and the mapping sub-module is configured to:
[0212] Receive a character control request for a target virtual character, and determine device control information and control part type information based on the character control request;
[0213] Map the device control information to the target virtual character based on the control part type information to obtain an initial virtual screen.
[0214] Optionally, the acquisition module 406 is further configured to:
[0215] Start a target acquisition device, and acquire an anchor image of the target anchor based on the target acquisition device;
[0216] Obtain virtual character drive data in the anchor image based on the character part type information.
[0217] Optionally, the acquisition module 406 is further configured to:
[0218] Parse the anchor image to obtain anchor action information;
[0219] Extract virtual character drive data from the anchor action information according to the character part type information.
[0220] Optionally, the mapping module 408 is further configured to:
[0221] Determine the target character part of the target virtual character according to the character part type information;
[0222] Determine the character part attribute information corresponding to the target character part;
[0223] Adjust the character part attribute information based on the virtual character drive data to obtain a target virtual screen.
[0224] Optionally, the device further includes an acquisition sub-module configured to:
[0225] Acquire the current character state of the target virtual character;
[0226] Determine static part information and dynamic part information in the part type information of the character based on the current character state.
[0227] Optionally, the acquisition module 406 is further configured to:
[0228] Determine the static parts of the target virtual character according to the static part information;
[0229] Collect virtual character drive data corresponding to the target anchor based on the static parts.
[0230] Optionally, the acquisition module 406 is further configured to:
[0231] Determine the dynamic parts of the target virtual character according to the dynamic part information;
[0232] Obtain a preset virtual character animation corresponding to the target anchor based on the dynamic parts.
[0233] Optionally, the device further includes a detection module configured to:
[0234] Detect the camera device corresponding to the target live broadcast room and the on state of the camera device;
[0235] When it is determined that the target camera device is in the on state, determine that the first control mode is the action control mode.
[0236] The live broadcast screen display method provided by this application displays an initial virtual screen generated by a target virtual character based on a first control mode in a target live broadcast room; receives a control mode switching request generated based on a preset trigger condition, where the control mode switching request includes switching information; switches the first control mode to a second control mode based on the switching information, where the first control mode and the second control mode include a device control mode or an action control mode or a semi-automatic control mode; obtains character data according to the second control mode, and maps the character data to the target virtual character to obtain a target virtual screen; displays the target virtual screen in the target live broadcast room.
[0237] In an embodiment of the present application, when an initial virtual screen generated based on a first control mode is displayed in a target live broadcast room, it is possible to switch to a second control mode based on a control mode switching request, and display a target virtual screen in the second control mode, thereby enriching the control methods of virtual characters.
[0238] The above is a schematic solution of a live broadcast screen display device according to this embodiment. It should be noted that the technical solution of the live broadcast screen display device and the technical solution of the above live broadcast screen display method belong to the same concept. For the details not described in the technical solution of the live broadcast screen display device, reference can be made to the description of the technical solution of the above live broadcast screen display method.
[0239] Figure 5 The structural block diagram of a computing device 500 according to an embodiment of the present application is shown. The components of the computing device 500 include, but are not limited to, a memory 510 and a processor 520. The processor 520 is connected to the memory 510 through a bus 530, and a database 550 is used to store data.
[0240] The computing device 500 further includes an access device 540, which enables the computing device 500 to communicate via one or more networks 560. Examples of these networks include the Public Switched Telephone Network (PSTN), Local Area Network (LAN), Wide Area Network (WAN), Personal Area Network (PAN), or a combination of communication networks such as the Internet. The access device 540 may include one or more of any type of wired or wireless network interfaces (e.g., a network interface card (NIC)), such as an IEEE 802.11 Wireless Local Area Network (WLAN) wireless interface, a Worldwide Interoperability for Microwave Access (Wi-MAX) interface, an Ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a Bluetooth interface, a Near Field Communication (NFC) interface, and so on.
[0241] In an embodiment of the present application, the above components of the computing device 500 and Figure 5 other components not shown in Figure 5The block diagram of the computing device shown is for illustrative purposes only and is not a limitation on the scope of the present application. Those skilled in the art can add or replace other components as needed.
[0242] The computing device 500 can be any type of stationary or mobile computing device, including mobile computers or mobile computing devices (e.g., tablet computers, personal digital assistants, laptop computers, notebook computers, netbooks, etc.), mobile phones (e.g., smartphones), wearable computing devices (e.g., smartwatches, smart glasses, etc.) or other types of mobile devices, or stationary computing devices such as desktop computers or personal computers (PCs). The computing device 500 can also be a mobile or stationary server.
[0243] Wherein, when the processor 520 executes the computer instructions, the steps of the live video display method are implemented.
[0244] The above is a schematic solution of a computing device in this embodiment. It should be noted that the technical solution of this computing device and the technical solution of the above live video display method belong to the same concept. For the details not described in the technical solution of the computing device, reference can be made to the description of the technical solution of the above live video display method.
[0245] An embodiment of the present application also provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed by a processor, the steps of the live video display method as described above are implemented.
[0246] The above is a schematic solution of a computer-readable storage medium in this embodiment. It should be noted that the technical solution of this storage medium and the technical solution of the above live video display method belong to the same concept. For the details not described in the technical solution of the storage medium, reference can be made to the description of the technical solution of the above live video display method.
[0247] The above describes specific embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve the desired result. Additionally, the processes depicted in the figures do not necessarily require the particular order or sequential order shown to achieve the desired result. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0248] The computer instructions include computer program code, which may be in the form of source code, object code, executable files, or some intermediate forms, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording media, USB flash drives, external hard drives, magnetic disks, optical discs, computer memories, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), electrical carrier signals, telecommunication signals, and software distribution media, etc. It should be noted that the content included in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice within the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable medium does not include electrical carrier signals and telecommunication signals.
[0249] It should be noted that for the foregoing method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations. However, those skilled in the art should know that the present application is not limited by the described action sequence, because according to the present application, some steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily all essential to the present application.
[0250] In the above embodiments, the descriptions of the various embodiments have their own focuses. For the parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0251] The preferred embodiments of the present application disclosed above are only used to help explain the present application. The alternative embodiments do not describe all the details in detail, nor do they limit the invention to the specific embodiments described. Obviously, many modifications and variations can be made according to the content of the present application. The present application selects and specifically describes these embodiments to better explain the principles and practical applications of the present application, so that those skilled in the art can understand and utilize the present application well. The present application is only limited by the claims and their full scope and equivalents.
Claims
1. A live video display method, characterized in that, including: displaying an initial virtual image generated by a target virtual character based on a first control mode in a target live streaming room; receiving a control mode switching request generated based on a preset triggering condition, where the control mode switching request includes switching information; switching the first control mode to a second control mode based on the switching information, where the first control mode and the second control mode include a device control mode or an action control mode or a semi-automatic control mode; acquiring character data according to the second control mode and mapping the character data to the target virtual character to obtain a target virtual image; displaying the target virtual image in the target live streaming room; wherein, the control mode switching request can be automatically switched when control information of other modes is received; wherein, when controlling a virtual character based on a control device, if facial driving data of the host collected by a camera is received, a control mode switching request can be generated based on the facial driving data of the host.
2. The method according to claim 1, characterized in that, The preset triggering conditions include: a host triggering condition, a control device triggering condition, and a character part triggering condition.
3. The method according to claim 1, characterized in that, When the first control mode is a device control mode and the second control mode is an action control mode, displaying an initial virtual image generated by a target virtual character based on the first control mode in a target live streaming room includes: displaying an initial virtual image generated by a target virtual character based on the device control mode in a target live streaming room; receiving a control mode switching request, where the control mode switching request carries character part type information; collecting virtual character driving data corresponding to the target host according to the character part type information; mapping the virtual character driving data to the target virtual character according to the character part type information to obtain a target virtual image; displaying the target virtual image in the target live streaming room.
4. The method according to claim 1, characterized in that When the first control mode is an action control mode and the second control mode is a device control mode, displaying an initial virtual image generated by a target virtual character based on the first control mode in a target live streaming room includes: displaying a first virtual image generated by a target virtual character based on the action control mode in the target live streaming room; receiving a control mode switching request, where the control mode switching request carries character part type information and character control information; mapping the character control information to the target virtual character based on the character part type information to obtain a second virtual image; displaying the second virtual image in the target live streaming room.
5. The method according to claim 1, characterized in that, When the first control mode is an action control mode and the second control mode is a semi-automatic control mode, displaying an initial virtual image generated by a target virtual character based on the first control mode in a target live streaming room includes: receiving a control mode switching request, where the control mode switching request carries target character part type information and target character control information; determining other character part type information corresponding to the target virtual character based on the target character part type information; collecting target virtual character driving data corresponding to the target host according to the other character part type information; Map the character control information to the target character part of the target virtual character based on the target character part type information, and map the target virtual character drive data to other character parts of the target virtual character based on the other character part type information to obtain a second virtual screen; Display the second virtual screen in the target live broadcast room.
6. The method according to claim 3, characterized in that, Before displaying the initial virtual screen generated by the target virtual character based on the device control mode in the target live broadcast room, it further includes: Receive a character control request for the target virtual character, and determine device control information and control part type information based on the character control request; Map the device control information to the target virtual character based on the control part type information to obtain an initial virtual screen.
7. The method according to claim 3, wherein Collect virtual character drive data corresponding to the target anchor according to the character part type information, including: Start the target acquisition device, and acquire the anchor image of the target anchor based on the target acquisition device; Obtain virtual character drive data in the anchor image based on the character part type information.
8. The method according to claim 7, characterized in that, Obtain virtual character drive data in the anchor image based on the character part type information, including: Analyze the anchor image to obtain anchor action information; Extract virtual character drive data from the anchor action information according to the character part type information.
9. The method according to claim 3, wherein Map the virtual character drive data to the target virtual character according to the character part type information to obtain a target virtual screen, including: Determine the target character part of the target virtual character according to the character part type information; Determine the character part attribute information corresponding to the target character part; Adjust the character part attribute information based on the virtual character drive data to obtain a target virtual screen.
10. The method according to claim 3, wherein Before collecting virtual character drive data corresponding to the target anchor according to the character part type information, it further includes: Obtain the current character state of the target virtual character; Determine the static part information and dynamic part information in the character part type information based on the current character state.
11. The method according to claim 10, wherein Collect virtual character drive data corresponding to the target anchor according to the character part type information, including: Determine the static part of the target virtual character according to the static part information; Collect virtual character drive data corresponding to the target anchor based on the static part.
12. The method according to claim 10, wherein Collect virtual character drive data corresponding to the target anchor according to the character part type information, including: Determine the dynamic part of the target virtual character according to the dynamic part information; Obtain the preset virtual character animation corresponding to the target anchor based on the dynamic part.
13. The method according to claim 1, characterized in that, Before displaying the initial virtual screen generated by the target virtual character based on the first control mode in the target live broadcast room, it further includes: Detect the camera device corresponding to the target live broadcast room and the on state of the camera device; When it is determined that the target camera device is in the on state, determine that the first control mode is the action control mode.
14. A live video display device, characterized in that, Includes: A first display module configured to display an initial virtual screen generated by the target virtual character based on the first control mode in the target live broadcast room; A receiving module, configured to receive a control mode switching request generated based on a preset trigger condition, wherein the control mode switching request includes switching information; A switching module, configured to switch the first control mode to a second control mode based on the switching information, wherein the first control mode and the second control mode include a device control mode or an action control mode or a semi-automatic control mode; A mapping module, configured to obtain role data according to the second control mode and map the role data to the target virtual role to obtain a target virtual screen; A second display module, configured to display the target virtual screen in the target live broadcast room; Wherein, the control mode switching request can be automatically switched when control information of other modes is received; Wherein, when controlling a virtual role based on a control device, if the face driving data of the anchor collected by the camera is received, a control mode switching request can be generated based on the face driving data of the anchor.
15. A computing device, comprising a memory, a processor, and computer instructions stored on the memory and executable on the processor, characterized in that, When the processor executes the computer instructions, the steps of the method according to any one of claims 1-13 are implemented.
16. A computer-readable storage medium storing computer instructions, characterized in that, When the computer instructions are executed by the processor, the steps of the method according to any one of claims 1-13 are implemented.
17. A computer program product, the computer program product includes computer instructions, characterized in that, When the computer instructions are executed by the processor, the steps of the method according to any one of claims 1-13 are implemented.
Citation Information
Patent Citations
Conference control method and device and electronic equipment
CN113938336A