Live broadcast data processing method and apparatus, and electronic device

Abstract

The invention provides a live broadcast data processing method and device and electronic equipment, and the method comprises the steps: determining a target virtual venue in response to a live broadcast starting event triggered by an anchor end; determining a virtual role in the virtual seat based on a second live broadcast account in a live broadcast room of the first live broadcast account; the second live broadcast account is controlled by the audience side; determining target live broadcast data based on the target virtual venue, the virtual role and live broadcast data collected by the anchor terminal, and pushing the target live broadcast data to the audience terminal, so that the audience terminal generates a live broadcast picture; the target virtual venue and the virtual role are displayed in the live broadcast picture. In the mode, when the user performs live broadcast, the target virtual venue is determined for the user, and the virtual role in the target virtual venue is determined based on the audience of the live broadcast room, so that a scene that the user sings in a performance venue is formed, and the live broadcast performance experience of the user and the live broadcast watching experience of the audience are improved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of live broadcast data processing, and in particular to a live broadcast data processing method, device and electronic device. Background Art

[0002] When the host is performing a live singing performance, he or she can usually only sing along with the accompaniment, or sing together with a certain audience member watching the live broadcast. The performance effect is relatively simple and the atmosphere is poor, resulting in a poor experience of the live singing process for the host and the audience. Summary of the invention

[0003] In view of this, the purpose of the present disclosure is to provide a method, device and electronic device for processing live broadcast data to improve the live broadcast performance experience of users and the live broadcast viewing experience of viewers.

[0004] In a first aspect, an embodiment of the present disclosure provides a method for processing live broadcast data, the method comprising: determining a target virtual venue in response to a live broadcast start event triggered by an anchor end; the target virtual venue includes multiple virtual seats; the anchor end is used to control a first live broadcast account; based on a second live broadcast account in a live broadcast room of the first live broadcast account, a virtual character located in a virtual seat is determined; the second live broadcast account is controlled by an audience end; based on the target virtual venue, the virtual character and the live broadcast data collected by the anchor end, target live broadcast data is determined, and the target live broadcast data is pushed to the audience end so that the audience end generates a live broadcast picture; the target virtual venue and the virtual character are displayed in the live broadcast picture.

[0005] In a second aspect, an embodiment of the present disclosure provides a device for processing live broadcast data, the device comprising: a venue determination module, for determining a target virtual venue in response to a live broadcast start event triggered by an anchor end; the target virtual venue comprises a plurality of virtual seats; the anchor end is used to control a first live broadcast account; a virtual character determination module, for determining a virtual character located in a virtual seat based on a second live broadcast account in a live broadcast room of the first live broadcast account; the second live broadcast account is controlled by an audience end; a scene data determination module, for determining target live broadcast data based on the target virtual venue, the virtual character and the live broadcast data collected by the anchor end, and pushing the target live broadcast data to the audience end so that the audience end generates a live broadcast picture; the target virtual venue and the virtual character are displayed in the live broadcast picture.

[0006] In a third aspect, an embodiment of the present invention provides an electronic device, including a processor and a memory, wherein the memory stores machine executable instructions that can be executed by the processor, and the processor executes the machine executable instructions to implement the above-mentioned live broadcast data processing method.

[0007] In a fourth aspect, an embodiment of the present invention provides a machine-readable storage medium, which stores machine-executable instructions. When the machine-executable instructions are called and executed by a processor, the machine-executable instructions prompt the processor to implement the above-mentioned live broadcast data processing method.

[0008] The embodiments of the present invention bring the following beneficial effects:

[0009] The above-mentioned method, device and electronic device for processing live broadcast data determine the target virtual venue in response to the live broadcast start event triggered by the anchor end; determine the virtual character located in the virtual seat based on the second live broadcast account in the live broadcast room of the first live broadcast account; the second live broadcast account is controlled by the audience end; determine the target live broadcast data based on the target virtual venue, the virtual character and the live broadcast data collected by the anchor end, and push the target live broadcast data to the audience end so that the audience end generates a live broadcast screen; the target virtual venue and the virtual character are displayed in the live broadcast screen. In this way, when the user is broadcasting live, the target virtual venue is determined for the user, and the virtual character in the target virtual venue is determined based on the audience in the live broadcast room, thereby forming a scene of the user singing in the performance venue, improving the user's live performance experience and the audience's live viewing experience.

[0010] Other features and advantages of the present disclosure will be described in the following description, and partly become apparent from the description, or understood by practicing the present disclosure. The purpose and other advantages of the present disclosure are realized and obtained by the structures particularly pointed out in the description, claims and drawings.

[0011] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In order to more clearly illustrate the specific embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the specific embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without paying any creative work.

[0013] Figure 1 A flowchart of a method for processing live broadcast data provided by an embodiment of the present disclosure;

[0014] Figure 2 A schematic diagram of the structure of a live broadcast data processing device provided by an embodiment of the present disclosure;

[0015] Figure 3 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0016] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present disclosure, rather than all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present disclosure.

[0017] When users sing in the singing app, there is a lack of dedicated virtual stage and venue, resulting in a lack of atmosphere, affecting the audience's viewing and listening experience. When users are live streaming, they can only sing along with the accompaniment, or sing with a certain audience watching the live broadcast, which is a relatively simple performance and leads to a poor user experience.

[0018] Based on this, the embodiments of the present disclosure provide a method, device and electronic device for processing live broadcast data, and the technology can be applied to the scenario where users perform live broadcasts.

[0019] See also Figure 1 First, a method for processing live broadcast data provided by an embodiment of the present invention is introduced. The method comprises the following steps:

[0020] Step S102, in response to a live broadcast start event triggered by the anchor terminal, determining a target virtual venue; the target virtual venue includes a plurality of virtual seats; the anchor terminal is used to control the first live broadcast account.

[0021] The triggering method of the live broadcast start event may include multiple methods. For example, a graphical user interface provided by the anchor terminal displays a control or link for controlling the start of the live broadcast, and after the user clicks the control or link, the live broadcast start event is triggered.

[0022] Usually, multiple virtual venues are preset. Different virtual venues correspond to different live broadcast types. For example, when the live broadcast type is singing, the virtual venue can be a virtual venue used to simulate a concert venue; when the live broadcast type is crosstalk, the virtual venue can be a virtual venue used to simulate a theater. It can be set according to needs and is not limited here. The scale of different virtual venues is usually different, such as small concert venues, large concert venues, etc.

[0023] A selection interface for a virtual venue may be provided to the anchor end, such as displaying a corresponding selection control on the anchor end, so that the user can select the target virtual venue corresponding to the live broadcast to be conducted through the selection control. The preference of the first live broadcast user in selecting a virtual venue may also be determined based on the historical data of the first live broadcast user, so as to determine the target virtual venue that matches the preference. Alternatively, a target virtual venue may be allocated to the first live broadcast user based on the first live broadcast user's level, number of fans, activity, etc. Generally speaking, the higher the user's level, the more fans, and the higher the activity, the larger the allocated target virtual venue and the more gorgeous the decoration.

[0024] Step S104, based on a second live broadcast account in the live broadcast room of the first live broadcast account, determining a virtual character located in a virtual seat; the second live broadcast account is controlled by the audience end.

[0025] The target virtual venue usually includes multiple virtual seats. The second live broadcast account in the live broadcast room of the first live broadcast account will watch the performance of the first live broadcast account. In order to simulate a concert in the real world, a virtual seat can be assigned to each second live broadcast account. A virtual seat selection interface can be provided to the audience end, such as displaying a virtual seat selection control on the audience end, so that the user can make a selection through the selection control.

[0026] A virtual seat can also be randomly assigned to the second live broadcast account. Alternatively, the level of the second live broadcast account can be determined based on one or more of the user level of the second live broadcast account, the number of virtual props donated to the first live broadcast account, and the interaction data between the second live broadcast account and the first live broadcast account. Virtual seats also have corresponding levels, and the second live broadcast account can be assigned a virtual seat corresponding to its level.

[0027] After the virtual seat is allocated, that is, the virtual seat corresponding to the virtual character of the second live broadcast account, the virtual character can be automatically generated for the second live broadcast account by the live broadcast system, or can be edited and generated by the second live broadcast account using the live broadcast system, which is not limited here.

[0028] Step S106, based on the target virtual stadium, virtual character and live broadcast data collected by the anchor end, determine the target live broadcast data, push the target live broadcast data to the audience end, so that the audience end generates a live broadcast screen; the target virtual stadium and virtual character are displayed in the live broadcast screen.

[0029] The above-mentioned target virtual venue usually has model data, and the virtual character also has model data and position parameters in the target virtual venue. The anchor end collects live broadcast data in real time, and the live broadcast data usually includes video data and audio data generated by the first live broadcast account. In order to create the atmosphere of the concert, virtual background data can be determined based on the relevant data of the target virtual venue and the virtual character, and the virtual background data is used to generate the display effect of the virtual character in the target virtual venue. Then, the background formed by the video data of the first live broadcast account is replaced with a virtual venue including the target virtual venue and the virtual character, thereby generating the target live broadcast data.

[0030] After receiving the target live broadcast data, the audience will generate a live broadcast screen based on the target live broadcast data. In the live broadcast screen, the audience can see that the anchor is in the target virtual venue, and there are other virtual characters in the venue, forming a display effect that the anchor is holding a concert.

[0031] The above-mentioned method for processing live broadcast data determines the target virtual venue in response to the live broadcast start event triggered by the anchor end; determines the virtual character located in the virtual seat based on the second live broadcast account in the live broadcast room of the first live broadcast account; the second live broadcast account is controlled by the audience end; determines the target live broadcast data based on the target virtual venue, the virtual character and the live broadcast data collected by the anchor end, and pushes the target live broadcast data to the audience end so that the audience end generates a live broadcast screen; and displays the target virtual venue and the virtual character in the live broadcast screen. In this method, when the user is broadcasting live, the target virtual venue is determined for the user, and the virtual character in the target virtual venue is determined based on the audience in the live broadcast room, thereby forming a scene of the user singing in the performance venue, improving the user's live performance experience and the audience's live viewing experience.

[0032] The following embodiment provides a specific method for determining a target virtual venue.

[0033] In a specific implementation, the performance level corresponding to the first live broadcast account can be determined based on the first relevant data of the first live broadcast account. The first relevant data may include one or more of the number of live broadcast accounts following the first live broadcast account, the type and / or number of live broadcast props received from the live broadcast account, the interaction data between the first live broadcast account and other live broadcast accounts, and the generation time of the live broadcast start event. The number of live broadcast accounts following the first live broadcast account can be regarded as the "number of fans" of the first live broadcast account. The more fans a live broadcast account has, the higher the performance level it corresponds to. The types and numbers of live broadcast props received from the live broadcast account can reflect the degree of recognition of the first live broadcast account. The higher the value and number of live broadcast props received, the higher the degree of recognition of the first live broadcast account, and the higher its performance level can be considered. Similarly, the more interactions with other live broadcast accounts can also be considered that the performance level of the first live broadcast account is higher. When using the above multiple data to determine the performance level, different data can be quantified, and corresponding weights can be set for different data, and the performance level of the first live broadcast account can be determined based on the final calculation result.

[0034] Usually, multiple virtual venues are preset, each of which has a corresponding performance level. After determining the performance level corresponding to the first live broadcast account, based on the performance level corresponding to the first live broadcast account, a target virtual venue matching its performance level is determined from the preset multiple virtual venues.

[0035] The following embodiment provides a specific method for determining a virtual character located in a virtual seat based on a second live broadcast account in a live broadcast room of a first live broadcast account.

[0036] In a specific implementation, the position characteristics of the virtual seats corresponding to the second live broadcast account can be determined based on the second relevant data of the second live broadcast account in the live broadcast room of the first live broadcast account. The second relevant data can be the account level of the second live broadcast account, the interaction data with the first live broadcast account, etc. When the second relevant data used is different, the determined position characteristics are usually different. The determined position characteristics may include the orientation of the virtual seat in the target virtual venue, or the position level of the virtual seat, or both. Then, based on the position characteristics, the target seat among the multiple virtual seats is determined, and the target seat is allocated to the virtual character corresponding to the second live broadcast account.

[0037] When the second relevant data includes the Internet Protocol address of the second live broadcast account, the determined location feature includes the orientation of the virtual seat in the target virtual venue. Specifically, the geographical location of the second live broadcast account can be determined based on the Internet Protocol address of the second live broadcast account in the live broadcast room of the first live broadcast account, and then the orientation of the virtual seat corresponding to the second live broadcast account in the target virtual venue can be determined based on the geographical location of the second live broadcast account. For example, the geographical location of the second live broadcast account is Heilongjiang, and the orientation of the virtual seat corresponding to the second live broadcast account in the target virtual venue can be determined to be northeast. Alternatively, the geographical location corresponding to each virtual seat can be pre-set, and after the geographical location of the second live broadcast account is determined, the target seat of the virtual seat that matches the geographical location can be searched.

[0038] When the second related data includes virtual props presented by the second live broadcast account to the first live broadcast account, the seat level of the virtual seat corresponding to the second live broadcast account can usually be determined. In specific implementation, the types, quantities and other information of the virtual props presented by the second live broadcast account in the live broadcast room of the first live broadcast account to the first live broadcast account can be counted, and then the seat level of the virtual seat corresponding to the second live broadcast account can be determined based on this information. Generally speaking, the higher the value of the virtual props presented by the second live broadcast account, the higher the seat level of the corresponding virtual seat.

[0039] The following embodiment provides a specific method for determining target live broadcast data based on the target virtual venue, virtual character and live broadcast data collected by the anchor terminal, and pushing the target live broadcast data to the audience terminal so that the audience terminal generates a live broadcast screen.

[0040] In actual applications, the behavior of the second live broadcast account and the virtual character can also be synchronized. Device data can be obtained by running the terminal device of the audience end. Among them, the device data includes one or more of image acquisition data, sound acquisition data, and device posture data. Based on the device data, the virtual behavior corresponding to the second live broadcast account is determined; the virtual behavior may include waving, singing along, clapping, etc. After the virtual behavior is determined, the target live broadcast data is determined based on the target virtual venue, virtual character, virtual behavior and live broadcast data collected by the anchor end. The target live broadcast data is then pushed to the audience end so that the audience end generates a live broadcast screen. In the live broadcast screen, the virtual character performs the virtual behavior.

[0041] The above-mentioned device data may include image acquisition data or device posture data. Based on the above two types of device data, it can be determined whether the terminal device is in a shaking state. The image acquisition data is a plurality of image data captured by the camera of the device. If the image data has low similarity and repeatability, it can be determined that the terminal device is in a shaking state. The device posture data is obtained through the gyroscope of the device, and it can be determined whether the terminal device is in a shaking state based on the change state and repeatability of the device posture data. If so, it is determined that the second live broadcast account uses a specified virtual prop. The specified virtual prop can be a virtual fluorescent stick, etc.

[0042] The above-mentioned device data may include sound collection data. At this time, it is necessary to determine the similarity between the sound collection data and the live audio data of the first live account, and based on the similarity, determine whether the second live account has a sing-along behavior. Generally speaking, when the similarity is higher than a specified threshold, it can be determined that the second live account has a sing-along behavior. At this time, it is necessary to mix the sound collection data and the live audio data, and update the target live data in real time so that the live sound heard by the audience end contains the sing-along sound of the second live account.

[0043] The present disclosure also provides another method for processing live broadcast data. Figure 1 The method is implemented based on the method shown in . The method introduces virtual reality technology to create a real and interactive virtual stage, so that the audience feels that they are in the concert scene. Such a virtual stage can provide various special effects and environmental settings, including lighting, sound effects, background, etc., which can enhance the audience's viewing and listening experience.

[0044] This method is implemented through the following techniques:

[0045] 1. Technology for configuring venues of corresponding levels according to user attributes: This technology involves data collection and analysis, including collecting user data, storing it in a relational database, and using data analysis tools to perform data statistics and classification. At the same time, different levels of venue models are preset, and the matching algorithm assigns users to the corresponding venue model, and provides an interface for users to select according to their own attributes.

[0046] 2. Technology for matching the location of the venue and displaying it in the video stream based on the attributes of the fan users in the concert application: This technology involves collecting fan attributes, including obtaining IP addresses, geographic location analysis, recording reward behavior, and interactive data collection. At the same time, the geographic location information of the fan users is matched to the corresponding location and VIP seats to achieve interactive effects, including light stick synchronization, singing along sound fusion, and video stream push.

[0047] First, the method needs to configure the corresponding level of venues according to the attributes (equivalent to the above-mentioned "first relevant data") of the user (equivalent to the above-mentioned "first live broadcast account").

[0048] In the specific implementation, it is necessary to collect data such as the number of users' fans, broadcast time, number of gifts received, and number of interactions through the API interface of the application platform; and store the collected data in a relational database (such as MySQL, PostgreSQL) for subsequent query and analysis; further, use data analysis tools (such as Pandas, NumPy) to count and classify the collected data, and divide users into three levels: top users, celebrity users, and trainees.

[0049] Then the venue model is matched. There are preset venue models in the application platform. Concert venue models of different levels need to be made in advance. You can use 3D modeling software (such as Blender, Maya) to create venue models such as the Taipei Arena, the Bird's Nest, the Olympic Sports Center, the Opera House, the Qing Bar, and the Commercial Plaza, and load them into the application. And according to the analysis results, use matching algorithms (such as rule matching, machine learning classification) to assign users to the corresponding venue models. For example, top users match the Taipei Arena and the Bird's Nest, celebrity users match the Olympic Sports Center and the Opera House, and trainees match the Qing Bar and the Commercial Plaza.

[0050] An interface may also be provided to allow users to select from matching venue models based on their own attributes and wishes.

[0051] After determining the target virtual venue, it is necessary to match the venue location based on the attributes of the user's fan users (equivalent to the above-mentioned "second live broadcast user") in the concert application and display it in the video stream.

[0052] In the process of matching the venue location, it is necessary to collect fan attributes (equivalent to the "second related data mentioned above"). For example, the IP address information of the fan user is obtained through the application platform, and the geographic location is resolved. The IP address geographic location API (such as IP Geolocation API) can be used for resolution. The reward behavior of the fan user can also be recorded and stored in the database.

[0053] Or collect interactive data, such as obtaining data from user devices (such as camera, gyroscope, and microphone data) through the application platform's API interface or directly, and recording the interactive behaviors of fan users (such as waving hands and singing along).

[0054] When matching the venue location, location mapping is required: preset camera positions in different directions in the venue model, and use the fan user's geographic location information to match them to the corresponding direction. For example, users in the north are matched to the northern area of ​​the venue.

[0055] According to the reward records of the fans, the users who give more rewards will be assigned to the VIP seating area. The matching can be done by setting the identification and priority algorithm of the VIP area.

[0056] When a fan user waves his hand or shakes his phone, the camera and gyroscope data are obtained to trigger the fan character in the venue model to swing the light stick synchronously. The light stick swinging effect can be achieved using 3D animation technology and physics engines (such as Unity, Unreal Engine).

[0057] When fans sing along, their microphone data is collected and audio processing (such as noise reduction and mixing) is performed to blend their voices into the background sound of the venue. Audio processing tools (such as Audacity and FFmpeg) and real-time audio mixing technologies (such as Web Audio API) can be used to achieve sound fusion.

[0058] Finally, the processed interactive effects and sounds are integrated into the video stream and pushed to all fans who are watching in real time. You can use a video streaming server (such as Wowza, NGINX-RTMP) to push the video stream.

[0059] For the above method embodiments, see Figure 2 A live data processing device is shown, the device comprising:

[0060] The venue determination module 202 is used to determine a target virtual venue in response to a live broadcast start event triggered by the anchor terminal; the target virtual venue includes a plurality of virtual seats; the anchor terminal is used to control the first live broadcast account;

[0061] A virtual character determination module 204 is used to determine a virtual character located in a virtual seat based on a second live broadcast account in the live broadcast room of the first live broadcast account; the second live broadcast account is controlled by the audience terminal;

[0062] The scene data determination module 206 is used to determine the target live broadcast data based on the target virtual venue, virtual character and live broadcast data collected by the anchor end, and push the target live broadcast data to the audience end so that the audience end generates a live broadcast screen; the target virtual venue and virtual character are displayed in the live broadcast screen.

[0063] The above-mentioned live broadcast data processing device determines the target virtual venue in response to the live broadcast start event triggered by the anchor end; determines the virtual character located in the virtual seat based on the second live broadcast account in the live broadcast room of the first live broadcast account; the second live broadcast account is controlled by the audience end; determines the target live broadcast data based on the target virtual venue, the virtual character and the live broadcast data collected by the anchor end, and pushes the target live broadcast data to the audience end so that the audience end generates a live broadcast screen; the target virtual venue and the virtual character are displayed in the live broadcast screen. In this method, when the user is broadcasting live, the target virtual venue is determined for the user, and the virtual character in the target virtual venue is determined based on the audience in the live broadcast room, thereby forming a scene of the user singing in the performance venue, improving the user's live performance experience and the audience's live viewing experience.

[0064] The above-mentioned venue determination module is also used to: determine the performance level corresponding to the first live broadcast account based on the first relevant data of the first live broadcast account; wherein the first relevant data includes at least one of the following: the number of live broadcast accounts following the first live broadcast account, the types and / or quantities of live broadcast props received from the live broadcast account, the interaction data between the first live broadcast account and other live broadcast accounts, and the generation time of the live broadcast start event; based on the performance level corresponding to the first live broadcast account, determine the target virtual venue from multiple preset virtual venues; each virtual venue has a corresponding performance level.

[0065] The above-mentioned virtual character determination module is also used to: determine the position characteristics of the virtual seat corresponding to the second live broadcast account based on the second relevant data of the second live broadcast account in the live broadcast room of the first live broadcast account; the position characteristics include the orientation of the virtual seat in the target virtual venue, and / or, the position level; based on the position characteristics, determine the target seat among multiple virtual seats; assign the target seat to the virtual character corresponding to the second live broadcast account.

[0066] The above-mentioned second related data includes the Internet Protocol address of the second live broadcast account; the location characteristics include the position of the virtual seat in the target virtual venue; the above-mentioned virtual character determination module is also used to: determine the geographical location of the second live broadcast account based on the Internet Protocol address of the second live broadcast account in the live broadcast room of the first live broadcast account; based on the geographical location of the second live broadcast account, determine the position of the virtual seat corresponding to the second live broadcast account in the target virtual venue.

[0067] The above-mentioned second related data includes virtual props donated by the second live broadcast account to the first live broadcast account; the above-mentioned virtual character determination module is also used to: determine the seat level of the virtual seat corresponding to the second live broadcast account based on the type and / or quantity of virtual props donated by the second live broadcast account in the live broadcast room of the first live broadcast account to the first live broadcast account.

[0068] The above-mentioned scene data determination module is also used to: obtain device data by running the terminal device of the audience end; the device data includes image acquisition data, sound acquisition data, and / or device posture data; based on the device data, determine the virtual behavior corresponding to the second live broadcast account; based on the target virtual venue, virtual character, virtual behavior and the live broadcast data collected by the anchor end, determine the target live broadcast data; push the target live broadcast data to the audience end so that the audience end generates a live broadcast picture; in the live broadcast picture, the virtual character performs a virtual behavior; in the live broadcast picture, the virtual character performs a virtual behavior.

[0069] The above-mentioned device data includes image acquisition data or device posture data; the above-mentioned scene data determination module is also used to: based on the device data, determine whether the terminal device is in a shaking state; if so, determine that the second live broadcast account uses designated virtual props.

[0070] The above-mentioned device data includes sound collection data; the above-mentioned scene data determination module is also used to: determine the similarity between the sound collection data and the live audio data of the first live broadcast account; based on the similarity, judge whether the second live broadcast account has a sing-along behavior; if so, mix the sound collection data and the live audio data, and update the target live broadcast data in real time.

[0071] This embodiment further provides an electronic device, including a processor and a memory, wherein the memory stores machine executable instructions that can be executed by the processor, and the processor executes the machine executable instructions to implement the above-mentioned live broadcast data processing method, for example:

[0072] In response to a live broadcast start event triggered by the anchor end, a target virtual venue is determined; the target virtual venue includes multiple virtual seats; the anchor end is used to control a first live broadcast account; based on a second live broadcast account in the live broadcast room of the first live broadcast account, a virtual character located in a virtual seat is determined; the second live broadcast account is controlled by the audience end; based on the target virtual venue, the virtual character and the live broadcast data collected by the anchor end, target live broadcast data is determined, and the target live broadcast data is pushed to the audience end so that the audience end generates a live broadcast picture; the target virtual venue and the virtual character are displayed in the live broadcast picture.

[0073] In the above method, when a user is live streaming, a target virtual venue is determined for the user, and a virtual character in the target virtual venue is determined based on the audience in the live streaming room, thereby creating a scene where the user is singing in the performance venue, improving the user's live streaming performance experience and the audience's live streaming viewing experience.

[0074] Optionally, the step of determining the target virtual venue includes: determining a performance level corresponding to the first live broadcast account based on first relevant data of the first live broadcast account; wherein the first relevant data includes at least one of the following: the number of live broadcast accounts following the first live broadcast account, the types and / or quantities of live broadcast props received from the live broadcast account, interaction data between the first live broadcast account and other live broadcast accounts, and the time when the live broadcast start event occurs; determining the target virtual venue from a plurality of preset virtual venues based on the performance level corresponding to the first live broadcast account; each virtual venue has a corresponding performance level.

[0075] Optionally, the step of determining a virtual character located in a virtual seat based on a second live broadcast account in a live broadcast room of the first live broadcast account includes: determining a position feature of a virtual seat corresponding to the second live broadcast account based on second relevant data of the second live broadcast account in the live broadcast room of the first live broadcast account; the position feature includes the orientation of the virtual seat in the target virtual venue, and / or the position level; determining a target seat among multiple virtual seats based on the position feature; and allocating a target seat to the virtual character corresponding to the second live broadcast account.

[0076] Optionally, the second relevant data includes an Internet Protocol address of a second live broadcast account; the location characteristics include the position of the virtual seats in the target virtual venue; based on the second relevant data of the second live broadcast account in the live broadcast room of the first live broadcast account, the step of determining the location characteristics of the virtual seats corresponding to the second live broadcast account includes: determining the geographical location of the second live broadcast account based on the Internet Protocol address of the second live broadcast account in the live broadcast room of the first live broadcast account; determining the position of the virtual seats corresponding to the second live broadcast account in the target virtual venue based on the geographical location of the second live broadcast account.

[0077] Optionally, the second relevant data includes virtual props donated by the second live broadcast account to the first live broadcast account; the step of determining the position characteristics of the virtual seat corresponding to the second live broadcast account based on the second relevant data of the second live broadcast account in the live broadcast room of the first live broadcast account includes: determining the seat level of the virtual seat corresponding to the second live broadcast account based on the type and / or quantity of virtual props donated by the second live broadcast account in the live broadcast room of the first live broadcast account to the first live broadcast account.

[0078] Optionally, the above-mentioned steps of determining the target live broadcast data based on the target virtual venue, virtual character and the live broadcast data collected by the anchor end, and pushing the target live broadcast data to the audience end so that the audience end generates a live broadcast picture include: obtaining device data by running the terminal device of the audience end; the device data includes image acquisition data, sound acquisition data, and / or device posture data; based on the device data, determining the virtual behavior corresponding to the second live broadcast account; based on the target virtual venue, virtual character, virtual behavior and the live broadcast data collected by the anchor end, determining the target live broadcast data; pushing the target live broadcast data to the audience end so that the audience end generates a live broadcast picture; in the live broadcast picture, the virtual character performs the virtual behavior; in the live broadcast picture, the virtual character performs the virtual behavior.

[0079] Optionally, the above-mentioned device data includes image acquisition data or device posture data; based on the device data, the step of determining the virtual behavior corresponding to the second live broadcast account includes: based on the device data, judging whether the terminal device is in a shaking state; if so, determining that the second live broadcast account uses specified virtual props.

[0080] Optionally, the above-mentioned device data includes sound collection data; based on the device data, the step of determining the virtual behavior corresponding to the second live broadcast account includes: determining the similarity between the sound collection data and the live audio data of the first live broadcast account; based on the similarity, judging whether the second live broadcast account has a sing-along behavior; if so, mixing the sound collection data and the live audio data, and updating the target live broadcast data in real time.

[0081] See also Figure 3 As shown, the electronic device includes a processor 100 and a memory 101, wherein the memory 101 stores machine executable instructions that can be executed by the processor 100, and the processor 100 executes the machine executable instructions to implement the above-mentioned live data processing method.

[0082] Further, Figure 3 The electronic device shown further includes a bus 102 and a communication interface 103 , and the processor 100 , the communication interface 103 and the memory 101 are connected via the bus 102 .

[0083] The memory 101 may include a high-speed random access memory (RAM), and may also include a non-volatile memory, such as at least one disk storage. The communication connection between the system network element and at least one other network element is realized through at least one communication interface 103 (which may be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. may be used. The bus 102 may be an ISA bus, a PCI bus, or an EISA bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 3 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0084] The processor 100 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 100. The above processor 100 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present disclosure can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in conjunction with the embodiments of the present disclosure can be directly embodied as a hardware decoding processor for execution, or a combination of hardware and software modules in the decoding processor for execution. The software module may be located in a storage medium mature in the art, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 101, and the processor 100 reads the information in the memory 101 and completes the steps of the method of the above embodiment in combination with its hardware.

[0085] This embodiment also provides a machine-readable storage medium, which stores machine-executable instructions. When the machine-executable instructions are called and executed by a processor, the machine-executable instructions prompt the processor to implement the above-mentioned live broadcast data processing method.

[0086] A method, device and electronic device for processing live data provided in the embodiments of the present disclosure include a computer-readable storage medium storing program code, and the program code includes instructions that can be used to execute the methods described in the previous method embodiments, for example:

[0087] In response to a live broadcast start event triggered by the anchor end, a target virtual venue is determined; the target virtual venue includes multiple virtual seats; the anchor end is used to control a first live broadcast account; based on a second live broadcast account in the live broadcast room of the first live broadcast account, a virtual character located in a virtual seat is determined; the second live broadcast account is controlled by the audience end; based on the target virtual venue, the virtual character and the live broadcast data collected by the anchor end, target live broadcast data is determined, and the target live broadcast data is pushed to the audience end so that the audience end generates a live broadcast picture; the target virtual venue and the virtual character are displayed in the live broadcast picture.

[0088] In the above method, when a user is live streaming, a target virtual venue is determined for the user, and a virtual character in the target virtual venue is determined based on the audience in the live streaming room, thereby creating a scene where the user is singing in the performance venue, improving the user's live streaming performance experience and the audience's live streaming viewing experience.

[0089] Optionally, the step of determining the target virtual venue includes: determining a performance level corresponding to the first live broadcast account based on first relevant data of the first live broadcast account; wherein the first relevant data includes at least one of the following: the number of live broadcast accounts following the first live broadcast account, the types and / or quantities of live broadcast props received from the live broadcast account, interaction data between the first live broadcast account and other live broadcast accounts, and the time when the live broadcast start event occurs; determining the target virtual venue from a plurality of preset virtual venues based on the performance level corresponding to the first live broadcast account; each virtual venue has a corresponding performance level.

[0090] Optionally, the step of determining a virtual character located in a virtual seat based on a second live broadcast account in a live broadcast room of the first live broadcast account includes: determining a position feature of a virtual seat corresponding to the second live broadcast account based on second relevant data of the second live broadcast account in the live broadcast room of the first live broadcast account; the position feature includes the orientation of the virtual seat in the target virtual venue, and / or the position level; determining a target seat among multiple virtual seats based on the position feature; and allocating a target seat to the virtual character corresponding to the second live broadcast account.

[0091] Optionally, the second relevant data includes an Internet Protocol address of a second live broadcast account; the location characteristics include the position of the virtual seats in the target virtual venue; based on the second relevant data of the second live broadcast account in the live broadcast room of the first live broadcast account, the step of determining the location characteristics of the virtual seats corresponding to the second live broadcast account includes: determining the geographical location of the second live broadcast account based on the Internet Protocol address of the second live broadcast account in the live broadcast room of the first live broadcast account; determining the position of the virtual seats corresponding to the second live broadcast account in the target virtual venue based on the geographical location of the second live broadcast account.

[0092] Optionally, the second relevant data includes virtual props donated by the second live broadcast account to the first live broadcast account; the step of determining the position characteristics of the virtual seat corresponding to the second live broadcast account based on the second relevant data of the second live broadcast account in the live broadcast room of the first live broadcast account includes: determining the seat level of the virtual seat corresponding to the second live broadcast account based on the type and / or quantity of virtual props donated by the second live broadcast account in the live broadcast room of the first live broadcast account to the first live broadcast account.

[0093] Optionally, the above-mentioned steps of determining the target live broadcast data based on the target virtual venue, virtual character and the live broadcast data collected by the anchor end, and pushing the target live broadcast data to the audience end so that the audience end generates a live broadcast picture include: obtaining device data by running the terminal device of the audience end; the device data includes image acquisition data, sound acquisition data, and / or device posture data; based on the device data, determining the virtual behavior corresponding to the second live broadcast account; based on the target virtual venue, virtual character, virtual behavior and the live broadcast data collected by the anchor end, determining the target live broadcast data; pushing the target live broadcast data to the audience end so that the audience end generates a live broadcast picture; in the live broadcast picture, the virtual character performs the virtual behavior; in the live broadcast picture, the virtual character performs the virtual behavior.

[0094] Optionally, the above-mentioned device data includes image acquisition data or device posture data; based on the device data, the step of determining the virtual behavior corresponding to the second live broadcast account includes: based on the device data, judging whether the terminal device is in a shaking state; if so, determining that the second live broadcast account uses specified virtual props.

[0095] Optionally, the above-mentioned device data includes sound collection data; based on the device data, the step of determining the virtual behavior corresponding to the second live broadcast account includes: determining the similarity between the sound collection data and the live audio data of the first live broadcast account; based on the similarity, judging whether the second live broadcast account has a sing-along behavior; if so, mixing the sound collection data and the live audio data, and updating the target live broadcast data in real time.

[0096] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system and device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0097] In addition, in the description of the embodiments of the present disclosure, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For those skilled in the art, the specific meanings of the above terms in the present disclosure can be understood according to specific circumstances.

[0098] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program code.

[0099] In the description of the present disclosure, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicating the orientation or positional relationship, are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present disclosure and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation of the present disclosure. In addition, the terms "first", "second", and "third" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.

[0100] Finally, it should be noted that the above embodiments are only specific implementation methods of the present disclosure, which are used to illustrate the technical solutions of the present disclosure, rather than to limit them. The protection scope of the present disclosure is not limited thereto. Although the present disclosure is described in detail with reference to the above embodiments, those skilled in the art should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above embodiments within the technical scope disclosed in the present disclosure, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims

1. A method for processing live broadcast data, characterized in that: The method comprises: In response to a live broadcast start event triggered by the anchor terminal, a target virtual venue is determined; the target virtual venue includes a plurality of virtual seats; the anchor terminal is used to control the first live broadcast account; Determining a virtual character located in the virtual seat based on a second live broadcast account in the live broadcast room of the first live broadcast account; the second live broadcast account is controlled by the audience end; Based on the target virtual venue, the virtual character and the live broadcast data collected by the anchor terminal, target live broadcast data is determined, and the target live broadcast data is pushed to the audience terminal so that the audience terminal generates a live broadcast screen; the target virtual venue and the virtual character are displayed in the live broadcast screen.

2. The method according to claim 1, characterized in that Steps to identify target virtual venues include; Determine the performance level corresponding to the first live broadcast account based on the first relevant data of the first live broadcast account; wherein the first relevant data includes at least one of the following: the number of live broadcast accounts following the first live broadcast account, the type and / or number of live broadcast props given by the live broadcast account, the interaction data between the first live broadcast account and other live broadcast accounts, and the generation time of the live broadcast start event; Based on the performance level corresponding to the first live broadcast account, a target virtual venue is determined from a plurality of preset virtual venues; each of the virtual venues has a corresponding performance level.

3. The method according to claim 1, characterized in that The step of determining the virtual character located in the virtual seat based on the second live broadcast account in the live broadcast room of the first live broadcast account includes: Based on second relevant data of a second live broadcast account in the live broadcast room of the first live broadcast account, determining a position feature of a virtual seat corresponding to the second live broadcast account; the position feature includes a position of the virtual seat in the target virtual venue, and / or a position level; Based on the position feature, determining a target seat among the plurality of virtual seats; The target seat is allocated to the virtual character corresponding to the second live broadcast account.

4. The method according to claim 3, wherein the second related data comprises an Internet Protocol address of the second live broadcast account; the location feature comprises a position of the virtual seat in the target virtual venue; The step of determining the position feature of the virtual seat corresponding to the second live broadcast account based on the second relevant data of the second live broadcast account in the live broadcast room of the first live broadcast account includes: Determining a geographic location of a second live broadcast account based on an Internet Protocol address of the second live broadcast account in the live broadcast room of the first live broadcast account; Based on the geographical location of the second live broadcast account, the position of the virtual seat corresponding to the second live broadcast account in the target virtual venue is determined.

5. The method according to claim 3, wherein the second related data includes virtual props donated by the second live broadcast account to the first live broadcast account; The step of determining the position feature of the virtual seat corresponding to the second live broadcast account based on the second relevant data of the second live broadcast account in the live broadcast room of the first live broadcast account includes: Based on the type and / or quantity of virtual props donated by a second live broadcast account in the live broadcast room of the first live broadcast account to the first live broadcast account, the seat level of the virtual seat corresponding to the second live broadcast account is determined.

6. The method according to claim 1, based on the target virtual venue and the virtual character, determining scene data, and sending the scene data to the anchor terminal so that the anchor terminal generates a live screen based on the collected live data and the scene data, comprises: Acquiring device data by running the terminal device of the audience; the device data includes image acquisition data, sound acquisition data, and / or device posture data; Based on the device data, determining a virtual behavior corresponding to the second live broadcast account; Determining scene data based on the target virtual venue, the virtual character, and the virtual behavior; The scene data is sent to the anchor end, so that the anchor end generates a live broadcast screen based on the collected live broadcast data and the scene data; in the live broadcast screen, the virtual character performs the virtual behavior.

7. The method according to claim 6, wherein the device data comprises image acquisition data or device posture data; The step of determining the virtual behavior corresponding to the second live broadcast account based on the device data includes: Based on the device data, determining whether the terminal device is in a shaking state; If yes, determine that the second live broadcast account uses the specified virtual props.

8. The method according to claim 6, wherein the device data comprises sound collection data; The step of determining the virtual behavior corresponding to the second live broadcast account based on the device data includes: Determining the similarity between the sound collection data and the live broadcast audio data of the first live broadcast account; Based on the similarity, determining whether the second live broadcast account has a sing-along behavior; If yes, the sound collection data is sent to the anchor end, so that the anchor end mixes the sound collection data and the live audio data.

9. A live broadcast data processing device, characterized in that: The device comprises: A venue determination module, configured to determine a target virtual venue in response to a live broadcast start event triggered by the anchor terminal; the target virtual venue includes a plurality of virtual seats; the anchor terminal is configured to control the first live broadcast account; A virtual character determination module, configured to determine a virtual character located in the virtual seat based on a second live broadcast account in the live broadcast room of the first live broadcast account; the second live broadcast account is controlled by a viewer terminal; The scene data determination module is used to determine target live broadcast data based on the target virtual venue, the virtual character and the live broadcast data collected by the anchor end, and push the target live broadcast data to the audience end so that the audience end generates a live broadcast screen; the target virtual venue and the virtual character are displayed in the live broadcast screen.

10. An electronic device, characterized in that: It includes a processor and a memory, the memory stores machine executable instructions that can be executed by the processor, and the processor executes the machine executable instructions to implement the live broadcast data processing method described in any one of claims 1-8.

11. A machine-readable storage medium, characterized in that: The machine-readable storage medium stores machine-executable instructions. When the machine-executable instructions are called and executed by the processor, the machine-executable instructions prompt the processor to implement the live broadcast data processing method described in any one of claims 1-8.

Images