Live broadcast interaction method and device, equipment and storage medium

Abstract

The embodiment of the invention provides a live broadcast interaction method and device, equipment and a storage medium. The method comprises the following steps: receiving a request for using an interactive resource in a target interface of a live broadcast room; in response to the received sliding operation, a first graphic element is rendered in the target interface based on the first group of coordinate points corresponding to the sliding operation, and the first graphic element comprises various chartlet elements corresponding to the interactive resources; in response to the ending of the sliding operation, smoothing the first group of coordinate points to determine a second group of coordinate points; and based on the second group of coordinate points, a second graphic element is rendered in the target interface, and the rendered first graphic element and the rendered second graphic element are provided for generating a live broadcast picture of the live broadcast room. Therefore, the embodiment of the invention can support the creation of the corresponding graphic elements in the live broadcast picture by utilizing the interactive resources (such as drawing props) in the live broadcast process.

Description

Technical Field

[0001] The exemplary embodiments disclosed herein generally relate to the field of computers, and particularly to methods, apparatus, devices, and computer-readable storage media for live interactive broadcasts. Background Technology

[0002] With the development of computer technology, live streaming has become an important way for people to obtain and share information. Traditional live streaming content has relatively low interactivity, usually limited to text chat or simple gift-giving. People expect to see richer interactive elements in live streaming scenarios. Summary of the Invention

[0003] In a first aspect of this disclosure, a user interface interaction method is provided. The method includes: receiving a request to use interactive resources in a target interface of a live streaming room; in response to receiving a swipe operation, rendering a first graphic element in the target interface based on a first set of coordinate points corresponding to the swipe operation, the first graphic element including multiple texture elements corresponding to the interactive resources; in response to the end of the swipe operation, smoothing the first set of coordinate points to determine a second set of coordinate points; and rendering a second graphic element in the target interface based on the second set of coordinate points, wherein the rendered first and second graphic elements are provided for generating a live stream screen in the live streaming room.

[0004] In a second aspect of this disclosure, an apparatus for live streaming interaction is provided. The apparatus includes: a request receiving module configured to receive a request to use interactive resources in a target interface of a live streaming room; a first rendering module configured to, in response to receiving a swipe operation, render a first graphic element in the target interface based on a first set of coordinate points corresponding to the swipe operation, the first graphic element including multiple texture elements corresponding to the interactive resources; a coordinate smoothing module configured to, in response to the end of the swipe operation, smooth the first set of coordinate points to determine a second set of coordinate points; and a second rendering module configured to render a second graphic element in the target interface based on the second set of coordinate points, wherein the rendered first and second graphic elements are provided for generating a live stream image of the live streaming room.

[0005] In a third aspect of this disclosure, an electronic device is provided. The device includes at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit. When executed by the at least one processing unit, the instructions cause the device to perform the method of the first aspect.

[0006] In a fourth aspect of this disclosure, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program that can be executed by a processor to implement the method of the first aspect.

[0007] It should be understood that the content described in this content section is not intended to limit the key or essential features of the embodiments of this disclosure, nor is it intended to restrict the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0008] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. In the drawings, the same or similar reference numerals denote the same or similar elements, wherein:

[0009] Figure 1 A schematic diagram of an example environment in which embodiments of the present disclosure can be implemented is shown;

[0010] Figures 2A to 2C A schematic diagram of an example interface according to some embodiments of the present disclosure is shown;

[0011] Figure 3 An example flowchart of drawing graphical elements according to some embodiments of the present disclosure is shown;

[0012] Figure 4 A flowchart is shown illustrating an example process for live streaming interaction according to some embodiments of this disclosure;

[0013] Figure 5 A block diagram of an apparatus for live interactive broadcasting according to some embodiments of the present disclosure is shown; and

[0014] Figure 6 A block diagram of an electronic device capable of implementing several embodiments of the present disclosure is shown. Detailed Implementation

[0015] It is understood that before using the technical solutions disclosed in the various embodiments of this disclosure, users should be informed of the types, scope of use, and usage scenarios of the personal information involved in this disclosure in an appropriate manner in accordance with relevant laws and regulations, and user authorization should be obtained.

[0016] For example, upon receiving a user's active request, a prompt message is sent to the user to explicitly inform them that the requested operation will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the software or hardware, such as the electronic device, application, server, or storage medium performing the operations of this disclosed technical solution, based on the prompt message.

[0017] As an optional but non-limiting implementation, in response to a user's active request, sending a prompt message to the user can be done via a pop-up window, which can display the prompt message in text format. Furthermore, the pop-up window can also include a selection control allowing the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0018] It is understood that the above notification and user authorization process are merely illustrative and do not constitute a limitation on the implementation of this disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of this disclosure.

[0019] It is understood that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and related provisions.

[0020] The term "in response to" as used herein refers to a state in which a corresponding event occurs or a condition is satisfied. It will be understood that the timing of subsequent actions performed in response to such event or condition is not necessarily strongly correlated with the time when the event occurs or the condition is met. For example, in some cases, subsequent actions may be performed immediately upon the occurrence of the event or the fulfillment of the condition; while in others, they may be performed some time after the occurrence of the event or the fulfillment of the condition.

[0021] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0022] It should be noted that the headings of any section / subsection provided herein are not limiting. Various embodiments are described throughout this document, and embodiments of any type may be included under any section / subsection. Furthermore, embodiments described in any section / subsection may be combined in any way with any other embodiments described in the same section / subsection and / or different sections / subsections.

[0023] In the description of embodiments of this disclosure, the term "comprising" and similar terms should be understood as open-ended inclusion, i.e., "including but not limited to". The term "based on" should be understood as "at least partially based on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below. The terms "first", "second", etc., may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0024] Existing live streaming scenarios lack dedicated interactive drawing tools. While drawing tools exist outside of live streaming, they often suffer from high performance costs and are not well-suited to the demands of live streaming. Furthermore, these tools offer limited texture representation, restricting the possibilities for creative expression during live streams.

[0025] Therefore, embodiments of this disclosure propose a scheme for live streaming interaction. According to various embodiments of this disclosure, a set of interactive components is displayed in the playback interface of the target media content. The set of interactive components includes a first interactive component corresponding to a first entity, the first entity being determined based on the target media content, the first interactive component displaying first descriptive information of the first entity; and in response to the selection of the first interactive component, a first set of search results corresponding to the first entity is displayed.

[0026] Therefore, the embodiments of this disclosure significantly enhance the interactivity of live streaming by implementing an interactive drawing tool for a live streaming scenario. Furthermore, by providing brush styles corresponding to various texture elements, the embodiments of this disclosure further enrich the expressive forms of the drawing content.

[0027] Furthermore, by performing rendering processes with different performance at different stages (e.g., during and after the sliding process), embodiments of this disclosure can not only reduce rendering performance consumption but also improve the quality of the created graphic elements.

[0028] Example embodiments of this disclosure are described below with reference to the accompanying drawings.

[0029] Example Environment

[0030] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. For example... Figure 1 As shown, example environment 100 may include electronic device 110.

[0031] In this example environment 100, electronic device 110 may run an application 120 for providing and viewing media content. Application 120 may be any suitable type of application for providing and viewing media content, examples of which may include, but are not limited to, online video applications, social applications, content sharing applications, etc. User 140 may interact with application 120 via electronic device 110 and / or its attached devices.

[0032] exist Figure 1 In environment 100, if application 120 is active, electronic device 110 can display interface 150 corresponding to application 120. Interface 150 may include various pages provided by application 120, such as media content playback pages.

[0033] In some embodiments, electronic device 110 communicates with server 130 to provide services to application 120. Server 130 can provide functions such as management, configuration, and maintenance of the application or website.

[0034] Electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal, including mobile phones, desktop computers, laptop computers, notebook computers, netbook computers, tablet computers, media computers, multimedia tablets, handheld computers, portable gaming terminals, VR / AR devices, personal communication system (PCS) devices, personal navigation devices, personal digital assistants (PDAs), audio / video players, digital cameras / camcorders, positioning devices, television receivers, radio receivers, e-book devices, gaming devices, or any combination thereof, including accessories and peripherals of these devices or any combination thereof. In some embodiments, electronic device 110 can also support any type of user-facing interface (such as "wearable" circuitry).

[0035] Server 130 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content delivery networks, and big data and artificial intelligence platforms. Server 130 may include, for example, computing systems / servers such as mainframes, edge computing nodes, computing devices in a cloud environment, etc. Server 130 can provide backend services for applications 120 in electronic devices 110 that support live interactive streaming.

[0036] A communication connection can be established between server 130 and electronic device 110. This communication connection can be established via wired or wireless means. The communication connection may include, but is not limited to, Bluetooth, mobile network, Universal Serial Bus (USB), and Wireless Fidelity (WiFi) connections; the embodiments of this disclosure are not limited in this respect. In the embodiments of this disclosure, server 130 and electronic device 110 can achieve signaling interaction through the communication connection between them.

[0037] It should be understood that the structure and function of the various elements in environment 100 are described for illustrative purposes only and do not imply any limitation on the scope of this disclosure.

[0038] The various example implementations of this disclosure will be described in detail below.

[0039] Example drawing tools

[0040] The following will be referenced Figures 2A to 2C To describe an example live streaming interaction process according to embodiments of the present disclosure. Figures 2A to 2C Example live streaming interfaces 200A to 200C according to some embodiments of the present disclosure are shown. Interfaces 200A to 200C may, for example, be provided by... Figure 1 The electronic device 110 shown is provided.

[0041] In some embodiments, interfaces 200A to 200C may correspond to the live streamer (e.g., the streamer user). As will be described in detail below, electronic device 110 may receive requests from the streamer user for the use of interactive resources (e.g., drawing props) and may accordingly add graphic elements corresponding to the touch operation to the live stream screen.

[0042] In some embodiments, the electronic device 110 may provide broadcasters with various types of drawing tools. In some embodiments, different types of drawing tools may correspond to different brush effects, that is, the style of the texture element corresponding to the brush trajectory.

[0043] like Figure 2A As shown, the electronic device 110 can, for example, receive the selection of an animal brush by the broadcaster user. Furthermore, the electronic device 110 can receive the swiping operation 205 of the broadcaster user on the live streaming interface 200A.

[0044] In some embodiments, the electronic device 110 may determine the corresponding first set of coordinate points (i.e., sliding coordinates) based on the sliding operation 205. Further, the electronic device 110 may render the graphic element 210 based on the first set of coordinate points during the sliding operation 205.

[0045] like Figure 2B As shown, as the sliding operation 205 continues, the graphic element 210 can gradually extend and be updated to graphic element 215 (also known as the first graphic element).

[0046] like Figure 2B As shown, graphic element 215 can have an animal style, and it can, for example, have a variety of different texture elements. These various texture elements can each correspond to a selected painting tool. For example, different painting tools can correspond to different styles of texture elements.

[0047] As an example, graphic element 215 may include texture element 220 corresponding to the tail (also called head texture), texture element 225 corresponding to the body (also called body texture), and texture element 230 corresponding to the head (also called head texture).

[0048] In some embodiments, the rendered graphic element 210 can be added to the live stream of the live broadcast room as part of the live stream. For example, the electronic device 110 can generate a video stream containing the graphic element 210 locally and send the video stream to the server 130 so that other clients in the live broadcast room can display the live stream containing the graphic element 210.

[0049] In some embodiments, during the continuous sliding operation 205, the electronic device 110 draws the graphic element 215 based on the user's sliding coordinates. However, since the user's sliding may not be smooth enough, it affects the realism of the graphic element 215.

[0050] In some embodiments, after the sliding operation 205 ends, the electronic device 110 may also perform smoothing processing on the first set of coordinate points (i.e., the sliding coordinates) corresponding to the sliding operation 205 to determine the second set of coordinate points. As will be described in detail below, the electronic device 110 may, for example, perform one or more rounds of interpolation calculations to determine the second set of coordinate points.

[0051] Furthermore, such as Figure 2C As shown, the electronic device 110 can render the graphic element 240 based on the smoothed second set of coordinate points.

[0052] In some embodiments, the rendered graphic element 240 can be added to the live stream of the live broadcast room as part of the live stream. For example, the electronic device 110 can generate a video stream containing the graphic element 240 locally and send the video stream to the server 130 so that other clients in the live broadcast room can display the live stream containing the graphic element 240.

[0053] In this way, the embodiments of this disclosure significantly enhance the interactivity of live streaming by implementing an interactive drawing tool for a live streaming scenario. Furthermore, by providing brush styles corresponding to various texture elements, the embodiments of this disclosure further enrich the expressive forms of the drawing content.

[0054] In some embodiments, the electronic device 110 may also provide one or more editing controls (not shown) corresponding to the selected interactive resource (e.g., drawing props).

[0055] As an example, electronic device 110 may provide, for instance, a first editing control (also known as an erase control) for erasing the most recently added graphic element. Figure 2C As an example, upon receiving a selection of the erase control, the electronic device 110 can stop displaying the rendered graphical elements 240 in the live broadcast interface 200C.

[0056] In some embodiments, the electronic device 110 may also provide a second editing control (also called a clear control) for clearing all graphic elements corresponding to the selected drawing prop.

[0057] Alternatively, in response to a selection of a second editing control associated with the interactive resource in the live streaming interface, the display of a set of graphical elements rendered based on the interactive resource can be stopped in the live streaming interface. As an example, upon receiving a selection of the clear control, the electronic device 110 may stop displaying all graphical elements rendered based on the drawing prop in the live streaming interface.

[0058] In some embodiments, the electronic device 110 may allow the creation of multiple graphic elements in the live streaming interface. For example, for the same drawing tool, the electronic device 110 may set an upper limit on the number of graphic elements that can be added. Once this upper limit is reached, when the electronic device 110 receives a new drawing operation, it can erase the earliest graphic element rendered based on that drawing tool from the live streaming interface.

[0059] In some embodiments, the electronic device 110 may also allow simultaneous rendering of graphic elements created using different drawing tools within a live streaming interface. As an example, the electronic device 110 may also receive a selection of another drawing tool (also known as a second interactive resource). Furthermore, the electronic device 110 may receive a swipe operation and render new graphic elements based on a third set of coordinate points corresponding to the received swipe operation.

[0060] In some examples, the new graphic element may include multiple texture elements of different types corresponding to the selected painting prop. For example, another painting prop may correspond to a head texture, body texture, and tail texture for another animal.

[0061] Similarly, after the sliding operation is completed, the electronic device 110 can smooth the third set of coordinate points and render updated graphic elements based on the smoothed coordinate points.

[0062] The following will be further combined Figure 3 This describes the specific process of rendering graphical elements.

[0063] like Figure 3 As shown, at 302, the electronic device 110 can write the starting coordinates of the swipe operation into a coordinate point array. At 304, the electronic device 110 can receive the swipe operation of a finger.

[0064] At 306, the electronic device 110 can determine whether the sliding distance exceeds a threshold. If so, at 308, the electronic device 110 can write the new touch point to the coordinate point array; otherwise, the electronic device 110 can determine whether the threshold is exceeded based on the detected change in the sliding distance.

[0065] At 310, the electronic device 110 can determine whether the array length of the coordinate points exceeds two. If so, the electronic device 110 can initiate the first stage of the rendering process. Specifically, at 312, the electronic device 110 can calculate the mesh based on the coordinate points.

[0066] like Figure 3 As shown, step 312 may specifically include steps 316 to 320. Specifically, in step 316, the electronic device 110 may determine the tangent direction of the new coordinate point based on the coordinate points in the coordinate point array, and may determine the normal direction based on the perpendicular line of the tangent direction. Further, the electronic device 110 may determine the drawing coordinates (e.g., UV coordinates) corresponding to the coordinate point. The above information may, for example, be written to a cache.

[0067] Furthermore, at 318, the electronic device 110 can correct the tangent, normal, and UV coordinates of the previous coordinate point based on the data of the new coordinate point. For example, in the case of multiple coordinate points forming a corner, the electronic device 110 can correct the vertex data and vertex index data of the previous coordinate based on the data of the new coordinate point, thereby improving the continuity between rendering data. The electronic device 110 can write the corrected data into a cache.

[0068] In 320, the electronic device 110 can calculate the vertex array and triangle index based on the coordinate point array, the line segment length array, and the texture coordinate array, and can write the above data into the cache.

[0069] In 322, the electronic device 110 can calculate the triangles and mesh based on the vertex information and index information in the buffer.

[0070] Specifically, during the process of calculating the grid, the electronic device 110 can determine a target direction (e.g., the tangent direction) corresponding to the target texture coordinates to be rendered. Further, the electronic device 110 can determine multiple extended coordinates associated with the target texture coordinates based on the target direction. For example, the electronic device 110 can determine multiple extended coordinates corresponding to uv.y = 0 and uv.y = 1 based on the target texture coordinates and the corresponding normal direction.

[0071] Further, the electronic device 110 can determine the grid corresponding to the target texture coordinates based on the multiple corresponding extended coordinates.

[0072] Continue to refer to Figure 3 , at box 324, the electronic device 110 can perform material rendering and display. Specifically, the electronic device 110 can determine a set of texture coordinates (e.g., UV coordinates) corresponding to the first set of coordinate points. Further, the electronic device 110 can determine the target texture map element corresponding to the target texture coordinates from a set of preset texture map elements based on the distance from the target texture coordinates to the reference texture coordinates in the set of texture coordinates.

[0073] Specifically, the uv.x corresponding to the reference texture coordinates can be 0. Further, if uv.x < 0.1 (i.e., the first threshold) corresponding to the texture coordinates, the electronic device 110 can sample the tail texture map (i.e., the first texture map element); if 0.01 <= uv.x <= 0.99 (i.e., the second threshold), the electronic device 110 can sample the body texture map (i.e., the second texture map element); if uv.x > 0.99, the electronic device 110 can sample the head texture map (e.g., the third texture map element).

[0074] Further, the electronic device 110 can render the target texture map element in the grid corresponding to the target texture coordinates.

[0075] Continue to refer to Figure 3 , at 326, the electronic device 110 can detect whether the finger is lifted, that is, detect whether the sliding operation ends.

[0076] If the sliding operation ends, the electronic device 110 can smooth the coordinate point array at 328 to generate a new grid.

[0077] Specifically, at 330, the electronic device 110 can perform interpolation smoothing according to the coordinate point array in the cache (i.e., the first set of coordinate points) to determine the second set of coordinate points. Further, the electronic device 110 can recalculate rendering data such as the coordinate point array, line segment length array, UV array, order array, triangle face index data, etc. based on the smoothed second set of coordinate points.

[0078] Specifically, in the process of smooth interpolation, electronic device 110 can determine multiple interpolated coordinate points based on the interpolation of multiple coordinate point pairs in the first set of coordinate points. As an example, the calculation process for multiple interpolated coordinate points can be as follows:

[0079]

[0080] Where p1 and p2 are coordinate pairs in the first set of coordinate points, and q1 and q2 are the interpolated coordinate points obtained after interpolation.

[0081] Electronic device 110 may, for example, perform one or more rounds of interpolation to determine a smoothed second set of coordinate points.

[0082] Furthermore, at 332, the electronic device 110 can calculate the triangles and meshes based on the rendering data in the cache. At 334, the electronic device 110 can render new graphical elements based on the updated triangles and meshes.

[0083] Therefore, by performing rendering processes with different performance at different stages (e.g., during and after the sliding process), the embodiments of this disclosure can not only reduce the performance consumption of rendering, but also improve the quality of the created graphic elements.

[0084] Example process

[0085] Figure 4 A flowchart illustrating an example process 400 for live interaction according to some embodiments of the present disclosure is shown. Process 400 can be implemented at terminal device 110. Reference is made below. Figure 1 To describe process 400.

[0086] like Figure 4 As shown in box 410, electronic device 110 receives a request to use interactive resources in the target interface of the live broadcast room.

[0087] In frame 420, in response to receiving a sliding operation, electronic device 110 renders a first graphic element in the target interface based on a first set of coordinate points corresponding to the sliding operation. The first graphic element includes multiple texture elements corresponding to interactive resources.

[0088] In box 430, electronic device 110 responds to the end of the sliding operation by smoothing the first set of coordinate points to determine the second set of coordinate points.

[0089] In box 440, electronic device 110 renders a second graphic element in the target interface based on the second set of coordinate points.

[0090] In some embodiments, the rendered first and second graphical elements are provided to generate the live stream of the live streaming room.

[0091] In some embodiments, rendering a first graphic element in a target interface based on a first set of coordinate points corresponding to a sliding operation includes: determining a set of texture coordinates corresponding to the first set of coordinate points; determining a target texture element corresponding to the target texture coordinates from a set of preset texture elements based on the distance from the target texture coordinates to the reference texture coordinates in the set of texture coordinates; and rendering the target texture element in the grid corresponding to the target texture coordinates.

[0092] In some embodiments, determining the target texture element corresponding to the target texture coordinate based on the distance from the target texture coordinate to the reference texture coordinate in a set of texture coordinates includes one of the following: determining a first texture element from a set of preset texture elements in response to a distance less than a first threshold; determining a second texture element from a set of preset texture elements in response to a distance greater than or equal to the first threshold and less than or equal to a second threshold; and determining a third texture element from a set of preset texture elements in response to a distance greater than the second threshold.

[0093] In some embodiments, the first texture element is a tail texture; or the second texture element is a body texture; or the third texture element is a head texture.

[0094] In some embodiments, process 400 further includes: determining a target direction corresponding to the target texture coordinates; determining a plurality of extended coordinates associated with the target texture coordinates based on the target direction; and determining a mesh based on the plurality of extended coordinates.

[0095] In some embodiments, in response to the end of the sliding operation, smoothing the first set of coordinate points to determine the second set of coordinate points includes: determining a plurality of interpolated coordinate points based on interpolation of a plurality of coordinate point pairs in the first set of coordinate points; and determining the second set of coordinate points based on the plurality of interpolated coordinate points.

[0096] In some embodiments, the interactive resource is a first interactive resource, the multiple texture elements are a first group of texture elements corresponding to the first interactive resource, the sliding operation is a first sliding operation, and the process 400 further includes: receiving a request to use the second interactive resource in the target interface of the live broadcast room; and in response to receiving the second sliding operation, rendering a third graphic element in the target interface based on a third group of coordinate points corresponding to the second sliding operation, the third graphic element including a second group of texture elements corresponding to the second interactive resource.

[0097] In some embodiments, process 400 further includes: stopping the display of rendered second graphical elements in the live streaming interface in response to the selection of a first editing control associated with the interactive resource in the live streaming interface; or stopping the display of a set of graphical elements rendered based on the interactive resource in the live streaming interface in response to the selection of a second editing control associated with the interactive resource in the live streaming interface.

[0098] In some embodiments, process 400 further includes: sending live data to a server to display a live screen including a first graphical element or a second graphical element at a client associated with the live room.

[0099] Example devices and equipment

[0100] Embodiments of this disclosure also provide corresponding apparatus for implementing the above methods or processes. Figure 4 A schematic structural block diagram of a device 400 for live interactive broadcasting according to certain embodiments of the present disclosure is shown. The device 500 may be implemented as or included in a terminal device 110. The various modules / components in the device 500 may be implemented by hardware, software, firmware, or any combination thereof.

[0101] like Figure 5 As shown, the apparatus 500 includes: a request receiving module 510 configured to receive a request to use interactive resources in a target interface of a live streaming room; a first rendering module 520 configured to render a first graphic element in the target interface based on a first set of coordinate points corresponding to the sliding operation in response to receiving a sliding operation, the first graphic element including multiple texture elements corresponding to the interactive resources; a coordinate smoothing module 530 configured to smooth the first set of coordinate points to determine a second set of coordinate points in response to the end of the sliding operation; and a second rendering module 540 configured to render a second graphic element in the target interface based on the second set of coordinate points, wherein the rendered first and second graphic elements are provided for generating a live streaming screen of the live streaming room.

[0102] In some embodiments, the rendered first and second graphical elements are provided to generate the live stream of the live streaming room.

[0103] In some embodiments, the first rendering module 520 is further configured to: determine a set of texture coordinates corresponding to the first set of coordinate points; determine a target texture element corresponding to the target texture coordinates from a set of preset texture elements based on the distance from the target texture coordinates to the reference texture coordinates in the set of texture coordinates; and render the target texture element in the grid corresponding to the target texture coordinates.

[0104] In some embodiments, the first rendering module 520 is further configured to: determine a first texture element from a set of preset texture elements in response to a distance less than a first threshold; determine a second texture element from a set of preset texture elements in response to a distance greater than or equal to the first threshold and less than or equal to a second threshold; and determine a third texture element from a set of preset texture elements in response to a distance greater than the second threshold.

[0105] In some embodiments, the first texture element is a tail texture; or the second texture element is a body texture; or the third texture element is a head texture.

[0106] In some embodiments, the first rendering module 520 is further configured to: determine a target direction corresponding to the target texture coordinates; determine a plurality of extended coordinates associated with the target texture coordinates based on the target direction; and determine a mesh based on the plurality of extended coordinates.

[0107] In some embodiments, the coordinate smoothing module 530 is further configured to: determine a plurality of interpolated coordinate points based on the interpolation of a plurality of coordinate point pairs in the first set of coordinate points; and determine a second set of coordinate points based on the plurality of interpolated coordinate points.

[0108] In some embodiments, the interactive resource is a first interactive resource, the multiple texture elements are a first group of texture elements corresponding to the first interactive resource, the sliding operation is a first sliding operation, and the device 500 further includes an interactive module configured to: receive a request to use a second interactive resource in the target interface of the live broadcast room; and in response to receiving the second sliding operation, render a third graphic element in the target interface based on a third group of coordinate points corresponding to the second sliding operation, the third graphic element including a second group of texture elements corresponding to the second interactive resource.

[0109] In some embodiments, process 500 further includes a drawing control module configured to: stop displaying rendered second graphic elements in the live streaming interface in response to selection of a first editing control associated with an interactive resource in the live streaming interface; or stop displaying a set of graphic elements rendered based on the interactive resource in the live streaming interface in response to selection of a second editing control associated with an interactive resource in the live streaming interface.

[0110] In some embodiments, the apparatus 500 further includes a sending module configured to send live data to a server to display a live screen including a first graphical element or a second graphical element at a client associated with the live room.

[0111] The units included in device 500 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units may be implemented using software and / or firmware, such as machine-executable instructions stored on a storage medium. In addition to or as an alternative to machine-executable instructions, some or all of the units in device 500 may be implemented at least partially by one or more hardware logic components. By way of example and not limitation, exemplary types of hardware logic components that may be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-chips (SoCs), complex programmable logic devices (CPLDs), and so on.

[0112] Figure 6 A block diagram of an electronic device 500 in which one or more embodiments of the present disclosure may be implemented is shown. It should be understood that... Figure 6 The electronic device 600 shown is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. Figure 6 The electronic device 600 shown can be used to achieve Figure 1 Electronic devices 110.

[0113] like Figure 6 As shown, electronic device 600 is in the form of a general-purpose electronic device. Components of electronic device 600 may include, but are not limited to, one or more processors or processing units 610, memory 620, storage device 630, one or more communication units 640, one or more input devices 650, and one or more output devices 660. Processing unit 610 may be a physical or virtual processor and is capable of performing various processes according to programs stored in memory 620. In a multiprocessor system, multiple processing units execute computer-executable instructions in parallel to improve the parallel processing capability of electronic device 600.

[0114] Electronic device 600 typically includes multiple computer storage media. Such media can be any accessible media that is accessible to electronic device 600, including but not limited to volatile and non-volatile media, removable and non-removable media. Memory 620 can be volatile memory (e.g., registers, cache, random access memory (RAM)), non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. Storage device 630 can be removable or non-removable media and can include machine-readable media, such as flash drives, disks, or any other media that can be used to store information and / or data and can be accessed within electronic device 600.

[0115] Electronic device 600 may further include additional removable / non-removable, volatile / non-volatile storage media. Although not explicitly stated... Figure 6 As shown, disk drives for reading from or writing to removable, non-volatile disks (e.g., "floppy disks") and optical disk drives for reading from or writing to removable, non-volatile optical disks can be provided. In these cases, each drive can be connected to a bus (not shown) via one or more data media interfaces. Memory 620 may include computer program product 625 having one or more program modules configured to perform various methods or actions of various embodiments of this disclosure.

[0116] The communication unit 640 enables communication with other electronic devices via a communication medium. Additionally, the functionality of the components of the electronic device 600 can be implemented using a single computing cluster or multiple computing machines capable of communicating via communication connections. Therefore, the electronic device 600 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0117] Input device 650 can be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 660 can be one or more output devices, such as a monitor, speaker, printer, etc. Electronic device 600 can also communicate with one or more external devices (not shown) via communication unit 640 as needed. These external devices include storage devices, display devices, etc., and can communicate with one or more devices that enable user interaction with electronic device 600, or with any device that enables electronic device 600 to communicate with one or more other electronic devices (e.g., network card, modem, etc.). Such communication can be performed via input / output (I / O) interface (not shown).

[0118] According to an exemplary implementation of this disclosure, a computer-readable storage medium is provided that stores computer-executable instructions thereon, wherein the computer-executable instructions are executed by a processor to implement the methods described above. According to an exemplary implementation of this disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, which are executed by a processor to implement the methods described above.

[0119] Various aspects of this disclosure are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, devices, and computer program products implemented according to this disclosure. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0120] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processing unit of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner. Thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0121] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions that execute on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0122] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing the specified logical function. In some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0123] Various implementations of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed implementations. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The terminology used herein is chosen to best explain the principles, practical applications, or improvements to technology in the market, or to enable others skilled in the art to understand the various implementations disclosed herein.

Claims

1. A method for live streaming interaction, comprising: Receive requests to use interactive resources on the target interface of the live stream; In response to receiving a swipe operation, based on the first set of coordinate points corresponding to the swipe operation, a first graphic element is rendered in the target interface, the first graphic element including a variety of texture elements corresponding to the interactive resource; In response to the end of the sliding operation, the first set of coordinate points is smoothed to determine the second set of coordinate points; as well as Based on the second set of coordinate points, render the second graphic element in the target interface. The first and second graphic elements are rendered and provided to generate the live stream screen of the live streaming room.

2. The method according to claim 1, wherein rendering the first graphic element in the target interface based on the first set of coordinate points corresponding to the sliding operation comprises: Determine a set of texture coordinates corresponding to the first set of coordinate points; Based on the distance from the target texture coordinates to the reference texture coordinates in the set of texture coordinates, the target texture element corresponding to the target texture coordinates is determined from a set of preset texture elements; as well as The target texture element is rendered in the grid corresponding to the target texture coordinates.

3. The method according to claim 2, wherein determining the target texture element corresponding to the target texture coordinates from a set of preset texture elements based on the distance from the target texture coordinates to the reference texture coordinates in the set of texture coordinates includes one of the following: In response to the distance being less than a first threshold, a first texture element is determined from the set of preset texture elements; In response to the distance being greater than or equal to the first threshold and less than or equal to the second threshold, a second texture element is determined from the set of preset texture elements; In response to the distance being greater than the second threshold, a third texture element is determined from the set of preset texture elements.

4. The method according to claim 3, wherein: The first texture element is the tail texture; or The second texture element is a body texture; or The third texture element is the head texture.

5. The method according to claim 2, further comprising: Determine the target direction corresponding to the target texture coordinates; Based on the target direction, determine multiple extended coordinates associated with the target texture coordinates; as well as The grid is determined based on the multiple extended coordinates.

6. The method of claim 1, wherein smoothing the first set of coordinate points to determine the second set of coordinate points in response to the end of the sliding operation comprises: Based on the interpolation of multiple coordinate point pairs in the first set of coordinate points, multiple interpolation coordinate points are determined; as well as Based on the multiple interpolated coordinate points, the second set of coordinate points is determined.

7. The method according to claim 1, wherein the interactive resource is a first interactive resource, the plurality of texture elements are a first group of texture elements corresponding to the first interactive resource, the sliding operation is a first sliding operation, and the method further comprises: Receive requests to use the second interactive resource on the target interface of the live stream; as well as In response to receiving a second sliding operation, a third graphic element is rendered in the target interface based on a third set of coordinate points corresponding to the second sliding operation. The third graphic element includes a second set of texture elements corresponding to the second interactive resource.

8. The method according to claim 1, further comprising: In response to the selection of a first editing control associated with the interactive resource in the live streaming interface, the display of the rendered second graphical element in the live streaming interface is stopped; or In response to the selection of a second editing control associated with the interactive resource in the live streaming interface, the display of a set of graphical elements rendered based on the interactive resource in the live streaming interface is stopped.

9. The method according to claim 1, further comprising: Live data is sent to the server to display the live screen, including the first graphic element or the second graphic element, at the client associated with the live room.

10. A device for live streaming interaction, comprising: The request receiving module is configured to receive requests for using interactive resources in the target interface of the live broadcast room; The first rendering module is configured to, in response to receiving a sliding operation, render a first graphic element in the target interface based on a first set of coordinate points corresponding to the sliding operation. The first graphic element includes multiple texture elements corresponding to the interactive resource. A coordinate smoothing module is configured to smooth the first set of coordinate points in response to the end of the sliding operation to determine the second set of coordinate points; as well as The second rendering module is configured to render the second graphical element in the target interface based on the second set of coordinate points. The first and second graphic elements are rendered and provided to generate the live stream screen of the live streaming room.

11. An electronic device, comprising: At least one processing unit; as well as At least one memory, coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, which, when executed by the at least one processing unit, cause the electronic device to perform the method according to any one of claims 1 to 9.

12. A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method according to any one of claims 1 to 9.

Images