Bullet screen processing method, device, electronic device, and program
Customizable barrage styles enrich expression forms and improve user engagement while optimizing resource utilization in multimedia playback.
Patent Information
- Application Number
- JP2023182890
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-02-10
- Filing Date
- 2023-10-25
- Publication Date
- 2025-07-15
- Estimated Expiration
- 2040-11-03
AI Technical Summary
Existing barrage content display methods lack diversity in expression forms, fail to attract user attention, and inefficiently utilize computing resources due to the uniform display of text-based barrages.
A method and apparatus that allow users to customize the shape, color, and special effects of barrage content during multimedia playback, enabling dynamic or static styles, and transmit these customized styles alongside the content for synchronized display.
Enhances user engagement by providing diverse and attention-grabbing barrage displays, optimizing resource utilization by tailoring the presentation of barrage content.
Smart Images

Figure 0007707499000001 
Figure 0007707499000002 
Figure 0007707499000003
Abstract
Description
Cross-reference to Related Applications
[0001] This application is filed based on a Chinese patent application with an application number of 202010085287.8 and a filing date of February 10, 2020, and claims the priority of the Chinese patent application. All the contents of the Chinese patent application are incorporated herein by reference.
Technical Field
[0002] This application relates to Internet technology, and particularly to a barrage processing method, apparatus, electronic device, and computer-readable storage medium.
Background Art
[0003] With the development of Internet technology and multimedia technology, a new content display method, namely, barrage content display, has gradually become active and is widely applied in scenes such as video playback and live broadcast interaction. Regarding barrage content, generally, it is displayed on a multimedia playback interface so that when a user views multimedia information, the barrage content can also be viewed simultaneously. For example, when the multimedia information is a video and the barrage content is a user's comment, on the video playback interface, multiple barrage contents can be scrolled and displayed in order based on the order of the transmission times of the multiple barrage contents.
Summary of the Invention
[0004] The technical solution of the embodiments of this application is realized as follows. A barrage processing method executed by an electronic device according to an embodiment of this application is responding to a barrage editing operation received during the playback of multimedia information, and displaying a barrage editing interface; receiving, by the barrage editing interface, barrage content to be transmitted, and receiving, by the barrage editing interface, a barrage style set for the barrage content, wherein the attributes of the barrage style include the shape of the barrage content; Transmitting the barrage content and the barrage style, including the step of displaying the barrage content matching the barrage style on a multimedia playback interface.
[0005] The barrage processing apparatus according to an embodiment of the present application includes a display module configured to display a barrage editing interface in response to a barrage editing operation received during playback of multimedia information; a receiving module configured to receive, via the barrage editing interface, barrage content to be transmitted, and to receive, via the barrage editing interface, a barrage style set for the barrage content, wherein attributes of the barrage style include the shape of the barrage content; and a transmitting module configured to transmit the barrage content and the barrage style. The display module is configured to display the barrage content matching the barrage style on a multimedia playback interface.
[0006] The electronic device according to an embodiment of the present application includes a memory storing executable instructions; and a processor configured to implement the barrage processing method according to an embodiment of the present application when executing the executable instructions stored in the memory.
[0007] The computer-readable storage medium according to an embodiment of the present application stores executable instructions that, when executed by a processor, implement the barrage processing method according to an embodiment of the present application.
Brief Description of the Drawings
[0008]
Figure 1
Figure 2
Figure 3A
Figure 3B
Figure 3C
Figure 4
Figure 5A
Figure 5B
Figure 6
Figure 7
Figure 8
Figure 9
Figure 10
Figure 11
Embodiments for Carrying Out the Invention
[0009] To make the object, technical solution and advantages of the present application clearer, the present application will be further described in detail below with reference to the drawings. The described embodiments do not limit the present application, and other embodiments that can be conceived by those skilled in the art without creative efforts all belong to the protection scope of the present application.
[0010] The following "some embodiments" described only explain a subset of all possible embodiments. For better understanding, "some embodiments" may be the same or different subsets of all possible embodiments and can be combined with each other when they do not conflict.
[0011] Unless otherwise defined, all technical and scientific terms used in this specification have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. The terms used in this specification are for the purpose of describing the embodiments of the present application only and are not intended to limit the present application.
[0012] Before further elaborating on the embodiments of the present application, the nouns and terms related to the embodiments of the present application will be explained, and the nouns and terms related to the embodiments of the present application are applicable to the following interpretations.
[0013] 1) Bullet screen content: The bullet screen content may be from different users and is for commenting on multimedia information or for interacting based on multimedia information. When displaying the bullet screen content, it can be displayed on the playback interface of the multimedia information.
[0014] 2) Multimedia information: Media refers to a carrier that carries and transmits certain information or substances. In the field of computers, media is mainly a carrier for transmitting and storing information, and the information transmitted includes audio, characters, video, audio, etc. Multimedia information refers to integrating the functions of various media and displaying them in the form of characters, audio, or video on an interactive interface.
[0015] 3) Bullet screen style: Attributes / characteristics related to the visual representation of the bullet screen content, that is, the style when displaying the bullet screen content. In the embodiments of the present application, the attributes of the bullet screen style include at least the shape of the bullet screen content (i.e., the outer shape / contour of the bullet screen content).
[0016] The attributes of the bullet screen style may further include the arrangement method of the bullet screen content, the size of the bullet screen content, the color of the bullet screen content, the special effects of the bullet screen content, etc. Also, the types of bullet screen styles may include static bullet screens (corresponding to static display effects) and dynamic bullet screens (corresponding to dynamic display effects).
[0017] Note that the "plural" mentioned in this specification refers to two or more, and the symbol " / " indicates that the related objects before and after are in an "or" relationship.
[0018] Regarding the display of barrage content, the solution means in the related art is that the barrage content sent by the user can be streamed to the playback interface of the multimedia information in the form of a line of text. The expression form of the barrage content is single, and the barrage content sent by the user cannot be differentially displayed, which affects the user experience. At the same time, the displayed barrage content cannot attract the user's attention, and the computing resources consumed when the electronic device displays the barrage content are wasted. That is, the actual utilization rate of the computing resources of the electronic device is low.
[0019] In view of this, the embodiments of the present application provide a barrage processing method, device, electronic device and computer-readable storage medium, which can increase the expression form of the barrage content, improve the interestingness of the barrage content, and at the same time improve the actual utilization rate of the computing resources consumed when the electronic device displays the barrage content.
[0020] Hereinafter, application examples of the electronic device according to the embodiments of the present application will be described. The electronic device according to the embodiments of the present application may be implemented as various types of user terminals such as a notebook computer, a tablet computer, a desktop computer, a set-top box, a mobile device (for example, a mobile phone, a portable music player, a personal digital assistant, a dedicated messaging device, a portable game device), an in-vehicle computer, etc., may also be implemented as a server or a server cluster, etc., and may further be implemented in a manner in which the user terminal and the server cooperate. Hereinafter, application examples in the case where the electronic device is implemented as a user terminal will be described.
[0021] As shown in FIG. 1, FIG. 1 is a schematic architecture diagram of a barrage processing system 100 according to an embodiment of the present application. Both the user terminal 400-1 and the user terminal 400-2 are connected to the server 200 via the network 300. The network 300 may be a wide area network or a local area network, or a combination of both.
[0022] As shown in FIG. 1, the client 410-1 on the user terminal 400-1 requests multimedia information from the server 200 via the network 300. The types of multimedia information include audio, video, etc. The server 200 transmits the multimedia information requested by the client 410-1 to the client 410-1, and the client 410-1 decrypts and plays it. In FIG. 1, the multimedia information played by the client 410-2 is the same as that of the client 410-1.
[0023] During the playback of multimedia information by the client 410-1, the client 410-1 receives the barrage content submitted by the user 1 and transmits it to the server 200. Subsequently, the server 200 transmits the barrage content submitted by the user 1 to each client (including the client 410-1 and the client 410-2) that requests the multimedia information together with the multimedia information. When the client 410-1 and the client 410-2 decrypt and play the data stream of the multimedia information, they display the barrage on the multimedia playback interface. For example, according to the order in which the barrage content is sent to the server, a plurality of barrage contents are displayed in sequence. Also, for example, according to the order of the time points of the multimedia information corresponding to the barrage content (for example, if a certain barrage content is sent by the user at the 10th second of the multimedia information, the time point of the multimedia information corresponding to the barrage content is the 10th second), a plurality of barrage contents are displayed in sequence.
[0024] Regarding the display of each barrage content, the embodiment of the present application provides a barrage processing method. When a user sends a barrage, the user is provided with a function to set a barrage style customized for the barrage content to be sent. Exemplarily, when the client 410-1 receives a barrage editing operation during the playback of multimedia information, it displays a barrage editing interface, and through the barrage editing interface, it receives the barrage content to be sent and the barrage style set for the barrage content. Then, the client 410-1 sends the barrage content input by the user 1 and the barrage style set for the barrage content to the server 200. The server 200 can send the barrage content and the barrage style to all clients (which may include the client 410-1 itself) that are playing the same multimedia information as the client 410-1. Each client analyzes the received barrage style and displays the barrage content that matches the barrage style on the playback interface.
[0025] In some embodiments, the number of user terminals in FIG. 1 may be only one. Taking the user terminal 400-1 as an example, the client 410-1 can directly display the barrage content input by the user based on the barrage style set by the user, that is, there is no need to interact with the server 200, and the display of barrage content in the offline mode can be realized. Or, the client 410-1 sends the barrage style and the barrage content to the server 200. After the server 200 receives the barrage content sent from the client 410-1 and the barrage style set for the barrage content, by replying the barrage content and the barrage style only to the client 410-1, the barrage content that matches the barrage style can be displayed only on the multimedia playback interface of the client 410-1.
[0026] In some embodiments, the user terminal can implement the bullet screen processing method according to the embodiments of this application by executing a computer program. For example, the computer program may be a native program or software module in an operating system, and may also be a local (Native) application program (APP, Application), that is, a program that cannot be executed without being installed in the operating system. It may also be a widget, that is, a program that can be executed only by being downloaded in a browser environment, or a widget that can be embedded in any APP. In short, the above computer program may be an application program, module or plug-in in any form.
[0027] The embodiments of this application can be implemented by cloud technology. Cloud technology refers to a hosting technology that integrates a series of resources such as hardware, software, and networks in a wide area network or local area network to realize computing, storage, processing, and sharing of data. In another sense, cloud technology is also a general term for network technology, information technology, integration technology, management platform technology, and application technology based on the application of the business model of cloud computing. It constitutes a resource pool and can be used as needed, which is flexible and convenient. Cloud computing technology provides important support. The background service of the technical network system requires a large amount of computing and memory resources.
[0028] In some embodiments, the server may be an independent physical server, or may be a server cluster or distributed system composed of multiple physical servers, and may further be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, big data, and artificial intelligence platforms. For example, the cloud service may be a multimedia information service and is used for being called by a user terminal. The user terminal and the server can be directly or indirectly connected by a wired or wireless communication method, which is not limited in the embodiments of the present application.
[0029] As shown in FIG. 2, FIG. 2 is a schematic configuration diagram of an electronic device according to an embodiment of the present application. The user terminal 400 shown in FIG. 2 includes at least one processor 410, a memory 450, at least one network interface 420, and a user interface 430. Each component in the user terminal 400 is coupled by a bus system 440. As can be understood, the bus system 440 is for realizing connection communication between these components. In addition to including a data bus, the bus system 440 further includes a power bus, a control bus, and a status signal bus. For the sake of clarity in the description, in FIG. 2, all various buses are denoted as the bus system 440.
[0030] The processor 410 may be a general-purpose processor, a digital signal processor (DSP), or an integrated circuit chip having signal processing functions such as other programmable logic devices, discrete gates, or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any general processor, etc.
[0031] The user interface 430 includes one or more output devices 431 capable of displaying media content including one or more speakers and / or one or more visual displays. The user interface 430 further includes one or more input devices 432 including user interface components useful for user input such as a keyboard, mouse, microphone, touch screen display, camera, and other input keys and controls.
[0032] The memory 450 may be removable, non-removable, or a combination thereof. Exemplary hardware devices include solid state memory, hard disk drives, optical disk drives, and the like. The memory 450 preferably includes one or more storage devices physically separate from the processor 410.
[0033] The memory 450 includes volatile memory or non-volatile memory, and may include both volatile and non-volatile memory. The non-volatile memory may be read-only memory (ROM), and the volatile memory may be random access memory (RAM). The memory 450 described in the embodiments of the present application is considered to include any suitable type of memory.
[0034] In some embodiments, the memory 450 can store data to support various operations, examples of which include programs, modules, and data structures, or subsets or supersets thereof, which are exemplified below.
[0035] The operating system 451 includes system programs that process various basic system services and execute hardware-related tasks, such as a framework layer, a core library layer, a driver layer, etc., to implement various basic services and process hardware-based tasks. The network communication module 452 reaches other computing devices via one or more (wired or wireless) network interfaces 420. Exemplary network interfaces 420 include Bluetooth, Wireless Fidelity (WiFi), Universal Serial Bus (USB), and the like. The display module 453 can display information by means of one or more output devices 431 (such as a display, a speaker, etc.) related to the user interface 430 (for example, a user interface that operates peripheral devices and displays content and information). The input processing module 454 detects one or more user inputs or interactions from one of the one or more input devices 432 and translates the detected inputs or interactions.
[0036] In some embodiments, the bullet screen processing apparatus according to the embodiments of the present application can be implemented in a software manner. FIG. 2 shows the bullet screen processing apparatus 455 stored in the memory 450, which may be software in the form of a program, a plugin, etc., and includes software modules such as a display module 4551, a reception module 4552, and a transmission module 4553. In some embodiments, it may further include a determination module 4554 and a conversion module 4555. Since the above modules are logical, any combination or further division can be performed according to the realized functions. In FIG. 2, for the sake of convenience of expression, the above modules are shown at once, but it should not be considered that embodiments of the bullet screen processing apparatus 455 that may include only the display module 4551, the reception module 4552, and the transmission module 4553 are excluded. Hereinafter, the functions of each module will be described.
[0037] Hereinafter, taking the application example when the electronic device according to the embodiments of the present application is implemented as a user terminal as an example, the bullet screen processing method according to the embodiments of the present application will be described by taking the implementation in a client operating on the user terminal as an example.
[0038] Here, the client may be various types of dedicated clients (Native App), such as a video player, an audio player, a short video APP, and a live broadcast APP, etc. The client may also be a browser that plays multimedia information such as video and audio in the form of a web page. The client may further be various web applications (such as a social network APP) where a multimedia playback widget operates, including the browser environment in which the multimedia playback widget executes.
[0039] As shown in FIG. 3A, FIG. 3A is a preferred flowchart of the bullet screen processing method according to an embodiment of the present application, and will be described with reference to the steps shown in FIG. 3A. In step S301A, the client displays a bullet screen editing interface in response to a bullet screen editing operation received during the playback of multimedia information. In step S302A, the client receives the bullet screen content to be sent and the bullet screen style set for the bullet screen content through the displayed bullet screen editing interface. The attributes of the bullet screen style include the shape of the bullet screen content. In step S303A, the client sends the received bullet screen content and bullet screen style, and displays the bullet screen content that matches the bullet screen style on the multimedia playback interface. In this way, when the user sends a bullet screen, the user can set a customized shape for the bullet screen content, greatly enriching the expression form of the bullet screen content. When the client displays the bullet screen content with a customized shape, by increasing the probability that the bullet screen content attracts the user's attention, the actual utilization rate of the computing resources consumed in the display process of the client can be improved.
[0040] Hereinafter, taking the cooperation between the client and the server to implement the bullet screen processing method according to an embodiment of the present application as an example, a specific description will be given. As shown in FIG. 3B, FIG. 3B is a flowchart of the bullet screen processing method according to an embodiment of the present application, and will be described with reference to the steps shown in FIG. 3B.
[0041] In step S301B, the client displays a barrage editing interface in response to a barrage editing operation received during the playback of multimedia information.
[0042] In some embodiments, the client requests multimedia information from the server, decrypts and plays the multimedia information sent from the server. When a barrage editing operation is received during the playback of the multimedia information, it indicates that the user wants to perform barrage editing at that time, and the client displays a barrage editing interface in response to the barrage editing operation.
[0043] The barrage editing operation may be a touch panel operation performed by the user on the multimedia playback interface (i.e., the playback interface of multimedia information). For example, when it is detected that the user has performed a touch panel operation on the multimedia playback interface where the multimedia information is currently being played, a barrage editing interface is displayed. Here, the touch panel operation may include a slide gesture operation, a double-tap operation, or a long-press operation, etc. Naturally, the user can flexibly set different touch panel operations as the barrage editing operation according to their own needs to achieve the customization of the barrage editing operation. For example, the user can set the double-tap operation as the barrage editing operation, and in this way, when a double-tap operation on the multimedia playback interface is detected, the client displays a barrage editing interface.
[0044] Naturally, the type of the barrage editing operation is not limited to the touch panel operation. For example, it may be a voice operation, an operation based on various user interface components (such as a keyboard and a mouse), or a non-touch panel type gesture operation, etc. In the embodiments of the present application, the type of the touch panel operation is not limited.
[0045] Note that the embodiments of the present application do not limit the relationship between interfaces. Taking the multimedia playback interface and the barrage editing interface as examples, the barrage editing interface displayed when the client receives a barrage editing operation may completely cover the multimedia playback interface. The barrage editing interface may be a window-style interface. By covering a part of the multimedia playback interface, the user can perform barrage editing while browsing multimedia information.
[0046] In step S302B, the client receives the barrage content to be transmitted through the barrage editing interface, and receives the barrage style set for the barrage content through the barrage editing interface.
[0047] Here, the barrage editing interface provides an input function for the barrage content and a setting function for the barrage style of the barrage content. The user can input the barrage content and set the barrage style according to actual needs. The attributes of the barrage style include the shape of the barrage content, but this does not limit the embodiments of the present application. For example, the attributes of the barrage style may further include the color, size, special effects, and arrangement method of the barrage content.
[0048] In some embodiments, the types of barrage styles include static barrages and dynamic barrages, and the above step of receiving the barrage style set for the barrage content through the barrage editing interface can be realized in the following manner. The client determines a new barrage style including the set barrage type in response to the setting operation for the barrage type of the barrage content, displays the barrage content to which the new barrage style is applied on the barrage editing interface, and determines the new barrage style as the barrage style set for the barrage content when no setting operation is received within a predetermined time or a barrage transmission operation is received.
[0049] In the embodiments of the present application, a setting function for the type of barrage style can be provided in the barrage editing interface, and the types of barrage styles include static barrages and dynamic barrages. When the client receives a setting operation for the barrage type of the barrage content through the barrage editing interface, it determines a new barrage style including the set barrage type. To facilitate the user to determine whether the new barrage style meets their needs, the client displays the barrage content to which the new barrage style is applied in the barrage editing interface, for example, it can be displayed in the style preview area in the barrage editing interface. When the setting operation is no longer received within a predetermined time or a barrage sending operation is received, the new barrage style is determined as the barrage style set for the barrage content.
[0050] A static barrage refers to the situation where when the barrage content is displayed on the multimedia playback interface, the attributes in the barrage style (including the shape of the barrage, and may further include the color, size, special effects, arrangement method, etc. of the barrage content) do not change. A dynamic barrage refers to the situation where when the barrage content is displayed on the multimedia playback interface, the attributes in the barrage style change.
[0051] Exemplarily, when the barrage type is set to a static barrage, when the barrage content is displayed on the multimedia playback interface, each attribute in the barrage style applied to the barrage content does not change. For example, if the shape of the barrage content is a heart shape, it is always displayed in the shape of a heart during the display process of the barrage content (for example, the process of moving from one end to the other end of the multimedia playback interface).
[0052] Exemplarily, when the bullet screen type is set to a dynamic bullet screen and the bullet screen content is to be displayed on a multimedia playback interface, each attribute in the bullet screen style applied to the bullet screen content will change. Each attribute in the bullet screen style may change constantly, or may only change at the time displayed on the multimedia playback interface (for example, it may change within the first few seconds of display, within the last few seconds of display, or every few seconds). The way each attribute in the bullet screen style changes may change randomly or may be set by the user. For example, for a dynamic bullet screen, if the user does not make additional settings for the way the attributes change, the default change method is adopted. By the above method, the integrity of bullet screen processing can be improved, which meets the setting needs of the user for the type of bullet screen style.
[0053] In addition, the user can simultaneously set the attributes of the bullet screen style and the type of the bullet screen style in the bullet screen editing interface. For example, after the user sets a new shape for the bullet screen content, the user can further set other attributes of the bullet screen style (such as color, size, special effects, and arrangement method, etc.) and the type of the bullet screen style. If the user only sets the bullet screen shape and does not set other attributes and types, other attributes and types of the bullet screen content can adopt random settings or default settings.
[0054] In some embodiments, further, the above step of receiving the barrage style set for the barrage content by the barrage editing interface can be implemented in the following manner. The client displays candidate barrage styles corresponding to the barrage content on the barrage editing interface, and in response to a selection operation on the candidate barrage styles corresponding to the barrage content, determines the selected candidate barrage style as the barrage style set for the barrage content, or displays candidate barrage styles corresponding to the barrage content on the barrage editing interface, and in response to a setting operation of automatically setting a barrage style for the barrage content, determines the similarity between the feature vector of the candidate barrage style and the feature vector of the barrage editing account, and determines the candidate barrage style with the highest similarity as the barrage style set for the barrage content. The barrage editing account is the user account that edits the barrage style.
[0055] In the embodiments of the present application, in addition to manually setting the barrage style, the user can select the barrage style or the client can automatically select the barrage style.
[0056] For example, the client can display at least one candidate barrage style corresponding to the barrage content on the barrage editing interface, and the user can select any one of the candidate barrage styles by a preset operation (such as the method of swiping down with three fingers, tapping with four fingers, etc.). For the selected candidate barrage style, the client can use the candidate barrage style as the barrage style set for the barrage content as it is, or can further adjust the candidate barrage style. For example, a style editing interface can be displayed to allow the user to adjust the candidate barrage style. By the above method, the barrage style can be determined quickly, there is no need for the user to set it manually, and the user experience can be improved.
[0057] For example, after the client displays at least one candidate barrage style on the barrage editing interface, the client can perform automatic selection in response to a setting operation that automatically sets the barrage style for the barrage content. The embodiments of the present application provide two examples of automatic selection. In the first example, the client randomly selects from the at least one candidate barrage style displayed, and determines the candidate barrage style obtained by the selection as the barrage style set for the barrage content. In the second example, for each displayed candidate barrage style, the client determines the similarity between the feature vector of the candidate barrage style and the feature vector of the barrage editing account, and determines the candidate barrage style with the highest similarity as the barrage style set for the barrage content, thereby realizing intelligent selection. The barrage editing account is the user account that edits the barrage style. For example, it is the user account in the logged-in state on the client. By the above method, automatic selection of candidate barrage styles is realized, and further reduction of user operations is achieved.
[0058] In some embodiments, before the client displays the candidate barrage style corresponding to the barrage content on the barrage editing interface, the client further includes the step of performing at least one of the following operations: obtaining the barrage style used by the user account that has a potential friendship relationship with the barrage editing account as a candidate barrage style, obtaining the barrage style used by the user account that has a social relationship with the barrage editing account as a candidate barrage style, and obtaining the barrage style whose usage frequency is greater than the frequency threshold or whose score is greater than the score threshold as a candidate barrage style.
[0059] For example, a client can obtain new candidate barrage styles from the background (i.e., the server) regularly or irregularly. The new candidate barrage styles are the barrage styles used by user accounts that have a potential friendship relationship with the barrage editing account. When the similarity between the user characteristics of the barrage editing account (the user characteristics may include the vector representation of the multimedia information browsed / tapped "like" / retweeted by the barrage editing account) and the user characteristics of a certain user account is greater than the similarity threshold, the user account is regarded as a user account with a potential friendship relationship with the barrage editing account. The barrage style, and the barrage style used by the user account that has a social relationship (such as friends, following, etc.) with the barrage editing account. The social relationship may be subscription, following, interaction (such as tapping "like", sending electronic New Year's money, sharing multimedia information), etc., and this is not limited. The barrage style, and the high-frequency / high-score barrage style statistically obtained by the server according to different criteria. The high frequency may refer to the usage frequency of the barrage style being greater than the frequency threshold, and the high score may refer to the score of the barrage style being greater than the score threshold. It may include at least one of them. For the obtained candidate barrage styles, since the probability that the user (referring to the user using the barrage editing account) is interested in them is high, it can assist the user to set a satisfactory barrage style for the barrage content more quickly.
[0060] Exemplarily, when a user edits a barrage, the client randomly assigns / applies different candidate barrage styles to the barrage content input by the user in sequence, provides a preview entry and a switching entry for the candidate barrage styles, and facilitates the user to view the preview effect of the candidate barrage styles through the preview entry. In this way, until it is determined whether it meets the user's needs or a satisfactory barrage style is selected, the assigned candidate barrage styles can be quickly switched through the switching entry.
[0061] In some embodiments, based on the artificial intelligence solution means, it is possible to effectively assist the user in determining a satisfactory barrage style. For example, a model for predicting the barrage style is trained by a machine learning method, and the trained model is used to predict the barrage style that the user tends to use based on the user's current usage scenario (for example, at least one of the name, type, and duration of the multimedia information that the user is currently viewing) and persona data. This method can be applied to the scenario where the client automatically selects the candidate barrage style as the barrage style set for the barrage content.
[0062] Exemplarily, known persona data, user usage scenarios, and applied barrage styles are used as training samples for the model, and the model is trained using a machine learning method so that the trained model has the function of predicting the barrage style that the user is interested in based on the user's current usage scenario and persona data. Here, the loss function of the model may be various loss functions such as a regression loss function, a mean squared error loss function, an absolute error loss function, and a cross-entropy loss function. The loss function represents the difference between the predicted barrage style and the actually applied barrage style. The type of the model may be various machine learning models, for example, a classification and regression tree model, a neural network model, and various derived grid models.
[0063] In some embodiments, after step 301B, if the client receives the barrage content to be sent through the barrage editing interface and does not receive the barrage style set for the barrage content, the method further includes the step of sending the barrage content and the default barrage style to the server, and displaying the barrage content that matches the default barrage style on the multimedia playback interface.
[0064] Here, when the client only receives the bullet screen content and does not receive the bullet screen style, the default bullet screen style can be used as the bullet screen style set for the bullet screen content. The default bullet screen style may be the style of one-line text, and of course, it can be set based on the actual application scenario.
[0065] Exemplarily, as shown in FIG. 4, after the user inputs the bullet screen content to be sent into the text box (character input interface) of the bullet screen editing interface and then directly taps the "Send" key, the client sends the bullet screen content and the default bullet screen style to the server, and the bullet screen content is displayed on the multimedia playback interface of the client in the style of one-line text.
[0066] In step S303B, the client sends the bullet screen content and the bullet screen style to the server.
[0067] In some embodiments, when the client no longer receives a setting operation for the bullet screen style within a predetermined time or receives a bullet screen sending operation, it sends the bullet screen content and the bullet screen style set for the bullet screen content to the server. The predetermined time can be adjusted according to the actual application scenario.
[0068] Exemplarily, as shown in FIG. 5A, when the client no longer receives a setting operation for the bullet screen style within a predetermined time (for example, within 20 seconds) by the style adjustment area or receives a tap operation on the "Send" key in the style preview area from the user, it sends the bullet screen content and the bullet screen style set for the bullet screen content to the server. The style adjustment area and the style preview area will be described later.
[0069] In step S304B, the client receives the bullet screen content and the bullet screen style sent from the server.
[0070] In step S305B, the client displays bullet screen content that matches the bullet screen style on the multimedia playback interface.
[0071] In some embodiments, the client can send the bullet screen content and the bullet screen style to all clients (or web page playback interfaces) that are playing the same multimedia information and are in an online state by the server, so that the bullet screen content that matches the bullet screen style can be displayed on all multimedia playback interfaces that play the same multimedia information.
[0072] Exemplarily, take the example that clients 1 to N are currently playing the same multimedia information, where N is an integer greater than 1. During the playback of the multimedia information, client 1 receives the bullet screen content to be sent input by user 1 and the bullet screen style set for the bullet screen content, and then sends the bullet screen content and the bullet screen style to the server. After receiving the bullet screen content and the bullet screen style sent from client 1, the server sends the bullet screen content and the bullet screen style to clients 1 to N, so that the bullet screen content that matches the bullet screen style is displayed on the multimedia playback interfaces of clients 1 to N.
[0073] In addition, in the embodiments of the present application, the client may include a bullet screen on / off function. Only when the client turns on the bullet screen function, the bullet screen content that matches the bullet screen style is displayed on the multimedia playback interface of the client. When the client turns off the bullet screen function, no bullet screen content is displayed on the multimedia playback interface of the client.
[0074] In some embodiments, the client can transmit the barrage content and barrage style by the server to the client (or web page playback interface) associated with the user account that is playing the same multimedia information and has a potential friendship relationship with the barrage editing account. The barrage editing account refers to the user account that edits the barrage style. The method for determining the user account that has a potential friendship relationship with the barrage editing account is as follows: when the user account A receives the barrage content and barrage style transmitted for the multimedia information, extract the user characteristics of the user account A based on the persona data of the user account A, calculate the similarity with the user characteristics of the online user accounts that are currently viewing the same multimedia information, determine the user accounts with a similarity higher than the similarity threshold as the user accounts that have a potential friendship relationship with the user account A, and then transmit the barrage content and barrage style to the client associated with the user account that has a potential friendship relationship. It may also be like this.
[0075] For user accounts with a similarity of user characteristics lower than the similarity threshold (that is, user accounts that have no potential friendship relationship with the barrage editing account), it is possible to transmit the barrage content applying the default barrage style or the barrage content and barrage style (including a mask flag indicating not to apply the barrage style) to the associated client. In this way, the barrage content can be displayed on the multimedia playback interface of the associated client according to the default barrage style.
[0076] In some embodiments, the client can transmit the barrage content and barrage style by the server to the client (or web page playback interface) associated with the user account selected by the barrage editing account and that is playing the same multimedia information.
[0077] Exemplarily, in the barrage editing interface, a viewer setting interface for the barrage style can be further provided to allow users to select user accounts with social relationships as viewers. The selection criteria may be one social relationship or multiple social relationships, and may also be one or more user accounts in each social relationship, or a barrage style that corresponds one-to-one to different types of social relationships can be set. The social relationship may be subscription, following, interaction (for example, tapping "like", sending electronic New Year's money, sharing multimedia information), etc. In this way, the server only sends the barrage content and the barrage style to the client (or web page playback interface) related to the user account selected by the barrage editing account, which is playing the same multimedia information, so as to display the barrage content that matches the barrage style on the multimedia playback interface of the client related to the selected user account, and display the barrage content according to the default barrage style on the multimedia playback interface of the client related to the unselected user account.
[0078] Taking the example that clients 1 to N are currently playing the same multimedia information, where N is an integer greater than 4. During the playback of the multimedia information, client 1 receives the barrage content to be sent input by user 1 and the barrage style set for the barrage content, and at the same time, receives the user accounts related to client 2 and the user accounts related to client 3 of the viewers with the barrage style set by user 1. Then, client 1 sends the barrage content, the barrage style, and the user accounts of the viewers to the server. After receiving the barrage content, the barrage style, and the user accounts of the viewers sent from client 1, the server sends the barrage content and the barrage style to clients 1 to 3, so as to display the barrage content that matches the barrage style on the multimedia playback interfaces of clients 1 to 3. At the same time, the server can send the barrage content and the default barrage style to clients 4 to N, or send the barrage content and the barrage style (including a mask flag indicating not to apply the barrage style). In this way, clients 4 to N display the barrage content sent from user 1 according to the default barrage style. In this way, by displaying separately, the purpose of barrage processing is enhanced, and the interaction with a specific user account is made easier.
[0079] In some embodiments, the client can display bullet screen content that matches the bullet screen style on the multimedia playback interface of the client associated with the active user account by the server sending the bullet screen content and the bullet screen style to the client associated with the active user account. At the same time, for the client associated with the inactive user account, the server can send the bullet screen content and the default bullet screen style to it, or send the bullet screen content and the bullet screen style (including a mask flag indicating not to apply the bullet screen style), so as to display the bullet screen content on the multimedia playback interface of the client associated with the inactive user account according to the default bullet screen style. The active user account may be a user account whose online time reaches a preset time, or a user account whose number of sent bullet screens exceeds a preset number.
[0080] In some embodiments, the client can display bullet screen content that matches the bullet screen style on the multimedia playback interface of a part of the clients that are playing the same multimedia information by the server randomly sending the bullet screen content and the bullet screen style to a part of the clients that are playing the same multimedia information, and display the bullet screen content on the multimedia playback interfaces of the remaining clients according to the default bullet screen style.
[0081] In addition, in the embodiments of the present application, the server may send the bullet screen content input by the user and the bullet screen style set for the bullet screen content to the clients that are playing the same multimedia information at the current time, or send them to the clients that will play the same multimedia information at other times. For example, after screening the bullet screen content and the bullet screen style input by the user, the background (server) sends the bullet screen content and the bullet screen style that meet the requirements to the clients that will play the same multimedia information subsequently.
[0082] In some embodiments, it is further possible to implement the above step of displaying bullet screen content that conforms to the bullet screen style on the multimedia playback interface in the following manner. The client starts displaying bullet screen content that conforms to the bullet screen style from the first end of the multimedia playback interface and gradually moves it to the second end of the multimedia playback interface until it exits the multimedia playback interface.
[0083] Here, the first end and the second end of the multimedia playback interface are relative. For example, the first end may be the right end and the second end may be the left end, or for another example, the first end may be the lower end and the second end may be the upper end. When the client receives the bullet screen content and the bullet screen style, it can start displaying the bullet screen content that conforms to the bullet screen style from the first end of the multimedia playback interface and gradually move it to the second end of the multimedia playback interface until it exits the multimedia playback interface.
[0084] Naturally, this does not limit the embodiments of the present application. That is, the bullet screen content that conforms to the bullet screen style can also be displayed in other display methods. For example, the client can fixedly display the bullet screen content that conforms to the bullet screen style at the set display position on the multimedia playback interface until the set display time is reached.
[0085] As shown in FIG. 3B, in the embodiments of the present application, the client supports customizing the shape of the bullet screen content, thereby greatly enriching the expression form of the bullet screen content and being able to meet the needs of different users. At the same time, when the client displays the bullet screen content with the customized shape, by increasing the probability that the bullet screen content attracts the user's attention, the actual utilization rate of the computing resources consumed during the client's display can be improved.
[0086] In some embodiments, as shown in FIG. 3C, FIG. 3C is a flowchart of a danmaku processing method according to an embodiment of the present application. In FIG. 3C, step S301B shown in FIG. 3B can be updated to step S401. In step S401, in response to a danmaku editing operation received during playback of multimedia information, the client displays a character input interface for editing the danmaku content to be sent and an operation entry for setting the danmaku style.
[0087] In an embodiment of the present application, the danmaku editing interface may include a character input interface for editing the danmaku content to be sent, and an operation entry for setting the danmaku style.
[0088] Illustratively, as shown in Fig. 4, Fig. 4 is a schematic diagram of a barrage editing interface according to an embodiment of the present application. Fig. 4 shows a multimedia playback interface 41, which plays multimedia information and simultaneously displays multiple barrage contents such as "Is it funny?" and "Hahaha" in Fig. 4. The multimedia playback interface 41 includes a barrage editing interface 42, which includes a character input interface 43 and an operation entry 44 in the form of a text box.
[0089] In FIG. 3C, step S302B shown in FIG. 3B can be realized by steps S402 to S403, and will be described based on each step.
[0090] In step S402, the client receives the barrage content to be sent via the character input interface.
[0091] For example, as shown in FIG. 4, a user can input the content of the barrage to be sent, for example, “this is my barrage” into the character input interface 43.
[0092] In step S403, the client responds to the trigger operation on the operation entry, displays the style editing interface, and receives the bullet screen style set for the bullet screen content through the style editing interface.
[0093] Exemplarily, as shown in FIG. 4, when the user taps the "Style" key (i.e., operation entry 44), the client displays the style editing interface and receives the bullet screen style set for the bullet screen content through the style editing interface. Here, the style editing interface may completely cover the bullet screen editing interface 42 or may be displayed on the bullet screen editing interface 42 in the form of a window.
[0094] In some embodiments, it is possible to implement the above step of displaying the style editing interface and receiving the bullet screen style set for the bullet screen content through the style editing interface in the following manner. The client displays a style adjustment area in the style editing interface, displays each character included in the bullet screen content in the style adjustment area, determines a new bullet screen style including a new shape in response to a shift operation on at least some of the characters in the bullet screen content, displays the bullet screen content to which the new bullet screen style is applied in the style editing interface, and determines the new bullet screen style as the bullet screen style set for the bullet screen content when no shift operation is received within a predetermined time or when a bullet screen sending operation is received.
[0095] Here, the style editing interface may include a style adjustment area and provide a setting function for the barrage style. Each character included in the barrage content is initially displayed in the style adjustment area. When the client receives a shift operation for at least some of the characters in the barrage content displayed in the style adjustment area, the client takes the latest shape of the barrage content (i.e., the shape after the shift) as the new shape, and obtains a new barrage style including the new shape. Next, the client displays the barrage content to which the new barrage style is applied in the style editing interface. Here, the barrage content to which the new barrage style is applied may be directly displayed in the style adjustment area, or may be displayed in other areas. For example, a separate style preview area may be demarcated to display the barrage content to which the new barrage style is applied. When the client no longer receives a shift operation within a predetermined time or receives a barrage sending operation, the client determines the new barrage style as the barrage style set for the barrage content.
[0096] Exemplarily, as shown in FIG. 5A, FIG. 5A is a schematic diagram of a style editing interface according to an embodiment of the present application. As shown in FIG. 5A, the style editing interface mainly includes a style adjustment area 51 on the left side and a style preview area 52 on the right side. Note that the structure of the style adjustment area and the style preview area in FIG. 5A is an example, and there is no limitation on the relative positional relationship between these two areas. For example, the style adjustment area may be located on the right side of the style preview area, may be located above the style preview area, or may be located below the style preview area, supporting the user to set the relative position between the style adjustment area and the style preview area according to their own habits.
[0097] In FIG. 5A, taking the example that the style adjustment area is a grid area that supports the adjustment of character positions, the grid area includes a plurality of grids, and each grid corresponds to one character. Each grid is realized by one input text component, and by monitoring the tap event, the character input by the user into the grid and the coordinates of the grid are recorded. The style preview area mainly displays in real time the bullet screen content that applies the new shapes included in the new bullet screen style.
[0098] Exemplarily, as shown in FIG. 5B, FIG. 5B is a schematic diagram of the style editing interface according to an embodiment of the present application. As shown in FIG. 5B, the style editing interface mainly includes a style adjustment area 53 on the left side and a style preview area 54 on the right side. In FIG. 5B, taking the example that the style adjustment area is a pixel area that supports the adjustment of character positions, the coordinates of the characters displayed in the style adjustment area are pixel coordinates.
[0099] In some embodiments, it is possible to implement the above step of displaying each character included in the bullet screen content in the style adjustment area in the following manner. The client displays each character included in the bullet screen content in the style adjustment area based on the shape of the default bullet screen style.
[0100] Here, when the character input interface displays the received bullet screen content in the style adjustment area according to the shape of the default bullet screen style, the shape of the default bullet screen style is the initial shape. The shape of the default bullet screen style may be the shape of one line of text. After the client displays each character included in the bullet screen content in the style adjustment area, the user can obtain a new shape by performing a shift operation on each character included in the bullet screen content. Here, the shift operation may be a drag operation in which the user selects a character and drags it to the target position. Exemplarily, as shown in FIG. 5A, the heart shape shown in FIG. 5A is a new shape obtained after performing the shift operation, that is, the shape of one line of text is adjusted to a heart shape.
[0101] In some embodiments, the above step of displaying each character included in the bullet screen content in the style adjustment area in the following manner can be realized. The client displays candidate bullet screen styles corresponding to the bullet screen content in the style editing interface, and in response to a selection operation on the candidate bullet screen styles corresponding to the bullet screen content, based on the shape of the selected candidate bullet screen style, displays each character included in the bullet screen content in the style adjustment area.
[0102] Here, the shape of at least one candidate bullet screen style can be displayed in the style editing interface (for example, the style adjustment area), the user can select a shape that they like from among them, and then the client, based on the shape of the selected one candidate bullet screen style, displays each character included in the bullet screen content in the style adjustment area.
[0103] Exemplarily, the user can first select a shape that they like from the shapes of the candidate barrage styles displayed on the style editing interface. For example, if the user selects a triangle as the shape of the barrage, and then the user directly enters the barrage content entered on the character input interface into the triangle, the barrage content in the shape of a triangle can be formed. Naturally, after the user selects a certain shape, if they are not satisfied with the selected shape, they can further adjust the selected shape and enter the barrage content into the adjusted shape.
[0104] Note that the size of the style adjustment area according to the embodiment of the present application is adjustable. Therefore, before displaying the style adjustment area, first, a size setting operation for the style adjustment area can be received, and the size set by the size setting operation can be determined as the size applied when the style adjustment area is displayed on the style editing interface.
[0105] Taking the case where the style adjustment area is a grid area as an example, before displaying the grid area, various candidate sizes can be given for the user to select. The user can select the corresponding candidate size based on the number of characters included in the barrage content to be sent, or the user can also be directly allowed to input the size of the grid area (for example, the size of the grid area may be 10×10, or 15×15, etc., and the user can perform different granularity divisions based on the number of characters included in the actually input barrage content each time). If the user does not set the size of the grid area, the client can display the grid area on the style editing interface based on the default size. The default size can be set based on the actual application scenario, or the client can automatically select the smallest size that can accommodate the barrage content based on the number of characters included in the barrage content to be sent.
[0106] In some embodiments, the bullet screen style attributes further include at least one of the color of the bullet screen content, the size of the bullet screen content, the special effects of the bullet screen content, and the arrangement method of the bullet screen content, and the above step of receiving the bullet screen style set for the bullet screen content through the style editing interface can be realized in the following manner. The client determines a new bullet screen style in response to a setting operation on at least one of the color, size, special effects, and arrangement method of the bullet screen content in the style adjustment area, and displays the bullet screen content to which the new bullet screen style is applied in the style editing interface. When no setting operation is received within a predetermined time or a bullet screen sending operation is received, the new bullet screen style is determined as the bullet screen style set for the bullet screen content.
[0107] In the embodiments of the present application, in addition to including the shape, the bullet screen style attributes may further include at least one of the color of the bullet screen content, the size of the bullet screen content, the special effects of the bullet screen content, and the arrangement method of the bullet screen content (for example, horizontal arrangement, vertical arrangement, inclined arrangement, etc.).
[0108] The client determines a new bullet screen style in response to a setting operation on at least one of the color, size, special effects, and arrangement method of the bullet screen content in the style adjustment area. For example, if the bullet screen style includes color A1, size B1, special effect C1, and arrangement method D1, and the user changes color A1 to A2 and size B1 to B2, a new bullet screen style including color A2, size B2, special effect C1, and arrangement method D1 can be obtained.
[0109] For example, the user can uniformly set the color of the bullet screen content in the style adjustment area to red, green, or gradient, etc., or only set a part of the characters included in the bullet screen content to red, while keeping other characters in the default color. The user can set the size of the bullet screen content. For example, the size of the bullet screen content can be uniformly set to 10, or only a part of the characters included in the bullet screen content can be set to 10, while keeping the sizes of other characters at the default size.
[0110] For example, uniformly set the characters included in the barrage content to an inclined arrangement, or only set a part of the characters included in the barrage content to an inclined arrangement, and set other characters to a horizontal arrangement.
[0111] Naturally, the user can add corresponding special effects to the barrage content. For example, add flames, color stripes, etc. to all characters or a part of the characters.
[0112] The client can display in real time the barrage content to which a new barrage style is applied in the style editing interface (for example, the style preview area). When no setting operation is received within a predetermined time or a barrage sending operation is received, the client determines the new barrage style as the barrage style set for the barrage content.
[0113] In addition, the style adjustment area supports setting the attributes of the barrage style and also supports setting the type of the barrage style. For example, two options of "static barrage" and "dynamic barrage" can be provided for the user to select.
[0114] In some embodiments, before sending the barrage content and the barrage style, the client further includes the steps of determining the actual area occupied by each character included in the barrage content in the style adjustment area, and when the size of the actual area is smaller than the default size of the style adjustment area, performing conversion processing on the coordinates of each character in the barrage content based on the actual area to update the shape of the barrage style set for the barrage content.
[0115] Here, before sending the barrage content and the barrage style to the server, the client can further convert the shape of the barrage style and send the converted shape and the barrage content to the server.
[0116] Taking the case where the style adjustment area is a grid area as an example, when the size of the actual area occupied by the barrage content in the grid area is smaller than the size of the grid area, the actual area is used as a new grid area, and the coordinates of each character in the barrage content in the new grid area are determined as the coordinates after conversion.
[0117] For example, as shown in FIG. 6, the size of the grid area in the barrage editing interface is 7×7, and if the size of the actual area occupied by the barrage content (that is, the heart-shaped barrage in FIG. 6) is 5×4 (here, the matrix area is taken as an example for explanation), the client first converts the coordinates of the heart-shaped barrage in the 7×7 grid area to the coordinates in the 5×4 grid area (shown in FIG. 9), and sends the coordinates of each character in the barrage content in the 5×4 grid area to the server.
[0118] As shown in FIG. 3C, the embodiment of the present application provides an input function for barrage content through a character input interface, and provides a setting function for barrage style through an operation entry and a style editing interface. In this way, by improving the usability of barrage editing, the efficiency of obtaining barrage content and barrage style can be improved.
[0119] Next, an exemplary structure for implementing the barrage processing device 455 according to the embodiment of the present application as a software module will be continuously described. In some embodiments, as shown in FIG. 2, the software module in the barrage processing device 455 stored in the memory 450 may include a display module 4551, a receiving module 4552, and a transmitting module 4553. In some embodiments, it may further include a determination module 4554 and a conversion module 4555.
[0120] The display module 4551 is configured to display a bullet screen editing interface in response to a bullet screen editing operation received during the playback of multimedia information. The receiving module 4552 is configured to receive the bullet screen content to be transmitted through the bullet screen editing interface, and is configured to receive the bullet screen style set for the bullet screen content through the bullet screen editing interface. The bullet screen style includes the shape of the bullet screen content. The transmitting module 4553 is configured to transmit the bullet screen content and the bullet screen style. The display module 4551 is configured to display the bullet screen content that matches the bullet screen style on the multimedia playback interface.
[0121] In some embodiments, the bullet screen editing interface includes a character input interface for editing the bullet screen content to be transmitted and an operation entry for setting the bullet screen style. The receiving module 4552 is configured to receive the bullet screen content to be transmitted through the character input interface. The receiving module 4552 is configured to display a style editing interface in response to a trigger operation on the operation entry, and is configured to receive the bullet screen style set for the bullet screen content through the style editing interface.
[0122] In some embodiments, the display module 4551 displays a style adjustment area on the style editing interface, displays each character included in the bullet screen content in the style adjustment area, determines a new bullet screen style including a new shape in response to a shift operation on at least some of the characters in the bullet screen content, and is configured to display the bullet screen content to which the new bullet screen style is applied on the style editing interface. The apparatus further includes a determination module 4554 configured to determine the new bullet screen style as the bullet screen style set for the bullet screen content when no shift operation is received within a predetermined time or a bullet screen transmission operation is received.
[0123] In some embodiments, the style editing interface further includes a style preview area, and the display module 4551 is configured to display the barrage content applying the new barrage style in the style preview area.
[0124] In some embodiments, the style adjustment area is a grid area, the grid area includes a plurality of grids for filling characters in the barrage content, or the style adjustment area is a pixel area.
[0125] In some embodiments, the determination module 4554 is configured to determine, in response to a sizing operation on the style adjustment area, the size set by the sizing operation as the size to be applied when the style adjustment area is displayed in the style editing interface.
[0126] In some embodiments, the determination module 4554 is configured to determine the actual area occupied by each character included in the barrage content in the style adjustment area, and the apparatus further includes a conversion module 4555, and the conversion module 4555 is configured to perform a conversion process on the coordinates of each character in the barrage content based on the actual area when the size of the actual area is smaller than the size of the style adjustment area, so as to update the shape of the barrage style set for the barrage content.
[0127] In some embodiments, the display module 4551 is configured to perform either one of the following operations: displaying each character included in the barrage content in the style adjustment area based on the shape of the default barrage style; and displaying candidate barrage styles corresponding to the barrage content in the style editing interface, and in response to a selection operation on the candidate barrage styles corresponding to the barrage content, displaying each character included in the barrage content in the style adjustment area based on the shape of the selected candidate barrage style.
[0128] In some embodiments, the bullet screen style attributes further include at least one of the color of the bullet screen content, the size of the bullet screen content, the special effects of the bullet screen content, and the arrangement method of the bullet screen content. The style editing interface includes a style adjustment area. The display module 4551 is configured to determine a new bullet screen style in response to a setting operation on at least one of the color, size, special effects, and arrangement method of the bullet screen content in the style adjustment area, and display the bullet screen content to which the new bullet screen style is applied on the style editing interface. The determination module 4554 is configured to determine the new bullet screen style as the bullet screen style set for the bullet screen content when no setting operation is received within a predetermined time or a bullet screen sending operation is received.
[0129] In some embodiments, the style editing interface further includes a style preview area. The display module 4551 is configured to display the bullet screen content to which the new bullet screen style is applied in the style preview area.
[0130] In some embodiments, the types of bullet screen styles include static bullet screens and dynamic bullet screens. The display module 4551 is configured to determine a new bullet screen style including the set bullet screen type in response to a setting operation on the bullet screen type of the bullet screen content, and display the bullet screen content to which the new bullet screen style is applied on the bullet screen editing interface. The determination module 4554 is configured to determine the new bullet screen style as the bullet screen style set for the bullet screen content when no setting operation is received within a predetermined time or a bullet screen sending operation is received.
[0131] In some embodiments, when the bullet screen type in the new bullet screen style is a static bullet screen, the display module 4551 displays the bullet screen content to which the attributes in the new bullet screen style are applied on the bullet screen editing interface, retains the applied attributes as they are, and when the bullet screen type in the new bullet screen style is a dynamic bullet screen, the display module 4551 displays the bullet screen content to which the attributes in the new bullet screen style are applied on the bullet screen editing interface and is configured to change the applied attributes.
[0132] In some embodiments, the display module 4551 is configured to start displaying bullet screen content that matches the bullet screen style from the first end of the multimedia playback interface, and gradually move it to the second end of the multimedia playback interface until it disengages from the multimedia playback interface.
[0133] In some embodiments, the transmission module 4553 is configured to perform at least one of the operations of transmitting the bullet screen content and the bullet screen style to a client that is playing multimedia information and is in an online state, transmitting the bullet screen content and the bullet screen style to a client associated with a user account that is playing multimedia information and has a potential friendship relationship with the bullet screen editing account, transmitting the bullet screen content and the bullet screen style to a client associated with an active user account, and transmitting the bullet screen content and the bullet screen style to a client associated with a user account selected by the bullet screen editing account. The bullet screen editing account is the user account that edits the bullet screen style.
[0134] In some embodiments, when the transmission module 4553 receives the bullet screen content to be transmitted through the bullet screen editing interface and does not receive the bullet screen style set for the bullet screen content, it is configured to transmit the bullet screen content and the default bullet screen style. The display module 4551 is configured to display the bullet screen content that matches the default bullet screen style on the multimedia playback interface.
[0135] In some embodiments, the decision module 4554 displays candidate bullet screen styles corresponding to the bullet screen content on the bullet screen editing interface, and in response to a selection operation on the candidate bullet screen styles corresponding to the bullet screen content, determines the selected candidate bullet screen style as the bullet screen style set for the bullet screen content, or displays candidate bullet screen styles corresponding to the bullet screen content on the bullet screen editing interface, and in response to a setting operation for automatically setting the bullet screen style for the bullet screen content, determines the similarity between the feature vector of the candidate bullet screen style and the feature vector of the bullet screen editing account, and is configured to determine the candidate bullet screen style with the highest similarity as the bullet screen style set for the bullet screen content. The bullet screen editing account is the user account that edits the bullet screen style.
[0136] In some embodiments, the decision module 4554 is configured to perform at least one of an operation of obtaining, as candidate bullet screen styles, the bullet screen styles used by user accounts that have a potential friendship relationship with the bullet screen editing account, an operation of obtaining, as candidate bullet screen styles, the bullet screen styles used by user accounts that have a social relationship with the bullet screen editing account, and an operation of obtaining, as candidate bullet screen styles, bullet screen styles whose usage frequency is greater than a frequency threshold or whose score is greater than a score threshold.
[0137] Note that the description of the device according to the embodiments of the present application is similar to the description of the embodiments of the above method and has beneficial effects similar to those of the embodiments of the method, so the description is omitted. For technical details not defined in the bullet screen processing device according to the embodiments of the present application, they can be understood based on the description of any of the drawings in FIGS. 3A, 3B, 3C, and 8.
[0138] Hereinafter, application examples in the actual application scenarios of the embodiments of the present application will be described.
[0139] Taking a video playback client as an example, when a user wants to send a barrage while watching a video, he taps the barrage editing key to pop up an input method to input the barrage content. FIG. 4 is a schematic diagram of a preferred barrage editing interface according to an embodiment of the present application. As shown in FIG. 4, a user inputs a barrage content such as "this is my barrage" into a text box (i.e., a character input interface 43) and taps the "send" key on the right side of the text box, after which the barrage content is sent to the screen and displayed. In addition, the "style" key (i.e., an operation entry 44) on the right side of the "send" key is a function entry key for setting a barrage style for the barrage content newly added in the embodiment of the present application. When a user inputs the barrage content he wants to send into the text box and directly taps the "send" key, the barrage content is displayed on the screen in the style of one line of text (i.e., the default barrage style). When a user taps the "style" key, a style editing interface is displayed, for example, jumping to the style editing interface.
[0140] 5A is a schematic diagram of a style editing interface according to an embodiment of the present application. As shown in FIG. 5A, the style editing interface includes two main areas, a left style adjustment area 51 and a right style preview area 52. The right style preview area 52 displays the danmaku content after adjustment in the left style adjustment area 51 in real time. After the user checks the effect in the style preview area 52, the danmaku content and the danmaku style will enter the subsequent sending flow.
[0141] In addition, the relative positions of the style adjustment area and the style preview area are not limited to the relative positions shown in FIG. 5A, and may be such that the style adjustment area is located on the right side and the style preview area is located on the left side, or the style adjustment area is located on the upper side and the style preview area is located on the lower side.
[0142] As shown in FIG. 5A, the style adjustment area on the left is a grid area where the character position can be adjusted, and each grid has its own coordinates for position confirmation. In FIG. 5A, the size of the grid area is 7×7. Naturally, the size of the grid area is not limited to the 7×7 size shown in FIG. 5A, and it may be 10×10 or other sizes, and the embodiments of the present application do not limit this.
[0143] Hereinafter, the size of 7×7 shown in FIG. 5A will be described as an example, and the user can input characters into the grid area, and only one character can be input into each grid. When the user inputs multiple characters consecutively, the other characters are entered in the following grids in order. Next, a coordinate position corresponding to each grid is determined by constructing a coordinate system based on the grid area. FIG. 6 is a schematic diagram of a coordinate system according to an embodiment of the present application. As shown in FIG. 6, if the grid located at the upper left corner of the grid area is set as the coordinate origin (0,0), the coordinate of the grid at the lower right corner is (6,6), and thus the coordinate position of each grid is determined according to the coordinate system. Note that the embodiment of the present application only needs to determine the coordinate position of each grid, and does not limit the position of the coordinate origin. For example, the coordinate system may be constructed with the grid at the lower left corner of the grid area as the coordinate origin, the coordinate system may be constructed with the grid at the lower right corner of the grid area as the coordinate origin, or the coordinate system may be constructed with the grid at the upper right corner of the grid area as the coordinate origin. After the coordinate system is constructed, each character entered into the grid by the user will have a unique coordinate position corresponding thereto. As shown in FIG. 6, the barrage content "This is my barrage" (the barrage content further includes asterisk characters, and for ease of understanding, the corresponding description is omitted here) is arranged in a grid in a heart shape, and each character has a corresponding coordinate position. After a user adds characters to complete the arrangement and taps the "Send" key in FIG. 5A, the barrage content is displayed in the multimedia playback interface in the shape of a heart in the grid area. For example, as shown in FIG. 7, the multimedia playback interface 71 in FIG. 7 shows a movie being played and multiple heart-shaped barrage contents.
[0144] In addition, the embodiments of the present application are not limited to the above-mentioned method of positioning the character by a grid, and the user can actually drag the character directly in the style adjustment area and record the pixel coordinates of the character to record the character coordinate position, that is, the style adjustment area may be a pixel area.
[0145] Figure 8 is a flowchart of the barrage processing method according to the embodiment of the present application, and will be described below with reference to the steps shown in Figure 8.
[0146] In step S801, the client receives a barrage editing operation during video playback.
[0147] In step S802, the client displays a style editing interface in response to the barrage editing operation.
[0148] In some embodiments, when an operation (such as a tap operation or a long-press operation) on a specific hotkey set in the video playback interface is received, the style editing interface can be displayed.
[0149] Exemplarily, as shown in FIG. 4, when the user wants to send a barrage during video viewing, by tapping the "Style" key installed in the playback interface, the client can be made to display a style editing interface. The style editing interface may be floatingly displayed on the playing video, or may be displayed independently of the video playback interface.
[0150] In step S803, the client receives the barrage content and the barrage style set for the barrage content through the style editing interface.
[0151] The style editing interface includes a style adjustment area and a style preview area. The style adjustment area receives the barrage content to be sent and the barrage style set for the barrage content. The style preview area displays the barrage content with the applied set barrage style in real time.
[0152] In step S804, the client receives a confirmation operation.
[0153] As shown in FIG. 5A or 5B, the user previews the edited danmaku style in the style preview area, and after the user confirms the effect (i.e., the edited danmaku style meets the user's needs), the user taps the "Send" key to enter the subsequent sending flow.
[0154] In step S805, the client transmits the danmaku content and the danmaku style to the server.
[0155] When a client sends a barrage to a server, it not only sends the barrage contents, but also sends the barrage style set for the barrage contents. The barrage style may be a set of coordinate data consisting of the coordinate positions corresponding to each character included in the barrage contents. Taking the heart-shaped barrage in FIG. 6 as an example, the coordinates corresponding to each character included in the barrage contents are だった(2,1), 是(3,2), 我(4,1), 点(5,2), 弾(4,3), 話(3,4), 内(2,3), 央(1,2), and the coordinates of the three asterisks are (2,2), (4,2), and (3,3), respectively. This set of coordinates is calculated in a 7×7 grid coordinate system, but since the position occupied by the heart-shaped barrage only needs to be 5×4 in size, this set of coordinates is converted once to coordinates in the coordinate system shown in FIG. 9. The coordinates of each character after conversion are (1,0), (2,1), (3,0), (4,1), (3,2), (2,3), (1,2), (0,1), and the coordinates of the three asterisks are (1,1), (3,1), and (2,2). The converted coordinate data is sent to the server as danmaku style data and stored there.
[0156] In step S806, the client receives the danmaku content and danmaku style transmitted from the server.
[0157] The client requests the bullet screen data and simultaneously obtains the complete coordinate data of each bullet screen from the server. Here, the client may be all clients that are watching the video and have the bullet screen function turned on, or it may be only the clients related to the user accounts that have a social relationship with the bullet screen editing account. Still taking the heart-shaped bullet screen as an example, the bullet screen data downloaded by the client from the server is "crawl (1,0), yes (2,1), my (3,0), of (4,1), bullet (3,2), screen (2,3), inside (1,2), content (0,1)", and the coordinates of the three asterisks are (1,1), (3,1), and (2,2) respectively.
[0158] In step S807, the client analyzes and restores the bullet screen style based on the style rule.
[0159] In step S808, the client displays the bullet screen content that matches the bullet screen style on the multimedia playback interface.
[0160] After receiving the bullet screen data sent from the server, the client first determines the size of the screen that this bullet screen needs to occupy based on the coordinate position. Taking the heart-shaped bullet screen as an example, the client first determines that the size of the screen that this bullet screen needs to occupy is a 5×4 grid area based on the coordinate position. Next, by filling each character in the corresponding position in the 5×4 grid area, the shape of the bullet screen is obtained, and the bullet screen content is rendered on the screen according to the shape, thus forming the bullet screen content with a custom style on the final screen.
[0161] The bullet screen processing method according to the embodiment of the present application can be realized as three layers including a presentation layer, a control layer, and a data layer according to the Model-View-Controller (MVC) architecture.
[0162] As shown in Figure 5A, the interface schematic diagram of the presentation layer includes a style adjustment area on the left and a style preview area on the right. The following specifically describes these two areas respectively.
[0163] The style adjustment area is a grid area where the character position can be adjusted. Each grid is realized by one input text component (EditText), and the number of characters allowed to be entered in each grid is 1. By monitoring the tap event, when the user taps a certain grid, the corresponding input text component responds, and the characters entered by the user through the input method are also displayed in each grid. The entire grid area is tiled by 7×7 independent grids, and each grid records its own coordinate position.
[0164] Based on the correspondence between the coordinate positions of the grids in the left style adjustment area and the characters in them, the final style of the barrage is rendered in the right style preview area. The preview window is realized by a customized text control (TextView), and the rendering and display of each character at different coordinate positions are completed within the customized text control.
[0165] As shown in Figure 10, the schematic diagram of the control class includes a data class (DamakuData) and a barrage style window (DanmaStyleView). The control class serves as a bridge between the data class and the presentation class, combining the functions of both and packaging them into a class for external calls. In this way, the logic and the interface can be well separated, and only one implementation can complete one function. The realizable functions include the organization of barrage data, the creation of barrage styles, the transmission of new barrage content and barrage styles to the server, the analysis of the barrage styles returned from the server, etc.
[0166] The data layer mainly processes the transmission and analysis between the client and the server of the danmaku data. As shown in FIG. 11, the schematic diagram of the data class, the data class (DamakuData) stores all the danmaku data and is responsible for storing it in the form of a list (DanmakuList). A single danmaku (DanmukuItem) includes text data (mText) and position data (mPosition), and the position data includes the x coordinate and y coordinate corresponding to the character. The danmaku content with the danmaku style created by the danmaku style adjustment area corresponds to one single danmaku. The control layer also displays the style of the danmaku content by analyzing the data class.
[0167] The danmaku processing method according to the embodiment of the present application can not only increase the expression form of the danmaku and display the danmaku content on the screen in the style of a line of text, but also allow the user to customize the style of the danmaku content. At the same time, the danmaku style is stored in the server together with the danmaku content to realize the permanent storage of the danmaku style. The danmaku processing method according to the embodiment of the present application enriches the expression form of the danmaku, making the danmaku function more interesting, further increasing the user's willingness to use the danmaku function. At the same time, the displayed danmaku content is more likely to attract the user's attention and can improve the actual utilization rate of the computing resources consumed for displaying the danmaku content.
[0168] The embodiment of the present application provides a storage medium in which executable instructions are stored. When the executable instructions stored in the storage medium are executed by a processor, the processor is caused to execute the danmaku processing method according to the embodiment of the present application, for example, the danmaku processing methods shown in FIGS. 3A, 3B, 3C and 8.
[0169] In some embodiments, the storage medium may be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, flash memory, magnetic surface memory, optical disk, or CD-ROM, and may also be various devices including one or any combination of the above memories.
[0170] In some embodiments, the executable instructions may take the form of a program, software, software module, script, or code, and may be written in any form of programming language (including compiled or interpreted languages, or declarative or procedural languages), and may be deployed as a stand-alone program or in any form including modules, components, subroutines, or other units suitable for use in a computing environment.
[0171] By way of example, the executable instructions may correspond to a file in a file system, but need not, and may be stored in a part of a file that holds other programs or data (e.g., one or more scripts stored within a hypertext markup language (HTML) document), within a single file specific to the program in question, or within multiple cooperating files (e.g., files that hold one or more modules, subprograms, or portions of code).
[0172] By way of example, the executable instructions may be arranged to be executed on one computer or on multiple computers distributed at one or more locations and interconnected by a communication network.
[0173] From the above, the embodiments of the present application have the following beneficial effects. When a user needs to send a barrage, a function of setting a barrage style customized for the barrage content is provided to the user. The user can arrange the barrage content to be sent in different shapes, or add colors and special effects, and set the barrage type. The user can display the barrage content in the barrage style customized by the user, thereby enriching the expression form of the barrage content, making the barrage function more interesting, and further increasing the user's willingness to use the barrage function.
[0174] The above are only examples of the present application and do not limit the protection scope of the present application. Any changes, equivalent substitutions, improvements, etc. made without departing from the spirit and scope of the present application are all included in the protection scope of the present application.
[0175] [Appendix 1] A bullet screen processing method executed by an electronic device, comprising: displaying a bullet screen editing interface in response to a bullet screen editing operation received during the playback of multimedia information; receiving, by the bullet screen editing interface, bullet screen content to be transmitted, and receiving, by the bullet screen editing interface, a bullet screen style set for the bullet screen content, wherein the attributes of the bullet screen style include the shape of the bullet screen content; transmitting the bullet screen content and the bullet screen style; displaying, on a multimedia playback interface, the bullet screen content that matches the bullet screen style. [Appendix 2] The bullet screen editing interface includes a character input interface for editing bullet screen content to be transmitted and an operation entry for setting a bullet screen style. The step of receiving, by the bullet screen editing interface, bullet screen content to be transmitted includes: receiving, by the character input interface, bullet screen content to be transmitted. The step of receiving, by the bullet screen editing interface, a bullet screen style set for the bullet screen content includes: displaying a style editing interface in response to a trigger operation on the operation entry, and receiving, by the style editing interface, a bullet screen style set for the bullet screen content. The method according to Appendix 1. [Appendix 3] The step of displaying a style editing interface and receiving, by the style editing interface, a bullet screen style set for the bullet screen content includes: Displaying a style adjustment area on the style editing interface and displaying each character included in the barrage content in the style adjustment area; Responding to a shift operation on at least some of the characters in the barrage content, determining a new barrage style including a new shape, and displaying, on the style editing interface, barrage content to which the new barrage style is applied; When the shift operation is no longer received within a predetermined time or a barrage transmission operation is received, determining the new barrage style as the barrage style set for the barrage content, the method according to appended note 2. [Appended Note 4] The style editing interface further includes a style preview area, The step of displaying, on the style editing interface, barrage content to which the new barrage style is applied includes the step of displaying, in the style preview area, barrage content to which the new barrage style is applied, the method according to appended note 3. [Appended Note 5] The style adjustment area is a grid area, the grid area includes a plurality of grids for entering characters in the barrage content, or the style adjustment area is a pixel area, the method according to appended note 3. [Appended Note 6] Before displaying the style adjustment area on the style editing interface, further including the step of, in response to a size setting operation on the style adjustment area, determining the size set by the size setting operation as the size to be applied when the style adjustment area is displayed on the style editing interface, the method according to appended note 3. [Appended Note 7] Before transmitting the barrage content and the barrage style, determining an actual area occupied by each character included in the barrage content in the style adjustment area; When the size of the actual area is smaller than the size of the style adjustment area, by performing conversion processing on the coordinates of each character in the barrage content based on the actual area, updating the shape of the barrage style set for the barrage content; The method according to Supplementary Note 3, further comprising the step of [Supplementary Note 8] The step of displaying each character included in the barrage content in the style adjustment area is Based on the shape of the default barrage style, the operation of displaying each character included in the barrage content in the style adjustment area, and Displaying candidate barrage styles corresponding to the barrage content in the style editing interface, and in response to a selection operation on the candidate barrage styles corresponding to the barrage content, based on the shape of the selected candidate barrage style, Displaying each character included in the barrage content in the style adjustment area; The method according to Supplementary Note 3, including any one of the steps of [Supplementary Note 9] The attributes of the barrage style further include at least one of the color of the barrage content, the size of the barrage content, the special effect of the barrage content, and the arrangement method of the barrage content. The style editing interface includes a style adjustment area. The step of receiving, by the style editing interface, the barrage style set for the barrage content is In response to a setting operation on at least one of the color, size, special effect, and arrangement method of the barrage content in the style adjustment area, determining a new barrage style, and displaying, in the style editing interface, the barrage content to which the new barrage style is applied; When the setting operation is no longer received within a predetermined time or a barrage transmission operation is received, determining the new barrage style as the barrage style set for the barrage content; The method according to Supplementary Note 2, including the step of [Supplementary Note 10] The style editing interface further includes a style preview area. The step of displaying the barrage content to which the new barrage style is applied on the style editing interface is The method according to appendix 9, comprising the step of displaying the barrage content to which the new barrage style is applied in the style preview area. [Appendix 11] The types of the barrage styles include static barrages and dynamic barrages. The step of receiving, by the barrage editing interface, the barrage style set for the barrage content is responding to a setting operation for the barrage type of the barrage content, determining a new barrage style including the set barrage type, and displaying, on the barrage editing interface, the barrage content to which the new barrage style is applied; When the setting operation is not received within a predetermined time or a barrage sending operation is received, determining the new barrage style as the barrage style set for the barrage content, the method according to appendix 1. [Appendix 12] The step of displaying the barrage content to which the new barrage style is applied on the barrage editing interface is When the barrage type in the new barrage style is a static barrage, displaying, on the barrage editing interface, the barrage content to which the attributes in the new barrage style are applied, and retaining the applied attributes as they are; When the barrage type in the new barrage style is a dynamic barrage, displaying, on the barrage editing interface, the barrage content to which the attributes in the new barrage style are applied, and changing the applied attributes, the method according to appendix 11. [Appendix 13] The step of displaying the barrage content matching the barrage style on the multimedia playback interface is Starting to display the barrage content matching the barrage style from the first end of the multimedia playback interface, and gradually moving it to the second end of the multimedia playback interface until it exits the multimedia playback interface, the method according to appendix 1. [Appendix 14] The step of transmitting the barrage content and the barrage style is an operation of transmitting the barrage content and the barrage style to a client that is playing the multimedia information and is in an online state, an operation of transmitting the barrage content and the barrage style to a client associated with a user account that is playing the multimedia information and has a potential friendship relationship with the barrage editing account, an operation of transmitting the barrage content and the barrage style to a client associated with an active user account, and including a step of performing at least one of an operation of transmitting the barrage content and the barrage style to a client associated with a user account selected by the barrage editing account while playing the multimedia information, wherein the barrage editing account is a user account that edits the barrage style, the method according to Appendix 1. [Appendix 15] When the barrage editing interface receives the barrage content to be transmitted and does not receive the barrage style set for the barrage content, the barrage content and the default barrage style are transmitted, and further including a step of displaying, on the multimedia playback interface, the barrage content that matches the default barrage style, the method according to any one of Appendices 1 to 14. [Appendix 16] The step of receiving, by the barrage editing interface, the barrage style set for the barrage content is displaying candidate barrage styles corresponding to the barrage content on the barrage editing interface, and determining, in response to a selection operation on the candidate barrage styles corresponding to the barrage content, the selected candidate barrage style as the barrage style set for the barrage content, or Display a candidate barrage style corresponding to the barrage content on the barrage editing interface, and determine the similarity between the feature vector of the candidate barrage style and the feature vector of the barrage editing account in response to a setting operation for automatically setting a barrage style for the barrage content. Including the step of determining the candidate barrage style with the highest similarity as the barrage style set for the barrage content. The method according to any one of Appendices 1 to 14, wherein the barrage editing account is a user account for editing the barrage style. [Appendix 17] An operation of obtaining, as candidate barrage styles, the barrage styles used by user accounts that have a potential friendship relationship with the barrage editing account. An operation of obtaining, as candidate barrage styles, the barrage styles used by user accounts that have a social relationship with the barrage editing account, and The method according to Appendix 16, further including the step of performing at least one of an operation of obtaining, as candidate barrage styles, barrage styles whose usage frequency is greater than a frequency threshold or whose score is greater than a score threshold. [Appendix 18] A display module configured to display a barrage editing interface in response to a barrage editing operation received during the playback of multimedia information. A receiving module configured to receive, by the barrage editing interface, the barrage content to be transmitted and to receive, by the barrage editing interface, the barrage style set for the barrage content, wherein the attributes of the barrage style include the shape of the barrage content. Including a transmission module configured to transmit the barrage content and the barrage style. The barrage processing device, wherein the display module is configured to display, on the multimedia playback interface, the barrage content that matches the barrage style. [Appendix 19] A memory storing executable instructions. When executing the executable instructions stored in the memory, an electronic device including a processor that implements the bullet screen processing method described in any one of Appendices 1 to 17. [Appendix 20] A program that, when executed by a processor, implements the bullet screen processing method described in any one of Appendices 1 to 17.
Claims
1. A barrage processing method executed by an electronic device, comprising: displaying a barrage editing interface in response to a barrage editing operation received during playback of multimedia information; receiving, by the barrage editing interface, barrage content to be transmitted, and receiving, by the barrage editing interface, a barrage style set for the barrage content, wherein attributes of the barrage style include the shape of the barrage content; transmitting, by a server, the barrage content and the barrage style to other related electronic devices that are playing the multimedia information, wherein the other related electronic devices are used to display the barrage content that matches the barrage style on a playback interface of the multimedia information.
2. The barrage editing interface includes a character input interface for editing barrage content to be transmitted and an operation entry for setting a barrage style. The step of receiving, by the barrage editing interface, barrage content to be transmitted includes receiving, by the character input interface, barrage content to be transmitted. The step of receiving, by the barrage editing interface, a barrage style set for the barrage content includes, in response to a trigger operation on the operation entry, displaying a style editing interface, and receiving, by the style editing interface, a barrage style set for the barrage content. The method according to claim 1.
3. The step of displaying a style editing interface and receiving, by the style editing interface, a barrage style set for the barrage content includes displaying a style adjustment area on the style editing interface and displaying each character included in the barrage content in the style adjustment area; in response to a shift operation on at least some of the characters in the barrage content, determining a new barrage style including a new shape, and displaying, on the style editing interface, the barrage content to which the new barrage style is applied. Determining, when the shift operation is not received within a predetermined time or a barrage sending operation is received, the new barrage style as the barrage style set for the barrage content, the method according to claim 2.
4. The style editing interface further includes a style preview area, The step of displaying, on the style editing interface, the barrage content to which the new barrage style is to be applied, The method according to claim 3, including the step of displaying, in the style preview area, the barrage content to which the new barrage style is to be applied.
5. The style adjustment area is a grid area, and the grid area includes a plurality of grids for filling characters in the barrage content, or the style adjustment area is a pixel area, the method according to claim 3.
6. Before displaying the style adjustment area on the style editing interface, The method according to claim 3, further including the step of determining, in response to a size setting operation for the style adjustment area, the size set by the size setting operation as the size to be applied when the style adjustment area is displayed on the style editing interface.
7. Before transmitting the barrage content and the barrage style, Determining the actual area occupied by each character included in the barrage content in the style adjustment area, and When the size of the actual area is smaller than the size of the style adjustment area, updating the shape of the barrage style set for the barrage content by performing a conversion process on the coordinates of each character in the barrage content based on the actual area, the method according to claim 3.
8. The step of displaying each character included in the barrage content in the style adjustment area, An operation of displaying each character included in the barrage content in the style adjustment area based on the shape of the default barrage style, and Displaying in the style editing interface candidate barrage styles corresponding to the barrage content, and in response to a selection operation on a candidate barrage style corresponding to the barrage content, performing any one of operations of displaying each character included in the barrage content in the style adjustment area based on the shape of the selected candidate barrage style. The method according to claim 3 includes this step.
9. The attributes of the barrage style further include at least one of the color of the barrage content, the size of the barrage content, the special effects of the barrage content, and the arrangement method of the barrage content. The style editing interface includes a style adjustment area. The step of receiving, by the style editing interface, the barrage style set for the barrage content is as follows. In response to a setting operation on at least one of the color, size, special effects, and arrangement method of the barrage content in the style adjustment area, determining a new barrage style, and displaying in the style editing interface the barrage content to which the new barrage style is applied. When the setting operation is no longer received within a predetermined time or a barrage sending operation is received, determining the new barrage style as the barrage style set for the barrage content. The method according to claim 2 includes this step.
10. The style editing interface further includes a style preview area. The step of displaying in the style editing interface the barrage content to which the new barrage style is applied is as follows. The method according to claim 9 includes the step of displaying in the style preview area the barrage content to which the new barrage style is applied.
11. The types of the barrage style include static barrages and dynamic barrages. The step of receiving, by the barrage editing interface, the barrage style set for the barrage content is as follows. In response to a setting operation on the barrage type of the barrage content, determining a new barrage style including the set barrage type, and displaying in the barrage editing interface the barrage content to which the new barrage style is applied. When the setting operation is no longer received within a predetermined time or a barrage sending operation is received, determining the new barrage style as the barrage style set for the barrage content. The method according to claim 1 includes this step.
12. The step of displaying the barrage content to which the new barrage style is applied on the barrage editing interface is: When the barrage type in the new barrage style is a static barrage, the step of displaying the barrage content to which the attributes in the new barrage style are applied on the barrage editing interface and retaining the applied attributes as they are; When the barrage type in the new barrage style is a dynamic barrage, the method according to claim 11, wherein the barrage content to which the attributes in the new barrage style are applied is displayed on the barrage editing interface and the applied attributes are changed.
13. The step of the server transmitting the barrage content and the barrage style to other related electronic devices that are playing multimedia information is: The method according to claim 1, wherein the barrage content matching the barrage style is started to be displayed from the first end of the playback interface of the multimedia information and gradually moved to the second end of the playback interface of the multimedia information until it exits from the playback interface of the multimedia information.
14. The step of the server transmitting the barrage content and the barrage style to other related electronic devices that are playing multimedia information is: The operation of transmitting the barrage content and the barrage style to a client that is playing the multimedia information and whose user account used by the related electronic device is in an online state; The operation of transmitting the barrage content and the barrage style to a client that is playing the multimedia information and has a user account used by the related electronic device, wherein the user account used by the related electronic device is related to a client that has a potential friendship relationship with the barrage editing account; The operation of transmitting the barrage content and the barrage style to a client that has an active user account related to the user account used by the related electronic device, and The step of performing at least one of the operations of transmitting the barrage content and the barrage style to a client related to the user account selected by the barrage editing account while playing the multimedia information, The method according to claim 1, wherein the barrage editing account is the user account that edits the barrage style.
15. When the barrage editing interface receives the barrage content to be sent and does not receive the barrage style set for the barrage content, the server is sent the barrage content and the default barrage style, and The method according to any one of claims 1 to 14, further comprising the step of displaying the barrage content matching the default barrage style on the playback interface of the multimedia information of the other related electronic device.
16. The step of receiving, by the barrage editing interface, the barrage style set for the barrage content is Displaying candidate barrage styles corresponding to the barrage content on the barrage editing interface, and in response to a selection operation on the candidate barrage styles corresponding to the barrage content, determining the selected candidate barrage style as the barrage style set for the barrage content, or Displaying candidate barrage styles corresponding to the barrage content on the barrage editing interface, and in response to a setting operation of automatically setting a barrage style for the barrage content, determining the similarity between the feature vector of the candidate barrage style and the feature vector of the barrage editing account, Including the step of determining the candidate barrage style with the highest similarity as the barrage style set for the barrage content, The method according to any one of claims 1 to 14, wherein the barrage editing account is a user account that edits the barrage style.
17. An operation of obtaining, as candidate barrage styles, the barrage styles used by user accounts that have a potential friendship relationship with the barrage editing account, An operation of obtaining, as candidate barrage styles, the barrage styles used by user accounts that have a social relationship with the barrage editing account, and The method according to claim 16, further comprising the step of performing at least one of an operation of obtaining, as candidate barrage styles, barrage styles with a usage frequency greater than a frequency threshold or a score greater than a score threshold.
18. A display module configured to display a barrage editing interface in response to a barrage editing operation received during playback of multimedia information, A receiving module configured to receive bullet screen content to be transmitted through the bullet screen editing interface and to receive a bullet screen style set for the bullet screen content through the bullet screen editing interface, wherein attributes of the bullet screen style include a shape of the bullet screen content, the receiving module; A transmitting module configured to transmit the bullet screen content and the bullet screen style by a server to other related electronic devices playing multimedia information, wherein the other related electronic devices are used to display the bullet screen content matching the bullet screen style on a playback interface of the multimedia information, the transmitting module, a bullet screen processing apparatus including the same.
19. A memory storing executable instructions; An electronic device including a processor that, when executing the executable instructions stored in the memory, implements the method according to any one of claims 1 to 17.
20. A program that, when executed by a processor, implements the method according to any one of claims 1 to 17.
Citation Information
Patent Citations
Method and device for customizing high-level barrage for a viewer
CN104935997A
Barrage setting method and apparatus
CN106101804A
Software development apparatus and software development method
JP2015162218A
Comment display device, comment distribution device, comment display system, comment display method, and program
JP2015220610A
JPP7375186B