Bullet screen display method and device

Abstract

The embodiment of the invention provides a bullet screen display method and device, computer equipment, a computer readable storage medium and a computer program product, and belongs to the technical field of video playing interaction. The bullet screen display method is used for a playing end, and the playing end can communicate with a microphone. The method comprises the following steps: displaying a visual area, wherein the visual area is configured with a media display area and a bullet screen area for presenting bullet screens; receiving a target voice through the microphone, and displaying a target text content in the target voice in the visual area; and sending the target text content to a server, so that the server sends the target text content to the playing end and other playing ends in a bullet screen form, and the target text content is displayed in respective bullet screen areas of the playing end and other playing ends. According to the technical scheme of the embodiment of the invention, the bullet screen is efficiently and accurately sent through voice, the convenience and interaction efficiency of sending the bullet screen are improved, and the operation cost of a user is reduced.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of video playback interaction technology, and in particular to a bullet screen display method, device, computer equipment, computer-readable storage medium, and computer program product. Background Art

[0002] With the rapid development of video technology, more and more users are able to watch various video programs online. While watching videos, users can interact with other users by sending "danmu" messages. Danmu refers to interactive messages that pop up and move in a predetermined direction while watching a video. Danmu allows users to leave comments or reflections. However, unlike on typical video sharing websites, where comments are only displayed in a dedicated comment area below the video player, these messages appear in real time on the video screen as sliding subtitles, ensuring that all viewers are aware of them.

[0003] Danmu can also be used in TV scenarios. However, when users send Danmu on the playback end (such as the TV end), they need to use the remote control and the virtual keyboard on the playback end to enter text content. This method reduces the convenience of operation and leads to low interaction efficiency.

[0004] It should be noted that the above content is not necessarily prior art, nor is it intended to limit the scope of patent protection of this application. Summary of the Invention

[0005] The embodiments of the present application provide a bullet screen display method, apparatus, computer device, computer-readable storage medium, and computer program product to solve or alleviate one or more of the technical problems raised above.

[0006] One aspect of an embodiment of the present application provides a bullet screen display method, wherein the playback end can communicate with a microphone, and the method includes: Displaying a visible area, wherein the visible area is configured with a media display area and a bullet screen area for presenting bullet screens; receiving a target voice through the microphone, and displaying a target text content in the target voice in the visible area; and The target text content is sent to a server so that the server sends the target text content in the form of a bullet screen to the playback end and other playback ends, so as to be displayed in the respective bullet screen areas of the playback end and other playback ends.

[0007] Optionally, the playback end may receive a remote control command; receive a target voice through the microphone, and display target text content in the target voice in the visual area, including: In response to a long press of the microphone button of the remote control, if the media display area is playing a video, the target voice is recorded; wherein the target voice includes a barrage sending instruction and target text content; Analyzing the target voice to obtain the barrage sending instruction and the target text content; Displaying the target text content in the visible area; Among them, the barrage sending instruction is used to instruct the playback end to set the target text content as the barrage content.

[0008] Optionally, sending the target text content to a server includes: In response to the microphone button of the remote controller releasing the long press state, the target text content is sent to the server.

[0009] Optionally, the method further includes: In response to the microphone button of the remote control being in a long-press state, if the media display area is not playing a video, recording a target voice; wherein the target voice includes a video playback instruction, a barrage sending instruction, and a target text content; The video playback instruction is used to instruct the playback terminal to play corresponding video content.

[0010] Optionally, the method further includes: In response to the microphone button of the remote control being in a long-press state, a voice recording window pops up in the visible area, and the voice recording window is configured with an input box; wherein, the input box is used to display the target text content.

[0011] Optionally, the visible area is configured with a bullet screen control; and the method further includes: In response to the bullet screen control being triggered, a voice recording window pops up in the visible area, wherein the voice recording window is configured with an input box; Wherein, the input box is used to display the target text content.

[0012] Optionally, the playback terminal may receive remote control instructions; In response to the bullet screen control being triggered, a voice recording window pops up in the visible area, including: Receive an operation instruction of the remote control for the bullet screen control, and pop up the voice input window in the visible area.

[0013] Optionally, the voice recording window is further configured with a bullet screen sending control; Sending the target text content to the server includes: An operation instruction of the remote controller for the sending control is received, and the target text content is sent to the server.

[0014] Optionally, the method further includes: Generate a feedback instruction according to the recording status of the target voice by the playback end; The feedback instruction is sent to the remote controller to control the indicator light state of the remote controller through the feedback instruction.

[0015] Another aspect of an embodiment of the present application provides a bullet screen display device, which is used on a playback terminal, and the playback terminal can communicate with a microphone; the device includes: A display module is used to display a visible area, wherein the visible area is configured with a media display area and a bullet screen area for presenting bullet screens; a receiving module, configured to receive a target voice through the microphone and display a target text content in the target voice in the visual area; and The sending module is used to send the target text content to the server, so that the server sends the target text content in the form of bullet screen to the playback end and other playback ends, so as to be displayed in the respective bullet screen areas of the playback end and other playback ends.

[0016] Another aspect of an embodiment of the present application provides a computer device, including: at least one processor; and a memory communicatively coupled to the at least one processor; Wherein: the memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method described above.

[0017] Another aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and when the computer instructions are executed by a processor, the method described above is implemented.

[0018] Another aspect of an embodiment of the present application provides a computer program product, including a computer program, which implements the above-mentioned method when executed by a processor.

[0019] The embodiments of the present application employing the above-mentioned technical solution may have the following advantages: the target voice is received through a microphone, the recognized target text content is displayed in the visible area, and then sent to the server. The server then sends the target text content in the form of a bullet screen to the current player and other players, for display in their respective bullet screen areas. This enables the efficient and accurate sending of bullet screens through voice, improves the convenience and interaction efficiency of sending bullet screens, and reduces user operation costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings illustrate exemplary embodiments and constitute a part of the specification. Together with the description of the specification, they serve to explain exemplary implementation of the embodiments. The illustrated embodiments are for illustrative purposes only and do not limit the scope of the claims. Throughout the drawings, the same reference numerals designate similar, but not necessarily identical, elements.

[0021] Figure 1 The following diagram schematically shows an operating environment of the bullet screen display method according to the first embodiment of the present application; Figure 2 The following schematically shows a flow chart of a bullet screen display method according to the first embodiment of the present application; Figure 3 Schematically shows the Figure 2 Flowchart of sub-steps of step S202; Figure 4 The following schematically shows a newly added flow chart of the bullet screen display method according to the first embodiment of the present application; Figure 5 The following schematically illustrates an exemplary application of the bullet screen display method according to the first embodiment of the present application; Figure 6 The following schematically illustrates an exemplary application of the bullet screen display method according to the first embodiment of the present application; Figure 7 A block diagram of a bullet screen display device according to the second embodiment of the present application is schematically shown; and Figure 8 The following schematically shows a hardware architecture diagram of a computer device according to the third embodiment of the present application. DETAILED DESCRIPTION

[0022] In order to make the purpose, technical solutions and advantages of this application more clear, the present application is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are only used to explain this application and are not intended to limit this application. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0023] It should be noted that the descriptions of "first", "second", etc. in the embodiments of the present application are for descriptive purposes only and should not be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" or "second" may explicitly or implicitly include at least one of such features. In addition, the technical solutions between the various embodiments can be combined with each other, but this must be based on the fact that they can be implemented by ordinary technicians in this field. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such a combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0024] It should be noted that in all aspects of this application involving data collection, storage, use, transmission, and processing, all data must strictly adhere to the laws, regulations, industry standards, and regulatory requirements of the data's source and use locations, as well as the relevant countries and regions, to ensure the legality and compliance of data activities. During the collection phase, the purpose, method, and scope of collection will be clearly stated to the data subject in a conspicuous manner. Collection will be carried out only after obtaining the data subject's legal authorization, ensuring that the collection process adheres to the "minimum necessary" principle and does not exceed the scope of data collection. During storage, the storage period will be limited, and after the storage purpose has been achieved, data will be promptly deleted, anonymized, or encrypted. During the use phase, strict data security protection mechanisms will be implemented, using field-level desensitization technology to process raw data according to pre-set desensitization rules. A variety of desensitization strategies, such as data generalization, data anonymization, and data encryption, will be employed for different data types to effectively mitigate the risk of sensitive information leakage and ensure that the data ultimately used is securely desensitized data, fully protecting the rights and interests of data subjects and data security. During the transmission and processing phases, the confidentiality and security of data will be ensured during transmission and processing.

[0025] In the description of this application, it should be understood that the numerical labels before the steps do not indicate the order in which the steps are executed. They are only used to facilitate the description of this application and to distinguish each step. Therefore, they cannot be understood as limitations on this application.

[0026] First, an explanation of the terms involved in this application is provided: Danmu (bullet screen) refers to subtitles, images, and other content that pop up and move in a predetermined direction when watching a video online. While there's no fixed term for this term in English, it's commonly referred to as comment, danmaku, barrage, bullet screen, or bullet-screen comment. Danmu allows viewers to leave comments or reflections, but unlike typical video sharing websites where comments are displayed in a dedicated area below the video player, these comments appear in real-time as sliding subtitles on the video screen, ensuring that all viewers are aware of them. Danmu can be managed through a Danmu system. Some Danmu systems utilize CSS (Cascading Style Sheets) or JavaScript to provide customized Danmu formats, such as allowing them to appear or disappear at specific locations, control their speed, and position. Furthermore, Danmu that appears fixed at the bottom or top of the screen can also serve as subtitles for videos without subtitles.

[0027] For example, the data structure of a bullet comment can be as follows: { The time of emission in the video is in seconds; Type of barrage; The size of the barrage text; The color of the barrage text; Date the comment was created; The class name of the barrage; The user ID that created the barrage; Bullet chat identifier (e.g., bullet chat group identifier); Bullet comment content (e.g., text, images, controls); The duration of the barrage; Whether the bullet screen has a border; The color of the bullet screen border; The interline style of the barrage; }.

[0028] Playback terminal: It can refer to terminal devices related to video playback, such as smart TVs and set-top boxes with external monitors.

[0029] Speech recognition: An intelligent processing technology that maps human natural language speech signals into corresponding text sequences. The core is to extract audio features through acoustic models and combine them with language models for probabilistic decoding to achieve automatic conversion of speech to text. Semantic recognition: The process of deep semantic understanding of natural language text, with the goal of extracting user intent, entity information, and semantic relationships from the text.

[0030] Secondly, to facilitate those skilled in the art to understand the technical solutions provided by the embodiments of this application, the following describes the relevant technologies: The applicant has found that users can only view barrages on the playback end, which cannot meet user needs. Users also need to send barrages in an efficient way to improve interactivity and user experience. However, using a remote control and a virtual keyboard on the playback end to input text content is not so convenient, and the user operation cost is high, thereby reducing the user experience.

[0031] To this end, the present application provides a bullet screen display technology solution. In this technology solution, users can watch the video on the playback end and input and send bullet screens by voice. See below for details.

[0032] Finally, for ease of understanding, an exemplary operating environment is provided below.

[0033] like Figure 1 As shown, the operating environment diagram includes: a service platform 2, and playback terminals (4A, 4B, ..., 4N).

[0034] The service platform 2 can be connected to the playback terminals (4A, 4B, ..., 4N) via the network.

[0035] The service platform 2 can be a single server, a server cluster or a cloud computing service center.

[0036] Service platform 2 can provide services such as distributing barrage to the playback end.

[0037] Service platform 2 can be located in a single location, such as a data center, or distributed across different geographical locations (e.g., multiple locations). Service platform 2 can provide services via a network. The network includes various network devices, such as routers, switches, multiplexers, hubs, modems, bridges, repeaters, firewalls, proxy devices, and / or the like. The network can include physical links, such as coaxial cable links, twisted pair cable links, fiber optic links, combinations thereof, or wireless links, such as cellular links, satellite links, Wi-Fi links, and the like.

[0038] The playback terminals (4A, 4B, ..., 4N) can be configured to access the content and services of the service platform 2. The playback terminals (4A, 4B, ..., 4N) can be associated with one or more users. A single user can also use one or more of the playback terminals (4A, 4B, ..., 4N) to access the service platform 2. The playback terminals (4A, 4B, ..., 4N) can travel to various locations and use different networks to access the service platform 2.

[0039] The playback terminals (4A, 4B, ..., 4N) may include an interface. This interface may include a touchpad, a touch screen, a mouse, a button pad, or other sensing elements. A microphone may be integrated into the remote control or the playback terminal. For example, the remote control may be configured to receive user commands that cause the playback terminals (4A, 4B, ..., 4N) to perform various operations, and may receive user voice and convert the user voice into user commands and comment content.

[0040] It should be noted that the above devices are exemplary, and the number and type of devices can be adjusted in different scenarios or according to different needs.

[0041] The following describes the technical solutions of the present application through multiple embodiments, taking the playback end as the execution subject. It should be noted that these embodiments can be implemented in many different forms and should not be construed as being limited to the embodiments described here.

[0042] Example 1 Figure 2 The flowchart of the bullet screen display method according to the first embodiment of the present application is schematically shown.

[0043] like Figure 2 As shown, the bullet screen display method may include steps S200 to S204, wherein: Step S200: displaying a visible area, wherein the visible area is configured with a media display area and a bullet screen area for displaying bullet screens.

[0044] Step S202: receiving a target voice through the microphone, and displaying a target text content in the target voice in the visible area.

[0045] Step S204: sending the target text content to the server, so that the server sends the target text content in the form of bullet screen to the playback terminal and other playback terminals, so as to be displayed in the respective bullet screen areas of the playback terminal and other playback terminals.

[0046] The bullet screen display method provided in this embodiment receives target speech through a microphone, displays the recognized target text content in the visible area, and sends it to the server. The server then sends the target text content in the form of bullet screen to the current player and other players, for display in their respective bullet screen areas. This enables efficient and accurate delivery of bullet screens via voice, improves the convenience and interaction efficiency of sending bullet screens, and reduces user operation costs.

[0047] The following combination Figure 2 , each step in steps S200~S204 and other optional steps are described in detail.

[0048] Step S200 , displaying a visual area, wherein the visual area is configured with a media display area and a barrage area for presenting barrages.

[0049] The visible area refers to the area used by the playback end for screen display. The playback end can be a playback device such as a television or a projection device. The media display area can be used to display video content. The barrage area can be superimposed on various positions such as above or to the side of the media display area to slide and present the barrage content. The sliding direction can be from left to right, from bottom to top, or static stay (such as fixed display for 3 seconds), etc. According to actual needs, the transparency, size, and position of the barrage area can be adjusted to effectively reduce the obstruction of the barrage area to the video content in the visible area. In some embodiments, the barrage speed adaptively adjusts the scrolling speed according to the length of the barrage (long barrages are faster, short barrages are slower).

[0050] Step S202 , receiving the target voice through the microphone, and displaying the target text content in the target voice in the visual area.

[0051] In actual applications, users usually need to use the remote control and the virtual keyboard on the playback end to input text content in order to send barrages on the playback end, which reduces the convenience of user operation, and the high user operation cost will further reduce the user experience and interactivity. In order to solve the problem of cumbersome barrage sending operations, the embodiment of the present application innovatively proposes a barrage sending method based on voice input. To implement this method, the target voice can be recorded through a microphone, and the microphone can be integrated into the remote control or built into the playback end. The target voice received by the microphone can be subjected to voice recognition to convert the voice content into text content. Since the target voice may contain multiple semantics, the text content used to send the barrage can be extracted from it as the target text content. The target text content is displayed in the visual area of ​​the playback end for user confirmation or used directly as a barrage. In some embodiments, the target voice can be processed and parsed by a built-in voice semantic recognition service, or in conjunction with server-side collaborative recognition.

[0052] Step S204 , sending the target text content to the server, so that the server sends the target text content in the form of barrage to the playback end and other playback ends, so as to be displayed in the respective barrage areas of the playback end and other playback ends.

[0053] The target text content can be sent to a server (bullet screen server), which will then distribute the target text content in the form of a bullet screen. Specifically, the server can encapsulate the target text content into a structure that supports bullet screen rendering (such as timestamp, position, speed, color, and other parameters) and distribute the bullet screen corresponding to the target text content to the current player and other players playing the same video content, effectively ensuring that the bullet screen content can be viewed by multiple users simultaneously, achieving an interactive effect. The following example provides a solution for sending the target text content to the server.

[0054] The target text content of step S202 and the text sending of step S204 can be achieved by one key or by a combination of operations.

[0055] One-click implementation solution: One-click implementation solution 1 can realize one-click barrage entry and sending based on a single button (microphone button) on the remote control.

[0056] (1) One-click implementation solution - obtaining target text content: In the case of video playback: Figure 3 As shown, step S202 may include: Step S300, in response to the microphone button of the remote control being in a long-press state, if the media display area is playing a video, the target voice is recorded; wherein, the target voice includes a barrage sending instruction and a target text content.

[0057] Step S302: Analyze the target voice to obtain the barrage sending instruction and the target text content.

[0058] Step S304: display the target text content in the visible area.

[0059] Among them, the barrage sending instruction is used to instruct the playback end to set the target text content as the barrage content.

[0060] In actual applications, when a video is playing in the media display area, the user can record the target voice by long pressing the microphone button on the remote control. The target voice can include multiple semantic information, such as the barrage sending instruction and the barrage content to be sent. The target voice is analyzed through voice recognition and semantic recognition, and the barrage sending instruction and barrage content are converted into machine-recognizable instructions and corresponding target text content. For example, the user presses the microphone button on the remote control and says: "Hello, small TV, I want to send a barrage, and the barrage content is: This movie is really good!", and then the voice is parsed into the barrage sending instruction and the target text content "This movie is really good!", and the text is displayed in the visible area of ​​the playback end.

[0061] In this embodiment, the barrage sending instructions and the corresponding target text content can be obtained efficiently and accurately through the target voice, and then the barrage sending is realized on the playback end without the user having to perform complicated operations, which significantly improves the operational convenience.

[0062] (2) One-click implementation solution - sending target text content: Step S204 may include: In response to the microphone button of the remote controller releasing the long press state, the target text content is sent to the server.

[0063] Since voice recording can be performed by long-pressing the microphone button on the remote control, in this embodiment, when the user releases the microphone button on the remote control, the target voice recording is complete, and the recognized target text content can then be sent to the server, which forwards it to each playback terminal in the form of a bullet screen and displays it in the corresponding bullet screen area. In this embodiment, by releasing the long-press state of the microphone button on the remote control, the target text content is sent to the server, thus achieving a one-click bullet screen sending method (only one button interaction is required to send the bullet screen), improving the convenience and interaction efficiency of sending bullet screens, and reducing user operation costs.

[0064] This solution can realize the entry and sending of bullet comments on the playback end with one click.

[0065] One-click implementation solution 2: (1) One-click implementation solution - obtaining target text content: When no video is playing in the media display area: The method also includes: in response to the microphone button of the remote control being in a long-press state, if the media display area is not playing a video, recording a target voice; wherein the target voice includes a video playback instruction, a barrage sending instruction and a target text content; the video playback instruction is used to instruct the playback end to play the corresponding video content.

[0066] In actual applications, when the media display area is not playing a video, the semantic information of the target voice may include a video playback instruction, a barrage sending instruction, and the barrage content to be sent. The corresponding video content can be played in the media display area through the video playback instruction. In some embodiments, when the media display area is playing a video, the video playback instruction can be used to switch the currently playing video to the video corresponding to the video playback instruction for playback, and the target text content can be displayed in the visible area. For example, the user presses the microphone button on the remote control and says: "Hello, small TV, I want to turn on video A and send a barrage, and the barrage content is: This movie is really good!", and then the voice is parsed into an instruction to play video A, a barrage sending instruction, and the target text content "This movie is really good!", and video A is played according to the parsing result, and the text is displayed in the visible area of ​​the playback end.

[0067] In this embodiment, when no video is played in the media display area, the video playback instructions, barrage sending instructions and the corresponding target text content can be efficiently and accurately obtained through the target voice, and then the corresponding video can be played on the playback end and the barrage sending can be realized without the user having to perform complex operations, which significantly improves the convenience of operation.

[0068] (2) One-click implementation solution - sending target text content: Step S204 may include: In response to the microphone button of the remote controller releasing the long press state, the target text content is sent to the server.

[0069] Since voice recording can be performed by long-pressing the microphone button on the remote control, in this embodiment, when the user releases the microphone button on the remote control, the target voice recording is complete, and the recognized target text content can then be sent to the server, which forwards it to each playback terminal in the form of a bullet screen and displays it in the corresponding bullet screen area. In this embodiment, by releasing the long-press state of the microphone button on the remote control, the target text content is sent to the server, thus achieving a one-click bullet screen sending method (only one button interaction is required to send the bullet screen), improving the convenience and interaction efficiency of sending bullet screens, and reducing user operation costs.

[0070] Compared with the one-click implementation solution 1, this solution can realize the opening, jumping, barrage entry and sending of the target video on the playback end with one click.

[0071] To improve visibility and interactivity, in an optional embodiment, the method further includes: In response to the microphone button of the remote control being in a long-press state, a voice recording window pops up in the visible area, and the voice recording window is configured with an input box; wherein, the input box is used to display the target text content.

[0072] The voice input window can be used to prompt the user that a voice input operation is currently being performed. The input box configured in the input window can be used to display the target text content obtained by recognition in real time. In some embodiments, the input box configured in the input window can also be used to display the results of voice recognition in real time. According to actual needs, the voice input status can be fed back in the voice status feedback component of the voice input window, for example, the strength of the sound input can be dynamically displayed through sound waves, and the recording duration and progress bar can also be displayed. In this embodiment, the target text content parsed during the voice recognition process is presented in the input box to provide the user with visual feedback results, enhance the comprehensibility and confirmation mechanism of voice interaction, and help improve the accuracy of interaction and user satisfaction.

[0073] Operation combination implementation plan: This combined implementation includes the pop-up of the voice input window, voice input, and confirmation of the barrage sending.

[0074] (1) Regarding the pop-up of the voice input window and voice input, the visible area can be configured with bullet screen controls, etc.

[0075] The method further includes: in response to the bullet screen control being triggered, popping up a voice recording window in the visible area, wherein the voice recording window is configured with an input box, wherein the input box is used to display the target text content.

[0076] The barrage control serves as the entry point for the voice barrage feature. When users need to send a barrage, they can tap the barrage control to record their voice and display the target text content. The barrage control can appear as a button with an icon, such as a microphone or speech bubble, and can be placed above the media display area or in the sidebar to effectively avoid obstructing the screen.

[0077] In this embodiment, by triggering the bullet screen control, a voice input window pops up to record voice and display the target text content, so as to provide the user with visual feedback results, enhance the comprehensibility and confirmation mechanism of voice interaction, and help improve the accuracy of interaction and user satisfaction.

[0078] In an optional embodiment, the playback end may receive a remote control command; in response to the bullet screen control being triggered, a voice recording window pops up in the visible area, including: Receive an operation instruction of the remote control for the bullet screen control, and pop up the voice input window in the visible area.

[0079] The operating instructions of the remote control include directional instructions, confirmation instructions, menu instructions, digital instructions, etc. For example, directional instructions may include up, down, left, right, etc., which may be triggered by the up, down, left, and right directional keys on the remote control. The confirmation instruction may be triggered by buttons such as "Confirm" and "OK" on the remote control. The barrage control in the visible area can be selected by the directional instructions of the remote control and triggered by the confirmation instruction. For example, there may be an icon corresponding to the barrage control on the lower right side of the visible area. When the user moves the focus to the icon through the directional keys of the remote control and presses the confirmation key, a voice recording window will pop up to guide the user to send the barrage through voice. In this embodiment, the operation instructions of the remote control for the barrage control are used to realize the pop-up of the voice recording window in the visible area, thereby improving the intuitiveness and accuracy of the operation.

[0080] (2) Confirmation of sending barrage messages.

[0081] In an optional embodiment, the voice recording window is further configured with a bullet screen sending control. Step S204 may include: An operation instruction of the remote controller for the sending control is received, and the target text content is sent to the server.

[0082] The barrage sending control can be a send button or functional area provided in the voice recording window. Specifically, the barrage sending control can be presented in the form of text or corresponding icons such as "send", "confirm", and "barrage sending". In actual applications, the user can trigger voice recording through the pop-up voice recording window, and display the recognized target text content in the input box of the voice recording window. When the user confirms that the target text content is the barrage content to be sent, the icon corresponding to the barrage sending control can be selected through the remote control, and a confirmation instruction can be sent to send the target text content to the server. After the server receives the target text content, it can be forwarded to each playback end in the form of a barrage, and displayed in their respective barrage areas. In this embodiment, the barrage sending control can be used to enable the user to actively confirm whether to send after voice input, thereby enhancing the user's controllability over the barrage sending process, thereby effectively avoiding accidental sending.

[0083] The above introduces the implementation schemes of one-click barrage sending and operation-combined barrage sending.

[0084] In order to improve the user's perception of the voice input process, in an optional embodiment, such as Figure 4 As shown, the method further includes: Step S400: generating a feedback instruction according to the recording status of the target voice by the playback end.

[0085] Step S402: Send the feedback instruction to the remote controller to control the indicator light state of the remote controller through the feedback instruction.

[0086] The recording status may include recording, identifying and escaping, identification and escaping completed, and errors (such as recognition errors, escape errors). According to actual needs, the recording status of the target voice can also be displayed in the voice recording window. In some embodiments, in different states of voice recording, the indicator light of the remote control can provide corresponding visual feedback. When the recording status is recording, the indicator light is blue. When the status is identifying and escaping, the indicator light is green. When the identification and escaping are completed, the indicator light is white and flashes three times in succession. If an error occurs during the identification or escaping process, the indicator light is red and flashes three times in succession, and a corresponding error prompt message pops up in the visible area. In this embodiment, through feedback communication between the playback end and the remote control, the indicator light status of the remote control can reflect the voice recording status in real time, thereby improving the intuitiveness of voice interaction and user experience.

[0087] In order to make this application easier to understand, the following Figure 5 、 6 An exemplary application is provided.

[0088] 1. Combination Figure 5 The user on the TV side (i.e. the playback side) receives the target voice through the microphone of the remote control to send barrage.

[0089] In step S501, the user long presses the microphone button of the remote control to record the target voice.

[0090] Step S502: The user releases the microphone button of the remote control, and the target voice is recognized by the voice translation recognition service.

[0091] If the recognition fails, execute step S503; In case of failure to succeed, step S504 is executed.

[0092] Step S503: prompt the user that the voice recognition has failed and the user can try to input the voice again.

[0093] Step S504: determine whether a video is being played.

[0094] No, execute step S506 after executing step S505; If yes, proceed directly to step S506.

[0095] Step S505: Open the video that the user wants to open according to the play command of the target voice.

[0096] Step S506: Send the target text content in the target speech to the server.

[0097] In step S507, the target text content is sent to each TV terminal in the form of a bullet screen through the server, and then displayed in the bullet screen area of ​​each TV terminal.

[0098] 2. Combination Figure 6 This section describes the sequence of how a user sends a barrage by receiving a target voice message through the remote control's microphone.

[0099] In step S601, the user long presses the microphone button of the remote control (ie, the user presses the voice recording button) to trigger the voice collection module.

[0100] Step S602: The voice collection module collects the target voice.

[0101] Step S603: The voice collection module transmits the target voice to the voice semantic recognition service.

[0102] Step S604: The speech semantics recognition service executes the speech semantics recognizer to recognize the target speech.

[0103] Step S605, after the target speech is recognized successfully, the speech semantic recognition service transfers the target text content of the target speech to the barrage sending module, and sends the target text content to the server through the barrage sending module.

[0104] Step S606: The bullet screen display module receives the target text content sent by the server in the form of bullet screen.

[0105] Step S607: the bullet screen display module displays the target text content in the bullet screen area in the form of a bullet screen.

[0106] In this exemplary application, the barrage can be sent efficiently and accurately through voice, which improves the convenience and interaction efficiency of sending barrage and reduces user operation costs.

[0107] Example 2 Figure 7The block diagram of the bullet screen display device according to the second embodiment of the present application is schematically shown. The device can be divided into one or more program modules, one or more program modules are stored in a storage medium, and are executed by one or more processors to complete the embodiment of the present application. The program module referred to in the embodiment of the present application refers to a series of computer program instruction segments that can complete specific functions. The following description will specifically introduce the functions of each program module in this embodiment. The device is used for the playback end, and the playback end can communicate with the microphone. Figure 7 As shown, the device 700 may include: a display device 710, a receiving device 720 and a sending device 730, wherein: The display module 710 is used to display the visible area, wherein the visible area is configured with a media display area and a bullet screen area for displaying bullet screens; The receiving module 720 is configured to receive a target speech through the microphone and display a target text content in the target speech in the visible area; and The sending module 730 is used to send the target text content to the server, so that the server sends the target text content in the form of barrage to the playback end and other playback ends, so as to be displayed in the barrage areas of the playback end and other playback ends respectively.

[0108] As an optional embodiment, the playback end may receive remote control instructions; the receiving module 720 is further configured to: In response to a long press of the microphone button of the remote control, if the media display area is playing a video, the target voice is recorded; wherein the target voice includes a barrage sending instruction and target text content; Analyzing the target voice to obtain the barrage sending instruction and the target text content; Displaying the target text content in the visible area; Among them, the barrage sending instruction is used to instruct the playback end to set the target text content as the barrage content.

[0109] As an optional embodiment, the sending module 730 is further configured to: In response to the microphone button of the remote controller releasing the long press state, the target text content is sent to the server.

[0110] As an optional embodiment, the receiving module 720 is further configured to: In response to the microphone button of the remote control being in a long-press state, if the media display area is not playing a video, recording a target voice; wherein the target voice includes a video playback instruction, a barrage sending instruction, and a target text content; The video playback instruction is used to instruct the playback terminal to play corresponding video content.

[0111] As an optional embodiment, the receiving module 720 is further configured to: In response to the microphone button of the remote control being in a long-press state, a voice recording window pops up in the visible area, and the voice recording window is configured with an input box; wherein, the input box is used to display the target text content.

[0112] As an optional embodiment, the visible area is configured with a bullet screen control; the receiving module 720 is further configured to: In response to the bullet screen control being triggered, a voice recording window pops up in the visible area, wherein the voice recording window is configured with an input box; Wherein, the input box is used to display the target text content.

[0113] As an optional embodiment, the playback end may receive remote control instructions; the receiving module 720 is further configured to: Receive an operation instruction of the remote control for the bullet screen control, and pop up the voice input window in the visible area.

[0114] As an optional embodiment, the voice recording window is further configured with a bullet screen sending control; the sending module 730 is further used to: An operation instruction of the remote controller for the sending control is received, and the target text content is sent to the server.

[0115] As an optional embodiment, the sending module 730 is further configured to: Generate a feedback instruction according to the recording status of the target voice by the playback end; The feedback instruction is sent to the remote controller to control the indicator light state of the remote controller through the feedback instruction.

[0116] Example 3 Figure 8 The following schematically shows a hardware architecture diagram of a computer device 10000 suitable for implementing a bullet screen display method according to the third embodiment of the present application. In some embodiments, the computer device 10000 can be various playback terminals, such as smart TVs, set-top boxes, and other terminal devices with built-in TV playback software, such as smart phones, tablet computers, personal computers, car terminals, game consoles, virtual devices, workstations, robots, and other terminal devices. Figure 8 As shown, the computer device 10000 includes but is not limited to: a memory 10010, a processor 10020, and a network interface 10030 that can communicate with each other via a system bus. Memory 10010 includes at least one type of computer-readable storage medium, including flash memory, a hard disk, a multimedia card, card-type memory (e.g., SD or DX memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, a magnetic disk, an optical disk, and the like. In some embodiments, memory 10010 may be an internal storage module of computer device 10000, such as a hard disk or memory of computer device 10000. In other embodiments, memory 10010 may also be an external storage device of computer device 10000, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash memory card, and the like equipped on computer device 10000. Of course, memory 10010 may also include both internal storage modules and external storage devices of computer device 10000. In this embodiment, the memory 10010 is generally used to store the operating system and various application software installed on the computer device 10000, such as the program code of the bullet screen display method, etc. In addition, the memory 10010 can also be used to temporarily store various data that have been output or will be output.

[0117] In some embodiments, processor 10020 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other chips. Processor 10020 is typically used to control the overall operation of computer device 10000, such as performing control and processing related to data exchange or communication with computer device 10000. In this embodiment, processor 10020 is used to execute program code stored in memory 10010 or process data.

[0118] Network interface 10030 may include a wireless network interface or a wired network interface. Network interface 10030 is typically used to establish a communication link between computer device 10000 and other computer devices. For example, network interface 10030 is used to connect computer device 10000 to an external terminal via a network, establishing a data transmission channel and a communication link between computer device 10000 and the external terminal. The network may be a wireless or wired network such as an intranet, the Internet, the Global System of Mobile Communications (GSM), Wideband Code Division Multiple Access (WCDMA), a 4G network, a 5G network, Bluetooth, or Wi-Fi.

[0119] It should be pointed out that Figure 8 A computer device is shown having components 10010 - 10030 , but it should be understood that implementing all of the illustrated components is not a requirement, and greater or fewer components may alternatively be implemented.

[0120] In this embodiment, the bullet screen display method stored in the memory 10010 can also be divided into one or more program modules and executed by one or more processors (such as processor 10020) to complete the embodiment of the present application.

[0121] Example 4 An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the barrage display method in the embodiment are implemented.

[0122] In this embodiment, computer-readable storage media include flash memory, hard disks, multimedia cards, card-type memories (e.g., SD or DX memories), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic storage, magnetic disks, optical disks, and the like. In some embodiments, the computer-readable storage medium may be an internal storage unit of a computer device, such as the computer device's hard disk or memory. In other embodiments, the computer-readable storage medium may also be an external storage device of the computer device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash memory card, and the like. Of course, the computer-readable storage medium may also include both the internal storage unit and external storage devices of the computer device. In this embodiment, the computer-readable storage medium is typically used to store the operating system and various application software installed on the computer device, such as the program code of the bullet screen display method in the embodiment. In addition, the computer-readable storage medium may also be used to temporarily store various types of data that has been output or is about to be output.

[0123] Example 5 An embodiment of the present application further provides a computer program product, including a computer program, which implements the method in the above embodiment when executed by a processor.

[0124] Obviously, those skilled in the art should understand that the modules or steps of the above-mentioned embodiments of the present application can be implemented using general-purpose computer devices. They can be concentrated on a single computer device or distributed on a network composed of multiple computer devices. Alternatively, they can be implemented using program codes executable by the computer device, so that they can be stored in a storage device and executed by the computer device. In some cases, the steps shown or described can be performed in a different order than herein, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the embodiments of the present application are not limited to any specific combination of hardware and software.

[0125] It should be noted that the above are only preferred embodiments of the present application and do not limit the scope of patent protection of the present application. Any equivalent structure or equivalent process transformation made using the contents of the description and drawings of this application, or directly or indirectly applied in other related technical fields, are also included in the scope of patent protection of the present application.

Claims

1. A bullet screen display method, characterized in that: For a playback terminal, the playback terminal can communicate with a microphone, and the method includes: Displaying a visible area, wherein the visible area is configured with a media display area and a bullet screen area for presenting bullet screens; receiving a target voice through the microphone, and displaying a target text content in the target voice in the visible area; and The target text content is sent to a server so that the server sends the target text content in the form of a bullet screen to the playback end and other playback ends, so as to be displayed in the respective bullet screen areas of the playback end and other playback ends.

2. The method according to claim 1, characterized in that The playback terminal can receive remote control instructions; Receiving a target voice through the microphone and displaying target text content in the target voice in the visual area includes: In response to a long press of the microphone button of the remote control, if the media display area is playing a video, the target voice is recorded; wherein the target voice includes a barrage sending instruction and target text content; Analyzing the target voice to obtain the barrage sending instruction and the target text content; Displaying the target text content in the visible area; Among them, the barrage sending instruction is used to instruct the playback end to set the target text content as the barrage content.

3. The method according to claim 2, characterized in that Sending the target text content to the server includes: In response to the microphone button of the remote controller releasing the long press state, the target text content is sent to the server.

4. The method according to claim 2, characterized in that The method further comprises: In response to the microphone button of the remote control being in a long-press state, if the media display area is not playing a video, recording a target voice; wherein the target voice includes a video playback instruction, a barrage sending instruction, and a target text content; The video playback instruction is used to instruct the playback terminal to play corresponding video content.

5. The method according to claim 2, characterized in that The method further comprises: In response to the microphone button of the remote control being in a long-press state, a voice recording window pops up in the visible area, and the voice recording window is configured with an input box; wherein, the input box is used to display the target text content.

6. The method according to claim 1, wherein The visible area is configured with a bullet screen control; the method further includes: In response to the bullet screen control being triggered, a voice recording window pops up in the visible area, wherein the voice recording window is configured with an input box; Wherein, the input box is used to display the target text content.

7. The method according to claim 6, characterized in that The playback terminal can receive remote control instructions; In response to the bullet screen control being triggered, a voice recording window pops up in the visible area, including: Receive an operation instruction of the remote control for the bullet screen control, and pop up the voice input window in the visible area.

8. The method according to claim 6, characterized in that The voice input window is also configured with a bullet screen sending control; sending the target text content to the server includes: An operation instruction of the remote controller for the sending control is received, and the target text content is sent to the server.

9. The method according to any one of claims 2, 3, 4, 5, 7 and 8, characterized in that: The method further comprises: Generate a feedback instruction according to the recording status of the target voice by the playback end; The feedback instruction is sent to the remote controller to control the indicator light state of the remote controller through the feedback instruction.

10. A bullet screen display device, characterized in that: The device is used for a playback end, and the playback end can communicate with a microphone; the device includes: A display module is used to display a visible area, wherein the visible area is configured with a media display area and a bullet screen area for presenting bullet screens; a receiving module, configured to receive a target voice through the microphone and display a target text content in the target voice in the visual area; and The sending module is used to send the target text content to the server, so that the server sends the target text content in the form of bullet screen to the playback end and other playback ends, so as to be displayed in the respective bullet screen areas of the playback end and other playback ends.

11. A computer device, characterized in that: include: at least one processor; and a memory communicatively coupled to the at least one processor; wherein: The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, which, when executed by a processor, implement the method according to any one of claims 1 to 9.

13. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to claims 1 to 9 are implemented.

Images