Interface display method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention discloses an interface display method and device, electronic equipment and a storage medium, and is applied to the field of man-machine interaction, the method comprises the steps that multimedia content is played in a playing area of a first interface in a video listening mode, and the size of the playing area is smaller than that of the first interface; and in response to the operation of starting the first function, displaying text information for the multimedia content in a non-playing area of the second interface, the text information corresponding to the first function, and the text information comprising first subtitle information and / or bullet screen information. By adopting the embodiment of the invention, the character information aiming at the multimedia content is displayed in the non-playing area based on the user operation in the video listening mode, and the non-playing area is beneficial to providing more space to display the character information, so that the displayed character information is larger, the user can see the clearer character information, and the user experience is improved. Therefore, the use experience of the user in the video listening mode can be improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of human-computer interaction technology, and relate to but are not limited to a method and device for interface display, an electronic device, and a storage medium. Background Art

[0002] With the development of multimedia information, users can browse multimedia contents such as video, audio, etc. on various types of application programs (eg, video software, audio software, social software, etc.).

[0003] Some current short video applications support the playback of multimedia content in the listening video mode. Compared with the full-screen playback of multimedia content in the normal mode, the playback screen of multimedia content in the listening video mode will become smaller, resulting in the display of text related to the multimedia content, such as subtitles and / or bullet screens, being restricted. For example, the relevant text is not displayed in the listening video mode or is displayed on a reduced playback screen, which will affect the user experience in the listening video mode. Summary of the invention

[0004] In view of this, the embodiments of the present application provide a method and device for interface display, an electronic device, and a storage medium, which can display subtitles and / or barrages corresponding to multimedia content in the listening and video mode, so as to facilitate users to understand the video content and improve the user experience in the listening and video mode.

[0005] The present application provides a method for displaying an interface, the method comprising:

[0006] Playing multimedia content in a playback area of ​​a first interface in a video listening mode, wherein the size of the playback area is smaller than the size of the first interface;

[0007] In response to the operation of starting the first function, text information for the multimedia content is displayed in the non-playback area of ​​the second interface, wherein the text information corresponds to the first function, and the text information includes first subtitle information and / or barrage information, and the first subtitle information includes target subtitles displayed synchronously with the current playback content of the multimedia content.

[0008] In the above technical solution, when the user wants to understand the text information of multimedia content such as subtitles and / or bullet screens in the listening video mode, the user can switch to the second interface of the listening video mode by turning on the subtitle and / or bullet screen function (such as the first function), and generate and display text information related to the multimedia content in the non-playing area of ​​the second interface. Compared with the prior art solution that displays text information on a reduced playback screen or does not display text information, resulting in a poor user experience, in the technical solution of the present application, text information for multimedia content is displayed in the non-playing area based on user operations in the listening video mode. Since the non-playing area is conducive to providing more space to display text information, the displayed text information can be made larger, so that the user can see clearer text information, thereby improving the user experience in the listening video mode.

[0009] In some embodiments, the first function includes a subtitle function, and the text information includes the first subtitle information; and in response to the operation of enabling the first function, displaying the text information for the multimedia content in the non-playing area of ​​the second interface includes:

[0010] In response to a first operation on the first interface, the first subtitle information for the multimedia content is displayed in a non-playing area of ​​the second interface.

[0011] In the above technical solution, the subtitle function can be directly turned on by operating the first interface. When the subtitle function is turned on, the first subtitle information will be displayed in the non-playing area of ​​the second interface, so that users can understand more text information related to the multimedia content.

[0012] In some embodiments, the first operation is a sliding operation on the first interface.

[0013] In the above technical solution, the subtitle function can be quickly turned on by performing a sliding operation on the first interface, which improves the efficiency and operational convenience of turning on the subtitle function and simplifies the user operation process.

[0014] In some embodiments, the first interface includes a subtitle control in a closed state, and the first operation is an opening operation for the subtitle control in the closed state.

[0015] In the above technical solution, the subtitle function can be quickly turned on by opening the subtitle control of the first interface, which is convenient for the user to control and operate the turning on and off of the subtitle function.

[0016] In some embodiments, in a first direction, a size of the non-playback area of ​​the second interface is larger than a size of a playback screen of the multimedia content in the second interface, and the first direction is a width direction of the playback screen.

[0017] In the above technical solution, since the width of the non-playing area for displaying text information in the second interface is greater than the width of the playing area, more text can be displayed without changing the text size, so that the non-playing area can display more subtitles and / or barrages in the width direction of the interface, and display subtitles and / or barrage information more clearly, effectively improving the user experience of reading text information.

[0018] In some embodiments, the first function further includes a bullet screen function, the text information further includes the bullet screen information, and after displaying the first subtitle information for the multimedia content in the non-playing area of ​​the second interface in response to the first operation on the first interface, the method further includes:

[0019] In response to the operation of turning on the barrage function, the barrage information and second subtitle information are displayed in a non-playing area of ​​the third interface, and the second subtitle information includes the target subtitle.

[0020] In the above technical solution, the barrage function is turned on by operation. When the barrage function is turned on, the barrage information will be automatically displayed in the non-playing area of ​​the third interface. At the same time, the target subtitles can be displayed synchronously with the current playing content of the multimedia content, so that users can watch the barrage and target subtitles at the same time through the third interface, thereby improving the user experience in the video listening mode.

[0021] In some embodiments, the operation of turning on the barrage function is a sliding operation on the second interface.

[0022] In the above technical solution, when the user watches subtitles through the second interface, he can also further enable the barrage function by sliding the second interface, which improves the efficiency and convenience of enabling the barrage function, enhances the interactivity and continuity of interaction with the user, and reduces the complexity of user operations.

[0023] In some embodiments, before displaying the barrage information and the second subtitle information in the non-playing area of ​​the third interface in response to the operation of enabling the barrage function, the method further includes:

[0024] In response to an operation on the second interface, displaying third subtitle information in a non-playing area of ​​a fourth interface, the third subtitle information including the target subtitle and the first subtitle, the first subtitle and the target subtitle being subtitles corresponding to at least part of the audio of the multimedia content;

[0025] And, in response to the operation of turning on the bullet screen function, displaying the bullet screen information and the second subtitle information in the non-playing area of ​​the third interface includes:

[0026] In response to the operation on the fourth interface, the barrage information and the second subtitle information are displayed in the non-playing area of ​​the third interface.

[0027] In the above technical solution, when the user watches the target subtitles displayed synchronously with the currently playing content of the multimedia content through the second interface, he can also switch to the fourth interface by operating the second interface, and display more subtitles through the fourth interface, providing the user with richer subtitle choices.

[0028] In some embodiments, the non-playback area of ​​the third interface includes a bullet screen area and a subtitle area, and the playback area, the bullet screen area and the subtitle area of ​​the third interface are arranged in sequence along the height direction of the third interface.

[0029] In the above technical solution, starting from the user's viewing habits, by setting the playback area, barrage area and subtitle area in the third interface from top to bottom, not only the aesthetics of the third interface layout is optimized, but also the user's viewing experience when watching multimedia playback content, barrage and subtitles at the same time is improved.

[0030] In some embodiments, the first subtitle information further includes a first subtitle, and the first subtitle and the target subtitle are subtitles corresponding to at least a portion of the audio of the multimedia content.

[0031] In the above technical solution, by displaying more subtitles related to multimedia content in the second interface, users can view more text information in the second interface, thereby improving the diversity and amount of information displayed in the first subtitle information in the second interface, and helping users understand multimedia content through more subtitles.

[0032] In some embodiments, the first function includes a bullet screen function, and the text information includes the bullet screen information; and in response to the operation of starting the first function, displaying the text information for the multimedia content in the non-playing area of ​​the second interface includes:

[0033] In response to a second operation on the first interface, the bullet screen information for the multimedia content is displayed in a non-playing area of ​​the second interface.

[0034] In the above technical solution, the barrage function can be turned on by operating the first interface. When the barrage function is turned on, the barrage information will be displayed in the non-playing area of ​​the second interface, so that users can understand more text information related to the multimedia content, thereby improving the user experience in the video listening mode.

[0035] In some embodiments, the second operation is a sliding operation on the first interface.

[0036] In the above technical solution, the barrage function can be quickly turned on by performing a sliding operation on the first interface, which improves the efficiency and operational convenience of turning on the barrage function and simplifies the user operation process.

[0037] In some embodiments, the first interface includes a bullet screen control in a closed state, and the second operation is an opening operation for the bullet screen control in the closed state.

[0038] In the above technical solution, the barrage function can be quickly turned on by opening the barrage control of the first interface, which is convenient for users to control and operate the turning on and off of the barrage function.

[0039] In some embodiments, the first function includes a subtitle function and a bullet screen function, the text information includes the first subtitle information and the bullet screen information; and the displaying of the text information for the multimedia content in the non-playing area of ​​the second interface in response to the operation of enabling the first function includes:

[0040] In response to an operation on the first interface, displaying the first subtitle information for the multimedia content in a non-playing area of ​​the fifth interface;

[0041] In response to the operation on the fifth interface, the bullet screen information for the multimedia content is displayed in the non-playing area of ​​the second interface.

[0042] In the above technical solution, by operating the first interface, you can switch to the fifth interface (an interface before the second interface), so that only subtitles are displayed on the fifth interface; and then by operating the fifth interface, you can switch to the second interface, so that only bullet comments are displayed on the second interface. This method of displaying subtitles or bullet comments separately on different interfaces improves the simplicity of interface display, so that users can more clearly view the subtitles or bullet comments displayed on the corresponding interface when browsing each interface without being disturbed by other text information.

[0043] In some embodiments, after displaying text information for the multimedia content in the non-playing area of ​​the second interface in response to the operation of starting the first function, the method further includes:

[0044] In response to the operation of exiting the video listening mode, the multimedia content is played in full screen on the sixth interface.

[0045] In the above technical solution, when a user exits the listening to video mode while watching a certain multimedia content, the multimedia content will be played in full screen on the new sixth interface, so that the user can continue to watch the multimedia content, and playing the multimedia content in full screen on the sixth interface can better enhance the user's viewing experience.

[0046] An embodiment of the present application provides an interface display device, including:

[0047] A first display module, used to play multimedia content in a play area of ​​a first interface in an audio-video mode, wherein the size of the play area is smaller than the size of the first interface;

[0048] A second display module is used to display text information for the multimedia content in a non-playing area of ​​a second interface in response to an operation of starting the first function, wherein the text information corresponds to the first function, and the text information includes first subtitle information and / or barrage information, and the first subtitle information includes a target subtitle displayed synchronously with the current playing content of the multimedia content.

[0049] An electronic device provided in an embodiment of the present application includes a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, the method described in the embodiment of the present application is implemented.

[0050] The computer-readable storage medium provided in the embodiment of the present application stores a computer program thereon, and when the computer program is executed by a processor, the method described in the embodiment of the present application is implemented.

[0051] The computer program product provided in the embodiments of the present application includes a computer program, and when the computer program is executed by a processor, the method described in the embodiments of the present application is implemented. BRIEF DESCRIPTION OF THE DRAWINGS

[0052] The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present application and are used together with the specification to illustrate the technical solution of the present application.

[0053] Figure 1 It is a schematic diagram of an application scenario disclosed in an embodiment of the present application;

[0054] Figure 2 It is a flowchart of a method for interface display disclosed in an embodiment of the present application;

[0055] Figure 3 is a schematic diagram of a first interface in an audio-video mode disclosed in an embodiment of the present application;

[0056] Figure 4A is a schematic diagram of entering a listening and video mode disclosed in an embodiment of the present application;

[0057] Figure 4B It is another schematic diagram of entering the listening and video mode disclosed in the embodiment of the present application;

[0058] Figure 5Ais a schematic diagram of displaying first subtitle information on a second interface through a sliding operation disclosed in an embodiment of the present application;

[0059] Figure 5B is another schematic diagram of displaying first subtitle information on a second interface through a sliding operation disclosed in an embodiment of the present application;

[0060] Figure 5C This is a schematic diagram of displaying first subtitle information on a second interface by opening a subtitle control disclosed in an embodiment of the present application;

[0061] Figure 5D It is another schematic diagram disclosed in an embodiment of the present application for displaying first subtitle information on a second interface by opening a subtitle control;

[0062] Fig. 6A This is a schematic diagram of displaying bullet message information on a second interface through a sliding operation disclosed in an embodiment of the present application;

[0063] Figure 6B This is a schematic diagram of displaying bullet screen information on a second interface by opening a bullet screen control, as disclosed in an embodiment of the present application;

[0064] Figure 6C This is a schematic diagram of displaying first subtitle information on a fifth interface and displaying bullet screen information on a second interface through a sliding operation disclosed in an embodiment of the present application;

[0065] Fig. 7A This is a schematic diagram of displaying first subtitle information and bullet screen information on a second interface through a sliding operation disclosed in an embodiment of the present application;

[0066] Figure 7B This is another schematic diagram of displaying first subtitle information and bullet screen information on a second interface through a sliding operation disclosed in an embodiment of the present application;

[0067] Figure 8 It is a flowchart of another method for displaying an interface disclosed in an embodiment of the present application;

[0068] Fig. 9A This is a schematic diagram of displaying bullet screen information and second subtitle information on a third interface through a sliding operation disclosed in an embodiment of the present application;

[0069] Fig. 9B This is another schematic diagram disclosed in an embodiment of the present application of displaying bullet screen information and second subtitle information on a third interface by opening a subtitle control and performing a sliding operation;

[0070] Fig. 9C This is a schematic diagram of displaying third subtitle information on a fourth interface through a sliding operation disclosed in an embodiment of the present application;

[0071] Fig. 10A It is a schematic diagram of a sixth interface after exiting the listening and video mode disclosed in an embodiment of the present application;

[0072] Fig. 10B It is a schematic diagram of a seventh interface after exiting a video application disclosed in an embodiment of the present application;

[0073] Fig.11 It is a structural schematic diagram of an interface display device disclosed in an embodiment of the present application;

[0074] Fig.12 It is a structural schematic diagram of an electronic device disclosed in an embodiment of the present application. DETAILED DESCRIPTION

[0075] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the specific technical solution of the present application will be further described in detail below in conjunction with the drawings in the embodiments of the present application. The following embodiments are used to illustrate the present application, but are not used to limit the scope of the present application.

[0076] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.

[0077] In the following description, reference is made to “some embodiments”, which describe a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0078] It should be pointed out that the terms "first\second\third" involved in the embodiments of the present application are used to distinguish similar or different objects, and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged in a specific order or sequence where permitted, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.

[0079] The following is an introduction to the scenarios and some concepts involved in the embodiments of the present application.

[0080] In order to more clearly introduce the interface display method disclosed in the embodiment of the present application, the application scenarios applicable to the method are first introduced. Optionally, the method can be applied to electronic devices, including but not limited to: portable electronic devices such as mobile phones and tablets, wearable devices such as smart watches and smart bracelets, desktop devices such as desktop computers and televisions, and in-vehicle terminals and other devices, which are not limited here. For example, please refer to Figure 1 , Figure 1is a schematic diagram of an application scenario disclosed in an embodiment of the present application. Optionally, the method can be applied to the process in which the user 110 uses the electronic device 120. It should be noted that: Figure 1 The illustration using a "mobile phone" as an example is merely an optional implementation and should not constitute a limitation on the embodiments of the present application.

[0081] The interface display method disclosed in the embodiment of the present application can be specifically applied to the process of an electronic device running a target application to play multimedia content. Optionally, the target application may include various video applications, audio and video applications, shopping applications, or social applications, etc., which are not limited here. This application will take a video application as an example to explain the purpose and technical solution of this application in detail.

[0082] The multimedia content may be a video type work, a picture type work, an audio type work, a work combining video type and picture type, a work combining audio type and picture type, a work combining video type and audio type, a work combining video type, picture type and audio type, etc. It should be noted that the types of multimedia content are not specifically limited in the embodiments of the present application, but the multimedia content in the present application includes audio information, such as live broadcast, television, movies, music, etc.

[0083] The interface display method disclosed in the embodiment of the present application can be specifically applied to the process of playing multimedia content in the listening and video mode in a video application. Some current video applications support the playing of multimedia content in the listening and video mode.

[0084] Take the example of a user watching a video using a video application. When the user is in the normal playback mode, the user watches the video with his eyes. However, when the user feels tired and does not want to watch with his eyes, but does not want to pause the video, he can switch the normal playback mode of the video to the listening video mode. In the listening video mode, the user's main purpose is to "listen" to the video, and by "listening", he can understand the content of the video. In addition, in the listening video mode, the video can also be played in the background.

[0085] In the related technologies of the listening video mode, since the main purpose of the user in the listening video mode is to "listen", the playback area for playing videos in the listening video mode is usually set to be smaller (the display mode of the video in the video application in the conventional playback mode is usually full-screen), so that compared with the full-screen playback of multimedia content in the conventional mode, the playback screen of the video in the listening video mode will become smaller. In practice, it is found that in the listening video mode, users also have the need to understand the video content by watching subtitles or bullet screens, so this way of setting the playback area in the listening video mode will have the problem of limiting the display of text information related to the multimedia content, such as subtitles and / or bullet screens, which will affect the user experience of the user in the listening video mode.

[0086] On the one hand, when a video includes subtitles made by the creator, when a user wants to understand the content of the video by watching the subtitles in the video, the video playback screen will become smaller in the listening video mode, and the subtitles are usually located below the video playback screen. Therefore, displaying relevant text information on the reduced playback screen will cause the size of the subtitles and / or barrage text displayed in the video to also become smaller, resulting in a poor experience for users when watching the subtitles, or even making it difficult for users to see the subtitles clearly.

[0087] On the other hand, when the video does not include subtitles, since the relevant technology does not automatically generate subtitles corresponding to the video in the listening video mode, if the user is in a noisy environment or the user is performing other tasks, he may not be able to concentrate on "listening" to the video. When the user wants to understand the playback content by watching the subtitles, the playback screen of the video in the listening video mode is smaller than that in the normal mode, and the video-related subtitles and other text information are not displayed in the listening video mode, the user's viewing experience in the listening video mode is not good and the user cannot accurately understand the video content.

[0088] Even for some non-native users, that is, when the audio information of the video is not in the user's native language, if the video does not include subtitles and the user is in a noisy environment, when the user wants to understand the playback content by watching the subtitles in the listening video mode, it is difficult to help the non-native user understand the video content in the listening video mode, thereby reducing the viewing experience of the non-native user in the listening video mode.

[0089] In addition, when users use video applications to watch videos, they usually interact by posting comments, bullet screens, etc. In the related art, the display of comments, bullet screens, etc. is not supported in the listening video mode. When the user wants to know the comments, bullet screens, etc. while "listening" to the video in the listening video mode, he can only exit the listening video mode and watch the comments, bullet screens, etc. in the regular playback mode, which undoubtedly increases the user's operations and reduces the user's viewing experience in the listening video mode.

[0090] In view of this, the embodiments of the present application provide a method and device for interface display, an electronic device, and a storage medium. When a user wants to understand the text information of multimedia content such as subtitles and / or bullet screens in the listening video mode, the user can switch to the second interface of the listening video mode by turning on the function of subtitles and / or bullet screens (such as the first function), and generate and display text information related to the multimedia content in the non-playing area of ​​the second interface. Compared with the prior art solution of displaying text information on a reduced playback screen or not displaying text information, resulting in a poor user experience, in the technical solution of the present application, text information for multimedia content is displayed in the non-playing area based on user operation in the listening video mode. Since the non-playing area is conducive to providing more space to display text information, the displayed text information can be made larger, so that the user can see clearer text information, thereby improving the user experience in the listening video mode.

[0091] In order to make the purpose and technical solution of the present application clearer and more intuitive, a method for interface display disclosed in the present application is described in detail below with reference to the accompanying drawings.

[0092] See also Figure 2 , Figure 2 Schematic diagram of a method for displaying an interface disclosed in an embodiment of the present application. Figure 2 The method shown may include the following steps:

[0093] Step 210: Play the multimedia content in the play area of ​​the first interface in the audio-video mode, and the size of the play area is smaller than the size of the first interface.

[0094] The interface in the embodiments of the present application may also be referred to as a user interface (UI), which is a medium interface for interaction and information exchange between an application or operating system and a user, and which implements conversion between the internal form of information and a form acceptable to the user.

[0095] In an embodiment of the present application, the first interface refers to an interface in the video listening mode in the video application. When the video listening mode is entered, the first interface is displayed, and the first interface includes a playback area of ​​the first interface and a non-playback area of ​​the first interface. The playback area of ​​the first interface is used to play multimedia content, such as short videos, pictures, and other content. The non-playback area of ​​the first interface is used to display a control that triggers at least one function of the multimedia content, and text information of the multimedia content, and the text information includes first subtitle information and / or barrage information.

[0096] The control in the embodiments of the present application is also called a widget, which is a basic element of the user interface. Typical controls include toolbars, menu bars, text boxes, buttons, scroll bars, pictures and text. Among them, controls can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets and other visual interface elements.

[0097] Optionally, since the main purpose of the user in the listening video mode is to "listen", and in order to set a control on the first interface to trigger at least one function of the multimedia content, the size of the play area of ​​the first interface can be set to be smaller than the size of the first interface, so as to facilitate setting controls in the non-play area of ​​the first interface to control the played multimedia content through the controls. It should be understood that since the size of the play area of ​​the first interface in the listening video mode is smaller than the size of the first interface, the play screen of the multimedia content played in the play area of ​​the first interface in the listening video mode is in a non-full screen display state.

[0098] For example, see Figure 3 , Figure 3 is a schematic diagram of a first interface in a listening and video mode disclosed in an embodiment of the present application. Figure 3 The first interface shown is an interface in the listening and video mode. In the listening and video mode, the first interface plays multimedia content of any user X, wherein the first interface includes a playback area 310, and the playback area 310 is the area where the playback screen of the multimedia content is located; wherein the first interface also includes a non-playback area 320, and the non-playback area 320 is provided with controls such as like, comment, favorite, share, display playback progress, loop playback, adjust playback speed, pause playback, restart playback, timed playback, play list, and frequently listened list (shown in the figure as My Frequently Listened), which are not limited here.

[0099] It should be noted that the present application does not limit the position of the playback area of ​​the first interface in the first interface, and the position of the non-playback area of ​​the first interface in the first interface. For example, the playback area of ​​the first interface can be set at the top of the first interface, and the non-playback area of ​​the first interface can be set below the playback area of ​​the first interface.

[0100] In the embodiment of the present application, the multimedia content is played through a video application. Before playing the multimedia content in the playback area of ​​the first interface in the listening video mode, it is necessary to enter the listening video mode of the video application.

[0101] As an optional implementation, before playing multimedia content in the playback area of ​​the first interface in the listening to video mode, it may also include: in response to the operation of starting the video application, displaying the home page interface of the video application, the home page interface including at least one multimedia content; in response to a click operation on one of the at least one multimedia content, displaying the playback interface of the multimedia content, and playing the multimedia content in full screen in the playback interface; in response to a long press operation on the playback interface, displaying a tool selection interface corresponding to the multimedia content, wherein the tool selection interface includes a control corresponding to the listening to video mode; in response to a click operation on the control corresponding to the listening to video mode, playing the multimedia content in the playback area of ​​the first interface in the listening to video mode.

[0102] For example, see Figure 4A , Figure 4A is a schematic diagram of entering the audio and video mode disclosed in the embodiment of the present application. Figure 4A (a) in the figure is the home page interface of the video application. Figure 4A As shown in (a), the home page interface of the video application can display one or more multimedia content playback screens and one or more function controls, which are not limited here. Figure 4A (b) in FIG. 1 is a playback interface for playing multimedia content in full screen, such as Figure 4A As shown in (b) of FIG. 1 , the full-screen multimedia content playback interface can play the multimedia content in full screen and display one or more function controls, which are not limited here. For example, when a user wants to watch Figure 4A When user 1 is viewing multimedia content in (a), he can click on the playback screen 1 to switch to the following Figure 4A The interface shown in (b) makes Figure 4A In (b), the multimedia content of user 1 is played in full screen.

[0103] It should be noted that functional controls are controls used to enable users to trigger various functions, including but not limited to Figure 4A The example video app "Home" "Home" "Home Control", the video app "Featured Control" "Featured Function" and so on. Figure 4A The number and types of functional controls shown in the figure should not constitute a limitation on the embodiments of the present application.

[0104] Further, Figure 4A (c) in FIG. 1 is a tool selection interface corresponding to multimedia content, such as Figure 4A As shown in (c), one or more function controls may be displayed in the tool selection interface corresponding to the multimedia content, wherein the function controls include controls corresponding to the audio and video mode, which is not limited here. Figure 4A (d) in the figure is the first interface of the audio and video mode. Figure 4AAs shown in (d), the first interface of the audio and video mode can play the multimedia content of user 1 and display one or more function controls related to the audio and video mode, which are not limited here. Figure 4A When the playback interface 1 of the multimedia content of user 1 is played in full screen as shown in (b) of FIG. 1 , if the user wants to enter the listening video mode to play the multimedia content of user 1, the user can switch to the listening video mode by long pressing the playback interface 1. Figure 4A The interface shown in (c) in the figure, Figure 4A In (c), the tool selection interface corresponding to the multimedia content of user 1 can be displayed, and then the control corresponding to the listening video mode can be clicked to switch to the following mode: Figure 4A The interface shown in (d) in the figure enters the first interface of the listening and video mode, and plays the multimedia content of user 1 in the listening and video mode.

[0105] In this implementation, when a user uses a video application to play multimedia content in full screen, the user can perform a "long press operation" on the play interface, and further perform an "operation of clicking the control corresponding to the video listening mode" on the pop-up tool selection interface to enter the video listening mode. This method can be applicable to the case where a user uses a video application to play any multimedia content in full screen mode. The user only needs to perform a corresponding operation on the full screen play interface of any multimedia content to enter the video listening mode, and the user does not need to exit the full screen play interface of the multimedia content, thereby improving the convenience of operation.

[0106] As another optional implementation, before playing multimedia content in the playback area of ​​the first interface in the listening to video mode, it may also include: in response to the operation of starting the video application, displaying the home page interface of the video application, the home page interface including at least one multimedia content and a tool control; in response to a click operation on the tool control, displaying the tool selection interface corresponding to the video application, wherein the tool selection interface corresponding to the video application includes a control corresponding to the listening to video mode; in response to a click operation on the control corresponding to the listening to video mode, playing the multimedia content in the playback area of ​​the first interface in the listening to video mode.

[0107] For example, see Figure 4B , Figure 4B is another schematic diagram of entering the audio and video mode disclosed in the embodiment of the present application. Figure 4B (a) in the figure is the home page interface of the video application. Figure 4B As shown in (a), the home page interface of the video application can display one or more multimedia content playback screens and one or more function controls, and the function controls include a tool control 410 located in the upper left corner, which is not limited here. Figure 4B (b) in the figure is the tool selection interface corresponding to the video application, such as Figure 4BAs shown in (b), one or more function controls may be displayed in the tool selection interface corresponding to the video application, which is not limited here. Figure 4B (c) in the figure is the first interface of the audio and video mode. Figure 4B As shown in (c) of FIG. 1 , the first interface of the audio and video mode can play multimedia content of any user X and display one or more function controls related to the audio and video mode, which are not limited here. For example, when a user wants to enter the audio and video mode of a video application to play selected multimedia content, he can switch to the following by clicking the tool control 410: Figure 4B Then click the control corresponding to the video listening mode to switch to the interface shown in (b) Figure 4B The interface shown in (c) in the figure enters the first interface of the listening and video mode, and plays the multimedia content of any user X in the selected multimedia content in the listening and video mode.

[0108] In this implementation, if the user does not select to play a certain multimedia content by clicking on the home page interface of the video application, the user can perform the "click tool control operation" on the home page interface of the video application, and further perform the "click the control operation corresponding to the listening video mode" on the tool selection interface corresponding to the pop-up video application to enter the listening video mode. This method can be applied to the case where the user does not select to play a certain multimedia content on the home page interface of the video application. The user only needs to perform the corresponding operation on the home page interface of the video application to enter the listening video mode. The user does not need to enter a certain multimedia content separately and then operate to enter the listening video mode, which improves the convenience of operation.

[0109] Step 220, in response to the operation of starting the first function, text information for the multimedia content is displayed in the non-playing area of ​​the second interface, wherein the text information corresponds to the first function, the text information includes first subtitle information and / or barrage information, and the first subtitle information includes target subtitles displayed synchronously with the current playing content of the multimedia content.

[0110] In some implementations, the first function includes a subtitle function. When the subtitle function is turned on, first subtitle information corresponding to the multimedia content is automatically generated in the video listening mode.

[0111] Optionally, the first subtitle information of the multimedia content is obtained by identifying audio information of the multimedia content.

[0112] Optionally, the audio information of the multimedia content may be recognized by AI recognition technology to automatically generate first subtitle information of the multimedia content.

[0113] For example, when a user uses a video application to play a video introducing an air conditioner function in the listening video mode, the audio information of the video content can be recognized by AI recognition technology, and the first subtitle information of the video content can be automatically generated. If the audio information of the video content includes "In this hot summer, it is crucial to keep cool. Our smart air conditioner is equipped with a remote control. You can easily control the temperature through the temperature adjustment button on the remote control. Just one click can adjust to your ideal temperature. Our smart air conditioner also has a sleep mode to provide the most comfortable environment for your night", then the first subtitle information generated is "In this hot summer, it is crucial to keep cool. Our smart air conditioner is equipped with a remote control. You can easily control the temperature through the temperature adjustment button on the remote control. Just one click can adjust to your ideal temperature. Our smart air conditioner also has a sleep mode to provide the most comfortable environment for your night".

[0114] In this implementation, subtitles can be automatically generated based on the audio information of the multimedia content, which is particularly suitable for scenarios where there are no subtitles in the multimedia content. Compared with the prior art method of generating subtitles through documents uploaded by the creator, and not displaying subtitles when the creator has not uploaded the document, this solution not only does not require the user to manually upload the document, but can also automatically generate subtitles, thereby improving the user's viewing experience in the video listening mode.

[0115] Optionally, in the case where the multimedia content includes original subtitles, the first subtitle information of the multimedia content can also be obtained by identifying the original subtitles. It should be noted that the original subtitles can be subtitles uploaded by the creator during the production process of the multimedia content. When the creator has uploaded subtitles during the production process of the multimedia content, the original subtitles are displayed in the playback area of ​​the first interface of the video listening mode.

[0116] Furthermore, after the first subtitle information corresponding to the multimedia content is automatically generated in the video listening mode, the automatically generated first subtitle information can be displayed in the non-playing area of ​​the second interface. This can effectively improve the viewing experience of the user when the multimedia content is played in the video listening mode, even if there are no subtitles in the playback screen of the multimedia content or the subtitles in the playback screen are not displayed clearly, the viewing experience of the user can still be improved.

[0117] Optionally, the first subtitle information of the multimedia content displayed in the non-playing area of ​​the second interface includes target subtitles that are displayed synchronously with the current playing content of the multimedia content. It should be understood that the first subtitle information usually includes multiple subtitles, each subtitle corresponds to information of a different audio segment in the multimedia content, and the display progress of each subtitle is synchronized with the playing progress of each audio segment in the multimedia content, that is, each subtitle can usually be understood as a "sentence" obtained by grammatical segmentation. When the current playing content of the multimedia content plays a certain target audio, the subtitle corresponding to the target audio is the target subtitle.

[0118] It should be noted that the number of subtitles in the first subtitle information corresponding to the multimedia content is positively correlated with the audio information of the multimedia content. The more audio information, the more subtitles in the first subtitle information. In order to simplify the display content of the non-playing area of ​​the second interface, when there are many subtitles but the size of the non-playing area of ​​the second interface is limited, it can be set to display only the target subtitles corresponding to the current playing content of the multimedia content in the non-playing area of ​​the second interface.

[0119] For example, when a user uses a video application to play a video introducing a function of an air conditioner in listening mode, when the audio information corresponding to the currently playing content of the multimedia content is "Our smart air conditioner also has a sleep mode", then the corresponding target subtitle "Our smart air conditioner also has a sleep mode" will be displayed in the non-playing area of ​​the second interface.

[0120] In some embodiments, the first function further includes a bullet screen function, and when the bullet screen function is turned on, bullet screen information corresponding to the multimedia content is automatically displayed in the video listening mode. Optionally, the bullet screen information can be text information that any user customizes and uploads through the bullet screen control in the non-audio video mode when watching multimedia content in the non-audio video mode.

[0121] Optionally, the bullet screen information can be text information that any user customizes and uploads through the bullet screen control in the listening video mode when watching multimedia content in the listening video mode. This application does not limit the method for obtaining the bullet screen information corresponding to the multimedia content.

[0122] Optionally, automatically displaying the bullet screen information corresponding to the multimedia content in the video listening mode may include displaying the bullet screen information corresponding to the multimedia content in a non-playing area of ​​the second interface.

[0123] In the embodiment of the present application, the text information and the first function are in a one-to-one correspondence, the text information includes the first subtitle information and / or the bullet screen information, and the first function includes the subtitle function and / or the bullet screen function. Specifically, the correspondence between the text information and the first function may include the following three situations:

[0124] Case 1: When the first function includes a subtitle function, text information including first subtitle information for multimedia content is displayed in the non-playing area of ​​the second interface. In this case, it means that when the subtitle function is turned on, subtitles can be displayed.

[0125] Case 2: When the first function includes the bullet screen function, text information including bullet screen information for multimedia content is displayed in the non-playing area of ​​the second interface. In this case, it means that when the bullet screen function is turned on, the bullet screen can be displayed.

[0126] Case 3: When the first function includes the subtitle function and the bullet screen function, the text information for the multimedia content displayed in the non-playing area of ​​the second interface includes the first subtitle information and the bullet screen information. In this case, it means that when the subtitle function and the bullet screen function are turned on at the same time, the subtitle and the bullet screen can be displayed.

[0127] The following will explain the above three situations in detail.

[0128] In some implementations, for case 1 where the text information corresponds to the first function, that is, when the first function includes a subtitle function and the text information includes first subtitle information, in response to the operation of turning on the first function in step 220, displaying text information for the multimedia content in the non-playing area of ​​the second interface includes: displaying the first subtitle information for the multimedia content in the non-playing area of ​​the second interface in response to the first operation on the first interface. In this implementation, the subtitle function can be directly turned on by operating the first interface, and when the subtitle function is turned on, the first subtitle information will be automatically displayed in the non-playing area of ​​the second interface, so that the user can learn more text information related to the multimedia content.

[0129] In some implementations, the first operation on the first interface may include the following two operation modes:

[0130] Mode 1: The first operation on the first interface is a sliding operation on the first interface. It should be understood that the user can perform a sliding operation on the first interface, thereby switching to the second interface, and the first subtitle information of the multimedia content is displayed in the non-playing area of ​​the second interface. In Mode 1, the subtitle function can be quickly turned on by performing a sliding operation on the first interface, which improves the efficiency and convenience of turning on the subtitle function, and simplifies the user operation process.

[0131] Optionally, in method 1, the user can perform a sliding operation on the first interface by sliding the first interface with a finger, using a stylus pen to slide the first interface, etc. The present application does not limit the specific method of performing the sliding operation.

[0132] Optionally, the sliding operation on the first interface in mode 1 is a horizontal sliding operation. In this optional implementation, the horizontal sliding operation is adapted to the user's operating habits, can effectively improve the convenience of operation, and reduce the complexity of user operation.

[0133] For example, see Figure 5A , Figure 5A This is a schematic diagram of displaying first subtitle information on a second interface through a sliding operation disclosed in an embodiment of the present application, wherein the first subtitle information includes a target subtitle. Figure 5A (a) in the figure is the first interface in the listening and video mode. The user can slide on the first interface in the direction of the gesture sliding (left) as shown in the figure, thereby Figure 5A (a) in the switch to Figure 5A (b) in the above equation. Figure 5A (b) is the second interface in the audio and video mode. Figure 5A The second interface shown in (b) includes a playback area 510 of the second interface and a non-playback area 520 of the second interface. The non-playback area 520 of the second interface displays first subtitle information 521 of the multimedia content. The first subtitle information 521 is the target subtitle displayed synchronously with the current playback content of the multimedia content.

[0134] In some embodiments, the first subtitle information of the multimedia content displayed in the non-playing area of ​​the second interface may include a target subtitle displayed synchronously with the current playing content of the multimedia content, and a first subtitle, wherein the first subtitle and the target subtitle are subtitles corresponding to at least part of the audio of the multimedia content. The first subtitle is a subtitle that is adjacent to the target subtitle in front and behind the subtitle corresponding to at least part of the audio. It should be understood that in the case where the first subtitle information of the multimedia content displayed in the non-playing area of ​​the second interface can also include the first subtitle, the first subtitle information of the multimedia content displayed in the non-playing area of ​​the second interface includes the first subtitle, and the target subtitle displayed synchronously with the current playing content of the multimedia content. In this embodiment, by displaying more subtitles related to the multimedia content in the second interface, the user can view more text information in the second interface, thereby increasing the diversity and amount of information displayed by the first subtitle information in the second interface, and helping the user understand the multimedia content through more subtitles.

[0135] It should be noted that in order to allow users to watch more subtitles corresponding to multimedia content in the video listening mode, and considering the limited size of the non-playing area of ​​the second interface, the subtitles corresponding to at least part of the audio of the multimedia content can be displayed in the non-playing area of ​​the second interface.

[0136] For example, when a user uses a video application to play a video introducing an air conditioner function in audio-visual mode, the first subtitle of the video content is "Keeping cool is crucial in this hot summer. Our smart air conditioner is equipped with a remote control. You can easily control the temperature through the temperature adjustment button on the remote control. With just a touch, you can adjust to your ideal temperature. Our smart air conditioner also has a sleep mode, providing the most comfortable environment for your night." If the video plays to the content corresponding to "Our smart air conditioner also has a sleep mode," in addition to displaying the target subtitle "Our smart air conditioner also has a sleep mode" in the non-playback area of ​​the second interface, the first subtitles adjacent to the target subtitles can also be displayed, "You can easily control the temperature through the temperature adjustment button on the remote control. With just a touch, you can adjust to your ideal temperature," and "Provide the most comfortable environment for your night."

[0137] Optionally, the amount of first subtitle information displayed in the non-playing area of ​​the second interface is related to the size of the non-playing area of ​​the second interface and the size of the first subtitle information. It should be understood that when the size of the first subtitle information is a fixed value, the larger the size of the non-playing area of ​​the second interface, the more first subtitle information is displayed.

[0138] For example, when a user uses a video application to play a video introducing an air conditioner function in listening mode, the first subtitle information of the video content is "In this hot summer, keeping cool is crucial. Our smart air conditioner is equipped with a remote control. You can easily control the temperature through the temperature adjustment button on the remote control. With just a touch, you can adjust it to your ideal temperature. Our smart air conditioner also has a sleep mode to provide the most comfortable environment for your night." When the size of the non-playing area of ​​the second interface can only display 4 subtitles (which can be understood as 4 sentences), and the target subtitle is "Our smart air conditioner also has a sleep mode", the first subtitle information displayed in the non-playing area of ​​the second interface includes "With just a touch, you can adjust it to your ideal temperature. Our smart air conditioner also has a sleep mode to provide the most comfortable environment for your night", among which "With just a touch, you can adjust it to your ideal temperature to provide the most comfortable environment for your night" is the first subtitle.

[0139] Optionally, the display state of the target subtitle is different from the display state of the first subtitle. In this optional implementation, by setting the display states of the target subtitle and the first subtitle differently, the user is helped to timely and accurately understand the target subtitle displayed synchronously with the current playing content of the multimedia content when watching the first subtitle information.

[0140] Optionally, the display state of the target subtitle may include at least one of enlarged display, bold display, color marking, and background marking. It should be understood that in order to make the display state of the target subtitle different from the display state of the first subtitle, the display state of the first subtitle may be set to a default initial state, and the initial state may be set by those skilled in the art according to actual conditions, and this application does not limit this.

[0141] For example, see Figure 5B , Figure 5B is another schematic diagram of displaying first subtitle information on the second interface through a sliding operation disclosed in an embodiment of the present application, wherein the first subtitle information includes a first subtitle and a target subtitle. Figure 5B (a) in the figure is the first interface in the listening and video mode. The user can slide on the first interface in the direction of the gesture sliding (left) as shown in the figure, thereby Figure 5B (a) in the switch to Figure 5B (b) in the above equation. Figure 5B (b) is the second interface in the audio and video mode. Figure 5B The second interface shown in (b) includes a playback area of ​​the second interface and a non-playback area of ​​the second interface. The non-playback area of ​​the second interface displays first subtitle information 522 of the multimedia content. The first subtitle information 522 includes a target subtitle (such as a subtitle 222) that is synchronously displayed with the current playback content of the multimedia content. Figure 5B The target subtitle is in bold as shown in (b) of FIG. 1 ), and the first subtitle (as shown in FIG. 1 ) Figure 5B The first subtitle shown in (b) is in a non-bold state), so that the user can intuitively see the target subtitle and the first subtitle of the multimedia content by performing a sliding operation on the first interface.

[0142] Mode 2: When the first interface includes a subtitle control in a closed state, the first operation on the first interface is an opening operation on the subtitle control in a closed state. It should be understood that the user can open the subtitle control on the first interface, so as to display the first subtitle information of the multimedia content in the non-playing area of ​​the second interface. In this mode 2, the subtitle function can be quickly turned on by opening the subtitle control on the first interface, which is convenient for the user to control and operate the opening and closing of the subtitle function.

[0143] Optionally, the playback area of ​​the first interface in mode 2 includes a subtitle control. In this optional implementation, the subtitle control is integrated into the playback area of ​​the first interface, which improves the compactness and aesthetics of the control setting in the first interface.

[0144] For example, see Figure 5C , Figure 5CThe embodiment of the present application discloses a schematic diagram of displaying first subtitle information on a second interface by opening a subtitle control, wherein the first subtitle information includes a target subtitle. Figure 5C (a) is the first interface in the audio-video mode, the first interface includes a first interface play area 530, the first interface play area 530 is provided with a subtitle control 531, and the subtitle control 531 can be used to control whether to display the target subtitle in the non-play area of ​​the second interface in the audio-video mode. Figure 5C As shown in (a) in FIG. 1 , the subtitle control 531 is in a closed state, and the user can press Figure 5C The gesture shown in (a) in FIG. 10 clicks the closed subtitle control 531, thereby opening the subtitle control 531 and turning on the subtitle function, so that Figure 5C (a) in the switch to Figure 5C (b) in the above equation. Figure 5C (b) is the second interface in the audio and video mode. Figure 5C The non-playing area of ​​the second interface shown in (b) displays first subtitle information 521 of the multimedia content, and the first subtitle information 521 is the target subtitle displayed synchronously with the current playing content of the multimedia content.

[0145] In some embodiments, the size of the playback screen of the multimedia content of the second interface is smaller than the size of the playback screen of the multimedia content of the first interface. It should be understood that since it is necessary to display the first subtitle information for the multimedia content in the non-playback area of ​​the second interface, in order to allow the user to view the subtitles more clearly, after switching from the first interface to the second interface, the size of the playback screen of the multimedia content of the second interface can be set to be reduced relative to the playback screen of the multimedia content of the first interface, that is, the playback area of ​​the second interface plays the multimedia content with the reduced screen, so that the size of the non-playback area of ​​the second interface is sufficient to display the subtitles. For example, Figure 5A The first interface in the listening and video mode shown in (a) includes a first interface playback area 500, and the first interface playback area 500 is used to display the playback screen of the first interface, such as Figure 5AThe second interface in the listening and video mode shown in (b) includes a playback area 510 of the second interface, and the playback area 510 of the second interface is used to display the playback screen of the second interface; wherein the playback area 510 of the second interface is smaller than the playback area 500 of the first interface, that is, the size of the playback screen of the second interface is smaller than the size of the playback screen of the first interface, so that the non-playback area 520 of the second interface can be sufficient to display subtitles. In this embodiment, by reducing the size of the playback screen of the second interface, the size of the non-playback area in the second interface becomes larger than the size of the non-playback area in the first interface, so that the non-playback area in the second interface is sufficient to display text information related to the multimedia content, which can help users view the text information more clearly.

[0146] In some embodiments, in the first direction, the size of the non-playing area of ​​the second interface is larger than the size of the playing screen of the multimedia content in the second interface, and the first direction is the width direction of the playing screen. Figure 5A As shown in (b), the size of the non-playing area 520 of the second interface is larger than the size of the playing area 510 of the second interface in the width direction of the playing screen, that is, larger than the size of the playing screen of the multimedia content in the second interface. In this implementation, since the width of the non-playing area for displaying text information in the second interface is larger than the width of the playing area, more text can be displayed without changing the text size, so that the non-playing area displays more subtitles and / or bullet screens in the width direction of the interface, and the subtitles and / or bullet screen information are displayed more clearly, which effectively improves the user's experience of reading text information.

[0147] In some implementations, the play area of ​​the second interface is close to the top of the second interface, and the non-play area of ​​the second interface includes a text area, the text area displays text information for the multimedia content, and the text area is located below the play area. Figure 5A In the second interface shown in (b), the play area 510 of the second interface is located at the top of the second interface, and the non-play area 520 of the second interface includes a text area, and the text area is located below the play area 510 of the second interface. The text area displays the first subtitle information 521 of the multimedia content. In this implementation, the play area is placed at the top of the second interface, and the text area is set below the play area, so that the display effect of the text information is more eye-catching, which not only adapts to the user's viewing habits, but also improves the aesthetics of the interface setting.

[0148] In some implementations, the non-playing area of ​​the second interface further includes a control area, the text area is located between the playing area and the control area, and the control area includes a control for triggering at least one function of the multimedia content. Figure 5AIn the second interface shown in (b), the non-playing area 520 of the second interface also includes a control area, and the control area is located below the text area, that is, the text area is located between the playing area 510 and the control area of ​​the second interface. Among them, controls with multiple functions are displayed in the control area, which is not limited here. In this embodiment, by setting the control area in the non-playing area of ​​the second interface, it is convenient for the user to operate the control of at least one function in the control area, so as to facilitate the operation of opening other related functions when playing multimedia content in the listening video mode, thereby further improving the user interaction experience.

[0149] For example, see Figure 5D , Figure 5D is another schematic diagram disclosed in an embodiment of the present application for displaying first subtitle information on a second interface by opening a subtitle control, wherein the first subtitle information includes a first subtitle and a target subtitle. Figure 5D (a) is the first interface in the video listening mode, the first interface includes a first interface play area 530, the first interface play area 530 is provided with a subtitle control 531, and the subtitle control 531 can also be used to control whether to display the target subtitle and the first subtitle in the non-playing area of ​​the second interface in the video listening mode. Figure 5D As shown in (a) in FIG. 5 , when the user turns on the subtitle control 531, the subtitle function is turned on, so that Figure 5D (a) in the switch to Figure 5D (b) in the above equation. Figure 5D (b) is the second interface in the audio and video mode. Figure 5D The second interface shown in (b) includes a playback area of ​​the second interface and a non-playback area of ​​the second interface. The non-playback area of ​​the second interface displays first subtitle information 522 of the multimedia content. The first subtitle information 522 includes a target subtitle (such as a subtitle 222) that is synchronously displayed with the current playback content of the multimedia content. Figure 5D The target subtitle is in bold as shown in (b) of FIG. 1 ), and the first subtitle (as shown in FIG. 1 ) Figure 5D The first subtitle shown in (b) is in a non-bold state), so that the user can intuitively see the target subtitles and the first subtitles of the multimedia content by opening the subtitle control of the first interface.

[0150] In another example, when the first operation on the first interface in the above method 2 is an opening operation on the subtitle control in the closed state, it can also be displayed Figure 5A (b) and Figure 5B The second interface shown in (b) is shown in FIG. Figure 5A Scenario (b): Users can follow Figure 5CThe gesture shown in (a) in FIG. 10 clicks the closed subtitle control 531, thereby opening the subtitle control 531 and turning on the subtitle function, so that Figure 5C (a) in the switch to Figure 5A (b) in the figure. Figure 5B Scenario (b): Users can follow Figure 5D The gesture shown in (a) in FIG. 10 clicks the closed subtitle control 531, thereby opening the subtitle control 531 and turning on the subtitle function, so that Figure 5D (a) in the switch to Figure 5B (b) in .

[0151] Optionally, the target subtitle is displayed at a first preset position in the non-playing area of ​​the second interface, and the first subtitle is displayed at a second preset position in the non-playing area of ​​the second interface, and the first preset position and the second preset position are different. In this optional implementation, the target subtitle is fixed at a preset position in the display area of ​​the second interface, which can ensure that the target subtitle is always within the user's field of vision. The user does not need to look for the target subtitle on the interface, and can focus on the target subtitle more quickly, thereby improving the readability of the subtitle and enhancing the overall viewing experience; at the same time, the fixed subtitle position helps to maintain the consistency of the interface layout.

[0152] It should be noted that the first preset position and the second preset position can be set by those skilled in the art according to the actual situation of the non-playing area of ​​the second interface, and this application does not limit this.

[0153] In some embodiments, for case 2 where the text information corresponds to the first function, that is, when the first function includes a bullet screen function and the text information includes bullet screen information, in response to the operation of turning on the first function in the above step 220, the text information for the multimedia content is displayed in the non-playing area of ​​the second interface, including: in response to the second operation on the first interface, the bullet screen information for the multimedia content is displayed in the non-playing area of ​​the second interface. In this embodiment, the bullet screen function can be turned on by operating the first interface, and when the bullet screen function is turned on, the bullet screen information will be displayed in the non-playing area of ​​the second interface, so that the user can understand more text information related to the multimedia content, thereby improving the user's experience in the video listening mode.

[0154] In some implementations, the second operation on the first interface may include the following two operation modes:

[0155] Mode 1: The second operation on the first interface is a sliding operation on the first interface. In Mode 1, the bullet screen function can be quickly turned on by performing a sliding operation on the first interface, thereby improving the efficiency and convenience of turning on the bullet screen function and simplifying the user operation process.

[0156] Optionally, the sliding operation is a horizontal sliding operation. In this optional implementation, the horizontal sliding operation is adapted to the user's operating habits, can effectively improve the convenience of the operation, and reduce the complexity of the user's operation.

[0157] For example, see Fig. 6A , Fig. 6A This is a schematic diagram of displaying bullet message information on the second interface through sliding operation disclosed in an embodiment of the present application. Fig. 6A (a) in the figure is the first interface in the listening and video mode. The user can slide on the first interface in the direction of the gesture sliding (left) as shown in the figure, thereby Fig. 6A (a) in the switch to Fig. 6A (b) in the above equation. Fig. 6A (b) is the second interface in the audio and video mode. Fig. 6A The non-playback area of ​​the second interface shown in (b) displays bullet screen information 621 of the multimedia content.

[0158] It should be noted that the number of bullet screen information for multimedia content displayed in the non-playing area of ​​the second interface is not limited in this application.

[0159] Mode 2: When the first interface includes a bullet screen control in a closed state, the second operation on the first interface is an opening operation on the bullet screen control in a closed state. In Mode 2, the bullet screen function can be quickly opened by opening the bullet screen control on the first interface, which facilitates the user to control and operate the opening and closing of the bullet screen function.

[0160] Optionally, the playback area of ​​the first interface includes a bullet screen control. In this optional implementation, the bullet screen control is integrated into the playback area of ​​the first interface, which improves the compactness and aesthetics of the control setting in the first interface.

[0161] For example, see Figure 6B , Figure 6B This is a schematic diagram of displaying bullet screen information on a second interface by opening a bullet screen control disclosed in an embodiment of the present application. Figure 6B (a) is the first interface in the listening and video mode, the first interface includes a play area of ​​the first interface, and the play area of ​​the first interface is provided with a bullet screen control 611, such as Figure 6B As shown in (a) of FIG. 1 , the bullet screen control 611 is in a closed state. The user can click the bullet screen control 611 in a closed state according to the gesture shown in the figure, thereby opening the bullet screen control 611 and turning on the bullet screen function. Figure 6B (a) in the switch to Figure 6B (b) in the above equation. Figure 6B(b) is the second interface in the audio and video mode. Figure 6B The non-playback area of ​​the second interface shown in (b) displays bullet screen information 621 of the multimedia content.

[0162] In some embodiments, for case 3 where the text information corresponds to the first function, that is, when the first function includes a subtitle function and a bullet screen function, and the text information includes the first subtitle information and the bullet screen information, in response to the operation of turning on the first function, the text information for the multimedia content is displayed in the non-playing area of ​​the second interface, including: in response to the operation on the first interface, the first subtitle information for the multimedia content is displayed in the non-playing area of ​​the fifth interface; in response to the operation on the fifth interface, the bullet screen information for the multimedia content is displayed in the non-playing area of ​​the second interface. In this embodiment, by operating the first interface, you can switch to the fifth interface (an interface before the second interface), so that only subtitles are displayed on the fifth interface; and then by operating the fifth interface, you can switch to the second interface, so that only bullet screens are displayed on the second interface. This method of displaying subtitles or bullet screens separately on different interfaces improves the simplicity of the interface display, so that users can more clearly view the subtitles or bullet screens displayed on the corresponding interface when browsing each interface without being disturbed by other text information.

[0163] Optionally, the subtitle area of ​​the fifth interface displays first subtitle information. Optionally, the first subtitle information includes a target subtitle displayed synchronously with the current playing content of the multimedia content, or the first subtitle information includes a target subtitle displayed synchronously with the current playing content of the multimedia content and a first subtitle, and the first subtitle and the target subtitle are subtitles corresponding to at least part of the audio of the multimedia content.

[0164] For example, see Figure 6C , Figure 6C This is a schematic diagram of displaying first subtitle information on the fifth interface and displaying bullet screen information on the second interface through a sliding operation disclosed in an embodiment of the present application. Figure 6C (a) is the first interface in the audio and video mode. Figure 6C The subtitle control 531 shown in (a) is in a closed state. When the subtitle control 531 is in a closed state, as shown in FIG. Figure 6C In (a), the target subtitle is not displayed; Figure 6C (c) is the second interface in the video listening mode. When the subtitle control 531 is in the closed state, Figure 6C (c) in FIG. 1 also does not display the target subtitles. Specifically, Figure 6C The operation process from (a) to (c) is as follows:

[0165] When the subtitle control 531 is in the closed state, the user can Figure 6CThe direction of the gesture sliding shown in (a) (leftward) performs a sliding operation on the first interface, thereby Figure 6C (a) in the switch to Figure 6C (b) in the above equation. Figure 6C (b) in the figure is the fifth interface in the listening and video mode. Figure 6C The fifth interface shown in (b) includes first subtitle information 522 of multimedia content displayed in the non-playing area of ​​the fifth interface. The first subtitle information 522 includes a target subtitle (such as a subtitle displayed synchronously with the current playing content of the multimedia content) Figure 6C The target subtitle is in bold as shown in (b) of FIG. 1 ), and the first subtitle (as shown in FIG. 1 ) Figure 6C (b) shows that the first subtitle is not bold), even if the subtitle control 531 is closed, the user can still view the subtitles of the multimedia content by sliding the first interface. Figure 6C The direction of the gesture sliding shown in (b) (leftward) performs a sliding operation on the fifth interface, thereby Figure 6C (b) in the switch to Figure 6C (c) in 6C shows barrage information 621 of multimedia content.

[0166] In some embodiments, Figure 6C When the subtitle control 531 shown in (a) is in a closed state, the user can also click the subtitle control 531 in the closed state to turn on the subtitle function, so that the first interface in the video listening mode is switched to the fifth interface (see Figure 5C (b) in the fifth interface, the target subtitle is displayed on the fifth interface. Further, if the user wants to turn on the bullet screen function, the user can perform a sliding operation on the fifth interface to switch from the fifth interface to the Figure 6C (c) in .

[0167] As an optional implementation, for situation 3 where the text information corresponds to the first function, that is, when the first function includes a subtitle function and a barrage function, and the text information includes first subtitle information and barrage information, in response to the operation of turning on the first function, text information for the multimedia content is displayed in the non-playback area of ​​the second interface, including: in response to a third operation on the first interface, the first subtitle information and barrage information for the multimedia content are displayed in the non-playback area of ​​the second interface.

[0168] Optionally, the third operation on the first interface is a sliding operation on the first interface, and the first subtitle information includes target subtitles that are displayed synchronously with the currently played content of the multimedia content.

[0169] For example, see Fig. 7A , Fig. 7A This is a schematic diagram of displaying first subtitle information and bullet screen information on a second interface through a sliding operation disclosed in an embodiment of the present application. Fig. 7A (a) in the figure is the first interface in the listening and video mode. The user can slide on the first interface in the direction of the gesture sliding (left) as shown in the figure, thereby Fig. 7A (a) in the switch to Fig. 7A (b) in the above equation. Fig. 7A (b) is the second interface in the audio and video mode. Fig. 7A The non-playing area of ​​the second interface shown in (b) displays the first subtitle information 521 and the barrage information 621 of the multimedia content. The first subtitle information 521 is the target subtitle displayed synchronously with the current playing content of the multimedia content.

[0170] Optionally, the third operation on the first interface is a sliding operation on the first interface, and the first subtitle information includes a target subtitle and a first subtitle displayed synchronously with the currently playing content of the multimedia content, and the first subtitle and the target subtitle are subtitles corresponding to at least part of the audio of the multimedia content.

[0171] For example, see Figure 7B , Figure 7B is another schematic diagram of displaying first subtitle information and bullet screen information on the second interface through a sliding operation disclosed in an embodiment of the present application. Figure 7B (a) in the figure is the first interface in the listening and video mode. The user can slide on the first interface in the direction of the gesture sliding (left) as shown in the figure, thereby Figure 7B (a) in the switch to Fig. 7A (b) in the above equation. Figure 7B (b) is the second interface in the audio and video mode. Figure 7B The non-playing area of ​​the second interface shown in (b) of FIG. 1 displays the first subtitle information 522 of the multimedia content and the barrage information 621. The first subtitle information 522 includes the target subtitles (such as the subtitles of the current playing content of the multimedia content) displayed synchronously. Figure 7B The target subtitle is in bold as shown in (b) of FIG. 1 ), and the first subtitle (as shown in FIG. 1 ) Figure 7B The first subtitle shown in (b) is not bold).

[0172] In this optional implementation, the user only needs to perform an operation on the first interface once to switch to the second interface to view subtitles and bullet comments at the same time.

[0173] It can be seen that, by implementing the embodiment of the present application, when the user wants to understand the text information of multimedia content such as subtitles and / or bullet screens in the listening video mode, the user can switch to the second interface of the listening video mode by turning on the subtitle and / or bullet screen function (such as the first function), and generate and display text information related to the multimedia content in the non-playing area of ​​the second interface. Compared with the prior art solution of displaying text information on a reduced playback screen or not displaying text information, resulting in a poor user experience, in the technical solution of the present application, in the listening video mode, text information for multimedia content is displayed in the non-playing area based on user operation. Since the non-playing area is conducive to providing more space to display text information, the displayed text information can be made larger, so that the user can see clearer text information, thereby improving the user experience in the listening video mode.

[0174] Through the above steps, we can understand the method steps of the interface display of text information for multimedia content in the non-playback area of ​​the second interface in the embodiment of the present application. The step flow of the interface display method of the embodiment of the present application will be further described in detail below.

[0175] See also Figure 8 , Figure 8 FIG. 1 is a flow chart of another method for displaying an interface disclosed in an embodiment of the present application. Figure 8 The method shown may include the following steps:

[0176] Step 810: Play multimedia content in a play area of ​​the first interface in a video listening mode, where the size of the play area is smaller than the size of the first interface.

[0177] Step 820: In response to a first operation on the first interface, first subtitle information for the multimedia content is displayed in a non-playing area of ​​the second interface.

[0178] The specific implementation of steps 810 to 820 may refer to the above steps 210 to 220 in which the first subtitle information for the multimedia content is displayed in the non-playing area of ​​the second interface, and will not be described in detail here.

[0179] Step 830, in response to the operation of turning on the barrage function, displaying barrage information and second subtitle information in the non-playing area of ​​the third interface, wherein the second subtitle information includes the target subtitle.

[0180] In an embodiment of the present application, the first function includes a subtitle function and a barrage function, and the first subtitle information of the multimedia content has been displayed in the non-playing area of ​​the second interface. In order to further display the barrage information of the multimedia content, the barrage information and the second subtitle information can be displayed in the non-playing area of ​​the third interface by turning on the barrage function, wherein the second subtitle information includes the target subtitle. It should be noted that since the first subtitle information of the multimedia content has been displayed in the non-playing area of ​​the second interface, and considering that the size of the non-playing area of ​​the third interface is limited, and the main function of the third interface is to allow users to view the barrage information of the multimedia content, the second subtitle information displayed in the third interface is set to display the target subtitles in this embodiment.

[0181] In some embodiments, the operation of opening the bullet screen function is a sliding operation on the second interface. In this embodiment, when the user is watching subtitles through the second interface, the bullet screen function can be further opened by sliding the second interface, which improves the efficiency and convenience of opening the bullet screen function, enhances the interactivity and continuity of the interaction with the user, and reduces the complexity of the user's operation.

[0182] It should be understood that the user can perform a sliding operation on the second interface to switch to the third interface, and the bullet screen information and target subtitles of the multimedia content are displayed in the non-playing area of ​​the third interface. In this optional implementation, the bullet screen function can be quickly turned on by performing a sliding operation on the second interface, which improves the efficiency and convenience of turning on the bullet screen function and simplifies the user operation process.

[0183] Optionally, the sliding operation is a horizontal sliding operation. In this optional implementation, the horizontal sliding operation is adapted to the user's operating habits, can effectively improve the convenience of the operation, and reduce the complexity of the user's operation.

[0184] For example, see Fig. 9A , Fig. 9A This is a schematic diagram of displaying bullet screen information and second subtitle information on a third interface through a sliding operation disclosed in an embodiment of the present application. Fig. 9A (a) is the first interface in the video listening mode. Users can Fig. 9A The direction of the gesture sliding shown in (a) (leftward) performs a sliding operation on the first interface, thereby Fig. 9A (a) in the switch to Fig. 9A (b) in the above equation. Fig. 9A (b) is the second interface in the audio and video mode. Fig. 9A The non-playing area of ​​the second interface shown in (b) of FIG. 1 displays the first subtitle information 522 of the multimedia content, and the first subtitle information 522 is the target subtitle and the first subtitle. Fig. 9A The direction of the gesture sliding shown in (b) (leftward) performs a sliding operation on the second interface, thereby Fig. 9A (b) in the switch to Fig. 9A (c) in which, Fig. 9A (c) in the figure is the third interface in the listening and video mode, such as Fig. 9A The third interface shown in (c) includes a playback area 910 of the third interface and a non-playback area 920 of the third interface. The non-playback area 920 of the third interface displays barrage information 621 and second subtitle information 521 of the multimedia content. The second subtitle information 521 is the target subtitle displayed synchronously with the current playback content of the multimedia content.

[0185] For example, see Fig. 9B , Fig. 9B This is another schematic diagram of displaying bullet screen information and second subtitle information on the third interface by opening the subtitle control and sliding operation disclosed in the embodiment of the present application. Fig. 9B (a) is the first interface in the video listening mode. The playback area of ​​the first interface is provided with a subtitle control 531, and the subtitle control 531 is in a closed state. The user can Fig. 9B The gesture shown in (a) in FIG. 10 clicks the closed subtitle control 531, thereby opening the subtitle control 531 and turning on the subtitle function, so that Fig. 9B (a) in the switch to Fig. 9B (b) in the above equation. Fig. 9B (b) is the second interface in the audio and video mode. Fig. 9B The non-playing area of ​​the second interface shown in (b) of FIG. 1 displays the first subtitle information 521 of the multimedia content. The first subtitle information 521 is the target subtitle displayed synchronously with the current playing content of the multimedia content. Further, the user can Fig. 9B The direction of the gesture sliding shown in (b) (leftward) performs a sliding operation on the second interface, thereby Fig. 9B (b) in the switch to Fig. 9B (c) in which, Fig. 9B (c) in the figure is the third interface in the listening and video mode, such as Fig. 9B The non-playing area of ​​the third interface shown in (c) displays bullet screen information 621 and second subtitle information 521 of the multimedia content, and the second subtitle information 521 is the target subtitle displayed synchronously with the current playing content of the multimedia content.

[0186] In some implementations, the non-playing area of ​​the third interface includes a bullet screen area and a subtitle area, and the playing area, bullet screen area, and subtitle area of ​​the third interface are sequentially arranged along the height direction of the third interface. Fig. 9BThe third interface shown in (b) includes a playback area 910 of the third interface and a non-playback area 920 of the third interface, and the non-playback area 920 of the third interface includes a bullet screen area and a subtitle area, wherein the playback area 910, the bullet screen area, and the subtitle area of ​​the third interface are sequentially arranged along the height direction of the third interface (shown from top to bottom). In this implementation, based on the user's viewing habits, by sequentially arranging the playback area, the bullet screen area, and the subtitle area from top to bottom in the third interface, not only the aesthetics of the third interface layout is optimized, but also the viewing experience of the user when watching multimedia playback content, bullet screen, and subtitles at the same time can be improved.

[0187] In some embodiments, in the first direction, the size of the bullet screen area and the size of the subtitle area of ​​the third interface are both larger than the size of the playback screen of the multimedia content in the third interface, and the first direction is the width direction of the playback screen. Fig. 9B In the third interface shown in (b), the sizes of the barrage area and the subtitle area of ​​the non-playback area 920 of the third interface are larger than the size of the playback area 910 of the third interface in the width direction of the playback screen, that is, larger than the size of the playback screen of the multimedia content in the third interface.

[0188] In some embodiments, before displaying the bullet screen information and the second subtitle information in the non-playing area of ​​the third interface in response to the operation of turning on the bullet screen function, the method further includes: displaying the third subtitle information in the non-playing area of ​​the fourth interface in response to the operation on the second interface, the third subtitle information including the target subtitle and the first subtitle, the first subtitle and the target subtitle being subtitles corresponding to at least part of the audio of the multimedia content; and displaying the bullet screen information and the second subtitle information in the non-playing area of ​​the third interface in response to the operation on the fourth interface. In this embodiment, when the user watches the target subtitles displayed synchronously with the current playing content of the multimedia content through the second interface, the user can also switch to the fourth interface by operating the second interface, and display more subtitles through the fourth interface, providing the user with a richer selection of subtitles.

[0189] Optionally, the operation on the second interface is a sliding operation on the second interface. Optionally, the operation on the fourth interface is a sliding operation on the fourth interface. In this optional implementation, the text information displayed between different interfaces is switched by sliding operation, and the user's operation process is simplified by maintaining the consistency of the user operation.

[0190] Optionally, the sliding operation is a horizontal sliding operation. In this optional implementation, the horizontal sliding operation is adapted to the user's operating habits, can effectively improve the convenience of the operation, and reduce the complexity of the user's operation.

[0191] For example, see Fig. 9C , Fig. 9C is a schematic diagram of displaying third subtitle information on a fourth interface through a sliding operation disclosed in an embodiment of the present application. Fig. 9C (a) is the first interface in the video listening mode. The playback area of ​​the first interface is provided with a subtitle control 531, and the subtitle control 531 is in a closed state. The user can Fig. 9C The gesture shown in (a) in FIG. 10 clicks the closed subtitle control 531, thereby opening the subtitle control 531 and turning on the subtitle function, so that Fig. 9C (a) in the switch to Fig. 9C (b) in which, Fig. 9C (b) is the second interface in the audio and video mode. Fig. 9C The non-playing area of ​​the second interface shown in (b) of FIG. 1 displays the first subtitle information 521 of the multimedia content. The first subtitle information 521 is the target subtitle displayed synchronously with the current playing content of the multimedia content. Further, the user can Fig. 9C The direction of the gesture sliding shown in (b) (leftward) performs a sliding operation on the second interface, thereby Fig. 9C (b) in the switch to Fig. 9C (c) in which, Fig. 9C (c) in the figure is the fourth interface in the listening and video mode, such as Fig. 9C The non-playing area of ​​the fourth interface shown in (c) of FIG. 9 shows third subtitle information 522 of the multimedia content, and the third subtitle information 522 includes a target subtitle (the target subtitle is in bold as shown in (c) of FIG. 9C ) and a first subtitle (the first subtitle is in non-bold as shown in (c) of FIG. 9C ). Further, the user can select the subtitle according to the following steps: Fig. 9C The direction of the gesture sliding shown in (c) (leftward) performs a sliding operation on the fourth interface, thereby Fig. 9C (c) in the switch to Fig. 9C (d) in which, Fig. 9C (d) in the figure is the third interface in the listening and video mode, such as Fig. 9C The non-playing area of ​​the third interface shown in (d) displays bullet screen information 621 and second subtitle information 521 of the multimedia content, and the second subtitle information 521 is the target subtitle displayed synchronously with the current playing content of the multimedia content.

[0192] Optionally, the size of the multimedia content playback screen in the fourth interface is smaller than the size of the multimedia content playback screen in the second interface. It should be understood that since it is necessary to display more subtitles for the multimedia content in the non-playing area of ​​the fourth interface, in order to allow the user to view the target subtitles and the first subtitles more clearly, the size of the multimedia content playback screen in the fourth interface can be reduced so that the size of the non-playing area of ​​the fourth interface is sufficient to display the target subtitles and the first subtitles. For example, Fig. 9C The size of the playback screen shown in (c) is smaller than Fig. 9C The size of the playback screen shown in (b) in the figure makes the non-playback area of ​​the fourth interface large enough to display the target subtitles and the first subtitles. In this optional implementation, since the fourth interface displays more subtitles than the second interface, when the playback screen size of the multimedia content in the fourth interface is smaller than the playback screen size of the multimedia content in the second interface, the size of the non-playback area for displaying subtitles in the fourth interface becomes larger, so that the non-playback area in the fourth interface is large enough to display subtitles related to the multimedia content, which can improve the user's viewing experience.

[0193] In some implementations, in response to the operation of exiting the video listening mode, the multimedia content is played in full screen on the sixth interface. Fig. 10A , Fig. 10A : is a schematic diagram of the sixth interface after exiting the listening and video mode disclosed in an embodiment of the present application. Fig. 10A (a) in the figure is the first interface in the listening and video mode. The user can slide on the first interface in the direction of the gesture sliding (left) as shown in the figure to exit the listening and video mode. Fig. 10A (a) in the switch to Fig. 10A (b) in the above equation. Fig. 10A (b) is the sixth interface after exiting the video listening mode. Fig. 10A In the sixth interface shown in (b), multimedia content can be played in full screen. In this implementation, when a user exits the listening and video mode while watching a certain multimedia content in the listening and video mode, the multimedia content will be played in full screen in the new sixth interface, so that the user can continue to watch the multimedia content, and playing the multimedia content in full screen in the sixth interface can better enhance the user's viewing experience.

[0194] In some embodiments, the multimedia content is played through a video application. In response to an operation of playing the multimedia content in the background in the video listening mode, subtitles corresponding to the currently playing content of the multimedia content are synchronously displayed on the seventh interface, wherein the seventh interface is the lock screen interface or the device desktop.

[0195] For example, if the device desktop is displayed after exiting the video application and multimedia content is played in the background, see Fig. 10B , Fig. 10B : is a schematic diagram of the seventh interface after exiting a video application disclosed in an embodiment of the present application. Fig. 10B (a) is the first interface in the video listening mode. Users can Fig. 10B The direction of the gesture sliding shown in (a) (downward and upward) is used to perform a sliding operation on the first interface, thereby exiting the video application, and exiting the video application. Fig. 10B (a) in the switch to Fig. 10B (b) in the figure makes the multimedia content play in the background, wherein: Fig. 10B (b) in FIG. 1 is the seventh interface (i.e., the device desktop) after exiting the video application. Further, when multimedia content is played in the background, such as Fig. 10B The seventh interface (ie, the device desktop) shown in (b) may display first subtitle information 521 of the multimedia content, where the first subtitle information 521 is subtitles displayed synchronously with the currently played content of the multimedia content.

[0196] For example, if the device is in the locked screen state and multimedia content is playing in the background, see Fig. 10B In (c), when the electronic device 120 used by the user plays multimedia content in the audio and video mode, the electronic device 120 is set to the lock screen state, and the multimedia content can be played in the background. The lock screen interface of the electronic device 120 is as follows Fig. 10B As shown in (c), Fig. 10B (c) in the figure is the seventh interface in the lock screen state (i.e., the lock screen interface). Fig. 10B The seventh interface (ie, the lock screen interface) shown in (c) may display first subtitle information 521 of the multimedia content, where the first subtitle information 521 is subtitles displayed synchronously with the currently played content of the multimedia content.

[0197] In this implementation, while the multimedia content continues to be played in the background in the listening to video mode, the subtitles corresponding to the currently playing content of the multimedia content can also be displayed in other interfaces. Even if the current interface is not the interface in the listening to video mode of the video application, the user can still watch the subtitles corresponding to the currently playing content in other interfaces, thereby better improving the user experience in the listening to video mode.

[0198] It can be seen that, by implementing the embodiment of the present application, when the user wants to understand the text information of multimedia content such as subtitles and / or bullet screens in the listening video mode, the user can switch to the second interface of the listening video mode by turning on the subtitle and / or bullet screen function (such as the first function), and generate and display text information related to the multimedia content in the non-playing area of ​​the second interface. Compared with the prior art solution of displaying text information or not displaying text information on the reduced playback screen, which leads to poor user experience, in the technical solution of the present application, in the listening video mode, text information for multimedia content is displayed in the non-playing area based on user operation, because the non-playing area is conducive to providing more space to display text information, the displayed text information can be made larger, so that the user can see clearer text information, thereby improving the user's experience in the listening video mode. By operating the bullet screen function, when the bullet screen function is turned on, the bullet screen information will be automatically displayed in the non-playing area of ​​the third interface, and the target subtitles displayed synchronously with the current playback content of the multimedia content can also be displayed, so that the user can watch the bullet screen and the target subtitles at the same time through the third interface, thereby improving the user's experience in the listening video mode.

[0199] It should be understood that, although the steps in the above-mentioned flowcharts are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the above-mentioned flowcharts may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these sub-steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps. In addition, the above-mentioned multiple embodiments can be implemented independently, and can also be combined with each other, which is not limited here.

[0200] Based on the foregoing embodiments, the embodiments of the present application provide an interface display device, which includes the modules included and the units included in the modules, and can be implemented by a processor; of course, it can also be implemented by a specific logic circuit; in the implementation process, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA), etc.

[0201] See also Fig.11 , Fig.11 is a schematic diagram of the structure of an interface display device disclosed in an embodiment of the present application, such as Fig.11 The device shown includes:

[0202] The first display module 1101 is used to play multimedia content in a play area of ​​the first interface in an audio-video mode, and the size of the play area is smaller than the size of the first interface;

[0203] The second display module 1102 is used to display text information about the multimedia content in the non-playing area of ​​the second interface in response to the operation of starting the first function, wherein the text information corresponds to the first function, and the text information includes first subtitle information and / or barrage information, and the first subtitle information includes target subtitles displayed synchronously with the current playing content of the multimedia content.

[0204] In some embodiments, the first function includes a subtitle function, and the text information includes first subtitle information; the second display module 1102 is specifically used for:

[0205] In response to a first operation on the first interface, first subtitle information for the multimedia content is displayed in a non-playing area of ​​the second interface.

[0206] In some embodiments, the first function also includes a bullet screen function, and the text information also includes bullet screen information, such as Fig.11 The device shown also includes:

[0207] The third display module is used to display the first subtitle information for the multimedia content in the non-playing area of ​​the second interface in response to the first operation on the first interface in the second display module 1102, and then, in response to the operation of turning on the barrage function, display the barrage information and the second subtitle information in the non-playing area of ​​the third interface, wherein the second subtitle information includes the target subtitle.

[0208] In some embodiments, Fig.11 The device shown also includes:

[0209] a fourth display module, configured to display third subtitle information in a non-playing area of ​​a fourth interface in response to an operation on the second interface before the third display module displays the barrage information and the second subtitle information in a non-playing area of ​​the third interface in response to an operation on the second interface, wherein the third subtitle information includes a target subtitle and a first subtitle, and the first subtitle and the target subtitle are subtitles corresponding to at least part of the audio of the multimedia content;

[0210] The third display module is specifically used for:

[0211] In response to the operation on the fourth interface, the barrage information and the second subtitle information are displayed in the non-playing area of ​​the third interface.

[0212] In some embodiments, the first function includes a bullet screen function, and the text information includes bullet screen information; the second display module 1102 is specifically used for:

[0213] In response to a second operation on the first interface, bullet screen information for the multimedia content is displayed in a non-playing area of ​​the second interface.

[0214] In some embodiments, the first function includes a subtitle function and a bullet screen function, and the text information includes first subtitle information and bullet screen information; Fig.11 The device shown also includes:

[0215] a fifth display module, configured to display first subtitle information for the multimedia content in a non-playing area of ​​the fifth interface in response to an operation on the first interface;

[0216] The second display module 1102 is further specifically used for:

[0217] In response to the operation on the fifth interface, barrage information for the multimedia content is displayed in the non-playing area of ​​the second interface.

[0218] In some embodiments, Fig.11 The device shown also includes:

[0219] The sixth display module is used to display text information about the multimedia content in the non-playing area of ​​the second interface in response to the operation of starting the first function on the second display module 1102, and then play the multimedia content in full screen on the sixth interface in response to the operation of exiting the listening and video mode.

[0220] In some embodiments, the multimedia content is played through a video application; Fig.11 The device shown also includes:

[0221] The seventh display module is used to respond to the operation of starting the first function on the second display module 1102, display text information about the multimedia content in the non-playing area of ​​the second interface, and then respond to the operation of exiting the video application in the video listening mode to play the multimedia content in the background; when the multimedia content is played in the background, the subtitles corresponding to the currently played content of the multimedia content are synchronously displayed on the seventh interface, wherein the seventh interface at least includes the lock screen interface and other application interfaces.

[0222] It should be noted that in the embodiments of this application Fig.11 The division of modules in the interface display device shown is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0223] Please refer to Fig.12 , Fig.12 Schematic diagram of the structure of an electronic device disclosed in the embodiment of the present application. Fig.12 As shown, the electronic device includes:

[0224] A memory 1201 storing executable program codes;

[0225] A processor 1202 coupled to the memory 1201;

[0226] The processor 1202 calls the executable program code stored in the memory 1201 to execute any one of the interface display methods in the above method embodiments.

[0227] An embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps in any one of the interface display methods provided in the above embodiments are implemented.

[0228] The embodiments of the present application also disclose an application publishing platform, wherein the application publishing platform is used to publish a computer program product, wherein when the computer program product runs on a computer, the computer executes part or all of the steps of the method in the above method embodiments.

[0229] Those skilled in the art will understand that Fig.12 The structure shown in the figure is merely a block diagram of a partial structure related to the scheme of the present application, and does not constitute a limitation on the electronic device to which the scheme of the present application is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0230] It should be noted here that the description of the above device, electronic device, computer-readable storage medium, and computer program product embodiments is similar to the description of the above method embodiments, and has similar beneficial effects as the method embodiments. For technical details not disclosed in the embodiments of the device, electronic device, computer-readable storage medium, and computer program product of this application, please refer to the description of the method embodiments of this application for understanding.

[0231] It should be understood that "one embodiment" or "an embodiment" or "some embodiments" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in one embodiment" or "in some embodiments" appearing throughout the specification may not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The above-mentioned sequence numbers of the embodiments of the present application are only for description and do not represent the advantages and disadvantages of the embodiments. The above description of each embodiment tends to emphasize the differences between the various embodiments, and the same or similar aspects can be referenced to each other. For the sake of brevity, this article will not repeat them.

[0232] The term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there may be three relationships. For example, object A and / or object B can represent three situations: object A exists alone, object A and object B exist at the same time, and object B exists alone.

[0233] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0234] In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The embodiments described above are merely illustrative. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as: multiple modules or components can be combined, or can be integrated into another system, or some features can be ignored, or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0235] Those skilled in the art will appreciate that all or part of the steps of the above method embodiments may be implemented by hardware associated with program instructions, and the aforementioned program may be stored in a computer-readable storage medium, which, when executed, executes the steps of the above method embodiments; and the aforementioned storage medium includes various media that can store program codes, such as mobile storage devices, read-only memories (ROM), magnetic disks or optical disks.

[0236] The methods disclosed in several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0237] The features disclosed in several device embodiments provided in this application can be arbitrarily combined without conflict to obtain new device embodiments.

[0238] The above is only an implementation method of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for interface display, characterized in that: The method comprises: Playing multimedia content in a playback area of ​​a first interface in a video listening mode, wherein the size of the playback area is smaller than the size of the first interface; In response to the operation of starting the first function, text information for the multimedia content is displayed in the non-playback area of ​​the second interface, wherein the text information corresponds to the first function, and the text information includes first subtitle information and / or barrage information, and the first subtitle information includes target subtitles displayed synchronously with the current playback content of the multimedia content.

2. The method according to claim 1, characterized in that The first function includes a subtitle function, and the text information includes the first subtitle information; And, in response to the operation of starting the first function, displaying text information for the multimedia content in the non-playing area of ​​the second interface includes: In response to a first operation on the first interface, the first subtitle information for the multimedia content is displayed in a non-playing area of ​​the second interface.

3. The method according to claim 2, characterized in that The first operation is a sliding operation on the first interface.

4. The method according to claim 2, characterized in that: The first interface includes a subtitle control in a closed state, and the first operation is an opening operation for the subtitle control in the closed state.

5. The method according to any one of claims 1 to 4, characterized in that In the first direction, the size of the non-playing area of ​​the second interface is larger than the size of the playing screen of the multimedia content in the second interface, and the first direction is the width direction of the playing screen.

6. The method according to any one of claims 2 to 5, characterized in that The first function further includes a bullet screen function, the text information further includes the bullet screen information, and after the first subtitle information for the multimedia content is displayed in the non-playing area of ​​the second interface in response to the first operation on the first interface, the method further includes: In response to the operation of turning on the barrage function, the barrage information and second subtitle information are displayed in a non-playing area of ​​the third interface, and the second subtitle information includes the target subtitle.

7. The method according to claim 6, characterized in that The operation of turning on the barrage function is a sliding operation on the second interface.

8. The method according to claim 6, characterized in that Before displaying the barrage information and the second subtitle information in the non-playing area of ​​the third interface in response to the operation of enabling the barrage function, the method further includes: In response to an operation on the second interface, displaying third subtitle information in a non-playing area of ​​a fourth interface, the third subtitle information including the target subtitle and the first subtitle, the first subtitle and the target subtitle being subtitles corresponding to at least part of the audio of the multimedia content; And, in response to the operation of turning on the bullet screen function, displaying the bullet screen information and the second subtitle information in the non-playing area of ​​the third interface includes: In response to the operation on the fourth interface, the barrage information and the second subtitle information are displayed in the non-playing area of ​​the third interface.

9. The method according to any one of claims 6 to 8, characterized in that The non-playing area of ​​the third interface includes a bullet screen area and a subtitle area, and the playing area, the bullet screen area and the subtitle area of ​​the third interface are arranged in sequence along the height direction of the third interface.

10. The method according to any one of claims 2 to 7, characterized in that The first subtitle information further includes a first subtitle, and the first subtitle and the target subtitle are subtitles corresponding to at least a portion of the audio of the multimedia content.

11. The method according to claim 1, characterized in that The first function includes a bullet screen function, the text information includes the bullet screen information; and the displaying of the text information for the multimedia content in the non-playing area of ​​the second interface in response to the operation of starting the first function includes: In response to a second operation on the first interface, the bullet screen information for the multimedia content is displayed in a non-playing area of ​​the second interface.

12. The method according to claim 11, characterized in that The second operation is a sliding operation on the first interface.

13. The method according to claim 11, characterized in that The first interface includes a bullet screen control in a closed state, and the second operation is an opening operation for the bullet screen control in the closed state.

14. The method according to claim 1, characterized in that The first function includes a subtitle function and a bullet screen function, and the text information includes the first subtitle information and the bullet screen information; And, in response to the operation of starting the first function, displaying text information for the multimedia content in the non-playing area of ​​the second interface includes: In response to the operation on the first interface, displaying the first subtitle information for the multimedia content in a non-playing area of ​​a fifth interface; In response to the operation on the fifth interface, the bullet screen information for the multimedia content is displayed in the non-playing area of ​​the second interface.

15. The method according to any one of claims 1 to 14, characterized in that After displaying text information for the multimedia content in the non-playing area of ​​the second interface in response to the operation of starting the first function, the method further includes: In response to the operation of exiting the video listening mode, the multimedia content is played in full screen on the sixth interface.

16. A device for interface display, characterized in that: include: A first display module, used to play multimedia content in a play area of ​​a first interface in an audio-video mode, wherein the size of the play area is smaller than the size of the first interface; A second display module is used to display text information for the multimedia content in a non-playing area of ​​a second interface in response to an operation of starting the first function, wherein the text information corresponds to the first function, and the text information includes first subtitle information and / or barrage information, and the first subtitle information includes a target subtitle displayed synchronously with the current playing content of the multimedia content.

17. An electronic device comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, characterized in that: When the processor executes the program, the steps of the method according to any one of claims 1 to 15 are implemented.

18. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 15 is implemented.

19. A computer program product, characterized in that The method comprises a computer program, and when the computer program is executed by a processor, the method according to any one of claims 1 to 15 is implemented.

Images