Audio-video processing method, device, equipment and storage medium

Abstract

The present disclosure provides an audio-video processing method, apparatus, device and storage medium, which includes: first, in response to a preset trigger operation acting on a video playback page corresponding to a target video, the target video being a video in a video information stream, jumping from the video playback page to an audio playback page, and playing the audio corresponding to the target video in the audio playback page.

Description

[Technical field]

[0001] This application is based on and claims priority from a Chinese application having the application number 202210238660.8 and filed on March 11, 2022, the entire disclosure of which is incorporated herein by reference.

[0002] The present disclosure relates to the field of data processing, and in particular to audio-video processing methods, devices, equipment and storage media. [Background technology]

[0003] With the development of multimedia technology applications, the demands on the functionality of video-based applications have become more and more diverse. Summary of the Invention [Means for solving the problem]

[0004] According to a first aspect, the present disclosure provides an audio-video processing method, the method comprising: obtaining audio corresponding to a target video, the target video being a video in a video information stream, in response to a preset trigger operation acting on a video playback page corresponding to the target video; jumping from the video playback page to an audio playback page, and playing the audio corresponding to the target video on the audio playback page.

[0005] In some embodiments, before playing the audio corresponding to the target video on the audio playback page, further In response to a preset trigger operation acting on a video playback page corresponding to a target video, obtaining currently playing information of the target video, including playing state information and / or playing progress information; The playing of the audio corresponding to the target video on the audio playing page includes: Playing audio corresponding to the target video on the audio playback page according to currently playing information of the target video.

[0006] In some embodiments, after playing the audio corresponding to the target video on the audio playback page, In response to a preset first page sliding operation acting on the audio playback page, acquiring an audio information stream in which audio corresponding to the target video is located; and playing audio on the audio playback page based on the audio information stream.

[0007] In some embodiments, after playing the audio corresponding to the target video on the audio playback page, In response to a preset second page sliding operation acting on the audio playback page, obtaining a first audio play list of the user corresponding to the target video, the first audio play list including audio corresponding to each of the videos belonging to the user; and playing audio on the audio playback page based on the first audio playlist.

[0008] In some embodiments, after playing the audio corresponding to the target video on the audio playback page, In response to a preset return operation applied to the audio playback page that plays a target audio, obtaining a video corresponding to the target audio; The method further includes jumping from the audio playback page to the video playback page, and playing a video corresponding to the target audio on the video playback page.

[0009] In some embodiments, after playing the audio corresponding to the target video on the audio playback page, The method further includes presenting comment information corresponding to the audio currently being played on the audio playback page in a preset screen scrolling mode on the audio playback page in response to a trigger operation on a preset first control on the audio playback page.

[0010] In some embodiments, the first control of the preset presents an audio cover image that is a preset frame image of the target video.

[0011] In some embodiments, after playing the audio corresponding to the target video on the audio playback page, The method further includes displaying a comment panel on the audio playback page in response to a trigger operation on a preset comment control on the audio playback page.

[0012] In some embodiments, the method further comprises: In response to a trigger operation on a target avatar on the audio playback page, presenting a video of a user corresponding to the target avatar in a preset floating window format on the audio playback page, where the target avatar is an avatar of a user corresponding to a comment on the audio playback page or an avatar of a user corresponding to a currently played audio; In response to a trigger operation on a first video in the video of the user corresponding to the target avatar, determining a second audio playlist based on the video of the user corresponding to the target avatar, the second audio playlist having audio corresponding to the first video as a first playback audio; and playing audio on the audio playback page based on the second audio playlist.

[0013] In some embodiments, after playing the audio corresponding to the target video on the audio playback page, The method further includes, in response to a trigger operation on a fast-forward control or a fast-rewind control on the audio playback page, fast-forwarding or fast-rewinding the audio corresponding to the target video by a preset time length.

[0014] In some embodiments, after playing the audio corresponding to the target video on the audio playback page, presenting a timer interface on the audio playback page in response to a trigger operation on a timer control on the audio playback page; The method further includes determining timer information for the audio playback page based on the timer interface, the timer information being used to turn off an application corresponding to the audio playback page at a regular interval.

[0015] According to a second aspect, the present disclosure provides an audio-video processing apparatus, comprising: a first acquisition module for acquiring audio corresponding to a target video, the audio being a video in a video information stream, in response to a preset trigger operation acting on a video playback page corresponding to the target video; a first playback module for jumping from the video playback page to an audio playback page and playing the audio corresponding to the target video on the audio playback page.

[0016] According to a third aspect, the present disclosure provides a computer-readable storage medium having instructions stored thereon which, when executed on a terminal device, cause the terminal device to implement the above method.

[0017] According to a fourth aspect, the present disclosure provides an audio-video processing apparatus comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program implementing the above method when executed by the processor.

[0018] According to a fifth aspect, the present disclosure provides a computer program product including computer programs / instructions which, when executed by a processor, implement the above method.

[0019] According to a sixth aspect, the present disclosure provides a computer program comprising instructions, which when executed by a processor, cause the processor to perform an audio-video processing method according to any one of the embodiments described above. [Brief description of the drawings]

[0020] The drawings herein are incorporated in and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification serve to explain the principles of the present disclosure.

[0021] In order to more clearly explain the technical solutions in the embodiments or prior art of the present disclosure, the following briefly introduces drawings necessary for explaining the embodiments or prior art, and it is obvious that those skilled in the art can also derive other drawings based on these drawings without exerting creative efforts.

[0022] [Figure 1] 4 is a flowchart of some exemplary embodiments of an audio-video processing method according to embodiments of the present disclosure. [Diagram 2] 1A-1C are schematic diagrams of several examples of video playback pages according to embodiments of the present disclosure. [Diagram 3] 1A-1C are schematic diagrams of several examples of audio playback pages according to embodiments of the present disclosure. [Figure 4] 11A-11C are schematic diagrams of some further examples of audio playback pages according to embodiments of the present disclosure. [Diagram 5] 11A-11C are schematic diagrams of some further examples of an audio playback page according to embodiments of the present disclosure. [Figure 6] 11A-11C are schematic diagrams of several examples of comment information scrolling panels according to embodiments of the present disclosure. [Figure 7] 1A-1C are schematic diagrams of several examples of comment panels according to embodiments of the present disclosure. [Figure 8] 11A-11C are schematic diagrams of some further examples of audio playback pages according to embodiments of the present disclosure. [Figure 9] 1A to 1C are structural schematic diagrams of some embodiments of audio-video processing devices according to embodiments of the present disclosure; [Figure 10] 1A-1C are structural schematic diagrams of some embodiments of audio-video processing devices according to embodiments of the present disclosure; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] In order to make the above objectives, features and advantages of the present disclosure more clearly understood, the technical solutions of the present disclosure are further described below. It should be explained that, unless contradictory, the embodiments and features in the embodiments of the present disclosure can be combined with each other.

[0024] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure; however, the present disclosure may be embodied in other ways not described herein, and it is apparent that the embodiments in the specification are merely some embodiments of the present disclosure, but not all embodiments.

[0025] As mentioned above, how to enrich the functions of video-based applications to meet the needs of users in more situations and thereby improve user experience is currently an issue that needs to be urgently solved.

[0026] To solve the above problems, the present disclosure provides an audio-video processing method, which can realize playing audio corresponding to a target video on an audio playback page. By implementing page-based audio playback, the needs of users in more scenarios can be met, thereby improving the user experience.

[0027] With the development of multimedia technology applications, the demands for the functions of video-based applications are becoming more and more diverse. For example, in some situations where it is inconvenient to watch a shot video, users want to continue playing the audio corresponding to the shot video. Therefore, how to enrich the functions of video-based applications and realize page-based audio playback, so as to meet the needs of users in more situations and thereby improve user experience, is currently an issue that needs to be solved urgently.

[0028] In order to improve user experience by meeting the needs of users in more scenes, the embodiment of the present disclosure provides an audio-video processing method. First, in response to a preset trigger operation acting on a video playback page corresponding to a target video, obtain an audio corresponding to the target video, which is a video in a video information stream, and then jump from the video playback page to an audio playback page, and play the audio corresponding to the target video on the audio playback page. As can be seen, the embodiment of the present disclosure can realize playing the audio corresponding to the target video on the audio playback page, and implement the audio playback on a page basis, which can meet the needs of users in more scenes, thereby improving the user experience.

[0029] Based on this, an embodiment of the present disclosure provides an audio-video processing method, and referring to FIG. 1, there is shown a flowchart of some embodiments of an audio-video processing method according to an embodiment of the present disclosure, where the method includes:

[0030] S101: In response to a preset trigger operation acting on a video playback page corresponding to a target video, audio corresponding to the target video is obtained.

[0031] Here, the target video is a video in a video information stream.

[0032] The audio-video processing method according to the embodiment of the present disclosure can be applied to a client, for example, the client may include a client deployed in a smart phone, a client deployed in a tablet PC, etc.

[0033] In the embodiment of the present disclosure, a preset trigger operation can also be performed on the video playback page while playing a target video in the video information stream on the video playback page, and when the preset trigger operation is applied to the video playback page corresponding to the target video, an audio corresponding to the target video is obtained, where the obtained audio includes the contents contained in all video tracks corresponding to the target video.

[0034] In the embodiment of the present disclosure, the preset trigger operation may include various methods. For example, as method 1, a long press operation is triggered on an arbitrary blank position on a video playback page, a plurality of function options including a preset function (e.g., functions such as not interested, save locally, favorite, share, etc.) are displayed, and a tap operation is triggered on the preset function. As method 2, a long press operation is triggered on a preset audio control set on a video playback page, where the preset audio control may be set at an arbitrary position on the video playback page (e.g., a position such as the lower right corner or directly below the video playback page), and the preset audio control may be set to an arbitrary shape (e.g., a square, a circle, etc.).

[0035] It should be noted that the embodiments of the present disclosure are not limited to any particular manner or particular location of the preset audio controls set on the video playback page.

[0036] In some embodiments, when it is detected that the number of times the target video is played exceeds a preset number of times, a preset guide hint (e.g., "Press and hold for a surprise" and point to the preset audio control) can be displayed at a position corresponding to the preset audio control to serve as an effective hint. Here, for the same target user, the number of times of the preset guide hint can be set to be equal to or less than a preset number threshold (e.g., 3 times), or the time interval during which the preset guide hint is displayed can be set to be greater than a preset time threshold (e.g., 3 days).

[0037] It should be clarified that the embodiment of the present disclosure is not limited to any specific language for presenting the preset guiding hints and specific values ​​corresponding to the preset number threshold and the preset time threshold, respectively.

[0038] As shown in FIG. 2, it is a schematic diagram of some embodiments of a video playback page according to an embodiment of the present disclosure. In the video playback page, a target video is played, and a preset audio control 201 is set in the lower right corner of the video playback page. The preset audio control is set as a square rotating wheel, with a dynamic effect of rotation. And, a preset guide hint "Long press for a surprise" is displayed at the position of the preset audio control. When a long press operation is received on the preset audio control in the video playback page corresponding to the target video, the audio corresponding to the target video can be obtained.

[0039] S102: Jump from the video playback page to an audio playback page, and play the audio corresponding to the target video on the audio playback page.

[0040] In an embodiment of the present disclosure, after acquiring audio corresponding to the target video in response to a preset trigger operation acting on a video playback page corresponding to the target video based on S101 above, a jump may be made from the video playback page to an audio playback page, and the acquired audio may be played on the audio playback page.

[0041] In an embodiment of the present disclosure, the audio playback page may include an avatar and a user identifier (e.g., a user ID) of the contributor of the target video, preset audio controls to be enlarged, playback progress bar controls corresponding to the audio, a page return control, etc. Here, the cover image corresponding to the preset audio controls to be enlarged may be a video cover image of the target video, an avatar image of the contributor of the target video, etc.

[0042] The technical solutions according to the embodiments of the present disclosure have at least the following advantages over the prior art:

[0043] The embodiment of the present disclosure provides an audio-video processing method, which first obtains an audio corresponding to a target video, which is a video in a video information stream, in response to a preset trigger operation acting on a video playback page corresponding to a target video, and then jumps from the video playback page to an audio playback page, and plays the audio corresponding to the target video on the audio playback page. It can be seen that the embodiment of the present disclosure can realize the playback of the audio corresponding to the target video on the audio playback page and the implementation of audio playback on a page basis, which can meet the needs of users in more scenes, and thereby improve the user experience.

[0044] In some embodiments, after playing the audio corresponding to the target video on the audio playback page, the video corresponding to the target audio is first obtained in response to a preset return operation applied to the audio playback page that plays the target audio, and then the video corresponding to the target audio is played on the video playback page by jumping from the audio playback page.

[0045] In the embodiment of the present disclosure, the audio playback page for playing the target audio may include a preset page back control. Upon receiving a trigger operation (i.e., a preset back operation) on the page back control on the audio playback page, a video corresponding to the target audio may be acquired. The acquired video may include the contents contained in all audio tracks corresponding to the target audio, and may further include one or more pieces of playback status information and playback progress information corresponding to the target audio. Then, based on the acquired video corresponding to the target audio, the current audio playback page may be logged out. Return to the video playback page corresponding to the target video, and play the video corresponding to the target audio on the video playback page.

[0046] 3 is a schematic diagram of some embodiments of an audio playback page according to an embodiment of the present disclosure. On the audio playback page, audio corresponding to a target video is played, and the avatar and user ID of the contributor (e.g., user A) of the target video are set at the upper left corner of the audio playback page, a page return control 301 is set at the upper right corner, and a preset audio control 302 that is enlarged and displayed at an equal scale is set at the middle position, and the preset audio control 302 is set in the form of a square rotating disk with a dynamic effect of rotation, and the cover image corresponding to the preset audio control 302 may be the video cover image of the target video, and a playback progress bar control 303 and a play / pause control 304 corresponding to the audio are set at the position directly below, and when a trigger operation on the play / pause control on the audio playback page is received, the audio may be controlled to be played or paused.

[0047] In some embodiments, after jumping from a video playback page to an audio playback page, a pop-up may be displayed on the audio playback page to inform the user that the audio playback page has already been jumped to and entered into a preset function mode. The preset function mode may be named a listening mode, an audio mode, etc., and the embodiments of the present disclosure are not limited to the specific naming of the preset function mode. For example, to inform the user that the listening mode has already been entered, the pop-up window may include a hint language (e.g., "Entered listening mode") and a preset control (e.g., "Got it" control). In addition, the user may be informed that the audio can still be played if the screen is locked or switched to the backend after entering the listening mode. Here, the pop-up hint may be turned off by triggering a tap operation on the preset control.

[0048] In some embodiments, in response to a triggering operation on a fast forward or rewind control on the audio playback page, the audio corresponding to the target video is played forward or reverse a preset length of time.

[0049] In the embodiment of the present disclosure, the audio playback page may further include a fast-forward control and a fast-rewind control. See FIG. 3 for a schematic diagram of some embodiments of the audio playback page. A fast-forward control and a fast-rewind control 305 are further set at the lower position of the audio playback page. When a trigger operation is received on the fast-forward control or the fast-rewind control on the audio playback page, the audio corresponding to the target video can be fast-forwarded or fast-rewinded by a preset time length. The trigger operation on the fast-forward control or the fast-rewind control may include a tap operation or a long press operation. For example, when the preset time length is 15 seconds and the current audio is played until 00:47, when a triggered tap operation is received on the fast-forward control on the audio playback page, the audio corresponding to the target video can be fast-forwarded by 15 seconds, that is, the current audio can be continued to be played from 01:02.

[0050] In an embodiment of the present disclosure, when a long press operation is received triggered on a fast-forward control or a fast-rewind control on an audio playback page, the audio corresponding to the target video can be fast-forwarded or fast-rewinded at a multiple speed (e.g., 2x, 3x, etc.), and the icon corresponding to the fast-forward control or the fast-rewind control can be switched from a normal state (the icon of the fast-forward control or the fast-rewind control 305 in FIG. 3 ) to an icon of a fast-forward or fast-rewind dynamic effect.

[0051] 4 is a schematic diagram of another embodiment of an audio playback page according to an embodiment of the present disclosure. The audio playback page further includes a speed control 401. Upon receiving a trigger operation on the speed control 401, the audio playback page presents a speed drag bar 402 in the form of a semi-floating window. The speed drag bar includes multiple speed selections (e.g., normal, 1.5x, 2x, 3x, etc.), and upon receiving a drag operation on the speed drag bar, a corresponding speed can be selected. The selected speed can be highlighted.

[0052] In some embodiments, in response to a trigger operation on a timer control on the audio playback page, a timer interface is presented on the audio playback page, and timer information for the audio playback page is determined based on the timer interface, where the timer information is used to timely turn off an application corresponding to the audio playback page.

[0053] In an embodiment of the present disclosure, the audio playback page may further include a timer control, see FIG. 3 for a schematic diagram of some embodiments of the audio playback page. A timer control 306 is further set at a lower position of the audio playback page. Upon receiving a trigger operation on the timer control on the audio playback page, a timer interface is presented on the audio playback page. Based on the timer page, timer information for the audio playback page can be determined. When the audio played on the audio playback page is played for a time length corresponding to the timer information, the application corresponding to the audio playback page can be automatically turned off.

[0054] FIG. 5 shows a schematic diagram of some other examples of an audio playback page according to an embodiment of the present disclosure. When a trigger operation on the timer control 306 is received, a timer drag bar 501 is presented in the form of a semi-floating window on the audio playback page. When a drag operation on the timer drag bar is received, timer information (e.g., 12:35) for the audio playback page can be determined. Then, the determined timer information can be highlighted (e.g., the determined time information is displayed on the timer drag bar). Furthermore, based on the determined timer information, when the audio played on the audio playback page has been played for 12 minutes and 35 seconds, the application corresponding to the audio playback page can be automatically turned off.

[0055] In order to improve the user experience, after jumping from a video playback page to an audio playback page, the audio corresponding to the target video can continue to be played in a take-over manner, thereby improving the user's seamless experience when performing audio-to-video conversion.

[0056] In some embodiments, first, in response to a preset trigger operation acting on a video playback page corresponding to a target video, obtain currently playing information of the target video, and then play audio corresponding to the target video on an audio playback page based on the currently playing information of the target video, where the currently playing information includes playback state information and / or playback progress information.

[0057] In the embodiment of the present disclosure, upon receiving a preset trigger operation acting on a video playback page corresponding to a target video, obtain currently playing information of the target video, and play audio corresponding to the target video on an audio playback page according to the currently playing information, where the currently playing information includes one or more of playing status information and playing progress information, the playing status information may include playing status information, pause status information and double speed status information, and the playing progress information may include playing time length information.

[0058] For example, when a preset trigger operation is applied to a video playback page corresponding to a target video, the acquired currently playing information of the target video includes playing status information and playback time length information (e.g., played up to 47 seconds), indicating that the target video is played up to 00:47, and based on the currently playing information, the audio playback page continues to play the audio corresponding to the target video from 00:47. When a preset trigger operation is applied to a video playback page corresponding to a target video, the acquired currently playing information of the target video includes pause status information, indicating that the target video is currently in a paused state, and based on the currently playing information, the audio playback page temporarily stops playing the audio corresponding to the target video (e.g., the play / pause control on the audio playback page is in a paused state), and when a tap operation on the play / pause control is received, the audio corresponding to the target video can be resumed.

[0059] In the embodiment of the present disclosure, the number of likes, the number of comments and the comment content, and the number of forwards corresponding to the audio corresponding to the target video and the target video are all the same. Therefore, the currently playing information of the target video may further include the like information, the comment information, the forwarding information, etc. corresponding to the target video. Based on this currently playing information, when the audio corresponding to the target video is played on the audio playback page, the number of likes, the number of comments, the number of forwards, etc. of the audio corresponding to the target video can be presented on the audio playback page. Referring to the schematic diagram of some embodiments of the audio playback page in FIG. 3, the number of likes, the number of comments, and the number of forwards of the audio are respectively displayed below the avatar and user ID of the poster of the target video (e.g., user A) on the audio playback page.

[0060] In some embodiments, after playing audio corresponding to a target video on the audio playback page, a comment panel can be displayed on the audio playback page in response to a trigger operation on a preset comment control on the audio playback page.

[0061] In an embodiment of the present disclosure, the audio playback page may include a preset comment control that is previously set. For example, in the audio playback page shown in FIG. 3, the preset comment control may present the number of comments. When a tap operation is received triggered on the preset comment control displayed on the audio playback page, a comment panel may be presented on the audio playback page in the form of a semi-floating window. The comment panel presents specific comment content of the comment information corresponding to the target video, and more comment content can be viewed by manually sliding up or down.

[0062] The target video played on the video playback page is a video in the video recommendation stream distributed by the service side to the client. The video recommendation stream includes one or more recommended videos that have already been loaded locally. When jumping from the video playback page to the audio playback page and playing audio, the current recommendation stream can be replaced to recommend to the user an audio recommendation stream that is more suitable for the preset function mode (e.g., listening mode), thereby achieving the effect of content differentiation.

[0063] In some embodiments, in response to a preset first page sliding operation acting on the audio playback page, an audio information stream in which audio corresponding to the target video is located is obtained, and audio is played on the audio playback page based on the audio information stream.

[0064] In the embodiment of the present disclosure, the preset first page slide operation may include an upward or downward slide operation triggered for any position on the audio playback page. When the preset first page slide operation acting on the audio playback page is received, an audio information stream in which the audio corresponding to the target video is located is obtained. The audio in the audio information stream may include audio corresponding to each video in the video information stream already loaded locally, or may further include audio (e.g., talk shows, stand-up comedy, lectures, etc. that the user is interested in) that is recommended based on the user's interest points or trend hotspots, etc., and is more suitable for the preset function mode (e.g., listening mode). Then, the audio information stream is used to replace the video recommendation stream in which the target video is located, and the audio is played on the audio playback page based on the audio information stream. Here, the manner of playing the audio may include loop playback (e.g., loop playback of a single audio), sequential playback, etc.

[0065] For example, assume that the audio in the audio information stream includes audio corresponding to each video in the video information stream already loaded locally. Take the example that the video information stream where the target video (e.g., video A) is located further includes video B, video C, video D, etc., and when an upward slide operation on the audio playback page is received, an audio information stream where the audio a corresponding to video A is located (e.g., audio information stream 1) is obtained, and the audio information stream 1 further includes audio b corresponding to video B, audio c corresponding to video C, audio d corresponding to video D, etc. The audio a, audio b, audio c, and audio d are used to replace the video A, video B, video C, and video D, and further the audio a, audio b, audio c, and audio d are played on the audio playback page, and when a downward slide operation on the audio playback page is received, the audio is still played according to the audio information stream 1, and the playback order may be audio d-audio c-audio b-audio a.

[0066] Assume that the audio in the audio information stream is recommended based on the user's interest points or trend hotspots, etc., and includes audio that is more suitable for a preset function mode (e.g., listening mode). For example, in the case where the video information stream where the target video (e.g., video A) is located further includes video B, video C, video D, etc., when an upward sliding operation on the audio playback page is received, an audio information stream where the audio a corresponding to video A is located (e.g., audio information stream 2) is obtained, and the audio information stream 2 may include audio b' (e.g., comedy 1), audio c' (e.g., comedy 2), audio d' (e.g., comedy 3), etc., which are recommended based on the user's interest points. The audio a, audio b', audio c', and audio d' are replaced with the video A, video B, video C, and video D, and further, the audio playback page sequentially plays audios such as audio a, audio b', audio c', and audio d' based on the user's operation.

[0067] In some other embodiments, in response to a preset second page sliding operation acting on the audio playback page, a first audio playlist of the user corresponding to the target video is obtained, and audio is played on the audio playback page based on the first audio playlist, where the first audio playlist includes audio corresponding to each of the videos belonging to the user corresponding to the target video.

[0068] In an embodiment of the present disclosure, the preset second page slide operation may include a leftward or rightward slide operation triggered to any position on the audio playback page. Upon receiving the preset second page slide operation acting on the audio playback page, obtain a first audio playlist of the user corresponding to the target video, and replace the video recommendation stream where the target video is located with audio corresponding to each of the videos posted by the contributor of the target video included in the first audio playlist. Furthermore, play the audio in the first audio playlist on the audio playback page, where the manner of playing the audio may include loop playback (e.g., loop playback of a single audio), sequential playback, etc.

[0069] In some embodiments, for example, in situations where it is inconvenient for a user to operate manually, the comment content corresponding to the currently playing audio is presented to the user based on a method of automatically scrolling and presenting comments, thereby simplifying user operations and thereby improving the user experience.

[0070] In some embodiments, in response to a trigger operation on a preset first control on the audio playback page, comment information corresponding to the currently playing audio on the audio playback page is presented on the audio playback page in a preset screen scrolling mode.

[0071] In an embodiment of the present disclosure, the preset first control may include a preset audio control 302. Upon receiving a trigger operation on the preset audio control on the audio playback page, comment information corresponding to the currently played audio on the audio playback page may be presented in a preset screen scroll mode on the audio playback page. The comment information corresponding to the currently played audio may be comment information posted by other users based on a video corresponding to the currently played audio, or may be comment information posted by other users based only on the currently played audio, etc. The preset screen scroll mode may include modes such as upward scroll, downward scroll presentation, and floating presentation.

[0072] In the embodiment of the present disclosure, when a tap operation is triggered on certain comment information, the comment information can be presented in the form of a semi-floating window on the audio playback page, i.e., a comment panel can be presented, which is positioned at the position of the tapped target comment information and expands reply comment information included in the target comment information in the comment panel.

[0073] In some embodiments, a first control of a preset presents an audio cover image, which is a preset frame image of the target video.

[0074] In embodiments of the present disclosure, the first control of the preset may be a preset audio control 302, and a cover image of the audio may be presented in the preset audio control 302. For example, the cover image of the audio may include an image of any frame in the target video that corresponds to the currently playing audio of the preset, an avatar image of the contributor of the target video, etc. In some embodiments, the preset audio control 302 may be presented with an image of the first frame of the target video that corresponds to the currently playing audio.

[0075] As shown in Fig. 6, there are schematic diagrams of some embodiments of a comment information scroll panel according to an embodiment of the present disclosure. The comment information scroll panel automatically presents comment information corresponding to the currently playing audio in an upward scroll mode. The upper right corner position on the comment information scroll panel may further include an off control, and in response to a trigger operation on the off control, the user can log out of the current comment information scroll panel and return to the audio playing page.

[0076] 7 shows a schematic diagram of some embodiments of a comment panel according to an embodiment of the present disclosure. A comment panel is presented in the form of a half-floating window on an audio playback page. Upon receiving a trigger operation on the comment a in the comment information scroll panel shown in FIG. 6, the comment a and reply comment information corresponding to the comment a are presented in the comment panel shown in FIG. 7.

[0077] In some embodiments, switching between two audio playback pages can be realized based on steps A1-A3 as follows.

[0078] Step A1: In response to a trigger operation on a target avatar on an audio playback page, present a video of a user corresponding to the target avatar in a preset floating window format on the audio playback page.

[0079] Here, the target avatar is the avatar of the comment user on the audio playback page or the avatar of the user corresponding to the currently playing audio.

[0080] In the embodiment of the present disclosure, when a trigger operation is received for a user's avatar corresponding to any comment information in the comment panel deployed on the audio playback page, or a trigger operation is received for a user's avatar corresponding to the currently played audio on the audio playback page, a video of a user corresponding to the user's avatar can be presented on the audio playback page in the form of a semi-floating window. If the user corresponding to the user's avatar has not posted a video, preset hint information can be displayed in a pop-up on the audio playback page, for example, the preset hint information may include: "This user has not posted a video yet, so videos cannot be presented for a while".

[0081] Step A2: In response to a trigger operation on a first video in the video of the user corresponding to the target avatar, determine a second audio playlist based on the video of the user corresponding to the target avatar.

[0082] Here, in the second audio playlist, the audio corresponding to the first video is set as the first playback audio.

[0083] In an embodiment of the present disclosure, when a trigger operation is received for a first video in a video of a user (e.g., user B) corresponding to a target avatar based on the video of the user corresponding to the target avatar presented in step A1 above, a first audio corresponding to the first video is obtained, and a second audio playlist is determined based on the video of user B, where the second audio playlist includes audio corresponding to each of all videos posted by user B, and the first audio is set as the first played audio in the second audio playlist.

[0084] Step A3: Further, play audio on an audio playing page according to the second audio playing list.

[0085] In an embodiment of the present disclosure, audio is played on the audio playback page based on the second audio playlist determined in step A2 above, and the audio corresponding to the first video (e.g., the first audio) is set as the first played audio. When a downward slide operation is triggered to any position on the audio playback page, the audio immediately after the first audio in the second audio playlist is played, and when an upward slide operation is triggered to any position on the audio playback page, the audio immediately before the first audio in the second audio playlist is played.

[0086] In the embodiment of the present disclosure, the audio playback page in step A3 is an audio playback page corresponding to any audio in the second audio playback list. Different from presenting the audio playback page of the user's video corresponding to the target avatar in step A1, two audio playback pages can be switched.

[0087] For example, when a tap operation is triggered on a user's avatar corresponding to certain comment information in a comment panel deployed on an audio playback page A, a video of a user (e.g., user B) corresponding to the user's avatar can be presented on the audio playback page A in the form of a semi-floating window. FIG. 8 shows a schematic diagram of another embodiment of an audio playback page according to an embodiment of the present disclosure. Here, the audio playback page shown in FIG. 8 is an audio playback page A on which a video of user B (e.g., including at least video 1 to video 6 presented in FIG. 8) is presented in the form of a semi-floating window. When a trigger operation on video 4 in a video posted by user B is received, audio 4 corresponding to video 4 is obtained, and a second audio playlist determined based on the video posted by user B includes at least audio 1 to audio 6, and audio 4 is set as the first played audio. In the process of playing audio 4 on audio playback page B, triggering a downward sliding operation to any position on audio playback page B plays audio 5 in the second audio playlist, and in the process of playing audio 4 on audio playback page B, triggering a downward sliding operation to any position on audio playback page B plays audio 3 in the second audio playlist.

[0088] In the audio-video processing method according to the embodiment of the present disclosure, first, in response to a preset trigger operation acting on a video playback page corresponding to a target video, obtain an audio corresponding to the target video, which is a video in a video information stream, and then jump from the video playback page to an audio playback page, and play the audio corresponding to the target video on the audio playback page. It can be seen that the embodiment of the present disclosure can realize playing the audio corresponding to the target video on the audio playback page, and implement the audio playback on a page basis, which can meet the needs of users in more scenes, thereby improving the user experience.

[0089] In addition, the audio-video processing method according to the embodiment of the present disclosure can also support performing trigger operations on various preset controls on the audio playback page, enriching the playback control function of the audio playback page, and updating the recommended stream through the preset sliding operation on the audio playback page, realizing content differentiation, and thereby improving the user experience.

[0090] Based on the same inventive idea as the above embodiment, the embodiment of the present disclosure further provides an audio-video processing device. Referring to FIG. 9, there is shown a structural schematic diagram of some embodiments of an audio-video processing device according to the embodiment of the present disclosure, the audio-video processing device 900 includes: a first acquisition module 901 for acquiring audio corresponding to a target video, the audio being a video in a video information stream, in response to a preset trigger operation acting on a video playback page corresponding to the target video; A first playback module 902 for jumping from the video playback page to an audio playback page and playing the audio corresponding to the target video on the audio playback page.

[0091] In some embodiments, the apparatus further comprises: Further comprising a second acquisition module for acquiring currently played information of a target video in response to a preset trigger operation acting on a video playback page corresponding to the target video, where the currently played information includes playback state information and / or playback progress information; In response, the first playback module 902: a playback sub-module for playing audio corresponding to the target video on the audio playback page according to current playback information of the target video;

[0092] In some embodiments, the apparatus further comprises: a third acquisition module for acquiring an audio information stream in which an audio corresponding to the target video is located in response to a preset first page sliding operation applied to the audio playback page; and a second playback module for playing audio on the audio playback page based on the audio information stream.

[0093] In some embodiments, the apparatus further comprises: a fourth acquisition module for acquiring a first audio playlist of the user corresponding to the target video in response to a preset second page sliding operation acting on the audio playback page, the first audio playlist including audio corresponding to each of the videos belonging to the user; and a third playback module for playing audio on the audio playback page based on the first audio playlist.

[0094] In some embodiments, the apparatus further comprises: a fifth acquisition module for acquiring a video corresponding to the target audio in response to a preset return operation applied to the audio playback page for playing the target audio; and a fourth playback module for jumping from the audio playback page to the video playback page and playing a video corresponding to the target audio on the video playback page.

[0095] In some embodiments, the apparatus further comprises: The device further includes a first presentation module that, in response to a trigger operation on a preset first control on the audio playback page, presents comment information corresponding to the audio currently being played on the audio playback page in a preset screen scrolling mode on the audio playback page.

[0096] In some embodiments, the preset first control presents an audio cover image that is a preset frame image of the target video.

[0097] In some embodiments, the apparatus further comprises: The apparatus further comprises a display module for displaying a comment panel on the audio playback page in response to a trigger operation on a preset comment control on the audio playback page.

[0098] In some embodiments, the apparatus further comprises: A second presentation module, which responds to a trigger operation on a target avatar on the audio playback page by presenting a video of a user corresponding to the target avatar on the audio playback page in a preset floating window format, the target avatar being an avatar of a comment user on the audio playback page or an avatar of a user corresponding to a currently played audio; a first determination module for determining a second audio playlist based on the video of the user corresponding to the target avatar in response to a trigger operation on a first video in the video of the user corresponding to the target avatar, the first determination module setting an audio corresponding to the first video as a first playback audio in the second audio playlist; and a fifth playback module for playing audio on the audio playback page based on the second audio playlist.

[0099] In some embodiments, the apparatus further comprises: The audio playback page further includes a sixth playback module for fast-forwarding or fast-rewinding the audio corresponding to the target video at a preset time length in response to a trigger operation on a fast-forward control or a fast-rewind control on the audio playback page.

[0100] In some embodiments, the apparatus further comprises: a third presentation module that presents a timer interface on the audio playback page in response to a trigger operation on a timer control on the audio playback page; The present invention further includes a second determination module that determines timer information for the audio playback page based on the timer interface, the timer information being used to turn off an application corresponding to the audio playback page at a regular interval.

[0101] In the audio-video processing device according to the embodiment of the present disclosure, first, in response to the preset trigger operation acting on the video playback page corresponding to the target video, obtain the audio corresponding to the target video, which is a video in the video information stream, and then jump from the video playback page to the audio playback page, and play the audio corresponding to the target video on the audio playback page. It can be seen that the embodiment of the present disclosure can realize the playback of the audio corresponding to the target video on the audio playback page, and can implement the audio playback on a page basis, which can meet the needs of users in more scenes, thereby improving the user experience.

[0102] In addition to the above methods and apparatus, embodiments of the present disclosure further provide a computer-readable storage medium on which instructions are stored, which, when executed by a terminal device, cause the terminal device to realize the audio-video processing method described in the embodiments of the present disclosure.

[0103] An embodiment of the present disclosure further provides a computer program product including a computer program / instruction, which, when executed by a processor, implements the audio-video processing method according to the embodiment of the present disclosure.

[0104] Moreover, an embodiment of the present disclosure further provides an audio-video processing device, as shown in FIG. 10 , comprising: The audio / video processing device may include a processor 1001, a memory 1002, an input device 1003, and an output device 1004. The number of processors 1001 in the audio / video processing device may be one or more, and one processor is exemplified in Fig. 10. In some embodiments of the present disclosure, the processor 1001, the memory 1002, the input device 1003, and the output device 1004 may be connected via a bus or other methods, and connection via a bus is exemplified in Fig. 10.

[0105] The memory 1002 may be used to store software programs and modules, and the processor 1001 executes the software programs and modules stored in the memory 1002 to apply various functions of the audio-video processing device and process data. The memory 1002 may mainly include a program storage area and a data storage area. Here, the program storage area can store an operating system, an application required for at least one function, and the like. The memory 1002 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk memory device, a flash memory device, or other volatile solid-state memory device. The input device 1003 may be used to receive input numeric or character information and to generate signal inputs related to user settings and function control of the audio-video processing device.

[0106] In this embodiment, the processor 1001 loads executable files corresponding to the progress of one or more applications into the memory 1002 according to instructions such as the following, and the processor 1001 executes the applications stored in the memory 1002, thereby realizing various functions of the audio-video processing device.

[0107] The present disclosure also provides a computer program comprising instructions which, when executed by a processor, cause the processor to perform an audio-video processing method according to any one of the above embodiments.

[0108] It should be explained that in this specification, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, but do not necessarily require or imply that any such actual relationship or order exists between those entities or operations. And the terms "comprise", "comprises", or any other variant thereof are intended to cover a non-exclusive "comprise", whereby a process, method, article or device that includes a set of elements not only includes those elements, but also includes other elements not expressly illustrated, or further includes elements inherent to such process, method, article or device. In the absence of further limitations, an element qualified by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device that includes said element.

[0109] The above are only specific embodiments of the present disclosure, allowing those skilled in the art to understand or realize the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not limited to these embodiments described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. 1. An audio-video processing method, comprising: obtaining audio corresponding to a target video, the target video being a video in a video information stream, in response to a preset trigger operation acting on a video playback page corresponding to the target video; jumping from the video playback page to an audio playback page, and playing the audio corresponding to the target video on the audio playback page; 13. An audio-video processing method comprising:

2. before playing the audio corresponding to the target video on the audio playback page; The method further includes: in response to a preset trigger operation acting on a video playback page corresponding to a target video, obtaining currently played information of the target video, the currently played information including at least one of playback status information or playback progress information; The playing of the audio corresponding to the target video on the audio playing page includes: The audio-video processing method of claim 1 , further comprising: playing audio corresponding to the target video in the audio playback page based on currently playing information of the target video.

3. After playing the audio corresponding to the target video on the audio playback page, In response to a preset first page sliding operation acting on the audio playback page, acquiring an audio information stream in which audio corresponding to the target video is located; 3. The method of claim 1, further comprising: playing audio on the audio playback page based on the audio information stream.

4. After playing the audio corresponding to the target video on the audio playback page, In response to a preset second page sliding operation acting on the audio playback page, obtaining a first audio play list of the user corresponding to the target video, the first audio play list including audio corresponding to each of the videos belonging to the user; The audio-video processing method of claim 1 , further comprising: playing audio on the audio playback page based on the first audio playlist.

5. After playing the audio corresponding to the target video on the audio playback page, In response to a preset return operation applied to the audio playback page that plays the target audio, obtaining a video corresponding to the target audio; The audio-video processing method according to any one of claims 1 to 4, further comprising: jumping from the audio playback page to the video playback page, and playing a video corresponding to the target audio on the video playback page.

6. After playing the audio corresponding to the target video on the audio playback page, The audio-video processing method of any one of claims 1 to 5, further comprising: in response to a trigger operation on a preset first control on the audio playback page, presenting comment information corresponding to the audio currently being played on the audio playback page in a preset screen scrolling mode on the audio playback page.

7. 7. The audio-video processing method of claim 6, wherein the first preset control presents an audio cover image that is a preset frame image of the target video.

8. After playing the audio corresponding to the target video on the audio playback page, 8. The audio-video processing method of claim 1, further comprising: displaying a comment panel on the audio playback page in response to a trigger operation on a preset comment control on the audio playback page.

9. In response to a trigger operation on a target avatar on the audio playback page, presenting a video of a user corresponding to the target avatar on the audio playback page in the form of a preset floating window, where the target avatar is an avatar of a user corresponding to a comment on the audio playback page or an avatar of a user corresponding to a currently played audio; In response to a trigger operation on a first video in the video of the user corresponding to the target avatar, determining a second audio playlist based on the video of the user corresponding to the target avatar, the second audio playlist having audio corresponding to the first video as a first playback audio; The audio-video processing method of any one of claims 1 to 8, further comprising: playing audio on the audio playback page based on the second audio playlist.

10. After playing the audio corresponding to the target video on the audio playback page, An audio-video processing method as claimed in any one of claims 1 to 9, further comprising: in response to a trigger operation on a fast-forward control or a fast-rewind control on the audio playback page, fast-forwarding or fast-rewinding the audio corresponding to the target video for a preset length of time.

11. After playing the audio corresponding to the target video on the audio playback page, presenting a timer interface on the audio playback page in response to a triggering operation on a timer control on the audio playback page; The audio-video processing method of any one of claims 1 to 10, further comprising: determining timer information for the audio playback page based on the timer interface, the timer information being used to turn off an application corresponding to the audio playback page at regular intervals.

12. 1. An audio-video processing apparatus comprising: a first acquisition module for acquiring audio corresponding to a target video, the audio being a video in a video information stream, in response to a preset trigger operation acting on a video playback page corresponding to the target video; a first playback module for jumping from the video playback page to an audio playback page and playing the audio corresponding to the target video on the audio playback page; An audio-video processing device comprising:

13. A computer readable storage medium having instructions stored thereon which, when executed by a terminal device, cause the terminal device to implement the audio-video processing method of any one of claims 1 to 11.

14. 12. An audio-video processing device comprising a memory, a processor, and a computer program stored in the memory and executable by the processor, the audio-video processing device implementing the audio-video processing method of any one of claims 1 to 11 when the processor executes the computer program.

15. A computer program product comprising computer programs / instructions which, when executed by a processor, implement the audio-video processing method according to any one of claims 1 to 11.

16. A computer program comprising instructions, A computer program product comprising instructions which, when executed by a processor, cause the processor to carry out the audio-video processing method of any one of claims 1 to 11.

Images