Video playing method and device

Abstract

The embodiment of the invention discloses a video playing method and device which are applied to a user side. The method comprises the following steps: receiving a media stream of a first video file and preview data of a second video file from a server side, wherein the first video file and the second video file belong to different types of video files; the first video file is played in the first video page based on the media stream, a first sidebar window is displayed in the edge area of the first video page, preview data of the second video file is played in the first sidebar window, and the first sidebar window can be switched between an unfolded state and a hidden state; and in response to an event triggered when the first sidebar window is in the unfolded state, requesting and receiving a media stream of a second video file from the server side, skipping to a second video page, and playing the second video file on the second video page. The video watching experience of the user can be improved, and the efficiency is improved.

Description

Technical Field

[0001] The present application relates to the field of Internet application technology, and in particular to a video playback method and device. Background Art

[0002] With the rapid development of the Internet and mobile communication technologies, media playback services for mobile terminals such as mobile phones and tablets have become widely used. For example, users can watch videos anytime and anywhere through long video playback applications and short video playback applications.

[0003] However, in current video playback services, users are often limited to selecting a single video to watch, or they receive videos pushed by the server and watch them one by one. For example, in a short video playback service, the user receives a video stream pushed by the server and plays short videos one by one on the video playback page. The user can switch between short videos by swiping up and down. Obviously, this viewing experience is relatively simple and inefficient. Summary of the Invention

[0004] In view of this, the present application provides a video playback method and device to improve the user's video viewing experience and increase efficiency.

[0005] This application provides the following solutions:

[0006] In a first aspect, a video playback method is provided, which is applied to a user terminal, and the method includes:

[0007] receiving a media stream of a first video file and preview data of a second video file from a server, wherein the first video file and the second video file are video files of different types;

[0008] Playing the first video file on a first video page based on the media stream, displaying a first sidebar window in an edge area of ​​the first video page, and playing preview data of the second video file in the first sidebar window, wherein the first sidebar window is capable of switching between an expanded state and a hidden state;

[0009] In response to an event triggered when the first sidebar window is in the expanded state, the media stream of the second video file is requested from the server and received, and the second video file is jumped to the second video page and played on the second video page.

[0010] Optionally, the second video file is associated with the first video file; and / or,

[0011] The second video file is determined based on preference information of the account bound to the user terminal, and the preference information is determined by at least one of historical behavior information, attribute information, and a set preference tag of the account.

[0012] Optionally, playing the preview data of the second video file in the first sidebar window includes:

[0013] Playing preview data of the second video file for a first preset duration in the first sidebar window, and switching the first sidebar window to a hidden state in response to completion of playing the preview data of the second video file; or

[0014] There are multiple preview data of the second video file, and the preview data of the multiple second video files are played alternately in the first sidebar window until a second preset time length is reached, and the first sidebar window is switched to a hidden state.

[0015] Optionally, when the preview data of the second video file is played in the first sidebar window, at least one characteristic tag of the second video file is also displayed;

[0016] The feature tag is pre-set or determined based on the preference information of the account bound to the user terminal, and the preference information is determined by at least one of the historical behavior information, attribute information and set preference tag of the account.

[0017] Optionally, a first component is displayed on the first sidebar window, and in response to an event in which the first component is triggered, the first sidebar window is switched to a hidden state and a second component is displayed on the first video page, where an area occupied by the second component is smaller than an area where the first sidebar window is located;

[0018] In response to an event in which the second component is triggered, the first sidebar window is switched to an expanded state.

[0019] Optionally, when receiving the preview data of the second video file from the server, further receiving display position information corresponding to the preview data, the display position information being determined based on a first analysis result obtained by analyzing an area where a target object is located in a video frame of the first video file;

[0020] Displaying a first sidebar window in an edge area of ​​the first video page includes:

[0021] Based on the display position information, the display position of the first sidebar window on the first video page is determined, and the first sidebar window is displayed at the display position. The display position is located in the edge area of ​​the first video page and does not cover the area where the target object is located.

[0022] Optionally, displaying a first sidebar window in an edge area of ​​the first video page includes:

[0023] Based on the detected current operation mode of the user terminal, the display position of the first sidebar window on the first video page is determined, and the operation mode includes a left-hand operation mode and a right-hand operation mode.

[0024] Optionally, when receiving the preview data of the second video file from the server, further receiving display style information corresponding to the preview data, the display style information being determined based on a second analysis result obtained by analyzing video frame content of the first video file;

[0025] Displaying a first sidebar window in an edge area of ​​the first video page includes:

[0026] Based on the display style information, the display style of the first sidebar window on the first video page is determined, and the first sidebar window is displayed using the display style. The display style information includes at least one of the shape, transparency, brightness and color style of the first sidebar window.

[0027] Optionally, the method further includes:

[0028] When the second video file is played on the second video page, a second sidebar window is displayed in an edge area of ​​the second video page, and the first video file is played in the second sidebar window, and the second sidebar window can be switched between an expanded state and a hidden state;

[0029] In response to an event triggered when the second sidebar window is in the expanded state, jump back to the first video page and play the first video file on the first video page.

[0030] Optionally, the preview data includes at least one of the following: a video clip extracted from the second video file, a preview animation, and a preview atlas.

[0031] In a second aspect, a video playback device is provided, which is disposed on a client, and includes:

[0032] a data receiving unit configured to receive a media stream of a first video file and preview data of a second video file from a server, wherein the first video file and the second video file are video files of different types;

[0033] a page display unit, configured to play the first video file on a first video page based on the media stream, display a first sidebar window in an edge area of ​​the first video page, and play preview data of the second video file in the first sidebar window, wherein the first sidebar window is switchable between an expanded state and a hidden state;

[0034] An event monitoring unit, configured to monitor events on the first video page;

[0035] The data receiving unit is further configured to, in response to an event triggered when the first sidebar window is in an expanded state, request and receive a media stream of the second video file from the server;

[0036] The page display unit is further configured to jump to the second video page and play the second video file on the second video page in response to an event triggered when the first sidebar window is in the expanded state.

[0037] In a third aspect, a computer-readable storage medium is provided, on which a computer program is stored, and when the program is executed by a processor, the steps of any one of the methods in the first aspect are implemented.

[0038] In a fourth aspect, an electronic device is provided, including:

[0039] one or more processors; and

[0040] A memory associated with the one or more processors, the memory being used to store program instructions, wherein the program instructions, when read and executed by the one or more processors, execute the steps of the method described in any one of the first aspects above.

[0041] In a fifth aspect, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the steps of any one of the methods in the first aspect.

[0042] According to the specific embodiments provided in this application, this application discloses the following technical effects:

[0043] 1) The video playback method provided by this application enables a user to simultaneously preview other types of second video files through the first sidebar window while watching a first video file, thereby enriching the user's viewing experience. Furthermore, when a user is interested in a second video file played in the first sidebar window, the user can trigger the expanded first sidebar window to jump to the second video page to play the second video file. This significantly shortens the user's operation path for viewing other types of video files, making the operation simpler and more convenient, and improving efficiency. Furthermore, the design of the sidebar window avoids interference with the currently viewed content while allowing users to view previews of other videos at any time, allowing users to operate according to their own pace and interests, thereby enhancing the autonomy and comfort of viewing.

[0044] 2) In this application, the second video file can be associated with the first video file, so that the user can simultaneously view the preview data of the associated second video file through the first sidebar window while watching the first video file, or, the second video file is determined based on the preference information of the account bound to the user terminal, which can be more in line with the user's preferences, so that the user can simultaneously view the preview data of other types of second video files that meet the user's preferences through the first sidebar window while watching the first video file, thereby improving the user's viewing efficiency and viewing experience.

[0045] 3) In this application, the first sidebar window plays preview data of a second video file for a first preset duration, and in response to the completion of the preview data of the second video file, the first sidebar window is switched to a hidden state; or, if there are multiple preview data of the second video file, the preview data of multiple second video files are alternately played in the first sidebar window until the second preset duration is reached, and the first sidebar window is switched to a hidden state. This method allows the first sidebar to automatically retract in a timely manner after the preview of the second video file ends, ensuring the user's immersive viewing experience of the first video file.

[0046] 4) In this application, when the preview data of the second video file is played in the first sidebar window, at least one feature tag of the second video file is also displayed. The feature tag is presented in front of the content "keyword", which makes it convenient for users to quickly capture the key content information of the second video file through the tag, further improving the user's viewing efficiency and experience.

[0047] 5) In this application, a first component is displayed on the first sidebar window. This first component can be used to trigger the first sidebar window to hide and display a smaller second component, thereby reducing the first sidebar's obstruction of the first media file and ensuring the user's immersive viewing experience. Furthermore, when the user wants to continue viewing the first sidebar window, the second component can be used to trigger the first sidebar window to expand, which is convenient.

[0048] 6) In this application, the server can analyze the content of the pushed first video file to determine a suitable display position for the first sidebar window where the second video file is located, thereby minimizing the obstruction of the target object in the first video file and reducing the impact on the user's viewing experience.

[0049] 7) In this application, the user terminal can automatically identify the operation mode and use the identified left-hand operation mode or right-hand operation mode to determine the display position of the first sidebar window, so as to be more in line with the user's operating habits, facilitate user operation, and improve user efficiency and experience.

[0050] 8) In this application, the server can analyze the content of the pushed first video file to determine a display style suitable for the first sidebar window where the second video file is located, so that the display style of the first sidebar window is adapted to the content of the first video file, further improving the user's viewing experience.

[0051] 9) This application allows the first video file to be played through the second sidebar window while the second video file is playing on the second video page. This allows the user to trigger the second sidebar window to jump back to the first video page and play the first video file on the first video page. In this way, the user can switch between the two types of video files through the sidebar, making it convenient for the user to watch two types of video files at the same time, and the operation path is short, fast, and convenient.

[0052] 10) The preview data of this application includes at least one of the following: a video clip extracted from the second video file, a preview animation, and a preview atlas. Through these three preview modes, users can quickly establish a three-dimensional understanding of the content of the second video file, improving the user experience.

[0053] Of course, any product implementing the present application does not necessarily need to achieve all of the advantages described above at the same time. BRIEF DESCRIPTION OF THE DRAWINGS

[0054] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0055] Figure 1 is a system architecture diagram applicable to the embodiments of the present application;

[0056] Figure 2 A flow chart of the video playback method provided in an embodiment of the present application;

[0057] Figure 3 A schematic diagram of the expanded and hidden states of the first sidebar window provided in an embodiment of the present application;

[0058] Figure 4 A schematic diagram of the expanded position of the first sidebar window provided in an embodiment of the present application;

[0059] Figure 5 A schematic block diagram of a video playback device provided in an embodiment of the present application;

[0060] Figure 6 A schematic block diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0061] The following will be combined with the accompanying drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.

[0062] The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments and are not intended to limit the present invention. The singular forms "a", "an", "the" and "the" used in the embodiments of the present invention and the appended claims are also intended to include plural forms unless the context clearly indicates otherwise.

[0063] It should be understood that the term "and / or" as used herein is merely a description of the relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A exists alone, A and B exist simultaneously, or B exists alone. Furthermore, the character " / " in this document generally indicates that the associated objects are in an "or" relationship.

[0064] The word "if," as used herein, may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to the determination" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)," depending on the context.

[0065] In traditional video playback services, only one video is typically played on a video playback page. When switching between videos by swiping up and down, the videos playing on that page are typically of the same type. If a user wants to watch a different type of video, they need to trigger a specific component in the menu to enter a different category, then select a different type of video to play. For example, on the video playback page corresponding to the "Featured" section of a short video service, short videos of interest to the user are often played. If a user wants to watch a specific skit, they need to trigger the corresponding component in the menu to enter the skit section, then select the desired skit to play. This approach not only makes the user's switching process to play different video types very long, but also requires the user to identify and select the video they might be interested in from a large number of videos after entering the other video section. This is clearly inefficient and results in a poor user experience.

[0066] In view of this, the present application provides a new approach. To facilitate understanding of the present application, the system architecture on which the present application is based is first described. Figure 1 An exemplary system architecture to which the embodiments of the present application can be applied is shown. Figure 1 As shown in , the system architecture may include: a user end, a terminal device and a server end.

[0067] Among them, the user end is set on the terminal device. The user end involved in the embodiment of the present application can be a client running on the terminal device, a small program or a Web application running through a browser, etc.

[0068] Terminal devices may include, but are not limited to, smart mobile terminals, wearable devices, PCs (Personal Computers), smart home devices, and the like. Smart mobile devices may include, for example, mobile phones, tablets, laptops, PDAs (Personal Digital Assistants), and internet-connected car terminals. Wearable devices may include, for example, smart watches, smart glasses, smart bracelets, VR (Virtual Reality) devices, AR (Augmented Reality) devices, mixed reality devices (i.e., devices that support both virtual reality and augmented reality), and the like. Smart home devices may include, for example, smart TVs and smart refrigerators with displays.

[0069] The client can interact with the server through the network, request and obtain media files from the server and play them.

[0070] The server side can be a platform that provides video playback services. It can be a single server, a server cluster consisting of multiple servers, or even a cloud server. A cloud server, also known as a cloud computing server or cloud host, is a hosting product within the cloud computing service ecosystem. It addresses the management difficulties and poor scalability of traditional physical hosts and virtual private servers (VPS) services.

[0071] As one of the feasible ways, the user end can request the video file from the server end, and the server end transmits the video file to the user end, and the user end uses the method provided in the embodiment of the present application to play the video file.

[0072] It should be understood that Figure 1 The user end, terminal device and server end in the figure are only for illustration. According to the implementation requirements, there can be any number of user ends, terminal devices and server ends.

[0073] Figure 2 This is a flow chart of the video playback method provided in the embodiment of the present application. The method can be performed by Figure 1 The user side of the system shown is executed. Figure 2 As shown in , the method may include the following steps:

[0074] Step 201: receiving a media stream of a first video file and preview data of a second video file from a server, where the first video file and the second video file are different types of video files.

[0075] Step 203: Play the first video file on the first video page based on the media stream, display the first sidebar window in the edge area of ​​the first video page, and play the preview data of the second video file in the first sidebar window, wherein the first sidebar window can be switched between an expanded state and a hidden state.

[0076] Step 205: In response to an event triggered when the first sidebar window is in the expanded state, request and receive the media stream of the second video file from the server, jump to the second video page and play the second video file on the second video page.

[0077] It can be seen that the video playback method provided by this application enables users to simultaneously preview other types of second video files through the first sidebar window while watching the first video file, thereby enriching the user's viewing experience. Moreover, when the user is interested in the second video file played in the first sidebar window, the user can trigger the expanded first sidebar window to jump to the second video page to play the second video file. This obviously shortens the user's operation path for watching other types of video files, making the operation simpler and more convenient, and improving efficiency. In addition, the design of the sidebar window not only avoids interference with the currently watched content, but also facilitates users to view previews of other videos at any time, allowing users to operate according to their own rhythm and interests, thereby improving the autonomy and comfort of viewing.

[0078] The following describes in detail each step of the above process and the effects that can be further produced, in conjunction with the embodiments. It should be noted that the terms "first" and "second" in this disclosure do not have limitations on size, order, or quantity, but are merely used to distinguish between two video files. For example, "first video file" and "second video file" are used to distinguish between two video files.

[0079] First, the above step 201, namely "receiving the media stream of the first video file and receiving the preview data of the second video file from the server, the first video file and the second video file being different types of video files" is described in detail with reference to the embodiment.

[0080] The user terminal sends a request to the server terminal via a network connection, requesting the media stream of the first video file. Alternatively, the server terminal can push the media stream of the first video file corresponding to the video type selected by the user to the user terminal. The media stream is a continuous flow of video data. After receiving the media stream, the user terminal can play the first video file in real time on the first video page, providing the user with a smooth viewing experience.

[0081] While receiving the media stream of the first video file, the user terminal also receives preview data of the second video file from the server terminal. The preview data is a brief presentation of the second video file, which is used to help the user quickly understand the main content of the second video file.

[0082] The preview data may include but is not limited to the following forms:

[0083] Video clip: A wonderful clip extracted from the second video file, usually a short video that can quickly display the core content of the second video file.

[0084] Preview animated image: The key frames in the second video file are made into dynamic images and displayed in a loop to attract the user's visual attention.

[0085] Preview Album: Select multiple keyframes from the second video file to form a set of static images. Users can quickly understand the main scenes and content of the video by browsing these images.

[0086] The first video file can be the video currently selected by the user to watch, which is usually video content selected by the user through active search or platform recommendation. The first video file can be a long video (such as a movie, TV series, documentary, etc.) or a short video (such as a short video or Vlog uploaded by the user). Its characteristic is that the user has a high interest in and willingness to watch it. When the first video file is played on the first video page, the user terminal can display the video content in full screen or occupy the main area of ​​the page to provide the user with an immersive viewing experience.

[0087] The second video file and the first video file belong to different types of video files. These types can range from coarse-grained types like long videos and short videos to fine-grained types like movies, TV series, short dramas, documentaries, and commentary videos. For example, the first video file might be a short video, while the second video file might be a short drama. This design aims to provide users with more diverse content and choices, enriching their viewing experience while shortening the user's playback process for other video file types.

[0088] As one possible implementation, the second video file can be associated with the first video file. For example, if the first video file is a science fiction film, the second video file can be a short video related to the science fiction theme, a related commentary, or an interpretation video. For another example, if the first video file is a short video from an actor's account, the second video file can be a short play in which the actor starred.

[0089] As another achievable manner, the second video file is determined based on preference information of an account bound to the user terminal, where the preference information is determined by at least one of historical behavior information, attribute information, and a set preference tag of the account.

[0090] Historical behavior information may include, but is not limited to, video viewing behavior and video interaction behavior. For example, the server can record a user's video viewing history, including video type, viewing duration, and viewing frequency. For example, if a user frequently watches science fiction videos, the server will list science fiction videos as one of the user's preferences. The server will also record user interactions during video viewing, such as likes, comments, favorites, and shares. These behaviors can reflect the user's level of interest in certain video content.

[0091] Attribute information can be obtained from the account's registration information, such as registration location and account type, or from behavioral analysis of the account during use, such as location information and device type. For example, if the user is a teenager, the server may recommend more video content suitable for teenagers as the second video file; for example, if the user is in a Cantonese-speaking area, the server may recommend more Cantonese videos as the second video file.

[0092] Preference tags can be set by users themselves, or they can be obtained by analyzing the user's historical behavior. Preference tags can be video type information, actor information, language type information (for example, preference for Cantonese, preference for English), video theme, etc. Among them, users can customize preference tags for their own accounts, such as "science fiction movies", "food videos", etc. The server will recommend relevant video content to users as the second video file based on these customized preference tags. Alternatively, the server will adjust the preference tags based on the historical behavior of the account. For example, if an account has recently watched actor A's videos frequently, the server will automatically update the user's preference tags and add "actor A" as one of the account's preference tags.

[0093] The above step 203, namely "playing the first video file on the first video page based on the media stream, displaying the first sidebar window in the edge area of ​​the first video page, and playing the preview data of the second video file in the first sidebar window" is described in detail below in conjunction with an embodiment.

[0094] In an embodiment of the present application, a video player is created in a target area of ​​a first video page for playing the first video file. The target area may be a main area of ​​the first video page. For example, the user terminal plays the first video file in full screen or in a larger area on the page based on the received media stream.

[0095] In the edge area of ​​the first video page (such as the left or right edge), an area can be preset for displaying the first sidebar window. The sidebar window is essentially a sidebar component. In traditional applications, the sidebar window is mainly located at the edge of the page to provide additional navigation information or operation functions. The embodiment of the present application further expands the function of the sidebar component, that is, a player is created in the component to carry the preview data of the second media file. The sidebar window is suspended above the layer where the first video page is located and can be switched between an expanded state and a hidden state.

[0096] The size of the first sidebar window is typically significantly smaller than the playback area (i.e., the target area) of the first video file. Therefore, the sidebar window generally does not significantly interfere with the playback of the first video file, nor does it obstruct the main image of the first video file, while providing the user with additional information and operation access. Furthermore, the position of the sidebar window can also be flexibly adjusted based on user settings or operations.

[0097] For example, on a mobile phone or tablet device, the first sidebar window can be located on the right edge of the screen, and the user can easily reach it with the thumb; on a computer, the first sidebar window can be located on the left or right side of the screen, and the user can reach it with the mouse.

[0098] In an embodiment of the present application, the first sidebar window may have two states: an expanded state and a hidden state, and may be switched between the two states.

[0099] In the expanded state, the first sidebar window can display the preview data of the second video file, and the user can clearly see the preview content. The expanded sidebar window usually takes up a certain amount of screen space, but does not cause excessive interference with the playback of the first video file.

[0100] In the hidden state, the first sidebar window will be folded, and the size of the sidebar window in the hidden state is smaller than that of the sidebar window in the expanded state, thereby making more space for the playback of the first video file and allowing users to focus more on the video they are currently watching.

[0101] As one possible implementation method, a first component is displayed on the first sidebar window, such as Figure 3 As shown in (a), in response to the event that the first component is triggered, the first sidebar window is switched to a hidden state and the second component is displayed on the first video page, as shown in FIG. Figure 3 As shown in (b) in the figure, the area occupied by the second component is smaller than the area where the first sidebar window is located. The first component and the second component can both be in various forms such as buttons, icons, and text.

[0102] On the one hand, the second component can be used to identify the existence of the sidebar window, and on the other hand, it can also be used to trigger the expansion of the first sidebar window, that is, in response to the event that the second component is triggered, the first sidebar window is switched to the expanded state. Figure 3 When the second component shown in (b) is clicked, the following Figure 3 As shown in (a), the first sidebar window is switched to the expanded state.

[0103] As another achievable embodiment, the playback duration of the preview data of the second video file can be a first preset duration, which can be adjusted based on the type and characteristics of the video content. For example, for a short video preview, the first preset duration can be 5 seconds; for a long video preview, the first preset duration can be 10 seconds. After the preview data of the second video file is played in the first sidebar window, the user terminal automatically switches the first sidebar window to a hidden state.

[0104] As another possible implementation, the preview data of the second video file may be multiple, such as multiple video clips, multiple preview animations, or multiple preview image collections. The user terminal may alternately play these preview data in the first sidebar window until a second preset duration is reached, at which point the first sidebar window is switched to a hidden state. For example, the preview data of the second video file may be a preview image collection of a short play, containing five images, each of which is played for two seconds, for a total of 10 seconds, at which point the first sidebar window is switched to a hidden state.

[0105] Furthermore, when the preview data of the second video file is played in the first sidebar window, at least one characteristic tag of the second video file may be displayed. The characteristic tag is pre-set or determined based on preference information of an account bound to the user terminal, wherein the preference information is determined by at least one of historical behavior information, attribute information, and set preference tags of the account.

[0106] For the second video file, there are usually some tags to describe the characteristics of the second video file. For example, if the second video file is a short drama, the tags may include "free to watch", "limited time free", "popular drama", "follow the good drama", etc. The characteristic tags displayed to the user end can be pre-set by the server end, or determined based on the preference information of the account bound to the user end. For example, the server end sends the "follow the good drama" tag together with the preview data of the second video file to the user end, such as Figure 3 As shown in (a) in the figure, for example, the server side may determine, based on the preference information of the account bound to the user side, that the account prefers some free short dramas, and may then send a "free to watch" or "limited time free" tag together with the preview data of the second video file to the user side.

[0107] The user terminal can display at least one feature tag next to, above or below the preview data in the first sidebar window. The specific location can be optimized based on the interface design and user experience. The purpose is to facilitate users to quickly see the feature tag while minimizing the impact on the viewing of the second video file.

[0108] Feature labels can be static text, icons, etc., or dynamic interactive elements.

[0109] In an embodiment of the present application, the display position of the first sidebar window can be a fixed position, for example, the user terminal displays the first sidebar window fixedly in the left edge area of ​​the first video page. However, this fixed position may affect the user's viewing of the first video file in some cases. In view of this, an embodiment of the present application provides another more preferred implementation method, that is, the user terminal can also receive display position information corresponding to the preview data from the server. This display position information is used to determine the specific position of the first sidebar window on the first video page. The display position information is determined based on a first analysis result obtained by analyzing the video frame content of the first video file.

[0110] Specifically, the server side will perform content analysis on the video frame of the first video file to identify the area where the target object (such as people, important objects, key scenes, etc.) is located in the video frame. The above content analysis can be achieved through computer vision technology, such as target detection algorithms (such as YOLO, SSD and other algorithms) or semantic segmentation algorithms, to accurately identify and locate the target object in the video frame. Through the first analysis result obtained by the above content analysis, the server side can determine the display position of the first sidebar window to ensure that the first sidebar window does not cover the area where the target object is located in the video frame, thereby minimizing interference with the user's viewing of the first video file.

[0111] For example, if there is a person speaking in the video frame, the server will recognize that the area where the person is located is on the left side of the first video page, and the display position of the first sidebar window can be determined to be the right edge of the first video page.

[0112] For another example, if there is a horse running in the video frame, the server recognizes that the horse is located in a relatively wide area in the middle of the first video page. Whether it is placed on the left edge or the right edge, it may cause occlusion of the horse. In this case, the display position of the first sidebar window can be determined to be the upper edge of the first video page, such as Figure 4 As shown in .

[0113] As another feasible method, the user terminal can infer the user's operation mode by analyzing the user's operation behavior (such as the position of the touch screen, the sliding direction, etc.), where the operation mode can include the left-hand operation mode and the right-hand operation mode, and determine the display position of the first sidebar window on the first video page based on the detected operation mode currently in the user terminal. For example, if it is detected that the user terminal is in the left-hand operation mode, the user terminal can place the original video interaction area (such as the area where components such as likes, comments, favorites, and forwarding are located) on the left edge area of ​​the first video page, because the video interaction area is usually an area that users use more frequently; and place the first sidebar window on the right edge area of ​​the first video page.

[0114] In an embodiment of the present application, the display style used by the first sidebar window can be fixed. For example, the user terminal displays the first sidebar window in a fixed style. However, in some cases, this approach may not be compatible with the content of the first video file being played, affecting the user's viewing experience of the first video file. In view of this, an embodiment of the present application provides another more preferred implementation method, namely, when the user terminal receives preview data of the second video file from the server, it further receives display style information corresponding to the preview data from the server. This display style information is used to determine the display style of the first sidebar window.

[0115] The server can perform content analysis on the video frames of the first video file to identify features such as the style, hue, and scene of the video frames. For example, the server can identify whether the video frame is bright or dim, cool or warm, dynamic or static, fashionable or cute, etc. This analysis can be achieved through computer vision technology, such as image classification algorithms and color analysis algorithms. Based on the second analysis result obtained from the above content analysis, the server determines the display style of the first sidebar window. The display style information may include, but is not limited to, at least one of the shape, transparency, brightness, and color style of the first sidebar window.

[0116] For example, if the first video file is playing cartoon content, the first sidebar window may also be adaptively shaped like a heart, a bow, or other cute shapes.

[0117] For another example, the target object in the first video file usually occupies a larger area. In order to avoid the first sidebar window from affecting the first video file, the first sidebar window may be set to have a higher transparency.

[0118] For another example, if the content of the first video file uses a brighter color style, the first sidebar window can also use a brighter color style; if the content of the first video file uses warm colors, the first sidebar window can also use warm colors to unify the overall look and avoid giving users an abrupt viewing experience.

[0119] The server can transmit the analyzed display style information along with the preview data of the second video file to the user. After receiving this information, the user adjusts the visual style of the first sidebar window according to the display style information. After receiving the display style information, the user determines the specific display style of the first sidebar window based on the information.

[0120] The following describes in detail step 205, i.e., "in response to an event triggered when the first sidebar window is in an expanded state, requesting and receiving the media stream of the second video file from the server, jumping to the second video page and playing the second video file on the second video page," in conjunction with an embodiment.

[0121] If the user becomes interested in the second video file through the preview data of the second video file played in the first sidebar window and wishes to watch the second video file, the user can trigger the first sidebar window when the first sidebar window is in the expanded state, for example, by clicking in the area where the first sidebar window is located. The user end will immediately respond and send a request to the server end to request the media stream of the second video file. The request usually includes a unique identifier of the second video file (such as a video ID) so that the server end can accurately identify and provide the corresponding media stream.

[0122] In addition, the request can also include the user's device information (such as screen resolution, device type, etc.) and network conditions (such as network bandwidth, connection type, etc.), so that the server can select the appropriate media stream format and bit rate for transmission based on this information, ensuring that the user can obtain the best playback experience. After receiving the request, the server will retrieve the second video file from its storage system based on the information in the request and transmit its media stream to the user.

[0123] When the user switches from the first video page to the second video page, the second video page becomes the current playback page, and a video player is created in the target area to play the second video file. The target area can be the main area of ​​the second video page.

[0124] Furthermore, a second sidebar window can be displayed in the edge area (such as the left or right edge) of the second video page. The second sidebar window is used to play the first video file and provide the user with an entry to quickly switch back to the first video file. The second sidebar window can also be switched between an expanded state and a hidden state. The switching method, display position, display style, etc. of the second sidebar window are similar to those of the first sidebar window. Please refer to the relevant records in the previous embodiment and will not be repeated here.

[0125] Furthermore, if the user wants to return to the first video page to play the first video file, the user can trigger the second sidebar window when the second sidebar window is expanded, for example, by clicking in the area where the second sidebar window is located. In response to this triggering event, the user terminal jumps back to the first video page and continues to play the first video file on the first video page. After jumping back to the first video page, the user terminal can restore the playback status of the first video file, including playback progress, volume settings, etc.

[0126] Taking an example of the above method embodiment, for example, a user enters the "Featured" section of a short video playback application through the user terminal. The server terminal pushes a video stream of a short video of interest to the user terminal, which then plays the short video on the first video page. Simultaneously, the server terminal sends a preview clip of a short play that the user may be interested in to the user terminal. While the user terminal is playing the short video on the first video page, the preview clip of the short play is played in the first sidebar window in the edge area. This allows the user to simultaneously view the preview clip of the short play in the first sidebar window in the edge area while watching the short video. If the user is not interested, the first sidebar window can be hidden to reduce the impact on viewing the short video, and the first sidebar window can be switched back to its expanded state at any time. If the user is interested in the short play after viewing the preview clip, they can jump to the second playback page to play the short play at any time by triggering the first sidebar window. Compared to the traditional method of entering the short play section through a menu, selecting and clicking the short play of interest, this significantly shortens the operation process and directly jumps to the playback of the short play of interest, improving user efficiency and viewing experience.

[0127] Although the "short videos" and "short dramas" mentioned in the embodiments of this application are both characterized by "short duration," they are different types of video files. Short videos are independent videos that provide fragmented information and are relatively simple to produce. However, short dramas are usually serialized in episodes, have strong continuity, and have a complete narrative structure.

[0128] The foregoing description of this specification describes specific embodiments. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in an order different from that described in the embodiments and still achieve the desired results. Furthermore, the processes depicted in the accompanying drawings do not necessarily require the specific order shown or the sequential order to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0129] According to another embodiment, a video playback device is provided. Figure 5 A schematic block diagram of a video playback device according to an embodiment is shown. Figure 1 The user side of the architecture shown in Figure 1 is shown in Figure 2. Figure 5 As shown, the device 500 includes: a data receiving unit 501, an event monitoring unit 502 and a page display unit 503. The main functions of each component unit are as follows:

[0130] The data receiving unit 501 is configured to receive a media stream of a first video file and preview data of a second video file from a server, where the first video file and the second video file are of different types.

[0131] The event monitoring unit 502 is configured to monitor events on the first video page.

[0132] The page display unit 503 is configured to play the first video file on the first video page based on the media stream, and display the first sidebar window in the edge area of ​​the first video page, and play the preview data of the second video file in the first sidebar window, wherein the first sidebar window can switch between an expanded state and a hidden state.

[0133] The data receiving unit 501 is further configured to request and receive the media stream of the second video file from the server in response to an event triggered when the first sidebar window is in the expanded state.

[0134] The page display unit 503 is further configured to jump to the second video page and play the second video file on the second video page in response to an event triggered when the first sidebar window is in the expanded state.

[0135] As one possible implementation method, the second video file is associated with the first video file; and / or,

[0136] The second video file is determined based on preference information of the account bound to the user terminal, where the preference information is determined by at least one of historical behavior information, attribute information, and a set preference tag of the account.

[0137] As one possible implementation method, when the page display unit 503 plays the preview data of the second video file in the first sidebar window, it can be specifically configured as follows:

[0138] Playing preview data of a second video file of a first preset duration in the first sidebar window, and switching the first sidebar window to a hidden state in response to completion of playing the preview data of the second video file; or

[0139] There are multiple preview data of the second video file, and the preview data of the multiple second video files are played alternately in the first sidebar window until a second preset time length is reached, and the first sidebar window is switched to a hidden state.

[0140] Furthermore, when the page display unit 503 plays the preview data of the second video file in the first sidebar window, it also displays at least one feature tag of the second video file; wherein the feature tag is pre-set, or is determined based on the preference information of the account bound to the user terminal, and the preference information is determined by at least one of the account's historical behavior information, attribute information and set preference tags.

[0141] Furthermore, a first component is displayed on the first sidebar window, and the page display unit 503 can also be configured to: in response to an event in which the first component is triggered, switch the first sidebar window to a hidden state and display a second component on the first video page, where the area occupied by the second component is smaller than the area in which the first sidebar window is located; in response to an event in which the second component is triggered, switch the first sidebar window to an expanded state.

[0142] Furthermore, when the data receiving unit 501 receives the preview data of the second video file from the server, it further receives the display position information corresponding to the preview data. The display position information is determined based on the first analysis result, and the first analysis result is obtained by analyzing the area where the target object is located in the video frame of the first video file.

[0143] Accordingly, when the page display unit 503 displays the first sidebar window in the edge area of ​​the first video page, it is specifically configured to: determine the display position of the first sidebar window on the first video page based on the display position information, and display the first sidebar window at the display position, and the display position is located in the edge area of ​​the first video page and does not cover the area where the target object is located.

[0144] As one of the feasible methods, when the page display unit 503 displays the first sidebar window in the edge area of ​​the first video page, it is specifically configured to: determine the display position of the first sidebar window on the first video page based on the detected operation mode currently in which the user terminal is located, and the operation mode includes a left-hand operation mode and a right-hand operation mode.

[0145] Furthermore, when the data receiving unit 501 receives the preview data of the second video file from the server, it further receives display style information corresponding to the preview data. The display style information is determined based on the second analysis result, and the second analysis result is obtained by analyzing the video frame content of the first video file.

[0146] Accordingly, when the page display unit 503 displays the first sidebar window in the edge area of ​​the first video page, it is specifically configured to: determine the display style of the first sidebar window on the first video page based on the display style information, and display the first sidebar window using the display style, and the display style information includes at least one of the shape, transparency, brightness and color style of the first sidebar window.

[0147] Furthermore, when the second video file is played on the second video page, the page display unit 503 can also be configured to: display a second sidebar window in the edge area of ​​the second video page, play the first video file in the second sidebar window, and the second sidebar window can be switched between an expanded state and a hidden state; in response to an event triggered when the second sidebar window is in the expanded state, jump back to the first video page and play the first video file on the first video page.

[0148] The preview data of the second video file involved in the above embodiment includes at least one of the following: a video clip extracted from the second video file, a preview animation, and a preview atlas.

[0149] Each embodiment in this specification is described in a progressive manner. The same or similar parts between the embodiments can be referred to each other. Each embodiment focuses on the differences from other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple. For the relevant parts, refer to the partial description of the method embodiment. The device embodiment described above is merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. A person of ordinary skill in the art can understand and implement it without expending creative work.

[0150] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.

[0151] In addition, an embodiment of the present application further provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps of any one of the methods in the aforementioned method embodiments are implemented.

[0152] And an electronic device comprising:

[0153] one or more processors; and

[0154] A memory associated with the one or more processors, the memory being used to store program instructions, wherein the program instructions, when read and executed by the one or more processors, execute the steps of the method described in any one of the aforementioned method embodiments.

[0155] The present application also provides a computer program product, comprising a computer program, which implements the steps of any one of the methods described in the aforementioned method embodiments when executed by a processor.

[0156] in, Figure 6 The electronic device architecture is shown as an example, and may include a processor 610, a video display adapter 611, a disk drive 612, an input / output interface 613, a network interface 614, and a memory 620. The processor 610, the video display adapter 611, the disk drive 612, the input / output interface 613, the network interface 614, and the memory 620 may be communicatively connected via a communication bus 630.

[0157] The processor 610 may be implemented as a general-purpose CPU, a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and may be used to execute relevant programs to implement the technical solutions provided in this application.

[0158] The memory 620 can be implemented in the form of ROM (Read Only Memory), RAM (Random Access Memory), static storage device, dynamic storage device, etc. The memory 620 can store an operating system 621 for controlling the operation of the electronic device 600, and a basic input and output system (BIOS) 622 for controlling the low-level operations of the electronic device 600. In addition, a web browser 623, a data storage management system 624, and a video playback device 500, etc. can also be stored. The above-mentioned video playback device 500 can be an application program that specifically implements the operations of the aforementioned steps in the embodiment of the present application. In short, when the technical solution provided by the present application is implemented by software or firmware, the relevant program code is stored in the memory 620 and is called and executed by the processor 610.

[0159] The input / output interface 613 is used to connect to input / output modules to implement information input and output. The input / output modules can be configured as components within the device (not shown in the figure) or can be externally connected to the device to provide corresponding functions. Input devices may include a keyboard, mouse, touch screen, microphone, various sensors, etc., and output devices may include a display, speaker, vibrator, indicator light, etc.

[0160] The network interface 614 is used to connect to a communication module (not shown) to enable communication between the device and other devices. The communication module can communicate via a wired method (such as USB, network cable, etc.) or a wireless method (such as mobile network, WiFi, Bluetooth, etc.).

[0161] The bus 630 comprises a pathway for transmitting information between the various components of the device (eg, the processor 610 , the video display adapter 611 , the disk drive 612 , the input / output interface 613 , the network interface 614 , and the memory 620 ).

[0162] It should be noted that although the above device only shows a processor 610, a video display adapter 611, a disk drive 612, an input / output interface 613, a network interface 614, a memory 620, a bus 630, etc., in a specific implementation, the device may also include other components necessary for normal operation. In addition, it will be understood by those skilled in the art that the above device may also include only the components necessary to implement the solution of the present application, and does not necessarily include all the components shown in the figure.

[0163] Through the description of the above embodiments, it can be seen that those skilled in the art can clearly understand that the present application can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer program product, which can be stored in a storage medium such as ROM / RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in various embodiments of the present application or certain parts of the embodiments.

[0164] The above is a detailed introduction to the technical solutions provided by this application. Specific examples are used herein to illustrate the principles and implementation methods of this application. The description of the above embodiments is only intended to help understand the method and core concept of this application. At the same time, for those skilled in the art, based on the concept of this application, there may be changes in the specific implementation methods and application scope. In summary, the contents of this specification should not be understood as limiting this application.

Claims

1. A video playback method, applied to a user terminal, characterized in that: The method comprises: receiving a media stream of a first video file and preview data of a second video file from a server, wherein the first video file and the second video file are video files of different types; Playing the first video file on the first video page based on the media stream, displaying a first sidebar window in an edge area of ​​the first video page, and playing preview data of the second video file in the first sidebar window, wherein the first sidebar window is suspended above the layer where the first video page is located and can be switched between an expanded state and a hidden state; In response to an event triggered when the first sidebar window is in the expanded state, the media stream of the second video file is requested from the server and received, and the second video file is jumped to the second video page and played on the second video page.

2. The method according to claim 1, characterized in that The second video file is associated with the first video file; and / or, The second video file is determined based on preference information of the account bound to the user terminal, and the preference information is determined by at least one of historical behavior information, attribute information, and a set preference tag of the account.

3. The method according to claim 1, characterized in that Playing the preview data of the second video file in the first sidebar window includes: Playing preview data of the second video file for a first preset duration in the first sidebar window, and switching the first sidebar window to a hidden state in response to completion of playing the preview data of the second video file; or There are multiple preview data of the second video file, and the preview data of the multiple second video files are played alternately in the first sidebar window until a second preset time length is reached, and the first sidebar window is switched to a hidden state.

4. The method according to claim 3, characterized in that When playing the preview data of the second video file in the first sidebar window, at least one characteristic tag of the second video file is also displayed; The feature tag is pre-set or determined based on the preference information of the account bound to the user terminal, and the preference information is determined by at least one of the historical behavior information, attribute information and set preference tag of the account.

5. The method according to claim 1, wherein A first component is displayed on the first sidebar window. In response to an event in which the first component is triggered, the first sidebar window is switched to a hidden state and a second component is displayed on the first video page, where the area occupied by the second component is smaller than the area of ​​the area where the first sidebar window is located. In response to an event in which the second component is triggered, the first sidebar window is switched to an expanded state.

6. The method according to any one of claims 1 to 5, characterized in that When receiving preview data of the second video file from the server, further receiving display position information corresponding to the preview data, the display position information being determined based on a first analysis result obtained by analyzing an area where a target object is located in a video frame of the first video file; Displaying a first sidebar window in an edge area of ​​the first video page includes: Based on the display position information, the display position of the first sidebar window on the first video page is determined, and the first sidebar window is displayed at the display position. The display position is located in the edge area of ​​the first video page and does not cover the area where the target object is located.

7. The method according to any one of claims 1 to 5, characterized in that Displaying a first sidebar window in an edge area of ​​the first video page includes: Based on the detected current operation mode of the user terminal, the display position of the first sidebar window on the first video page is determined, and the operation mode includes a left-hand operation mode and a right-hand operation mode.

8. The method according to any one of claims 1 to 5, characterized in that When receiving preview data of the second video file from the server, further receiving display style information corresponding to the preview data, the display style information being determined based on a second analysis result obtained by analyzing video frame content of the first video file; Displaying a first sidebar window in an edge area of ​​the first video page includes: Based on the display style information, the display style of the first sidebar window on the first video page is determined, and the first sidebar window is displayed using the display style. The display style information includes at least one of the shape, transparency, brightness and color style of the first sidebar window.

9. The method according to any one of claims 1 to 5, characterized in that The method further comprises: When the second video file is played on the second video page, a second sidebar window is displayed in an edge area of ​​the second video page, and the first video file is played in the second sidebar window, and the second sidebar window can be switched between an expanded state and a hidden state; In response to an event triggered when the second sidebar window is in the expanded state, jump back to the first video page and play the first video file on the first video page.

10. The method according to any one of claims 1 to 5, characterized in that The preview data includes at least one of the following: a video clip extracted from the second video file, a preview animated image, and a preview atlas.

11. A video playback device, provided on a client, characterized in that: The device comprises: a data receiving unit configured to receive a media stream of a first video file and preview data of a second video file from a server, wherein the first video file and the second video file are video files of different types; a page display unit, configured to play the first video file on a first video page based on the media stream, display a first sidebar window in an edge area of ​​the first video page, and play preview data of the second video file in the first sidebar window, wherein the first sidebar window is switchable between an expanded state and a hidden state; An event monitoring unit, configured to monitor events on the first video page; The data receiving unit is further configured to, in response to an event triggered when the first sidebar window is in an expanded state, request and receive a media stream of the second video file from the server; The page display unit is further configured to jump to the second video page and play the second video file on the second video page in response to an event triggered when the first sidebar window is in the expanded state.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method according to any one of claims 1 to 10 are implemented.

13. An electronic device, characterized in that: include: one or more processors; as well as A memory associated with the one or more processors, the memory being used to store program instructions, wherein the program instructions, when read and executed by the one or more processors, perform the steps of the method according to any one of claims 1 to 10.

14. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 10 are implemented.

Images