Video playing method and device

Abstract

The invention provides a video playing method and device, and relates to the field of terminals, and the method comprises the steps: obtaining the first size information of a picture of a first video and the second size information of a first display area, and the first display area comprises at least a part of display area in a display screen of a first device; if the first size information is not matched with the second size information, a second display area is determined in the first display area, the second display area comprises a partial area in the first display area, and third size information of the second display area is matched with the first size information; the first video is played in the second display area, the multimedia information is played in the third display area, the third display area comprises at least part of remaining areas, except the second display area, in the first display area, and the multimedia information is generated based on the first video. According to the technical scheme provided by the invention, the black edge problem occurring during video playing is reduced, and the utilization rate of the display screen and the impression experience of a user are improved.

Description

Technical Field

[0001] The present application relates to the field of terminals, and in particular to a method and device for playing videos. Background Art

[0002] Devices such as smart screens include display screens, and videos are played through the display screens, thereby meeting user needs in a variety of scenarios such as media playback, screen projection, streaming media playback, live broadcasts, video calls, etc. When playing videos through a display screen, the size information of the video to be played may not match the size information of the display area of ​​the display screen, so that the video screen may not cover the entire display area, which in turn causes the display area to include black edges, resulting in low utilization of the display screen and a poor viewing experience for users.

[0003] In the prior art, the screen of the video to be played can be stretched based on the size information of the display screen so that the screen of the video covers all the display areas of the display screen. Although this avoids the black border problem, it will cause the screen of the video to be deformed, further reducing the user's viewing experience. Summary of the invention

[0004] In view of this, the present application provides a method and device for playing videos, which significantly reduce the black edge problem that occurs when playing videos, and improve the utilization rate of the display screen and the user's viewing experience.

[0005] In order to achieve the above-mentioned purpose, a first aspect provides a method for playing a video, which is applied to a first device, and the method includes: obtaining first size information of a picture of a first video and second size information of a first display area, the first display area including at least part of the display area in a display screen of the first device; if the first size information does not match the second size information, determining a second display area in the first display area, the second display area including part of the first display area, and third size information of the second display area matching the first size information; playing the first video in the second display area, and playing multimedia information in the third display area, the third display area including at least part of the remaining area in the first display area except the second display area, and the multimedia information is generated based on the first video.

[0006] The first video may be a video to be played; the display screen may refer to a display screen in a physical sense or a display screen in a logical sense.

[0007] In an embodiment of the present application, the first device can obtain the first size information of the screen of the first video and the second size information of the first display area. The first display area includes at least part of the display area in the display screen of the first device, so when the first size information does not match the second size information, the second display area can be determined in the first display area, the second display area includes part of the first display area, and at least part of the remaining area in the first display area except the second display area can be used as the third display area. The third size information of the second display area matches the first size information, and the first video is played in the second display area, so that the screen of the first video can cover the second display area, and the multimedia information is played in the third display area, which significantly reduces the black edge problem of the first device when playing the first video, and improves the utilization rate of the display screen and the user's viewing experience. And because the multimedia information is generated based on the first video, the multimedia information is highly correlated with the first video, which can not only provide the user with more details related to the first video, but also improve the user's attention to the first video, and further improve the user's viewing experience. The larger the third display area, the smaller the black edge, and the higher the utilization rate of the display screen and the user's viewing experience.

[0008] In some embodiments, if the aspect ratio of the first video is the same as the aspect ratio of the first display area, the first size information matches the second size information; if the aspect ratio of the first video is different from the aspect ratio of the first display area, the first size information does not match the second size information.

[0009] In some embodiments, if the horizontal width of the screen of the first video is the same as the horizontal width of the first display area, and the vertical height of the screen of the first video is the same as the vertical height of the first display area, the first size information matches the second size information; in some embodiments, if the horizontal width of the screen of the first video is different from the horizontal width of the first display area, or the vertical height of the screen of the first video is different from the vertical height of the first display area, the first size information does not match the second size information.

[0010] In some implementations, the type of multimedia information may include a static image, a dynamic image, or a video.

[0011] In some embodiments, playing the first video in the second display area and playing multimedia information in the third display area includes: when the second display area displays the first picture, the third display area displays the second picture, the first picture includes any video frame in the first video, and the second picture includes at least part of the first picture. The second picture includes at least part of the first picture, which can make the second picture more relevant to the first picture.

[0012] In some embodiments, the second display area includes a navigation window, and the fourth size information of the navigation window matches the fifth size information of the third display area; playing the first video in the second display area and playing multimedia information in the third display area includes: playing the first video in the second display area and playing the second video in the third display area, the picture of the second video is a partial picture of the picture of the first video in the navigation window.

[0013] A navigation window is displayed in the second display area, the fourth size information of the navigation window matches the fifth size information of the third display area, the first video is played in the second display area, and the second video is played in the third display area. Since the screen of the second video is the partial screen of the screen of the first video in the navigation window, it ensures that the user can continue to watch the first video in the second display area, and the detailed information of the first video in the navigation window can be displayed to the user through the third display area, further improving the user's viewing experience.

[0014] In some implementations, fourth size information may be determined based on fifth size information of the third display area, and the navigation window may be drawn in the second display area based on the fourth size information.

[0015] In some embodiments, the first video may be located in the first layer, and the first device may add a second layer above the first layer, and draw a navigation window in the second layer. The first layer and the second layer are superimposed to form a first picture seen by the user. In some embodiments, the second layer may be a transparent or semi-transparent layer, and / or the navigation window may be a transparent or semi-transparent window, thereby improving the display effect of the first video.

[0016] In some embodiments, playing the second video in the third display area includes: in response to an update operation, playing an updated second video in the third display area, the updated screen of the second video is a partial screen of the first video in the updated navigation window, the update operation is used to move the navigation window from a first position in the second display area to a second position in the second display area, or, the update operation is used to update the fourth size information of the navigation window to sixth size information, and the sixth size information matches the fifth size information.

[0017] Through the update operation, the position and / or size of the navigation window can be updated, thereby updating the second video displayed in the third display area. During the playback of the first video, the user can move the navigation window to the screen content of interest in the second screen in the second display area at any time, and watch the screen content in a larger and clearer size in the third display area, thereby further improving the user's viewing experience.

[0018] In some embodiments, playing the first video in the second display area and playing multimedia information in the third display area includes: playing the first video in the second display area and playing a first image in the third display area, the first image including at least one video frame in the first video, or the first image is an image generated based on the at least one video frame. In some embodiments, the first device may splice or fuse at least one video frame to obtain a first image. In some embodiments, the first device may directly use the acquired video frame as the first image, that is, the first image includes the at least one video frame.

[0019] In some embodiments, playing the first video in the second display area and playing multimedia information in the third display area includes: playing the first video in the second display area and playing a third video in the third display area, wherein the third video is a video generated based on at least one video frame in the first video. In some embodiments, the first device can generate the third video based on the at least one video frame.

[0020] By acquiring at least one video frame from the first video played in the second display area, then generating a first image or a third video based on the at least one video frame, and playing the first image or the third video in the third display area, it is ensured that the user can continue to watch the first video in the second display area, and more information included in the first video can be displayed to the user through the third display area, such as displaying video frames captured by the user from the first video in the third display area, or video frames with aesthetic significance and large amount of information, thereby further improving the user's viewing experience.

[0021] In some embodiments, when the second display area of ​​the first device displays the first picture, the third display area may display the second picture, wherein the first picture may include any video frame in the first video, and the second picture may include the first image or any video frame in the third video. In some embodiments, if at least one video frame acquired by the first device from the first video includes a video frame in the first picture, the second picture may also include the video frame, that is, the second picture may include at least part of the picture in the first picture.

[0022] In some embodiments, if the first image is an image obtained by splicing or fusion based on at least one video frame, the second screen may include the first image, so that the at least one video frame can be simultaneously displayed to the user through the second screen.

[0023] In some embodiments, if the first image includes at least one video frame acquired by the first device from the first video, the second picture may include part or all of the at least one video frame.

[0024] In some implementations, if the third video is played in the third display area, the second picture may include any video frame of the third video frames.

[0025] In some embodiments, the first device can perform super-resolution (SR) processing on the first image or the third video, and display the first image or the third video after super-resolution processing in the third display area, so as to purify the tiny details and enhanced features in the picture to a certain extent, and produce a clearer picture effect through a series of technical processing, bringing a comfortable and clear visual experience to the user.

[0026] In some embodiments, the first device can perform Gaussian blur processing on the first image or the third video, and display the first image or the third video after Gaussian blur processing in the third display area, so that the second picture displayed in the third display area is more blurred than the first picture displayed in the second display area, thereby making the first picture more attractive to the user and improving the user's viewing experience.

[0027] In some embodiments, the method further includes: determining at least one of a frame type, an amount of information, and an aesthetic score of a plurality of video frames in the first video; and obtaining the at least one video frame from the plurality of video frames based on at least one of the frame type, the amount of information, and the aesthetic score of the plurality of video frames. In some embodiments, taking the frame type as an example, the first device may determine the frame type of a plurality of video frames in the first video, and obtain at least one video frame whose frame type is an I frame from the plurality of video frames. In some embodiments, taking the amount of information as an example, the first device may determine the amount of information of a plurality of video frames in the first video, and obtain at least one video frame with a higher amount of information (such as greater than or equal to a preset first value) from the plurality of video frames, so that the amount of information of the obtained at least one video frame is higher than the amount of information of other video frames in the plurality of video frames; or, the difference in the amount of information of any two video frames in the plurality of video frames may be determined, and based on the correlation of the amount of information, at least one video frame with a smaller difference in the amount of information (such as less than a preset second value) is obtained from the plurality of video frames, so that the information difference of the obtained at least one video frame is similar. In some embodiments, taking aesthetic score as an example, the first device may determine aesthetic scores of multiple video frames in the first video, and obtain at least one video frame with a higher aesthetic score (e.g., higher than a preset third value) from the multiple video frames, so that the aesthetic score of the obtained at least one video frame is higher than the aesthetic scores of other videos in the multiple video frames.

[0028] In combination with the above-mentioned frame type, information amount and aesthetic score, it can be known that obtaining at least one video frame based on at least one of the frame type and information amount of the video frame can make the at least one video frame include more information or details, thereby showing more information to the user; obtaining at least one video frame based on the correlation of the information amount and at least one of the aesthetic score can make the at least one video frame more coordinated, unified, and more aesthetic, thereby bringing a more comfortable viewing experience to the user.

[0029] In some implementations, the first device may acquire a complete or partial picture of a video frame currently displayed in the second display area in response to a screenshot operation by the user.

[0030] In some implementations, the method further includes: obtaining the first video projected by the second device.

[0031] In some implementations, the method further includes: storing the multimedia information.

[0032] The multimedia information played in the third display area is information that is highly relevant to the first video played in the second display area. For example, it can provide the user with more details related to the first video. Therefore, the first device can store the multimedia information played in the third display area so that on the basis of displaying the multimedia information related to the first video to the user, the multimedia information can be further processed, thereby further improving the user experience.

[0033] In some embodiments, the first device may store the multimedia information in the first device. In some embodiments, if the first device is a first video obtained from other video sources such as the second device, the first device may send the multimedia information to other video sources such as the second device, thereby storing the multimedia information in other video sources such as the second device.

[0034] In a second aspect, a device for playing a video is provided, which has the function of realizing the device behaviors in the above aspects and possible implementation methods of the above aspects. The functions can be realized by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above functions. For example, a transceiver module or unit, a processing module or unit, an acquisition module or unit, etc.

[0035] A third aspect provides a device, comprising: a memory and a processor, wherein the memory is used to store a program; and the processor is used to execute any one of the methods described in the first aspect when calling the program.

[0036] A fourth aspect provides a chip system, the chip system comprising a processor, the processor coupled to a memory, the processor executing a program stored in the memory to implement any of the methods described in the first aspect. The chip system may be a single chip or a chip module composed of multiple chips.

[0037] The fifth aspect provides a readable storage medium having a program stored thereon, and when the program is executed by a processor, the method described in any one of the above-mentioned first aspects is implemented.

[0038] A sixth aspect provides a program product, which, when executed on a device, enables the device to execute any one of the methods described in the first aspect.

[0039] It can be understood that the beneficial effects of the second to sixth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 A schematic diagram of the structure of a device provided in an embodiment of the present application;

[0041] Figure 2A schematic diagram of a video playback interface provided in an embodiment of the present application;

[0042] Figure 3 A schematic diagram of another video playback interface provided in an embodiment of the present application;

[0043] Figure 4 A flowchart of a method for playing a video provided in an embodiment of the present application;

[0044] Figure 5 A schematic diagram of a display area provided in an embodiment of the present application;

[0045] Figure 6 A schematic diagram of another video playback interface provided in an embodiment of the present application;

[0046] Figure 7 A schematic diagram of another video playback interface provided in an embodiment of the present application;

[0047] Figure 8 A schematic diagram of another video playback interface provided in an embodiment of the present application;

[0048] Fig. 9 A schematic diagram of another display area provided in an embodiment of the present application;

[0049] Fig.10 A schematic diagram of another video playback interface provided in an embodiment of the present application;

[0050] Fig.11 A schematic diagram of another video playback interface provided in an embodiment of the present application;

[0051] Fig.12 A flowchart of another method for playing a video provided in an embodiment of the present application;

[0052] Fig.13 A flowchart of another method for playing a video provided in an embodiment of the present application;

[0053] Fig.14 A schematic diagram of another video playback interface provided in an embodiment of the present application;

[0054] Fig.15 A schematic diagram of another video playback interface provided in an embodiment of the present application;

[0055] Fig.16 A schematic diagram of another video playback interface provided in an embodiment of the present application;

[0056] Fig.17 A flowchart of a method for playing a video provided in an embodiment of the present application. DETAILED DESCRIPTION

[0057] The method for playing videos provided in the embodiments of the present application can be applied to smart screens, large-screen devices, televisions, mobile phones, tablet computers, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA) and other devices. The embodiments of the present application do not impose any restrictions on the specific types of devices.

[0058] Figure 1 1 is a schematic diagram of a structure of a device 100 provided in an embodiment of the present application. The device 100 may include a processor 110, a memory 120, a communication module 130, a display screen 140, and the like.

[0059] The processor 110 may include one or more processing units, and the memory 120 is used to store program codes and data. In the embodiment of the present application, the processor 110 may execute the program codes stored in the memory 120 to control and manage the actions of the device 100.

[0060] The communication module 130 can be used for communication between various internal modules of the device 100, or communication between the device 100 and other external devices. For example, if the device 100 communicates with other devices via a wired connection, the communication module 130 may include an interface, such as a USB interface. The USB interface may be an interface that complies with USB standard specifications, specifically a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface can be used to connect a charger to charge the device 100, and can also be used to transmit data between the device 100 and peripheral devices. It can also be used to connect headphones to play audio through the headphones.

[0061] Alternatively, the communication module 130 may include an audio device, a radio frequency circuit, a Bluetooth chip, a wireless fidelity (Wi-Fi) chip, a near-field communication (NFC) module, etc., and the interaction between the device 100 and other devices can be achieved in a variety of different ways.

[0062] The display screen 140 can display images or videos in the human-computer interaction interface. In some embodiments, the display screen 140 can be a flexible screen, and the display screen 140 can form a larger display screen by stretching or unfolding the flexible screen, or can form a smaller display screen by curling or folding. In some embodiments, the device 100 may include multiple display screens 140, and multiple display screens 140 can be spliced / connected to form a larger display screen. It can be understood that in the embodiment of the present application, a display screen can refer to a display screen in a physical sense or a display screen in a logical sense. For example, the display screen 140 is a folding screen, including a first screen and a second screen in a folded state, and a third screen composed of the first screen and the second screen in an unfolded state. If the folding screen is folded by an active mechanism such as a hinge between the first screen and the second screen, the first screen and the second screen can be respectively a display screen in a physical sense, and the third screen can be a display screen in a logical sense. If the folding screen is folded by bending the relatively soft screen area between the first screen and the second screen, the first screen and the second screen can be respectively a display screen in a logical sense, and the third screen can be a display screen in a physical sense.

[0063] Optionally, the device 100 may further include a peripheral device 150 , such as a remote control, a mouse, a keyboard, a speaker, a microphone, etc.

[0064] It should be understood that, in addition to Figure 1 In addition to the various components or modules listed in the figure, the present embodiment of the application does not specifically limit the structure of the device 100. In other embodiments of the present application, the device 100 may also include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure can be implemented in hardware, software, or a combination of software and hardware.

[0065] In order to facilitate understanding of the technical solutions in the embodiments of the present application, the application scenarios of the embodiments of the present application are first introduced below.

[0066] Devices such as smart screens include display screens, and videos are played through the display screens to meet user needs in various scenarios such as media playback, screen projection, streaming media playback, live broadcasts, video calls, etc. A video may include multiple video frames, and the device may display video frames on the display screen to form a picture. The size information of the display area of ​​the display screen may be a fixed value. For example, the aspect ratio of the display area of ​​a smart screen may be 16:9, and the aspect ratio of the display area of ​​a mobile phone may be 18.5:9, 19.5:9, or 20:9. The size information of the video screen is determined by other devices that generate the video. For different videos, the video screen may have different size information. Therefore, when playing a video through a display screen, the size information of the video screen may not match the size information of the display area of ​​the display screen, so that the video screen may not cover the display area, which in turn causes the display area to include black edges (also referred to as blank areas).

[0067] Please refer to Figure 2 , is a schematic diagram of a video playback interface provided in an embodiment of the present application. The screen of the video played on the display screen only occupies about one-third of the center area of ​​the display screen, and the remaining two-thirds of the area are black borders. It can be seen that when the size information of the video screen does not match the size information of the display area of ​​the display screen, the black borders will not only lead to low utilization of the display screen, but also bring a poor viewing experience to the user.

[0068] In some implementations, the device may stretch the video to be played based on the size information of the display screen so that the video fills all display areas of the display screen. This may avoid the black border problem but may cause the video to be distorted, further reducing the user's viewing experience. Figure 3 As shown, after the video image is stretched to cover the entire display area of ​​the display screen, the content in the image of the video has been severely deformed.

[0069] In order to solve at least part of the above technical problems, the embodiment of the present application provides another method for playing a video. In this method, the first size information of the screen of the first video and the second size information of the first display area can be obtained. The first display area includes at least part of the display area in the display screen of the first device, so when the first size information does not match the second size information, the second display area can be determined in the first display area, the second display area includes part of the first display area, and at least part of the remaining area in the first display area except the second display area can be used as the third display area. The third size information of the second display area matches the first size information, and the first video is played in the second display area, so that the screen of the first video can be covered with the second display area, and the multimedia information is played in the third display area, which significantly reduces the black edge problem of the first device when playing the first video, and improves the utilization rate of the display screen and the user's viewing experience. And because the multimedia information is generated based on the first video, the multimedia information is highly correlated with the first video, which can not only provide the user with more details related to the first video, but also improve the user's attention to the first video, and further improve the user's viewing experience.

[0070] The technical solution of the present application is described in detail with specific embodiments below. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

[0071] Please refer to Figure 4 , is a flow chart of a method for playing a video provided in an embodiment of the present application. It should be noted that the method is not based on Figure 4 The specific order described below is a limitation, and it should be understood that in other embodiments, the order of some steps in the method can be interchanged according to actual needs, or some steps can be omitted or deleted. The method includes the following steps:

[0072] S401, a first device obtains first size information of a first video screen and second size information of a first display area, where the first display area includes at least a portion of a display area in a display screen of the first device.

[0073] The first video may be a video to be played.

[0074] In some embodiments, the first device may, when detecting a corresponding operation or data (e.g., video, audio, image, text, or streaming media), obtain first size information of the first video screen and second size information of the first display area in response to the operation or video. In some embodiments, the first video is a video stored by the first device. Exemplarily, the first device displays a video list to the user, the video list includes the first video, the user clicks on the first video, and the first device may obtain the first video in response to the user's click.

[0075] In some embodiments, the first video may be a streaming media sent by the second device. Exemplarily, the second device may be a device with a screen projection function such as a mobile phone, and the first device receives the first video projected by the second device. Exemplarily, the second device may be a server, and the first device may establish a network connection with the second device, and obtain a video list from the second device based on the network connection, the video list including the first video, and the user clicks on the first video, and the first device may obtain the first video from the second device in response to the user's click. Exemplarily, the second device may be a device including a camera, and the user may turn on the camera function of the second device and send the first video shot to the first device, and the first device may obtain the first video shot by the second device.

[0076] The first size information is used to indicate the size of the screen of the first video. In some embodiments, the first size information includes the aspect ratio of the screen of the first video, that is, the ratio between the horizontal width and the vertical height of the screen of the first video. In some embodiments, the first size information includes the horizontal width and the vertical height of the screen of the first video.

[0077] In some embodiments, the first size information may be carried in the first video, and the first device may obtain the first size information from the first video. In some embodiments, the first device may identify the size of the video frame included in the first video, thereby determining the first size information. In some embodiments, the first device may obtain the first size information from the video source of the first video. For example, when the first device obtains the first video projected by the second device, the first device may obtain the first size information from the second device.

[0078] It is understandable that, in actual applications, the first device may also obtain the first video from other video sources, and may also obtain the first size information of the first video screen in other ways.

[0079] The first display area may include at least a portion of the display area in the display screen of the first device. The display screen may refer to a display screen in a physical sense or a display screen in a logical sense. The second size information may be used to indicate the size of the first display area. In some embodiments, the second size information includes the aspect ratio of the first display area, that is, the ratio between the horizontal width and the vertical height of the first display area. In some embodiments, the second size information includes the horizontal width and the vertical height of the first display area. In some embodiments, the first display area includes the entire display area of ​​the display screen, and the second size information is used to indicate the size of the display screen.

[0080] In some embodiments, since the display screen of the first device does not change after the first device leaves the factory, the first device can obtain the second size information from the first device. In some embodiments, the display screen includes a memory for storing relevant information of the display screen, and the first device can obtain the second size information of the display screen from the memory.

[0081] It is understandable that, in actual applications, the first device may also determine the first display area and obtain the second size information of the first display area in other ways.

[0082] S402, if the first size information does not match the second size information, the first device determines a second display area in the first display area, the second display area includes a portion of the first display area, and third size information of the second display area matches the first size information.

[0083] When the first device obtains the first size information and the second size information, the first size information and the second size information can be compared. If the first size information matches the second size information, the picture of the first video can fill the first display area, so the first video can be played directly in the first display area. If the first size information does not match the second size information, the picture of the first video cannot fill the first display area. If the first video is displayed directly in the first display area, the first display area may include some black edges. Therefore, in order to improve the utilization rate of the display screen and the user's viewing experience, the first device can determine the second display area in the first display area, and the third size information of the second display area matches the first size information.

[0084] In some embodiments, if the aspect ratio of the first video is the same as the aspect ratio of the first display area, the first size information matches the second size information; if the aspect ratio of the first video is different from the aspect ratio of the first display area, the first size information does not match the second size information.

[0085] In some embodiments, if the horizontal width of the screen of the first video is the same as the horizontal width of the first display area, and the vertical height of the screen of the first video is the same as the vertical height of the first display area, the first size information matches the second size information; in some embodiments, if the horizontal width of the screen of the first video is different from the horizontal width of the first display area, or the vertical height of the screen of the first video is different from the vertical height of the first display area, the first size information does not match the second size information.

[0086] The second display area is used to play the second video, and the third size information of the second display area is used to indicate the size of the second display area. In some embodiments, the third size information includes the aspect ratio of the second display area, that is, the ratio between the horizontal width and the vertical height of the second display area. In some embodiments, the third size information includes the horizontal width and the vertical height of the second display area.

[0087] It can be understood that the method of determining whether the third size information matches the first size information can be the same or similar to the method of determining whether the first size information matches the second size information, and will not be repeated here.

[0088] S403, the first device plays the first video in the second display area, and plays multimedia information in the third display area, the third display area includes at least part of the remaining area in the first display area except the second display area, and the multimedia information is generated based on the first video.

[0089] Since the third size information of the second display area matches the first size information of the screen of the first video, playing the first video in the second display area can make the screen of the first video cover the second display area. In addition, multimedia information can be played in at least part of the remaining area of ​​the first display area except the second display area, that is, the third display area, which can significantly reduce the area of ​​the black border in the first display area, improve the utilization rate of the display screen and the user's viewing experience. The larger the third display area, the smaller the black border, the higher the utilization rate of the display screen and the user's viewing experience. In addition, since the multimedia information is generated based on the first video, the multimedia information is highly correlated with the first video, which can not only provide the user with more details related to the first video, but also increase the user's attention to the first video, further improving the user's viewing experience.

[0090] In some embodiments, the third display area may include all remaining areas in the first display area except the second display area, so that when the first video is played in the second display area and the multimedia information is played in the third display area, there is no black border in the first display area, further improving the utilization rate of the display screen and the user's viewing experience.

[0091] In some implementations, the type of multimedia information may include a static image, a dynamic image, or a video.

[0092] In some embodiments, when the second display area displays the first picture, the third display area displays the second picture, the first picture includes any video frame in the first video, and the second picture may include at least a portion of the first picture. The second picture includes at least a portion of the first picture, which can make the second picture more relevant to the first picture.

[0093] For example, the first device is a smart screen, the second device is a mobile phone, the entire display area of ​​the display screen of the smart screen is the first display area, and the first video is the video projected from the mobile phone to the smart screen.

[0094] In some examples, such as Figure 5 As shown, the first device can determine a portion of the display area near the center of the first display area as the second display area, and the aspect ratio of the second display area is the same as the aspect ratio of the first video. In addition, the area on the left and / or right of the second display area can be used as the third display area. The first device can play the first video in the second display area and play multimedia information in the third display area, such as Figure 6-Figure 8 shown.

[0095] exist Figure 6 In the video playback interface shown, the third display area includes the entire display area on the left side of the second display area. The first device displays an image in the third display area on the left side of the second display area, and the image covers the entire third display area on the left side of the second display area, and the right side of the second display area is still black. Figure 2 compared to, Figure 6 The video playback interface shown has the black border reduced by half.

[0096] exist Figure 7 In the video playback interface shown, the third display area includes the entire display area on the left side and the entire display area on the right side of the second display area. The first device displays an image in the third display area on the left side of the second display area, and displays another image in the third display area on the right side of the second display area, and these two images cover the entire third display area. Figure 2 compared to, Figure 7The video playback interface shown does not have any black edges; on the other hand, the image in the third display area to the right of the second display area is the same as the picture in the first video in the second display area.

[0097] exist Figure 8 In the video playback interface shown, the third display area includes a portion of the display area on the left side and a portion of the display area on the right side of the second display area. The first device displays an image in the third display area on the left side of the second display area, and displays another image in the third display area on the right side of the second display area, and both the upper and lower sides of the two images include black borders. Figure 2 compared to, Figure 8 The video playback interface shown includes only a small black border; on the other hand, the image in the third display area is similar to a portion of the first video in the second display area.

[0098] In some examples, such as Fig. 9 As shown, the first device can determine a portion of the display area near the edge of the first display area as the second display area, and the aspect ratio of the second display area is the same as that of the first video. In addition, at least a portion of the right side of the second display area can be used as the third display area. The first device can play the first video in the second display area and play multimedia information in the third display area, such as Fig.10 and Fig.11 shown.

[0099] exist Fig.10 In the video playback interface shown, the third display area includes part of the display area on the right side of the second display area. The first device displays an image in the third display area on the left side of the second display area, and the image covers the entire third display area, and the right side of the third display area is still black. Figure 2 compared to, Fig.10 The video playback interface shown has the black border reduced by half.

[0100] exist Fig.11 In the video playback interface shown, the third display area includes the entire display area to the right of the second display area. The first device displays two images side by side in the third display area to the left of the second display area, and the two images cover the entire third display area. Figure 2 compared to, Fig.11 The video playback interface shown does not have any black edges; on the other hand, the image in the third display area is similar to a portion of the first video in the second display area.

[0101] It should be noted that the embodiments of this application are only based on the above Figure 6-Figure 11As an example, the division method of the second display area and the third display area, and the method of displaying multimedia information in the third display area are described, but not limited.

[0102] In addition, the first device plays the first video in the second display area and plays the multimedia information in the third display area, which can also refer to the following Figure 12-13 Related description.

[0103] S404: The first device stores the multimedia information played in the third display area.

[0104] The multimedia information played in the third display area is information that is highly relevant to the first video played in the second display area, for example, it can provide the user with more details related to the first video. Therefore, the first device can store the multimedia information played in the third display area, so that on the basis of displaying the multimedia information related to the first video to the user, the multimedia information can be further processed, thereby further improving the user experience. For example, the stored multimedia information can be used for the user to watch again, or the user can further edit or otherwise process the media information.

[0105] In some embodiments, the first device may store the multimedia information in the first device. In some embodiments, if the first device is a first video obtained from other video sources such as the second device, the first device may send the multimedia information to other video sources such as the second device, thereby storing the multimedia information in other video sources such as the second device.

[0106] In some embodiments, the first device may display a first prompt message to the user after the first video is played, and the first prompt message may be used to ask the user whether to store the multimedia information and / or the method of storing the multimedia information. If the first device receives one or more operations of the user on the first prompt message, the first device stores the multimedia information based on the storage method indicated by the user in response to the one or more operations.

[0107] In some implementations, S404 may be omitted.

[0108] In an embodiment of the present application, the first device can obtain the first size information of the screen of the first video and the second size information of the first display area. The first display area includes at least part of the display area in the display screen of the first device, so when the first size information does not match the second size information, the second display area can be determined in the first display area, the second display area includes part of the first display area, and at least part of the remaining area in the first display area except the second display area can be used as the third display area. The third size information of the second display area matches the first size information, and the first video is played in the second display area, so that the screen of the first video can cover the second display area, and the multimedia information is played in the third display area, which significantly reduces the black edge problem of the first device when playing the first video, and improves the utilization rate of the display screen and the user's viewing experience. And because the multimedia information is generated based on the first video, the multimedia information is highly correlated with the first video, which can not only provide the user with more details related to the first video, but also improve the user's attention to the first video, and further improve the user's viewing experience.

[0109] Please refer to Fig.12 , is a flow chart of a method for playing a video provided by an embodiment of the present application. The multimedia information may include a first image or a third video. It should be noted that the method does not Fig.12 The specific order described below is a limitation, and it should be understood that in other embodiments, the order of some steps in the method can be interchanged according to actual needs, or some steps can be omitted or deleted. The method includes the following steps:

[0110] S1201: A first device obtains at least one video frame from a first video.

[0111] In some embodiments, the first device may determine at least one of a frame type, an amount of information, and an aesthetic score of multiple video frames in the first video; and obtain at least one video frame from the multiple video frames based on at least one of the frame type, the amount of information, and the aesthetic score of the multiple video frames.

[0112] In some embodiments, the first video is a video stored in the first device, that is, all video frames of the first video are stored in the first device, so the multiple video frames may include all video frames in the first video, and may also include any partial video frames in the first video. Exemplarily, the first video includes 100 video frames, and the 37th video frame is currently displayed in the second display area. The multiple video frames in the first video may include the 37th video frame, and may also include the first 36 video frames that have been displayed, and may also include the last 63 video frames that have not yet been displayed.

[0113] In some embodiments, the first video is a streaming media obtained by the first device from the second device, and the first device may only store the video frames that have been displayed and the video frames that are currently being displayed, so the multiple video frames may include all or part of the video frames that the first device has obtained from the second device. Exemplarily, the 37th video frame of the first video is currently displayed in the second display area, and the multiple video frames may include the 37th video frame, and may also include the first 36 video frames that have been displayed.

[0114] The frame type of a video frame may include an I frame, a B frame, or a P frame. An I frame refers to a complete picture, which can be decoded without referring to any other frame. A P frame refers to a forward reference frame, which needs to refer to the previous video frame to correctly decode the data. A B frame refers to a bidirectional reference frame, which needs to refer to the previous frame data and the next frame data to normally decode the data. In some embodiments,

[0115] Taking the frame type as an example, the first device may determine the frame types of multiple video frames in the first video, and obtain at least one video frame whose frame type is an I frame from the multiple video frames.

[0116] The amount of information is a measure of the amount of information in an image. The higher the resolution of an image, the greater the amount of information in the image. In some embodiments, taking the amount of information as an example, the first device may determine the amount of information of multiple video frames in the first video, and obtain at least one video frame with a higher amount of information (such as greater than or equal to a preset first value) from the multiple video frames, so that the amount of information of the at least one video frame obtained is higher than the amount of information of other video frames in the multiple video frames; or, the difference in the amount of information of any two video frames in the multiple video frames may be determined, and based on the correlation of the amount of information, at least one video frame with a smaller difference in the amount of information (such as less than a preset second value) is obtained from the multiple video frames, so that the information difference of the at least one video frame obtained is similar. It can be understood that in actual applications, other methods can also be used to obtain at least one video frame from the multiple videos based on the amount of information of the multiple video frames.

[0117] The aesthetic score can be used to indicate the subjective beauty of the image. In some embodiments, the higher the aesthetic score of the image, the more the image matches the user's aesthetic ability. In some embodiments, the aesthetic score of the image can be determined by at least one aspect of the image features such as the color, chromaticity, brightness, contrast, spatial composition, foreground and background matching of the image. And it can be understood that the embodiment of the present application does not limit the method for determining the aesthetic score of the image. In some embodiments, taking the aesthetic score as an example, the first device can determine the aesthetic scores of multiple video frames in the first video, and obtain at least one video frame with a higher aesthetic score (for example, higher than a preset third value) from the multiple video frames, so that the aesthetic score of the at least one video frame obtained is higher than the aesthetic score of other videos in the multiple video frames.

[0118] In combination with the above-mentioned frame type, information amount and aesthetic score, it can be known that obtaining at least one video frame based on at least one of the frame type and information amount of the video frame can make the at least one video frame include more information or details, thereby showing more information to the user; obtaining at least one video frame based on the correlation of the information amount and at least one of the aesthetic score can make the at least one video frame more coordinated, unified, and more aesthetic, thereby bringing a more comfortable viewing experience to the user.

[0119] In some implementations, the first device may acquire a complete or partial picture of a video frame currently displayed in the second display area in response to a screenshot operation by the user.

[0120] It should be understood that in actual applications, the first device may also obtain at least one video frame from the first video in other ways.

[0121] S1202: The first device generates a first image or a third video based on at least one video frame.

[0122] In some implementations, the first device may splice or fuse at least one video frame to obtain a first image.

[0123] In some implementations, the first device may directly use the acquired video frame as the first image, that is, the first image includes the at least one video frame.

[0124] In some implementations, the first device may generate a third video based on the at least one video frame.

[0125] S1203: The first device plays the first video in the second display area, and plays the first image or the third video in the third display area.

[0126] Since the first image includes at least one video frame in the first video frame, or the first image or the third video can be generated based on the at least one video frame, and the at least one video frame is obtained from the first video based on at least one of the frame type, the amount of information and the aesthetic score, the first device plays the first video in the second display area, ensuring that the user can continue to watch the first video, and plays the first image or the third video in the third display area, which can show the user more information included in the first video, further improving the user's viewing experience.

[0127] In some embodiments, when the second display area of ​​the first device displays the first picture, the third display area may display the second picture, wherein the first picture may include any video frame in the first video, and the second picture may include the first image or any video frame in the third video. In some embodiments, if at least one video frame acquired by the first device from the first video includes a video frame in the first picture, the second picture may also include the video frame, that is, the second picture may include at least part of the picture in the first picture.

[0128] In some embodiments, if the first image is an image obtained by splicing or fusion based on at least one video frame, the second screen may include the first image, so that the at least one video frame can be simultaneously displayed to the user through the second screen.

[0129] In some embodiments, if the first image includes at least one video frame obtained by the first device from the first video, the second picture may include part or all of the at least one video frame. Exemplarily, the first device may arrange all of the at least one video frame for display in the third display area, then the second picture may include each of the at least one video frame, and the display interface of the first device may be as described above. Figure 7 , Figure 8 and Fig.11 Alternatively, the first device may display the at least one video frame in turn in the third display area, then the second picture may include only one video frame of the at least one video frame at the same time, and the display interface of the first device may be as described above. Figure 6 and Fig.10 shown.

[0130] exist Figure 6 In the example, the multimedia information on the left side of the first video may be a first image, and the first image may be any video frame in the first video. Exemplarily, the first image may be a video frame obtained by the first device from the first video through aesthetic scoring.

[0131] exist Figure 7In the example, the multimedia information on both sides of the first video may be the first image, and the first image on the left side of the first video may be any video frame that has been played in the first video, and the first image on the right side of the first video may be a video frame currently played in the first video. Exemplarily, the first image on the left side of the first video may be a video frame obtained from the first video by the first device through aesthetic scoring, and the first image on the right side of the first video may be obtained by the user taking a full-screen screenshot of the video frame currently played in the first video.

[0132] exist Figure 8 In the example, the multimedia information on both sides of the first video may be first images, and the first images on the left and right sides of the first video are the same. Exemplarily, the first image may be obtained by a user taking a partial screenshot of a video frame currently being played of the first video.

[0133] exist Fig.10 In the example, the multimedia information on the right side of the first video may be a first image. Exemplarily, the first image may be a video frame obtained by the first device from the first video through aesthetic scoring.

[0134] exist Fig.11 In the example, the multimedia information on the right side of the first video may be the first image. For example, the first image may be obtained by the user taking partial screenshots of two different regions of the video frame currently playing the first video. Alternatively, the first image may be obtained by the user taking a full-screen screenshot of the video frame currently playing the first video and then cropping it from two different regions of the video frame.

[0135] In some implementations, if the third video is played in the third display area, the second picture may include any video frame of the third video frames.

[0136] In some embodiments, the first device may perform super-resolution processing on the first image or the third video, and display the first image or the third video after super-resolution processing in the third display area. Among them, super-resolution processing refers to the technology of reconstructing a low-resolution image through relevant image quality to present a corresponding high-resolution image, which can purify the tiny details and enhanced features in the picture to a certain extent, and produce a clearer picture effect after a series of technical processing, bringing a comfortable and clear visual experience to the user. In some embodiments, the first image or the third video can be super-resolution processed based on an image difference method or a deep learning method.

[0137] In some embodiments, the first device can perform Gaussian blur processing on the first image or the third video, and display the first image or the third video after Gaussian blur processing in the third display area, so that the second picture displayed in the third display area is more blurred than the first picture displayed in the second display area, thereby making the first picture more attractive to the user and improving the user's viewing experience.

[0138] In an embodiment of the present application, at least one video frame can be obtained from the first video played in the second display area, and then a first image or a third video can be generated based on the at least one video frame, and the first image or the third video can be played in the third display area, which not only ensures that the user can continue to watch the first video in the second display area, but also can display more information included in the first video to the user through the third display area, such as displaying video frames captured by the user from the first video in the third display area, or video frames with aesthetic significance and large amount of information, to further improve the user's viewing experience.

[0139] Please refer to Fig.13 , is a flow chart of a method for playing a video provided in an embodiment of the present application. The multimedia information includes a second video. It should be noted that the method does not Fig.13 The specific order described below is a limitation, and it should be understood that in other embodiments, the order of some steps in the method can be interchanged according to actual needs, or some steps can be omitted or deleted. The method includes the following steps:

[0140] S1301: The first device displays a navigation window in the second display area, and fourth size information of the navigation window matches fifth size information of the third display area.

[0141] The navigation window may be used to guide the user to configure the range of the second video played in the third display area. The fourth size information may be used to indicate the size of the navigation window. In some embodiments, the fourth size information includes the aspect ratio of the navigation window, that is, the ratio between the horizontal width and the vertical height of the navigation window. In some embodiments, the fourth size information includes the horizontal width and the vertical height of the navigation window.

[0142] The fifth size information is used to indicate the size of the third display area. In some embodiments, the fifth size information includes the aspect ratio of the third display area, that is, the ratio between the horizontal width and the vertical height of the third display area. In some embodiments, the fifth size information includes the horizontal width and the vertical height of the third display area.

[0143] In some implementations, fourth size information may be determined based on fifth size information of the third display area, and the navigation window may be drawn in the second display area based on the fourth size information.

[0144] In some embodiments, the first video may be located in the first layer, and the first device may add a second layer above the first layer, and draw a navigation window in the second layer. The first layer and the second layer are superimposed to form a first picture seen by the user. In some embodiments, the second layer may be a transparent or semi-transparent layer, and / or the navigation window may be a transparent or semi-transparent window, thereby improving the display effect of the first video.

[0145] For example, Fig.14 As shown, the second display area is located on the left side of the display screen, and all display areas to the right of the second display area are the third display area. If the third display area has a horizontal width of 60 cm, a vertical height of 50 cm, and an aspect ratio of 6:5, the first device can display a navigation window with a width of 12 cm, a height of 10 cm, and an aspect ratio of 6:5 in the second display area.

[0146] S1302, the first device plays the first video in the second display area, and plays the second video in the third display area, the screen of the second video is the partial screen of the screen of the first video in the navigation window.

[0147] In some embodiments, when the second display area of ​​the first device displays the first picture, the third display area may display the second picture, wherein the first picture may include any video frame in the first video, and the second picture may include a portion of the first picture within the navigation window.

[0148] For example, Fig.14 As shown, a navigation window is included at the bottom of the second display area. When the first device displays the first picture in the second display area, the navigation window includes a sitting image of the person in the first picture, and the second picture displayed in the third display area also includes a larger and clearer sitting image of the person, so that more details in the first picture can be shown to the user.

[0149] In some embodiments, the first device may perform super-resolution processing on the second video and display the super-resolution processed second video in the third display area.

[0150] In some embodiments, the first device may perform Gaussian blur processing on the second video, and display the Gaussian blurred second video in the third display area.

[0151] S1303, the first device plays an updated second video in the third display area in response to an update operation, the picture of the updated second video is a partial picture of the picture of the first video in the updated navigation window, the update operation is used to move the navigation window from a first position in the second display area to a second position in the second display area, or, the update operation is used to update the fourth size information of the navigation window to the sixth size information, and the sixth size information matches the fifth size information.

[0152] The first position and the second position are different positions, and the size indicated by the fourth size information is different from the size indicated by the sixth size information. Exemplarily, the horizontal width in the fourth size information is different from the horizontal width in the sixth size information, and / or the vertical width in the fourth size information is different from the vertical width in the sixth size information; but the aspect ratio in the fourth size information is the same as the aspect ratio in the sixth size information.

[0153] Through the update operation, the position and / or size of the navigation window can be updated, thereby updating the second video displayed in the third display area. During the playback of the first video, the user can move the navigation window to the screen content of interest in the second screen in the second display area at any time, and watch the screen content in a larger and clearer size in the third display area, thereby further improving the user's viewing experience.

[0154] For example, Fig.14 As shown, the first position of the navigation window is below the second display area, and the navigation window includes the seated image of the person in the first picture.

[0155] like Fig.15 As shown, the navigation window moves from the bottom of the second display area to the middle of the second display area. The moved navigation window includes the riding figures and trees in the first picture. Then the third display area is also updated to the third picture, which includes larger and clearer riding figures and trees.

[0156] Or, if Fig.16 As shown, the navigation window is reduced from a width of 12 cm and a height of 10 cm to a width of 6 cm and a height of 5 cm. The reduced navigation window includes the head of the seated person in the first picture. The third display area is also updated to the third picture, and the third picture includes a larger and clearer head of the seated person.

[0157] In some implementations, the first device may receive the update operation via an external device such as a remote controller.

[0158] Exemplarily, the remote controller includes four direction keys: up, down, left, and right. When the first device detects that the user presses any direction key, the navigation window can be moved from the first position in the second display area to the second position in the second display area.

[0159] Exemplarily, the remote controller includes a "+" key and a "-" key. When the first device detects that the user presses the "+" key, the navigation window can be enlarged. When the first device detects that the user presses the "-" key, the navigation window can be reduced.

[0160] It is understandable that in actual applications, the first device may also receive the update operation in other ways, such as the first device receiving the update operation through voice, or the first device directly receiving the update operation of the user on the display screen of the first device.

[0161] In some implementations, S1303 may be omitted.

[0162] In an embodiment of the present application, a navigation window can be displayed in the second display area, the fourth size information of the navigation window matches the fifth size information of the third display area, the first video is played in the second display area, and the second video is played in the third display area. Since the screen of the second video is the partial screen of the screen of the first video in the navigation window, it ensures that the user can continue to watch the first video in the second display area, and the detailed information of the first video in the navigation window can be displayed to the user through the third display area, further improving the user's viewing experience.

[0163] Please refer to Fig.17 , is a flow chart of a method for playing a video provided by an embodiment of the present application. The method may be Figure 4 , Figure 12-13 The method shown in the figure is combined to obtain the result. This method can realize the selection or configuration of the video playback mode based on the relevant control of the user, thereby further improving the user's viewing experience. It should be noted that this method does not Fig.17 The specific order described below is a limitation, and it should be understood that in other embodiments, the order of some steps in the method can be interchanged according to actual needs, or some steps can be omitted or deleted. The method includes the following steps:

[0164] S1701, a first device obtains first size information of a first video screen and second size information of a first display area, where the first display area includes at least a portion of a display area in a display screen of the first device.

[0165] The manner in which the first device executes S1701 may refer to the related description in the aforementioned S401.

[0166] S1702: If the first size information does not match the second size information, the first device prompts the user to select a first play mode or a second play mode.

[0167] The manner in which the first device determines whether the first size information matches the second size information may refer to the related description in S402 above. The first playback mode may be the same as the above Fig.12 Corresponding to the method shown in the figure, the second playback mode can be Fig.13 The method shown corresponds to

[0168] In some embodiments, the first device may display a second prompt message, and the second prompt message may be used to prompt the user to select the first play mode or the second play mode. In some embodiments, the second prompt message may be used to prompt that the first size information of the screen of the first video does not match the second size information of the second display area. In some embodiments, the second prompt message may be used to prompt relevant information of the first play mode, relevant information of the second play mode, and the difference between the first play mode and the second play mode.

[0169] S1703: The first device determines to enter a first play mode in response to the first selection operation.

[0170] In some implementations, the first device may receive the first selection operation through an external device such as a remote controller.

[0171] Exemplarily, the remote controller includes two directional keys, an up directional key and a down directional key. When the first device detects that the user presses the up directional key or the down directional key, it can be determined that the first selection operation is received.

[0172] It is understandable that, in actual applications, the first device may also receive the first selection operation in other ways, such as the first device receiving the first selection operation through voice, or the first device directly receiving the first selection operation of the user on the display screen of the first device.

[0173] S1704: The first device determines a second display area in the first display area, where the second display area includes a portion of the first display area, and third size information of the second display area matches the first size information.

[0174] The manner in which the first device executes S1704 may refer to the related description in the aforementioned S402.

[0175] S1705: The first device obtains at least one video frame from the first video.

[0176] The manner in which the first device executes S1705 may refer to the related description in the aforementioned S1201.

[0177] S1706: The first device generates a first image or a third video based on at least one video frame.

[0178] The manner in which the first device executes S1706 may refer to the related description in the aforementioned S1202.

[0179] S1707: The first device plays the first video in the second display area, and plays the first image or the third video in the third display area.

[0180] The manner in which the first device executes S1707 may refer to the related description in the aforementioned S1203.

[0181] S1708: The first device stores the first image or the third video.

[0182] The manner in which the first device executes S1708 may refer to the related description in the aforementioned S404.

[0183] S1709: The first device determines to enter a second play mode in response to the second selection operation.

[0184] In some implementations, the first device may receive the second selection operation via an external device such as a remote controller.

[0185] Exemplarily, the remote controller includes an “OK” key. When the first device detects that the user presses the “OK” key, it can be determined that the second selection operation is received.

[0186] It is understandable that, in actual applications, the first device may also receive the second selection operation in other ways, such as the first device receiving the second selection operation through voice, or the first device directly receiving the second selection operation of the user on the display screen of the first device.

[0187] S1710: The first device determines a second display area in the first display area, where the second display area includes a partial area in the first display area, and third size information of the second display area matches the first size information.

[0188] The manner in which the first device executes S1710 may refer to the related description in the aforementioned S402.

[0189] S1711: The first device displays a navigation window in the second display area, and fourth size information of the navigation window matches fifth size information of the third display area.

[0190] The manner in which the first device executes S1711 may refer to the related description in the aforementioned S1301.

[0191] S1712, the first device plays the first video in the second display area, and plays the second video in the third display area, the screen of the second video is the partial screen of the screen of the first video in the navigation window.

[0192] The manner in which the first device executes S1712 may refer to the related description in the aforementioned S1302.

[0193] S1713, the first device plays an updated second video in the third display area in response to an update operation, the picture of the updated second video is a partial picture of the first video in the updated navigation window, the update operation is used to move the navigation window from a first position in the second display area to a second position in the second display area, or, the update operation is used to update the fourth size information of the navigation window to the sixth size information, and the sixth size information matches the fifth size information.

[0194] The manner in which the first device executes S1713 may refer to the related description in the aforementioned S1303.

[0195] In the embodiment of the present application, when the first size information of the screen of the first video does not match the second size information of the first display area, the user may be prompted to select the first playback mode or the second mode, so that in response to the user's first selection operation, based on Fig.12 The method shown in the figure corresponds to a first playback mode, in which the first video is played in the second display area, and the first image or the third video is played in the third display area, so as to show the user more information included in the first video, or, in response to the user's second selection operation, based on Fig.13 The second playback mode corresponding to the method shown plays the first video in the second display area and plays the second video in the third display area, thereby showing the user detailed information of the first video in the navigation window. That is, it is convenient for the user to select the mode for playing the video, further improving the user's viewing experience.

[0196] Based on the same inventive concept, as an implementation of the above method, an embodiment of the present application provides a device for playing videos. The device embodiment corresponds to the above method embodiment. For ease of reading, the device embodiment will no longer repeat the details of the above method embodiment one by one, but it should be clear that the device in this embodiment can correspond to all the contents of the above method embodiment.

[0197] Based on the same inventive concept, the embodiment of the present application further provides a device, which includes: a memory and a processor, wherein the memory is used to store a machine program; and the processor is used to execute the method described in the above method embodiment when calling the program.

[0198] The device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effect are similar, which will not be repeated here.

[0199] Based on the same inventive concept, the embodiment of the present application further provides a chip system, which includes a processor coupled to a memory, and the processor executes a program stored in the memory to implement the method described in the above method embodiment.

[0200] The chip system may be a single chip or a chip module composed of multiple chips.

[0201] The embodiment of the present application also provides a readable storage medium on which a program is stored. When the program is executed by a processor, the method described in the above method embodiment is implemented.

[0202] The embodiment of the present application also provides a program product, which, when executed on a device, enables the device to implement the method described in the above method embodiment.

[0203] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a program, and the program can be stored in a readable storage medium, which can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the program includes program code, and the program code can be in source code form, object code form, executable file or some intermediate form. The readable storage medium may include at least: any entity or device that can carry the program code to the device, a recording medium, a memory, a read-only memory, a random access memory, an electrical carrier signal, a telecommunication signal, and a software distribution medium. For example, a USB flash drive, a mobile hard disk, a disk or an optical disk.

[0204] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0205] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or units can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units, which can be electrical, mechanical or other forms.

[0206] It should be understood that when used in the present specification and the appended claims, the term "comprising" indicates the presence of described features, wholes, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or combinations thereof.

[0207] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.

[0208] It should also be understood that the term “and / or” used in the specification and appended claims refers to any and all possible combinations of one or more of the associated listed items, and includes these combinations.

[0209] In addition, in the description of the present application specification and the appended claims, the terms "first", "second", "third", etc. are only used to distinguish the descriptions and cannot be understood as indicating or implying relative importance.

[0210] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0211] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for playing a video, characterized in that: Applied to a first device, the method includes: Acquire first size information of a screen of a first video and second size information of a first display area, where the first display area includes at least a portion of a display area of ​​a display screen of the first device; If the first size information does not match the second size information, determining a second display area in the first display area, the second display area includes a partial area of ​​the first display area, and third size information of the second display area matches the first size information; The first video is played in the second display area, and multimedia information is played in a third display area, wherein the third display area includes at least a portion of a remaining area of ​​the first display area except the second display area, and the multimedia information is generated based on the first video.

2. The method according to claim 1, characterized in that The playing of the first video in the second display area and the playing of multimedia information in the third display area includes: When the second display area displays a first picture, the third display area displays a second picture, the first picture includes any video frame in the first video, and the second picture includes at least a portion of the first picture.

3. The method according to claim 1 or 2, characterized in that: The second display area includes a navigation window, and the fourth size information of the navigation window matches the fifth size information of the third display area; The playing of the first video in the second display area and the playing of multimedia information in the third display area includes: The first video is played in the second display area, and the second video is played in the third display area, wherein the screen of the second video is a partial screen of the screen of the first video in the navigation window.

4. The method according to claim 3, characterized in that Playing the second video in the third display area includes: In response to an update operation, an updated second video is played in the third display area, the updated screen of the second video is a partial screen of the first video in the updated navigation window, and the update operation is used to move the navigation window from a first position in the second display area to a second position in the second display area, or, the update operation is used to update the fourth size information of the navigation window to sixth size information, and the sixth size information matches the fifth size information.

5. The method according to claim 1 or 2, characterized in that: The playing of the first video in the second display area and the playing of multimedia information in the third display area includes: The first video is played in the second display area, and a first image is played in the third display area, wherein the first image includes at least one video frame in the first video, or the first image is an image generated based on the at least one video frame.

6. The method according to claim 1 or 2, characterized in that: The playing of the first video in the second display area and the playing of multimedia information in the third display area includes: The first video is played in the second display area, and a third video is played in the third display area, where the third video is a video generated based on at least one video frame in the first video.

7. The method according to claim 5 or 6, characterized in that: The method further comprises: determining at least one of a frame type, an amount of information, and an aesthetic score for a plurality of video frames in the first video; The at least one video frame is obtained from the plurality of video frames based on at least one of the frame type, the amount of information, and the aesthetic score of the plurality of video frames.

8. The method according to any one of claims 1 to 7, characterized in that: The method further comprises: Obtain the first video projected by the second device.

9. The method according to claims 1-8, characterized in that The method further comprises: The multimedia information is stored.

10. A device, characterized in that: include: A memory and a processor, wherein the memory is used to store a program; and the processor is used to execute the method according to any one of claims 1 to 9 when calling the program.

11. A readable storage medium having a program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 9 is implemented.

12. A program product, characterized in that When the program product is run on a device, the device is caused to execute the method according to any one of claims 1 to 9.

Images