Picture-based Video Playback Method, Device, Electronic Device, and Storage Medium
By identifying the content information of multiple pictures and dynamically adjusting the playback speed, the problem of cumbersome playback operations is solved and the human-computer interaction efficiency and user experience are improved.
Patent Information
- Application Number
- CN202211627330.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-16
- Publication Date
- 2025-07-08
- Estimated Expiration
- 2042-12-16
AI Technical Summary
When playing short videos generated by multiple pictures, the existing technology is complicated to pause and repeat playback operations, which affects the efficiency of human-computer interaction.
By identifying the content information of multiple pictures, the playback speed matching the content information is determined. When the picture content is too much, the picture content is slow and when there is little content, the speed is fast, and when there is little content, intelligent playback is achieved.
It improves human-computer interaction efficiency, and users do not need to pause or repeat video playback, improving user experience.
Smart Images

Figure CN116033219B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of multimedia technologies, and particularly to a method, an apparatus, an electronic device, and a storage medium for playing a video based on pictures. Background Art
[0002] With the development of multimedia technologies, more and more people are accustomed to watching short videos to obtain information. Among them, short videos generated from multiple pictures play an important role in various types of short videos. When playing a short video generated from multiple pictures, these multiple pictures are played at a fixed speed, and during the playing process, pause operations or repeated playing operations may be involved to meet the viewing needs of users, which is cumbersome and affects the human-computer interaction efficiency. Summary of the Invention
[0003] The present disclosure provides a method, an apparatus, an electronic device, and a storage medium for playing a video based on pictures, which can improve the human-computer interaction efficiency and thus enhance the user experience. The technical solution of the present disclosure is as follows:
[0004] According to one aspect of the embodiments of the present disclosure, there is provided a method for playing a video based on pictures, including:
[0005] Responding to a play instruction for a target video, and identifying content information of multiple pictures in the target video;
[0006] Based on the content information of the multiple pictures, determining a play speed of the multiple pictures;
[0007] Playing the multiple pictures at the play speed of the multiple pictures.
[0008] According to another aspect of the embodiments of the present disclosure, there is provided a device for playing a video based on pictures, including:
[0009] An identification unit configured to execute, in response to a play instruction for a target video, identifying content information of multiple pictures in the target video;
[0010] A determination unit configured to execute, based on the content information of the multiple pictures, determining a play speed of the multiple pictures;
[0011] A play unit configured to execute playing the multiple pictures at the play speed of the multiple pictures.
[0012] In some embodiments, the identification unit is configured to execute, in response to a play instruction for the target video, determining whether an intelligent play function is enabled; in the case where the intelligent play function is enabled, identifying content information of the multiple pictures in the target video; in the case where the intelligent play function is not enabled, playing the multiple pictures at a preset play speed.
[0013] In some embodiments, the apparatus further comprises:
[0014] A display unit configured to display the target video in a playback interface;
[0015] The display unit is further configured to display a setting panel in the playback interface in response to a setting operation on the target video, where an intelligent speed control is displayed in the setting panel, and the intelligent speed control is used to set the playback speed of multiple pictures in the target video;
[0016] A start unit configured to start the intelligent playback function in response to a trigger operation on the intelligent speed control.
[0017] In some embodiments, the recognition unit is configured to obtain the video content type of the target video; recognize the text in the multiple pictures when the video content type is text content; and recognize the pattern in the multiple pictures when the video content type is pattern content.
[0018] In some embodiments, the determination unit comprises:
[0019] A first determination subunit configured to determine, for any one picture, the complexity of the content information of the picture based on the content information of the picture;
[0020] A second determination subunit configured to determine a playback speed matching the complexity based on the complexity, and the playback speed is negatively correlated with the complexity.
[0021] In some embodiments, the first determination subunit is configured to obtain the number of characters in the picture when the video content type of the target video is text content; and determine the complexity of the content information of the picture based on the number of characters, and the complexity is positively correlated with the number of characters.
[0022] In some embodiments, the first determination subunit is configured to obtain the character size in the picture when the video content type of the target video is text content; and determine the complexity of the content information of the picture based on the character size, and the complexity is negatively correlated with the character size.
[0023] In some embodiments, the first determination subunit is configured to obtain the number of colors in the picture when the video content type of the target video is pattern content; and determine the complexity of the content information of the picture based on the number of colors, and the complexity is positively correlated with the number of colors.
[0024] In some embodiments, the first determination subunit is configured to obtain the contrast between adjacent colors in the picture when the video content type of the target video is pattern content; and determine the complexity of the content information of the picture based on the contrast between adjacent colors, where the complexity is negatively correlated with the contrast between adjacent colors.
[0025] In some embodiments, the recognition unit is configured to recognize the text in the multiple pictures when the video content type of the target video is hybrid content, where the hybrid content includes text and patterns.
[0026] The determination unit is configured to determine the playback speed of the multiple pictures based on the text in the multiple pictures.
[0027] In some embodiments, the device further includes:
[0028] An acquisition unit configured to obtain the length of the multiple pictures in response to a playback instruction for the target video when the multiple pictures are spliced end to end, where the length of the picture is the length of the side perpendicular to the head and tail of the picture.
[0029] The determination unit is configured to determine, for any one picture, a playback speed that matches the length of the picture based on the length of the picture, where the length of the picture is negatively correlated with the playback speed.
[0030] According to another aspect of the embodiments of the present disclosure, there is provided an electronic device, which includes:
[0031] One or more processors;
[0032] A memory for storing program code executable by the processor;
[0033] Wherein, the processor is configured to execute the program code to implement the above-mentioned video playback method based on pictures.
[0034] According to another aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium, when the program code in the computer-readable storage medium is executed by a processor of an electronic device, enabling the electronic device to execute the above-mentioned video playback method based on pictures.
[0035] According to another aspect of the embodiments of the present disclosure, there is provided a computer program product, including computer program / instructions, which implement the above-mentioned video playback method based on pictures when the computer program / instructions are executed by a processor.
[0036] Embodiments of the present disclosure provide a method for playing a video based on pictures. When playing a target video generated from multiple pictures, it is possible to identify the content information of multiple pictures in the target video, thereby determining a playing speed that matches the content information. When there is more content information in the picture, that is, when the amount of information is larger, the corresponding playing speed is slower, enabling the user to have enough time to view all the content in the picture without having to pause or replay the target video. When there is less content information in the picture, that is, when the amount of information is smaller, the corresponding playing speed is faster, enabling the user not to waste much time, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0037] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and do not limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] The accompanying drawings herein are incorporated into the specification and form a part of the specification, showing embodiments consistent with the present disclosure, and are used together with the specification to explain the principles of the present disclosure and do not constitute an improper limitation to the present disclosure.
[0039] Figure 1 is a schematic diagram of an implementation environment of a method for playing a video based on pictures shown according to an exemplary embodiment.
[0040] Figure 2 is a flowchart of a method for playing a video based on pictures shown according to an exemplary embodiment.
[0041] Figure 3 is a flowchart of another method for playing a video based on pictures shown according to an exemplary embodiment.
[0042] Figure 4 is a schematic diagram of enabling an intelligent playing function shown according to an exemplary embodiment.
[0043] Figure 5 is a schematic diagram of a setting panel shown according to an exemplary embodiment.
[0044] Figure 6 is a block diagram of a device for playing a video based on pictures shown according to an exemplary embodiment.
[0045] Figure 7 is a block diagram of another device for playing a video based on pictures shown according to an exemplary embodiment.
[0046] Figure 8 is a block diagram of a terminal shown according to an exemplary embodiment.
[0047] Figure 9It is a block diagram of a server shown according to an exemplary embodiment. Detailed implementation mode
[0048] In order to enable those of ordinary skill in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.
[0049] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and do not necessarily need to be used to describe a specific order or sequence. It should be understood that such used data can be interchanged under appropriate circumstances so that the embodiments of the present disclosure described here can be implemented in an order other than those illustrated or described here. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present disclosure. On the contrary, they are only examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.
[0050] It should be noted that the information (including but not limited to the device information of the user, the personal information of the user, etc.), data (including but not limited to the data for analysis, the stored data, the displayed data, etc.) and signals involved in this application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data need to comply with the relevant laws, regulations and standards of relevant countries and regions. For example, the content information involved in this application is obtained under full authorization.
[0051] Figure 1 It is a schematic diagram of the implementation environment of a video playback method based on pictures shown according to an exemplary embodiment. Taking the electronic device being provided as a terminal as an example, see Figure 1 This implementation environment specifically includes: a terminal 101 and a server 102.
[0052] The terminal 101 is at least one of devices such as a smart phone, a smart watch, a desktop computer, a laptop computer, an MP3 player, an MP4 player, and a laptop portable computer. A video application program is installed and run on the terminal 101, and the user can log in to the video application program through the terminal 101 to watch a video generated by multiple pictures. The terminal 101 can be connected to the server 102 through a wireless network or a wired network, and thus can obtain a video generated by multiple pictures from the server 102 and play it.
[0053] The terminal 101 generally refers to one of multiple terminals, and this embodiment takes the terminal 101 as an example for illustration. Those skilled in the art can understand that the number of the above terminals can be more or less. For example, the above terminals can be several, or dozens or hundreds of the above terminals, or a larger number. The embodiments of the present disclosure do not limit the number and device type of the terminals.
[0054] The server 102 is at least one of a server, multiple servers, a cloud computing platform, and a virtualization center. The server 102 can be connected to the terminal 101 and other terminals through a wireless network or a wired network, and the server 102 can send a video generated by multiple pictures to the terminal 101. In some embodiments, the number of the above servers can be more or less, and the embodiments of the present disclosure do not limit this. Of course, the server 102 also includes other functional servers to provide more comprehensive and diverse services.
[0055] Figure 2 is a flowchart of a picture-based video playback method shown according to an exemplary embodiment. Refer to Figure 2 , and this picture-based video playback method is applied to a terminal and includes the following steps:
[0056] In step 201, in response to a playback instruction for a target video, the terminal identifies the content information of multiple pictures in the target video.
[0057] In the embodiments of the present disclosure, the target video is generated by multiple pictures. When playing the target video, the terminal can identify the content information in each picture of the target video. For any picture, the content information of the picture can include text or a pattern, and the embodiments of the present disclosure do not limit this. That is, the terminal can use text recognition technology or image recognition technology to identify the content information in multiple pictures.
[0058] In step 202, the terminal determines the playback speed of multiple pictures based on the content information of the multiple pictures.
[0059] In the embodiments of the present disclosure, the terminal determines the playback speed of multiple pictures according to the amount of content information in the multiple pictures. The more the content information, the slower the playback speed; the less the content information, the faster the playback speed. The playback speed of each picture in the multiple pictures can be the same or different, and the embodiments of the present disclosure do not limit this. The terminal can obtain a playback speed based on the content information of the multiple pictures and use this playback speed as the playback speed of each picture in the multiple pictures. The terminal can also, for any picture, determine the playback speed of the picture based on the content information in the picture. That is, the terminal can obtain multiple playback speeds according to the content information of the multiple pictures and use these multiple playback speeds as the playback speeds of the multiple pictures, and the embodiments of the present disclosure do not limit this. Herein, the playback speed refers to the number of pictures played per second or the playback duration of each picture.
[0060] In step 203, the terminal plays multiple pictures at the playback speed of the multiple pictures.
[0061] In the embodiments of the present disclosure, the terminal plays the multiple pictures in sequence according to the determined playback speed and the playback order of the multiple pictures in the target video.
[0062] The embodiments of the present disclosure provide a video playback method based on pictures. When playing a target video generated by multiple pictures, it can identify the content information of the multiple pictures in the target video, thereby determining a playback speed that matches the content information. When the content information in the picture is more, that is, when the amount of information is larger, the corresponding playback speed is slower, enabling the user to have enough time to view all the content in the picture without pausing or repeating the playback of the target video. When the content information in the picture is less, that is, when the amount of information is smaller, the corresponding playback speed is faster, enabling the user not to waste much time, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0063] In some embodiments, in response to a playback instruction for the target video, identifying the content information of multiple pictures in the target video includes:
[0064] In response to a playback instruction for the target video, determining whether the intelligent playback function is enabled;
[0065] In the case where the intelligent playback function is enabled, identifying the content information of multiple pictures in the target video;
[0066] In the case where the intelligent playback function is not enabled, playing multiple pictures at a preset playback speed.
[0067] The solution provided by the embodiments of the present disclosure will identify the content information of multiple pictures in the target video only when the intelligent playback function is turned on, which is conducive to determining the playback speed matching the content information subsequently, without pausing or repeating the target video, meeting the viewing needs of users. When the intelligent playback function is not turned on, the multiple pictures are directly played at a preset playback speed without identifying the content information in the pictures, saving operation consumption.
[0068] In some embodiments, the method further includes:
[0069] Display the target video on the playback interface;
[0070] In response to a setting operation on the target video, display a setting panel on the playback interface. An intelligent speed control is displayed in the setting panel, and the intelligent speed control is used to set the playback speed of multiple pictures in the target video;
[0071] In response to a trigger operation on the intelligent speed control, turn on the intelligent playback function.
[0072] The solution provided by the embodiments of the present disclosure enables the user to control the turn-on of the intelligent playback function by triggering the intelligent speed control by displaying the intelligent speed control in the setting panel, that is, to turn on the intelligent playback function according to the user's needs. Only then will the content information of multiple pictures in the target video be identified, which is conducive to determining the playback speed matching the content information subsequently, without pausing or repeating the target video, meeting the viewing needs of users.
[0073] In some embodiments, identifying the content information of multiple pictures in the target video includes:
[0074] Obtain the video content type of the target video;
[0075] When the video content type is text content, identify the text in multiple pictures;
[0076] When the video content type is pattern content, identify the patterns in multiple pictures.
[0077] The solution provided by the embodiments of the present disclosure can improve the efficiency and accuracy of identifying content information because the video content type can represent the main content in multiple pictures in the target video, and identify the content corresponding to the video content type according to the video content type of the target video, so that the identified content information can represent the content of multiple pictures. Moreover, when the video content type is text content, identify the text in multiple pictures without performing pattern recognition; when the video content type is pattern content, identify the patterns in multiple pictures without performing text recognition, which can also reduce operation consumption.
[0078] In some embodiments, determining the playback speed of multiple pictures based on the content information of the multiple pictures includes:
[0079] For any picture, based on the content information of the picture, determine the complexity of the content information of the picture;
[0080] Based on the complexity, determine the playback speed that matches the complexity, and the playback speed is negatively correlated with the complexity.
[0081] The solution provided by the embodiments of the present disclosure determines the complexity of the content information of a picture according to the amount of content information in the picture. The more the content information, the higher the complexity of the content information; the less the content information, the lower the complexity of the content information. Then, according to the complexity of the content information, determine the playback speed of the picture. The higher the complexity of the content information, the slower the playback speed; the lower the complexity of the content information, the faster the playback speed. That is, when there is more content information in the picture, the corresponding playback speed is slower, so that the user can have enough time to view all the content in the picture without pausing or repeating the target video. When there is less content information in the picture, the corresponding playback speed is faster, so that the user can avoid wasting too much time, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0082] In some embodiments, determining the complexity of the content information of a picture based on the content information of the picture includes:
[0083] When the video content type of the target video is text content, obtain the number of words in the picture;
[0084] Based on the number of words, determine the complexity of the content information of the picture, and the complexity is positively correlated with the number of words.
[0085] The solution provided by the embodiments of the present disclosure, when the video content type of the target video is text content, the more words in the picture, the higher the complexity of the content information of the picture, and thus the slower the subsequent determined playback speed. That is, when the user views more content, the playback speed is slower, so that the user can have enough time to view all the content in the picture without pausing or repeating the target video; the fewer words in the picture, the lower the complexity of the content information of the picture, and thus the faster the subsequent determined playback speed. That is, when the user views less content, the playback speed is faster, so that the user can avoid wasting too much time, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0086] In some embodiments, determining the complexity of the content information of a picture based on the content information of the picture includes:
[0087] When the video content type of the target video is text content, obtain the text size in the picture;
[0088] Based on the text size, determine the complexity of the content information of the picture, and the complexity is negatively correlated with the text size.
[0089] The solution provided by the embodiments of the present disclosure is that when the video content type of the target video is text content, the smaller the text size in the picture, the higher the complexity of the content information of the picture, and thus the slower the subsequent determined playback speed. That is, when the difficulty for the user to view the content is greater, the playback speed is slower, enabling the user to have enough time to view all the content in the picture without pausing or repeating the target video; the larger the text size in the picture, the lower the complexity of the content information of the picture, and thus the faster the subsequent determined playback speed. That is, when the difficulty for the user to view the content is smaller, the playback speed is faster, enabling the user to not waste much time, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0090] In some embodiments, based on the content information of the picture, determining the complexity of the content information of the picture includes:
[0091] When the video content type of the target video is pattern content, obtain the number of colors in the picture;
[0092] Based on the number of colors, determine the complexity of the content information of the picture, and the complexity is positively correlated with the number of colors.
[0093] The solution provided by the embodiments of the present disclosure is that when the video content type of the target video is pattern content, the more colors in the picture, the higher the complexity of the content information of the picture, and thus the slower the subsequent determined playback speed. That is, when the user views more content, the playback speed is slower, enabling the user to have enough time to view all the content in the picture without pausing or repeating the target video; the fewer colors in the picture, the lower the complexity of the content information of the picture, and thus the faster the subsequent determined playback speed. That is, when the user views less content, the playback speed is faster, enabling the user to not waste much time, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0094] In some embodiments, based on the content information of the picture, determining the complexity of the content information of the picture includes:
[0095] When the video content type of the target video is pattern content, obtain the contrast between adjacent colors in the picture;
[0096] Based on the contrast between adjacent colors, determine the complexity of the content information of the picture, and the complexity is negatively correlated with the contrast between adjacent colors.
[0097] In the solution provided by the embodiments of the present disclosure, when the video content type of the target video is pattern content, the smaller the contrast between adjacent colors in the picture, the higher the complexity of the content information in the picture, and thus the slower the subsequent determined playback speed. That is, when the difficulty for the user to view the content is greater, the playback speed is slower, enabling the user to have enough time to view all the content in the picture without pausing or repeating the playback of the target video; the greater the contrast between adjacent colors in the picture, the lower the complexity of the content information in the picture, and thus the faster the subsequent determined playback speed. That is, when the difficulty for the user to view the content is smaller, the playback speed is faster, enabling the user not to waste much time, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0098] In some embodiments, the method further includes:
[0099] When the video content type of the target video is mixed content, identify the text in multiple pictures, where the mixed content includes text and patterns;
[0100] Based on the text in the multiple pictures, determine the playback speeds of the multiple pictures.
[0101] In the solution provided by the embodiments of the present disclosure, since the time consumed by the user to read text is generally longer than the time consumed to view patterns, when the pictures in the target video include both text and patterns, identify the text in the multiple pictures, and thus determine the playback speeds of the multiple pictures based on the text in the multiple pictures, which not only meets the viewing needs of the user but also does not require pattern recognition, saving the running consumption.
[0102] In some embodiments, the method further includes:
[0103] When the multiple pictures are spliced end to end, in response to a playback instruction for the target video, obtain the lengths of the multiple pictures, where the length of a picture is the length of the picture in the vertical direction;
[0104] For any picture, based on the length of the picture, determine a playback speed that matches the length of the picture, where the length of the picture is negatively correlated with the playback speed.
[0105] The solution provided by the embodiments of the present disclosure can determine a playback speed that matches the length of the pictures when multiple pictures are spliced end to end. The longer the length of the picture, the more content information the picture contains, and the slower the obtained playback speed, so that the user can have enough time to view all the content in the picture without pausing or repeating the playback of the target video; the shorter the length of the picture, the less content information the picture contains, and the faster the obtained playback speed, so that the user can avoid wasting too much time, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0106] The above Figure 2 The following only shows the basic process of the present disclosure. Based on a specific implementation manner, the solution provided by the present disclosure will be further elaborated. Figure 3 It is a flowchart of another picture-based video playback method shown according to an exemplary embodiment. Taking the electronic device being provided as a terminal as an example, refer to Figure 3 , the method includes:
[0107] In step 301, in response to a playback instruction for a target video, the terminal identifies the content information of multiple pictures in the target video.
[0108] In the embodiments of the present disclosure, the target video contains multiple pictures. The multiple pictures can be multiple independent pictures or multiple pictures spliced together, and the embodiments of the present disclosure do not limit this. When the user views the target video, the terminal can identify the content information of multiple pictures respectively. For any picture, the picture can include text or patterns. The picture-based video playback method provided by the embodiments of the present disclosure can perform text recognition or pattern recognition on the picture, and the embodiments of the present disclosure do not limit this.
[0109] In some embodiments, the terminal can determine the recognition type for the pictures in the target video according to the video content type of the target video. For example, it can perform text recognition or pattern recognition. Accordingly, the process for the terminal to recognize the content information of multiple pictures in the target video is as follows: The terminal obtains the video content type of the target video. Then, when the video content type is text-based content, the terminal recognizes the text in the multiple pictures. When the video content type is pattern-based content, the terminal recognizes the patterns in the multiple pictures. Among them, the video content in the target video can be a novel. In this case, most of the content in the multiple pictures of the target video is text, and the video content type of the target video is text-based content. The video content in the target video can also be a wallpaper. In this case, most of the content in the multiple pictures of the target video is patterns, and the video content type of the target video is pattern-based content. The solution provided by the embodiments of the present disclosure, since the video content type can represent the main content in the multiple pictures of the target video, recognizes the content corresponding to the video content type according to the video content type of the target video, so that the recognized content information can represent the content of the multiple pictures, which can improve the efficiency and accuracy of recognizing the content information. Moreover, when the video content type is text-based content, it recognizes the text in the multiple pictures without performing pattern recognition; when the video content type is pattern-based content, it recognizes the patterns in the multiple pictures without performing text recognition, which can also reduce the running consumption.
[0110] Optionally, when the pictures in the target video include both text and patterns, since the time consumed by users to read text is generally longer than the time consumed to view patterns, the terminal can only perform text recognition on the pictures in the target video. Accordingly, the process for the terminal to recognize the content information of multiple pictures in the target video is as follows: When the video content type of the target video is mixed content, it recognizes the text in the multiple pictures. Among them, the mixed content includes text and patterns. The video content of the target video can be a comic, and the embodiments of the present disclosure do not limit this. The solution provided by the embodiments of the present disclosure, since the time consumed by users to read text is generally longer than the time consumed to view patterns, when the pictures in the target video include both text and patterns, it recognizes the text in the multiple pictures, which is beneficial for subsequently determining the playback speed of the multiple pictures according to the text in the multiple pictures, not only meeting the viewing needs of users, but also not requiring pattern recognition and saving running consumption.
[0111] Optionally, when the picture in the target video includes both text and patterns, the terminal can also determine whether to perform text recognition or pattern recognition on the picture in the target video according to the proportion of text and patterns in the picture. Among them, the proportion can be the proportion of the occupied area. Accordingly, the process of the terminal recognizing the content information of multiple pictures in the target video is as follows: when the video content type of the target video is a mixed type of content, for any picture, the terminal obtains the area occupied by the text in the picture and the area occupied by the patterns. Then, when the area occupied by the text exceeds the area occupied by the patterns, the terminal performs text recognition on the text in the picture. When the area occupied by the text does not exceed the area occupied by the patterns, the terminal performs pattern recognition on the patterns in the picture. The solution provided by the embodiments of the present disclosure determines whether to perform text recognition or pattern recognition on the picture in the target video according to the proportion of text and patterns in the picture when the picture in the target video includes both text and patterns, which not only meets the viewing needs of users but also saves operation consumption without performing both recognitions.
[0112] Optionally, when the picture in the target video includes both text and patterns, the terminal can also recognize both the text and the patterns in the picture, so as to subsequently determine the first playback speed according to the text recognition result and determine the second playback speed according to the pattern recognition result. Then, the terminal selects the slower playback speed among the first playback speed and the second playback speed as the playback speed of the picture. The solution provided by the embodiments of the present disclosure recognizes both the text and the patterns in the picture when the picture in the target video includes both text and patterns, and uses the slowest playback speed corresponding to the text recognition result and the pattern recognition result as the final playback speed of the picture, so that the user can have enough time to view all the content in the picture without pausing or repeating the playback of the target video, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0113] In some embodiments, the picture-based video playing method provided by the embodiments of the present disclosure is an intelligent playing function. Only when this intelligent playing function is enabled, will the terminal execute the steps in the picture-based video playing method. Correspondingly, in response to a playing instruction for a target video, the terminal determines whether the intelligent playing function is enabled. Then, when the intelligent playing function is enabled, the content information of multiple pictures in the target video is recognized. When the intelligent playing function is not enabled, the terminal plays the multiple pictures at a preset playing speed. Wherein, the preset playing speed can be a default playing speed set by developers, and the embodiments of the present disclosure do not limit the magnitude of the preset playing speed. The solution provided by the embodiments of the present disclosure will recognize the content information of multiple pictures in the target video only when the intelligent playing function is enabled, thereby facilitating the subsequent determination of the playing speed matching the content information, without the need to pause or repeat playing the target video, meeting the user's viewing needs. When the intelligent playing function is not enabled, the multiple pictures are directly played at the preset playing speed without the need to recognize the content information in the pictures, saving running consumption.
[0114] Among them, the user can control whether to enable the intelligent playing function. Correspondingly, the terminal displays the target video on the playing interface. Then, in response to a setting operation on the target video, the terminal displays a setting panel on the playing interface. The setting panel displays an intelligent speed control for setting the playing speed of multiple pictures in the target video. Then, in response to a triggering operation on the intelligent speed control, the terminal enables the intelligent playing function. The solution provided by the embodiments of the present disclosure enables the user to control the enabling of the intelligent playing function by triggering the intelligent speed control by displaying the intelligent speed control in the setting panel, that is, can enable the intelligent playing function according to the user's needs, and then will recognize the content information of multiple pictures in the target video, thereby facilitating the subsequent determination of the playing speed matching the content information, without the need to pause or repeat playing the target video, meeting the user's viewing needs.
[0115] For example, Figure 4 is a schematic diagram of enabling the intelligent playing function shown according to an exemplary embodiment. Refer to Figure 4, the terminal displays a target video on the playback interface. The target video is generated from multiple independent pictures. The multiple pictures can slide leftward in sequence to achieve the purpose of playing the multiple pictures. When the intelligent playback function is not enabled, the terminal plays the multiple pictures at a preset playback speed. Of course, the user can also enable the intelligent playback function. In response to a long press operation on the target video, the terminal displays a negative feedback panel on the playback interface. The negative feedback panel includes multiple functions, namely, the function of indicating that the user is not interested in the target video, the function of picture playback settings, the function of saving the target video to the album, the barrage function, and the barrage settings function, etc. In response to a trigger operation on the picture playback settings control, the terminal displays a settings panel for the function of picture playback settings on the playback interface. The settings panel displays a start control for the intelligent playback function. In response to a trigger operation on the start control, the terminal enables the intelligent playback function.
[0116] In some embodiments, the settings panel further includes at least one target speed control, and the user can provide the settings panel to set the playback speed of the multiple pictures. Accordingly, the playback speed at which the user sets the playback speed of the multiple pictures is: in response to a trigger operation on the target speed control in the settings panel, the terminal plays the multiple pictures at the target speed. The solution provided by the embodiments of the present disclosure enables the user to set the playback speed of the multiple pictures by themselves through the settings panel, which can meet the viewing needs of the user. Moreover, without content recognition, the multiple pictures are directly played at the target speed selected by the user, saving running consumption.
[0117] For example, Figure 5 is a schematic diagram of a settings panel shown according to an exemplary embodiment. Refer to Figure 5 , the settings panel includes an intelligent playback function, a function for setting the playback speed of pictures and texts, and a function for setting the playback speed of long pictures. Among them, pictures and texts refer to multiple independent pictures. A long picture refers to multiple pictures spliced together at the head and tail. Taking the function for setting the playback speed of pictures and texts as an example, this function corresponds to four target speeds: slower, slow, normal, and fast. When the target video is generated from multiple independent pictures, in response to a trigger operation on any target speed control corresponding to the function for setting the playback speed of pictures and texts, the terminal plays the multiple pictures in the target video at that target speed. The settings panel also includes a restore default control. In response to a trigger operation on the restore default control, the terminal plays the multiple pictures in the target video at the default speed.
[0118] In step 302, for any picture, the terminal determines the complexity of the content information of the picture based on the content information of the picture.
[0119] In an embodiment of the present disclosure, for any picture in a target video, the terminal can determine the complexity of the content information in the picture according to the amount of content information in the picture. The more content information in the picture, the higher the complexity of the content information; the less content information in the picture, the lower the complexity of the content information. Since the video content types of the target video are different, the recognized content information is different, and thus the determined complexity is different.
[0120] For a target video whose video content type is text content, the terminal can recognize the text in the picture in the target video to obtain at least one of the number of text and the text size in the picture, and thus determine the complexity of the content information in the picture according to at least one of the number of text and the text size.
[0121] In some embodiments, the terminal can determine the complexity of the content information in the picture according to the number of text in the picture. Correspondingly, step 302 includes the following steps: when the video content type of the target video is text content, the terminal obtains the number of text in the picture. Then, the terminal determines the complexity of the content information in the picture based on the number of text. Among them, the complexity is positively correlated with the number of text. The solution provided by the embodiment of the present disclosure is that when the video content type of the target video is text content, the more text in the picture, the higher the complexity of the content information in the picture, and thus the slower the subsequent determined playback speed, that is, when the user watches more content, the playback speed is slower, so that the user can have enough time to watch all the content in the picture without pausing or repeating the target video; the less text in the picture, the lower the complexity of the content information in the picture, and thus the faster the subsequent determined playback speed, that is, when the user watches less content, the playback speed is faster, so that the user can avoid wasting too much time, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0122] In some embodiments, the terminal can determine the complexity of the content information in the picture according to the text size in the picture. Accordingly, step 302 includes the following steps: When the video content type of the target video is text content, the terminal obtains the text size in the picture. Then, based on the text size, the terminal determines the complexity of the content information in the picture, and the complexity is negatively correlated with the text size. In the solution provided by the embodiments of the present disclosure, when the video content type of the target video is text content, the smaller the text size in the picture, the higher the complexity of the content information in the picture, and thus the slower the playback speed determined subsequently. That is, when the difficulty for the user to view the content is greater, the playback speed is slower, so that the user can have enough time to view all the content in the picture without pausing or repeating the target video; the larger the text size in the picture, the lower the complexity of the content information in the picture, and thus the faster the playback speed determined subsequently. That is, when the difficulty for the user to view the content is smaller, the playback speed is faster, so that the user can avoid wasting too much time, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0123] In some embodiments, the terminal can determine the complexity of the content information in the picture according to the number of texts and the text size in the picture. Accordingly, step 302 includes the following steps: When the video content type of the target video is text content, the terminal obtains the number of texts and the text size in the picture. Then, based on the number of texts, the terminal determines the first complexity of the content information in the picture. Based on the text size, the terminal determines the second complexity of the content information in the picture. Then, the terminal performs a weighted sum on the first complexity and the second complexity to obtain the target complexity of the content information in the picture. In the solution provided by the embodiments of the present disclosure, when the video content type of the target video is text content, the more texts and the smaller the text size in the picture, the higher the complexity of the content information in the picture, and thus the slower the playback speed determined subsequently. That is, when the user views more content and the viewing difficulty is greater, the playback speed is slower, so that the user can have enough time to view all the content in the picture without pausing or repeating the target video; the fewer texts and the larger the text size in the picture, the lower the complexity of the content information in the picture, and thus the faster the playback speed determined subsequently. That is, when the user views less content and the viewing difficulty is smaller, the playback speed is faster, so that the user can avoid wasting too much time, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0124] Optionally, the terminal can also select the maximum complexity among the first complexity and the second complexity as the target complexity of the content information in the picture. The embodiments of the present disclosure do not limit this.
[0125] For a target video whose video content type is pattern content, the terminal can identify the patterns in the picture in the target video to obtain at least one of the number of colors in the picture and the contrast between adjacent colors, and then determine the complexity of the content information in the picture according to at least one of the number of colors and the contrast between adjacent colors.
[0126] In some embodiments, the terminal can determine the complexity of the content information in the picture according to the number of colors in the picture. Accordingly, step 302 includes the following steps: when the video content type of the target video is pattern content, the terminal obtains the number of colors in the picture. Then, the terminal determines the complexity of the content information of the picture based on the number of colors. Among them, the complexity is positively correlated with the number of colors. The solution provided by the embodiments of the present disclosure is that when the video content type of the target video is pattern content, the more colors in the picture, the higher the complexity of the content information in the picture, and thus the slower the subsequent determined playback speed, that is, when the user watches more content, the playback speed is slower, so that the user can have enough time to watch all the content in the picture without pausing or repeating the target video; the fewer colors in the picture, the lower the complexity of the content information in the picture, and thus the faster the subsequent determined playback speed, that is, when the user watches less content, the playback speed is faster, so that the user can avoid wasting too much time, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0127] In some embodiments, the terminal can determine the complexity of the content information in the picture according to the contrast between adjacent colors in the picture. Adjacent colors refer to the colors adjacent to each other in the picture, that is, the areas covered by adjacent colors are adjacent and there is no area covered by other colors between them. Accordingly, step 302 includes the following steps: when the video content type of the target video is pattern content, the terminal obtains the contrast between adjacent colors in the picture. Then, the terminal determines the complexity of the content information of the picture based on the contrast between adjacent colors. Among them, the complexity is negatively correlated with the contrast between adjacent colors. The solution provided by the embodiments of the present disclosure is that when the video content type of the target video is pattern content, the smaller the contrast between adjacent colors in the picture, the higher the complexity of the content information in the picture, and thus the slower the subsequent determined playback speed, that is, when the difficulty for the user to watch the content is greater, the playback speed is slower, so that the user can have enough time to watch all the content in the picture without pausing or repeating the target video; the greater the contrast between adjacent colors in the picture, the lower the complexity of the content information in the picture, and thus the faster the subsequent determined playback speed, that is, when the difficulty for the user to watch the content is smaller, the playback speed is faster, so that the user can avoid wasting too much time, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0128] In some embodiments, the terminal can determine the complexity of the content information in the picture according to the number of colors in the picture and the contrast between adjacent colors. Correspondingly, step 302 includes the following steps: When the video content type of the target video is pattern content, the terminal obtains the number of colors in the picture and the contrast between adjacent colors. Then, the terminal determines the third complexity of the content information of the picture based on the number of colors. The terminal determines the fourth complexity of the content information of the picture based on the contrast between adjacent colors. Then, the terminal performs a weighted sum of the third complexity and the fourth complexity to obtain the target complexity of the content information of the picture. In the solution provided by the embodiments of the present disclosure, when the video content type of the target video is pattern content, the more colors in the picture and the smaller the contrast between adjacent colors, the higher the complexity of the content information of the picture, and thus the slower the subsequent determined playback speed. That is, when the user watches more content and the viewing difficulty is greater, the playback speed is slower, so that the user can have enough time to view all the content in the picture without pausing or repeating the playback of the target video; the greater the contrast between adjacent colors in the picture, the lower the complexity of the content information of the picture, and thus the faster the subsequent determined playback speed. That is, when the user watches less content and the viewing difficulty is smaller, the playback speed is faster, so that the user can avoid wasting more time, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0129] Optionally, the terminal can also select the maximum complexity among the third complexity and the fourth complexity as the target complexity of the content information of the picture. The embodiments of the present disclosure do not limit this.
[0130] In step 303, the terminal determines the playback speed matching the complexity based on the complexity, and the playback speed is negatively correlated with the complexity.
[0131] In the embodiments of the present disclosure, the complexity of the content information of the picture is determined according to the amount of content information in the picture. Then, according to the complexity of the content information, the playback speed of the picture is determined. The higher the complexity of the content information, the slower the playback speed, and the lower the complexity of the content information, the faster the playback speed. That is, when there is more content information in the picture, the corresponding playback speed is slower, so that the user can have enough time to view all the content in the picture without pausing or repeating the playback of the target video. When there is less content information in the picture, the corresponding playback speed is faster, so that the user can avoid wasting more time, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0132] In some embodiments, multiple pictures in the target video are spliced together at the head and tail to form a long picture. When playing the target video, the multiple pictures can slide upward in sequence to achieve the purpose of playing the multiple pictures. Before playing the target video, the terminal can determine the playing speed of the pictures according to the size of the pictures. Accordingly, the process for the terminal to determine the playing speed is as follows: in the case where the multiple pictures are spliced at the head and tail, in response to a playing instruction for the target video, the terminal obtains the lengths of the multiple pictures, and the length of the picture is the length of the picture in the vertical direction. The vertical direction refers to the direction perpendicular to the head and tail of the picture. Then, for any picture, the terminal determines a playing speed matching the length of the picture based on the length of the picture, and the length of the picture is negatively correlated with the playing speed. The solution provided in the embodiments of the present disclosure can, in the case where the multiple pictures are spliced at the head and tail, determine a playing speed matching the length of the picture according to the length of the picture. The longer the length of the picture, the more content information the picture contains, and the slower the obtained playing speed, so that the user can have enough time to view all the content in the picture without pausing or repeating the playing of the target video; the shorter the length of the picture, the less content information the picture contains, and the faster the obtained playing speed, so that the user can avoid wasting too much time, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0133] In step 304, the terminal plays the multiple pictures at the playing speed of the multiple pictures.
[0134] In the embodiments of the present disclosure, the terminal plays the multiple pictures in sequence according to the determined playing speed of the multiple pictures and the playing order of the multiple pictures.
[0135] The embodiments of the present disclosure provide a method for playing a video based on pictures. When playing a target video generated from multiple pictures, it can identify the content information of the multiple pictures in the target video, so as to determine a playing speed matching the content information. When the content information in the picture is more, that is, when the amount of information is larger, the corresponding playing speed is slower, so that the user can have enough time to view all the content in the picture without pausing or repeating the playing of the target video. When the content information in the picture is less, that is, when the amount of information is smaller, the corresponding playing speed is faster, so that the user can avoid wasting too much time, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0136] All the above optional technical solutions can be combined arbitrarily to form optional embodiments of the present disclosure, which will not be elaborated one by one here.
[0137] Figure 6 is a block diagram of a video playing device based on pictures shown according to an exemplary embodiment. Refer to Figure 6, the picture-based video playing device includes: an identifying unit 601, a determining unit 602, and a playing unit 603.
[0138] The identifying unit 601 is configured to execute, in response to a playing instruction for a target video, to identify the content information of multiple pictures in the target video;
[0139] The determining unit 602 is configured to execute to determine the playing speed of the multiple pictures based on the content information of the multiple pictures;
[0140] The playing unit 603 is configured to execute to play the multiple pictures at the playing speed of the multiple pictures.
[0141] An embodiment of the present disclosure provides a picture-based video playing device. When playing a target video generated by multiple pictures, it can identify the content information of the multiple pictures in the target video, so as to determine a playing speed that matches the content information. When there is more content information in the picture, that is, when the amount of information is larger, the corresponding playing speed is slower, so that the user can have enough time to view all the content in the picture without pausing or repeatedly playing the target video. When there is less content information in the picture, that is, when the amount of information is smaller, the corresponding playing speed is faster, so that the user can avoid wasting more time, thereby improving the human-computer interaction efficiency and further enhancing the user experience.
[0142] In some embodiments, Figure 7 is a block diagram of another picture-based video playing device shown according to an exemplary embodiment. Refer to Figure 7 , the identifying unit 601 is configured to execute, in response to a playing instruction for a target video, to determine whether the intelligent playing function is enabled; in the case where the intelligent playing function is enabled, to identify the content information of multiple pictures in the target video; in the case where the intelligent playing function is not enabled, to play the multiple pictures at a preset playing speed.
[0143] In some embodiments, continue to refer to Figure 7 , the device further includes:
[0144] A display unit 604 is configured to execute to display the target video in a playing interface;
[0145] The display unit 604 is further configured to execute, in response to a setting operation on the target video, to display a setting panel in the playing interface. The setting panel displays an intelligent speed control for setting the playing speed of multiple pictures in the target video;
[0146] A starting unit 605 is configured to execute, in response to a triggering operation on the intelligent speed control, to enable the intelligent playing function.
[0147] In some embodiments, continue to refer to Figure 7 the recognition unit 601, which is configured to obtain the video content type of the target video; when the video content type is text content, recognize the text in multiple pictures; when the video content type is pattern content, recognize the patterns in multiple pictures.
[0148] In some embodiments, continue to refer to Figure 7 the determination unit 602, including:
[0149] the first determination subunit 6021, which is configured to, for any picture, determine the complexity of the content information of the picture based on the content information of the picture;
[0150] the second determination subunit 6022, which is configured to determine the playback speed matching the complexity based on the complexity, and the playback speed is negatively correlated with the complexity.
[0151] In some embodiments, continue to refer to Figure 7 the first determination subunit 6021, which is configured to, when the video content type of the target video is text content, obtain the number of words in the picture; based on the number of words, determine the complexity of the content information of the picture, and the complexity is positively correlated with the number of words.
[0152] In some embodiments, continue to refer to Figure 7 the first determination subunit 6021, which is configured to, when the video content type of the target video is text content, obtain the text size in the picture; based on the text size, determine the complexity of the content information of the picture, and the complexity is negatively correlated with the text size.
[0153] In some embodiments, continue to refer to Figure 7 the first determination subunit 6021, which is configured to, when the video content type of the target video is pattern content, obtain the number of colors in the picture; based on the number of colors, determine the complexity of the content information of the picture, and the complexity is positively correlated with the number of colors.
[0154] In some embodiments, continue to refer to Figure 7 the first determination subunit 6021, which is configured to, when the video content type of the target video is pattern content, obtain the contrast between adjacent colors in the picture; based on the contrast between adjacent colors, determine the complexity of the content information of the picture, and the complexity is negatively correlated with the contrast between adjacent colors.
[0155] In some embodiments, continue to refer to Figure 7, an identification unit 601, configured to perform identifying text in multiple pictures when the video content type of the target video is a mixed type of content, where the mixed type of content includes text and patterns;
[0156] A determination unit 602, configured to perform determining the playback speed of multiple pictures based on the text in the multiple pictures.
[0157] In some embodiments, continue to refer to Figure 7 , the apparatus further includes:
[0158] An acquisition unit 606, configured to perform, when the multiple pictures are spliced end to end, in response to a playback instruction for the target video, acquiring the lengths of the multiple pictures, where the length of a picture is the length of the side perpendicular to the head and tail of the picture;
[0159] A determination unit 602, configured to perform, for any one picture, determining a playback speed matching the length of the picture based on the length of the picture, where the length of the picture is negatively correlated with the playback speed.
[0160] It should be noted that when the above-described video playback apparatus based on pictures plays a target video generated from multiple pictures, only the above-described division of each functional unit is used for illustration. In practical applications, the above functions can be allocated to different functional units according to needs, that is, the internal structure of the electronic device is divided into different functional units to complete all or part of the functions described above. In addition, the above-described video playback apparatus based on pictures and the embodiment of the video playback method based on pictures belong to the same concept, and the specific implementation process is detailed in the method embodiment and will not be elaborated here.
[0161] Regarding the apparatus in the above embodiments, the specific manners in which each module performs operations have been described in detail in the embodiments related to the method, and will not be elaborated here.
[0162] When the electronic device is provided as a terminal, Figure 8 is a block diagram of a terminal 800 shown according to an exemplary embodiment. The Figure 8The structural block diagram of a terminal 800 provided by an exemplary embodiment of the present disclosure is shown. The terminal 800 may be: a smart phone, a tablet computer, an MP3 player (Moving Picture Experts Group Audio Layer III), an MP4 (Moving Picture Experts Group Audio Layer IV) player, a notebook computer, or a desktop computer. The terminal 800 may also be referred to by other names such as a user equipment, a portable terminal, a laptop terminal, a desktop terminal, etc.
[0163] Generally, the terminal 800 includes: a processor 801 and a memory 802.
[0164] The processor 801 may include one or more processing cores, such as a quad-core processor, an octa-core processor, etc. The processor 801 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), or PLA (Programmable Logic Array). The processor 801 may also include a main processor and a co-processor. The main processor is a processor for processing data in the wake state, also known as the CPU (Central Processing Unit); the co-processor is a low-power processor for processing data in the standby state. In some embodiments, the processor 801 may be integrated with a GPU (Graphics Processing Unit), and the GPU is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 801 may further include an AI (Artificial Intelligence) processor, and the AI processor is used to process computational operations related to machine learning.
[0165] The memory 802 may include one or more computer-readable storage media, and the computer-readable storage media may be non-transitory. The memory 802 may further include high-speed random access memory and non-volatile memory, such as one or more disk storage devices and flash storage devices. In some embodiments, the non-transitory computer-readable storage media in the memory 802 is used to store at least one program code, and the at least one program code is used to be executed by the processor 801 to implement the picture-based video playback method provided by the method embodiments of the present disclosure.
[0166] In some embodiments, the terminal 800 may further optionally include: a peripheral device interface 803 and at least one peripheral device. The processor 801, the memory 802, and the peripheral device interface 803 may be connected through a bus or signal lines. Each peripheral device may be connected to the peripheral device interface 803 through a bus, signal lines, or a circuit board. Specifically, the peripheral device includes at least one of the following: a radio frequency circuit 804, a display screen 805, a camera assembly 806, an audio circuit 807, a positioning assembly 808, and a power supply 809.
[0167] The peripheral device interface 803 can be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 801 and the memory 802. In some embodiments, the processor 801, the memory 802, and the peripheral device interface 803 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 801, the memory 802, and the peripheral device interface 803 can be implemented on a separate chip or circuit board, and this embodiment does not limit this.
[0168] The radio frequency circuit 804 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 804 communicates with a communication network and other communication devices through electromagnetic signals. The radio frequency circuit 804 converts an electrical signal into an electromagnetic signal for transmission, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 804 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so on. The radio frequency circuit 804 can communicate with other terminals through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to: a metropolitan area network, various generations of mobile communication networks (2G, 3G, 4G, and 5G), a wireless local area network, and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 804 may further include a circuit related to NFC (Near Field Communication), and this disclosure does not limit this.
[0169] The display screen 805 is used to display the UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 805 is a touch display screen, the display screen 805 also has the ability to collect touch signals on or above the surface of the display screen 805. The touch signal can be input to the processor 801 as a control signal for processing. At this time, the display screen 805 can also be used to provide virtual buttons and / or a virtual keyboard, also known as soft buttons and / or a soft keyboard. In some embodiments, there may be one display screen 805, which is provided on the front panel of the terminal 800; in other embodiments, there may be at least two display screens 805, which are respectively provided on different surfaces of the terminal 800 or in a foldable design; in still other embodiments, the display screen 805 may be a flexible display screen, which is provided on the curved surface or the folding surface of the terminal 800. Even more, the display screen 805 can also be set to an irregular non-rectangular shape, that is, a special-shaped screen. The display screen 805 can be prepared from materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).
[0170] The camera module 806 is used to capture images or videos. Optionally, the camera module 806 includes a front camera and a rear camera. Generally, the front camera is provided on the front panel of the terminal, and the rear camera is provided on the back of the terminal. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth-of-field camera, a wide-angle camera, and a telephoto camera, so as to implement the function of background blurring by fusing the main camera and the depth-of-field camera, panoramic shooting by fusing the main camera and the wide-angle camera, and VR (Virtual Reality) shooting function or other fused shooting functions. In some embodiments, the camera module 806 may further include a flash. The flash can be a single-color-temperature flash or a two-color-temperature flash. The two-color-temperature flash refers to the combination of a warm-light flash and a cold-light flash, which can be used for light compensation under different color temperatures.
[0171] The audio circuit 807 may include a microphone and a speaker. The microphone is used to collect sound waves of the user and the environment, and convert the sound waves into electrical signals for input to the processor 801 for processing, or input to the radio frequency circuit 804 to achieve voice communication. For the purpose of stereo collection or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the terminal 800. The microphone may also be an array microphone or an omnidirectional collection microphone. The speaker is used to convert the electrical signals from the processor 801 or the radio frequency circuit 804 into sound waves. The speaker may be a traditional thin film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert electrical signals into sound waves audible to humans, but also convert electrical signals into sound waves inaudible to humans for uses such as ranging. In some embodiments, the audio circuit 807 may further include a headphone jack.
[0172] The positioning component 808 is used to locate the current geographical location of the terminal 800 to achieve navigation or LBS (Location Based Service). The positioning component 808 may be a positioning component based on the GPS (Global Positioning System) of the United States, the Beidou system of China, the GLONASS system of Russia, or the Galileo system of the European Union.
[0173] The power supply 809 is used to supply power to each component in the terminal 800. The power supply 809 may be alternating current, direct current, a disposable battery, or a rechargeable battery. When the power supply 809 includes a rechargeable battery, the rechargeable battery may support wired charging or wireless charging. The rechargeable battery may also be used to support fast charging technology.
[0174] In some embodiments, the terminal 800 further includes one or more sensors 810. The one or more sensors 810 include but are not limited to: an acceleration sensor 811, a gyroscope sensor 812, a pressure sensor 813, a fingerprint sensor 814, an optical sensor 815, and a proximity sensor 816.
[0175] The acceleration sensor 811 can detect the magnitudes of accelerations on the three coordinate axes of the coordinate system established with the terminal 800. For example, the acceleration sensor 811 can be used to detect the components of the gravitational acceleration on the three coordinate axes. The processor 801 can control the display screen 805 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 811. The acceleration sensor 811 can also be used for collecting game or user's motion data.
[0176] The gyroscope sensor 812 can detect the body direction and rotation angle of the terminal 800. The gyroscope sensor 812 can cooperate with the acceleration sensor 811 to collect the 3D actions of the user on the terminal 800. Based on the data collected by the gyroscope sensor 812, the processor 801 can implement the following functions: motion sensing (such as changing the UI according to the user's tilting operation), image stabilization during shooting, game control, and inertial navigation.
[0177] The pressure sensor 813 can be disposed on the side frame of the terminal 800 and / or the lower layer of the display screen 805. When the pressure sensor 813 is disposed on the side frame of the terminal 800, it can detect the holding signal of the user on the terminal 800, and the processor 801 can perform left / right hand recognition or quick operation according to the holding signal collected by the pressure sensor 813. When the pressure sensor 813 is disposed on the lower layer of the display screen 805, the processor 801 can control the operable controls on the UI interface according to the pressure operation of the user on the display screen 805. The operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.
[0178] The fingerprint sensor 814 is used to collect the fingerprint of the user. The processor 801 can identify the user's identity according to the fingerprint collected by the fingerprint sensor 814, or the fingerprint sensor 814 can identify the user's identity according to the collected fingerprint. When the identified user identity is a trusted identity, the processor 801 authorizes the user to perform relevant sensitive operations, and the sensitive operations include unlocking the screen, viewing encrypted information, downloading software, making payments, and changing settings, etc. The fingerprint sensor 814 can be disposed on the front, back, or side of the terminal 800. When there are physical buttons or manufacturer logos on the terminal 800, the fingerprint sensor 814 can be integrated with the physical buttons or manufacturer logos.
[0179] The optical sensor 815 is used to collect the ambient light intensity. In one embodiment, the processor 801 can control the display brightness of the display screen 805 according to the ambient light intensity collected by the optical sensor 815. Specifically, when the ambient light intensity is high, the display brightness of the display screen 805 is increased; when the ambient light intensity is low, the display brightness of the display screen 805 is decreased. In another embodiment, the processor 801 can also dynamically adjust the shooting parameters of the camera module 806 according to the ambient light intensity collected by the optical sensor 815.
[0180] The proximity sensor 816, also known as the distance sensor, is usually disposed on the front panel of the terminal 800. The proximity sensor 816 is used to collect the distance between the user and the front of the terminal 800. In one embodiment, when the proximity sensor 816 detects that the distance between the user and the front of the terminal 800 is gradually decreasing, the processor 801 controls the display screen 805 to switch from the lit state to the off state; when the proximity sensor 816 detects that the distance between the user and the front of the terminal 800 is gradually increasing, the processor 801 controls the display screen 805 to switch from the off state to the lit state.
[0181] Those skilled in the art can understand that Figure 8 the structure shown in does not constitute a limitation on the terminal 800, and may include more or fewer components than shown in the figure, or combine some components, or adopt a different component layout.
[0182] When the electronic device is provided as a server, Figure 9 is a block diagram of a server 900 shown according to an exemplary embodiment. The server 900 may vary greatly due to configuration or performance, and may include one or more processors (Central Processing Units, CPUs) 901 and one or more memories 902. Among them, at least one program code is stored in the memory 902, and the at least one program code is loaded and executed by the processor 901 to implement the picture-based video playback method provided by each of the above method embodiments. Of course, the server may also have components such as a wired or wireless network interface, a keyboard, and an input / output interface for input / output. The server 900 may also include other components for implementing the functions of the device, which will not be elaborated here.
[0183] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as the memory 802 or the memory 902 including instructions. The above instructions can be executed by the processor 801 of the terminal 800 or the processor 901 of the server 900 to complete the above picture-based video playback method. Optionally, the computer-readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.
[0184] A computer program product includes a computer program / instructions, and when the computer program / instructions are executed by a processor, the above picture-based video playback method is implemented.
[0185] Other embodiments of the present disclosure will be readily apparent to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include known common general knowledge or conventional technical means in the technical field not disclosed by the present disclosure. The specification and examples are only to be considered as exemplary, and the true scope and spirit of the present disclosure are pointed out by the following claims.
[0186] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.
Claims
1. A video playing method based on pictures, characterized in that, The method is applied to a video application running on a terminal, and the method includes: In response to a play instruction for a target video, identifying content information of multiple pictures in the target video; Based on the content information of the multiple pictures, obtaining a play speed and using the play speed as the play speed of the multiple pictures; Playing the multiple pictures at the play speed of the multiple pictures; Wherein, the identifying content information of multiple pictures in the target video includes: obtaining a video content type of the target video according to the ratio of text to pattern in the picture, where the video content type represents the main content of the multiple pictures in the target video; in the case where the video content type is text-based content, identifying the text in the multiple pictures to obtain at least one of the number of characters and the character size in the picture.
2. The method for playing a video based on pictures according to claim 1, wherein The responding to a play instruction for a target video and identifying content information of multiple pictures in the target video includes: In response to a play instruction for the target video, determining whether the intelligent play function is enabled; In the case where the intelligent play function is enabled, identifying content information of the multiple pictures in the target video; In the case where the intelligent play function is not enabled, playing the multiple pictures at a preset play speed.
3. The method for playing a video based on pictures according to claim 2, wherein The method further includes: Displaying the target video in a play interface; In response to a setting operation on the target video, displaying a setting panel in the play interface, where an intelligent speed control is displayed in the setting panel, and the intelligent speed control is used to set the play speed of multiple pictures in the target video; In response to a triggering operation on the intelligent speed control, enabling the intelligent play function.
4. The picture-based video playing method according to claim 1, wherein The identifying content information of multiple pictures in the target video further includes: In the case where the video content type is pattern-based content, identifying the patterns in the multiple pictures.
5. A video playing device based on pictures, characterized in that, The apparatus is applied to a terminal running a video application, and the apparatus includes: An identification unit configured to execute identifying content information of multiple pictures in the target video in response to a play instruction for the target video; A determination unit configured to execute obtaining a play speed based on the content information of the multiple pictures and using the play speed as the play speed of the multiple pictures, where the play speed is negatively correlated with the content information; A play unit configured to execute playing the multiple pictures at the play speed of the multiple pictures; Wherein, when the identification unit executes identifying content information of multiple pictures in the target video, it includes: obtaining a video content type of the target video according to the ratio of text to pattern in the picture, where the video content type represents the main content of the multiple pictures in the target video; in the case where the video content type is text-based content, identifying the text in the multiple pictures to obtain at least one of the number of characters and the character size in the picture.
6. An electronic device, characterized in that, The electronic device includes: One or more processors; A memory for storing executable program code for the processor; Wherein, the processor is configured to execute the program code to implement the picture-based video playing method according to any one of claims 1 to 4.
7. A computer-readable storage medium, characterized in that, When the instructions in the computer-readable storage medium are executed by the processor of the electronic device, the electronic device is enabled to execute the picture-based video playing method according to any one of claims 1 to 4.
Citation Information
Patent Citations
Video stream playing method, device and equipment
CN107371061A
Automatic page turning method for cartoon type electronic books, computing device and storage medium
CN110187816A
Video special effect generation method and terminal
CN112422804A
Video dynamic speed regulation playing method
CN112565910A
Automatic display method and device of picture sequence, electronic equipment and storage medium
CN112631480A