Video processing method, device and electronic equipment
By obtaining and automatically classifying video feature information, extracting and adding it to the page, the problem of users' cumbersome operations when looking for short video content is solved, and the effect of rapid query and simplifying operations is achieved.
Patent Information
- Application Number
- CN202010949290.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-09-10
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2040-11-15
AI Technical Summary
When users look for short video content, they need to browse a large number of videos in the list of likes in turn, resulting in cumbersome operations.
By obtaining the feature information of the video, automatically classifying and extracting relevant key information, and adding it to the target page, it can achieve quick query and simplify user operations.
Automatically collect key information when users browse videos, without stopping browsing and manually collecting, which simplifies operations. Users can quickly find content in key information and avoid flipping through a large number of videos.
Smart Images

Figure CN112084370B_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of electronic technology, and specifically relates to a video processing method, device and electronic equipment. Background Art
[0002] With the rapid development of short videos on the Internet, a large number of short videos have emerged. Among them, the content expressed in short videos is rich and colorful, including short videos expressing music content, short videos expressing movie content, and so on.
[0003] Usually, users will double-click on the short videos they are interested in, so that the short videos are moved to the user's favorite list. As the number of users' daily browsing is huge, the number of short videos in the favorite list is increasing. When users want to find some content, they can only browse a large number of short videos in the favorite list one by one, which makes the user's operation cumbersome.
[0004] Therefore, in the process of implementing this application, the inventors found that there are at least the following problems in the prior art: when a user wants to find some content, he can only browse a large number of short videos in the favorite list in turn, which makes the user operation cumbersome. Summary of the invention
[0005] The purpose of the embodiments of the present application is to provide a video processing method that can solve the problem that when a user wants to find some content, he can only browse a large number of short videos in the favorite list in sequence, which causes cumbersome user operations.
[0006] In order to solve the above technical problems, this application is implemented as follows:
[0007] In a first aspect, an embodiment of the present application provides a video processing method, the method comprising: obtaining characteristic information of a target video; determining a target type to which the target video belongs based on the characteristic information of the target video; obtaining target key information associated with the target type in the target video; and adding the target key information to a target page.
[0008] In a second aspect, an embodiment of the present application provides a video processing device, which includes: a feature acquisition module for acquiring feature information of a target video; a type determination module for determining a target type to which the target video belongs based on the feature information of the target video; an information acquisition module for acquiring target key information associated with the target type in the target video; and an information adding module for adding the target key information to a target page.
[0009] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method of the first aspect.
[0010] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method of the first aspect are implemented.
[0011] In a fifth aspect, an embodiment of the present application provides a chip, the chip including a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the method of the first aspect.
[0012] Thus, in the embodiment of the present application, the video that the user is browsing can be used as the target video, so as to obtain the characteristic information of the target video, and then classify the target video based on the characteristic information to determine whether the target video belongs to the target type. Furthermore, after determining the target type, the key information associated with the target type is extracted from the content of the target video as the target key information of this embodiment, and added to the target page. It can be seen that compared with the prior art, on the one hand, this embodiment automatically collects key information when the user browses the video, without the need for the user to stop browsing the video and then manually collect it, thus simplifying the user operation; on the other hand, the target page presents the key information, so that the user can quickly query in the key information, avoid flipping through a large number of videos, and simplify the user operation. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] Figure 1 is one of the flow charts of the video processing method according to an embodiment of the present application;
[0014] Figure 2 This is the second flowchart of the video processing method of the embodiment of the present application;
[0015] Figure 3 This is the third flowchart of the video processing method of the embodiment of the present application;
[0016] Figure 4 This is the fourth flowchart of the video processing method of the embodiment of the present application;
[0017] Figure 5 This is one of the operation diagrams of the video processing method according to an embodiment of the present application;
[0018] Figure 6 This is the second operation diagram of the video processing method according to the embodiment of the present application;
[0019] Figure 7 This is the fifth flowchart of the video processing method of the embodiment of the present application;
[0020] Figure 8 This is the third operation diagram of the video processing method according to the embodiment of the present application;
[0021] Fig. 9 This is the sixth flowchart of the video processing method of the embodiment of the present application;
[0022] Fig.10 This is the seventh flowchart of the video processing method of the embodiment of the present application;
[0023] Fig.11 This is the fourth operation diagram of the video processing method according to the embodiment of the present application;
[0024] Fig.12 This is the eighth flowchart of the video processing method of the embodiment of the present application;
[0025] Fig.13 This is the fifth operation diagram of the video processing method according to the embodiment of the present application;
[0026] Fig.14 is one of the block diagrams of the video processing device according to an embodiment of the present application;
[0027] Fig.15 This is one of the hardware structure diagrams of the electronic device according to the embodiment of the present application.
[0028] Fig.16 This is the second schematic diagram of the hardware structure of the electronic device according to the embodiment of the present application. DETAILED DESCRIPTION
[0029] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0030] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.
[0031] The video processing method provided in the embodiment of the present application is described in detail below through specific embodiments and their application scenarios in conjunction with the accompanying drawings.
[0032] Figure 1A flowchart of a video processing method according to an embodiment of the present application is shown, including:
[0033] Step S1: Obtain feature information of the target video.
[0034] Optionally, the target video is a short video.
[0035]
[0036] Table 1
[0037] See Table 1. The characteristic information includes but is not limited to the contents listed in Table 1.
[0038] Step S2: Determine the target type to which the target video belongs based on the feature information of the target video.
[0039] Different feature information corresponds to different types.
[0040] See Table 1, for example, for videos containing music names, they belong to the music genre.
[0041] Step S3: Obtain target key information associated with the target type in the target video.
[0042] For example, when the target video belongs to the music genre, the music name in the target video is obtained as the target key information.
[0043] Step S4: Add target key information to the target page.
[0044] Optionally, the target page is a browsing list generated for the new function of this embodiment. When a user browses a video, information related to the type of the video can be automatically extracted from the video according to the type of the video and added to the browsing list.
[0045] In this step, users can quickly locate specific information in the target page without scrolling through the video.
[0046] Thus, in the embodiment of the present application, the video that the user is browsing can be used as the target video, so as to obtain the characteristic information of the target video, and then classify the target video based on the characteristic information to determine whether the target video belongs to the target type. Furthermore, after determining the target type, the key information associated with the target type is extracted from the content of the target video as the target key information of this embodiment, and added to the target page. It can be seen that compared with the prior art, on the one hand, this embodiment automatically collects key information when the user browses the video, without the need for the user to stop browsing the video and then manually collect it, thus simplifying the user operation; on the other hand, the target page presents the key information, so that the user can quickly query in the key information, avoid flipping through a large number of videos, and simplify the user operation.
[0047] exist Figure 1 Based on the embodiment shown, Figure 2 A flowchart of a video processing method according to another embodiment of the present application is shown, wherein step S1 includes at least one of the following:
[0048] Step S101: upon receiving a preset input of a target video from a user, acquiring feature information of the target video, wherein the preset input includes at least one of like, comment, favorite, and follow.
[0049] Optionally, the preset input includes a touch input and air input performed by a user on the screen, and is not limited to inputs such as clicking and sliding; the preset input also includes an input performed by a user on a physical button on the device, and is not limited to inputs such as pressing. Moreover, the preset input includes one or more inputs, wherein the multiple inputs may be continuous or intermittent.
[0050] The preset input is an input method that is set in advance to facilitate viewers to input the target video.
[0051] Step S102: when it is detected that the playback time of the target video is greater than a preset threshold, characteristic information of the target video is obtained.
[0052] In this embodiment, in order to make the information collected in the target page closely related to the user behavior to meet the user's preferences, on the one hand, when the user likes, comments, collects, follows, etc., the key information in the video can be actively obtained and collected; on the other hand, when the user stays on the video for more than a certain threshold while browsing the video, the key information in the video can be actively obtained and collected.
[0053] The preset threshold is: a threshold set in advance. Optionally, the preset threshold is 4 / 5 of the video duration.
[0054] In this embodiment, the relevant data of users browsing videos, including the user's input into the video, browsing time and other data, can be reported to the backend for data collection through big data embedding.
[0055] In this embodiment, on the basis of realizing automatic acquisition of key information in the video, only the videos that the user is interested in are automatically acquired, so that the key information in the target page is more relevant to the user and meets the user's needs.
[0056] exist Figure 1 Based on the embodiment shown, Figure 3 A flowchart of a video processing method according to another embodiment of the present application is shown, wherein step S2 comprises:
[0057] Step S201: Calculate the probability value of the target video belonging to each category according to the feature information of the target video.
[0058] Step S202: Determine, based on the probability value, whether the target video belongs to at least one of the categories.
[0059] Among them, each type includes at least music type, family type, travel type and food type.
[0060] In this embodiment, features can be extracted by a machine learning algorithm, specifically, by a gradient boosting iterative decision tree (GBDT) algorithm feature selection, and the features used by GBDT include but are not limited to the features listed in Table 1. In Table 1, the features corresponding to the first column are music type features, the features corresponding to the second column are movie type features, the features corresponding to the third column are food type features, and the features corresponding to the fourth column are travel type features.
[0061] Specifically, manual labeling of offline training samples of the GBDT algorithm: After the modeling features are selected, it is necessary to start collecting training samples. This embodiment includes but is not limited to the following collection methods: supervised manual labeling of commercially purchased short video content, short video content uploaded by users themselves, and open source video sets. Offline training is then performed using these sample feature sets and manual labeling results.
[0062] The machine learning algorithm used for offline training of the model is GBDT, but not limited thereto. The GBDT parameters used in this embodiment are as follows, but not limited to these parameters. The maximum likelihood logarithm is used as the loss function, MMSE is used as the decision tree feature splitting principle, and the depth of the GBDT tree, the number of trees, and the learning factor are all configurable items.
[0063] There are four types of videos in this embodiment, namely music, video, food, and travel. Therefore, the multi-classification model of GBDT is used for offline training. The core idea is to train four learners through GBDT, weak learners trained by multiple decision trees of GBDT, and finally fit four strong learners of classification. These four strong learners correspond to the four types of this embodiment respectively. With the four learners trained by GBDT, the probabilities of these four types can be obtained. Each decision is made by comparing the maximum values of the probabilities of these four types and outputting the type unique code (Identity document, referred to as ID) value.
[0064] Among them, the probability of belonging to the cth class is calculated as:
[0065]
[0066] G c (x) is the c-th type of learner that GBDT needs to train. This learner is composed of M trained weak learners.
[0067] (Which leaf node does x belong to)
[0068] From the above formula, we can see that the final learner is obtained by adding the output of the previous GBDT to the residual R of this GBDT. Then we get the final learner G c (x) After that, the final probability distribution of the multi-type IDs can be obtained as follows, where the music type is 1, the video type is 2, the food type is 3, and the travel type is 4.
[0069]
[0070] Among them, c is 1, 2, 3, 4.
[0071] When classifying videos, all feature information reported by multiple devices will select the final leaf nodes in these M decision trees in turn, so that the G(x) value of the information that needs to be predicted in the final learner can be calculated, and then substituted into the third formula to obtain the probability values of these four types.
[0072] Optionally, the type corresponding to the obtained maximum probability value is used as the finally determined video type.
[0073] Furthermore, for music videos, song titles and song links are extracted as key information; for movie videos, movie titles and movie links are extracted as key information; and for food videos, food store addresses are extracted as key information.
[0074] In this embodiment, a method for classifying videos is provided. First, four types of videos are obtained based on a large amount of data. Among them, more types can be obtained, and the video type can also be customized by the user. Further, the probability value of the video belonging to each type is calculated using the feature information in the video, and then the type corresponding to the maximum probability value is determined as the type to which the video belongs. It can be seen that the video type obtained based on the feature information in this embodiment makes the video classification more accurate.
[0075] exist Figure 1 Based on the embodiment shown, Figure 4 A flowchart of a video processing method according to another embodiment of the present application is shown, and after step S4, the method further includes:
[0076] Step S5: receiving a first input of a first identifier, wherein the first identifier is used to indicate a target page.
[0077] Optionally, the first input includes a touch input and an air input performed by a user on the screen, and is not limited to inputs such as clicking and sliding; the first input also includes an input performed by a user on a physical button on the device, and is not limited to inputs such as pressing. Moreover, the first input includes one or more inputs, wherein the multiple inputs may be continuous or intermittent.
[0078] Optionally, the first identifier includes an icon or the like.
[0079] See also Figure 5 ,Application scenarios, such as, in the video playback interface, you can add a list icon on the right (where the finger points in the picture), and the user clicks the list icon.
[0080] Step S6: In response to the first input, display at least one second identifier, wherein the second identifier is used to indicate a type.
[0081] An application scenario is that a user clicks a list icon to display at least one type in a target page, and each type corresponds to a second identifier.
[0082] The target page may only display the type identifiers that the user has followed. For example, the target page displays four parts of content: music, film, food, and travel.
[0083] Step S7: Receive a second input of a second identifier corresponding to the target type.
[0084] Optionally, the second input includes a touch input and an air input performed by a user on the screen, and is not limited to inputs such as clicks and slides; the second input also includes an input performed by a user on a physical button on the device, and is not limited to inputs such as pressing. Moreover, the second input includes one or more inputs, wherein the multiple inputs may be continuous or intermittent.
[0085] In this step, taking the target type as an example, the user clicks the second identifier corresponding to the target type.
[0086] Step S8: In response to the second input, display key information corresponding to the target type, wherein the key information includes target key information.
[0087] See also Figure 6 , the user can select the second identifier corresponding to the different types to display the key information corresponding to the type.
[0088] Taking the target type as an example, the user clicks the second identifier corresponding to the target type to display the key information corresponding to the target type. Since the target key information is collected in the target type, the displayed key information includes the target key information of the embodiment of the present application.
[0089] Optionally, after displaying the key information, the source address of the key information is noted, for example, a link to the corresponding video. In this way, the user can also jump to the original video for viewing, helping the user to learn more about the content related to the key information.
[0090] In this embodiment, the content in the target page is displayed according to various categories to implement information classification management. Users can quickly view information based on classification, thereby further simplifying user operations.
[0091] exist Figure 4 Based on the embodiment shown, Figure 7 A flowchart of a video processing method according to another embodiment of the present application is shown. After step S7, the method further includes:
[0092] Step S9: In response to the second input, when receiving the preset input of the user for the target video or receiving the preset input of the user for the target key information, the target key information corresponding to the target type is displayed, and the input mark corresponding to the target key information is displayed.
[0093] Among them, the preset input includes at least one of like, comment, favorite, and follow.
[0094] In the case of displaying key information corresponding to the target type, the key information corresponding to the input mark is prioritized over the other key information.
[0095] In this embodiment, in response to receiving a preset input of a target video by a user, the target video is first moved to a list corresponding to the preset input, such as a favorite list, a favorite list, etc. At the same time, the target page is shared with each list data, and in the target page, the target key information extracted from the target video can be marked, so that when the target key information is displayed, the corresponding input mark is displayed at the same time.
[0096] For example, the user double-clicks the target video to like it, and the "red heart" lights up. The target video is moved to the list of liked works. Correspondingly, when the target key information on the target page is displayed, the lit "red heart" is noted to indicate that the target video to which it belongs has been liked.
[0097] In addition, in response to receiving preset input of target key information by the user on the target page, the target key information may be marked on the target page, so that when the target key information is displayed, the corresponding input mark is also displayed.
[0098] Different input types may correspond to different input marks. For example, for a favorite input, the corresponding input mark is a "yellow five-pointed star".
[0099] It should be noted that the “preset input” mentioned twice in this embodiment may be preset input of the same type or preset input of different types, without limitation.
[0100] Optionally, based on the above-mentioned display method of input marks, marked information and unmarked information can be distinguished in the target page, and in the target page, the marked information is sorted first.
[0101] In this embodiment, two methods for marking information in a target page are provided to highlight information of interest to the user in the target page, thereby facilitating the user to quickly view the information and further simplifying the user operation.
[0102] In more embodiments, on the basis of automatically acquiring the key information in the video, the user can also manually select the key information to be added to the target page.
[0103] See also Figure 8 ,Application scenarios such as: the user double-clicks the screen to input a like for a video, thereby automatically obtaining key information in the video and displaying the obtained key information. The user can select part or all of the displayed key information as key information to be added to the target page. In addition, the user can also cancel the addition of all key information to the target page.
[0104] In this way, on the basis of automatic acquisition, a manual selection function is added to avoid the target page containing information that the user does not need, thereby meeting the user's personalized needs.
[0105] exist Figure 4 Based on the embodiment shown, Fig. 9 A flowchart of a video processing method according to another embodiment of the present application is shown, and after step S8, the method further includes:
[0106] Step S10: receiving a third input of a third identifier.
[0107] Optionally, the third input includes a touch input and an air input performed by a user on the screen, and is not limited to inputs such as clicks and slides; the third input also includes an input performed by a user on a physical button on the device, and is not limited to inputs such as pressing. Moreover, the third input includes one or more inputs, wherein the multiple inputs may be continuous or intermittent.
[0108] Optionally, the third identifier includes an icon or the like.
[0109] Optionally, a third identifier is used to indicate a key information.
[0110] Step S11: in response to the third input, searching for the key information indicated by the third identifier in the program associated with the key information indicated by the third identifier.
[0111] Step S12: Display the search results in the program.
[0112] For example, when a user double-clicks a third identifier corresponding to a key information including a music title, the user will be redirected to a music application with the music title, and will automatically search with the music title on the search page, displaying a related list of results.
[0113] For another example, if a user double-clicks a third identifier corresponding to a key information including a restaurant address link and a restaurant name, the user will be redirected to a map application with the restaurant address link and the restaurant name, and will search on the search page with the restaurant address link and the restaurant name, displaying a navigation route to the restaurant.
[0114] There is no limitation on the program associated with the key information, and multiple programs may be included. The user may also select any program from the multiple programs to open.
[0115] In this embodiment, the target page is interconnected with multiple applications. When the user views information in the target page, there is no need to manually switch applications, and more relevant information can be searched in other applications, thereby further simplifying user operations.
[0116] exist Figure 4 Based on the embodiment shown, Fig.10 A flowchart of a video processing method according to another embodiment of the present application is shown, and after step S8, the method further includes:
[0117] Step S13: receiving a fourth input of the second identifier or the fourth identifier.
[0118] Optionally, the fourth input includes a touch input and an air input performed by a user on the screen, and is not limited to inputs such as clicks and slides; the fourth input also includes an input performed by a user on a physical button on the device, and is not limited to inputs such as pressing. Moreover, the fourth input includes one or more inputs, wherein the multiple inputs may be continuous or intermittent.
[0119] Optionally, the fourth identifier includes an icon, a button, etc.
[0120] Optionally, a fourth identifier is used to indicate a key information.
[0121] Step S14: in response to the fourth input, searching for and displaying videos associated with the type indicated by the second identifier; or searching for and displaying videos associated with the key information indicated by the fourth identifier.
[0122] See also Fig.11For example, a user clicks a button set on a key information to search and display a list of video recommendations that are similar to the original video containing the key information.
[0123] For another example, a user clicks a preset button in a sub-page of a certain type to search for and display a recommended list of similar videos of the same type.
[0124] In this embodiment, a quick search method is provided. When the user views the information collected in the target page, the user can quickly retrieve the relevant video without manually switching the search interface, thereby further simplifying the user operation. At the same time, the push is performed based on the information in the target page to ensure the accuracy of the pushed video.
[0125] exist Figure 1 Based on the embodiment shown, Fig.12 A flowchart of a video processing method according to another embodiment of the present application is shown, and after step S4, the method further includes:
[0126] Step S15: receiving the fifth input from the user.
[0127] Optionally, the fifth input includes a touch input and an air input performed by a user on the screen, and is not limited to inputs such as clicks and slides; the fifth input also includes an input performed by a user on a physical button on the device, and is not limited to inputs such as pressing. Moreover, the fifth input includes one or more inputs, wherein the multiple inputs may be continuous or intermittent.
[0128] See also Fig.13 In an application scenario, for example, a user clicks a share icon in my browsing list (ie, the target page of this embodiment), selects at least one key information as the target content, and then selects the target object from multiple objects that pop up.
[0129] Another application scenario is that in the application where the video is located, the user takes a picture of his friend's portrait, activates the sharing function, and directly shares the target page in the application to his friend.
[0130] Step S16: In response to the fifth input, the target content in the target page is sent to the target object.
[0131] In this step, the key information selected by the user through the fifth input is sent to the target object selected through the fifth input.
[0132] The target content is associated with the fifth input, and the target object is associated with the fifth input.
[0133] Optionally, the target object may be from a social platform.
[0134] The target content may be one or more pieces of information, or all information of the same type, or all information in the target page.
[0135] In this embodiment, the user can share the target page within the same application or between multiple applications, thereby achieving fast content sharing without the user having to switch applications, thereby further simplifying user operations.
[0136] In summary, the purpose of this application is to provide a browsing history theme classification management based on short video browsing content, so that users can intelligently manage related theme information while paying attention to short videos, which is convenient for quick query and various theme contents in short video applications. Among them, it includes intelligent analysis of related theme information in video content, without the need for users to perform operations such as collection, which greatly improves the user's interactive experience with short videos, and also facilitates users to quickly find historical video content information when they forget to collect them separately. At the same time, browsing list operation management is provided to facilitate users to quickly share the theme content they are interested in and search for similar short videos. In addition, this application combines machine learning well to improve users' management of short video content information, greatly improving the user experience of searching for theme information in short videos.
[0137] It should be noted that the video processing method provided in the embodiment of the present application can be executed by a video processing device or a control module in the video processing device for executing the video processing method. In the embodiment of the present application, the video processing method is executed by a video processing device as an example to illustrate the apparatus of the video processing method provided in the embodiment of the present application.
[0138] Fig.14 A block diagram of a video processing device according to another embodiment of the present application is shown, comprising:
[0139] A feature acquisition module 10 is used to acquire feature information of a target video;
[0140] A type determination module 20, used to determine the target type to which the target video belongs according to the characteristic information of the target video;
[0141] The information acquisition module 30 is used to acquire target key information associated with the target type in the target video;
[0142] The information adding module 40 is used to add target key information to the target page.
[0143] Thus, in the embodiment of the present application, the video that the user is browsing can be used as the target video, so as to obtain the characteristic information of the target video, and then classify the target video based on the characteristic information to determine whether the target video belongs to the target type. Furthermore, after determining the target type, the key information associated with the target type is extracted from the content of the target video as the target key information of this embodiment, and added to the target page. It can be seen that compared with the prior art, on the one hand, this embodiment automatically collects key information when the user browses the video, without the need for the user to stop browsing the video and then manually collect it, thus simplifying the user operation; on the other hand, the target page presents the key information, so that the user can quickly query in the key information, avoid flipping through a large number of videos, and simplify the user operation.
[0144] Optionally, the feature acquisition module 10 includes at least one of the following:
[0145] A first acquisition unit is used to acquire feature information of a target video when receiving a preset input of a target video by a user; wherein the preset input includes at least one of like, comment, favorite, and follow;
[0146] The second acquisition unit is used to acquire feature information of the target video when it is detected that the playback time of the target video is greater than a preset threshold.
[0147] Optionally, the type determination module 20 includes:
[0148] A calculation unit, used to calculate the probability value of the target video belonging to each type according to the feature information of the target video;
[0149] The determination unit is used to determine, according to the probability value, whether the target video belongs to at least one of the categories.
[0150] Optionally, the device further comprises:
[0151] A first input receiving module, used to receive a first input of a first identifier; wherein the first identifier is used to indicate a target page;
[0152] A first input response module, used to display at least one second identifier in response to the first input; wherein the second identifier is used to indicate a type;
[0153] A second input receiving module, used to receive a second input of a second identifier corresponding to the target type;
[0154] The second input response module is used to display key information corresponding to the target type in response to the second input; wherein the key information includes target key information.
[0155] Optionally, the device further comprises:
[0156] a marking unit, configured to, in response to a second input, display target key information corresponding to the target type and display an input mark corresponding to the target key information when receiving a preset input of a target video from a user or receiving a preset input of target key information from a user;
[0157] The preset input includes at least one of like, comment, favorite, and follow;
[0158] In the case of displaying key information corresponding to the target type, the key information corresponding to the input mark is prioritized over the other key information.
[0159] Optionally, the device further comprises:
[0160] A third input receiving module, used to receive a third input of a third identifier;
[0161] a third input response module, configured to, in response to a third input, search for the key information indicated by the third identifier in a program associated with the key information indicated by the third identifier;
[0162] Display module, used to display search results in the program.
[0163] Optionally, the device further comprises:
[0164] A fourth input receiving module, used to receive a fourth input of the second identifier or the fourth identifier;
[0165] The fourth input response module is used to search for and display videos associated with the type indicated by the second identifier in response to the fourth input; or search for and display videos associated with the key information indicated by the fourth identifier.
[0166] Optionally, the device further comprises:
[0167] A fifth input receiving module, used for receiving a fifth input from a user;
[0168] a fifth input response module, configured to send the target content in the target page to the target object in response to the fifth input;
[0169] The target content is associated with the fifth input, and the target object is associated with the fifth input.
[0170] The video processing device in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and the non-mobile electronic device can be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.
[0171] The video processing device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.
[0172] The video processing device provided in the embodiment of the present application can achieve Figures 1 to 13 To avoid repetition, the various processes implemented by the method embodiment are not described here.
[0173] Alternatively, if Fig.15 As shown, an embodiment of the present application also provides an electronic device 100, including a processor 101, a memory 102, and a program or instruction stored in the memory 102 and executable on the processor 101. When the program or instruction is executed by the processor 101, each process of the above-mentioned video processing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.
[0174] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.
[0175] Fig.16 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.
[0176] The electronic device 1000 includes but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010 and other components.
[0177] Those skilled in the art will appreciate that the electronic device 1000 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 1010 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.16 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.
[0178] Among them, processor 1010 is used to obtain characteristic information of the target video; determine the target type to which the target video belongs based on the characteristic information of the target video; obtain target key information associated with the target type in the target video; and add the target key information to the target page.
[0179] Thus, in the embodiment of the present application, the video that the user is browsing can be used as the target video, so as to obtain the characteristic information of the target video, and then classify the target video based on the characteristic information to determine whether the target video belongs to the target type. Furthermore, after determining the target type, the key information associated with the target type is extracted from the content of the target video as the target key information of this embodiment, and added to the target page. It can be seen that compared with the prior art, on the one hand, this embodiment automatically collects key information when the user browses the video, without the need for the user to stop browsing the video and then manually collect it, thus simplifying the user operation; on the other hand, the target page presents the key information, so that the user can quickly query in the key information, avoid flipping through a large number of videos, and simplify the user operation.
[0180] Optionally, the processor 1010 is further used to obtain characteristic information of the target video when receiving a preset input of the user for the target video; wherein the preset input includes at least one of like, comment, favorite, and follow; and obtain the characteristic information of the target video when it is detected that the playback time of the target video is greater than a preset threshold.
[0181] Optionally, the processor 1010 is further configured to calculate probability values of the target video belonging to each type according to the feature information of the target video; and determine, according to the probability values, that the target video belongs to at least one of the types.
[0182] Optionally, the user input unit 1007 is used to receive a first input for a first identifier; wherein the first identifier is used to indicate the target page; and to receive a second input for a second identifier corresponding to the target type; the processor 1010 is also used to display at least one second identifier in response to the first input; wherein the second identifier is used to indicate the type; and in response to the second input, display key information corresponding to the target type; wherein the key information includes the target key information.
[0183] Optionally, the processor 1010 is also used to respond to the second input, and display the target key information corresponding to the target type and the input mark corresponding to the target key information when receiving the user's preset input for the target video or receiving the user's preset input for the target key information; wherein the preset input includes at least one of like, comment, favorite, and follow; when displaying the key information corresponding to the target type, the sorting of the key information corresponding to the input mark takes precedence over the sorting of other key information.
[0184] Optionally, the user input unit 1007 is also used to receive a third input for a third identifier; the processor 1010 is also used to search for the key information indicated by the third identifier in a program associated with the key information indicated by the third identifier in response to the third input; and the display unit 1006 displays the search results in the program.
[0185] Optionally, the user input unit 1007 is also used to receive a fourth input for the second identifier or the fourth identifier; the processor 1010 is also used to search for and display videos associated with the type indicated by the second identifier in response to the fourth input; or, to search for and display videos associated with the key information indicated by the fourth identifier.
[0186] Optionally, the user input unit 1007 is further used to receive a fifth input from the user; the processor 1010 is further used to send the target content in the target page to the target object in response to the fifth input; wherein the target content is associated with the fifth input, and the target object is associated with the fifth input.
[0187] The purpose of this application is to provide a browsing history theme classification management based on short video browsing content, so that users can intelligently manage related theme information while paying attention to short videos, which is convenient for quick query and various theme contents in short video applications. Among them, it includes intelligent analysis of related theme information in video content, without the need for users to perform operations such as collection, which greatly improves the user's interactive experience with short videos, and also facilitates users to quickly find historical video content information when they forget to collect them separately. At the same time, browsing list operation management is provided to facilitate users to quickly share the theme content they are interested in and search for similar short videos. In addition, this application combines machine learning well to improve users' management of short video content information, greatly improving the user experience of searching for theme information in short videos.
[0188] It should be understood that in the embodiment of the present application, the input unit 1004 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 10042, and the graphics processor 10041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 1009 can be used to store software programs and various data, including but not limited to applications and operating systems. The processor 1010 may integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the modem processor may not be integrated into the processor 1010.
[0189] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned shooting control method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0190] The processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0191] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned shooting control method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
[0192] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
[0193] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.
[0194] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present application.
[0195] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.
Claims
1. A video processing method, characterized in that: The method comprises: Obtain feature information of the target video; Determining the target type to which the target video belongs according to the feature information of the target video; Acquire target key information associated with the target type in the target video; Add the target key information to the target page; After adding the target key information to the target page, the method further includes: Receiving a first input of a first identifier; wherein the first identifier is used to indicate the target page; In response to the first input, display at least one second identifier; wherein the second identifier is used to indicate a type; receiving a second input of a second identifier corresponding to the target type; In response to the second input, key information corresponding to the target type is displayed; wherein the key information includes the target key information.
2. The method according to claim 1, characterized in that The step of obtaining characteristic information of the target video includes at least one of the following: Upon receiving a preset input of a target video by a user, acquiring feature information of the target video; wherein the preset input includes at least one of like, comment, favorite, and follow; When it is detected that the playback time of the target video is greater than a preset threshold, characteristic information of the target video is obtained.
3. The method according to claim 1, characterized in that The step of determining the target type to which the target video belongs according to the feature information of the target video includes: According to the feature information of the target video, respectively calculating the probability value of the target video belonging to each type; According to the probability value, it is determined that the target video belongs to at least one of the types.
4. The method according to claim 1, characterized in that: After receiving a second input of a second identifier corresponding to the target type, the method further includes: In response to the second input, when receiving a preset input of the target video by the user, or receiving a preset input of the target key information by the user, displaying the target key information corresponding to the target type, and displaying an input mark corresponding to the target key information; The preset input includes at least one of like, comment, favorite, and follow; In the case of displaying the key information corresponding to the target type, the key information corresponding to the input mark is prioritized over the other key information.
5. The method according to claim 1, characterized in that After the key information corresponding to the target type is displayed in response to the second input, the method further includes: receiving a third input for a third identifier; In response to the third input, searching for the key information indicated by the third identifier in a program associated with the key information indicated by the third identifier; The search results are displayed in the program.
6. The method according to claim 1, characterized in that After the key information corresponding to the target type is displayed in response to the second input, the method further includes: receiving a fourth input of the second identifier or the fourth identifier; In response to the fourth input, videos associated with the type indicated by the second identifier are searched for and displayed; or, videos associated with the key information indicated by the fourth identifier are searched for and displayed.
7. The method according to claim 1, characterized in that After adding the target key information to the target page, the method further includes: receiving a fifth input from the user; In response to the fifth input, sending the target content in the target page to the target object; The target content is associated with the fifth input, and the target object is associated with the fifth input.
8. A video processing device, characterized in that: The device comprises: A feature acquisition module is used to acquire feature information of a target video; A type determination module, used to determine the target type to which the target video belongs according to the feature information of the target video; An information acquisition module, used to acquire target key information associated with the target type in the target video; An information adding module, used for adding the target key information to the target page; The device further comprises: A first input receiving module, used to receive a first input of a first identifier; wherein the first identifier is used to indicate the target page; A first input response module, configured to display at least one second identifier in response to the first input; wherein the second identifier is used to indicate a type; A second input receiving module, configured to receive a second input of a second identifier corresponding to the target type; The second input response module is used to display key information corresponding to the target type in response to the second input; wherein the key information includes the target key information.
9. The device according to claim 8, characterized in that The feature acquisition module includes at least one of the following: A first acquisition unit is configured to acquire feature information of a target video upon receiving a preset input of a target video by a user; wherein the preset input includes at least one of a like, a comment, a favorite, and a follow; The second acquisition unit is used to acquire feature information of the target video when it is detected that the playback time of the target video is greater than a preset threshold.
10. The device according to claim 8, characterized in that The type determination module comprises: A calculation unit, used to calculate the probability value of the target video belonging to each type according to the feature information of the target video; A determination unit is used to determine, according to the probability value, whether the target video belongs to at least one of the types.
11. The device according to claim 8, characterized in that The device also includes: a marking unit, configured to, in response to the second input, display the target key information corresponding to the target type and display an input mark corresponding to the target key information when receiving a preset input of the target video by a user or receiving a preset input of the target key information by a user; The preset input includes at least one of like, comment, favorite, and follow; In the case of displaying the key information corresponding to the target type, the key information corresponding to the input mark is prioritized over the other key information.
12. The device according to claim 8, characterized in that The device also includes: A third input receiving module, used to receive a third input of a third identifier; a third input response module, configured to, in response to the third input, search for the key information indicated by the third identifier in a program associated with the key information indicated by the third identifier; The display module is used to display the search results in the program.
13. The device according to claim 8, characterized in that The device further comprises: A fourth input receiving module, used to receive a fourth input of the second identifier or the fourth identifier; A fourth input response module is used to search for and display videos associated with the type indicated by the second identifier in response to the fourth input; or to search for and display videos associated with the key information indicated by the fourth identifier.
14. The device according to claim 8, characterized in that The device further comprises: A fifth input receiving module, used for receiving a fifth input from a user; a fifth input response module, configured to send the target content in the target page to the target object in response to the fifth input; The target content is associated with the fifth input, and the target object is associated with the fifth input.
15. An electronic device, characterized in that: The method comprises a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the video processing method according to any one of claims 1 to 7.
16. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the video processing method according to any one of claims 1 to 7 are implemented.
Citation Information
Patent Citations
Hotspot video displaying method and device
CN105872813A
Video classification method and apparatus, and electronic device
CN107451148A
Video labeling method and video playing device
CN107566917A
Video collection method and device
CN108540848A
Video classification method, device, electronic device and computer-readable storage medium
CN109376268A
