Information recommendation method and device and electronic equipment

Abstract

The embodiment of the invention discloses an information recommendation method and device and electronic equipment. A specific embodiment of the method comprises the following steps: acquiring a target video stream, and playing the target video stream; in the video playing process, identifying the image content of at least one target frame in the target video stream to obtain an identification result; determining at least one target object corresponding to the recognition result, and obtaining object information corresponding to each target object; and presenting the object information of the at least one target object in a playing page of the target video stream. According to the embodiment, the related information of the commodity appearing in the video stream is recommended to the user in the video stream playing process, so that channels for the user to obtain the commodity information are increased, and tedious operation generated by the user due to the fact that the user actively searches the commodity appearing in the video is also avoided.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of computer technology, and in particular to an information recommendation method, device, and electronic device. Background Art

[0002] With the rise of short video platforms, more and more users are learning about and purchasing products through short videos. As a new e-commerce model, short video sales provide huge business opportunities for entrepreneurs. How to display product features and usage scenarios through short video platforms, thereby increasing users' channels for obtaining product information, is an urgent problem to be solved. Summary of the invention

[0003] This disclosure section is provided to introduce concepts in a brief form, which will be described in detail in the detailed description section below. This disclosure section is not intended to identify key features or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0004] In a first aspect, an embodiment of the present disclosure provides an information recommendation method, including: obtaining a target video stream and playing the target video stream; during the video playback process, identifying the image content of at least one target frame in the target video stream to obtain a recognition result; determining at least one target object corresponding to the recognition result, and obtaining object information corresponding to each target object; and presenting the object information of at least one target object in the playback page of the target video stream.

[0005] In a second aspect, an embodiment of the present disclosure provides an information recommendation device, comprising: an acquisition unit, used to acquire a target video stream and play the target video stream; an identification unit, used to identify the image content of at least one target frame in the target video stream during video playback to obtain a recognition result; a determination unit, used to determine at least one target object corresponding to the recognition result, and obtain object information corresponding to each target object; and a presentation unit, used to present the object information of at least one target object in the playback page of the target video stream.

[0006] In a third aspect, an embodiment of the present disclosure provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement the information recommendation method as described in the first aspect.

[0007] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the information recommendation method as described in the first aspect.

[0008] The information recommendation method, device and electronic device provided by the disclosed embodiment obtain a target video stream and play the target video stream; then, during the video playback process, the image content of at least one target frame in the target video stream is recognized to obtain a recognition result; then, at least one target object corresponding to the recognition result is determined, and the object information corresponding to each target object is obtained; finally, the object information of the at least one target object is presented in the playback page of the target video stream. In this way, relevant information of the goods appearing in the video stream can be recommended to the user during the video stream playback, thereby increasing the channels for users to obtain product information and avoiding the tedious operations caused by users actively searching for goods appearing in the video. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and the originals and elements are not necessarily drawn to scale.

[0010] Figure 1 is a flow chart of an embodiment of the information recommendation method according to the present disclosure;

[0011] Figure 2 is a flow chart of another embodiment of the information recommendation method according to the present disclosure;

[0012] Figure 3 is a schematic diagram of an application scenario of the information recommendation method according to the present disclosure;

[0013] Figure 4 is a structural schematic diagram of an embodiment of an information recommendation device according to the present disclosure;

[0014] Figure 5 is an exemplary system architecture diagram in which various embodiments of the present disclosure may be applied;

[0015] Figure 6 It is a schematic diagram of the structure of a computer system suitable for implementing the electronic device of the embodiment of the present disclosure. DETAILED DESCRIPTION

[0016] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0017] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0018] The term "including" and its variations used herein are open inclusions, i.e., "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". The relevant definitions of other terms will be given in the following description.

[0019] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0020] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0021] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0022] Please refer to Figure 1 , shows a process 100 of an embodiment of an information recommendation method according to the present disclosure. The information recommendation method comprises the following steps:

[0023] Step 101, obtain a target video stream and play the target video stream.

[0024] In this embodiment, the execution subject of the information recommendation method (for example Figure 5 The terminal device shown in the figure can obtain the target video stream. Here, the target video stream can be a video stream obtained from a target server (e.g., a short video social server), and the target video stream can be a video stream with weak e-commerce intentions. For example, in the process of playing the target video stream, it is usually necessary to recommend relevant information of the goods appearing in the video stream to the user.

[0025] After acquiring the target video stream, the execution subject may play the target video stream. As an example, the execution subject usually plays the acquired target video stream automatically.

[0026] Step 102: During video playback, the image content of at least one target frame in the target video stream is identified to obtain an identification result.

[0027] In this embodiment, during the video playback process, the execution subject may identify the image content of at least one target frame in the target video stream to obtain a recognition result. As an example, the execution subject may identify each frame in the target video stream.

[0028] Specifically, the execution subject determines the information of the object contained in the target frame by identifying the image content of the target frame, such as the name, category, label, etc. of the object. It should be noted that multiple objects can be identified from one target frame.

[0029] Step 103: determine at least one target object corresponding to the recognition result, and obtain object information corresponding to each target object.

[0030] In this embodiment, the execution subject may determine at least one target object corresponding to the recognition result, and obtain object information corresponding to each target object. Here, the target object may be a commodity, and commodity information corresponding to each commodity is obtained. The commodity information may include but is not limited to at least one of the following: commodity category, commodity color, commodity style, and commodity brand.

[0031] Specifically, the execution subject may obtain at least one commodity corresponding to the recognition result from the target server. The execution subject may also store commodity information locally and determine at least one commodity corresponding to the recognition result locally.

[0032] It should be noted that at least one product corresponding to the recognition result may be determined according to business requirements. For example, the same product as the recognition result may be determined, or similar products of the same category as the recognition result may be determined.

[0033] Step 104: present object information of at least one target object in the playback page of the target video stream.

[0034] In this embodiment, the execution subject may present the object information of the at least one target object in the playback page of the target video stream. Here, the execution subject may present the commodity information of the corresponding at least one commodity in the playback page during the playback of the target video stream. As an example, the execution subject may present all the acquired commodity information in the playback page at once.

[0035] Here, after determining at least one commodity corresponding to the recognition result, the execution subject may display the corresponding commodity information in the lower left corner of the playback page. It should be noted that the position where the commodity information appears on the playback page can be set according to actual conditions.

[0036] The method provided by the above embodiment of the present disclosure obtains a target video stream and plays the target video stream; then, during the video playback process, the image content of at least one target frame in the target video stream is recognized to obtain a recognition result; then, at least one target object corresponding to the recognition result is determined, and object information corresponding to each target object is obtained; finally, the object information of the at least one target object is presented in the playback page of the target video stream. In this way, relevant information of the goods appearing in the video stream can be recommended to the user during the video stream playback, and the tedious operation caused by the user actively searching for the goods appearing in the video can be avoided.

[0037] In some optional implementations, the play page may include an object recommendation area. The execution entity may present the object information of the at least one target object in the play page of the target video stream in the following manner: The execution entity may present the object information of the at least one target object in the object recommendation area. By presenting the product information in the product recommendation area, the play page is made more concise.

[0038] In some optional implementations, a target object may correspond to an object card, and at least one of the following items may be presented on the object card: an object picture and an object name. Object cards are usually used to jump to the purchase page of the corresponding object. When a user clicks on an object card, the page may jump to the purchase page accordingly. The above-mentioned execution entity may present the object information of the above-mentioned at least one target object in the above-mentioned object recommendation area in the following manner: the above-mentioned execution entity may present an object card corresponding to each target object in the above-mentioned at least one target object in the above-mentioned object recommendation area. By presenting the product card corresponding to each product in the product recommendation area, a presentation form of product information is provided, and the relevant information of the product can be presented more clearly.

[0039] In some optional implementations, the object recommendation area may correspond to a control icon, and the control icon may be used to expand and / or collapse at least a portion of the object recommendation area. Specifically, if the object information in the object recommendation area is currently in an expanded state, and a user's triggering operation on the control icon is detected, at least a portion of the object recommendation area may be collapsed. If the object information in the object recommendation area is currently in a collapsed state, and a user's triggering operation on the control icon is detected, at least a portion of the object recommendation area may be expanded.

[0040] In this way, the product recommendation area can be expanded or collapsed to avoid excessive obstruction of the playback page when the product information does not need to be viewed.

[0041] In some optional implementations, in response to detecting a retracting instruction for the object recommendation area, the execution subject may retract a portion of the object recommendation area. Afterwards, an object anchor corresponding to each target object in the at least one target object may be presented in the unretracted area. The object anchor may be presented with an object name, and the area occupied by the object anchor is usually smaller than the area occupied by the object card.

[0042] As an example, if the execution subject collapses two-thirds of the object recommendation area, the object anchor point corresponding to each target object in the at least one target object may be presented in the remaining one-third of the area.

[0043] In this way, another presentation form of product information is provided, which can present the product information while reducing the obstruction of the playback page.

[0044] In some optional implementations, at least two target objects are identified from the target video stream. In response to detecting a sliding operation on object information corresponding to each of the at least two target objects, the execution subject may slide to display each object information. As an example, a user may slide left and right on the product information to view relevant information of the product appearing in the video stream. In this way, it is convenient for the user to browse the product information.

[0045] In some optional implementations, the above-mentioned execution entity can detect whether to play the above-mentioned target video stream again. If it is detected that the above-mentioned target video stream is played again, the above-mentioned execution entity can determine whether the target condition is met. Specifically, the above-mentioned execution entity can determine whether to play the above-mentioned target video stream in a loop. Loop playback usually refers to automatically restarting the playback after the video stream playback ends. The above-mentioned execution entity can also determine whether the time interval between the replay and the last playback does not exceed a preset duration threshold (for example, 1 hour). The above-mentioned execution entity can also determine that the number of video streams separated by the replay and the last playback does not exceed a preset number threshold (for example, 20).

[0046] If it is determined that the target condition is met, the execution entity may display the object information corresponding to at least one target object identified from the target video stream at one time in the playback page. That is, when it is detected that the video stream is played again and meets the target condition, the object information will not be presented one by one, but will be presented at one time.

[0047] In this way, it is avoided that the image recognition and product identification process has to be performed again every time the video stream is played, thereby reducing resource usage.

[0048] In some optional implementations, before recognizing the image content of at least one target frame in the target video stream and obtaining the recognition result, the execution subject may segment the target video stream to obtain at least one frame sequence. Specifically, the execution subject may segment based on the image content in each frame in the target video stream. For example, video frames describing the same scene may be segmented into one segment, or video frames containing more than a preset number of the same product may be segmented into one segment. The execution subject may input the target video stream into a pre-trained segmentation model to obtain at least one frame sequence.

[0049] Afterwards, the target frame may be determined from each frame sequence in the at least one frame sequence. As an example, the execution subject may select any frame from each frame sequence as the target frame; may select the frame containing the largest number of commodities from each frame sequence as the target frame; may also select the frame with the best image quality from each frame sequence as the target frame.

[0050] In this way, the correspondence between the frame sequence and the target frame can be determined, so that the recognition result can be identified more accurately.

[0051] Continue to refer Figure 2 , which shows a process 200 of another embodiment of an information recommendation method. The process 200 of the information recommendation method includes the following steps:

[0052] Step 201, obtain a target video stream, and play the target video stream.

[0053] Step 202: During video playback, the image content of at least one target frame in the target video stream is identified to obtain an identification result.

[0054] Step 203: determine at least one target object corresponding to the recognition result, and obtain object information corresponding to each target object.

[0055] In this embodiment, steps 201-203 may be performed in a manner similar to steps 101-103, and will not be described in detail herein.

[0056] Step 204 : for each target frame in at least one target frame, present object information of at least one target object corresponding to the target frame during the process of playing the frame sequence corresponding to the target frame.

[0057] In this embodiment, for each target frame in the at least one target frame, the execution subject of the information recommendation method (for example Figure 5 The terminal device shown in the figure can present object information of at least one target object corresponding to the target frame during the process of playing the frame sequence corresponding to the target frame. The similarity between the frames in the frame sequence corresponding to the target frame is usually greater than a preset similarity threshold, that is, the frames in the frame sequence corresponding to each target frame can describe the same scene, or contain the same or similar objects.

[0058] Here, during the video playback process, the above-mentioned execution subject can identify the presented target frames in the order of video playback. When the first target frame is played, the product corresponding to the first target frame can be determined, and during the playback of the frame sequence corresponding to the first target frame, the product information of the product identified from the first target frame can be presented; thereafter, when the second target frame is played, the product corresponding to the second target frame can be determined, and during the playback of the frame sequence corresponding to the second target frame, the product information of the product identified from the second target frame can be presented, and this process is repeated until the target video stream is played.

[0059] from Figure 2 It can be seen that Figure 1 Compared with the corresponding embodiment, the process 200 of the information recommendation method in this embodiment embodies the step of presenting the object information of the target object identified from the target frame during the playback of the frame sequence corresponding to each target frame. Therefore, the scheme described in this embodiment can present the product information corresponding to a certain product when the product appears in the image content of the video stream, so that the product information can be presented at the appropriate time, improving the consistency between the image content and the product that appears.

[0060] In some optional implementations, the execution subject may identify at least two target objects from the target frame. The execution subject may present the object information of at least one target object corresponding to the target frame in the process of playing the frame sequence corresponding to the target frame in the following manner: the execution subject may present the object information of at least two target objects corresponding to the target frame one by one in the process of playing the frame sequence corresponding to the target frame. Presenting one by one usually refers to presenting one by one, where the product information of a commodity may be presented every preset time (for example, 1 second). Compared to presenting the product information of all commodities at once, presenting the product information of each commodity one by one may present the product information more fully.

[0061] In some optional implementations, the execution subject may present the object information of at least two target objects corresponding to the target frame one by one in the following manner: the execution subject may present the object information of at least two target objects corresponding to the target frame one by one in the order of the area occupied by the target objects in the target frame from large to small. Since the area occupied by each commodity in the image is different, the commodity with a larger area will attract the user's attention in visual presentation. Therefore, the commodity information of at least two commodities identified from the target frame is presented one by one in the order of the area occupied by the commodities in the image from large to small at intervals of a preset time (for example, 1 second), so that the presentation order corresponding to the commodities can be planned more reasonably.

[0062] In some optional implementations, the execution subject may present the object information of at least two target objects corresponding to the target frame one by one in the following manner: the execution subject may sort the at least two target objects based on the matching degree between the at least two target objects and each frame in the frame sequence corresponding to the target frame, and present the object information of at least two target objects corresponding to the target frame one by one. For each of the at least two target objects, the execution subject may determine the matching degree between the target object and each frame in the frame sequence corresponding to the target frame, determine the frame with the highest matching degree between the target object and the target object, and thus determine the frame with the highest matching degree corresponding to each target object; then, the target objects corresponding to each frame may be sorted according to the order in which each frame appears in the frame sequence. Here, the global matching score maximum algorithm may be used to determine the corresponding relationship between each target object and each frame in the frame sequence when the matching score is the highest, and then the target objects corresponding to each frame may be sorted according to the corresponding relationship.

[0063] Here, the target object identified from the target frame may appear in the frame sequence corresponding to the target frame, but the area occupied by the target object in each frame is usually different. For each of the at least two target objects, the area occupied by the image corresponding to the target object in each frame can be used to determine the matching degree between the target object and each frame. Generally, the larger the area occupied by the target object in the frame, the higher the matching degree between the target object and the frame.

[0064] In this way, the consistency between the image content and the products that appear can be further improved.

[0065] Continue to see Figure 3 , Figure 3 FIG. 1 is a schematic diagram of an application scenario of the information recommendation method according to this embodiment. Figure 3 In the application scenario, after acquiring the video stream, the user terminal plays the video stream. During the video playback process, the image content of the target frame A shown by the icon 301 currently appearing in the video stream can be recognized to obtain the recognition result: laptop computer. After that, the product A corresponding to the laptop computer can be determined, the product name and product image corresponding to the product A can be obtained to form a product card, and the product card 303 corresponding to the product A can be presented in the product recommendation area 302 of the current playback page of the video stream.

[0066] Then, when the user terminal plays the target frame B indicated by the icon 304, the image content of the target frame B can be identified to obtain the identification result: mouse and desk lamp. After that, the product B corresponding to the mouse and the product C corresponding to the desk lamp can be determined, and the product name and product image corresponding to the product B are obtained to form a product card, and the product name and product image corresponding to the product C are obtained to form a product card, and the product card 305 corresponding to the product B and the product card 306 corresponding to the product C are presented behind the product card 303 of the product A in the product recommendation area 302.

[0067] The product recommendation area may include a collapse icon 307 and an expand icon 311. When the user clicks the collapse icon 307, the product recommendation area will be partially collapsed. In the uncollapsed area shown by icon 312, a product anchor point 308 corresponding to product A, a product anchor point 309 corresponding to product B, and a product anchor point 310 corresponding to product C are presented. The user clicks the expand icon 311 to expand the product recommendation area.

[0068] Further references Figure 4 As an implementation of the methods shown in the above figures, the present application provides an embodiment of an information recommendation device, which is similar to Figure 1Corresponding to the method embodiment shown, the device can be specifically applied to various electronic devices.

[0069] like Figure 4 As shown, the information recommendation device 400 of this embodiment includes: an acquisition unit 401, an identification unit 402, a determination unit 403 and a presentation unit 404. The acquisition unit 401 is used to acquire a target video stream and play the target video stream; the identification unit 402 is used to identify the image content of at least one target frame in the target video stream during video playback to obtain a recognition result; the determination unit 403 is used to determine at least one target object corresponding to the recognition result and obtain object information corresponding to each target object; the presentation unit 404 is used to present the object information of the at least one target object in the playback page of the target video stream.

[0070] In this embodiment, the specific processing of the acquisition unit 401, the identification unit 402, the determination unit 403 and the presentation unit 404 of the information recommendation device 400 can be referred to. Figure 1 This corresponds to step 101, step 102, step 103 and step 104 in the embodiment.

[0071] In some optional implementations, the presentation unit 404 is further used to present the object information of the at least one target object in the playback page of the target video stream in the following manner: for each target frame in the at least one target frame, during the playback of the frame sequence corresponding to the target frame, present the object information of at least one target object corresponding to the target frame, wherein the similarity between each frame in the frame sequence corresponding to the target frame is greater than a preset similarity threshold.

[0072] In some optional implementations, at least two target objects are identified from the target frame; and the above-mentioned presentation unit 404 is further used to present object information of at least one target object corresponding to the target frame in the process of playing the frame sequence corresponding to the target frame in the following manner: in the process of playing the frame sequence corresponding to the target frame, the object information of at least two target objects corresponding to the target frame is presented one by one.

[0073] In some optional implementations, the presentation unit 404 is further used to present object information of at least two target objects corresponding to the target frame one by one in the following manner: present object information of at least two target objects corresponding to the target frame one by one in the order of the areas occupied by the target objects in the target frame from large to small.

[0074] In some optional implementations, the presentation unit 404 is further used to present object information of at least two target objects corresponding to the target frame one by one in the following manner: based on the degree of matching between the at least two target objects and each frame in a frame sequence corresponding to the target frame, the at least two target objects are sorted, and object information of the at least two target objects corresponding to the target frame is presented one by one.

[0075] In some optional implementations, the above-mentioned playback page includes an object recommendation area; and the above-mentioned presentation unit 404 is further used to present the object information of the above-mentioned at least one target object in the playback page of the above-mentioned target video stream in the following manner: presenting the object information of the above-mentioned at least one target object in the above-mentioned object recommendation area.

[0076] In some optional implementations, one target object corresponds to one object card, and at least one of the following items is presented on the object card: an object picture and an object name, and the object card is used to jump to the purchase page of the corresponding object; and the above-mentioned presentation unit 404 is further used to present the object information of the above-mentioned at least one target object in the above-mentioned object recommendation area in the following manner: presenting the object card corresponding to each target object in the above-mentioned at least one target object in the above-mentioned object recommendation area.

[0077] In some optional implementations, the object recommendation area corresponds to a control icon, and the control icon is used to expand and / or collapse at least a portion of the object recommendation area.

[0078] In some optional implementations, the information recommendation device 400 may further include a retracting unit (not shown in the figure). The retracting unit is used to, in response to detecting a retracting instruction for the object recommendation area, retract a portion of the object recommendation area, and present an object anchor point corresponding to each target object in the at least one target object in the unretracted area, wherein the object anchor point presents an object name, and the area occupied by the object anchor point is smaller than the area occupied by the object card.

[0079] In some optional implementations, at least two target objects are identified from the target video stream. The information recommendation device 400 may further include a sliding unit (not shown). The sliding unit is used to slide and display the object information of each target object in response to detecting a sliding operation on the object information corresponding to each of the at least two target objects.

[0080] In some optional implementations, the information recommendation device 400 may further include a condition determination unit (not shown in the figure) and a display unit (not shown in the figure). The condition determination unit is used to determine whether a target condition is met in response to detecting that the target video stream is played again, wherein the target condition includes at least one of the following: the target video stream is played in a loop, the time interval between the replay and the last play does not exceed a preset time threshold, and the number of video streams between the replay and the last play does not exceed a preset number threshold; the display unit is used to display the object information corresponding to at least one target object identified from the target video stream in the play page at one time if it is determined that the target condition is met.

[0081] In some optional implementations, the information recommendation device 400 may further include a segmentation unit (not shown in the figure) and a target frame determination unit (not shown in the figure). The segmentation unit is used to segment the target video stream to obtain at least one frame sequence; the target frame determination unit is used to determine the target frame from each frame sequence in the at least one frame sequence.

[0082] Figure 5 An exemplary system architecture 500 is shown to which an embodiment of the information recommendation method of the present disclosure can be applied.

[0083] like Figure 5 As shown, the system architecture 500 may include terminal devices 5011, 5012, 5013, a network 502, and a server 503. The network 502 is used to provide a medium for communication links between the terminal devices 5011, 5012, 5013 and the server 503. The network 502 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.

[0084] The user can use the terminal devices 5011, 5012, 5013 to interact with the server 503 through the network 502 to send or receive messages, etc. For example, the server 503 can send object information to the terminal devices 5011, 5012, 5013 that browse the video stream. Various communication client applications can be installed on the terminal devices 5011, 5012, 5013, such as video streaming social software, video playback applications, etc.

[0085] The terminal devices 5011, 5012, and 5013 can first obtain the target video stream from the server 503 and play the above target video stream; thereafter, during the video playback process, the image content of at least one target frame in the above target video stream can be identified to obtain an identification result; then, at least one target object corresponding to the above identification result can be determined, and object information corresponding to each target object can be obtained from the server 503; finally, the object information of the above at least one target object can be presented in the playback page of the above target video stream.

[0086] Terminal devices 5011, 5012, 5013 can be hardware or software. When terminal devices 5011, 5012, 5013 are hardware, they can be various electronic devices with display screens and supporting information interaction, including but not limited to smart phones, tablet computers, laptop portable computers, etc. When terminal devices 5011, 5012, 5013 are software, they can be installed in the electronic devices listed above. It can be implemented as multiple software or software modules (for example, multiple software or software modules for providing distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.

[0087] The server 503 may be a server that provides various services, for example, a background server that provides video streams and object information to the terminal devices 5011 , 5012 , and 5013 .

[0088] It should be noted that the server 503 can be hardware or software. When the server 503 is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or it can be implemented as a single server. When the server 503 is software, it can be implemented as multiple software or software modules (for example, for providing distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.

[0089] It should also be noted that the information recommendation method provided in the embodiments of the present disclosure is usually executed by the terminal devices 5011 , 5012 , 5013 , and the information recommendation apparatus is usually provided in the terminal devices 5011 , 5012 , 5013 .

[0090] It should be understood that Figure 5 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0091] Reference below Figure 6 , which shows an electronic device (eg, Figure 5The terminal device in the embodiment of the present disclosure may include but is not limited to mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 6 The terminal device shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0092] like Figure 6 As shown, the electronic device 600 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage device 608 into a random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the electronic device 600 are also stored. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0093] Typically, the following devices may be connected to the I / O interface 605: an input device 606 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 607 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; and a communication device 609. The communication device 609 may allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data. Figure 6 The electronic device 600 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead. Figure 6 Each block shown in the figure may represent one device, or may represent multiple devices as required.

[0094] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through a communication device 609, or installed from a storage device 608, or installed from a ROM 602. When the computer program is executed by the processing device 601, the above functions defined in the method of the embodiment of the present disclosure are executed. It should be noted that the computer-readable medium described in the embodiment of the present disclosure can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to, an electrical connection with one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In an embodiment of the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, an apparatus, or a device. In an embodiment of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in combination with an instruction execution system, an apparatus, or a device. The program code embodied on the computer readable medium may be transmitted using any appropriate medium, including but not limited to: wire, optical cable, RF (radio frequency), etc., or any suitable combination of the foregoing.

[0095] The computer-readable medium may be included in the electronic device; or it may exist independently without being installed in the electronic device. The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: obtains a target video stream and plays the target video stream; during the video playback, recognizes the image content of at least one target frame in the target video stream to obtain a recognition result; determines at least one target object corresponding to the recognition result, and obtains object information corresponding to each target object; and presents the object information of the at least one target object in the playback page of the target video stream.

[0096] Computer program code for performing the operations of embodiments of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on a user's computer, partially on a user's computer, as a separate software package, partially on a user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0097] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0098] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware. The units described may also be arranged in a processor, for example, may be described as: a processor includes an acquisition unit, an identification unit, a determination unit, and a presentation unit. The names of these units do not constitute limitations on the units themselves in certain circumstances, for example, the acquisition unit may also be described as a "unit for acquiring a target video stream and playing the target video stream".

[0099] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalent features without departing from the above-mentioned inventive concept. For example, the above-mentioned features are replaced with the technical features with similar functions disclosed in the embodiments of the present disclosure (but not limited to) to form a technical solution.

Claims

1. An information recommendation method, characterized in that: include: Obtaining a target video stream, and playing the target video stream; During video playback, the image content of at least one target frame in the target video stream is recognized to obtain a recognition result; Determine at least one target object corresponding to the recognition result, and obtain object information corresponding to each target object; In the playback page of the target video stream, object information of the at least one target object is presented.

2. The method according to claim 1, characterized in that The presenting of the object information of the at least one target object in the playback page of the target video stream includes: For each target frame of the at least one target frame, during the process of playing the frame sequence corresponding to the target frame, object information of at least one target object corresponding to the target frame is presented, wherein the similarity between each frame in the frame sequence corresponding to the target frame is greater than a preset similarity threshold.

3. The method according to claim 2, characterized in that identifying at least two target objects from the target frame; as well as The presenting of object information of at least one target object corresponding to the target frame during the process of playing the frame sequence corresponding to the target frame includes: During the process of playing the frame sequence corresponding to the target frame, object information of at least two target objects corresponding to the target frame is presented one by one.

4. The method according to claim 3, characterized in that The presenting object information of at least two target objects corresponding to the target frame one by one includes: Object information of at least two target objects corresponding to the target frame is presented one by one in the order of the areas occupied by the target objects in the target frame from large to small.

5. The method according to claim 3, characterized in that: The presenting object information of at least two target objects corresponding to the target frame one by one includes: Based on the matching degree between the at least two target objects and each frame in the frame sequence corresponding to the target frame, the at least two target objects are sorted, and the object information of the at least two target objects corresponding to the target frame is presented one by one.

6. The method according to any one of claims 1 to 5, characterized in that: The play page includes an object recommendation area; as well as The presenting of the object information of the at least one target object in the playback page of the target video stream includes: Object information of the at least one target object is presented in the object recommendation area.

7. The method according to claim 6, characterized in that One target object corresponds to one object card, and the object card presents at least one of the following items: an object picture and an object name, and the object card is used to jump to the purchase page of the corresponding object; as well as Presenting the object information of the at least one target object in the object recommendation area includes: An object card corresponding to each target object in the at least one target object is presented in the object recommendation area.

8. The method according to claim 7, characterized in that The object recommendation area corresponds to a control icon, and the control icon is used to expand and / or collapse at least a part of the object recommendation area.

9. The method according to claim 8, characterized in that The method further comprises: In response to detecting a collapse instruction for the object recommendation area, a portion of the object recommendation area is collapsed, and an object anchor point corresponding to each target object in the at least one target object is presented in the uncollapsed area, wherein the object name is presented on the object anchor point, and the area occupied by the object anchor point is smaller than the area occupied by the object card.

10. The method according to claim 7, characterized in that Identifying at least two target objects from the target video stream; The method further comprises: In response to detecting a sliding operation on the object information corresponding to each of the at least two target objects, each object information is displayed by sliding.

11. The method according to claim 1, characterized in that: The method further comprises: In response to detecting that the target video stream is played again, determining whether a target condition is met, wherein the target condition includes at least one of the following: the target video stream is played in a loop, the time interval between the last playback and the next playback does not exceed a preset time threshold, and the number of video streams between the last playback and the next playback does not exceed a preset number threshold; If so, the object information corresponding to at least one target object identified from the target video stream is displayed at one time on the playback page.

12. The method according to claim 2, characterized in that: Before identifying the image content of at least one target frame in the target video stream to obtain the identification result, the method further includes: Segmenting the target video stream to obtain at least one frame sequence; A target frame is determined from each of the at least one frame sequence.

13. An information recommendation device, characterized in that: include: An acquisition unit, used for acquiring a target video stream and playing the target video stream; An identification unit, used to identify the image content of at least one target frame in the target video stream during video playback to obtain an identification result; a determination unit, configured to determine at least one target object corresponding to the recognition result, and obtain object information corresponding to each target object; A presentation unit is used to present the object information of the at least one target object in the playback page of the target video stream.

14. An electronic device, characterized in that: include: one or more processors; a storage device having one or more programs stored thereon, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 12.

15. A computer readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 12 is implemented.

Images