Information display method, device, computer equipment and storage medium

By responding to user search operations during video playback, and obtaining and displaying multimedia resources and key information of multiple objects of the same entity type in the video, it solves the problem that users find it difficult to quickly find content that meets the search intention under video guidance, and achieves the effect of users quickly identifying and consuming content they are interested in.

CN116156274BActive Publication Date: 2025-03-21BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202310132848.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-02-17
Publication Date
2025-03-21
Estimated Expiration
2043-02-17

AI Technical Summary

Technical Problem

After users obtain information under video guidance, it is difficult for users to quickly find content that meets their search intentions from unnecessary and complicated search results.

Method used

When playing the target video, in response to the user's search operation, the target multimedia resources and key information related to multiple objects of the same entity type in the video are obtained and displayed. These objects are filtered and compared and displayed through attribute dimensions, helping users quickly identify the entity objects of interest.

Benefits of technology

By displaying key information and multimedia resources of multiple physical objects of the same type in the video, users can quickly understand the video content and find the objects of interest, thereby conveniently consuming relevant multimedia content.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116156274B_ABST
    Figure CN116156274B_ABST
Patent Text Reader

Abstract

The present disclosure provides an information display method, apparatus, computer equipment and storage medium, wherein the method comprises: playing a target video; in response to a search operation for the target video, obtaining at least one target multimedia resource corresponding to each entity object, and key information of each entity object, wherein the key information at least includes information used to characterize the entity object; each entity object is a plurality of entity objects of the same entity type determined from the target video based on the search operation; and displaying the key information of each entity object and the corresponding target multimedia resource on a search result page.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of image recognition technology, and in particular to an information display method, device, computer equipment and storage medium. Background Art

[0002] Playing videos to users is a way to use videos to convey information to users. Under the guidance of the video, users can obtain key information. At the same time, users will also have the need to further search for related content introduced in the video. At this time, users can initiate a visual search for the video. After initiating a visual search, the search results obtained are often numerous and complex, and it is difficult for users to quickly find search results that meet their search intent. Summary of the invention

[0003] The embodiments of the present disclosure at least provide an information display method, apparatus, computer equipment and storage medium.

[0004] In a first aspect, an embodiment of the present disclosure provides an information display method, comprising: playing a target video; in response to a search operation for the target video, obtaining at least one target multimedia resource corresponding to each entity object, and key information of each entity object, wherein the key information includes at least information used to characterize the entity object; each entity object is a plurality of entity objects of the same entity type determined from the target video based on the search operation; and displaying the key information of each entity object and the corresponding target multimedia resource on a search results page.

[0005] In an optional embodiment, the entity object is determined in the following manner: at least one initial entity object in the target video is determined based on the trigger time and / or video frame corresponding to the search operation; and initial entity objects belonging to the same entity type are filtered out from the at least one initial entity object as entity objects for displaying the key information.

[0006] In an optional implementation, initial entity objects belonging to the same entity type are screened out from the at least one initial entity object to determine the entity object displaying the key information, including: based on at least one attribute dimension associated with the initial entity object under the entity type to which it belongs, other entity objects that have an association relationship with the initial entity object in each of the attribute dimensions are selected from multiple entity objects belonging to the same entity type as the initial entity object in the target video; and the initial entity object and the selected other entity objects are used as the entity objects.

[0007] In an optional implementation, the key information of each entity object and the corresponding target multimedia resource are displayed on the search results page, including: on the search results page, comparative information of multiple entity objects under each attribute dimension corresponding to the entity type to which they belong, and the target multimedia resource; the comparative information under each attribute dimension is used to indicate the feature information of the multiple entity objects under the attribute dimension, and the difference between the feature information corresponding to the multiple entity objects respectively.

[0008] In an optional embodiment, the display of comparative information of multiple entity objects under various attribute dimensions corresponding to the entity type to which they belong, as well as the target multimedia resources, includes: displaying labels of the various attribute dimensions in a first area of ​​the search results page, and in response to a selection operation on a label of any of the attribute dimensions, displaying comparative information of the multiple entity objects under the attribute dimension; and, in a second area of ​​the search results page, displaying each of the target multimedia resources.

[0009] In an optional implementation, the characteristic information of the entity object in each attribute dimension is determined in the following manner: based on the image information of the entity object in the target video, searching and acquiring text introduction information corresponding to the entity object; based on the description information of the entity object in the target multimedia resource corresponding to the entity object, and the acquired text introduction information of the entity object, determining the characteristic information of the entity object in each attribute dimension.

[0010] In an optional implementation, the key information of the entity object includes identification information of the entity object; displaying the key information of each entity object and the target multimedia resource on the search results page includes: displaying each target multimedia resource on the search results page, and displaying the identification information of the entity object corresponding to the target multimedia resource at the associated display position of each target multimedia resource.

[0011] In an optional implementation, the target multimedia resources corresponding to the entity object include target multimedia resources under multiple resource types; displaying the target multimedia resources on the search results page includes: displaying multiple resource types on the search results page, and displaying the target multimedia resources of each entity object under each resource type; or, displaying the resource collection of each entity object in turn on the search results page, the resource collection including the target multimedia resources of the entity object under multiple resource types.

[0012] In an optional implementation, the attribute dimension of the entity object includes at least one of the following: attribute dimensions of an entity type to which the entity object belongs, and attribute dimensions of a video frame in which the entity object appears in the target video.

[0013] In a second aspect, an embodiment of the present disclosure also provides an information display device, comprising: a playback module for playing a target video; an acquisition module for acquiring, in response to a search operation for the target video, at least one target multimedia resource corresponding to each entity object, and key information of each entity object, wherein the key information at least includes information used to characterize the entity object; each entity object is a plurality of entity objects of the same entity type determined from the target video based on the search operation; and a display module for displaying the key information of each entity object and the corresponding target multimedia resource on a search results page.

[0014] In an optional embodiment, the device also includes a processing module, which is specifically used to determine the entity object in the following manner: determining at least one initial entity object in the target video based on the trigger time and / or video frame corresponding to the search operation; and filtering out initial entity objects belonging to the same entity type from the at least one initial entity object as entity objects for displaying the key information.

[0015] In an optional embodiment, when the processing module filters out the initial entity objects belonging to the same entity type from the at least one initial entity object and determines the entity object that displays the key information, it is used to: select other entity objects that have an association relationship with the initial entity object in each attribute dimension from multiple entity objects belonging to the same entity type as the initial entity object in the target video based on at least one attribute dimension associated with the initial entity object under the entity type to which it belongs; and use the initial entity object and the selected other entity objects as the entity objects.

[0016] In an optional embodiment, when the display module displays the key information of each entity object and the corresponding target multimedia resource on the search results page, it is used to: display comparative information of multiple entity objects under each attribute dimension corresponding to the entity type to which they belong, and the target multimedia resource on the search results page; the comparative information under each attribute dimension is used to indicate the feature information of the multiple entity objects under the attribute dimension, and the difference between the feature information corresponding to the multiple entity objects respectively.

[0017] In an optional embodiment, when displaying comparative information of multiple entity objects under various attribute dimensions corresponding to the entity type to which they belong, as well as the target multimedia resources, the display module is used to: display labels of the various attribute dimensions in a first area of ​​the search results page, and in response to a selection operation on a label of any of the attribute dimensions, display comparative information of the multiple entity objects under the attribute dimension; and, in a second area of ​​the search results page, display each of the target multimedia resources.

[0018] In an optional implementation, the characteristic information of the entity object in each attribute dimension is determined in the following manner: based on the image information of the entity object in the target video, searching and acquiring text introduction information corresponding to the entity object; based on the description information of the entity object in the target multimedia resource corresponding to the entity object, and the acquired text introduction information of the entity object, determining the characteristic information of the entity object in each attribute dimension.

[0019] In an optional implementation, the key information of the entity object includes identification information of the entity object; when the display module displays the key information of each entity object and the target multimedia resource on the search results page, it is used to: display each target multimedia resource on the search results page, and display the identification information of the entity object corresponding to the target multimedia resource at the associated display position of each target multimedia resource.

[0020] In an optional implementation, the target multimedia resources corresponding to the entity object include target multimedia resources under multiple resource types; when the display module displays the target multimedia resources on the search results page, it is used to: display multiple resource types on the search results page, and display each of the target multimedia resources of each entity object under each resource type; or, display the resource collection of each entity object in turn on the search results page, and the resource collection includes the target multimedia resources of the entity object under multiple resource types.

[0021] In an optional implementation, the attribute dimension of the entity object includes at least one of the following: attribute dimensions of an entity type to which the entity object belongs, and attribute dimensions of a video frame in which the entity object appears in the target video.

[0022] In a third aspect, an optional implementation of the present disclosure further provides a computer device, a processor, and a memory, wherein the memory stores machine-readable instructions executable by the processor, and the processor is used to execute the machine-readable instructions stored in the memory, and when the machine-readable instructions are executed by the processor, the machine-readable instructions perform the steps of the above-mentioned first aspect, or any possible implementation of the first aspect.

[0023] In a fourth aspect, an optional implementation of the present disclosure further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed, the steps of the above-mentioned first aspect, or any possible implementation of the first aspect are executed.

[0024] The disclosed embodiments provide an information display method, apparatus, computer equipment, and storage medium. When playing a target video, multiple entity objects of the same entity type can be obtained from the target video in response to a search operation on the target video. For the identified entity objects, relevant target multimedia resources and key information of the entity objects themselves can be further obtained to be displayed in the search results page. In this way, when searching for related videos, key information of multiple entity objects of the same type involved in the video and related multimedia resources can be directly displayed in the search results. These multiple entity objects of the same type reflect the expression intent of the video. Directly displaying the key information of these multiple entity objects of the same type can facilitate users to quickly understand the video content and quickly find the entity objects of interest, so as to further consume the related multimedia content of the entity objects. In this way, entity objects that match the search intent can be quickly found, and key information about the entity objects and more resource content can be conveniently further consumed.

[0025] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following is a brief introduction to the drawings required for use in the embodiments. The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and are used together with the specification to illustrate the technical solutions of the present disclosure. It should be understood that the following drawings only illustrate certain embodiments of the present disclosure and should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can also be obtained based on these drawings without creative work.

[0027] Figure 1 A flow chart of an information display method provided by an embodiment of the present disclosure is shown;

[0028] Figure 2 A schematic diagram of a search result page provided by an embodiment of the present disclosure is shown;

[0029] Figure 3 A schematic diagram showing another search result page provided by an embodiment of the present disclosure is shown;

[0030] Figure 4 A schematic diagram of an information display device provided by an embodiment of the present disclosure is shown;

[0031] Figure 5 A schematic diagram of a computer device provided by an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0032] In order to make the purpose, technical scheme and advantages of the embodiments of the present disclosure clearer, the technical scheme in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. The components of the embodiments of the present disclosure generally described and shown here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present disclosure is not intended to limit the scope of the present disclosure claimed for protection, but merely represents the selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present disclosure.

[0033] Research has found that when users are watching a video, they may be very interested in the information in it. At this time, they can initiate a visual search for the video. However, the search results obtained after the search are often numerous and complex, and it is not easy for users to quickly find results that match their intentions. Therefore, how to enable users to quickly find information content that matches their intentions based on videos is worthy of further study.

[0034] Based on this, the disclosed embodiment provides an information display method. When playing a target video, multiple entity objects of the same entity type can be obtained from the target video in response to a search operation on the target video. For the identified entity objects, key information of the entity object itself and related target multimedia resources can be further obtained to display them in the search results page. Here, multiple entity objects of the same type reflect the expression intent of the video. Directly displaying the key information of these multiple entity objects of the same type can facilitate users to quickly understand the video content and quickly find the entity objects of interest, so as to further consume the related multimedia content of the entity object. In this way, the entity object that matches the search intent can be quickly found, and the key information about the entity object and more resource content can be conveniently further consumed.

[0035] The defects existing in the above solutions are the results obtained by the inventor after practice and careful research. Therefore, the discovery process of the above problems and the solutions proposed by the present disclosure for the above problems below should be the contributions made by the inventor to the present disclosure during the disclosure process.

[0036] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.

[0037] To facilitate understanding of this embodiment, a method for displaying information disclosed in the embodiment of the present disclosure is first introduced in detail. The execution subject of the method for displaying information provided in the embodiment of the present disclosure is generally a computer device with certain computing capabilities, and the computer device includes, for example: a terminal device or a server or other processing device, and the terminal device can be a user equipment (User Equipment, UE), a mobile device, a user terminal, a terminal, a cellular phone, a cordless phone, a personal digital assistant (Personal Digital Assistant, PDA), a handheld device, a computing device, a vehicle-mounted device, a wearable device, etc. In some possible implementations, the method for displaying information can be implemented by a processor calling a computer-readable instruction stored in a memory.

[0038] The information display method provided by the embodiment of the present disclosure is described below. The information display method provided by the embodiment of the present disclosure is used in the scene of video playback, and is mainly used to supplement the information related to the entity object of the same entity type in the video. Therefore, the information display method provided by the embodiment of the present disclosure can be applied to video playback platforms such as short video platforms and interactive video platforms, and is also applicable to shopping platforms that play product information of multiple products, or product evaluation platforms that play evaluation videos of multiple products, which are not listed one by one here. Using the information display method provided by the embodiment of the present disclosure, after the user performs a relevant search on the video, the key information and related multimedia resources of multiple entity objects of the same type can be obtained, and the entity object of interest can be easily and quickly found, so as to further consume the related multimedia content of the entity object, so that the entity object that matches the search intention can be quickly found, and the key information and more resource content related to the entity object can be conveniently further consumed; in addition, the embodiment of the present disclosure can also continue to realize the viewing and purchase of entity objects, which is simpler and more convenient in operation, so it is also easier to meet the user's scalability requirements for videos.

[0039] See also Figure 1 FIG. 1 is a flowchart of an information display method provided by an embodiment of the present disclosure, wherein the method includes steps S101 to S103, wherein:

[0040] S101: Play the target video;

[0041] S102: In response to a search operation for the target video, obtaining at least one target multimedia resource corresponding to each entity object and key information of each entity object, wherein the key information at least includes information used to characterize the entity object; each entity object is a plurality of entity objects of the same entity type determined from the target video based on the search operation;

[0042] S103: Displaying key information of each entity object and the corresponding target multimedia resource on the search result page.

[0043] The above S101 to S103 are described in detail below.

[0044] With respect to the above S101, for the target video to be played, the specific videos played on different application platforms are different. For example, the target video may include an evaluation video, such as an evaluation video of multiple mobile phones, or an evaluation video of multiple sweeping robots. The target video may also be a live video, or a video captured from a live video, such as a live video of selling multiple dresses.

[0045] With respect to the above S102, for the target video being played, since the target video may include a large number of objects, in order to confirm the object that the user is interested in, a plurality of entity objects of the same entity type can be determined from the target video in response to a search operation for the target video, and the determined entity objects can be used to determine at least one corresponding target multimedia resource, as well as key information of each entity object.

[0046] Exemplarily, the target video may be a video of computer accessories evaluation, and includes multiple video segments, such as the evaluation of the computer screen in the first half of the video segment, and the evaluation of the keyboard and mouse set in the second half of the video segment. In such a video, the entity objects recommended by the video include multiple computer screens and multiple keyboard and mouse sets. In a possible case, if the relevant information of all entity objects is displayed, the occupied area may be large, which will cause occlusion to the target video originally played. In addition, the user does not have the need to view the relevant information of all entity objects. Therefore, it can be inferred based on the search operation which entity objects the user has a viewing need for in the target video, and then the extended information of these entity objects is displayed. For example, if the user is searching in the playback of the second half of the video segment of the video, then the extended display demand for the above two computer accessories should be the extended display demand corresponding to the entity object of the keyboard and mouse set, rather than the extended display demand for the computer screen. In this case, only the target multimedia resources and key information corresponding to the keyboard and mouse set can be displayed or displayed preferentially during the display.

[0047] In addition, when determining the entity object from the target video, it will be specifically carried out through the technical means of entity recognition, such as object recognition of the video frame image to determine the entity object contained therein. In the target video, there may be more than one object in one frame or multiple consecutive frames of video frame images. For example, in the above-mentioned target video including computer screen evaluation, in order to display the computer screen, the computer screen will be placed on the same computer desk for comparison and display one by one, then there will be multiple frames of video frame images in the target video including this computer desk. In fact, the focus of guiding users to watch in the target video is on multiple different computer screens. Therefore, after the computer desk is identified by entity recognition, it should not be selected as the entity object for displaying extended information.

[0048] Therefore, in the disclosed embodiment, when determining the entity object, the object of the same entity type determined in the target video is used as the entity object. The same type can be reflected as different models of products under the same brand, such as three different series of cars under the XX brand car; or it can be reflected as multiple products of the same entity type, such as four women's clothing of different styles but all belonging to the Chanel style top type.

[0049] According to the above two aspects of the description of determining entity objects in the target video, in the embodiment of the present disclosure, the entity objects can be determined specifically in the following manner: according to the trigger time and / or video frame corresponding to the search operation, at least one initial entity object in the target video is determined; and initial entity objects belonging to the same entity type are filtered out from the at least one initial entity object as entity objects for displaying the key information.

[0050] Here, the user's search operation may be a triggering operation of a search button displayed on the page playing the target video, such as a button displayed at the bottom of the video or other locations to instruct to search for products displayed in the target video. This search operation may also not rely on a specific search button, such as being triggered by gestures such as double-clicking the screen, swiping the screen to the left, etc., which is not limited here.

[0051] Under the search operation, the trigger time and / or video frame corresponding to the search operation can be determined, and based on this, at least one initial entity object can be determined from the target video. Taking the above target video including a computer accessories evaluation video as an example, assuming that the evaluation video is 8 minutes, each minute of the first 4 minutes introduces a computer screen, and each minute of the last 4 minutes introduces a keyboard and mouse set.

[0052] First, let's take the trigger time as an example. If the trigger time is determined to be 5 minutes and 10 seconds based on the search operation, that is, the second keyboard and mouse set introduced, and it is used as the initial entity object, it can be actually determined that the user is specifically interested in products related to the keyboard and mouse set. And through entity recognition, 4 screens and 4 keyboard and mouse sets can be determined from the target video one after another. Taking the keyboard and mouse set determined at the trigger time as the entity type benchmark for determining the entity object, the entity objects that are not of this entity type can be deleted from the previously obtained entities, that is, the 4 screens recommended in the first 4 minutes, and the remaining first keyboard and mouse set, as well as the two keyboard and mouse sets introduced in the subsequent videos, and the second keyboard and mouse set determined at the trigger time, are used as entity objects of the same entity type obtained from the target video.

[0053] Secondly, the video frame corresponding to the search operation is used as an example to illustrate. If the video frame is determined when the trigger is triggered, it is a video frame with a timestamp of 5 minutes and 10 seconds. According to the video frame, the entity objects that can be obtained from it include a keyboard and mouse set and a computer desk, and the two are respectively used as initial entity objects. Based on the entity types corresponding to the two, it can be determined whether the target video also includes other different entity objects of the same entity type. For example, for the entity type of the keyboard and mouse set, three other keyboard and mouse set products can be found, while for the entity type of the computer desk, each video frame includes the same computer desk, so other computer desk products cannot be found. This is also because the target video focuses on different keyboard and mouse sets, not multiple computer desks. Therefore, multiple different keyboard and mouse sets can be used as entity objects of the same entity type obtained from the target video, and the result obtained by the above method is the same.

[0054] In this way, entity objects of the same entity type can be determined from the target video by searching for the initial entity object indicated by the operation.

[0055] Furthermore, in screening out the initial entity objects belonging to the same entity type from the initial entity objects and determining the entity object that displays the key information, the following method can also be adopted: based on at least one attribute dimension associated with the initial entity object under the entity type to which it belongs, other entity objects that have an association relationship with the initial entity object in each of the attribute dimensions are selected from multiple entity objects in the target video that belong to the same entity type as the initial entity object; and the initial entity object and the selected other entity objects are used as the entity objects.

[0056] Here, at least one attribute dimension associated with the entity type may specifically include model, brand, price, etc. Exemplarily, after selecting the initial entity object from the target video, the entity type to which it belongs can be determined, and an attribute dimension associated with the entity type can be determined, such as the price described above. On this basis, when multiple entity objects of the same type as the initial entity object are determined from the target video, the screening condition for the entity object under the entity type is that the price is the same, or belongs to the same price range. Using such a screening condition, multiple entity objects that can be identified in the target video can be screened, so that the screened entity objects and the initial entity objects are both used as entity objects for expanding the display information.

[0057] For example, if the initial entity object is determined to be a brand A Chanel-style summer top with a price of 100 yuan, and the brand A Chanel-style long skirt, brand B Chanel-style top with a price of 100 yuan, and brand C Chanel-style summer top with a price of 1,000 yuan are identified in the target video, then under the corresponding entity type of the Chanel-style top, if the determined attribute dimension is price, the brand B Chanel-style top with a price of 100 yuan can be used as the other entity object that has an association relationship with the initial entity object in the price attribute dimension; if the determined attribute dimension is brand, the brand A Chanel-style long skirt is used as the other entity object that has an association relationship with the initial entity object in the price attribute dimension; and if the determined attribute dimension is summer clothing, the brand C Chanel-style summer top with a price of 1,000 yuan is used as the other entity object that has an association relationship with the initial entity object in the price attribute dimension.

[0058] That is, when the determined attribute dimensions are different, the other entity objects that can be determined are different. In actual operation, there can be multiple attribute dimensions that can be selected, so other entity objects selected under different attribute dimensions can be used together with the initial entity object as entity objects to be expanded and displayed.

[0059] In this way, each entity object can be determined through the above method.

[0060] For each determined entity object, at least one target multimedia resource corresponding to each entity object and key information of each entity object can be obtained. Here, the target multimedia resources corresponding to the entity object include target multimedia resources under multiple resource types. Multiple resource types may specifically include evaluation videos, live videos, or product push videos containing links that can be clicked to purchase products, etc. The key information of the entity object at least includes information used to characterize the entity object, such as the name and picture of the entity object. In addition, the attribute dimensions described above can also be displayed as key information of the entity object, such as price and brand.

[0061] With respect to the above S103, when multiple entity objects of the same entity type are determined from the target video, and key information of the entity objects and the target multimedia resources are determined, the information can be displayed on the search result page.

[0062] In one possible case, the search result page may be a playback page for playing the target video, or a page displayed in a floating window or a bottom pop-up window on the playback page, or may be another display page that can be jumped to from the playback.

[0063] In a specific implementation, the key information of each entity object and the corresponding target multimedia resources are displayed on the search results page. Specifically, the following method can be used: on the search results page, the comparative information of multiple entity objects under each attribute dimension corresponding to the entity type to which they belong, and the target multimedia resources are displayed; the comparative information under each attribute dimension is used to indicate the feature information of the multiple entity objects under the attribute dimension, and the difference between the feature information corresponding to the multiple entity objects.

[0064] Here, the attribute dimension of the entity object includes at least one of the following: each attribute dimension of the entity type to which the entity object belongs, and the attribute dimension of the video frame in which the entity object appears in the target video. Among them, the attribute dimensions of the entity type to which the entity object belongs can be specifically referred to the above description, and will not be repeated here. For the attribute dimension of the video frame in which the entity object appears in the target video, it can specifically include the order in which multiple entity objects appear in the target video, or the time they occupy, etc. In one case, if the entity object appears more forward or occupies a longer time in the target video, it can be said that the entity object is a more recommended entity object. When determining the comparison information of multiple entity objects, it can be arranged in the front position for display. The time when different entity objects appear in the target video can also be used as the comparison information between entity objects. In order to show the comparison information of multiple entity objects under the same attribute dimension, it can be presented in a table or other manner when displaying, and the specific details can be seen in the attached figure in the following example.

[0065] As for the characteristic information of the entity object in each attribute dimension, it can be determined specifically according to the following methods: based on the image information of the entity object in the target video, searching and acquiring the text introduction information corresponding to the entity object; based on the description information of the entity object in the target multimedia resource corresponding to the entity object and the acquired text introduction information of the entity object, determining the characteristic information of the entity object in each attribute dimension.

[0066] Since the user determines that he is interested in the entity object in the target video by watching the target video, that is, the information contained in the target video itself prompts the user to search and explore the entity object, which means that the information in the target video is valuable to the user. Therefore, for the entity object determined in the target video, the text description information corresponding to the entity object can be searched and obtained based on the image information of the entity object in the target video, such as the image information of the video frame image containing the entity object.

[0067] Here, in one possible case, the explanatory text for explaining the entity object can be obtained from at least one frame of video frame image by text recognition as text introduction information. In another case, the text containing relevant information about the entity object introduction from other multimedia information can be obtained by image comparison, keyword search, etc. through image information as text introduction information corresponding to the entity object.

[0068] When determining the characteristic information of the entity object under each attribute dimension, the description information for the entity object in the target multimedia resource can be used, such as the host's explanation of the entity object in the live sales video, and the text introduction information obtained in the above method, to determine the characteristic information of the entity object under each attribute dimension. Here, the description information obtained from the target multimedia resource and the text introduction information described above are both channels for determining the characteristic information. You can select one of them to obtain the characteristic information, or you can obtain the characteristic information by complementing each other, and there is no specific limitation.

[0069] In a specific implementation, the determined comparison information and target multimedia resources can be displayed on the search results page in the following manner: in the first area of ​​the search results page, the labels of the various attribute dimensions are displayed, and in response to a selection operation on a label of any of the attribute dimensions, the comparison information of the multiple entity objects under the attribute dimension is displayed; and, in the second area of ​​the search results page, each of the target multimedia resources is displayed.

[0070] For example, see Figure 2 As shown, it is a schematic diagram of a search result page provided by an embodiment of the present disclosure. In the search result page, the entity object includes a display, and specifically includes a first area and a second area in the search result page for displaying extended information. The first area is used to display labels for each attribute dimension, such as listing the model, brand, and price in the figure. For the displayed attribute dimension, in response to the user's selection operation, the comparative information of multiple entity objects under the attribute dimension can be further displayed. When the user selects the label of the attribute dimension, the user can select one or more, and the comparative information can also be displayed in the form of a table. For example, in Figure 2In the search result page shown, labels of two attribute dimensions, brand and price, are specifically selected for display.

[0071] In the second area, which is specifically used to display the target multimedia resources, the display order of the target multimedia resources of each entity object may be the same as the order in which each entity object appears in the target video.

[0072] In a possible case, in order to distinguish the entity object associated with the target multimedia resource, textual guidance information corresponding to the entity object or an icon containing an image of the entity object can be displayed at the associated position of the target multimedia resource. Here, the textual guidance information and the icon can be used as identification information of the entity object and as key information of the entity object.

[0073] In this case, see Figure 3 FIG. 1 is a schematic diagram of another search result page provided by an embodiment of the present disclosure. In the playback page of the target video, the search result display page is displayed in the form of a bottom pop-up window, and the search result page is displayed with the same Figure 2 Similar multiple target multimedia resources, each target multimedia resource has an associated display location, such as Figure 3 At the upper left corner shown in the figure, identification information in the form of an icon is displayed. Here, the image of the entity object in the icon can be specifically obtained by identifying from the target video. For example, at the upper left corner of the target multimedia resource of "A-brand monitor evaluation", the commodity images corresponding to the entity objects "monitor I" and "monitor II" involved are displayed, so that users can more easily identify what product the entity object corresponding to each target multimedia resource specifically indicates.

[0074] When displaying the target multimedia resources on the search results page, since there are multiple resource types of the target multimedia resources and the associated entity objects are also different, when displaying, they can be classified and displayed according to the resource type, or they can be classified and displayed according to the associated entity objects.

[0075] In a specific implementation, the target multimedia resources can be displayed in the search results page in the following manner: display multiple resource types on the search results page, and display the target multimedia resources of each entity object under each resource type under the resource type; or, display the resource collection of each entity object in turn on the search results page, and the resource collection includes the target multimedia resources of the entity object under multiple resource types.

[0076] First, take the classification display by resource type as an example. The target multimedia resources that can be displayed can specifically include videos, web pages, and other types of resources. In order to distinguish and arrange these different types of resources, the target multimedia resources can be arranged and displayed according to different types. In this way, users can select the multimedia resources they need to view from the aggregated display results according to their own needs. For example, for clothing products, users pay more attention to the wearing effect of the clothing, so they can view the displayed videos; and for electronic products, users pay more attention to performance and components, so they can view the web pages to get the parameter information of the electronic products at a glance, so as to make better decisions such as purchases.

[0077] Secondly, the classification display through entity objects is used as an example for explanation. For the entity objects determined in the above steps, that is, the entity objects that the user is interested in, in fact, by watching the target video, the user may have already focused on some of the entity objects. In this case, if some of the target multimedia resources associated with each entity object are first aggregated from multiple target multimedia resources to obtain the target multimedia resources of each entity object, the user can view the target multimedia resources in a targeted manner according to the entity objects he prefers during the display. Here, for the target multimedia resources under each entity object, they can also be classified by different resource types in the above manner to further assist the user in selecting and viewing.

[0078] In this way, different display modes can help users select and view target multimedia resources. Here, a switch button can also be set to allow users to select which display mode to use to receive target multimedia resources, which will not be described in detail.

[0079] Those skilled in the art will appreciate that, in the above method of specific implementation, the order in which the steps are written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of the steps should be determined by their functions and possible internal logic.

[0080] Based on the same inventive concept, an information display device corresponding to the information display method is also provided in the embodiment of the present disclosure. Since the principle of solving the problem by the device in the embodiment of the present disclosure is similar to the above-mentioned information display method in the embodiment of the present disclosure, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0081] Reference Figure 4 FIG. 4 is a schematic diagram of an information display device provided by an embodiment of the present disclosure, wherein the device comprises: a playback module 41, an acquisition module 42, and a display module 43; wherein:

[0082] A playback module 41, used for playing a target video;

[0083] The acquisition module 42 is used to acquire at least one target multimedia resource corresponding to each entity object and key information of each entity object in response to the search operation for the target video, wherein the key information at least includes information used to characterize the entity object; each entity object is a plurality of entity objects of the same entity type determined from the target video based on the search operation;

[0084] The display module 43 is used to display the key information of each entity object and the corresponding target multimedia resource on the search result page.

[0085] In an optional embodiment, the device also includes a processing module 44, which is specifically used to determine the entity object in the following manner: determine at least one initial entity object in the target video based on the trigger time and / or video frame corresponding to the search operation; and filter out initial entity objects belonging to the same entity type from the at least one initial entity object as entity objects for displaying the key information.

[0086] In an optional embodiment, when the processing module 44 filters out the initial entity objects belonging to the same entity type from the at least one initial entity object and determines the entity object that displays the key information, it is used to: select other entity objects that have an association relationship with the initial entity object in each attribute dimension from multiple entity objects belonging to the same entity type as the initial entity object in the target video based on at least one attribute dimension associated with the initial entity object under the entity type to which it belongs; and use the initial entity object and the selected other entity objects as the entity objects.

[0087] In an optional implementation, when the display module 43 displays the key information of each entity object and the corresponding target multimedia resource on the search results page, it is used to: display comparative information of multiple entity objects under each attribute dimension corresponding to the entity type to which they belong, and the target multimedia resource on the search results page; the comparative information under each attribute dimension is used to indicate the feature information of the multiple entity objects under the attribute dimension, and the difference between the feature information corresponding to the multiple entity objects respectively.

[0088] In an optional embodiment, when displaying comparative information of multiple entity objects under various attribute dimensions corresponding to the entity type to which they belong, as well as the target multimedia resources, the display module 43 is used to: display labels of the various attribute dimensions in the first area of ​​the search results page, and in response to a selection operation on a label of any of the attribute dimensions, display comparative information of the multiple entity objects under the attribute dimension; and, in the second area of ​​the search results page, display each of the target multimedia resources.

[0089] In an optional implementation, the characteristic information of the entity object in each attribute dimension is determined in the following manner: based on the image information of the entity object in the target video, searching and acquiring text introduction information corresponding to the entity object; based on the description information of the entity object in the target multimedia resource corresponding to the entity object, and the acquired text introduction information of the entity object, determining the characteristic information of the entity object in each attribute dimension.

[0090] In an optional implementation, the key information of the entity object includes identification information of the entity object; when the display module 43 displays the key information of each entity object and the target multimedia resource on the search results page, it is used to: display each target multimedia resource on the search results page, and display the identification information of the entity object corresponding to the target multimedia resource at the associated display position of each target multimedia resource.

[0091] In an optional implementation, the target multimedia resources corresponding to the entity object include target multimedia resources under multiple resource types; when the display module 43 displays the target multimedia resources on the search results page, it is used to: display multiple resource types on the search results page, and display each of the target multimedia resources of each entity object under each resource type; or, display the resource collection of each entity object in turn on the search results page, and the resource collection includes the target multimedia resources of the entity object under multiple resource types.

[0092] In an optional implementation, the attribute dimension of the entity object includes at least one of the following: attribute dimensions of an entity type to which the entity object belongs, and attribute dimensions of a video frame in which the entity object appears in the target video.

[0093] For descriptions of the processing flow of each module in the device and the interaction flow between each module, reference may be made to the relevant descriptions in the above method embodiment, which will not be described in detail here.

[0094] The present disclosure also provides a computer device, such as Figure 5FIG. 1 is a schematic diagram of a computer device structure provided in an embodiment of the present disclosure, including:

[0095] A processor 10 and a memory 20; the memory 20 stores machine-readable instructions executable by the processor 10, and the processor 10 is used to execute the machine-readable instructions stored in the memory 20. When the machine-readable instructions are executed by the processor 10, the processor 10 performs the following steps:

[0096] Play a target video; in response to a search operation for the target video, obtain at least one target multimedia resource corresponding to each entity object, and key information of each entity object, wherein the key information at least includes information used to characterize the entity object; each entity object is a plurality of entity objects of the same entity type determined from the target video based on the search operation; and display the key information of each entity object and the corresponding target multimedia resource on a search results page.

[0097] The above-mentioned memory 20 includes an internal memory 210 and an external memory 220; the internal memory 210 here is also called an internal memory, which is used to temporarily store the calculation data in the processor 10, as well as the data exchanged with the external memory 220 such as a hard disk. The processor 10 exchanges data with the external memory 220 through the internal memory 210.

[0098] The specific execution process of the above instructions can refer to the steps of the information display method described in the embodiment of the present disclosure, which will not be repeated here.

[0099] The present disclosure also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the information display method described in the above method embodiment are executed. The storage medium can be a volatile or non-volatile computer-readable storage medium.

[0100] The present disclosure also provides a computer program product that carries a program code. The program code includes instructions that can be used to execute the steps of the information display method described in the above method embodiment. For details, please refer to the above method embodiment, which will not be repeated here.

[0101] The computer program product may be implemented in hardware, software or a combination thereof. In one optional embodiment, the computer program product is implemented as a computer storage medium. In another optional embodiment, the computer program product is implemented as a software product, such as a software development kit (SDK).

[0102] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, the specific working process of the system and device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, device and method can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the device or unit can be electrical, mechanical or other forms.

[0103] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0104] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0105] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0106] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present disclosure, which are used to illustrate the technical solutions of the present disclosure, rather than to limit them. The protection scope of the present disclosure is not limited thereto. Although the present disclosure is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed in the present disclosure, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims

1. An information display method, characterized in that: include: Play the target video; In response to a search operation for the target video, acquiring at least one target multimedia resource corresponding to each entity object and key information of each entity object, wherein the key information at least includes information for characterizing the entity object; Display the key information of each entity object and the corresponding target multimedia resource on the search result page. The entity objects are multiple entity objects of the same entity type determined from the target video based on the search operation and at least one attribute dimension associated with the entity type to which the entity objects belong.

2. The method according to claim 1, characterized in that: The entity object is determined in the following manner: Determine at least one initial entity object in the target video according to a trigger time and / or video frame corresponding to the search operation; Initial entity objects belonging to the same entity type are screened out from the at least one initial entity object as entity objects for displaying the key information.

3. The method according to claim 2, characterized in that Filtering out initial entity objects belonging to the same entity type from the at least one initial entity object and determining an entity object displaying the key information includes: According to at least one attribute dimension associated with the initial entity object under the entity type to which it belongs, selecting other entity objects that have an association relationship with the initial entity object in each attribute dimension from multiple entity objects of the same entity type as the initial entity object in the target video; The initial entity object and the selected other entity objects are used as the entity objects.

4. The method according to claim 1, characterized in that The displaying of the key information of each entity object and the corresponding target multimedia resource on the search result page includes: On the search results page, comparative information of multiple entity objects under each attribute dimension corresponding to the entity type to which they belong, as well as the target multimedia resource, are displayed; the comparative information under each attribute dimension is used to indicate feature information of the multiple entity objects under the attribute dimension, and the difference between the feature information corresponding to the multiple entity objects respectively.

5. The method according to claim 4, characterized in that The display of comparison information of multiple entity objects in various attribute dimensions corresponding to the entity types to which they belong, and the target multimedia resource, includes: In the first area of ​​the search results page, labels of the various attribute dimensions are displayed, and in response to a selection operation on a label of any of the attribute dimensions, comparative information of the multiple entity objects under the attribute dimension is displayed; and in the second area of ​​the search results page, each of the target multimedia resources is displayed.

6. The method according to claim 4 or 5, characterized in that: The characteristic information of the entity object in each attribute dimension is determined according to the following method: Based on the image information of the entity object in the target video, searching and acquiring text introduction information corresponding to the entity object; Based on the description information of the entity object in the target multimedia resource corresponding to the entity object and the acquired text introduction information of the entity object, feature information of the entity object in each attribute dimension is determined.

7. The method according to claim 1, characterized in that The key information of the entity object includes identification information of the entity object; the displaying the key information of each entity object and the target multimedia resource on the search result page includes: The target multimedia resources are displayed on the search result page, and identification information of the entity object corresponding to each target multimedia resource is displayed at the associated display position of each target multimedia resource.

8. The method according to claim 1, characterized in that The target multimedia resources corresponding to the entity object include target multimedia resources under multiple resource types; The displaying of the target multimedia resource on the search result page includes: Displaying multiple resource types on the search result page, and displaying under each resource type the target multimedia resources of each entity object under the resource type; or, The resource collections of the entity objects are sequentially displayed on the search result page, and the resource collections include the target multimedia resources of the entity objects under multiple resource types.

9. The method according to claim 4 or 5, characterized in that: The attribute dimensions of the entity object include at least one of the following: The attribute dimensions of the entity type to which the entity object belongs, and the attribute dimensions of the video frame in which the entity object appears in the target video.

10. An information display device, characterized in that: include: A playback module, used to play the target video; an acquisition module, configured to acquire, in response to a search operation for the target video, at least one target multimedia resource corresponding to each entity object and key information of each entity object, wherein the key information at least includes information for characterizing the entity object; A display module is used to display the key information of each entity object and the corresponding target multimedia resource on the search result page. The entity objects are multiple entity objects of the same entity type determined from the target video based on the search operation and at least one attribute dimension associated with the entity type to which the entity objects belong.

11. A computer device, characterized in that: include: A processor and a memory, wherein the memory stores machine-readable instructions executable by the processor, and the processor is used to execute the machine-readable instructions stored in the memory. When the machine-readable instructions are executed by the processor, the processor executes the steps of the information display method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program. When the computer program is executed by a computer device, the computer device executes the steps of the information display method according to any one of claims 1 to 9.

Citation Information

Patent Citations

  • Video-based article search method and device, equipment and storage medium

    CN113761360A