Information pushing method, information display method and device

By identifying related objects in multimedia information and generating display information, the problem of users being unable to quickly obtain object information in multimedia information is solved, and efficient information push and improved interactivity are achieved.

CN114461823BActive Publication Date: 2025-10-10BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111590787.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-23
Publication Date
2025-10-10
Estimated Expiration
2041-12-23

AI Technical Summary

Technical Problem

In the prior art, users cannot quickly obtain relevant information about objects in multimedia information.

Method used

By performing object recognition on multimedia information, display information and manipulation information of related objects are generated and pushed together with the multimedia information. Users can trigger the display of detailed information of related objects through manipulation information.

Benefits of technology

The convenience and efficiency of obtaining related object information are improved, the user experience is enhanced, and the workload of multimedia information creators is reduced.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114461823B_ABST
    Figure CN114461823B_ABST
Patent Text Reader

Abstract

The present disclosure relates to an information pushing method, an information display method and device. The information pushing method comprises: in response to a multimedia information display request sent by a target terminal, determining candidate multimedia information; generating object display information corresponding to the candidate multimedia information based on an associated object corresponding to the candidate multimedia information; the associated object is obtained based on object recognition on the candidate multimedia information; the object display information carries object access address information; generating display control information corresponding to the object display information; pushing the candidate multimedia information, the object display information and the display control information to the target terminal. The present disclosure can quickly obtain object information of an associated object, and improve the convenience and efficiency of obtaining object information of an associated object.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of information processing technology, and in particular to an information push method, an information display method, and a device. Background Art

[0002] With the development of multimedia information technology, users have access to vast amounts of multimedia information, which also contains rich content information. Related technologies generally push multimedia information to user terminals, allowing them to display the pushed multimedia information. However, when a user is interested in an object mentioned in the multimedia information, it is difficult to quickly obtain object information related to that object. Summary of the Invention

[0003] The present disclosure provides an information push method, an information display method, and an apparatus to at least solve the problem in related technologies of being unable to quickly obtain object information of objects in multimedia information. The technical solutions of the present disclosure are as follows:

[0004] According to a first aspect of an embodiment of the present disclosure, there is provided an information push method, comprising:

[0005] determining candidate multimedia information in response to a multimedia information display request sent by a target terminal;

[0006] generating object display information corresponding to the candidate multimedia information based on the associated object corresponding to the candidate multimedia information; the associated object is obtained based on object recognition of the candidate multimedia information; the object display information carries object access address information;

[0007] generating display manipulation information corresponding to the object display information;

[0008] Pushing the candidate multimedia information, the object display information, and the display control information to the target terminal.

[0009] In an exemplary embodiment, the multimedia information presentation request includes user identification information of the requesting user;

[0010] The generating, based on the associated object corresponding to the candidate multimedia information, object display information corresponding to the candidate multimedia information includes:

[0011] Obtaining object information of an object to be pushed; the object to be pushed is an object in the associated object that matches the user identification information;

[0012] The object display information is generated based on the object information of the object to be pushed.

[0013] In an exemplary embodiment, the step of obtaining object information of the object to be pushed further includes:

[0014] Sending an information push query request to the object information server; the information push query request includes the user identification information and the object identification information of the associated object; the information push query request is used to instruct the object information server to determine the object to be pushed from the associated objects based on the user identification information and the object identification information of the associated object;

[0015] Receive the result of determining the object to be pushed returned by the object information server.

[0016] In an exemplary embodiment, the generating of object display information corresponding to the candidate multimedia information based on the associated object corresponding to the candidate multimedia information includes:

[0017] Loading a display information generation template; the display information generation template includes an object image identification field and an object attribute identification field;

[0018] Acquire the object image identifier of the associated object and the object attribute identifier of the associated object;

[0019] The object image identifier of the associated object is filled into the object image identifier field, and the object attribute identifier of the associated object is filled into the object attribute identifier field to generate the object display information.

[0020] In an exemplary embodiment, the method further comprises:

[0021] Performing object recognition on the candidate multimedia information to obtain object feature information of the recognized object;

[0022] Matching the object feature information of the identified object with the object feature information of multiple objects to be matched in a preset object library to obtain an object matching result;

[0023] Based on the object matching result, the associated object is determined from the multiple objects to be matched.

[0024] In an exemplary embodiment, performing object recognition on the candidate multimedia information to obtain object feature information of the recognized object includes:

[0025] Performing speech recognition on the candidate multimedia information to obtain first text information;

[0026] Performing text recognition on the candidate multimedia information to obtain second text information;

[0027] perform image recognition on the candidate multimedia information to obtain object image information of the recognition object;

[0028] obtain object feature information of the recognition object based on the first text information, the second text information, and the object image information of the recognition object.

[0029] According to a second aspect of the embodiments of the present disclosure, an information display method is provided, including:

[0030] in response to a multimedia information display operation, display candidate multimedia information and display operation information;

[0031] in response to a triggering operation on the display operation information, display object display information corresponding to the candidate multimedia information; the object display information is obtained based on an associated object corresponding to the candidate multimedia information, the associated object is obtained based on object recognition on the candidate multimedia information; the object display information carries access address information of a to-be-pushed object.

[0032] In an example embodiment, the method further includes:

[0033] in response to a selection operation on the object display information, generate an object access request; the object access request includes the access address information of the to-be-pushed object;

[0034] send the object access request to a multimedia information server;

[0035] receive object detail information corresponding to the access address information returned by the multimedia information server based on the object access request;

[0036] display the object detail information.

[0037] In an example embodiment, in response to a multimedia information display operation, display candidate multimedia information and display operation information, including:

[0038] in response to the multimedia information display operation, display the candidate multimedia information;

[0039] display the display operation information in a target state on a display interface of the candidate multimedia information.

[0040] In an example embodiment, the method further includes:

[0041] in response to a display operation on the display operation information, display description information of the display operation information on a display interface of the candidate multimedia information.

[0042] According to a third aspect of an embodiment of the present disclosure, there is provided an information push device, including:

[0043] a candidate multimedia information determining unit configured to determine candidate multimedia information in response to a multimedia information display request sent by a target terminal;

[0044] an object display information generating unit configured to generate object display information corresponding to the candidate multimedia information based on an associated object corresponding to the candidate multimedia information; the associated object is obtained based on object recognition of the candidate multimedia information; the object display information carries object access address information;

[0045] a display manipulation information generating unit, configured to generate display manipulation information corresponding to the object display information;

[0046] The information pushing unit is configured to push the candidate multimedia information, the object display information and the display control information to the target terminal.

[0047] In an exemplary embodiment, the multimedia information presentation request includes user identification information of the requesting user;

[0048] The object display information generating unit includes:

[0049] An object information acquisition unit is configured to acquire object information of an object to be pushed; the object to be pushed is an object in the associated object that matches the user identification information;

[0050] The first generating unit is configured to generate the object display information based on the object information of the object to be pushed.

[0051] In an exemplary embodiment, the apparatus further comprises:

[0052] an information push query request sending unit configured to send an information push query request to an object information server; the information push query request includes the user identification information and the object identification information of the associated object; the information push query request is used to instruct the object information server to determine the object to be pushed from the associated objects based on the user identification information and the object identification information of the associated object;

[0053] The object determination result receiving unit is configured to receive the to-be-pushed object determination result returned by the object information server.

[0054] In an exemplary embodiment, the object display information generating unit includes:

[0055] A template loading unit configured to load a display information generation template; the display information generation template includes an object image identification field and an object attribute identification field;

[0056] an identification information acquiring unit, configured to acquire an object image identification of the associated object and an object attribute identification of the associated object;

[0057] The information filling unit is configured to fill the object image identifier of the associated object into the object image identifier field and fill the object attribute identifier of the associated object into the object attribute identifier field to generate the object display information.

[0058] In an exemplary embodiment, the apparatus further comprises:

[0059] an object recognition unit configured to perform object recognition on the candidate multimedia information to obtain object feature information of the recognized object;

[0060] an object matching unit configured to match the object feature information of the identified object with the object feature information of a plurality of objects to be matched in a preset object library to obtain an object matching result;

[0061] The associated object determining unit is configured to determine the associated object from the multiple objects to be matched based on the object matching result.

[0062] In an exemplary embodiment, the object recognition unit includes:

[0063] a speech recognition unit configured to perform speech recognition on the candidate multimedia information to obtain first text information;

[0064] a text recognition unit configured to perform text recognition on the candidate multimedia information to obtain second text information;

[0065] an image recognition unit configured to perform image recognition on the candidate multimedia information to obtain object image information of the recognition object;

[0066] The object feature information determining unit is configured to obtain the object feature information of the identified object based on the first text information, the second text information, and the object image information of the identified object.

[0067] According to a fourth aspect of an embodiment of the present disclosure, there is provided an information display device, comprising:

[0068] A first display unit is configured to display candidate multimedia information and manipulation information in response to a multimedia information display operation;

[0069] The second display unit is configured to execute a triggering operation on the display control information to display object display information corresponding to the candidate multimedia information; the object display information is obtained based on the associated object corresponding to the candidate multimedia information, and the associated object is obtained based on object identification of the candidate multimedia information; the object display information carries access address information of the object to be pushed.

[0070] In an exemplary embodiment, the apparatus further comprises:

[0071] The object access request generating unit is configured as an execution unit, configured to generate an object access request in response to a selection operation on the object display information; the object access request includes access address information of the object to be pushed;

[0072] an object access request sending unit, configured to execute sending the object access request to the multimedia information server;

[0073] an object detail information receiving unit configured to receive object detail information corresponding to the access address information returned by the multimedia information server based on the object access request;

[0074] The object detail information display unit is configured to display the object detail information.

[0075] In an exemplary embodiment, the first display unit includes:

[0076] a first operation response unit, configured to execute, in response to the multimedia information display operation, display the candidate multimedia information;

[0077] The third display unit is configured to be executed on the display interface of the candidate multimedia information and display the display control information in a target state.

[0078] In an exemplary embodiment, the apparatus further comprises:

[0079] The second operation response unit is configured to execute a display operation on the display manipulation information in response to the display manipulation information, and display description information of the display manipulation information on the display interface of the candidate multimedia information.

[0080] According to a fifth aspect of an embodiment of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to execute the instructions to implement the information push method or the information display method as described above.

[0081] According to a sixth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When the instructions in the computer-readable storage medium are executed by a processor of a server, the server is enabled to execute the information push method or information display method as described above.

[0082] According to the seventh aspect of an embodiment of the present disclosure, a computer program product is provided, which includes a computer program, and the computer program is stored in a readable storage medium. At least one processor of a computer device reads and executes the computer program from the readable storage medium, so that the device executes the above-mentioned information push method or information display method.

[0083] The technical solutions provided by the embodiments of the present disclosure bring at least the following beneficial effects:

[0084] The present disclosure determines candidate multimedia information upon receiving a multimedia information display request; generates object display information based on the associated objects corresponding to the candidate multimedia information, and generates display control information for displaying the object display information; and then pushes the candidate multimedia information, object display information, and display control information. The associated objects are determined by pre-identifying the candidate multimedia information, so that when the multimedia information display request is received, the pre-determined associated objects can be directly obtained without the need to determine the associated objects in real time, thereby improving the efficiency of information push; by performing object identification on the objects in the candidate multimedia information, the corresponding associated objects are determined, and object display information of the associated objects and display control information are further generated, so that the target terminal can display the object display information of the associated objects of the candidate multimedia information at the same time as displaying the candidate multimedia information; the object display information can be displayed by triggering the display control information, thereby realizing rapid acquisition of the object information of the associated objects, improving the convenience and efficiency of obtaining the object information of the associated objects; further, the candidate multimedia information and the object information of the associated objects are displayed simultaneously, enhancing interactivity and improving the user experience; in addition, the multimedia information creator does not need to add additional associated object display information, thereby improving the convenience and efficiency of the multimedia information creator's creation.

[0085] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0086] The accompanying drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute an improper limitation of the present disclosure.

[0087] Figure 1It is a schematic diagram of an implementation environment according to an exemplary embodiment.

[0088] Figure 2 The figure is a flow chart of an information push method according to an exemplary embodiment.

[0089] Figure 3 The figure is a flow chart of a method for generating object display information according to an exemplary embodiment.

[0090] Figure 4 The figure is a flow chart of a method for determining an object to be pushed according to an exemplary embodiment.

[0091] Figure 5 The figure is a flow chart of another method for generating object display information according to an exemplary embodiment.

[0092] Figure 6 The figure is a flow chart of a method for determining an associated object according to an exemplary embodiment.

[0093] Figure 7 The figure is a flow chart of a method for generating object feature information according to an exemplary embodiment.

[0094] Figure 8 The figure is a flow chart of an information display method according to an exemplary embodiment.

[0095] Figure 9 The figure is a flow chart of a method for displaying object detail information according to an exemplary embodiment.

[0096] Figure 10 It is a schematic diagram of an interface display according to an exemplary embodiment.

[0097] Figure 11 The figure is a block diagram of an information pushing device according to an exemplary embodiment.

[0098] Figure 12 The figure is a block diagram of an information display device according to an exemplary embodiment.

[0099] Figure 13 The block diagram shows an electronic device for information presentation according to an exemplary embodiment.

[0100] Figure 14 The figure is a block diagram of an electronic device for information push according to an exemplary embodiment. DETAILED DESCRIPTION

[0101] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

[0102] It should be noted that the terms "first," "second," and the like in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or precedence. It should be understood that the numbers used in this manner are interchangeable where appropriate so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure as detailed in the appended claims.

[0103] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display, data for analysis, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties.

[0104] See also Figure 1 , which shows a schematic diagram of the implementation environment provided by an embodiment of the present disclosure, the implementation environment may include: at least one target terminal 110, an object information server 120 and a multimedia information server 130, and data communication can be carried out between the target terminal 110, the object information server 120 and the multimedia information server 130 through the network.

[0105] Specifically, the target terminal 110 can send a multimedia information display request to the object information server 130. The object information server 130 pushes candidate multimedia information and object display information of associated objects that have an associated relationship with the candidate multimedia information to the target terminal 110 based on the multimedia information display request; the target terminal 110 displays the candidate multimedia information and object display information.

[0106] Furthermore, the multimedia information server 130 can obtain corresponding object information from the object information server 120. The multimedia information server 130 can also send an information push query request to the object information server 120. The object information server 120 returns information push feedback information to the multimedia information server 130 based on the information push query request.

[0107] In addition, the target terminal 110 may send an object access request to the object information server 120 , and the object information server 120 returns object detail information to the target terminal 110 based on the object access request.

[0108] The target terminal 110 can communicate with the object information server 120 based on a browser / server (B / S) or client / server (C / S) model. Similarly, the target terminal 110 can communicate with the multimedia information server 130 based on a browser / server (B / S) or client / server (C / S) model. The target terminal 110 may include a physical device such as a smartphone, tablet computer, laptop computer, digital assistant, smart wearable device, vehicle-mounted terminal, server, etc., and may also include software running on the physical device, such as an application. The operating system running on the target terminal 110 in the embodiments of the present disclosure may include, but is not limited to, Android, iOS, Linux, Windows, etc.

[0109] A communication connection can be established between the target terminal 110, the object information server 120 and the multimedia information server 130 via wired or wireless communication. The object information server 120 and the multimedia information server 130 can each include an independently running server, or a distributed server, or a server cluster consisting of multiple servers, where the server can be a cloud server.

[0110] In order to solve the problem in the related art that users cannot quickly obtain the object information of objects in multimedia information, the embodiment of the present disclosure provides an information push method, the execution subject of which can be the above-mentioned Figure 1 For multimedia information server in Figure 2 , the method may specifically include:

[0111] S210. Determine candidate multimedia information in response to the multimedia information display request sent by the target terminal.

[0112] The multimedia information display request can be generated by the target terminal and sent to the multimedia information server. The target terminal here can correspond to Figure 1 specifically, the requesting user may perform a display trigger operation based on the target terminal, and the target terminal generates a corresponding multimedia information display request in response to the display trigger operation.

[0113] In an optional embodiment, the multimedia information display request may include user identification information of the requesting user, where the requesting user is the user corresponding to the target terminal. Candidate multimedia information matching the user identification information may be determined based on the user identification information. Furthermore, user feature information of the requesting user may be obtained based on the user identification information. The user feature information may be pre-stored on the multimedia information server or in a database corresponding to the multimedia information server. Candidate multimedia information matching the user feature information may then be determined based on the user feature information.

[0114] In an optional embodiment, the multimedia information display request may directly include user characteristic information of the requesting user, and then candidate multimedia information matching the user characteristic information may be determined based on the user characteristic information.

[0115] In another optional embodiment, the candidate multimedia information may include one or more multimedia information; the candidate multimedia information may specifically be multimedia information that has been displayed more than a preset number of times within a preset time period, or multimedia information related to current hot events, etc.

[0116] S220. Based on the associated object corresponding to the candidate multimedia information, generate object display information corresponding to the candidate multimedia information; the associated object is obtained based on object recognition of the candidate multimedia information; the object display information carries object access address information.

[0117] In an optional embodiment, the associated object may be an object associated with the candidate multimedia information. Specifically, the associated object may be an object that is identical, similar, or associated with the object included in the candidate multimedia information. The objects in the candidate multimedia information may include events, people, items, music, etc., so that when performing object recognition on the candidate multimedia information, one or more associated objects may be determined.

[0118] In a specific embodiment, when the candidate multimedia information is multimedia information related to food, it may include objects such as ingredients and tableware. After object recognition of the candidate multimedia information, the corresponding associated objects can be ingredients that are the same or similar to the ingredients in the candidate multimedia information, and can be tableware that is the same or similar to the tableware in the multimedia information.

[0119] In another specific embodiment, when the candidate multimedia information is multimedia information related to a person introduction, it may include an image of the person being introduced. After object recognition is performed on the candidate multimedia information, the corresponding associated object can be the target person involved in the candidate multimedia information, or a person who has an associated relationship with the target task, or a work published by the target person, or an activity in which the target person participates, etc.

[0120] In another specific embodiment, when the candidate multimedia information is multimedia information related to music, it may include target music. After object recognition is performed on the candidate multimedia information, the corresponding associated objects can be the target music in the candidate multimedia information, other music written by the same author as the target music, music with a similar style to the target music, etc.

[0121] The associated objects are determined by pre-identifying the candidate multimedia information. When a multimedia information display request is received, the pre-determined associated objects can be directly obtained without the need to determine the associated objects in real time, thereby improving the efficiency of information push.

[0122] S230. Generate display manipulation information corresponding to the object display information.

[0123] The display control information can be used to touch the display object display information. When the target terminal displays the candidate multimedia information, the display control information can be displayed at the same time. The display of the display control information does not affect the display effect of the candidate multimedia information; the display control information provides the user with an interface for accessing and obtaining the object display information. By touching the display control information, the corresponding object display information can be accessed, thereby avoiding the problem of directly displaying the object display information at the same time as the candidate multimedia information, thereby obscuring the candidate multimedia information and affecting the display effect of the candidate multimedia information.

[0124] In a specific embodiment, the display manipulation information may be configured in a related manner, such as display format, display text information, display location information, display timing, etc.

[0125] S240. Push the candidate multimedia information, the object display information, and the display control information to the target terminal.

[0126] In a specific embodiment, each candidate multimedia message pushed may include multiple multimedia messages, object display information corresponding to each multimedia message, and display control information. Specifically, the multiple multimedia messages may be considered a multimedia message stream, so that the target terminal may sequentially display the multimedia messages in the multimedia message stream. When displaying each multimedia message, the display control information of the multimedia message may also be displayed simultaneously.

[0127] The present disclosure performs object recognition on objects in candidate multimedia information, determines corresponding associated objects, and further generates object display information of associated objects and display control information, so that the target terminal can display the object display information of the associated objects of the candidate multimedia information while displaying the candidate multimedia information; the object display information can be displayed by triggering the display control information, thereby realizing rapid acquisition of object information of associated objects, and improving the convenience and efficiency of acquiring object information of associated objects; further, the object information of candidate multimedia information and associated objects is displayed to enhance interactivity and improve user experience; in addition, there is no need for multimedia information creators to make additional additions to associated object display information, thereby improving the convenience and efficiency of multimedia information creators' creation.

[0128] In an optional embodiment, the multimedia information display request includes the user identification information of the requesting user; accordingly, please refer to Figure 3 , which shows a method for generating object display information, which may include:

[0129] S310. Obtain object information of an object to be pushed; the object to be pushed is an object in the associated objects that matches the user identification information.

[0130] The objects to be pushed can be all or part of the associated objects, and can be specifically determined based on the user identification information. The objects to be pushed can be specifically determined by the object information server or the multimedia information server. The object information server and the multimedia information server can exchange information through a real-time interface.

[0131] In one specific embodiment, when the multimedia information server determines the object to be pushed, for each associated object, the multimedia information server can pass the object identification information of the associated object through a real-time interface to obtain the user identification information matching the associated object from the object information server. The multimedia information server can then match the user identification information matching the associated object with the user identification information of the current requesting user to obtain the object to be pushed that matches the user identification information of the current requesting user. In other words, by calling the real-time interface to obtain the user identification information matching the associated object, the object to be pushed is determined, thereby improving the convenience and efficiency of determining the object to be pushed.

[0132] In another specific embodiment, when the object to be pushed is determined by the object information server, please refer to Figure 4 , which shows a method for determining an object to be pushed, which may include:

[0133] S410. Send an information push query request to the object information server; the information push query request includes the user identification information and the object identification information of the associated object; the information push query request is used to instruct the object information server to determine the object to be pushed from the associated objects based on the user identification information and the object identification information of the associated object.

[0134] S420. Receive the result of determining the object to be pushed returned by the object information server.

[0135] The multimedia information server sends an information push inquiry request to the object information server through a real-time interface, and the information push inquiry request is used to inquire the object information server about which objects among the associated objects can be pushed; the object information server can make a judgment based on the user identification information when judging which objects can be pushed, and specifically can make a matching judgment by the user identification information of the requesting user sent by the multimedia information server through the real-time interface and the object identification information of the associated objects, and determine the object to be pushed that matches the user identification information of the requesting user; after determining the object to be pushed, the object determination result is returned to the multimedia information server through the real-time interface, which can specifically be the object identification information of the object to be pushed.

[0136] Therefore, by inputting user identification information and object identification information of the associated object into the real-time interface, the process of determining the object to be pushed is implemented on the object information server, thereby reducing the information processing pressure on the multimedia information server and improving the efficiency of information push on the multimedia information server.

[0137] In one example, user characteristic information can also be obtained based on the user identification information. User characteristic information can include user classification information, user static attribute characteristic information and user dynamic attribute characteristic information. User classification information can be the user category to which the user belongs in the push system. User static attribute characteristic information can include user gender, age, etc.; user dynamic attribute information can include user historical behavior data, etc. The above user characteristic information can be pre-stored in the multimedia information server or in a database corresponding to the multimedia information server, so that the user characteristic information corresponding to the requesting user can be obtained based on the user identification information. Thus, Figure 3 and Figure 4 In the method, user characteristic information can be obtained based on the user identification information, so that the object to be pushed that matches the user characteristic information of the requesting user can be determined based on the user characteristic information.

[0138] S320. Generate the object display information based on the object information of the object to be pushed.

[0139] After determining the object to be pushed, the multimedia information server can obtain the corresponding object information based on the object identification information of the object to be pushed. The object information here can specifically be the description information of the object to be pushed, which can be used to generate the original information of the object display information, and may include the object image identification of the object to be pushed, and the object attribute identification of the object to be pushed.

[0140] In an optional embodiment, the object image identifier of the object to be pushed may be image information containing the object to be pushed, and the object attribute identifier of the object to be pushed may be text description information of the object to be pushed.

[0141] Thus, based on the user identification information of the requesting user, the object to be pushed is determined from the associated objects corresponding to the candidate multimedia information, which can realize personalized information push, improve the efficiency of information push, and thus improve the user experience; on the other hand, by effectively pushing information, the conversion rate of the requesting user to the push object can be improved.

[0142] In an optional embodiment, the object information server and the multimedia information server further perform real-time information interaction through a real-time interface, so that when the object display information of the object to be pushed has been pushed to the target terminal but has not yet been displayed to the user, the multimedia information server receives a push adjustment instruction from the object information server, and the push adjustment instruction is used to indicate that the display information of the target object in the object to be pushed should not be pushed; the multimedia information server generates an information display instruction based on the push adjustment instruction, and the information display instruction is used to indicate that when the display control information is triggered, the display information of the target object in the object to be pushed should not be displayed, so that through the real-time interaction between the object information server and the multimedia information server, the object display information displayed to the user can be adjusted in real time before the push information is displayed to the user, thereby improving the flexibility of information push.

[0143] In an alternative embodiment, see Figure 5 , which shows another method for generating object display information, characterized in that the method may include:

[0144] S510. Load a display information generation template; the display information generation template includes an object image identification field and an object attribute identification field.

[0145] In an optional embodiment, the display information generation template may be a packaged program code or a preset function. By passing corresponding parameters into the packaged program code or preset function, the corresponding object display information may be generated.

[0146] In another optional embodiment, the input format of the display information generation template parameters can be set. For example, when there are multiple input parameters for the display information generation template, the input order of the multiple input parameters and the data format of the multiple input parameters can be set, so that the input parameters correspond to the fillable information in the display information generation template and the parameters can be uniformly identified.

[0147] S520. Obtain the object image identifier of the associated object and the object attribute identifier of the associated object.

[0148] In an optional embodiment, the associated object may correspond to object information, which may be descriptive information of the associated object and can be used to generate original information of the object display information. Specifically, it may include the object image identifier of the object to be associated and the object attribute identifier of the associated object. The object image identifier and object attribute identifier here can be used as input parameters of the display information generation template. The object image identifier can specifically be the object image file name, or the object storage location link information, etc. The object attribute identifier can be the text description file name of the object, or the text description file storage location link information.

[0149] S530. Fill the object image identifier of the associated object into the object image identifier field, and fill the object attribute identifier of the associated object into the object attribute identifier field, to generate the object display information.

[0150] By using the corresponding object image identifier and object attribute identifier as input parameters for the display information generation template and running the template with the input parameters, the field information is filled in, generating the object display information. After the object display information is pushed to the target terminal, the terminal renders the received object display information and displays the object image information and object attribute description information of the associated objects. Therefore, creating object display information using the display information generation template can improve the efficiency and convenience of object display information.

[0151] In an alternative embodiment, see Figure 6 , which shows a method for determining an associated object, which may include:

[0152] S610. Perform object recognition on the candidate multimedia information to obtain object feature information of the recognized object.

[0153] S620. Match the object feature information of the identified object with the object feature information of multiple objects to be matched in a preset object library to obtain an object matching result.

[0154] S630. Based on the object matching result, determine the associated object from the multiple objects to be matched.

[0155] In a specific embodiment, an object recognition model can be used to perform object recognition on candidate multimedia information, and then object feature information of the recognized object can be obtained; the object feature information of the recognized object can be matched with object feature information of multiple objects to be matched in a preset object library. The specific matching process may include: respectively calculating the matching similarity of the object feature information of the recognized object and the object feature information of multiple objects to be matched, and obtaining the matching similarity with multiple objects to be matched; and determining the objects to be matched whose matching similarity is greater than the preset similarity as associated objects.

[0156] In an optional embodiment, the object feature information may specifically be an object feature vector, so that the matching similarity between the identified object and the object to be matched may be determined based on the similarity of the object feature vector; any method in the related art that can realize vector similarity calculation may be applied in this embodiment, for example, the Euclidean distance calculation method or the cosine similarity calculation method may be used, etc., which is not specifically limited in the embodiment of the present disclosure.

[0157] The object feature information is an abstract expression of the features of each object. The object feature information of the identified object is matched with the object feature information of the object to be matched, and the associated objects are determined according to the object matching results, thereby improving the accuracy of the determination of the associated objects.

[0158] In an alternative embodiment, see Figure 7 , which shows a method for generating object feature information, which may include:

[0159] S710. Perform voice recognition on the candidate multimedia information to obtain first text information.

[0160] S720. Perform text recognition on the candidate multimedia information to obtain second text information.

[0161] S730. Perform image recognition on the candidate multimedia information to obtain object image information of the recognized object.

[0162] S740. Obtain object feature information of the identified object based on the first text information, the second text information, and the object image information of the identified object.

[0163] In a specific implementation process, the object feature information may be obtained based on one or more of the first text information, the second text information, and the object image information, which is not specifically limited in this embodiment.

[0164] In a specific embodiment, the candidate multimedia information contains rich content information, which may include voice information, text information, and image information, so that a voice recognition model can be used to perform voice recognition on the candidate multimedia information to obtain first text information, a text recognition model can be used to perform text recognition on the candidate multimedia information to obtain second text information, and an image recognition model can be used to perform image recognition on the candidate multimedia information to obtain object image information of the recognized object.

[0165] In an optional embodiment, when the candidate multimedia information includes human voice information, speech recognition is performed on the human voice information through a speech recognition model, and the corresponding first text information may be speech content information.

[0166] The object feature information may specifically include text feature information and image feature information, thereby generating the object feature information of the identified object through multiple types of feature information, which can improve the comprehensiveness of the object feature expression of the identified object, and thereby improve the feature expression ability of the object feature information for the identified object.

[0167] In an optional embodiment, specifically when matching the object feature information of the identified object with the object feature information of multiple objects to be matched in a preset object library, the text feature information of the identified object can be matched with the text feature information of the object to be matched respectively to obtain a first matching similarity, and the image feature information of the identified object can be matched with the image feature information of the object to be matched to obtain a second matching similarity; based on the first matching similarity and the second matching similarity, the matching similarity between the identified object and the object to be matched is determined.

[0168] In another optional embodiment, for an image-type object feature vector, it may include an abstract feature vector and a non-abstract feature vector; wherein the abstract feature vector may be a feature vector obtained by extracting features from image information containing an object through a convolutional network, wherein the features of each dimension in the feature vector have no specific meaning, and the features of each dimension are combined into a feature vector that expresses the features of the corresponding object; since the abstract feature vector can sample and express the features of the object, it can mine the potential features of the object, thus having a strong feature characterization capability. The non-abstract feature vector may specifically be a pixel feature vector, that is, obtained by extracting the values ​​of the pixels of the image information containing the object, and the features of each dimension in the corresponding pixel feature vector can be used to represent the pixel information of the object image information; the feature information of each dimension in the non-abstract feature vector is relatively easy to extract and has a specific feature meaning, thereby improving the convenience and concreteness of the object feature expression.

[0169] In an alternative embodiment, see Figure 8, which shows a method for displaying information. The execution subject of this method may be the target terminal mentioned above. The method may specifically include:

[0170] S810. In response to the multimedia information display operation, display candidate multimedia information and display manipulation information.

[0171] The requesting user may perform a multimedia information display operation on the target terminal. The multimedia information display operation may specifically be a preset gesture operation or a click operation. The preset gesture operations may include swiping up, swiping down, swiping left, swiping right, etc., and the click operation may include single-clicking or double-clicking, etc. In response to the multimedia information display operation, the target terminal renders the information received from the multimedia information server to display the candidate multimedia information and the display control information. Specifically, the display control information may be displayed on the display interface of the candidate multimedia information.

[0172] S820. In response to the triggering operation of the display control information, the object display information corresponding to the candidate multimedia information is displayed; the object display information is obtained based on the associated object corresponding to the candidate multimedia information, and the associated object is obtained based on object identification of the candidate multimedia information; the object display information carries the access address information of the object to be pushed.

[0173] In a specific embodiment, a display position may be used to display an object display information. The display position may include an image display area and a text display area. The image display area is used to display the object image identifier, and the text display area is used to display the object attribute identifier, which corresponds to the display information generation template.

[0174] In the present disclosure, the target terminal can display the object display information of the associated objects of the candidate multimedia information while displaying the candidate multimedia information; the object display information can be displayed through the trigger operation of the display control information, thereby realizing the rapid acquisition of the object information of the associated objects, and improving the convenience and efficiency of obtaining the object information of the associated objects; further, the display of the candidate multimedia information and the object information of the associated objects enhances interactivity and can improve the user experience.

[0175] In a specific embodiment, see Figure 9 , which shows a method for displaying object detail information, which may include:

[0176] S910. In response to a selection operation on the object display information, generate an object access request; the object access request includes access address information of the object to be pushed.

[0177] The access address information can be address information of the detail information of the to-be-pushed object on the object information server. The access address information can be sent by the object information server to the target terminal.

[0178] S920. The object access request is sent to the object information server.

[0179] S930. The object information server returns the object detail information corresponding to the access address information based on the object access request.

[0180] S940. The object detail information is displayed.

[0181] In an embodiment, the detail information of the object can be stored in the object information server, so that the detail information of the object can be accessed through the access address information of the object, and the obtained detail information can be displayed. Further, when information interaction with the object information server occurs, the target terminal can specifically jump from a client interface corresponding to the multimedia information server to a client interface corresponding to the object information server, that is, the page switching and display are realized, and the efficiency of obtaining and displaying the object detail information is improved.

[0182] In an optional embodiment, the candidate multimedia information can be displayed in response to the multimedia information display operation, and the display control information can be displayed in a target state on a display interface of the candidate multimedia information. The display control information can be displayed on the multimedia information display interface, and the display of the multimedia information and the display of the display control information do not affect each other, so that the user can trigger the object display information based on the display control information on the current display interface when watching the multimedia information, and the convenience of obtaining the object display information is improved. In addition, the target state can specifically include a display style, a display position, etc. The display style can include an icon style, a text style, etc. of the display control information, and the display state of the display control information can be flexibly set.

[0183] In a specific embodiment, in response to the display operation of the display manipulation information, the description information of the display manipulation information is displayed on the display interface of the candidate multimedia information. The description information of the display manipulation information can be specifically the description information of the corresponding object display information; for example, the object introduction, object type, object quantity, etc. specifically included in the object display information; specifically, when displaying the display manipulation information, the icon information of the display manipulation information can be displayed first; when the trigger operation is performed on the icon information, the description information of the display manipulation information will be displayed in the adjacent area of ​​the icon information; on the one hand, because the icon information occupies a smaller area of ​​the display interface, the icon information of the display manipulation information can avoid the text description information of the display manipulation information from obscuring the current multimedia information display; on the other hand, before the specific display object is displayed, the description information is displayed first, so that the user can understand the approximate information of the object display information in advance to determine whether it is necessary to further trigger the display of the object display information, thereby improving the user experience.

[0184] The following scenario is used as an example to illustrate the implementation details of the present disclosure. In this scenario, the object may be a product, and the object information server may be a product information server. The specific process may include:

[0185] 1. The product information server provides the relevant product library information to the multimedia information server in advance so that the multimedia information server can subsequently perform relevant product identification.

[0186] 2. Information interaction between the multimedia information server and the product information server is realized through a real-time interface. Whether to display product advertisements can be determined based on the real-time request of the information publisher to meet the requirements of information delivery.

[0187] 3. The multimedia information server pre-analyzes the uploaded multimedia information, identifies the product information in the multimedia information, and aggregates the relevant product names, categories, and categories.

[0188] 4. Search the product database based on the identified product information and retrieve matching product information that has a high matching rate with the identified product information.

[0189] 5. When a user accesses multimedia information, display touch information related to the multimedia information content can be displayed on the multimedia information display interface. The display touch information can be displayed in the form of components.

[0190] 6. When the user needs to learn more about the matching product, click the corresponding product display control to jump to the client page corresponding to the product information server.

[0191] Please refer to the following for details: Figure 10 , which shows a specific interface display schematic diagram, Figure 10 In (a), the multimedia information displayed on the current interface displays the display control information on the multimedia information display interface, and its specific display form includes an icon and a text description "related items in the video"; after clicking on the display control information, the display interface is as follows Figure 10 (b) shows the display information of the products. The products displayed here can be the same, similar or related to the items in the video. The display information of each product includes picture information and text description information. Furthermore, when one of the product information is selected, the display interface is as follows: Figure 10 As shown in (c), the corresponding APP client of the product information server is entered.

[0192] The present disclosure can reduce the cost of product delivery for creators, that is, product delivery can be achieved by performing object recognition on multimedia information; in addition, it improves the user experience of viewing multimedia information and delivering information, and solves the problem of no correlation between multimedia information and product delivery information.

[0193] Figure 11 FIG. 1 is a block diagram of an information push device according to an exemplary embodiment. Figure 11 , the device comprises:

[0194] The candidate multimedia information determining unit 1110 is configured to determine candidate multimedia information in response to a multimedia information display request sent by a target terminal;

[0195] The object display information generating unit 1120 is configured to generate object display information corresponding to the candidate multimedia information based on the associated object corresponding to the candidate multimedia information; the associated object is obtained by object recognition of the candidate multimedia information; the object display information carries object access address information;

[0196] The display manipulation information generating unit 1130 is configured to generate display manipulation information corresponding to the object display information;

[0197] The information pushing unit 1140 is configured to push the candidate multimedia information, the object display information, and the display control information to the target terminal.

[0198] In an exemplary embodiment, the multimedia information presentation request includes user identification information of the requesting user;

[0199] The object display information generating unit 1120 includes:

[0200] An object information acquisition unit is configured to acquire object information of an object to be pushed; the object to be pushed is an object in the associated object that matches the user identification information;

[0201] The first generating unit is configured to generate the object display information based on the object information of the object to be pushed.

[0202] In an exemplary embodiment, the apparatus further comprises:

[0203] an information push query request sending unit configured to send an information push query request to an object information server; the information push query request includes the user identification information and the object identification information of the associated object; the information push query request is used to instruct the object information server to determine the object to be pushed from the associated objects based on the user identification information and the object identification information of the associated object;

[0204] The object determination result receiving unit is configured to receive the to-be-pushed object determination result returned by the object information server.

[0205] In an exemplary embodiment, the object display information generating unit 1120 includes:

[0206] A template loading unit configured to load a display information generation template; the display information generation template includes an object image identification field and an object attribute identification field;

[0207] an identification information acquiring unit, configured to acquire an object image identification of the associated object and an object attribute identification of the associated object;

[0208] The information filling unit is configured to fill the object image identifier of the associated object into the object image identifier field and fill the object attribute identifier of the associated object into the object attribute identifier field to generate the object display information.

[0209] In an exemplary embodiment, the apparatus further comprises:

[0210] an object recognition unit configured to perform object recognition on the candidate multimedia information to obtain object feature information of the recognized object;

[0211] an object matching unit configured to match the object feature information of the identified object with the object feature information of a plurality of objects to be matched in a preset object library to obtain an object matching result;

[0212] The associated object determining unit is configured to determine the associated object from the multiple objects to be matched based on the object matching result.

[0213] In an exemplary embodiment, the object recognition unit includes:

[0214] a speech recognition unit configured to perform speech recognition on the candidate multimedia information to obtain first text information;

[0215] a text recognition unit configured to perform text recognition on the candidate multimedia information to obtain second text information;

[0216] an image recognition unit configured to perform image recognition on the candidate multimedia information to obtain object image information of the recognition object;

[0217] The object feature information determining unit is configured to obtain the object feature information of the identified object based on the first text information, the second text information, and the object image information of the identified object.

[0218] Figure 12 FIG. 1 is a block diagram of an information display device according to an exemplary embodiment. Figure 12 , the device comprises:

[0219] The first display unit 1210 is configured to display candidate multimedia information and display manipulation information in response to a multimedia information display operation;

[0220] The second display unit 1220 is configured to execute a triggering operation on the display control information to display object display information corresponding to the candidate multimedia information; the object display information is obtained based on the associated object corresponding to the candidate multimedia information, and the associated object is obtained based on object identification of the candidate multimedia information; the object display information carries access address information of the object to be pushed.

[0221] In an exemplary embodiment, the apparatus further comprises:

[0222] The object access request generating unit is configured as an execution unit, configured to generate an object access request in response to a selection operation on the object display information; the object access request includes access address information of the object to be pushed;

[0223] an object access request sending unit, configured to execute sending the object access request to the multimedia information server;

[0224] an object detail information receiving unit configured to receive object detail information corresponding to the access address information returned by the multimedia information server based on the object access request;

[0225] The object detail information display unit is configured to display the object detail information.

[0226] In an exemplary embodiment, the first display unit 1210 includes:

[0227] a first operation response unit, configured to execute, in response to the multimedia information display operation, display the candidate multimedia information;

[0228] The third display unit is configured to be executed on the display interface of the candidate multimedia information and display the display control information in a target state.

[0229] In an exemplary embodiment, the apparatus further comprises:

[0230] The second operation response unit is configured to execute a display operation on the display manipulation information in response to the display manipulation information, and display description information of the display manipulation information on the display interface of the candidate multimedia information.

[0231] Regarding the apparatus in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0232] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided. Optionally, the computer-readable storage medium may be a ROM, a random access memory (RAM), a CD-ROM, a tape, a floppy disk, an optical data storage device, etc.; when the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform any of the methods described above.

[0233] In an exemplary embodiment, a computer program product is also provided, which includes a computer program stored in a readable storage medium, and at least one processor of a computer device reads and executes the computer program from the readable storage medium, so that the device performs any of the above methods.

[0234] Figure 13 This is a block diagram of an electronic device for information display according to an exemplary embodiment. The electronic device may be a terminal, and its internal structure diagram may be as shown in FIG. Figure 13As shown. The electronic device includes a processor, a memory, a network interface, a display screen and an input device connected via a system bus. The processor of the electronic device is used to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the electronic device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, an information display method is implemented. The display screen of the electronic device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the electronic device can be a touch layer covering the display screen, or a button, trackball or touchpad provided on the housing of the electronic device, or an external keyboard, touchpad or mouse, etc.

[0235] Figure 14 This is a block diagram of an electronic device for information push according to an exemplary embodiment. The electronic device may be a server, and its internal structure diagram may be as shown in FIG. Figure 14 As shown. The electronic device includes a processor, a memory, and a network interface connected via a system bus. The processor of the electronic device is used to provide computing and control capabilities. The memory of the electronic device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer program in the non-volatile storage medium. The network interface of the electronic device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, an information push method is implemented.

[0236] Those skilled in the art will understand that Figure 13 and Figure 14 The structure shown in the figure is only a block diagram of a part of the structure related to the scheme of the present disclosure, and does not constitute a limitation on the electronic device to which the scheme of the present disclosure is applied. The specific electronic device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0237] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the following claims.

[0238] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An information push method, characterized in that: include: determining candidate multimedia information in response to a multimedia information display request sent by a target terminal; generating object display information corresponding to the candidate multimedia information based on the associated object corresponding to the candidate multimedia information; The associated object is obtained based on object recognition of the candidate multimedia information; the object display information carries object access address information; the associated object is an object that is identical, similar or associated with the object included in the candidate multimedia information; generating display manipulation information corresponding to the object display information; Pushing the candidate multimedia information, the object display information, and the display control information to the target terminal; so that the target terminal: displays the candidate multimedia information in response to the multimedia information display operation, and displays the display control information in a target state on the display interface of the candidate multimedia information; The display control information provides a user with an interface for accessing and obtaining the object display information corresponding to the candidate multimedia information, and the display of the display control information does not affect the display effect of the candidate multimedia information; in response to a selection operation on the object display information, an object access request is generated; the object access request includes access address information of the object to be pushed; the object access request is sent to an object information server; and object detail information corresponding to the access address information is received from the object information server based on the object access request; Displaying detailed information of the object; When the object display information of the object to be pushed has been pushed to the target terminal but before the object display information of the object to be pushed has been displayed to the user, a push adjustment instruction is received from the object information server indicating not to push the display information of the target object in the object to be pushed, and an information display instruction is generated based on the push adjustment instruction. The information display instruction is used to instruct the target terminal not to display the display information of the target object in the object to be pushed when the display control information is triggered.

2. The method according to claim 1, characterized in that The multimedia information display request includes user identification information of the requesting user; The generating, based on the associated object corresponding to the candidate multimedia information, object display information corresponding to the candidate multimedia information includes: Obtaining object information of an object to be pushed; the object to be pushed is an object in the associated object that matches the user identification information; The object display information is generated based on the object information of the object to be pushed.

3. The method according to claim 2, characterized in that The step of obtaining the object information of the object to be pushed further includes: Sending an information push query request to the object information server; the information push query request includes the user identification information and the object identification information of the associated object; the information push query request is used to instruct the object information server to determine the object to be pushed from the associated objects based on the user identification information and the object identification information of the associated object; Receive the result of determining the object to be pushed returned by the object information server.

4. The method according to claim 1, wherein The generating, based on the associated object corresponding to the candidate multimedia information, object display information corresponding to the candidate multimedia information includes: Loading a display information generation template; the display information generation template includes an object image identification field and an object attribute identification field; Acquire the object image identifier of the associated object and the object attribute identifier of the associated object; The object image identifier of the associated object is filled into the object image identifier field, and the object attribute identifier of the associated object is filled into the object attribute identifier field to generate the object display information.

5. The method according to claim 1, wherein The method further comprises: Performing object recognition on the candidate multimedia information to obtain object feature information of the recognized object; Matching the object feature information of the identified object with the object feature information of multiple objects to be matched in a preset object library to obtain an object matching result; Based on the object matching result, the associated object is determined from the multiple objects to be matched.

6. The method according to claim 5, characterized in that The performing object recognition on the candidate multimedia information to obtain object feature information of the recognized object includes: Performing speech recognition on the candidate multimedia information to obtain first text information; Performing text recognition on the candidate multimedia information to obtain second text information; Performing image recognition on the candidate multimedia information to obtain object image information of the recognition object; Object feature information of the identified object is obtained based on the first text information, the second text information, and the object image information of the identified object.

7. An information display method, characterized in that: include: In response to the multimedia information display operation, display candidate multimedia information, and display the display control information in a target state on the display interface of the candidate multimedia information; The display control information provides a user with an interface for accessing and obtaining the object display information corresponding to the candidate multimedia information. The display of the display control information does not affect the display effect of the candidate multimedia information. In response to a triggering operation on the display manipulation information, displaying object display information corresponding to the candidate multimedia information; The object display information is obtained based on the associated object corresponding to the candidate multimedia information, and the associated object is obtained based on object identification of the candidate multimedia information; the object display information carries access address information of the object to be pushed; the associated object is an object that is identical, similar, or associated with the object included in the candidate multimedia information; In response to a selection operation on the object display information, an object access request is generated; the object access request includes access address information of the object to be pushed; the object access request is sent to an object information server; and object detail information corresponding to the access address information is returned by the object information server based on the object access request; Displaying detailed information of the object; When the object display information of the object to be pushed is received but before the object display information of the object to be pushed has been displayed to the user, in response to the information display instruction, when the display control information is triggered, the display information of the target object in the object to be pushed is not displayed; the information display instruction is generated by the multimedia information server based on the instruction of the object information server not to push the display information of the target object in the object to be pushed.

8. The method according to claim 7, characterized in that The method further comprises: In response to a display operation on the display manipulation information, description information of the display manipulation information is displayed on a display interface of the candidate multimedia information.

9. An information push device, characterized in that: include: a candidate multimedia information determining unit configured to determine candidate multimedia information in response to a multimedia information display request sent by a target terminal; an object display information generating unit configured to generate object display information corresponding to the candidate multimedia information based on the associated object corresponding to the candidate multimedia information; The associated object is obtained based on object recognition of the candidate multimedia information; the object display information carries object access address information; the associated object is an object that is identical, similar or associated with the object included in the candidate multimedia information; a display manipulation information generating unit, configured to generate display manipulation information corresponding to the object display information; an information pushing unit, configured to push the candidate multimedia information, the object display information, and the display manipulation information to the target terminal; so that the target terminal: displays the candidate multimedia information in response to the multimedia information display operation, and displays the display control information in a target state on the display interface of the candidate multimedia information; The display control information provides a user with an interface for accessing and obtaining the object display information corresponding to the candidate multimedia information, and the display of the display control information does not affect the display effect of the candidate multimedia information; in response to a selection operation on the object display information, an object access request is generated; the object access request includes access address information of the object to be pushed; the object access request is sent to an object information server; and object detail information corresponding to the access address information is received from the object information server based on the object access request; Displaying detailed information of the object; When the object display information of the object to be pushed has been pushed to the target terminal but before the object display information of the object to be pushed has been displayed to the user, a push adjustment instruction is received from the object information server indicating not to push the display information of the target object in the object to be pushed, and an information display instruction is generated based on the push adjustment instruction. The information display instruction is used to instruct the target terminal not to display the display information of the target object in the object to be pushed when the display control information is triggered.

10. The device according to claim 9, characterized in that The multimedia information display request includes user identification information of the requesting user; The object display information generating unit includes: An object information acquisition unit is configured to acquire object information of an object to be pushed; the object to be pushed is an object in the associated object that matches the user identification information; The first generating unit is configured to generate the object display information based on the object information of the object to be pushed.

11. The device according to claim 10, characterized in that The device further comprises: an information push query request sending unit, configured to execute sending an information push query request to an object information server; the information push query request includes the user identification information and the object identification information of the associated object; the information push query request is used to instruct the object information server to determine the object to be pushed from the associated objects based on the user identification information and the object identification information of the associated object; The object determination result receiving unit is configured to receive the to-be-pushed object determination result returned by the object information server.

12. The device according to claim 9, characterized in that The object display information generating unit includes: A template loading unit configured to load a display information generation template; the display information generation template includes an object image identification field and an object attribute identification field; an identification information acquiring unit, configured to acquire an object image identification of the associated object and an object attribute identification of the associated object; The information filling unit is configured to fill the object image identifier of the associated object into the object image identifier field and fill the object attribute identifier of the associated object into the object attribute identifier field to generate the object display information.

13. The device according to claim 9, characterized in that The device further comprises: an object recognition unit configured to perform object recognition on the candidate multimedia information to obtain object feature information of the recognized object; an object matching unit configured to match the object feature information of the identified object with the object feature information of a plurality of objects to be matched in a preset object library to obtain an object matching result; The associated object determining unit is configured to determine the associated object from the multiple objects to be matched based on the object matching result.

14. The device according to claim 13, characterized in that The object recognition unit includes: a speech recognition unit configured to perform speech recognition on the candidate multimedia information to obtain first text information; a text recognition unit configured to perform text recognition on the candidate multimedia information to obtain second text information; an image recognition unit configured to perform image recognition on the candidate multimedia information to obtain object image information of the recognition object; The object feature information determining unit is configured to obtain the object feature information of the identified object based on the first text information, the second text information, and the object image information of the identified object.

15. An information display device, characterized in that: include: a first display unit configured to display candidate multimedia information in response to a multimedia information display operation, and to display display manipulation information in a target state on a display interface of the candidate multimedia information; The display control information provides a user with an interface for accessing and obtaining the object display information corresponding to the candidate multimedia information. The display of the display control information does not affect the display effect of the candidate multimedia information. The second display unit is configured to execute a triggering operation on the display control information to display object display information corresponding to the candidate multimedia information; the object display information is obtained based on the associated object corresponding to the candidate multimedia information, and the associated object is obtained based on object recognition of the candidate multimedia information; the object display information carries access address information of the object to be pushed; the associated object is an object that is identical, similar or associated with the object included in the candidate multimedia information; in response to a selection operation on the object display information, an object access request is generated; the object access request includes the access address information of the object to be pushed; the object access request is sent to an object information server; and object detail information corresponding to the access address information is received, which is returned by the object information server based on the object access request; Displaying detailed information of the object; When the object display information of the object to be pushed is received but before the object display information of the object to be pushed has been displayed to the user, in response to the information display instruction, when the display control information is triggered, the display information of the target object in the object to be pushed is not displayed; the information display instruction is generated by the multimedia information server based on the instruction of the object information server not to push the display information of the target object in the object to be pushed.

16. The device according to claim 15, characterized in that The device further comprises: The second operation response unit is configured to execute a display operation on the display manipulation information in response to the display manipulation information, and display description information of the display manipulation information on the display interface of the candidate multimedia information.

17. An electronic device, characterized in that: include: processor; a memory for storing instructions executable by the processor; The processor is configured to execute the instructions to implement the information push method according to any one of claims 1 to 6, or the information display method according to any one of claims 7 to 8.

18. A computer-readable storage medium, characterized in that When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the information push method according to any one of claims 1 to 6, or the information display method according to any one of claims 7 to 8.

19. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instruction is executed by a processor, the information push method according to any one of claims 1 to 6 or the information display method according to any one of claims 7 to 8 is implemented.

Citation Information

Patent Citations

  • Method and device for displaying recommended programs

    CN103096172A

  • Information recommendation method and device, electronic equipment and storage medium

    CN113010703A