Information display method and device, equipment and storage medium

Abstract

The invention provides an information display method and device, equipment and a storage medium, and belongs to the technical field of computers. According to the method, object identification is carried out on the target video frame in the multimedia resource after the pause operation is triggered, at least one object in the target video frame can be determined in real time, and the object may be an object which a user is interested in. The object information associated with the object is displayed on the first page, so that a user can intuitively and quickly know the object in the target video frame through the object information. Compared with an existing scheme, the method has the advantages that the objects in the multimedia resources are diversified, so that the object information is diversified, the content of the object information is enriched, a user can obtain useful information more easily, the information obtaining efficiency of the user is improved, and then the man-machine interaction efficiency is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to an information display method, device, equipment and storage medium. Background Art

[0002] With the development of computer technology, users can watch videos or live broadcasts through electronic devices. Accordingly, when users watch videos or live broadcasts, recommendation information will be displayed to recommend the products sold in the video or live broadcast to users. However, the content of the recommended information in the above method is very single and lacks diversity, resulting in users being unable to obtain useful information through the recommended information, and the efficiency of human-computer interaction is low. Summary of the invention

[0003] The present disclosure provides an information display method, device, equipment and storage medium. Compared with the existing solution, the solution has a variety of objects in multimedia resources, so the object information is also diverse, enriching the content of the object information, making it easier for users to obtain information useful to themselves, improving the efficiency of users obtaining information, and thus improving the efficiency of human-computer interaction.

[0004] According to one aspect of an embodiment of the present disclosure, there is provided an information display method, the method comprising:

[0005] Displaying a first page, wherein the first page displays multimedia resources;

[0006] In response to a pause operation on the multimedia resource, at least one piece of object information is displayed on the first page, each piece of object information is associated with an object identified from a target video frame, and the target video frame is a currently displayed video frame.

[0007] According to another aspect of an embodiment of the present disclosure, there is provided an information display device, the device comprising:

[0008] A first display unit is configured to display a first page, wherein the first page displays multimedia resources;

[0009] The second display unit is configured to display at least one object information on the first page in response to a pause operation on the multimedia resource, each object information being associated with an object identified from a target video frame, the target video frame being a currently displayed video frame.

[0010] In some embodiments, the second display unit is configured to, in response to a pause operation on the multimedia resource, perform object recognition on the target video frame to obtain at least one object in the target video frame; crop the at least one object from the target video frame to obtain at least one object image, each object image corresponding to an object; and display the at least one object image on the first page.

[0011] In some embodiments, the second display unit is further configured to display a second page in response to a triggering operation on any object image, wherein the second page displays a plurality of recommended objects similar to the object in the object image.

[0012] In some embodiments, the second display unit is further configured to display an object details page corresponding to any object image in response to a trigger operation on the object image, wherein the object details page is used to introduce detailed information of the object in the object image.

[0013] In some embodiments, the second display unit is configured to, in response to a pause operation on the multimedia resource, perform object recognition on the target video frame to obtain at least one object in the target video frame; for any object, generate at least one expression image of the object based on the expression of the object; and display at least one expression image of the at least one object on the first page.

[0014] In some embodiments, the second display unit is configured to generate an expression image of the object in different styles based on the expression of the object, and each style corresponds to at least one expression image.

[0015] In some embodiments, the second display unit is configured to determine emotional information of the object based on the expression of the object; add text related to the emotional information to an object image including the object to obtain an expression image of the object.

[0016] In some embodiments, the second display unit is further configured to perform at least one of image recognition, text recognition, and audio recognition on the multimedia resource to obtain at least one introduction information, wherein the introduction information is used to introduce the multimedia resource; and display the at least one introduction information on the first page.

[0017] In some embodiments, the second display unit is further configured to determine the multimedia segment corresponding to the introduction information in response to a triggering operation on any introduction information; and play the multimedia resource from the starting position of the multimedia segment.

[0018] In some embodiments, the second display unit is further configured to perform object recognition on the multimedia resource to obtain a plurality of interactive objects in the multimedia resource; and display the plurality of interactive objects on the first page.

[0019] According to another aspect of an embodiment of the present disclosure, an electronic device is provided, the electronic device comprising:

[0020] one or more processors;

[0021] A memory for storing program codes executable by the processor;

[0022] The processor is configured to execute the program code to implement the above-mentioned information display method.

[0023] According to another aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the above-mentioned information display method.

[0024] According to another aspect of an embodiment of the present disclosure, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the above-mentioned information display method is implemented.

[0025] The disclosed embodiment provides an information display scheme, which can identify at least one object in the target video frame in the multimedia resource after triggering the pause operation, and can determine in real time at least one object in the target video frame, which may be an object of interest to the user. By displaying the object information associated with the object on the first page, the user can intuitively and quickly understand the object in the target video frame through the object information. Compared with the existing scheme, since the objects in the multimedia resources are diverse, the object information is also diverse, which enriches the content of the object information, makes it easier for users to obtain information that is useful to them, improves the efficiency of users in obtaining information, and thus improves the efficiency of human-computer interaction.

[0026] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0028] Figure 1 It is a schematic diagram of an implementation environment of an information display method according to an exemplary embodiment.

[0029] Figure 2The invention is a flowchart of an information display method according to an exemplary embodiment.

[0030] Figure 3 The figure is a flow chart of another information display method according to an exemplary embodiment.

[0031] Figure 4 is a schematic diagram of a first page provided according to an exemplary embodiment.

[0032] Figure 5 is a schematic diagram of a second page provided according to an exemplary embodiment.

[0033] Figure 6 The figure is a flow chart of another information display method according to an exemplary embodiment.

[0034] Figure 7 is a schematic diagram of another first page provided according to an exemplary embodiment.

[0035] Figure 8 The figure is a flow chart of another information display method according to an exemplary embodiment.

[0036] Fig. 9 is a schematic diagram of another first page provided according to an exemplary embodiment.

[0037] Fig.10 is a schematic diagram of another first page provided according to an exemplary embodiment.

[0038] Fig.11 is a schematic diagram of a third page provided according to an exemplary embodiment.

[0039] Fig.12 The figure is a flow chart of another information display method according to an exemplary embodiment.

[0040] Fig.13 The invention is a block diagram of an information display device according to an exemplary embodiment.

[0041] Fig.14 It is a block diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0042] In order to enable ordinary persons in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

[0043] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0044] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this disclosure are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions. For example, the images involved in this disclosure are all obtained with full authorization.

[0045] Figure 1 FIG. 1 is a schematic diagram of an implementation environment of an information display method according to an exemplary embodiment. Figure 1 The implementation environment specifically includes: an electronic device 101 and a server 102. The electronic device 101 can be connected to the server 102 via a wireless network or a wired network.

[0046] The electronic device 101 may be at least one of a smart phone, a smart watch, a desktop computer, a laptop computer, an MP3 player (Moving Picture Experts Group Audio Layer III), an MP4 player (Moving Picture Experts Group Audio Layer IV), and a laptop computer. An application may be installed and run on the electronic device 101, and the application is used to play multimedia resources. The application is associated with the server 102, and the server 102 provides background services to the electronic device 101.

[0047] The electronic device 101 may generally refer to one of a plurality of electronic devices, and this embodiment is illustrated by taking the electronic device 101 as an example. Those skilled in the art may know that the number of the electronic devices may be more or less. For example, the number of the electronic devices may be several, or the number of the electronic devices may be dozens or hundreds, or a greater number. The embodiment of the present disclosure does not limit the number and type of the electronic devices.

[0048] The server 102 is at least one of a single server, multiple servers, a cloud computing platform, and a virtualization center. Optionally, the number of the above servers may be more or less, which is not limited in the embodiments of the present disclosure. Of course, the server 102 may also include other functional servers to provide more comprehensive and diversified services. In some embodiments, the server 102 undertakes the main computing work, and the electronic device 101 undertakes the secondary computing work; or, the server 102 undertakes the secondary computing work, and the electronic device 101 undertakes the main computing work; or, the server 102 and the electronic device 101 use a distributed computing architecture for collaborative computing. The server 102 can be connected to the electronic device 101 and other electronic devices via a wireless network or a wired network. Optionally, the number of the above servers may be more or less, which is not limited in the embodiments of the present disclosure.

[0049] Figure 2 is a flow chart of an information display method according to an exemplary embodiment. Figure 2 As shown, the method is performed by an electronic device and includes the following steps:

[0050] In step S201, a first page is displayed, and the first page displays multimedia resources.

[0051] In the disclosed embodiments, the first page refers to the page that the user sees in the interactive interface of an application (such as a mobile phone APP, computer software), a website, or a terminal (such as a smart TV). Multimedia resources refer to information resources composed of a variety of different types of media elements. These media elements mainly include text, images, audio, video, etc. Optionally, the multimedia resource can also be a live video stream.

[0052] Among them, text is one of the most basic types of multimedia resources. Text can be used to convey concise and clear information, such as titles, slogans, and guides. Images are very intuitive multimedia resources. Images can be representative product pictures used in e-commerce applications to attract users to buy products; images can also be decorative background pictures to create a specific atmosphere. Audio resources can add atmosphere to the first page. Video is a dynamic multimedia resource. Video can show complex product features, exciting event content, or attractive storylines.

[0053] In step S202, in response to a pause operation on a multimedia resource, at least one piece of object information is displayed on a first page, each piece of object information is associated with an object identified from a target video frame, and the target video frame is a currently displayed video frame.

[0054] In the embodiments of the present disclosure, a multimedia resource is taken as an example. When watching a video, the user can trigger a command to pause the video playback by clicking a pause button on the playback interface, using a specific shortcut key (such as the space bar, which is the default pause / play switch in many players), inputting a specific gesture, or using a voice command (if the device supports the voice control function), etc., according to their own needs.

[0055] When the user pauses the video, the frame currently displayed on the playback interface is called the target video frame. By analyzing and processing the target video frame through computer vision technology, the various objects contained therein, such as people, objects, scene elements, etc., can be identified. The object information is obtained based on the analysis of the video content and will be presented to the user in a suitable form such as a list or card on the first page for the user to view. Optionally, the object information can be an object image containing the object, or an expression image of the object, or other information associated with the object, which is not limited in the embodiments of the present disclosure.

[0056] The disclosed embodiment provides an information display scheme, which can identify at least one object in the target video frame in the multimedia resource after triggering the pause operation, and can determine in real time at least one object in the target video frame, which may be an object of interest to the user. By displaying the object information associated with the object on the first page, the user can intuitively and quickly understand the object in the target video frame through the object information. Compared with the existing scheme, since the objects in the multimedia resources are diverse, the object information is also diverse, which enriches the content of the object information, makes it easier for users to obtain information that is useful to them, improves the efficiency of users in obtaining information, and thus improves the efficiency of human-computer interaction.

[0057] In some embodiments, in response to a pause operation on a multimedia resource, at least one piece of object information is displayed on a first page, including:

[0058] In response to a pause operation on the multimedia resource, performing object recognition on a target video frame to obtain at least one object in the target video frame;

[0059] Cropping at least one object from the target video frame to obtain at least one object image, each object image corresponding to one object;

[0060] At least one object image is displayed on the first page.

[0061] In the disclosed embodiment, by performing object recognition on the target video frame in the multimedia resource after the pause operation is triggered, at least one object in the target video frame can be determined in real time, and the object may be an object that the user is interested in. The object image is obtained by cropping the video frame, and the object image is displayed on the first page to assist in understanding the video content in an intuitive and visual form, so that the user can intuitively and quickly understand the object in the target video frame through the object image.

[0062] In some embodiments, the method further comprises:

[0063] In response to a triggering operation on any object image, a second page is displayed, where the second page displays a plurality of recommended objects similar to the object in the object image.

[0064] In the disclosed embodiment, by presenting multiple recommended objects similar to an object image after the user triggers it, the user's way of discovering related content is greatly expanded, the relevance and accuracy of content recommendations are enhanced, the user's efficiency in acquiring objects is improved, and the efficiency of human-computer interaction is thereby improved.

[0065] In some embodiments, the method further comprises:

[0066] In response to a triggering operation on any object image, an object detail page corresponding to the object image is displayed, where the object detail page is used to introduce detailed information of the object in the object image.

[0067] In the embodiments of the present disclosure, through the above-mentioned method, when the user triggers the image of an object of interest, detailed information of the object can be easily obtained, satisfying the user's need to further understand the object, enhancing the user's cognitive depth and interactive experience of the content, improving the user's efficiency in obtaining information, and improving the efficiency of human-computer interaction.

[0068] In some embodiments, in response to a pause operation on a multimedia resource, at least one piece of object information is displayed on a first page, including:

[0069] In response to a pause operation on the multimedia resource, performing object recognition on a target video frame to obtain at least one object in the target video frame;

[0070] For any object, based on the expression of the object, generating at least one expression image of the object;

[0071] At least one expression image of at least one object is displayed on the first page.

[0072] In the disclosed embodiment, by performing object recognition on the target video frame in the multimedia resource after the pause operation is triggered, at least one object in the target video frame can be determined in real time, and the object may be an object that the user is interested in. By generating an expression image based on the expression of the object and displaying it on the first page, the user can focus on the key object and expression at the moment of pause, enhance the understanding and memory of the video content, and make it easier for the user to obtain useful information through the object image, thereby improving the efficiency of the user in obtaining information, and further improving the efficiency of human-computer interaction.

[0073] In some embodiments, generating at least one expression image of the object based on the expression of the object includes:

[0074] Based on the expression of the object, an expression image of the object is generated according to different styles, and each style corresponds to at least one expression image.

[0075] In the disclosed embodiment, by generating a variety of expression images corresponding to the expressions of the objects in different styles, the presentation form and visual effects of the images are greatly enriched, satisfying the diverse aesthetic and usage needs of users, making it convenient for users to share or retain, and improving the efficiency of human-computer interaction.

[0076] In some embodiments, generating at least one expression image of the object based on the expression of the object includes:

[0077] Determine the emotional information of the object based on the object's expression;

[0078] Text related to emotion information is added to an object image including the object to obtain an expression image of the object.

[0079] In the disclosed embodiment, by determining the emotional information corresponding to the object's expression and adding relevant text, the emotional connotation conveyed by the expression image can be intuitively and accurately strengthened, the expression dimension of the image information is enriched, the efficiency of users in obtaining expression information is improved, and the efficiency of human-computer interaction is improved.

[0080] In some embodiments, the method further comprises:

[0081] Perform at least one of image recognition, text recognition and audio recognition on the multimedia resource to obtain at least one piece of introduction information, where the introduction information is used to introduce the multimedia resource;

[0082] At least one introductory message is displayed on the first page.

[0083] In the disclosed embodiment, by performing multiple identifications on multimedia resources to obtain introduction information and displaying it on the first page, users can quickly understand the core content of the resources, reduce the cost of obtaining key information, improve information acquisition efficiency, and attract users to further explore multimedia resources.

[0084] In some embodiments, the method further comprises:

[0085] In response to a triggering operation on any piece of introduction information, determining a multimedia segment corresponding to the introduction information;

[0086] Plays the multimedia resource from the beginning of the multimedia segment.

[0087] In the disclosed embodiment, by setting an interactive method of clicking on the introduction information to locate the multimedia clip, the user can quickly locate and directly view the corresponding key content based on the introduction information of interest, accurately meet the user's needs for specific information, improve the efficiency and experience of obtaining information, and improve the efficiency of human-computer interaction.

[0088] In some embodiments, the method further comprises:

[0089] Performing object recognition on multimedia resources to obtain multiple interactive objects in the multimedia resources;

[0090] Display multiple interactive objects on the first page.

[0091] In the disclosed embodiment, by performing object recognition on multimedia resources, interactive objects such as red envelopes and coupons can be accurately extracted from the rich information in the live broadcast room. Users can interact with these interactive objects by clicking, receiving, and other operations, which increases the fun of the live broadcast and user participation, improves the efficiency of users obtaining information, and improves the efficiency of human-computer interaction.

[0092] Above Figure 2 The figure shows a flow chart of an information display method of the present invention. The information display scheme provided by the present invention is further described below by taking the object information as an object image as an example. Figure 3 is a flowchart of another information display method according to an exemplary embodiment. Figure 3 The method is performed by an electronic device and comprises the following steps:

[0093] In step S301, a first page is displayed, and the first page displays multimedia resources.

[0094] In the embodiment of the present disclosure, this step is the same as the above step S201. Please refer to the description in the above step S201 and will not be repeated here.

[0095] In step S302, in response to the pause operation on the multimedia resource, object recognition is performed on the target video frame to obtain at least one object in the target video frame.

[0096] In the embodiments of the present disclosure, multimedia resources refer to resources that present information in various forms, including but not limited to text, images, audio, video, etc. Taking video as an example, the multimedia resource can convey rich content through dynamic images, sounds and other elements.

[0097] The user can temporarily stop the playing video and put it in a still picture state by specific operations, such as clicking the pause button on the video playback interface, using shortcut keys (such as the space bar can pause playback in most video players), inputting gestures, or using voice commands. Since the video is a dynamic picture formed by a series of continuous image frames played quickly, each frame contains the complete picture information of the video at a certain moment. When the user performs the pause operation, the frame of image currently displayed on the screen is the target video frame.

[0098] Among them, object recognition is a technology in the field of computer vision, which enables computer systems to understand the content in images or videos. Through algorithms and models, different objects or objects can be detected, classified and located from images or video frames. For example, people, animals, buildings, etc. in the picture can be identified. Through the calculation and analysis of object recognition, at least one object is finally determined from the target video frame. It should be noted that at least one means that a single object may be identified. For example, if there is only one person in the paused screen of the video, this person object is identified; multiple objects may also be identified. For example, if the paused screen is a classroom scene, multiple objects such as teachers, students, blackboards, tables and chairs may be identified.

[0099] In step S303, at least one object is cropped from the target video frame to obtain at least one object image, each object image corresponding to one object.

[0100] In the disclosed embodiment, after the target video frame is obtained, the cropping technology in computer vision is used to "cut" each object out of the entire video frame according to the position and boundary information of the previously identified object in the target video frame. That is, an image containing only specific objects is extracted from the target video frame. The target video frame is a zoo scene, in which there are monkeys, trees and fences. The objects of monkeys, trees and fences are determined by object recognition. Then, for each object, according to the contour range of the object in the picture, an image processing algorithm is used to crop the image of the monkey part from the entire video frame to obtain the object image of the monkey; in the same way, the trees and fences are cropped out separately to obtain corresponding object images of each.

[0101] Optionally, the above paragraph describes cropping an object according to its outline as an example. The object can also be cropped according to a preset size, or according to a preset shape, such as a square, by determining the minimum circumscribed square of the object and then cropping to obtain a square object image.

[0102] In step S304, at least one object image is displayed on the first page.

[0103] In the embodiment of the present disclosure, the at least one object image may be displayed around the multimedia resource, such as on the left side, right side, above or below the multimedia resource, etc., and the embodiment of the present disclosure is not limited to this.

[0104] For example, see Figure 4 As shown, Figure 4 is a schematic diagram of a first page provided according to an exemplary embodiment. Figure 4 As shown, a multimedia resource 401 is displayed in the first page, and the multimedia resource is in a paused state. The target video frame in the multimedia resource is currently displayed. The target video frame includes a person. By performing object recognition on the target video frame, three objects, namely, a coat, pants, and a handbag worn by the person, can be recognized, and then three object images 402 are displayed, which correspond to the above three objects respectively.

[0105] In step S305, in response to a triggering operation on any object image, a second page is displayed, where the second page displays a plurality of recommended objects similar to the object in the object image.

[0106] In the embodiments of the present disclosure, a trigger operation refers to an interactive action performed by a user in the first page, and the interactive action is initiated for a certain object image. Common trigger operations include clicking, long pressing, and double-clicking an object image. Among them, the second page is different from the first page in function and layout, and the second page is used to display specific content related to the object image targeted by the trigger operation, that is, multiple recommended objects. Recommended objects are other objects that have similar features to the objects in the object image that are screened out by a specific algorithm. These similar features may include appearance (such as shape, color, texture), function, category, etc. By presenting multiple recommended objects similar to the object image after the user triggers it, the way users discover related content is greatly expanded, the relevance and accuracy of content recommendations are enhanced, the efficiency of users acquiring objects is improved, and the efficiency of human-computer interaction is thereby improved.

[0107] For example, see Figure 5 As shown, Figure 5 is a schematic diagram of a second page provided according to an exemplary embodiment. Figure 5 As shown, the user triggers Figure 4 After the object image of the top is displayed, a second page is displayed, and the second page has images of multiple other tops similar to the top.

[0108] In some embodiments, when a user triggers an object image, the user can also view detailed information about the object. Accordingly, in response to a trigger operation on any object image, an object details page corresponding to the object image is displayed, and the object details page is used to introduce detailed information about the object in the object image. In the above manner, when a user triggers an object image of interest, detailed information about the object can be easily obtained, satisfying the user's need to further understand the object, enhancing the user's cognitive depth and interactive experience of the content, improving the efficiency of the user in obtaining information, and improving the efficiency of human-computer interaction.

[0109] The disclosed embodiment provides an information display scheme, which can identify at least one object in the target video frame in the multimedia resource in real time by performing object recognition on the target video frame after triggering the pause operation, and the object may be an object of interest to the user. The object image is obtained by cropping the video frame, and the object image is displayed on the first page, so as to assist in understanding the video content in an intuitive and visual form, so that the user can intuitively and quickly understand the object in the target video frame through the object image. Compared with the existing scheme, it makes it easier for users to obtain useful information through object images, improves the efficiency of users in obtaining information, and thus improves the efficiency of human-computer interaction.

[0110] The following takes the object information as an expression image as an example to further illustrate the information display scheme provided by the present disclosure. Figure 6 is a flowchart of another information display method according to an exemplary embodiment. Figure 6 The method is performed by an electronic device and comprises the following steps:

[0111] In step S601, a first page is displayed, and the first page displays multimedia resources.

[0112] In the embodiment of the present disclosure, this step is the same as the above step S201. Please refer to the description in the above step S201 and will not be repeated here.

[0113] In step S602, in response to the pause operation on the multimedia resource, object recognition is performed on the target video frame to obtain at least one object in the target video frame.

[0114] In the embodiment of the present disclosure, this step is the same as the above step S302. Please refer to the description in the above step S302 and will not be repeated here.

[0115] In step S603, for any object, at least one expression image of the object is generated based on the expression of the object.

[0116] In the disclosed embodiments, the object is an entity with expression features, usually referring to a person, an animal, or a cartoon character or virtual character with an anthropomorphic expression. Expression refers to a combination of features on the face of an object that can convey emotions, moods, or states, such as an upturned mouth and squinted eyes when happy, a furrowed brow and drooped mouth corners when sad, etc. An expression image is an image generated for a specific expression of the object. An expression image focuses on the expression features of the object and clearly displays the expression state of the object in the form of an image. Optionally, an expression image may also be referred to as an expression package. The expression image may be an image generated by taking a screenshot of the object's avatar and adding text, or it may be an image that stylizes the object and expresses the expression of the object.

[0117] In some embodiments, the electronic device can generate expression images of different styles. Accordingly, based on the expression of the object, at least one expression image of the object is generated, including: based on the expression of the object, the expression image of the object is generated in different styles, and each style corresponds to at least one expression image. By generating a variety of expression images corresponding to the expression of the object in different styles, the presentation form and visual effect of the image are greatly enriched, the user's diverse aesthetic and usage needs are met, the user is convenient to share or retain, and the efficiency of human-computer interaction is improved.

[0118] Among them, style refers to the characteristics and methods of artistic expression, which covers a variety of types. For example, the two-dimensional style has bright colors, simple and exaggerated lines, and characters with big eyes and small mouths, which often appear in animation works; the realistic style strives to accurately restore the real appearance and expression details of the object, just like photos in real life; there is also a retro style, which may be nostalgic in color matching, and the texture of the picture is similar to old photos or retro paintings, giving people a nostalgic feeling; the cartoon style is usually simple in shape, bright in color, and full of childlike image, which is common in children's animation and cartoon character design. In addition, there are simple style, hand-painted style, steampunk style, etc., each style has its own unique visual characteristics and expression methods.

[0119] Based on image processing technology, artificial intelligence algorithms or specific image generation tools, a new expression image can be created according to the expression of the object and the selected style. In the expression generation process, the features of the expression are extracted and analyzed, and then the expression is redrawn, rendered or synthesized according to the rules and characteristics of a specific style, so as to generate an expression image that conforms to the style.

[0120] In some embodiments, the electronic device can generate an expression image by adding text to an image. Accordingly, based on the expression of the object, generating at least one expression image of the object includes: determining the emotional information of the object based on the expression of the object; adding text related to the emotional information to the object image including the object to obtain the expression image of the object. By determining the emotional information corresponding to the expression of the object and adding relevant text, the emotional connotation conveyed by the expression image can be intuitively and accurately strengthened, the expression dimension of the image information is enriched, the efficiency of users obtaining expression information is improved, and the efficiency of human-computer interaction is improved.

[0121] Among them, the computer vision algorithm based on deep learning can perform a detailed analysis of the expression of the object. Based on the above analysis of the expression features, the emotion corresponding to the current expression of the object can be identified. This process involves comparing and matching the detected expression features with the annotated expression-emotion data to determine the emotional information of the object. After determining the emotional information of the object, text related to the emotional information is generated. For example, if the emotion of the object is identified as "happy", the relevant text can be "haha", "so happy", "great mood", etc. These texts can further strengthen and clarify the emotions expressed by the object in text form. Optionally, the selection or generation of text will take into account the specific context, the target audience, and the accuracy and vividness of the expression. Finally, the generated text is added to the object image containing the object. This process will be adjusted according to factors such as the font, color, size and position of the text to ensure that the text is coordinated with the overall style of the image and does not obstruct the key expression features of the object. For example, for an image of a happy expression of an animal in a cute style, a round and cute font can be selected, the color echoes the main color of the image, and the text is placed in a blank area of ​​the image, such as the bottom or corner of the picture, so as to synthesize the final expression image.

[0122] In step S604, at least one expression image of at least one object is displayed on the first page.

[0123] In the disclosed embodiment, at least one expression image is displayed on the first page. Among them, an object can have multiple expressions of different styles. Users can see the expression images of different objects at a glance without performing complex operations, so as to quickly obtain emotional information about these objects. By displaying the expression images of objects, clear operation instructions can be provided to users. For example, after seeing an expression image of interest, users can click to view more related expressions, or perform operations such as downloading, sharing, and making.

[0124] For example, see Figure 7 As shown, Figure 7 FIG. 1 is a schematic diagram of another first page provided according to an exemplary embodiment. Figure 7As shown, a multimedia resource 401 is displayed in the first page, and the multimedia resource is in a paused state. The target video frame in the multimedia resource is currently displayed. (a) shows that when the target video frame includes multiple people, one or more expression images of each person can be displayed. (b) shows that when the target video includes one person, expression images of different styles of the person can be displayed.

[0125] The disclosed embodiment provides an information display scheme, which can identify at least one object in the target video frame in the multimedia resource in real time by performing object recognition on the target video frame after triggering the pause operation, and the object may be an object of interest to the user. By generating an expression image based on the expression of the object and displaying it on the first page, the user can focus on the key object and expression at the moment of pause, and enhance the understanding and memory of the video content. Compared with the existing scheme, it makes it easier for users to obtain useful information through object images, improves the efficiency of users in obtaining information, and thus improves the efficiency of human-computer interaction.

[0126] The following takes displaying introduction information of multimedia resources as an example to further illustrate the information display scheme provided by the present disclosure. Figure 8 is a flowchart of another information display method according to an exemplary embodiment. Figure 8 The method is performed by an electronic device and comprises the following steps:

[0127] In step S801, a first page is displayed, and the first page displays multimedia resources.

[0128] In the embodiment of the present disclosure, this step is the same as the above step S201. Please refer to the description in the above step S201 and will not be repeated here.

[0129] In step S802, at least one of image recognition, text recognition and audio recognition is performed on the multimedia resource to obtain at least one piece of introduction information, where the introduction information is used to introduce the multimedia resource.

[0130] In the disclosed embodiments, image recognition is used to analyze the image part of multimedia resources. For example, in a video, image recognition technology can detect objects, people, scenes and other elements in the picture. By extracting and analyzing the features such as color, texture, shape, etc. in the image and comparing them with a huge image database, the content contained in the image can be determined.

[0131] Text recognition is used to identify text content that appears in multimedia resources. In a video, there may be text on subtitles and logos. Optionally, optical character recognition (OCR) is a commonly used text recognition technology that converts text in images or videos into editable text format. After recognizing the text, you can also analyze the text, such as extracting key information and judging the emotional tendency of the text.

[0132] Audio recognition is used to identify the sound part of multimedia resources. For the voice content in the video, audio recognition can convert it into text, which is the speech-to-text technology. Optionally, audio recognition can also identify the type of sound, such as whether the style of the background music is classical, rock or pop, and whether the ambient sound is rain, wind or car driving. By analyzing the audio features, the information conveyed by the audio can be determined.

[0133] It should be noted that, according to the type of multimedia resource, one or more of the above three identification methods can be selected for identification. Through one or more of the above identification methods, at least one introductory information about the multimedia resource can be obtained. For example, through image recognition, the main characters in the video can be known, through text recognition, the key lines in the video can be extracted, and through audio recognition, the background music style of the video can be determined. These information combined constitute an introduction to the multimedia resource.

[0134] For example, a multimedia resource is a cooking teaching video. Image recognition can accurately distinguish the various ingredients that appear in the teaching video. For example, it can identify the main ingredients such as fresh pork belly, green peppers, bright tomatoes, and auxiliary seasoning ingredients such as green onions, ginger, and garlic. As the teaching steps progress, image recognition captures the changes in the appearance of the dishes at different stages. From the initial cutting state of the ingredients, to the color change after cooking, to the appearance of the finished product when it is finally completed. If there are subtitles for step-by-step instructions in the teaching video, text recognition can quickly extract these key information. For example, "Cut the pork belly into small pieces of 2 cm square, put it in cold water, add ginger slices and cooking wine to remove the fishy smell", "Wait until the oil temperature is 70% hot, add peppercorns to stir-fry", etc. These texts clearly sort out the specific process and key points of cooking, which is convenient for users to quickly browse and remember, and can be accurately grasped in actual operation. Audio recognition can convert the voice of the chef or the narrator into text, fully presenting the detailed explanation of the cooking process. For example, explain "When frying fish, be sure to wait until the fish skin is golden and crispy before turning it over, so as to ensure the integrity of the fish and prevent it from breaking easily." Finally, generate introductory information in text form for users to read and learn.

[0135] In step S803, in response to a triggering operation on any piece of introduction information, a multimedia segment corresponding to the introduction information is determined.

[0136] In the disclosed embodiments, information describing the content of a multimedia resource is obtained by performing at least one of image recognition, text recognition, and audio recognition on a multimedia resource such as a cooking tutorial. For example, in a cooking tutorial, a text describing the cooking steps such as "cut the pork belly into small pieces and blanch it in cold water" is an introduction information.

[0137] When a user browses the introduction information of a multimedia resource and sees a piece of introduction information of interest, such as "add appropriate amount of soy sauce to stir-fry for coloring" in the introduction information of a cooking tutorial, the user clicks (or other set trigger operations) on this introduction information, and the electronic device can search for the part of the multimedia resource content closely related to the introduction information, thereby determining the corresponding multimedia segment.

[0138] In step S804, the multimedia resource is played from the starting position of the multimedia segment.

[0139] In the disclosed embodiments, the multimedia clip has a specific range in the entire multimedia resource, and the "starting position" refers to the time point or position mark where the multimedia clip starts in the complete multimedia resource. For example, the total duration of the cooking instruction video is 10 minutes, and the multimedia clip corresponding to the operation of "frying fish until both sides are golden brown" starts from the 3rd minute, then the 3rd minute is the starting position of the multimedia clip. After the starting position of the multimedia clip is determined, the entire multimedia resource is played from that position. This means that the user will see or hear that the video or audio is displayed in normal order from this key step. The purpose of this playback method is to enable users to accurately locate the content part they are interested in, and start immersive learning or viewing from this key node. Avoid users from looking for relevant content on their own in lengthy multimedia resources, saving time and improving the efficiency of obtaining information.

[0140] It should be noted that the first page also displays a View All button, and by clicking the View All button, all the introduction information can be viewed on the third page.

[0141] For example, see Fig. 9 As shown, Fig. 9 is a schematic diagram of another first page provided according to an exemplary embodiment, such as Fig. 9 As shown in FIG. 1 , during the cooking teaching video playing on the first page, multiple introduction messages are displayed on the right side of the first page. Each introduction message corresponds to a video clip. Fig.10 As shown, the user clicks on the third introduction information to jump to the video clip corresponding to the third introduction information. Fig.10 FIG. 1 is a schematic diagram of another first page provided according to an exemplary embodiment. The first page also displays a "All Tutorials" button. When the user clicks the button, Fig.11 As shown, the third page is displayed in a floating manner on the first page.

[0142] The disclosed embodiment provides an information display scheme, which can obtain introduction information through multiple identification of multimedia resources and display it on the first page, so that users can quickly understand the core content of the resources, reduce the cost of obtaining key information, improve the efficiency of information acquisition, and attract users to further explore multimedia resources. By setting an interactive mode of clicking on the introduction information to locate the multimedia clip, users can quickly locate and directly watch the corresponding key content based on the introduction information they are interested in, accurately meet the user's needs for specific information, improve the efficiency and experience of obtaining information, and improve the efficiency of human-computer interaction.

[0143] The information display scheme provided by the present disclosure is further described below by taking displaying multiple interactive objects in multimedia resources as an example. Fig.12 is a flowchart of another information display method according to an exemplary embodiment. Fig.12 The method is performed by an electronic device and comprises the following steps:

[0144] In step S1201, a first page is displayed, and the first page displays multimedia resources.

[0145] In the embodiment of the present disclosure, this step is the same as the above step S201. Please refer to the description in the above step S201 and will not be repeated here.

[0146] In step S1202, object recognition is performed on the multimedia resource to obtain a plurality of interactive objects in the multimedia resource.

[0147] In the embodiment of the present disclosure, object recognition for multimedia resources is similar to object recognition for target video frames, see the description in the above step S302, which will not be repeated here.

[0148] Among them, interactive objects refer to elements that users can interact with in the live broadcast scene. For example, in the live broadcast room, red envelopes and coupons are common interactive objects. By analyzing the multimedia resource screen, the visual features of the red envelope, such as the shape, color, and specific logo of the red envelope, are identified. For example, the common red envelopes in the live broadcast room usually have a red appearance and may be marked with the word "red envelope". Object recognition technology can capture these features, thereby determining that the red envelope in the picture is an interactive object. Similarly, with the help of image recognition technology, the pattern, text information and other features of the coupon are identified. For example, the coupon may be printed with text such as the discount amount, conditions of use, validity period, and a unique design pattern. By analyzing and judging these features, it is identified as an interactive object. Optionally, it may also be combined with audio recognition to assist in confirming the coupon as an interactive object when the host verbally introduces the coupon.

[0149] By performing object recognition on multimedia resources, interactive objects such as red envelopes and coupons can be accurately extracted from the rich information in the live broadcast room. Users can interact with these interactive objects by clicking, receiving, and other operations, which increases the fun of live broadcasts and user participation, improves the efficiency of users obtaining information, and improves the efficiency of human-computer interaction.

[0150] In step S1203, a plurality of interactive objects are displayed on the first page.

[0151] In the embodiment of the present disclosure, the multiple interactive objects are displayed around the multimedia resource, such as on the left side, right side, above or below the multimedia resource, etc., and the embodiment of the present disclosure is not limited to this.

[0152] It should be noted that by clicking on an interactive object, the user can obtain the virtual resources corresponding to the interactive object, such as clicking on a red envelope to receive the virtual resources in the red envelope, and clicking on a coupon to receive a virtual coupon.

[0153] The disclosed embodiments provide an information display solution, which performs object recognition on multimedia resources and can accurately extract interactive objects such as red envelopes and coupons from the rich information in the live broadcast room. Users can interact with these interactive objects by clicking, receiving, and other operations, which increases the fun of live broadcasts and user participation, improves the efficiency of users obtaining information, and improves the efficiency of human-computer interaction.

[0154] Fig.13 FIG. 1 is a block diagram of an information display device according to an exemplary embodiment. Fig.13 As shown, the device includes: a first display unit 1301 and a second display unit 1302.

[0155] The first display unit 1301 is configured to display a first page, where the first page displays multimedia resources;

[0156] The second display unit 1302 is configured to display at least one piece of object information on the first page in response to a pause operation on the multimedia resource, each piece of object information being associated with an object identified from a target video frame, where the target video frame is a currently displayed video frame.

[0157] In some embodiments, the second display unit 1302 is configured to, in response to a pause operation on a multimedia resource, perform object recognition on a target video frame to obtain at least one object in the target video frame; crop at least one object from the target video frame to obtain at least one object image, each object image corresponding to an object; and display at least one object image on a first page.

[0158] In some embodiments, the second display unit 1302 is further configured to display a second page in response to a triggering operation on any object image, wherein the second page displays a plurality of recommended objects similar to the object in the object image.

[0159] In some embodiments, the second display unit 1302 is further configured to display an object detail page corresponding to an object image in response to a trigger operation on any object image, where the object detail page is used to introduce detailed information of the object in the object image.

[0160] In some embodiments, the second display unit 1302 is configured to perform object recognition on the target video frame in response to a pause operation on the multimedia resource to obtain at least one object in the target video frame; for any object, generate at least one expression image of the object based on the expression of the object; and display at least one expression image of at least one object on the first page.

[0161] In some embodiments, the second display unit 1302 is configured to generate an expression image of the object in different styles based on the expression of the object, and each style corresponds to at least one expression image.

[0162] In some embodiments, the second display unit 1302 is configured to determine the emotional information of the object based on the expression of the object; add text related to the emotional information to the object image including the object to obtain the expression image of the object.

[0163] In some embodiments, the second display unit 1302 is further configured to perform at least one of image recognition, text recognition, and audio recognition on the multimedia resource to obtain at least one introduction information, which is used to introduce the multimedia resource; and display at least one introduction information on the first page.

[0164] In some embodiments, the second display unit 1302 is further configured to determine the multimedia segment corresponding to the introduction information in response to a triggering operation on any piece of introduction information; and play the multimedia resource from the starting position of the multimedia segment.

[0165] In some embodiments, the second display unit 1302 is further configured to perform object recognition on the multimedia resource to obtain a plurality of interactive objects in the multimedia resource; and display the plurality of interactive objects on the first page.

[0166] The disclosed embodiment provides an information display device, which can identify at least one object in the target video frame in the multimedia resource in real time by performing object recognition on the target video frame in the multimedia resource after triggering the pause operation. The object may be an object of interest to the user. The object image is obtained by cropping the video frame, and the object image is displayed on the first page, so as to assist in understanding the video content in an intuitive and visual form, so that the user can intuitively and quickly understand the object in the target video frame through the object image. Compared with the existing solution, it makes it easier for the user to obtain useful information through the object image, improves the efficiency of the user in obtaining information, and thus improves the efficiency of human-computer interaction.

[0167] It should be noted that the information display device provided in the above embodiment is only illustrated by the division of the above functional units. In actual applications, the above functions can be assigned to different functional units as needed, that is, the internal structure of the electronic device is divided into different functional units to complete all or part of the functions described above. In addition, the information display device provided in the above embodiment and the information display method embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0168] Regarding the information display device in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0169] In the embodiments of the present disclosure, the electronic device may be a terminal or a server. When the electronic device is a terminal, the terminal is used as an execution subject to implement the technical solution provided in the embodiments of the present disclosure; when the electronic device is a server, the server is used as an execution subject to implement the technical solution provided in the embodiments of the present disclosure; or, the technical solution provided in the present disclosure is implemented through interaction between the terminal and the server. The embodiments of the present disclosure are not limited to this.

[0170] Fig.14 14 is a block diagram of an electronic device according to an exemplary embodiment. Generally, the electronic device 1400 includes: a processor 1401 and a memory 1402 .

[0171] The processor 1401 may include one or more processing cores, such as a 4-core processor, an 8-core processor, etc. The processor 1401 may be implemented in at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array). The processor 1401 may also include a main processor and a coprocessor. The main processor is a processor for processing data in the awake state, also known as a CPU (Central Processing Unit); the coprocessor is a low-power processor for processing data in the standby state. In some embodiments, the processor 1401 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content to be displayed on the display screen. In some embodiments, the processor 1401 may also include an AI (Artificial Intelligence) processor, which is used to process computing operations related to machine learning.

[0172] The memory 1402 may include one or more computer-readable storage media, which may be non-transitory. The memory 1402 may also include a high-speed random access memory, and a non-volatile memory, such as one or more disk storage devices, flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 1402 is used to store at least one program code, which is used to be executed by the processor 1401 to implement the information display method provided in the method embodiment of the present disclosure.

[0173] In some embodiments, the electronic device 1400 may further optionally include: a peripheral device interface 1403 and at least one peripheral device. The processor 1401, the memory 1402 and the peripheral device interface 1403 may be connected via a bus or a signal line. Each peripheral device may be connected to the peripheral device interface 1403 via a bus, a signal line or a circuit board. Specifically, the peripheral device includes: at least one of a radio frequency circuit 1404, a display screen 1405, a camera assembly 1406, an audio circuit 1407 and a power supply 1408.

[0174] The peripheral device interface 1403 may be used to connect at least one peripheral device related to I / O (Input / Output) to the processor 1401 and the memory 1402. In some embodiments, the processor 1401, the memory 1402, and the peripheral device interface 1403 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 1401, the memory 1402, and the peripheral device interface 1403 may be implemented on a separate chip or circuit board, which is not limited in this embodiment.

[0175] The radio frequency circuit 1404 is used to receive and transmit RF (Radio Frequency) signals, also known as electromagnetic signals. The radio frequency circuit 1404 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 1404 converts the electrical signal into an electromagnetic signal for transmission, or converts the received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1404 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, and the like. The radio frequency circuit 1404 can communicate with other electronic devices through at least one wireless communication protocol. The wireless communication protocol includes, but is not limited to: a metropolitan area network, various generations of mobile communication networks (2G, 3G, 4G and 5G), a wireless local area network and / or a WiFi (Wireless Fidelity) network. In some embodiments, the radio frequency circuit 1404 may also include circuits related to NFC (Near Field Communication), which is not limited in the present disclosure.

[0176] The display screen 1405 is used to display a UI (User Interface). The UI may include graphics, text, icons, videos, and any combination thereof. When the display screen 1405 is a touch display screen, the display screen 1405 also has the ability to collect touch signals on the surface or above the surface of the display screen 1405. The touch signal can be input to the processor 1401 as a control signal for processing. At this time, the display screen 1405 can also be used to provide virtual buttons and / or virtual keyboards, also known as soft buttons and / or soft keyboards. In some embodiments, the display screen 1405 can be one, and the front panel of the electronic device 1400 is set; in other embodiments, the display screen 1405 can be at least two, which are respectively set on different surfaces of the electronic device 1400 or are folded; in some other embodiments, the display screen 1405 can be a flexible display screen, which is set on the curved surface or folded surface of the electronic device 1400. Even, the display screen 1405 can also be set to a non-rectangular irregular shape, that is, a special-shaped screen. The display screen 1405 can be made of materials such as LCD (Liquid Crystal Display) and OLED (Organic Light-Emitting Diode).

[0177] The camera assembly 1406 is used to capture images or videos. Optionally, the camera assembly 1406 includes a front camera and a rear camera. Typically, the front camera is arranged on the front panel of the electronic device, and the rear camera is arranged on the back of the electronic device. In some embodiments, there are at least two rear cameras, which are any one of a main camera, a depth of field camera, a wide-angle camera, and a telephoto camera, so as to realize the fusion of the main camera and the depth of field camera to realize the background blur function, the fusion of the main camera and the wide-angle camera to realize panoramic shooting and VR (Virtual Reality) shooting function or other fusion shooting functions. In some embodiments, the camera assembly 1406 may also include a flash. The flash can be a monochrome temperature flash or a dual-color temperature flash. A dual-color temperature flash refers to a combination of a warm light flash and a cold light flash, which can be used for light compensation at different color temperatures.

[0178] The audio circuit 1407 may include a microphone and a speaker. The microphone is used to collect sound waves from the user and the environment, and convert the sound waves into electrical signals and input them into the processor 1401 for processing, or input them into the radio frequency circuit 1404 to achieve voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the electronic device 1400. The microphone may also be an array microphone or an omnidirectional acquisition microphone. The speaker is used to convert the electrical signal from the processor 1401 or the radio frequency circuit 1404 into sound waves. The speaker may be a traditional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, it can not only convert the electrical signal into sound waves audible to humans, but also convert the electrical signal into sound waves inaudible to humans for purposes such as ranging. In some embodiments, the audio circuit 1407 may also include a headphone jack.

[0179] The power supply 1408 is used to power various components in the electronic device 1400. The power supply 1408 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power supply 1408 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

[0180] Those skilled in the art will understand that Fig.14 The structure shown in the figure does not constitute a limitation on the electronic device 1400, and may include more or less components than those shown in the figure, or combine certain components, or adopt a different component arrangement.

[0181] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory 1402 including instructions, and the instructions can be executed by a processor 1401 of an electronic device 1400 to complete the above information display method. Alternatively, the computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0182] A computer program product includes a computer program, and the computer program implements the above information display method when executed by a processor.

[0183] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0184] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. An information display method, characterized in that: The method comprises: Displaying a first page, wherein the first page displays multimedia resources; In response to a pause operation on the multimedia resource, at least one piece of object information is displayed on the first page, each piece of object information is associated with an object identified from a target video frame, and the target video frame is a currently displayed video frame.

2. The information display method according to claim 1, characterized in that: The step of displaying at least one piece of object information on the first page in response to the pause operation on the multimedia resource comprises: In response to a pause operation on the multimedia resource, performing object recognition on the target video frame to obtain at least one object in the target video frame; Cropping the at least one object from the target video frame to obtain at least one object image, each object image corresponding to one object; The at least one object image is displayed on the first page.

3. The information display method according to claim 2, characterized in that: The method further comprises: In response to a triggering operation on any object image, a second page is displayed, wherein the second page displays a plurality of recommended objects similar to the object in the object image.

4. The information display method according to claim 2, characterized in that: The method further comprises: In response to a triggering operation on any object image, an object detail page corresponding to the object image is displayed, wherein the object detail page is used to introduce detailed information of the object in the object image.

5. The information display method according to claim 1, characterized in that: The step of displaying at least one piece of object information on the first page in response to the pause operation on the multimedia resource comprises: In response to a pause operation on the multimedia resource, performing object recognition on the target video frame to obtain at least one object in the target video frame; For any object, based on the expression of the object, generating at least one expression image of the object; At least one expression image of the at least one object is displayed on the first page.

6. The information display method according to claim 5, characterized in that: The step of generating at least one expression image of the object based on the expression of the object comprises: Based on the expression of the object, an expression image of the object is generated in different styles, and each style corresponds to at least one expression image.

7. The information display method according to claim 5, characterized in that: The step of generating at least one expression image of the object based on the expression of the object comprises: Determining emotional information of the object based on the expression of the object; Text related to the emotion information is added to an object image including the object to obtain an expression image of the object.

8. The information display method according to claim 1, characterized in that: The method further comprises: Perform at least one of image recognition, text recognition and audio recognition on the multimedia resource to obtain at least one piece of introduction information, where the introduction information is used to introduce the multimedia resource; The at least one piece of introduction information is displayed on the first page.

9. The information display method according to claim 8, characterized in that: The method further comprises: In response to a triggering operation on any piece of introduction information, determining a multimedia segment corresponding to the introduction information; The multimedia resource is played from the starting position of the multimedia segment.

10. The information display method according to claim 1, characterized in that: The method further comprises: Performing object recognition on the multimedia resource to obtain a plurality of interactive objects in the multimedia resource; The multiple interactable objects are displayed on the first page.

11. An information display device, characterized in that: The device comprises: A first display unit is configured to display a first page, wherein the first page displays multimedia resources; The second display unit is configured to display at least one object information on the first page in response to a pause operation on the multimedia resource, each object information being associated with an object identified from a target video frame, the target video frame being a currently displayed video frame.

12. An electronic device, characterized in that: The electronic device comprises: one or more processors; a memory for storing program code executable by the processor; The processor is configured to execute the program code to implement the information display method according to any one of claims 1 to 10.

13. A computer-readable storage medium, characterized in that: When the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the information display method according to any one of claims 1 to 10.

14. A computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the information display method according to any one of claims 1 to 10 is implemented.

Images