Search result display method, device, readable medium and electronic device

JP7638305B2Active Publication Date: 2025-03-03DOUYIN VISION CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2022577246
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-08-27
Filing Date
2021-08-18
Publication Date
2025-03-03
Estimated Expiration
2041-08-18

Smart Images

  • Figure 0007638305000001
    Figure 0007638305000001
  • Figure 0007638305000002
    Figure 0007638305000002
  • Figure 0007638305000003
    Figure 0007638305000003
Patent Text Reader

Abstract

The present disclosure relates to a search result display method, device, readable medium and electronic device, the search result display method including: in response to a search command for a target entity object, obtaining at least one multimedia resource displaying the use effect of the target entity object, the multimedia resource being obtained based on multimedia content corresponding to the target entity object; and displaying the at least one multimedia resource.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention claims priority to a Chinese patent application bearing application number 202010879294.5, filed with the China Patent Office on August 27, 2020, the entire contents of which are incorporated herein by reference.

[0002] The present disclosure relates to the technical field of electronic information, for example, to a method, an apparatus, a readable medium, and an electronic device for displaying search results. [Background technology]

[0003] With the development of terminal technology and image processing technology, when a user shoots a video using a terminal device, the user can perform various processes on the video, such as adding subtitles, background music, and using special effects, tools, etc. on the video. When the user selects a target effect object to be used, the user can search for videos using the target effect object for reference. After the user issues a search command, the search result he sees is usually a video thumbnail of the video, and the video thumbnail is always generated randomly, so the user cannot obtain useful information from the video thumbnail, and the effectiveness of the search is low. In addition, the user needs to watch other videos completely to know the actual effect of the target process, which consumes data traffic. Summary of the Invention [Means for solving the problem]

[0004] The present disclosure relates to In response to a search command for a target entity object, obtain at least one multimedia resource for displaying a usage effect of the target entity object, the multimedia resource being obtained based on a multimedia content corresponding to the target entity object; displaying the at least one multimedia resource. Provide a way to display search results.

[0005] The present disclosure relates to receiving a search command for a target entity object and determining multimedia content corresponding to the target entity object; Determine search result information according to the multimedia content corresponding to the target entity object, and the search result information includes at least one multimedia resource for displaying the use effect of the target entity object, or at least one set of multimedia data, or at least one resource indication information, wherein the multimedia data is image frame data using the tag of the target entity object in the multimedia content, and the resource indication information is used to indicate a segment in which the target entity object appears in the multimedia content; and transmitting the search result information to a terminal device.

[0006] The present disclosure relates to an acquisition module configured to acquire at least one multimedia resource displaying a usage effect of the target entity object in response to a search command for the target entity object, the multimedia resource being obtained based on a multimedia content corresponding to the target entity object; A display module configured to display the at least one multimedia resource is provided.

[0007] The present disclosure relates to a receiving module configured to receive a search command for a target entity object and determine multimedia content corresponding to the target entity object; A determination module configured to determine search result information based on multimedia content corresponding to the target entity object, the search result information including at least one multimedia resource for displaying a usage effect of the target entity object, or at least one set of multimedia data, or at least one resource indication information, the multimedia data being image frame data using a tag of the target entity object in the multimedia content, and the resource indication information being used to indicate a segment in which the target entity object appears in the multimedia content; A sending module configured to send the search result information to a terminal device is provided.

[0008] The present disclosure relates to A computer-readable medium having a computer program stored thereon, A computer readable medium is provided which, when executed by a processor, implements a first type of method as described in the present disclosure.

[0009] The present disclosure relates to A storage device in which a computer program is stored; and a processing device configured to execute the computer program in the storage device so as to implement a first type of method according to the present disclosure.

[0010] The present disclosure relates to A computer-readable medium having a computer program stored thereon, A computer readable medium is provided which, when executed by a processor, implements a second type of method as described in the present disclosure.

[0011] The present disclosure relates to A storage device in which a computer program is stored; and a processing device configured to execute the computer program in the storage device so as to implement a second type of method according to the present disclosure. [Brief description of the drawings]

[0012] [Figure 1] FIG. 2 is a schematic diagram showing the arrangement of terminal devices and servers. [Diagram 2] 1 is a flowchart of a method for displaying search results according to one exemplary embodiment. [Diagram 3] FIG. 2 is a schematic diagram of display search results according to one exemplary embodiment. [Figure 4] 11 is a flowchart of another search result display method according to an exemplary embodiment. [Diagram 5] 11 is a flowchart of another search result display method according to an exemplary embodiment. [Figure 6] 11 is a flowchart of another search result display method according to an exemplary embodiment. [Figure 7] 11 is a flowchart of another search result display method according to an exemplary embodiment. [Figure 8] FIG. 2 is a schematic diagram of display search results according to one exemplary embodiment. [Figure 9] 1 is a flowchart of a method for displaying search results according to one exemplary embodiment. [Figure 10] 11 is a flowchart of another search result display method according to an exemplary embodiment. [Figure 11] 11 is a flowchart of another search result display method according to an exemplary embodiment. [Figure 12] 11 is a flowchart of another search result display method according to an exemplary embodiment. [Figure 13] 11 is a flowchart of another search result display method according to an exemplary embodiment. [Figure 14] FIG. 2 is a block diagram of a display device for search results according to one exemplary embodiment. [Figure 15] FIG. 11 is a block diagram of another search result display device according to one exemplary embodiment. [Figure 16] FIG. 11 is a block diagram of another search result display device according to one exemplary embodiment. [Figure 17] FIG. 11 is a block diagram of another search result display device according to one exemplary embodiment. [Figure 18] FIG. 2 is a block diagram of a display device for search results according to one exemplary embodiment. [Figure 19] FIG. 1 is a block diagram of an electronic device according to one example embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] Hereinafter, the embodiments of the present disclosure will be described with reference to the drawings. Although the drawings show some embodiments of the present disclosure, the present disclosure can be realized in various forms and should not be construed as being limited to the embodiments described herein, but on the contrary, these embodiments are provided for understanding the present disclosure. The drawings and embodiments of the present disclosure are merely illustrative and are not intended to limit the scope of protection of the present disclosure.

[0014] The steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. Also, method embodiments may include additional steps and / or steps that are shown omitted from the execution. The scope of the present disclosure is not limited in this respect.

[0015] As used herein, the term "comprising" and variations thereof are open inclusive, i.e., "including, but not limited to." The term "based on" means "based at least in part on." The term "one embodiment" refers to "at least one embodiment." The term "another embodiment" refers to "at least one other embodiment." The term "some embodiments" refers to "at least some embodiments." Relevant definitions of other terms are provided below in the description.

[0016] The concepts of "first", "second", etc. referred to in this disclosure are merely intended to distinguish different devices, modules or units, and are not intended to limit the order or interdependence of functions performed by these devices, modules or units.

[0017] The modifications "a" and "a plurality" referred to in this disclosure are exemplary but not limiting and should be understood as "one or more" unless the context clearly indicates otherwise.

[0018] The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of these messages or information.

[0019] Before describing the search result display method, device, readable medium, and electronic device according to the present disclosure, application scenarios according to several embodiments of the present disclosure will be described. The application scenario may include a terminal device and a server, and data transmission can be performed between the terminal device and the server. Here, the terminal device may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, personal digital assistants (PDA), tablet computers (Portable Android Devices, PAD), portable multimedia players (Portable Media Players, PMP), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital televisions (TV), desktop computers, and the like. The server may include, but is not limited to, for example, an entity server, a server cluster, or a cloud server, and the like. In the implementation scenario, as shown in FIG. 1, one or more terminal devices may be included.

[0020] FIG. 2 is a flowchart of a method for displaying search results according to an exemplary embodiment. As shown in FIG. 2, the method includes the following steps:

[0021] In step 101, in response to a search command for a target entity object, at least one multimedia resource for displaying a usage effect of the target entity object is obtained, where the multimedia resource is obtained based on a multimedia content corresponding to the target entity object.

[0022] For example, the execution subject of the method may be a terminal device, and when a user wants to search for a target entity object, the terminal device can input a search command, and the search command includes a search keyword corresponding to the target entity object. Here, the entity object can be understood as an object included in the multimedia content (e.g., a video), and the target entity object may be any entity object. The entity objects included in the multimedia content can be divided into two types: content entity objects and operation entity objects. The content entity object is used to indicate the content included in one or more image frames in the multimedia content, and may be, for example, a person, a car, a mountain, a lake, a sea, a cat, a dog, a rabbit, etc. The content entity object can also be used to indicate the emotional style of the content included in one or more image frames in the multimedia content, and may be, for example, a highlight content, a warm content, an emotional content, etc. For example, if the content included in multiple image frames belongs to a warm style, the content entity objects included in these image frames are "warm content", and the emotional style of the content included in the image frames may be automatically recognized by the terminal device or may be marked by the user as necessary, and the present disclosure is not limited thereto. The operation entity object is used to indicate an operation included in one or more image frames in the multimedia content, and may include, for example, facial beautification effect, skin beautification effect, baby face tool, cat face tool, subtitle specification, background music specification, etc. For example, if the target entity object is "baby face tool" and the search command is "how to use the baby face tool", the search command includes a search keyword "baby face tool" corresponding to the target entity object.

[0023] The terminal device can send a search command to the server, and after receiving the search command, the server analyzes the search command, obtains a search keyword contained in the search command, and determines a target entity object that matches the search keyword. It can be understood that the server stores multiple entity objects in advance, determines the matching degree between the search keyword and each entity object, and sets one or more entity objects with the highest matching degree as the target entity object. The search keyword may be one or more, and similarly, the target entity object may be one or more.

[0024] After determining the target entity object, the server can search for multimedia content corresponding to the target entity object from a large amount of multimedia content pre-stored in the server, and the multimedia content corresponding to the target entity object can be understood as multimedia content using the target entity object or multimedia content in which the target entity object appears. The server can determine search result information based on the multimedia content corresponding to the target entity object, and transmit the search result information to the terminal device.

[0025] The terminal device can obtain at least one multimedia resource capable of displaying the use effect of the target entity object according to the search result information. Here, the search result information may include at least one multimedia resource displaying the use effect of the target entity object, and correspondingly, the terminal device can directly obtain the multimedia resource from the search result information. Or, the search result information may include at least one set of multimedia data, where the multimedia data is image frame data using the tag of the target entity object in the multimedia content, and correspondingly, the terminal device can generate the multimedia resource displaying the use effect of the target entity object according to the multimedia data. Or, the search result information may include at least one resource indication information, where the resource indication information is used to indicate a segment in which the target entity object appears in the multimedia content, and correspondingly, the terminal device can obtain the multimedia data from the server according to the resource indication information, and then generate the multimedia resource displaying the use effect of the target entity object according to the multimedia data.

[0026] The multimedia content is a multimedia file with complete content and long duration, such as a video, audio, etc. file, and the multimedia resource is derived from a part in the multimedia content closely related to the target entity object, such as an animated image or a short video segment. The multimedia resource may be generated based on one or more image frames using the target entity object in the multimedia content, and the use effect of the target entity object can be intuitively displayed. Take the target entity object as a "cat face tool" and the multimedia content as a video, for example, when the "cat face tool" is used within a time period from 10s to 27s in the multimedia content, the multimedia resource may be an animated image generated based on the image frames within a time period from 10s to 27s in the multimedia content. Compared with the multimedia content, the amount of data included in the multimedia resource is small, and the use effect of the target entity object can be intuitively displayed, thereby reducing the consumption of data traffic.

[0027] The multimedia content is stored in a server and may be uploaded to the server by a user in advance or may be captured by the server from a network. The present disclosure does not limit the origin of the multimedia content, and the format of the multimedia content may be, for example, a video file (e.g., .avi, .mp4, .wmv, .rmvb, .3gp, .mov, .asf file) or an audio file (e.g., .mp3, .wav, .flac file). The multimedia resource is obtained based on the multimedia content corresponding to the target entity object, and may be, for example, an animated image or a video segment. The animated image may be understood as an animated image obtained by cutting out a certain number of image frames from the multimedia content and stitching them in a preset time order, and may be, for example, an animated image in .gif format. The video segment may be understood as a video obtained by cutting out a certain number of image frames from the multimedia content and stitching them in a preset time order, and may be, for example, a video file in a format such as .avi, .mp4, .wmv, .rmvb, .3gp, .mov, .asf, etc.

[0028] In step 102, at least one multimedia resource is displayed.

[0029] Exemplarily, after obtaining at least one multimedia resource, the at least one multimedia resource can be displayed on a display interface (e.g., a display screen) of a terminal device as a display result corresponding to a search command. All multimedia resources can be displayed on the display interface, and a specified number (e.g., 3) of multimedia resources can also be displayed. Different display manners can be determined for different formats of multimedia resources. For example, if the multimedia resource is a video, the multimedia resource can be displayed in a first preset manner, and the first preset manner includes any of loop play, reverse play, double speed play, and window play. Here, loop play can be understood as repeatedly playing a video. Reverse play can be understood as playing a video from the last image frame to the first image frame, and the video can also be repeatedly played in reverse. Double speed play can be understood as adjusting the playback speed of the video, which may be, for example, 0.5x speed, 1.25x speed, 2x speed, etc. Window playback can be understood as creating a new window on the display interface and displaying the video in this window, for example, three videos are displayed on the display interface, and when the user's finger moves to the position where the first video is displayed, a new window pops up to display the first video. If the multimedia resource is an animated image, the multimedia resource can be displayed in a second preset manner, and the second preset manner includes enlarged display or reduced display, and the enlarged display can be understood as enlarging and sequentially displaying each image frame included in the animated image, and the reduced display can be understood as sequentially displaying each image frame included in the animated image. For example, three animated images are displayed on the display interface, and when the user's finger moves to the position where the second animated image is displayed, the second animated image is enlarged or reduced.

[0030] Taking the search command as an example that the search command is "rabbit ear effect", the terminal device sends the search command to the server. The server analyzes "rabbit ear effect" and obtains the search keyword "rabbit ear". The server finds multimedia content using "rabbit ear" from pre-stored videos, including video 1, video 2 and video 3. The server determines the search result information of "rabbit ear" according to video 1, video 2 and video 3, and sends the search result information to the terminal device. The terminal device obtains a multimedia resource that can display the use effect of "rabbit ear" according to the search result information. For example, the multimedia resource may include A.gif corresponding to video 1, B.gif corresponding to video 2, and C.gif corresponding to video 3. Display the multimedia resource on the display screen of the terminal device. In the embodiment of the present disclosure, A.gif, B.gif, and C.gif can be displayed on the display screen, as shown in FIG. 3. Because A.gif, B.gif, and C.gif can display the use effect of "rabbit ears", users can intuitively see the use effect of the "rabbit ear tool", effectively improving the search effectiveness, and users no longer need to click and watch the complete video 1, video 2 and video 3 respectively, greatly reducing the consumption of data traffic.

[0031] In summary, the present disclosure is to obtain at least one multimedia resource for displaying the use effect of the target entity object in response to a search command for the target entity object, and the multimedia resource is obtained based on the multimedia content corresponding to the target entity object, and display the at least one multimedia resource. The present disclosure obtains, for each search command for a different target entity object, a multimedia resource capable of displaying the use effect of the target entity object based on the multimedia content corresponding to the target entity object, and displays the multimedia resource, without the need to display the complete multimedia content, which can improve the effectiveness of the search and reduce the consumption of data traffic.

[0032] FIG. 4 is a flowchart of another search result display method according to an exemplary embodiment, as shown in FIG. 4, the method may further include the following steps.

[0033] In step 103, at least one entity object used in the multimedia content and the usage time information of each entity object are recorded.

[0034] In step 104, the multimedia content and attribute information of the multimedia content are sent to the server, where the attribute information of the multimedia content includes identification information and use time information of each entity object.

[0035] In one implementation, the terminal device can use various entity objects in the multimedia content during the process of shooting the multimedia content or after the shooting of the multimedia content is finished, for example, can add subtitles, background music to the multimedia content, can use special effects, tools, etc. to the video, and can also directly add content tags corresponding to different contents to the multimedia content. The terminal device can record each entity object used in the multimedia content and the use time information corresponding to each entity object. The use time information may include the time (e.g., start time and end time) when the entity object is used in the multimedia content, or the number of the image frame (e.g., start frame number and end frame number) when the entity object is used in the multimedia content. The terminal device can transmit the identification information of each entity object (the identification information can uniquely identify the corresponding entity object) and the use time information of each entity object to the server together with the multimedia content as the attribute information of the multimedia content. After receiving, the server can determine a mapping relationship between the entity object identification information and the image frame information based on the identification information of each entity object and the use time information of each entity object, where the image frame information represents a segment in which each entity object appears in the multimedia content. A mapping relationship stores a number of records, each of which stores one entity object and the segment in which the entity object appears in the multimedia content.

[0036] The implementation of step 101 will be described below for different scenes in which multimedia resources are acquired.

[0037] Scene 1, the multimedia resource can be obtained as follows: The server determines target entity object identification information corresponding to a target entity object from the identification information of a plurality of entity objects stored in advance, and determines image frame information of the target entity object according to the mapping relationship between the entity object identification information and the image frame information. The image frame information of the target entity object can indicate a segment in which the target entity object appears in the multimedia content. Here, the image frame information can be understood as time information (e.g., 5s to 25s) corresponding to an image frame using the target entity object in the multimedia content, and may also be frame number information (e.g., the 20th frame to the 50th frame) corresponding to an image frame using the target entity object in the multimedia content. The server extracts a segment in which the target entity object appears in the multimedia content from the multimedia content according to the image frame information of the target entity object, thereby generating a multimedia resource that can display the use effect of the target entity object. In such a scene, the terminal device can directly obtain the multimedia resource from the server. The image frame information of the target entity object may indicate consecutive image frames in the multimedia content (which may be understood as all image frames using the target entity object) or may indicate non-consecutive image frames (which may be understood as key image frames using the target entity object).

[0038] For example, if the target video is video 1 and the target entity object is “beautiful skin effect”, the server can select image frames in which the “beautiful skin effect tag” appears from video 1, and use these image frames to create animated images in .gif format or video segments in .wmv format, and the terminal device can obtain the animated images or video segments from the server and display them.

[0039] An implementation of scene 2, step 101, as shown in FIG. 5, may include the following steps.

[0040] In step 1011, multimedia data is obtained, where the multimedia data includes image frame data using the target entity object in the multimedia content corresponding to the target entity object.

[0041] In step 1012, a multimedia resource is generated based on the multimedia data to display the usage effect of the target entity object.

[0042] Exemplarily, the multimedia resource may be generated by the terminal device based on the multimedia data transmitted from the server. The server may determine target entity object identification information corresponding to the target entity object from the identification information of a plurality of entity objects stored in advance, determine image frame data using the target entity object in the multimedia content based on the mapping relationship between the entity object identification information and the image frame information, and transmit the image frame data to the terminal device as multimedia data. Here, the image frame information may be understood as time information (e.g., 5s to 25s) corresponding to the image frame using the target entity object in the multimedia content, and may be frame number information (e.g., the 20th frame to the 50th frame) corresponding to the image frame using the target entity object in the multimedia content. The multimedia data may further include sequence information of the image frames using the target entity object in the multimedia content. Here, the image frame data may be understood as one or more image frames using the target entity object in the multimedia content. The order information can be understood as an order of image frames using the target entity object in the multimedia content, for example, a time order of image frames using the target entity object in the multimedia content (e.g., a time when each image frame appears in the multimedia content) or a frame number order corresponding to image frames using the target entity object in the multimedia content (e.g., a frame number in the multimedia content of each image frame). The image frame data can be consecutive image frames in the multimedia content (which can be understood as all image frames using the target entity object) or non-consecutive image frames (which can be understood as key image frames using the target entity object).

[0043] After obtaining the multimedia data, the terminal device can generate a multimedia resource according to the multimedia data to display the use effect of the target entity object, for example, according to the image frame data included in the multimedia data, stitching can be performed according to sequence information to generate a multimedia resource.

[0044] Take the multimedia content as an example, if the target entity object is "beautifying effect", the server can select image frames using "beautifying effect" from the video 2, and send these image frames and sequence information of these image frames to the terminal device as multimedia data. The terminal device creates animated images in .gif format or video segments in .mp4 format as multimedia resources according to the received image frames and sequence information of the image frames.

[0045] An implementation of scene 3, step 101, as shown in FIG. 6, may include the following steps.

[0046] In step 1013, resource indication information corresponding to the target entity object is obtained, and the resource indication information is used to indicate the segment in which the target entity object appears in the multimedia content.

[0047] In step 1014, multimedia data is obtained based on the resource indication information, where the multimedia data includes image frame data using the target entity object in the multimedia content.

[0048] In step 1015, a multimedia resource is generated based on the multimedia data to display the usage effect of the target entity object.

[0049] Exemplarily, the multimedia resource may be obtained by a terminal device acquiring resource indication information from a server, acquiring multimedia data from the server based on the resource indication information, and finally generating the multimedia resource based on the multimedia data. The server may determine target entity object identification information corresponding to the target entity object from identification information of a plurality of entity objects stored in advance, and determine the resource indication information based on a mapping relationship between the entity object identification information and image frame information. Here, the image frame information may be understood as time information (e.g., 5s to 25s) corresponding to an image frame using the target entity object in the multimedia content, and may be frame number information (e.g., 20th frame to 50th frame) corresponding to an image frame using the target entity object in the multimedia content. The resource indication information may indicate a segment in which the target entity object appears in the multimedia content. For example, the resource indication information may be time information (e.g., 5s to 10s in the multimedia content) corresponding to an image frame using the target entity object in the multimedia content, or may be frame number information (e.g., 15th frame to 30th frame) corresponding to an image frame using the target entity object in the multimedia content.

[0050] After obtaining the resource indication information, the terminal device can obtain server multimedia data based on the resource indication information. Here, the multimedia data includes image frame data using the target entity object in the multimedia content. The multimedia data may further include sequence information of the image frames using the target entity object in the multimedia content. Here, the image frame data can be understood as one or more image frames using the target entity object in the multimedia content. The sequence information can be understood as the sequence of the image frames using the target entity object in the multimedia content, for example, the time sequence of the image frames using the target entity object in the multimedia content (e.g., the time when each image frame appears in the multimedia content), or the frame number sequence corresponding to the image frames using the target entity object in the multimedia content (e.g., the frame number in the multimedia content of each image frame). The image frame data can be consecutive image frames in the multimedia content (which can be understood as all image frames using the target entity object) or non-consecutive image frames (which can be understood as a key image frame using the target entity object). After obtaining the multimedia data, the terminal device can generate a multimedia resource that displays the use effect of the target entity object based on the multimedia data. For example, based on the image frame data contained in the multimedia data, stitching can be performed according to sequence information to obtain a multimedia resource.

[0051] The difference from scene 2 is that in scene 2, the server directly determines the image frame data using the target entity object in the multimedia content, and directly transmits the image frame data to the terminal device, while in scene 3, the terminal device can obtain the image frame using the target entity object in the multimedia content from the server by dividing it into segments and frames.

[0052] Take the multimedia content as an example, if the target entity object is "ocean", the server can select segments in which "ocean" appears from video 3, and send resource indication information corresponding to these segments to the terminal device, where the resource indication information can be, for example, time information of image frames in which "ocean" appears in video 3, where 15s-100s represents that "ocean" appears in image frames from 15s to 100s in video 3. The terminal device obtains image frames within 15s-100s in video 3 and frame numbers of these image frames from the server based on the resource indication information, and creates animated images in .gif format or video segments in .avi format from these image frames according to the order of frame numbers as multimedia resources.

[0053] In the embodiment of the present disclosure, the manner in which the terminal device or the server performs stitching according to sequence information based on the image frame data included in the multimedia data to obtain the multimedia resource may be to combine all the image frame data included in the multimedia data (i.e., all the image frames using the target entity object in the multimedia content) into an animation image or a video segment, or to combine partial image frame data included in the multimedia data (i.e., partial image frames using the target entity object in the multimedia content) into an animation image or a video segment. The present disclosure is not limited thereto.

[0054] For example, if the image frames using the target entity object in multimedia content are the 21st to 75th image frames, these 55 image frames may be combined into a video segment in chronological order, or the intermediate image frames, the 47th to 56th image frames, may be taken and combined into an animation image.

[0055] The image frames using the target entity object do not have to be consecutive in the multimedia content, i.e., the target entity object can be used multiple times in the multimedia content. For example, the image frames using the target entity object in the multimedia content are the 10th to 22nd image frames and the 153rd to 170th image frames. Thus, the 10th to 22nd image frames and the 153rd to 170th image frames may be selected and combined with the animation image, the 15th to 20th image frames may be selected and combined with the animation image, or the 160th to 170th image frames may be selected and combined with the animation image.

[0056] FIG. 7 is a flowchart of another search result display method according to an exemplary embodiment, as shown in FIG. 7, step 102 may include the following steps:

[0057] In step 1021, an object identifier corresponding to the target entity object is obtained.

[0058] In step 1022, display an object identifier corresponding to the target entity object in a first area of ​​the display interface, and automatically play at least one multimedia resource in a second area of ​​the display interface.

[0059] For example, the terminal device can display the multimedia resource, and can also obtain an object identifier corresponding to the target entity object from the server. The object identifier can be understood as an icon corresponding to the target entity object. The terminal device can obtain the object identifier corresponding to the target entity object from the server and can also obtain a link corresponding to the target entity object, and the object identifier is associated with the link. The terminal device can simultaneously display the multimedia resource and the object identifier corresponding to the target entity object on the display interface. For example, the terminal device can display the object identifier corresponding to the target entity object in a first area of ​​the display interface of the terminal device, and automatically play at least one multimedia resource in a second area of ​​the display interface. Here, the first area and the second area may be different areas in the display interface.

[0060] The method may further include the following steps.

[0061] In step 105, in response to a trigger operation on the object identifier, jump to a multimedia shooting scene corresponding to the target entity object.

[0062] For example, after a user views the use effect of a target entity object through multimedia resources, the user can click on the object identifier corresponding to the target entity object to issue a trigger operation on the object identifier. In response to the trigger operation, the terminal device can jump to the multimedia shooting scene corresponding to the target entity object through a link associated with the object identifier. This allows the user to intuitively view the use effect of the target entity object through multimedia resources, and also quickly jump to the multimedia shooting scene corresponding to the target entity object through the object identifier corresponding to the target entity object, thereby improving the effectiveness of search and the convenience of operation.

[0063] Take the target entity object as an example: the "rabbit ear tool". The server finds the multimedia content using the "rabbit ear tool" in the pre-stored multimedia content, which includes video 1, video 2 and video 3. The terminal device obtains the multimedia resource capable of displaying the use effect of the "rabbit ear tool", which includes A.gif corresponding to video 1, B.gif corresponding to video 2 and C.gif corresponding to video 3. The terminal device further obtains the object identifier corresponding to the "rabbit ear tool". As shown in FIG. 8, the object identifier corresponding to the "rabbit ear tool" is displayed in the first area of ​​the display screen of the terminal device, and A.gif, B.gif and C.gif are automatically played in the second area. After the user clicks the object identifier corresponding to the "rabbit ear tool" and issues a trigger operation, the terminal device can jump to the multimedia shooting scene using the "rabbit ear tool".

[0064] In one application scenario, the implementation of step 101 is as follows:

[0065] Obtain a multimedia resource for displaying a usage effect of at least one entity object set, the entity object set including a target entity object and an associated entity object, the associated entity object being an entity object having an association relationship with the target entity object.

[0066] For example, the multimedia content may include various entity objects, and two or more entity objects having a related relationship may be related due to the possibility of an associated relationship between the entity objects. The entity objects having a related relationship may be entity objects that are often used simultaneously by a user, or may be multiple entity objects in one group of entity objects. For example, it can be determined that the "baby face tool" and the "rabbit ear tool" have an associated relationship because a user usually uses the "baby face tool" and the "rabbit ear tool" simultaneously. Or, it can be determined that the "face beauty effect" and the "skin beauty effect" both belong to one group of entity objects for portrait processing, and that the "face beauty effect" and the "skin beauty effect" have an associated relationship. Thus, when obtaining a multimedia resource, at least one multimedia resource displaying the use effect of the entity object set can be obtained, where the entity object set includes a target entity object and an associated entity object having an associated relationship with the target entity object. Thus, a user can view the use effect of the target entity object and the associated entity object simultaneously through the multimedia resource, improving the effectiveness of the search.

[0067] In another application scenario, the implementation of step 101 may be as follows.

[0068] A multimedia resource and an associated multimedia resource that displays the use effect of an associated entity object are obtained, and the associated entity object is an entity object that has an association relationship with the target entity object.

[0069] The implementation of step 102 may be as follows.

[0070] The multimedia resource is displayed in the third area of ​​the display interface, and the related multimedia resource is displayed in the fourth area of ​​the display interface.

[0071] For example, the terminal device can obtain a multimedia resource for displaying the use effect of a target entity object, and can also obtain a related multimedia resource for displaying the use effect of a related entity object, where the related entity object is an entity object having a related relationship with the target entity object. The related entity object can be an entity object that is frequently used simultaneously by a user, or a plurality of entity objects in a group of entity objects.

[0072] Thereby, the terminal device can simultaneously display the multimedia resource and the related multimedia resource on the display interface. For example, the multimedia resource can be displayed in the third area of ​​the display interface of the terminal device, and the related multimedia resource can be displayed in the fourth area of ​​the display interface. Here, the third area and the fourth area can be different areas in the display interface. This allows the user to view the use effect of the target entity object through the multimedia resource, and the use effect of the related entity object through the related multimedia resource, thereby improving the effectiveness of the search.

[0073] In summary, the present disclosure is to obtain at least one multimedia resource for displaying the use effect of the target entity object in response to a search command for the target entity object, and the multimedia resource is obtained based on the multimedia content corresponding to the target entity object, and display the at least one multimedia resource. The present disclosure obtains, for each search command for a different target entity object, a multimedia resource capable of displaying the use effect of the target entity object based on the multimedia content corresponding to the target entity object, and displays the multimedia resource, without the need to display the complete multimedia content, which can improve the effectiveness of the search and reduce the consumption of data traffic.

[0074] FIG. 9 is a flowchart of a method for displaying search results according to an exemplary embodiment. As shown in FIG. 9, the method includes the following steps:

[0075] In step 201, a search command for a target entity object is received, and multimedia content corresponding to the target entity object is determined.

[0076] For example, the execution subject of the method may be a server, and when a user wants to search for a target entity object, the user can input a search command through a terminal device, and the search command includes a search keyword corresponding to the target entity object. The terminal device can send the search command to the server, and after receiving the search command, the server analyzes the search command, obtains the search keyword included in the search command, and determines a target entity object that matches the search keyword. It can be understood that the server stores multiple entity objects in advance, determines the matching degree between the search keyword and each entity object, and sets one or more entity objects with the highest matching degree as the target entity object. The search keyword may be one or more, and similarly, the target entity object may be one or more. For example, take the target entity object as a "baby face tool" and the search command as a "how to use the baby face tool", the server can analyze "how to use the baby face tool", determine the search keyword "baby face tool" included in the search command, and determine that the target entity object is "baby face tool".

[0077] After determining the target entity object, the server can search for multimedia content corresponding to the target entity object in a large amount of multimedia content pre-stored in the server, which can be understood as multimedia content using the target entity object or multimedia content in which the target entity object appears. The multimedia content stored in the server may be that previously uploaded to the server by a user or that captured by the server from a network, and the present disclosure does not limit the origin of the multimedia content, and the format of the multimedia content may be a video file (e.g., .avi, .mp4, .wmv, .rmvb, .3gp, .mov, .asf file).

[0078] In step 202, determine search result information according to the multimedia content corresponding to the target entity object, where the search result information includes at least one multimedia resource for displaying the use effect of the target entity object, or at least one set of multimedia data, or at least one resource indication information, where the multimedia data is image frame data using the tag of the target entity object in the multimedia content, and the resource indication information is used to indicate a segment in which the target entity object appears in the multimedia content.

[0079] In step 203, the search result information is sent to the terminal device.

[0080] For example, the server can determine the search result information according to the multimedia content corresponding to the target entity object, and send the search result information to the terminal device. Here, the search result information can be divided into three types. The first type is at least one multimedia resource that displays the use effect of the target entity object, the second type is at least one set of multimedia data, and the third type is at least one resource indication information. The following describes the three types of search result information determining methods.

[0081] First, the server can determine target entity object identification information corresponding to the target entity object from the identification information of multiple entity objects stored in advance, and determine image frame information of the target entity object based on a mapping relationship between the entity object identification information and image frame information. The image frame information of the target entity object can indicate a segment in which the target entity object appears in the multimedia content. The mapping relationship can be understood as a plurality of records stored therein, each record including one entity object and a segment in which the entity object appears in the multimedia content. Here, the image frame information can be understood as time information (e.g., 5s to 25s) corresponding to an image frame using the target entity object in the multimedia content, and may be frame number information (e.g., 20th frame to 50th frame) corresponding to an image frame using the target entity object in the multimedia content. The server can generate a multimedia resource displaying the use effect of the target entity object by extracting a segment in which the target entity object appears in the multimedia content from the multimedia content based on the image frame information of the target entity object. The server can transmit the multimedia resource to a terminal device and cause the terminal device to display the multimedia resource. The image frame information of the target entity object may indicate consecutive image frames in the multimedia content (which may be understood as all image frames using the target entity object) or may indicate non-consecutive image frames (which may be understood as key image frames using the target entity object).

[0082] Second, the server can determine target entity object identification information corresponding to the target entity object from the identification information of a plurality of entity objects stored in advance, determine image frame data using the target entity object in the multimedia content based on the mapping relationship between the entity object identification information and the image frame information, and transmit the image frame data to the terminal device as multimedia data. Here, the image frame information can be understood as time information (e.g., 5s to 25s) corresponding to the image frame using the target entity object in the multimedia content, and may be frame number information (e.g., the 20th frame to the 50th frame) corresponding to the image frame using the target entity object in the multimedia content. The multimedia data may further include sequence information of the image frame using the target entity object in the multimedia content. Here, the image frame data can be understood as one or more image frames using the target entity object in the multimedia content. The sequence information can be understood as the sequence of the image frames using the target entity object in the multimedia content. For example, it may be the time sequence of the image frames using the target entity object in the multimedia content (e.g., the time when each image frame appears in the multimedia content), or it may be the frame number sequence (e.g., the frame number in the multimedia content of each image frame) corresponding to the image frame using the target entity object in the multimedia content. The image frame data may be consecutive image frames in the multimedia content (which may be understood as all image frames using the target entity object) or non-consecutive image frames (which may be understood as key image frames using the target entity object).After obtaining the multimedia data, the terminal device can generate and display a multimedia resource that displays the usage effect of the target entity object according to the multimedia data, for example, can perform stitching according to sequence information based on the image frame data included in the multimedia data to generate a multimedia resource.

[0083] Third, the server can determine target entity object identification information corresponding to the target entity object from the identification information of a plurality of entity objects stored in advance, and determine resource indication information based on a mapping relationship between the entity object identification information and image frame information. Here, the image frame information can be understood as time information (e.g., 5s to 25s) corresponding to an image frame using the target entity object in the multimedia content, and can also be frame number information (e.g., 20th frame to 50th frame) corresponding to an image frame using the target entity object in the multimedia content. The resource indication information can indicate a segment in which the target entity object appears in the multimedia content. For example, the resource indication information can be time information (e.g., 5s to 10s in the multimedia content) corresponding to an image frame using the target entity object in the multimedia content, or frame number information (e.g., 15th frame to 30th frame in the multimedia content) corresponding to an image frame using the target entity object in the multimedia content. After obtaining the resource indication information, the terminal device can obtain server multimedia data based on the resource indication information. Here, the multimedia data includes image frame data using the target entity object in the multimedia content. The multimedia data may further include sequence information of image frames using the target entity object in the multimedia content, where image frame data can be understood as one or more image frames using the target entity object in the multimedia content.The sequence information can be understood as the sequence of image frames using the target entity object in the multimedia content, for example, the time sequence of image frames using the target entity object in the multimedia content (for example, the time when each image frame appears in the multimedia content), or the frame number sequence corresponding to the image frames using the target entity object in the multimedia content (for example, the frame number of each image frame in the multimedia content). The image frame data can be consecutive image frames in the multimedia content (which can be understood as all image frames using the target entity object), or non-consecutive image frames (which can be understood as key image frames using the target entity object). After acquiring the multimedia data, the terminal device can generate and display a multimedia resource that displays the use effect of the target entity object based on the multimedia data. For example, based on the image frame data included in the multimedia data, stitching can be performed according to the sequence information to acquire the multimedia resource.

[0084] The multimedia content in the above embodiment can be understood as a multimedia file whose content is complete and long, for example, it may be a video, audio, etc. file, and the multimedia resource is derived from a part in the multimedia content that is closely related to the target entity object, for example, it may be an animated image or a video segment whose time is short. The multimedia resource may be generated based on one or more image frames using the target entity object in the multimedia content, and the use effect of the target entity object can be intuitively displayed. Take the target entity object as an example where the target entity object is a "cat face tool" and the multimedia content is a video, and when 10s to 27s in the multimedia content use the "cat face tool", the multimedia resource may be an animated image generated based on the image frames in 10s to 27s in the multimedia content. Compared with the multimedia content, the amount of data contained in the multimedia resource is small, and the use effect of the target entity object can be intuitively displayed. In this way, the terminal device can display the multimedia resource, and does not need to display the complete multimedia content, which can improve the effectiveness of searching and reduce the consumption of data traffic.

[0085] FIG. 10 is a flowchart of another search result display method according to an exemplary embodiment, as shown in FIG. 10, the method may further include the following steps.

[0086] In step 204, multimedia content corresponding to any one of the entity objects and attribute information of the multimedia content corresponding to each entity object are received, where the attribute information includes identification information and use time information of each entity object.

[0087] In one implementation, the terminal device can use various entity objects in the multimedia content during the process of shooting the multimedia content or after the shooting of the multimedia content is finished, for example, can add subtitles, background music to the multimedia content, can use special effects, tools, etc. to the video, and can also directly add content tags corresponding to different contents to the multimedia content. The terminal device can record each entity object used in the multimedia content and the use time information corresponding to each entity object. The use time information may include the time (e.g., start time and end time) when the entity object is used in the multimedia content, or the number of the image frame (e.g., start frame number and end frame number) when the entity object is used in the multimedia content. The terminal device can send the identification information of each entity object (the identification information can uniquely identify the corresponding entity object) and the use time information of each entity object as attribute information of the multimedia content to the server together with the multimedia content. After receiving the multimedia content and the attribute information of the multimedia content, the server can determine a mapping relationship between the entity object identification information and the image frame information based on the identification information of each entity object and the use time information of each entity object, where the image frame information represents a segment in which each entity object appears in the multimedia content. It can be understood that a mapping relationship stores multiple records, with each record storing one entity object and the segment in which the entity object appears in the multimedia content.

[0088] FIG. 11 is a flowchart of another search result display method according to an exemplary embodiment. As shown in FIG. 11, step 202 can be realized by the following steps:

[0089] In step 2021, obtain entity object information of the multimedia content, where the entity object information includes entity object identification information used in the multimedia content and a mapping relationship between the entity object identification information and image frame information, and the image frame information represents a segment in which each entity object appears in the multimedia content.

[0090] In step 2022, select a target entity object identification information corresponding to a target entity object from the entity object identification information, and determine the image frame information of the target entity object according to the mapping relationship.

[0091] In step 2023, a multimedia resource is generated based on the multimedia content and the image frame information of the target entity object.

[0092] The server can obtain entity object information of the multimedia content, where the entity object information includes entity object identification information used in the multimedia content and a mapping relationship between the entity object identification information and image frame information. Determine target entity object identification information corresponding to a target entity object from the entity object identification information, and then determine image frame information of the target entity object based on the mapping relationship between the entity object identification information and the image frame information. The image frame information of the target entity object can indicate a segment in which the target entity object appears in the multimedia content. The server generates a multimedia resource displaying the use effect of the target entity object by extracting the segment in which the target entity object appears in the multimedia content from the multimedia content based on the image frame information of the target entity object.

[0093] FIG. 12 is a flowchart of another search result display method according to an exemplary embodiment, as shown in FIG. 12, step 202 can be realized by the following steps:

[0094] In step 2024, obtain entity object information of the multimedia content, where the entity object information includes entity object identification information used in the multimedia content and a mapping relationship between the entity object identification information and image frame information, and the image frame information represents a segment in which each entity object appears in the multimedia content.

[0095] In step 2025, from the entity object identification information, select a target entity object identification information corresponding to the target entity object and a related entity object identification information corresponding to the related entity object, and determine the image frame information of the target entity object and the image frame information of the related entity object based on the mapping relationship, where the related entity object is an entity object that has an association relationship with the target entity object.

[0096] In step 2026, a multimedia resource is generated based on the multimedia content, the image frame information of the target entity object, and the image frame information of the related entity object.

[0097] For example, multimedia content may include various entity objects, and two or more entity objects having a related relationship may be related due to the possibility of an associated relationship between the entity objects. The entity objects having a related relationship may be entity objects that a user often uses simultaneously, or may be multiple entity objects in one group of entity objects. For example, a user usually uses a "baby face tool" and a "rabbit ear tool" simultaneously, so it can be determined that the "baby face tool" and the "rabbit ear tool" have a related relationship. Or, it can be determined that the "face beauty effect" and the "skin beauty effect" both belong to one group of entity objects for portrait processing, and that the "face beauty effect" and the "skin beauty effect" have a related relationship.

[0098] Thus, when the server determines the multimedia resource, it can obtain entity object information of the multimedia content, where the entity object information includes entity object identification information used in the multimedia content and a mapping relationship between the entity object identification information and image frame information. From the entity object identification information, determine target entity object identification information corresponding to the target entity object and related entity object identification information corresponding to the related entity object. Based on the mapping relationship between the entity object identification information and the image frame information, determine image frame information of the target entity object and image frame information of the related entity object. The image frame information of the target entity object can indicate a segment in the multimedia content where the target entity object appears, and the image frame information of the related entity object can indicate a segment in the multimedia content where the related entity object appears.

[0099] The server extracts a segment where the target entity object appears and a segment where the related entity object appears in the multimedia content based on the image frame information of the target entity object and the image frame information of the related entity object from the multimedia content, thereby generating a multimedia resource displaying the use effect of the target entity object and the related entity object. When the terminal device displays the multimedia resource, the user can simultaneously view the use effect of the target entity object and the related entity object, improving the search effectiveness. There may be overlapping image frames between the segment where the target entity object appears extracted from the multimedia content and the segment where the related entity object appears in the multimedia content, that is, the target entity object exists and the image frame of the related entity object may also appear.

[0100] FIG. 13 is a flowchart of another search result display method according to an exemplary embodiment, as shown in FIG. 13, the method may further include the following steps.

[0101] In step 205, an associated entity object having an association relationship with the target entity object is determined, and associated multimedia content corresponding to the associated entity object is determined.

[0102] In another application scenario, after receiving a search command, the server analyzes the search command, obtains search keywords contained in the search command, determines a target entity object that matches the search keywords, and then determines related entity objects that have a related relationship with the target entity object, and determines related multimedia content corresponding to the related entity object. The related multimedia content can be understood as the multimedia content using the related entity object or the multimedia content in which the related entity object appears.

[0103] In step 206, determine related search result information based on the related multimedia content, where the related search result information includes at least one related multimedia resource that displays the use effect of the related entity object, or at least one set of related multimedia data, or at least one related resource indication information, where the related multimedia data includes image frame data that uses the tag of the related entity object in the related multimedia content, and the related resource indication information is used to indicate a segment in which the related entity object appears in the related multimedia content.

[0104] In step 207, the related search result information is sent to the terminal device.

[0105] The server can determine related search result information according to the related multimedia content corresponding to the related entity object, and send the related search result information to the terminal device. Here, the related search result information can be divided into three types. The first type is at least one related multimedia resource that displays the use effect of the related entity object, the second type is at least one set of related multimedia data, and the third type is at least one related resource indication information. Here, the method of determining the related multimedia resource is the same as the method of generating the multimedia resource that displays the use effect of the target entity object, the related multimedia data is the same as the method of generating the multimedia data corresponding to the target entity object, and the related resource indication information is the same as the method of generating the resource indication information corresponding to the target entity object, and the description is omitted here.

[0106] Thus, the terminal device can obtain multimedia resources for displaying the use effect of the target entity object according to the search result information, and obtain related multimedia resources for displaying the use effect of the related entity object according to the related search result information. When the terminal device displays the multimedia resources and the related multimedia resources, the user can view the use effect of the target entity object through the multimedia resources, and the use effect of the related entity object through the related multimedia resources, thereby improving the effectiveness of the search.

[0107] In summary, the present disclosure receives a search command for a target entity object, determines multimedia content corresponding to the target entity object, and determines search result information according to the multimedia content corresponding to the target entity object. Here, the search result information may include at least one multimedia resource that displays the use effect of the target entity object, or at least one set of multimedia data, or at least one resource indication information. Send the search result information to a terminal device. The present disclosure determines search result information according to multimedia content corresponding to the target entity object for each search command of a different target entity object, and sends the search result information to a terminal device, so that the terminal device can obtain and display a multimedia resource that can display the use effect of the target entity object according to the search result information, without needing to display the complete multimedia content, and can improve the effectiveness of the search and reduce the consumption of data traffic.

[0108] FIG. 14 is a block diagram of a search result display device according to one exemplary embodiment. As shown in FIG. 14, the device 300 includes: an acquisition module 301 configured to acquire at least one multimedia resource displaying a usage effect of the target entity object in response to a search command for the target entity object, the multimedia resource being obtained based on a multimedia content corresponding to the target entity object; a display module 302 configured to display at least one multimedia resource; The present invention may also include:

[0109] In one application scenario, the display module 302 can determine different display manners according to the type of multimedia resource. For example, if the multimedia resource is a video, the multimedia resource is displayed in a first preset manner, which includes loop play, reverse play, double speed play, and window play. If the multimedia resource is an animation image, the multimedia resource is displayed in a second preset manner, which includes zooming in or zooming out.

[0110] FIG. 15 is a block diagram of another search result display device according to an exemplary embodiment. As shown in FIG. 15, the device 300 includes: A recording module 303 configured to record at least one entity object used in the multimedia content and the usage time information of each entity object; A sending module 304 configured to send multimedia content and attribute information of the multimedia content to a server, the attribute information of the multimedia content including identification information and use time information of each entity object; may further comprise:

[0111] In one application scenario, the acquisition module 301 may be configured to perform the following steps.

[0112] Step 1) Obtain multimedia data, the multimedia data including image frame data using the target entity object in the multimedia content corresponding to the target entity object.

[0113] Step 2) Generate a multimedia resource that displays the usage effect of the target entity object according to the multimedia data.

[0114] In another application scenario, the acquisition module 301 may be configured to perform the following steps.

[0115] Step 3) Obtain resource indication information corresponding to the target entity object, the resource indication information being used to indicate the segment in which the target entity object appears in the multimedia content.

[0116] Step 4) Obtain multimedia data according to the resource indication information, where the multimedia data includes image frame data using the target entity object in the multimedia content.

[0117] Step 5) Generate a multimedia resource that displays the usage effect of the target entity object according to the multimedia data.

[0118] FIG. 16 is a block diagram of another search result display device according to an exemplary embodiment. As shown in FIG. 16, the display module 302: an acquisition submodule 3021 configured to acquire an object identifier corresponding to a target entity object; a display sub-module 3022 configured to display an object identifier corresponding to the target entity object in a first area of ​​the display interface and automatically play at least one multimedia resource in a second area of ​​the display interface; The present invention may also include:

[0119] FIG. 17 is a block diagram of another search result display device according to an exemplary embodiment. As shown in FIG. 17, the device 300 includes: The system further comprises a jump module 305 configured to, in response to a trigger operation on the object identifier, jump to a multimedia filmed scene corresponding to a target entity object in response to the trigger operation on the object identifier.

[0120] In one application scenario, the acquisition module 301: It may be configured to obtain at least one multimedia resource that displays the usage effect of an entity object set, where the entity object set includes a target entity object and an associated entity object, and the associated entity object is an entity object that has an associated relationship with the target entity object.

[0121] In another application scenario, the acquisition module 301: It may be configured to obtain a related multimedia resource that displays the usage effect of the multimedia resource and a related entity object, where the related entity object is an entity object that has an association relationship with the target entity object.

[0122] The display module 302 is The display interface may be configured to cause a third region of the display interface to display the multimedia resource and a fourth region of the display interface to display a related multimedia resource.

[0123] Regarding the apparatus of the above embodiment, the manner in which the operations of the modules therein are performed has already been described in the embodiment related to the method, and therefore the description thereof will be omitted here.

[0124] In summary, the present disclosure obtains at least one multimedia resource for displaying the use effect of the target entity object in response to a search command for the target entity object, and the multimedia resource is obtained based on the multimedia content corresponding to the target entity object, and displays the at least one multimedia resource. For each search command for a different target entity object, the present disclosure obtains a multimedia resource capable of displaying the use effect of the target entity object based on the corresponding multimedia content, and displays the multimedia resource, without the need to display the complete multimedia content, which can improve the search effectiveness and reduce the consumption of data traffic.

[0125] FIG. 18 is a block diagram of a search result display device according to one exemplary embodiment. As shown in FIG. 18, the device 400 can be applied to a server, A receiving module 401 configured to receive a search command for a target entity object and determine multimedia content corresponding to the target entity object; A determination module 402 configured to determine search result information based on multimedia content corresponding to a target entity object, where the search result information includes at least one multimedia resource for displaying a use effect of the target entity object, or at least one set of multimedia data, or at least one resource indication information, where the multimedia data is image frame data using a tag of the target entity object in the multimedia content, and the resource indication information is used to indicate a segment in which the target entity object appears in the multimedia content; A sending module 403 configured to send the search result information to a terminal device; Equipped with.

[0126] In one application scenario, the receiving module 401 is further configured to receive multimedia content corresponding to any entity object and attribute information of the multimedia content corresponding to each entity object, where the attribute information includes identification information and use time information of each entity object.

[0127] In another application scenario, the determination module 402 may be configured to perform the following steps.

[0128] Step A) obtain entity object information of the multimedia content, where the entity object information includes entity object identification information used in the multimedia content and a mapping relationship between the entity object identification information and image frame information, and the image frame information represents a segment in which each entity object appears in the multimedia content.

[0129] Step B) Select a target entity object identification information corresponding to a target entity object from the entity object identification information, and determine the image frame information of the target entity object according to the mapping relationship.

[0130] Step C) generating a multimedia resource according to the multimedia content and the image frame information of the target entity object;

[0131] In another application scenario, the determination module 402 may be configured to perform the following steps.

[0132] Step D) obtaining entity object information of the multimedia content, where the entity object information includes entity object identification information used in the multimedia content and a mapping relationship between the entity object identification information and image frame information, and the image frame information represents a segment in which each entity object appears in the multimedia content.

[0133] Step E) selecting a target entity object identification information corresponding to the target entity object and a related entity object identification information corresponding to the related entity object from the entity object identification information, and determining image frame information of the target entity object and image frame information of the related entity object according to a mapping relationship, where the related entity object is an entity object that has an association relationship with the target entity object.

[0134] Step F) generating a multimedia resource according to the multimedia content, the image frame information of the target entity object, and the image frame information of the related entity object.

[0135] In another application scenario, the determination module 402 may further include: The method may be configured to determine related entity objects having an association relationship with the target entity object, determine related multimedia content corresponding to the related entity objects, and determine related search result information based on the related multimedia content, where the related search result information includes at least one related multimedia resource for displaying a usage effect of the related entity object, or at least one set of related multimedia data, or at least one related resource indication information, where the related multimedia data includes image frame data using a tag of the related entity object in the related multimedia content, and the related resource indication information is used for indicating a segment in which the related entity object appears in the related multimedia content.

[0136] A transmitting module 403, The relevant search result information may be configured to be transmitted to the terminal device.

[0137] Regarding the apparatus in the above embodiment, the manner in which the operations of the modules therein are performed has already been described in the embodiment related to the method, and the description thereof will be omitted here.

[0138] In summary, the present disclosure receives a search command for a target entity object, determines multimedia content corresponding to the target entity object, and determines search result information according to the multimedia content corresponding to the target entity object. Here, the search result information may include at least one multimedia resource that displays the use effect of the target entity object, or at least one set of multimedia data, or at least one resource indication information. Send the search result information to a terminal device. The present disclosure determines search result information according to the corresponding multimedia content for each search command of a different target entity object, and sends the search result information to a terminal device, so that the terminal device can obtain and display a multimedia resource that can display the use effect of the target entity object according to the search result information, without needing to display the complete multimedia content, and can improve the effectiveness of searching and reduce the consumption of data traffic.

[0139] Hereinafter, referring to FIG. 19, a structural schematic diagram of an electronic device (e.g., a terminal device or server in FIG. 1) 600 suitable for implementing the embodiment of the present disclosure is shown. The terminal device in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, notebook computers, digital broadcast receivers, PDAs, PADs, PMPs, in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG. 19 is merely an example and does not impose any limitations on the functions and scope of use of the embodiment of the present disclosure.

[0140] 19, the electronic device 600 may include a processing unit (e.g., a central processor, a graphic processor, etc.) 601, which can execute various appropriate operations and processes based on a program stored in a read-only memory (ROM) 602 or loaded from a storage device 608 into a random access memory (RAM) 603. The RAM 603 further stores various programs and data necessary for the operation of the electronic device 600. The processing unit 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0141] Input devices 606 including, for example, a touch panel, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc., output devices 607 including, for example, a liquid crystal display screen (LCD), a speaker, a vibrator, etc., storage devices 608 including, for example, a magnetic tape, a hard disk, etc., and communication devices 609 can be connected to the I / O interface 605. The communication devices 609 enable the electronic device 600 to communicate wirelessly or via wires with other devices to exchange data. Although FIG. 19 illustrates the electronic device 600 with various devices, it is not necessary for the electronic device 600 to implement or include all the illustrated devices, and instead, the electronic device 600 may implement or include more or less devices.

[0142] According to an embodiment of the present disclosure, the process described with reference to the flowchart above may be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product including a computer program carried on a computer-readable medium, the computer program including program code for performing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network by the communication device 609, or may be installed from the storage device 608, or may be installed from the ROM 602. When the computer program is executed by the processing device 601, it performs the above-mentioned functions defined in the method of the embodiment of the present disclosure.

[0143] The computer readable medium described in this disclosure may be a computer readable signal medium, a computer readable storage medium, or any combination of the above. The computer readable storage medium may be, for example, but not limited to, an electric, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the above. The computer readable storage medium may include, but is not limited to, an electrical connection with one or more leads, a portable computer disk, a hard disk, a RAM, a ROM, an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this disclosure, the computer readable storage medium may be any tangible medium that contains or stores a program that can be used in or in conjunction with an instruction execution system, apparatus, or device. In this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, in which computer-readable program code is carried. Such a propagated data signal may take various forms, including, but not limited to, an electromagnetic signal, an optical signal, or any suitable combination of the above. A computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium, which may transmit, propagate, or transmit a program for use in or in conjunction with an instruction execution system, apparatus, or device. The program code contained in the computer-readable medium may be transmitted by any suitable medium, including, but not limited to, an electrical wire, an optical cable, a radio frequency (RF), or the like, or any suitable combination of the above.

[0144] In some embodiments, the terminal devices, servers, and the like can communicate using any now known or later developed network protocol, such as HyperText Transfer Protocol (HTTP), and can interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communications networks include a Local Area Network (LAN), a Wide Area Network (WAN), a network off a network (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), and any now known or later developed network.

[0145] The computer-readable medium may be included in the electronic device, or may exist separately and not be attached to the electronic device.

[0146] One or more programs are carried on the computer-readable medium, and when the one or more programs are executed by the electronic device, the electronic device obtains at least one multimedia resource that displays the usage effect of the target entity object in response to a search command for the target entity object, where the multimedia resource is obtained based on multimedia content corresponding to the target entity object, and displays the at least one multimedia resource.

[0147] Alternatively, the computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device receives a search command for a target entity object, determines multimedia content corresponding to the target entity object, and determines search result information based on the multimedia content corresponding to the target entity object, where the search result information includes at least one multimedia resource for displaying the use effect of the target entity object, or at least one set of multimedia data, or at least one resource indication information, where the multimedia data is image frame data using the tag of the target entity object in the multimedia content, and the resource indication information is used to indicate the segment in which the target entity object appears in the multimedia content, and sends the search result information to a terminal device.

[0148] Computer program code for carrying out the operations of the present disclosure can be written in one or more programming languages ​​or combinations thereof, which may include, but are not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, and also include conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a single, separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a LAN or WAN, or may be connected to an external computer (e.g., connected via the Internet using an Internet Service Provider).

[0149] The flowcharts and block diagrams in the drawings illustrate possible architectures, functions and operations of the methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams may represent a module, program or part of code, which includes one or more executable instructions for implementing a certain logical function. In some alternative implementations, the functions described in the blocks may occur in a different order than the order described in the drawings. For example, two blocks shown as connected may actually be executed substantially in parallel or in reverse order depending on the functions involved. It should be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts may be implemented in a system based on dedicated hardware that executes a certain function or operation, or may be implemented in a combination of dedicated hardware and computer instructions.

[0150] The modules or units according to the embodiments of the present disclosure may be implemented in a software or hardware manner, and the names of the modules or units, if any, do not limit the modules or units themselves.

[0151] The modules or units according to the embodiments of the present disclosure may be implemented in a software or hardware manner, where the names of the modules or units do not limit the modules or units themselves, for example, an acquisition module may be described as a "module for acquiring multimedia resources."

[0152] The functionality of the present invention may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Parts (ASSPs), System on Chip (SOCs), Complex Programmable Logic Devices (CPLDs), etc.

[0153] In the present specification, a machine-readable medium may be a tangible medium that can contain or store a program used in or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the above. A machine-readable storage medium includes an electrical connection by one or more wires, a portable computer disk, a hard disk, a RAM, a ROM, an EPROM, a flash memory, an optical fiber, a portable CD-ROM, an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0154] According to one or more embodiments of the present disclosure, Example 1 provides a method for displaying search results, including, in response to a search command for a target entity object, obtaining at least one multimedia resource displaying a usage effect of the target entity object, the multimedia resource being obtained based on multimedia content corresponding to the target entity object, and displaying the at least one multimedia resource.

[0155] According to one or more embodiments of the present disclosure, Example 2 provides the method of Example 1, further including: recording at least one entity object used in the multimedia content and usage time information of each entity object; and transmitting the multimedia content and attribute information of the multimedia content, including identification information and usage time information of each entity object, to a server.

[0156] According to one or more embodiments of the present disclosure, Example 3 provides the method of Example 1, where obtaining at least one multimedia resource displaying a use effect of the target entity object includes obtaining multimedia data including image frame data using the target entity object in multimedia content corresponding to the target entity object, and generating the multimedia resource displaying a use effect of the target entity object based on the multimedia data.

[0157] According to one or more embodiments of the present disclosure, Example 4 provides the method of Example 1, in which obtaining at least one multimedia resource for displaying a use effect of the target entity object includes obtaining resource indication information corresponding to the target entity object, the resource indication information being for indicating a segment in the multimedia content in which the target entity object appears; obtaining multimedia data based on the resource indication information, the multimedia data including image frame data using the target entity object in the multimedia content; and generating a multimedia resource for displaying a use effect of the target entity object based on the multimedia data.

[0158] According to one or more embodiments of the present disclosure, Example 5 provides the method of any of Examples 1 to 4, where displaying the at least one multimedia resource includes obtaining an object identifier corresponding to the target entity object, displaying the object identifier corresponding to the target entity object in a first area of ​​a display interface, and automatically playing the at least one multimedia resource in a second area of ​​the display interface.

[0159] According to one or more embodiments of the present disclosure, Example 6 provides the method of Example 5, further including jumping to a multimedia captured scene corresponding to the target entity object in response to a trigger operation on the object identifier.

[0160] According to one or more embodiments of the present disclosure, Example 7 provides the method of any of Examples 1 to 4, wherein obtaining at least one multimedia resource that displays a usage effect of the target entity object includes obtaining at least one multimedia resource that displays a usage effect of an entity object set, the entity object set including the target entity object and related entity objects that are entity objects having an association relationship with the target entity object.

[0161] According to one or more embodiments of the present disclosure, Example 8 provides the method of any of Examples 1 to 4, wherein obtaining at least one multimedia resource displaying a usage effect of the target entity object includes obtaining the multimedia resource and an associated multimedia resource displaying a usage effect of an associated entity object, the associated entity object being an entity object having an associated relationship with the target entity object, and displaying the at least one multimedia resource includes displaying the multimedia resource in a third area of ​​a display interface and displaying the associated multimedia resource in a fourth area of ​​the display interface.

[0162] According to one or more embodiments of the present disclosure, Example 9 provides the method of any of Examples 1 to 4, wherein displaying the at least one multimedia resource includes, if the multimedia resource is a video, displaying the multimedia resource in a first preset manner including any one of loop playback, reverse playback, double speed playback, and window playback, and, if the multimedia resource is an animated image, displaying the multimedia resource in a second preset manner including zoomed in or zoomed out.

[0163] According to one or more embodiments of the present disclosure, Example 10 provides a method for displaying search results, including: receiving a search command for a target entity object; determining multimedia content corresponding to the target entity object; determining search result information based on the multimedia content corresponding to the target entity object, where the search result information includes at least one multimedia resource for displaying a usage effect of the target entity object, or at least one set of multimedia data, or at least one resource indication information, where the multimedia data is image frame data using a tag of the target entity object in the multimedia content, and the resource indication information is used to indicate a segment in which the target entity object appears in the multimedia content; and sending the search result information to a terminal device.

[0164] According to one or more embodiments of the present disclosure, Example 11 provides the method of Example 10, further including receiving multimedia content corresponding to any of the entity objects and attribute information of the multimedia content corresponding to each entity object, wherein the attribute information includes identification information and usage time information of each of the entity objects.

[0165] According to one or more embodiments of the present disclosure, Example 12 provides the method of Example 10, where determining search result information based on multimedia content corresponding to the target entity object includes obtaining entity object information of the multimedia content, the entity object information including entity object identification information used for the multimedia content and a mapping relationship between the entity object identification information and image frame information, the image frame information representing a segment in which each entity object appears in the multimedia content; selecting a target entity object identification information corresponding to the target entity object from the entity object identification information; determining image frame information of the target entity object based on the mapping relationship; and generating the multimedia resource based on the multimedia content and the image frame information of the target entity object.

[0166] According to one or more embodiments of the present disclosure, Example 13 provides the method of Example 10, where determining search result information based on multimedia content corresponding to the target entity object includes obtaining entity object information of the multimedia content, the entity object information including an entity object identification information used for the multimedia content and a mapping relationship between the entity object identification information and image frame information, the image frame information representing a segment in which each entity object appears in the multimedia content; selecting a target entity object identification information corresponding to the target entity object and a related entity object identification information corresponding to a related entity object from the entity object identification information; determining image frame information of the target entity object and image frame information of the related entity object based on the mapping relationship, the related entity object being an entity object having an associated relationship with the target entity object; and generating the multimedia resource based on the multimedia content, the image frame information of the target entity object, and the image frame information of the related entity object.

[0167] According to one or more embodiments of the present disclosure, Example 14 provides any of the methods of Examples 10 to 13, and includes: after receiving a search command for the target entity object, determining a related entity object having an associated relationship with the target entity object, determining related multimedia content corresponding to the related entity object; determining related search result information based on the related multimedia content, where the related search result information includes at least one related multimedia resource, or at least one set of related multimedia data, or at least one related resource indication information, for displaying a usage effect of the related entity object, where the related multimedia data includes image frame data using a tag of the related entity object in the related multimedia content, and the related resource indication information is used to indicate a segment in which the related entity object appears in the related multimedia content; and transmitting the related search result information to the terminal device.

[0168] According to one or more embodiments of the present disclosure, Example 15 provides a display device for search results, comprising: an acquisition module configured to acquire at least one multimedia resource displaying an effect of using the target entity object in response to a search command for the target entity object, the multimedia resource being obtained based on multimedia content corresponding to the target entity object; and a display module configured to display the at least one multimedia resource.

[0169] According to one or more embodiments of the present disclosure, Example 16 provides a search result display device, comprising: a receiving module configured to receive a search command for a target entity object and determine multimedia content corresponding to the target entity object; a determination module configured to determine search result information based on the multimedia content corresponding to the target entity object, where the search result information includes at least one multimedia resource displaying a usage effect of the target entity object, or at least one set of multimedia data, or at least one resource indication information, where the multimedia data is image frame data using a tag of the target entity object in the multimedia content, and the resource indication information is used to indicate a segment in which the target entity object appears in the multimedia content; and a transmitting module configured to transmit the search result information to a terminal device.

[0170] According to one or more embodiments of the present disclosure, Example 17 provides a computer-readable medium having a computer program stored thereon, the computer program being capable of implementing a method according to any one of Examples 1 to 9 or any one of Examples 10 to 14 when executed by a processing device.

[0171] According to one or more embodiments of the present disclosure, Example 18 provides an electronic device comprising: a storage device having a computer program stored therein; and a processing device configured to execute the computer program in the storage device to implement the method according to any one of Examples 1 to 9 or Examples 10 to 14.

[0172] Also, although operations have been described in a particular order, it should not be understood that these operations must be performed in the particular order shown, or in a forward order. In certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although the above discussion includes a number of implementation details, these should not be understood as limiting the scope of the disclosure. Some features described in the description of a single embodiment may be implemented in combination in a single embodiment. Conversely, various features described in the description of a single embodiment may be implemented in multiple embodiments alone or in any suitable subcombination.

Claims

1. A method for displaying search results applied to a terminal device, comprising: Sending a search command to a server for a target entity object, the search command including a search keyword corresponding to the target entity object; Obtaining search result information determined by the server according to the search command, the search result information including at least one multimedia data or at least one resource indication information, the multimedia data being image frame data using a tag of the target entity object in a multimedia content, and the resource indication information being used to indicate a segment in which the target entity object appears in the multimedia content; According to the search result information, obtain at least one multimedia resource for displaying a usage effect of the target entity object, the multimedia resource being an animation image obtained according to a multimedia content corresponding to the target entity object, and the multimedia resource being a part of the multimedia content; displaying the at least one multimedia resource on a display screen of the terminal device; receiving the related search result information sent by the server; The related search result information is determined based on related multimedia content corresponding to a related entity object having an associated relationship with the target entity object, and the related search result information includes at least one related multimedia resource for displaying a usage effect of the related entity object, or at least one set of related multimedia data, or at least one related resource indication information, the related multimedia data includes image frame data using a tag of the related entity object in the related multimedia content, and the related resource indication information is used to indicate a segment in which the related entity object appears in the related multimedia content; Obtaining at least one multimedia resource for displaying the usage effect of the target entity object includes: obtaining the multimedia resource based on the search result information, the multimedia resource being generated based on at least one set of multimedia data or at least one resource indication information; and obtaining the related multimedia resource based on the related search result information, the related multimedia resource being generated based on at least one related multimedia resource that displays a usage effect of the related entity object; Displaying the at least one multimedia resource includes: The method for displaying search results includes displaying the multimedia resource in a third area of ​​a display interface, and displaying the related multimedia resource in a fourth area of ​​the display interface.

2. Recording at least one entity object used in the multimedia content and usage time information of each entity object; 2. The method of claim 1, further comprising: sending the multimedia content and attribute information of the multimedia content, including identification information and usage time information of the entity object, to a server, wherein the identification information and usage time information of the entity object are used by the server to determine a mapping relationship between the identification information of the entity object and image frame information, the image frame information representing a segment in which the target entity object appears in the multimedia content, the mapping relationship including a plurality of mapping records, each of the plurality of mapping records including a mapping between an entity object and a segment in which the entity object appears in the multimedia content.

3. The related search result information includes at least one set of multimedia data, Obtaining at least one multimedia resource for displaying the usage effect of the target entity object includes: obtaining multimedia data including image frame data using the target entity object in a multimedia content corresponding to the target entity object; The method of claim 1 , further comprising: generating the at least one multimedia resource based on the multimedia data, the at least one multimedia resource displaying a usage effect of the target entity object.

4. The related search result information includes at least one resource indication information, Obtaining at least one multimedia resource for displaying the usage effect of the target entity object includes: obtaining resource indication information corresponding to the target entity object, the resource indication information being for indicating a segment in the multimedia content in which the target entity object appears; obtaining multimedia data including image frame data using the target entity object in the multimedia content based on the resource indication information; The method of claim 1 , further comprising: generating the at least one multimedia resource based on the multimedia data, the at least one multimedia resource displaying a usage effect of the target entity object.

5. Displaying the at least one multimedia resource includes: obtaining an object identifier corresponding to the target entity object; 5. A method according to claim 1, further comprising: displaying an object identifier corresponding to the target entity object in a first area of ​​a display interface; and automatically playing the at least one multimedia resource in a second area of ​​the display interface.

6. The method of claim 5 , further comprising: in response to a trigger operation on the object identifier, jumping to a multimedia filmed scene corresponding to the target entity object.

7. Obtaining at least one multimedia resource for displaying the usage effect of the target entity object includes: A method according to any one of claims 1 to 4, comprising obtaining at least one multimedia resource that displays the effect of using an entity object set, the entity object set including the target entity object and an associated entity object that is an entity object having an associated relationship with the target entity object.

8. Displaying the at least one multimedia resource includes: If the multimedia resource is a video, displaying the multimedia resource in a first preset manner, including any one of loop playback, reverse playback, double speed playback, and window playback; The method according to claim 1 , further comprising: if the multimedia resource is an animation image, displaying the multimedia resource in a second preset manner, which comprises zooming in or zooming out.

9. A method for displaying search results applied to a server, comprising: receiving a search command for a target entity object sent from a terminal device, and determining multimedia content corresponding to the target entity object according to a search keyword corresponding to the target entity object included in the search command; determining search result information based on multimedia content corresponding to the target entity object, the search result information including at least one set of multimedia data or at least one resource indication information, the multimedia data being image frame data using a tag of the target entity object in the multimedia content, the resource indication information being used to indicate a segment in which the target entity object appears in the multimedia content; transmitting the search result information to the terminal device; after receiving a search command for the target entity object; determining an associated entity object having an associated relationship with the target entity object, and determining associated multimedia content corresponding to the associated entity object; Determine related search result information based on the related multimedia content, and the related search result information includes at least one related multimedia resource that displays the use effect of the related entity object, or at least one set of related multimedia data, or at least one related resource indication information, the related multimedia data includes image frame data using the tag of the related entity object in the related multimedia content, and the related resource indication information is used to indicate a segment in which the related entity object appears in the related multimedia content; The method of displaying search results further comprising: transmitting the related search result information to the terminal device.

10. The method further includes receiving multimedia content corresponding to any one of the entity objects and attribute information of the multimedia content corresponding to each entity object; The method of claim 9 , wherein the attribute information includes identification information and usage time information of each of the entity objects.

11. determining search result information based on multimedia content corresponding to the target entity object; Obtaining entity object information of the multimedia content, the entity object information including entity object identification information used in the multimedia content and a mapping relationship between the entity object identification information and image frame information, the image frame information representing a segment in which each entity object appears in the multimedia content; Selecting a target entity object identification information corresponding to the target entity object from the entity object identification information, and determining image frame information of the target entity object according to the mapping relationship; and generating a multimedia resource based on the multimedia content and image frame information of the target entity object.

12. determining search result information based on multimedia content corresponding to the target entity object; Obtaining entity object information of the multimedia content, the entity object information including entity object identification information used in the multimedia content and a mapping relationship between the entity object identification information and image frame information, the image frame information representing a segment in which each entity object appears in the multimedia content; Select a target entity object identification information corresponding to the target entity object and a related entity object identification information corresponding to a related entity object from the entity object identification information, and determine image frame information of the target entity object and image frame information of the related entity object according to the mapping relationship, where the related entity object is an entity object having an association relationship with the target entity object; and generating a multimedia resource based on the multimedia content, the image frame information of the target entity object and the image frame information of the related entity object.

13. A storage device in which a computer program is stored; 13. An electronic device comprising: a processing unit configured to execute the computer program in the storage device so as to implement a method according to any one of claims 1 to 4 or claims 9 to 12.

Citation Information

Patent Citations

  • Authoring device for multimedia data

    JP2001008136A

  • Multimedia data manager

    JP2004326166A

  • Graphical user interface for creating animation

    US20080072166A1

  • Matching and recommending relevant videos and media to individual search engine results

    US20080140644A1

  • Caption and / or Metadata Synchronization for Replay of Previously or Simultaneously Recorded Live Programs

    US20110069230A1