Multimedia processing method, device, equipment, medium and computer program product
By displaying the first form of multimedia in the social page and displaying the associated page in response to the trigger event, the problem of low information acquisition efficiency in social scenarios is solved, and the convenience and efficiency of information acquisition are improved.
Patent Information
- Application Number
- CN202210007959.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-01-04
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2042-01-04
AI Technical Summary
In social scenarios, it is difficult for users to obtain multimedia information efficiently, and the existing technology cannot effectively improve the efficiency and convenience of information acquisition.
By displaying the first form of multimedia in the social page and displaying its second form in response to the trigger event, it prompts that the associated page has been searched, and the user can obtain more information from the associated page.
It improves the efficiency and convenience of information acquisition in social scenarios, and users can quickly obtain detailed information related to multimedia.
Smart Images

Figure CN116431947B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a multimedia processing method, device, equipment, medium and computer program product. Background Art
[0002] Social applications allow users to conduct social activities and information exchange through the Internet. For example, users can exchange information (instant messaging), share dynamics, and share online status through social applications. They can also transmit multimedia such as text, images, audio, video, and documents through social applications to achieve information exchange between users. Due to the complexity of multimedia, how to improve the efficiency of information acquisition in social scenarios is a current research hotspot. Summary of the invention
[0003] The embodiments of the present application provide a multimedia processing method, apparatus, device, storage medium and computer program product, which can improve the efficiency and convenience of information acquisition in social scenarios.
[0004] On the one hand, an embodiment of the present application provides a multimedia processing method, including:
[0005] Displaying a social page, wherein the social page includes target multimedia, and the target multimedia is displayed in a first form;
[0006] In response to the first form of the target multimedia being triggered, displaying a second form of the target multimedia, wherein the second form is used to prompt that an associated page of the target multimedia has been searched, and the page content of the associated page matches the multimedia content of the target multimedia;
[0007] When the target multimedia of the second form is triggered, the associated page is displayed.
[0008] On the one hand, an embodiment of the present application provides a multimedia processing device, characterized in that the multimedia processing device includes a processing unit and an output unit, and the processing unit and the output unit are used to execute the above-mentioned multimedia processing method.
[0009] On the one hand, an embodiment of the present application provides a multimedia processing device, characterized in that the multimedia processing device includes an input interface and an output interface, and further includes:
[0010] a processor adapted to implement one or more instructions; and,
[0011] A computer storage medium storing one or more instructions, wherein the one or more instructions are suitable for being loaded by the processor and executing the multimedia processing method.
[0012] On the one hand, an embodiment of the present application provides a computer storage medium, characterized in that computer program instructions are stored in the computer storage medium, and when the computer program instructions are executed by a processor, they are used to execute the above-mentioned multimedia processing method.
[0013] On the one hand, an embodiment of the present application provides a computer program product or a computer program, the computer program product includes a computer program, and the computer program is stored in a computer storage medium; the processor of the multimedia processing device reads the computer program from the computer storage medium, and the processor executes the computer program, so that the multimedia processing device performs the above-mentioned multimedia processing method.
[0014] In an embodiment of the present application, a first form of target multimedia is displayed in a social page, and in response to the first form of target multimedia being triggered, a second form of the target multimedia is displayed, and the second form is used to prompt that the associated page of the target multimedia has been searched; here, the first form of target multimedia is triggered, which can indicate that there is a need to further search for related information of the target multimedia, so the first form of target multimedia can be identified, and its associated page can be searched based on the identification result, and the target multimedia can be displayed in the second form to remind the user to view the searched associated page. When the second form of target multimedia is triggered, the associated page is displayed, and the user can obtain more information related to the target multimedia from the associated page, which effectively improves the efficiency and convenience of information acquisition in social scenarios. BRIEF DESCRIPTION OF THE DRAWINGS
[0015] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0016] Figure 1 is a structural schematic diagram of a multimedia processing system provided in an embodiment of the present application;
[0017] Figure 2 It is a flowchart of a multimedia processing method provided by an embodiment of the present application;
[0018] Figure 3 is a schematic diagram of a session page provided in an embodiment of the present application;
[0019] Figure 4 is a schematic diagram of a friend dynamic page provided in an embodiment of the present application;
[0020] Figure 5 is a schematic diagram of a status label and status description text provided in an embodiment of the present application;
[0021] Figure 6a This is a schematic diagram of a status query page for a target social friend provided in an embodiment of the present application;
[0022] Figure 6b It is a schematic diagram of a triggering display of a status query page of a target friend provided in an embodiment of the present application;
[0023] Figure 7 is a schematic diagram of a topic page provided in an embodiment of the present application;
[0024] Figure 8a is a schematic diagram of a second form of target multimedia including interactive tags provided by an embodiment of the present application;
[0025] Figure 8b is a schematic diagram of another target multimedia in a second form including an interactive tag provided in an embodiment of the present application;
[0026] Figure 8c is a schematic diagram of another target multimedia in a second form including an interactive tag provided in an embodiment of the present application;
[0027] Figure 8d is a schematic diagram of another target multimedia in a second form including an interactive tag provided in an embodiment of the present application;
[0028] Figure 9a is a schematic diagram of a second form of target multimedia including an associated page trigger control provided by an embodiment of the present application;
[0029] Figure 9b is a schematic diagram of another target multimedia of a second form including an associated page trigger control provided by an embodiment of the present application;
[0030] Fig.9c is a schematic diagram of another target multimedia of a second form including an associated page trigger control provided by an embodiment of the present application;
[0031] Figure 9d is a schematic diagram of another target multimedia of a second form including an associated page trigger control provided by an embodiment of the present application;
[0032] Fig.10a is a schematic diagram of a second form of target multimedia including multiple associated page trigger controls provided by an embodiment of the present application;
[0033] Fig.10b is a schematic diagram of another target multimedia of a second form including multiple associated page trigger controls provided by an embodiment of the present application;
[0034] Fig.10c is a schematic diagram of another target multimedia of a second form including multiple associated page trigger controls provided by an embodiment of the present application;
[0035] Fig.11 It is a schematic diagram of displaying page description information of an associated page based on an associated page trigger control provided by an embodiment of the present application;
[0036] Fig.12a It is a schematic diagram of triggering the display of an associated page of target multimedia provided by an embodiment of the present application;
[0037] Figure 12b It is a schematic diagram of an associated page for displaying target multimedia based on an interactive tag trigger provided by an embodiment of the present application;
[0038] Fig.12c It is a schematic diagram of triggering display of an associated page of a target multimedia based on an associated page trigger control provided by an embodiment of the present application;
[0039] Fig.12d It is a schematic diagram of displaying associated pages based on a candidate list provided in an embodiment of the present application;
[0040] Fig.12e It is a schematic diagram of triggering display of associated pages based on multiple associated page trigger controls provided by an embodiment of the present application;
[0041] Fig.13a It is a schematic diagram of triggering a related page for displaying target multimedia from a social page provided by an embodiment of the present application;
[0042] Fig.13b It is a schematic diagram of another method of triggering the display of a target multimedia associated page from a social page provided by an embodiment of the present application;
[0043] Fig.13c It is a schematic diagram of another method of triggering the display of a target multimedia associated page from a social page provided by an embodiment of the present application;
[0044] Fig.13d It is a schematic diagram of another method of triggering the display of a target multimedia associated page from a social page provided by an embodiment of the present application;
[0045] Fig.14 is a schematic diagram of displaying a second form of target multimedia in a social page provided by an embodiment of the present application;
[0046] Fig.15 is a flowchart of another multimedia processing method provided in an embodiment of the present application;
[0047] Fig.16It is a schematic diagram of performing multi-dimensional recognition processing on target multimedia provided by an embodiment of the present application;
[0048] Fig.17 is a schematic diagram of determining access link information provided by an embodiment of the present application;
[0049] Fig.18 It is a schematic diagram of obtaining access link information of associated pages based on a server provided in an embodiment of the present application;
[0050] Fig.19 is a schematic diagram of displaying a second form of target multimedia based on a label control provided by an embodiment of the present application;
[0051] Fig.20a It is a schematic diagram of displaying associated pages based on obtaining access link information of associated pages provided by an embodiment of the present application;
[0052] Fig.20b It is another schematic diagram of displaying associated pages based on obtaining access link information of associated pages provided by an embodiment of the present application;
[0053] Fig.21 is a structural schematic diagram of a multimedia processing device provided in an embodiment of the present application;
[0054] Fig. 22 It is a structural schematic diagram of a multimedia processing device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0055] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0056] The following is an introduction to the technical terms involved in the embodiments of the present application:
[0057] 1. Social Applications:
[0058] In a narrow sense, social applications can refer to social APPs (Applications) that correspond to servers and provide local services to users. Such social applications may include but are not limited to: instant messaging APPs, map social APPs, content interaction APPs, game social APPs, etc. In a broad sense, social applications can also refer to websites with social capabilities that correspond to servers and provide local services to users, such as social networking sites, forums, etc. Users can use social applications to conduct social activities such as information exchange (instant messaging), dynamic sharing, and online status sharing, and can transmit interactive multimedia in social activities, which may include but are not limited to: text, images, audio, video, documents, etc.
[0059] 2. Social Conversation:
[0060] The social application supports social conversations, which may include individual conversations and group chat conversations. An individual conversation refers to a social conversation in which two users participate, and is used to exchange information between the two users. A group chat conversation refers to a social conversation in which multiple (greater than two) users participate, and is used to exchange information between the multiple users. It should be noted that when the number of people participating in a social conversation exceeds a threshold number (e.g., 100,000), the social conversation may also be called a super community.
[0061] 3. Social Pages:
[0062] Social applications provide various social pages. Social pages refer to pages presented when social applications provide social services. Such social pages may include but are not limited to: conversation pages, friend dynamic pages, status query pages, topic pages, etc. Among them, conversation pages refer to pages used to present the conversation message stream of social conversations; users participating in social conversations can post conversation messages in conversation pages and browse conversation messages posted by other users, thereby achieving social communication. Friend dynamic pages refer to pages used to view the dynamics of social friends. Dynamics here refer to a way of publishing temporary content, which may include but is not limited to music, pictures, videos, text, etc. Status query pages refer to pages used to query the online status of social friends. The online status here is used to describe the current status of social friends, including but not limited to: online status, offline status, playing music, watching TV, running, etc.
[0063] 4. Mini Programs:
[0064] Mini Programs are lightweight applications that do not require downloading or installation and can realize almost all the functions of an APP. Mini Programs are usually run as sub-applications of an APP. For example, a social application can contain many Mini Programs; a payment APP can also contain many Mini Programs.
[0065] It is particularly important to note that in the subsequent specific implementation methods of this application, when it comes to user conversation messages, dynamics, online status and other related data, when the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards of relevant countries and regions.
[0066] A social page usually contains a lot of multimedia, which can be pictures, audio and video, etc. For example, a user sends a picture in a conversation page; another example is a user posts a video dynamic; etc. Under this premise, if a user is interested in a certain multimedia, there is a need to further search for information related to the multimedia; for example, it is hoped to find restaurants, flight information, electronic ID cards, bank services, commodity services, etc. based on the multimedia. In order to meet the search demand and achieve quick and convenient acquisition of more information in a social scene, the embodiment of the present application proposes the following multimedia processing scheme: displaying the first form of target multimedia in the social page, where the first form may refer to the form in which the target multimedia has not been identified and searched, for example, pictures that have been sent in the conversation page and have not been identified and searched. In response to the first form of the target multimedia being triggered, the second form of the target multimedia is displayed, and the second form is used to prompt that the associated page of the target multimedia has been searched; here, the first form of the target multimedia is triggered, which may indicate that the target multimedia has a need to further search for related information, then the background can identify the first form of the target multimedia, search its associated page based on the recognition result, and display the target multimedia in the second form to remind the user to view the associated page that has been searched. When the second form of target multimedia is triggered, the related page is displayed, and the user can obtain more information related to the target multimedia from the related page, which effectively improves the efficiency and convenience of information acquisition in social scenarios.
[0067] The present application embodiment provides a multimedia processing system. Figure 1 , is a structural diagram of a multimedia processing system provided in an embodiment of the present application. Figure 1 The multimedia processing system shown may include a terminal device 101 and a server 102. Among them:
[0068] The terminal device 101 may include but is not limited to a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, a vehicle-mounted terminal, a smart wearable device, etc. The terminal device is often configured with a display device, which may be a display, a display screen, a touch screen, etc. The touch screen may be a touch screen, a touch panel, etc. Various applications (APPs) may be run on the terminal device 101, such as social applications, browser applications, conference applications, etc. In one implementation of an embodiment of the present application, a social application is run in the terminal device 101, and the social application supports access to a mini-program, which may include but is not limited to: a food service mini-program, an Internet call mini-program, an e-commerce shopping mini-program, an electronic invoicing mini-program, etc. The present application does not limit the category of the mini-program.
[0069] The server 102 may be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms. In one implementation of the embodiment of the present application, a social application is running in the terminal device 101, and the server 102 may be a server corresponding to the social application, providing service support for the social application, for example, providing service support for the instant messaging service provided by the social application, providing service support for the dynamic sharing service provided by the social application, and providing service support for the online status sharing service provided by the social application. The terminal device 101 and the server 102 may be directly or indirectly connected in communication via wired or wireless communication, and this application does not limit this.
[0070] based on Figure 1 The multimedia processing system shown can implement the multimedia processing solution provided in the embodiment of the present application. The multimedia processing flow involved in the multimedia processing system is introduced below:
[0071] The terminal device 101 displays the target multimedia in the first form in the social page. The first form here may refer to the form in which the target multimedia has not been identified and searched, for example: a picture that has been sent in the conversation page and has not been identified and searched. In response to the first form of the target multimedia being triggered, the terminal device 101 displays the second form of the target multimedia, and the second form is used to prompt that the associated page of the target multimedia has been searched; here, the first form of the target multimedia is triggered, which may indicate that there is a need to further search for relevant information about the target multimedia, then the terminal device 101 can obtain the associated page of the target multimedia, and display the target multimedia in the second form to remind the user to view the associated page that has been searched. When the second form of the target multimedia is triggered, the terminal device 101 displays the associated page, and the user can obtain more information related to the target multimedia from the associated page.
[0072] Among them, the social page refers to any service page in the social application; the target multimedia can be any multimedia displayed in the social page, and the target multimedia can be received by the terminal device 101 and displayed in the social page. For example, the target multimedia can be an image sent by other users (such as the second user) and received by the first user through the terminal device 101, that is, after the terminal device 101 of the first user receives the image sent by the second user, when the social page is displayed, the image is displayed in the social page, wherein the first user is any user who uses the service provided by the social application. For the sake of convenience, the embodiments of the present application are subsequently described with the first user. The first form of the target multimedia is used to indicate that the target multimedia is in a state that has not yet been identified, that is, it is used to prompt that the associated page of the target multimedia has not yet been searched for the target multimedia; the second form of the target multimedia is used to indicate that the target multimedia is in a state that has been identified, that is, it is used to prompt that the associated page of the target multimedia has been searched for the target multimedia, and the associated page of the target multimedia has been searched. The page content of the target multimedia's associated page matches the multimedia content of the target multimedia, that is, the target multimedia's associated page may refer to a page whose page content matches the multimedia content of the target multimedia; for example, if the target multimedia is an image, and the image content of the image is a cake, then the target multimedia's associated page may be a cake's sales details page, a cake's production details page, etc. The target multimedia's associated page may be a mini-program page in a social application, a service page in other applications outside of a social application, a web page, etc.
[0073] Among them, the target multimedia of the second form carries the access link information of the associated page of the target multimedia, and the access link information contains the access path of the associated page of the target multimedia. When the target multimedia of the second form is triggered, the terminal device 101 can jump to the associated page based on the access link information and display it. The access link information of the associated page of the target multimedia carried in the target multimedia of the second form can be obtained by the terminal device 101 from the server 102; that is, the terminal device 101 can call the associated page search service provided by the server 102 at any time after receiving the target multimedia to obtain the access link information of the associated page of the target multimedia returned by the server 102. Exemplarily, any time after the terminal device 101 receives the target multimedia can be: after the terminal device 101 receives the target multimedia, before the first form of the target multimedia is displayed in the social page; or, after the terminal device 101 receives the target multimedia, when the first form of the target multimedia is displayed in the social page; or, after the terminal device 101 receives the target multimedia, after the first form of the target multimedia is displayed in the social page, or, when the terminal device 101 detects that the first form of the target multimedia is triggered, and so on. The terminal device 101 calls the associated page search service provided by the server 102 to obtain the access link information of the associated page of the target multimedia returned by the server 102. Specifically, it can be: the terminal device 101 sends an associated page search request to the server 102 to request to search the associated page of the target multimedia, and the associated page search request carries the target multimedia; after receiving the associated page search request, the server 102 searches for the access link information of the associated page of the target multimedia for the target multimedia, and after searching for the access link information of the associated page, returns the access link information to the terminal device 101.
[0074] In one embodiment, the access link information of the associated page of the target multimedia carried in the second form of the target multimedia can be obtained by searching by the terminal device 101, that is, the terminal device 101 can search for the access link information of the associated page of the target multimedia for the target multimedia at any time after receiving the target multimedia.
[0075] In one embodiment, the social page can be any service page in a social application, and the target multimedia can be any multimedia displayed in the social page, that is, for the target multimedia displayed in the first form contained in any service page of the social application, the terminal device 101 can determine the associated page of the target multimedia based on the search for the target multimedia, and then display the associated page of the target multimedia. Specifically, for the target multimedia displayed in the first form contained in any service page of the social application, the terminal device 101 can determine the associated page of the target multimedia based on the search for the target multimedia; and in response to the first form of the target multimedia being triggered, the second form of the target multimedia for prompting that the associated page of the target multimedia has been searched is displayed, and when the second form of the target multimedia is triggered, the associated page is displayed. It is worth noting that the first form of the target multimedia is used to indicate that the target multimedia is in a state that has not yet been identified; the second form of the target multimedia is used to indicate that the target multimedia is in a state that has been identified, and the associated page of the target multimedia has been searched; the first form and the second form of the target multimedia when displayed can be designed differently according to different needs, that is, for the target multimedia in different social pages, the target multimedia in different social pages can be displayed as different interface representations when displayed in the first form, and can be displayed as different interface representations when displayed in the second form. It is easy to understand that as long as all interface representations that can implement the multimedia processing method provided in the embodiments of the present application are within the protection scope of the embodiments of the present application.
[0076] In an embodiment of the present application, a first form of target multimedia is displayed in a social page, and in response to the first form of target multimedia being triggered, a second form of the target multimedia is displayed, and the second form is used to prompt that the associated page of the target multimedia has been searched; here, the first form of target multimedia is triggered, which can indicate that there is a need to further search for related information of the target multimedia, so the first form of target multimedia can be identified, and its associated page can be searched based on the identification result, and the target multimedia can be displayed in the second form to remind the user to view the searched associated page. When the second form of target multimedia is triggered, the associated page is displayed, and the user can obtain more information related to the target multimedia from the associated page, which effectively improves the efficiency and convenience of information acquisition in social scenarios.
[0077] The multimedia processing method proposed in the embodiment of the present application is described in detail below. It should be noted that the multimedia processing method can be executed by a multimedia processing device, which can be Figure 1 The terminal device in the multimedia processing system shown in FIG. 1 can independently complete the corresponding process of the multimedia processing method; of course, the terminal device can also Figure 1The relevant process of the multimedia processing method is completed with the assistance of the server shown. Figure 2 , Figure 2 : is a flowchart of a multimedia processing method exemplarily provided in an embodiment of the present application, and the multimedia processing method may include the following steps:
[0078] S201, displaying a social page.
[0079] Among them, the social page can be any service page in the social application; the social page contains the target multimedia, and the target multimedia is displayed in the first form; the target multimedia can be any multimedia displayed in the social page, and the target multimedia can be received by the terminal device and displayed in the social page; the first form of the target multimedia is used to indicate that the target multimedia is in a state that has not yet been recognized, that is, it is used to prompt that the associated page of the target multimedia has not yet been searched for the target multimedia. For the sake of ease of explanation, the embodiments of this application are hereinafter explained by taking the social page corresponding to the first user who uses the service provided by the social application as an example, that is, the social page is a social page displayed in the terminal device of the first user.
[0080] For example, in a social scenario of a social conversation, a social page may be a conversation page in a social application; if the conversation page is a conversation page corresponding to a first user using a service provided by a social application, the conversation page may be a conversation page for the first user to have a conversation with any of the first user's social friends, or a conversation page for the first user to have a conversation with any of the user groups to which he belongs, or a conversation page for the first user to have a temporary conversation with a stranger using the social application, and so on. The conversation page may include one or more conversation messages, and any of the one or more conversation messages may be generated based on multimedia sent by the first user or a conversation user having a conversation with the first user. The conversation page includes a target conversation message, and the target conversation message is any of the one or more conversation messages, and the multimedia included in the target conversation message is the target multimedia in a first form, that is, the first form of the target multimedia may be the interface presentation when the target multimedia is displayed based on the conversation message. See. Figure 3 , is a schematic diagram of a conversation page provided in an embodiment of the present application, which includes four conversation messages generated by a conversation between a first user and a second user. If the first user triggers a conversation message as indicated by the 301 mark among the four conversation messages, and the conversation message includes an image sent by the second user, then the first form of target multimedia is the image displayed based on the conversation message as indicated by the 301 mark.
[0081] For another example, in a social scenario of dynamic sharing, the social page may be a friend dynamic page in a social application; if the friend dynamic page is a friend dynamic page corresponding to a first user using a service provided by a social application, the friend dynamic page may include one or more dynamic messages, and any of the one or more dynamic messages may be generated based on multimedia posted by the first user or the first user's social friend, such as dynamic information generated based on posted text that only contains text, dynamic information generated based on posted images that only contain images, dynamic information generated based on posted text and images that contain text and images, and so on; that is, a dynamic message may include at least one of a variety of media such as text, image, audio, video, etc. The friend dynamic page includes a target dynamic message, which is any one of the one or more dynamic messages, and the multimedia included in the target dynamic message is the first form of the target multimedia, that is, the first form of the target multimedia may be the interface presentation when the target multimedia is displayed based on the dynamic message. See. Figure 4 , is a schematic diagram of a friend dynamic page provided in an embodiment of the present application, which includes two dynamic messages posted by a first user and a second user. If the first user triggers a dynamic message as indicated by the 401 mark among the two dynamic messages, and the dynamic message includes an image posted by the second user, then the first form of target multimedia is the image displayed based on the dynamic message as indicated by the 401 mark.
[0082] For another example, in a social scenario of online status sharing, the social page may be a status query page of a target social friend in a social application; the status query page may be a status query page of the first user triggered by the first user or a status query page of any social friend of the first user, that is, the target social friend here may refer to the first user or any social friend of the first user. The status query page may include identity information of the target social friend, and the identity information of the target social friend may include a nickname, an identifier (i.e., an account ID, Identity document), an avatar, etc. of the target social friend; the status query page may also include status content posted by the target social friend, and the status content may be used to indicate the online status of the target social friend, for example, it may include a status tag set by the target social friend, a status description text, and a status description image, etc., and the first form of target multimedia included in the status content is the status description image included in the status content.
[0083] The status label set for the target social friend is one of multiple status labels, and the multiple status labels can be icons designed based on specific business requirements to represent the user's online status. One status label corresponds to a status description text for describing the specific meaning of the status label. The status description text set for the target social friend is the status description text corresponding to the status label set for the target social friend. The status description image set for the target social friend can be any image set by the target social friend according to their preferences. See Figure 5 , which is a schematic diagram of a status label and a status description text provided by an embodiment of the present application. One of the status labels can be as marked by 501. This status label is used to describe the mood and thoughts, and the status description text corresponding to this status label is "very happy". It should be noted that Figure 5 The status labels included in are exemplary status labels and can be set according to specific business requirements. For example, it can also include online status, offline status, listening to music, watching TV, running, etc. See Figure 6a , which is a schematic diagram of a status query page for a target social friend provided by an embodiment of the present application. The target social friend is the second user. The status label included in the status content set for the target social friend can be as marked by 601. The status description text of the status label marked by 601 is "very happy". The status description image included in the status content set for the target social friend can be as marked by 602, that is, the target multimedia in the first form is the status description image marked by 602 shown in this status query page. Further, the status query page of the target social friend can be triggered based on a status list. The status list can include one or more status representation items; different status representation items in the one or more status representation items are used to trigger the display of status query pages of different social friends. One of the status representation items in the one or more status representation items can include: the identity information of a social friend who has set an online status and the status content set by this social friend. See Figure 6b , which is a schematic diagram of triggering the display of a status query page for a target friend provided by an embodiment of the present application. If both the second user and the third user among the social friends of the first user have set an online status, the status list can be as marked by 611. If the first user triggers the status representation item corresponding to the second user in the status list, the terminal device can display the status query page of the second user marked by 612.
[0084] For another example, in a social scenario of topic exchange, a social page may be a topic page in a social application; if the topic page is a topic page corresponding to a first user using a service provided by a social application, the topic page may be a page describing any topic triggered by the first user, and any topic triggered by the first user may be posted by any user, such as the first user or any social friend of the first user. Users with browsing rights to the topics in the topic page may view the topic page, and users with comment rights to the topic may comment on the topic to achieve communication between users. The topic page may contain topic content describing the topic, such as a topic title, topic description content, and topic replies; a topic reply may refer to content posted by a user with comment rights to the topic that can be used to express the user's opinion on the topic; the topic description content and topic replies may contain multimedia such as text, audio, image, and video. The multimedia displayed based on the topic page is all multimedia in the first form; the topic page contains target multimedia in the first form, and the target multimedia in the first form may be any multimedia contained in the topic page, such as an image, a video, and the like. See Figure 7 , which is a schematic diagram of a topic page provided in an embodiment of the present application. The topic title in the topic page can be as indicated by the 701 mark. For example, the first user is about to trigger the image as indicated by the 702 mark in the topic page, then the first form of target multimedia in the topic page is the image as indicated by the 702 mark.
[0085] S202: In response to the first form of the target multimedia being triggered, display a second form of the target multimedia.
[0086] The second form is used to indicate that the associated page of the target multimedia has been searched; the second form of the target multimedia is used to indicate that the target multimedia is in a recognized state, that is, it is used to indicate that the search for the associated page of the target multimedia has been completed for the target multimedia, and the associated page of the target multimedia has been searched. The page content of the associated page of the target multimedia matches the multimedia content of the target multimedia.
[0087] In one embodiment, the second form of the target multimedia can be displayed based on a multimedia browsing window, and the multimedia browsing window can be a page window different from the social page, or a pop-up window covering the social page, etc.; the embodiment of the present application does not limit the specific display method of the multimedia browsing window, and the interface performance of the multimedia browsing window that can realize the display of the second form of multimedia is within the protection scope of the embodiment of the present application. Specifically, when the terminal device responds to the first form of the target multimedia being triggered and displays the second form of the target multimedia, it can include: outputting a multimedia browsing window in response to the first form of the target multimedia being triggered; displaying the second form of the target multimedia in the multimedia browsing window. That is, the terminal device can output a multimedia browsing window in response to the triggering operation executed on the first form of the target multimedia; and displaying the second form of the target multimedia in the multimedia browsing window. The triggering operation may include, but is not limited to, any of the following: a click operation, a press gesture operation, and a floating gesture operation.
[0088] In one embodiment, the second form of target multimedia may include an interactive tag, and the interactive tag is used to prompt the existence of social friends associated with the target multimedia; wherein the display mode of the interactive tag in the second form of target multimedia includes any of the following: displaying at any position in the second form of target multimedia; or, the interactive tag is suspended and displayed in the second form of target multimedia; or, the interactive tag is hidden by default and is displayed only when there is a stay signal in the second form of target multimedia; the interactive tag includes any of the following: prompt text, prompt animation, identity information of social friends; identity information includes any of the following: nickname, logo, avatar. wherein the interactive tag is used to prompt the existence of social friends associated with the target multimedia, that is, there are social friends who have associated behaviors with the multimedia content in the target multimedia, for example, if the target multimedia is an image containing a cake, then the social friends associated with the target multimedia may be users who have eaten the cake in the target multimedia; if the target multimedia is an image containing a scenic spot, then the social friends associated with the target multimedia may be users who have been to the scenic spot in the target multimedia. The interactive tag includes tag content, which is the content used to prompt the existence of social friends who are associated with the target multimedia; the tag content can be the above-mentioned prompt text, prompt animation or identity information of social friends. The prompt text can be designed according to specific business needs. For example, "Friends are eating" or "Friends XX are eating" can be used to indicate that there are social friends who have eaten the multimedia content included in the target multimedia, "Friends are playing" or "Friends XX are playing" can be used to indicate that there are social friends who have played the multimedia content included in the target multimedia, such as toys included in the target multimedia, etc., "Friends have been" or "Friends XX have been" can be used to indicate that there are social friends who have been to the places included in the target multimedia, and "Friends are buying" or "Friends XX are buying" can be used to indicate that there are social friends who have bought the multimedia content included in the target multimedia, such as sunflowers included in the target multimedia. The prompt animation can also be an animation designed according to specific business needs. For example, the prompt animation can be a constantly lit icon (such as a constantly lit circular icon, square icon, etc.), or an icon that flashes at a certain frequency, etc.Among them, when the interactive tag is hidden by default and is only displayed when there is a stay signal in the target multimedia of the second form, the stay signal may be a stay signal such as a long press or a double click detected by the terminal device. When there is a stay signal in the target multimedia of the second form, the interactive tag may be displayed in the target multimedia of the second form based on the above-mentioned methods, for example, displayed at any position in the target multimedia of the second form; or, the interactive tag is displayed in a floating manner in the target multimedia of the second form; or, the interactive tag is displayed around the target multimedia of the second form, and so on.
[0089] Taking the interactive tag containing the prompt text as an example, assuming that the multimedia content of the second form of the target multimedia is a cake, the interactive tag can be "Friends are eating"; see Figure 8a , is a schematic diagram of a second form of target multimedia including an interactive tag provided by an embodiment of the present application, wherein the interactive tag is displayed in the upper left corner of the second form of target multimedia, as specifically indicated by the mark 801; see Figure 8b , which is a schematic diagram of another target multimedia of the second form including an interactive tag provided by an embodiment of the present application, wherein the interactive tag is suspended and displayed in the target multimedia of the second form, as specifically indicated by the mark 802; see Figure 8c , which is a schematic diagram of another second form of target multimedia including an interactive tag provided by an embodiment of the present application, wherein the interactive tag is displayed around the second form of target multimedia, specifically on the right side of the second form of target multimedia, as indicated by the mark 803; see Figure 8d , which is a schematic diagram of another second-form target multimedia including an interactive tag provided as an example in an embodiment of the present application. The interactive tag is hidden by default. At this time, the second-form target multimedia can be as shown by mark 804. The interactive tag is only displayed when there is a stay signal in the second-form target multimedia. For example, when there is a long press stay signal in the second-form target multimedia, the interactive tag is displayed in the upper left corner of the second-form target multimedia, which can be specifically shown by mark 805.
[0090] In one embodiment, the target multimedia of the second form may include an associated page trigger control, wherein the associated page trigger control is used to trigger the display of the associated page of the target multimedia, and the interface performance and display position of the associated page trigger control can be designed according to specific needs; the display mode of the associated page trigger control in the target multimedia of the second form may include any of the following: displayed at any position in the target multimedia of the second form; or, the associated page trigger control is displayed in a floating manner in the target multimedia of the second form; or, the associated page trigger control is displayed around the target multimedia of the second form; or, the associated page trigger control is hidden by default and is displayed only when a stay signal exists in the target multimedia of the second form. Wherein, in the case where the associated page trigger control is hidden by default and is displayed only when a stay signal exists in the target multimedia of the second form, the stay signal may be a stay signal such as a long press or double click detected by the terminal device. When a stay signal exists in the target multimedia of the second form, the associated page trigger control may be displayed in the target multimedia of the second form based on the above-mentioned modes, for example, displayed at any position in the target multimedia of the second form; or, the associated page trigger control is displayed in a floating manner in the target multimedia of the second form; or, the associated page trigger control is displayed around the target multimedia of the second form, and so on. See. Figure 9a , is a schematic diagram of a second form of target multimedia including an associated page trigger control provided by an embodiment of the present application, wherein the associated page trigger control is displayed in the lower right corner of the second form of target multimedia, as specifically indicated by the mark 901; see Figure 9b , is a schematic diagram of another target multimedia of a second form including an associated page trigger control provided by an embodiment of the present application, wherein the associated page trigger control is suspended and displayed in the target multimedia of the second form, as specifically indicated by the mark 902; see Fig.9c , is a schematic diagram of another target multimedia of the second form including an associated page trigger control provided by an embodiment of the present application, wherein the associated page trigger control is displayed around the target multimedia of the second form, specifically on the right side of the target multimedia of the second form, as indicated by the mark 903; see Figure 9d , is a schematic diagram of another target multimedia of the second form including an associated page trigger control provided as an example in an embodiment of the present application. The associated page trigger control is hidden by default. At this time, the target multimedia of the second form can be as shown by mark 904. The associated page trigger control is only displayed when there is a dwell signal such as a long press in the target multimedia of the second form. For example, when there is a dwell signal in the target multimedia of the second form, the associated page trigger control can be as shown by mark 905.
[0091] In one embodiment, the number of associated pages of the target multimedia can be multiple, that is, based on the search for the target multimedia, multiple pages whose page content matches the multimedia content of the target multimedia are determined; the second form of the target multimedia can include multiple associated page trigger controls, each associated page trigger control is used to trigger the display of an associated page of the target multimedia; the interface performance and display position of multiple associated page trigger controls can be designed according to specific needs; the display method of multiple associated page trigger controls in the second form of the target multimedia can include any of the following: randomly distributed and displayed in the second form of the target multimedia; sequentially arranged and displayed in the second form of the target multimedia; displayed around the second form of the target multimedia. Furthermore, in order to distinguish different associated pages of the target multimedia corresponding to different associated page trigger controls, the interface performance of the associated page trigger controls used to trigger the display of different associated pages can be different, and the interface performance of each associated page trigger control can be designed according to specific needs. Assuming that the number of associated pages of the target multimedia is 3, the second form of the target multimedia contains 3 associated page trigger controls; see Fig.10a , is a schematic diagram of a second form of target multimedia including multiple associated page trigger controls provided by an embodiment of the present application. At this time, the multiple associated page trigger controls are randomly distributed and displayed in the second form of target multimedia. One of the multiple associated page trigger controls can be shown as marked 1001; see Fig.10b , is a schematic diagram of another target multimedia of the second form including multiple associated page trigger controls provided by an embodiment of the present application. At this time, the multiple associated page trigger controls are sequentially arranged and displayed in the target multimedia of the second form, and the specific sequence is displayed below the target multimedia of the second form. One of the multiple associated page trigger controls can be shown as marked 1002; see Fig.10c , which is a schematic diagram of another target multimedia of the second form including multiple associated page trigger controls provided as an example in an embodiment of the present application. The multiple associated page trigger controls are displayed around the target multimedia of the second form, and specifically can all be displayed on the right side of the target multimedia of the second form. One of the multiple associated page trigger controls can be shown as marked 1003.
[0092] Furthermore, in order to distinguish different associated pages of the target multimedia corresponding to different associated page trigger controls, when the terminal device detects a pause signal for any associated page trigger control among multiple associated page trigger controls, the terminal device can display the page description information of the associated page pointed to by any associated page trigger control, and the page description information is used to describe the associated page. Furthermore, when the terminal device detects that the pause signal for the associated page trigger control disappears, the page description information of the associated page pointed to by the associated page trigger control is canceled. The pause signal may be a pause signal such as a long press or a double click detected by the terminal device. For example, assuming that the number of associated pages of the target multimedia is 3, the second form of the target multimedia includes 3 associated page trigger controls, namely associated page trigger control 1, associated page trigger control 2 and associated page trigger control 3, and the 3 associated page trigger controls point to associated page 1, associated page 2 and associated page 3, respectively; Fig.11 As shown, it is a schematic diagram of displaying page description information of an associated page based on an associated page trigger control provided in an embodiment of the present application. If the first user long presses the associated page trigger control 1 as shown by the mark 1101, the terminal device detects a stay signal for the associated page trigger control 1, and displays the page description information of the associated page 1 pointed to by the associated page trigger control 1. The page description information can be specifically displayed as "Matcha Thousand Layer XX Shop" as shown by the mark 1102.
[0093] S203: When the target multimedia of the second form is triggered, a related page is displayed.
[0094] Among them, the page content of the associated page of the target multimedia matches the multimedia content of the target multimedia, that is, the associated page of the target multimedia can be a page whose page content matches the multimedia content of the target multimedia; for example, if the target multimedia is an image, and the image content of the image is a cake, then the associated page of the target multimedia can be a cake sales details page, a cake production details page, and so on.
[0095] In one embodiment, the associated page of the target multimedia can be a mini-program page in a social application, a service page in other applications outside the social application, a web page, and so on. When the associated page of the target multimedia is a mini-program page in a social application, when the second form of the target multimedia is triggered, the terminal device can display the associated page based on the social application, that is, it can display the mini-program page based on the social application. When the associated page of the target multimedia is a service page in other applications outside the social application, when the second form of the target multimedia is triggered, the terminal device can display the associated page based on the social application, that is, it can display the service page in the other application based on the social application; it can also display the associated page based on the other application, that is, it can display the service page in the other application based on the other application. In a feasible implementation, when the associated page of the target multimedia is a service page in an application other than a social application, when the second form of the target multimedia is triggered, the terminal device can display the associated page based on the social application, and a jump control is displayed in the associated page, and the jump control is used to jump to the other application to display the associated page; when the jump control is triggered, the terminal device detects whether the other application is installed in the terminal device, and if it is detected that the terminal device has the other application installed, the other application is started, and the associated page is displayed based on the other application; if the terminal device is not detected to have the other application installed, it jumps to the application download page, downloads the other application based on the first user's confirmation operation on downloading the other application, and after the download is completed, the other application is started and the associated page is displayed based on the other application. When the associated page of the target multimedia is a web page, when the second form of the target multimedia is triggered, the terminal device can display the associated page based on the social application, that is, the web page can be displayed based on the social application; it can also display the associated page based on the browser installed in the terminal device, that is, the web page can be displayed based on the browser installed in the terminal device. In a feasible implementation, when the associated page of the target multimedia is a web page, when the second form of the target multimedia is triggered, the terminal device can display the associated page based on the social application, and a jump control is displayed in the associated page, and the jump control is used to jump to the browser to display the associated page; when the jump control is triggered, the terminal device starts the browser and displays the associated page based on the browser.
[0096] In one embodiment, when the second form of the target multimedia is triggered, the terminal device displays the associated page, which may include: when the second form of the target multimedia is triggered, the associated page is displayed; wherein the triggering operation may include but is not limited to any of the following: a click operation, a press gesture operation, and a floating gesture operation. For example, assuming that the target multimedia is an image of a cake, and the associated page of the target multimedia is a mini program page, see Fig.12a, which is a schematic diagram of a triggering display of an associated page of target multimedia provided in an embodiment of the present application, wherein the second form of target multimedia is indicated by mark 1201. If the first user performs a triggering operation on the second form of target multimedia, the associated page of the target multimedia as indicated by mark 1202 can be displayed in the terminal device, which is a sales details page of a cake, including the name, price, introduction, evaluation and other contents of the cake.
[0097] In one embodiment, when the second form of the target multimedia includes an interactive tag, when the second form of the target multimedia is triggered, the terminal device displays the associated page, which may include: when the interactive tag is triggered, the associated page is displayed; wherein the trigger operation includes but is not limited to any of the following: click operation, press gesture operation, floating gesture operation. For example, assuming that the target multimedia is an image of a cake, and the associated page of the target multimedia is a mini program page, see Figure 12b , which is a schematic diagram of an embodiment of the present application providing a method for triggering the display of an associated page of a target multimedia based on an interactive tag, wherein the interactive tag contained in the target multimedia of the second form is indicated by mark 1211. If the first user performs a trigger operation on the interactive tag, the terminal device can display an associated page of the target multimedia as indicated by mark 1212, which is a sales details page of a cake, including the name, price, introduction, evaluation and other contents of the cake.
[0098] In one embodiment, when the second form of the target multimedia includes an associated page trigger control, when the second form of the target multimedia is triggered, the terminal device displays the associated page, which may include: when the associated page trigger control is triggered, the associated page is displayed. For example, assuming that the target multimedia is an image of a cake, and the associated page of the target multimedia is a mini program page, see Fig.12c , which is a schematic diagram of an associated page of a target multimedia triggered by an associated page trigger control according to an embodiment of the present application, wherein the associated page trigger control contained in the target multimedia of the second form is indicated by mark 1221. If the first user performs a trigger operation on the associated page trigger control, the associated page of the target multimedia as indicated by mark 1222 can be displayed in the terminal device, which is a sales details page of a cake, including the name, price, introduction, evaluation and other contents of the cake.
[0099] Furthermore, when there are multiple associated pages of the target multimedia, when the associated page trigger control is triggered, the terminal device displays the associated page, which may include: when the associated page trigger control is triggered, a candidate list is displayed, and the candidate list contains multiple associated page candidates; different associated page candidates in the multiple associated page candidates are used to trigger the display of different associated pages of the target multimedia; when any associated page candidate in the candidate list is selected, the associated page pointed to by the selected associated page candidate is displayed. Among them, an associated page candidate in the candidate list may contain page description information of the associated page pointed to by the associated page candidate, and the page description information is used to describe the associated page. For example, assuming that the number of associated pages of the target multimedia is 3, the candidate list contains 3 associated page candidates, namely associated page candidate 1, associated page candidate 2 and associated page candidate 3, and the 3 associated page candidates point to associated page 1, associated page 2 and associated page 3, respectively; Fig.12d As shown, it is a schematic diagram of displaying associated pages based on a candidate list provided in an embodiment of the present application, wherein the associated page trigger control contained in the second form of the target multimedia is as shown by mark 1231, and if the first user performs a trigger operation on the associated page trigger control, the terminal device displays a candidate list as shown by mark 1232, and the candidate list includes associated page candidate 1, associated page candidate 2 and associated page candidate 3; if the first user selects associated page candidate 1 in the candidate list whose associated page description information is "Matcha Thousand Layer XX Shop", then the terminal device can display associated page 1 pointed to by the selected associated page candidate 1, as shown by mark 1233.
[0100] In one embodiment, when the number of associated pages of the target multimedia is multiple, and the target multimedia of the second form includes multiple associated page trigger controls, when the target multimedia of the second form is triggered, the terminal device displays the associated page, which may include: when any associated page trigger control among the multiple associated page trigger controls is triggered, displaying the associated page pointed to by the triggered associated page trigger control. For example, assuming that the number of associated pages of the target multimedia is 3, at this time the target multimedia of the second form includes 3 associated page trigger controls, namely associated page trigger control 1, associated page trigger control 2 and associated page trigger control 3, and the 3 associated page trigger controls point to associated page 1, associated page 2 and associated page 3 respectively; Fig.12eAs shown, it is a schematic diagram of triggering the display of associated pages based on multiple associated page trigger controls provided in an embodiment of the present application, wherein the target multimedia of the second form including multiple associated page trigger controls can be as shown by mark 1241. If the first user performs a trigger operation on associated page trigger control 1 whose associated page description information is "Matcha Thousand Layer XX Shop" as shown by mark 1242 among the multiple associated page trigger controls, then the associated page 1 pointed to by the associated page trigger control 1 can be displayed in the terminal device, as shown by mark 1243.
[0101] See also Fig.13a , which is a schematic diagram of triggering the display of an associated page of a target multimedia from a social page provided by an embodiment of the present application; assuming that the social scenario is a social scenario of a social conversation, specifically a social scenario in which a first user and a second user have a conversation; the social page is a conversation page in a social application, which may include 4 conversation messages as shown by the mark 1301; if the first user triggers the target conversation message, the target conversation message includes an image of a cake sent by the second user; the terminal device may display the second form of the target multimedia, that is, the second form of the image may be displayed, as shown by the mark 1302, the second form of the target multimedia as shown by the mark 1302 includes an interactive tag and an associated page trigger control; when the first user triggers the interactive tag or the associated page trigger control, the terminal device may display the associated page of the target multimedia as shown by the mark 1303, that is, display the associated page of the image, which is a sales details page of a cake matching the cake included in the image, including the name, price, introduction, evaluation and other contents of the cake.
[0102] See also Fig.13b , which is a schematic diagram of another method of triggering the display of an associated page of a target multimedia from a social page provided in an embodiment of the present application; assuming that the social scenario is a social scenario of dynamic sharing, the social page is a dynamic page of friends in a social application, which may include 2 dynamic messages as shown by the mark 1311; if the first user triggers the target dynamic message, the target dynamic message is a dynamic message posted by the second user, and the target dynamic message contains an image of a cake posted by the second user; the terminal device may display the second form of the target multimedia, that is, the second form of the image may be displayed, as shown by the mark 1312, and the second form of the target multimedia as shown by the mark 1312 contains an interactive tag and an associated page trigger control; when the first user triggers the interactive tag or the associated page trigger control, the terminal device may display the associated page of the target multimedia as shown by the mark 1313, that is, display the associated page of the image, which is a sales details page of a cake matching the cake contained in the image, including the name, price, introduction, evaluation and other contents of the cake.
[0103] See also Fig.13c , which is another schematic diagram of triggering the display of an associated page of a target multimedia from a social page provided by an embodiment of the present application; assuming that the social scenario is a social scenario of online status sharing, the social page is a status query page of a target social friend in a social application, which may include status content posted by the target social friend as shown by the mark 1321, and the status content includes a status description image set by the second user, and the image content of the status description image is a cake; if the first user triggers the status description image, the terminal device may display the second form of the target multimedia, that is, the second form of the status description image may be displayed, as shown by the mark 1322, and the second form of the target multimedia shown by the mark 1322 includes an associated page trigger control, specifically as shown by the mark 1323; when the first user triggers the associated page trigger control, the terminal device may display the associated page of the target multimedia as shown by the mark 1324, that is, the associated page of the status description image is displayed, and the associated page is a sales details page of a cake matching the cake included in the status description image, including the name, price, introduction, evaluation and other contents of the cake.
[0104] See also Fig.13d , which is a schematic diagram of another embodiment of the present application for triggering the display of an associated page of a target multimedia from a social page; assuming that the social scenario is a social scenario for topic exchange, the social page is a topic page in a social application, which may include topic content as indicated by the 1331 mark, and the topic content includes an image content of an image of a cake; if the first user triggers the image, the terminal device may display the second form of the target multimedia, that is, the second form of the image may be displayed, as indicated by the 1332 mark, and the second form of the target multimedia as indicated by the 1332 mark includes an interactive tag and an associated page trigger control; when the first user triggers the interactive tag or the associated page trigger control, the terminal device may display the associated page of the target multimedia as indicated by the 1333 mark, that is, display the associated page of the image, which is a sales details page of a cake that matches the cake contained in the image, including the name, price, introduction, evaluation and other content of the cake.
[0105] Optionally, the associated page of the target multimedia can be searched after the search function of the target multimedia is turned on, that is, the user who publishes the target multimedia can decide whether to turn on the search function for the target multimedia. The operation performed by the user who publishes the multimedia when turning on the search function for the multimedia is the same, that is, when the target multimedia is published by the first user, or the target multimedia is published by the social friend of the first user, the operation performed on the target multimedia is the same; based on this, the embodiment of the present application describes the process of turning on the search function for the target multimedia when the target multimedia is published by the first user. When the terminal device detects the target multimedia to be published in the social page, it outputs a search authorization prompt, and the search authorization prompt is used to prompt the search function to be turned on for the target multimedia; when the confirmation information of the search authorization prompt is received, the search function is turned on for the target multimedia. Further, the terminal device receives the target multimedia and displays the social page, which contains the target multimedia, and the target multimedia is displayed in the first form; that is, when the terminal device detects the publishing operation for the target multimedia, the target multimedia is displayed in the first form on the social page. Furthermore, the terminal device may display the second form of the target multimedia in response to the first form of the target multimedia being triggered, and display the associated page of the target multimedia when the second form of the target multimedia is triggered.
[0106] Among them, the search authorization prompt is used to prompt to enable the search function for the target multimedia, and the search authorization prompt may include an authorization confirmation item and an authorization cancellation item; optionally, the search authorization prompt may also include a search authorization prompt text, for example, the search authorization prompt text may be "whether to enable the search function for this content, if the search function for this content is enabled, it means that you authorize other users to search based on this content"; the embodiment of the present application does not limit the specific text content of the authorization prompt text. In a specific implementation, when the terminal device receives the confirmation information of the search authorization prompt and enables the search function for the target multimedia, the confirmation information of the authorization search prompt is generated based on the detected trigger operation of the authorization confirmation item, that is, the terminal device can enable the search function of the target multimedia based on the detected trigger operation of the authorization confirmation item; if the terminal device detects the trigger operation of the authorization cancellation item, the search function of the target multimedia is turned off.
[0107] In one embodiment, the second form of the target multimedia can be displayed based on the multimedia browsing window. When the second form of the target multimedia is displayed in the terminal device, it indicates that the associated page of the target multimedia has been searched. When the multimedia browsing window or the associated page is closed, the first form of the target multimedia is updated and displayed as the second form of the target multimedia in the social page. The second form of the target multimedia displayed in the social page based on the update of the first form of the target multimedia can be the same as or different from the second form of the target multimedia displayed in the multimedia browsing window. For example, see Fig.14 , which is a schematic diagram of displaying a second form of target multimedia in a social page provided in an embodiment of the present application; assuming that the social scenario is a social scenario of a social conversation, specifically a social scenario in which a first user and a second user have a conversation; the social page is a conversation page in a social application, which can be shown as a mark 1401; as shown in a mark 1402, the second form of target multimedia displayed based on the multimedia browsing window includes an interactive tag and an associated page trigger control; as shown in a mark 1403, the associated page of the target multimedia is shown. When the target user closes the associated page, the second form of target multimedia displayed in the social page can include an interactive tag as shown in a mark 1404.
[0108] In an embodiment of the present application, a first form of target multimedia is displayed in a social page, and in response to the first form of target multimedia being triggered, a second form of the target multimedia is displayed, and the second form is used to prompt that the associated page of the target multimedia has been searched; here, the first form of target multimedia is triggered, which can indicate that there is a need to further search for related information of the target multimedia, so the first form of target multimedia can be identified, and its associated page can be searched based on the identification result, and the target multimedia can be displayed in the second form to remind the user to view the searched associated page. When the second form of target multimedia is triggered, the associated page is displayed, and the user can obtain more information related to the target multimedia from the associated page, which effectively improves the efficiency and convenience of information acquisition in social scenarios.
[0109] Based on the above multimedia processing system and multimedia processing method, the present application embodiment provides another multimedia processing method, see Fig.15 , is a flow chart of another multimedia processing method provided in an embodiment of the present application, Fig.15 The multimedia processing method shown can be executed by a multimedia processing device, which can be Figure 1 The terminal device in the multimedia processing system shown in the figure can independently complete Fig.15 The corresponding process of the multimedia processing method shown in FIG. 1 is shown in FIG. 1 ; of course, the terminal device can also Figure 1 Completed with the assistance of the server shown Fig.15The relevant process of the multimedia processing method shown; for the convenience of explanation, the following description is based on the terminal device being the terminal device of the first user, and the first user is any user who uses the services provided by the social application. Fig.15 The multimedia processing method shown may include the following steps:
[0110] S1501, displaying a social page.
[0111] The social page includes the target multimedia, and the target multimedia is displayed in the first form; the target multimedia may be received by the terminal device and displayed in the social page; the target multimedia may be published by the first user based on the social application, or may be published by any social friend of the first user based on the social application. Step S1502 is consistent with the above step S201, and will not be described again.
[0112] S1502: Obtain access link information of the associated pages of the target multimedia.
[0113] Among them, the access link information includes: the access path of the associated page; the terminal device can access the associated page of the target multimedia based on the access path of the associated page and display the associated page. When the associated page of the target multimedia is a mini-program page in a social application, the access path of the associated page is the access path of the mini-program page (i.e., miniAPPId, miniApplicationIdentity document), and optionally, the access link information of the associated page may also include the mini-program name (i.e., miniAPPPath, miniApplicationPath). When the associated page of the target multimedia is a service page in an application other than a social application, the access path of the associated page is the access path of the service page in the other application, and optionally, the access link information of the associated page may also include the name of the other application. When the associated page of the target multimedia is a web page, the access path of the associated page is the access path of the web page, i.e., the URL of the web page. The embodiments of the present application are all introduced by taking the example that the associated page is a mini-program page in a social application.
[0114] In one embodiment, the terminal device obtains the access link information of the associated page of the target multimedia, which may include: performing multi-dimensional recognition processing on the target multimedia to obtain key information corresponding to the target multimedia; based on the key information corresponding to the target multimedia, searching the database for the access link information of the mini-program page that matches the target multimedia.
[0115] In a specific implementation, when the terminal device performs multi-dimensional recognition processing on the target multimedia and obtains the key information corresponding to the target multimedia, it may include: performing multi-dimensional recognition processing on the target multimedia based on deep learning technology and search query technology to obtain preliminary key information corresponding to the target multimedia; performing data analysis processing on the preliminary key information corresponding to the target multimedia to obtain the key information corresponding to the target multimedia. Among them, the key information corresponding to the target multimedia is information used to indicate the characteristics of the multimedia content contained in the target multimedia, and may include one or more keywords. Optionally, performing multi-dimensional recognition processing on the target multimedia may include performing multi-dimensional recognition processing on the target multimedia and the auxiliary information carried by the target multimedia. For example, the auxiliary information may be the location information carried by the target multimedia. See. Fig.16, which is a schematic diagram of a multi-dimensional recognition process for target multimedia provided in an embodiment of the present application; the terminal device performs multi-dimensional recognition process on the target multimedia based on deep learning technology and search query technology to obtain preliminary key information corresponding to the target multimedia; wherein the multi-dimensionality may include: certificate recognition dimension, bill recognition dimension, text recognition dimension, classification recognition dimension, and network image recognition dimension, etc.; the preliminary key information corresponding to the target multimedia may include the key information corresponding to the target multimedia in each dimension, and the key information corresponding to the target multimedia in one dimension may include one or more keywords corresponding to the target multimedia in the one dimension. Furthermore, the terminal device performs data analysis and processing on the preliminary key information corresponding to the target multimedia to obtain the key information corresponding to the target multimedia, which may be to determine the key information corresponding to each dimension as the key information corresponding to the target multimedia. The terminal device performs data analysis and processing on the preliminary key information corresponding to the target multimedia to obtain the key information corresponding to the target multimedia. It can also be to determine the key information corresponding to the target multimedia under the target dimension in the multi-dimensional as the key information corresponding to the target multimedia. The target dimension can be determined randomly or according to a certain strategy. For example, if the target multimedia is an image, the key information under the network image dimension can be determined as the key information corresponding to the image; if the target multimedia is text, the key information under the text recognition dimension can be determined as the key information of the text. The terminal device performs data analysis and processing on the preliminary key information corresponding to the target multimedia to obtain the key information corresponding to the target multimedia. It can also be a preset number of keywords selected from the key information corresponding to all dimensions according to the statistical number of keywords from high to low. The preset number can be set according to specific needs, for example, it can be 3. If the key information corresponding to all dimensions is in the order of the statistical number of keywords from high to low: keyword 1, keyword 2, keyword 3, keyword 4 and keyword 5, if the preset number is 3, then the key information corresponding to the target multimedia determined includes keyword 1, keyword 2 and keyword 3. Optionally, the terminal device performs data analysis on the preliminary key information corresponding to the target multimedia, and the key information corresponding to the target multimedia can also be obtained by performing data analysis on the preliminary key information corresponding to the target multimedia based on other data analysis strategies. Optionally, when the target multimedia is a video, multi-dimensional recognition processing can be performed based on the frame images of the video; when the target multimedia is audio, the audio can be first converted into text, and then multi-dimensional recognition processing can be performed based on the text.
[0116] Furthermore, after the terminal device obtains the key information corresponding to the target multimedia, it can search the database for access link information of the mini-program page that matches the target multimedia based on the key information corresponding to the target multimedia. The database maintains the access link information based on keywords, one keyword corresponds to one or more access link information, and one access link information points to a mini-program page. Fig.17 , a schematic diagram of determining access link information provided by an embodiment of the present application, the terminal device can sequentially perform error correction processing, word segmentation processing, syntax tree construction, access link information matching, access link information screening and scoring processing on the key information of the target multimedia to obtain the access link information of the mini-program page that matches the target multimedia. Among them, error correction processing and word segmentation processing are sequentially performed on the key information of the target multimedia to obtain one or more keywords to be processed, each of which is a keyword contained in the database; then, based on the operations of syntax tree construction and access link information matching performed on each keyword to be processed, one or more access link information corresponding to each keyword to be processed can be obtained; access link information screening processing is performed on the one or more access link information corresponding to each keyword to be processed to obtain a certain number of candidate access link information; the candidate access link information can be: a certain number of access link information determined in order from high to low according to the statistical number of access link information among the access link information corresponding to all keywords to be processed, and the number of candidate access link information can be set according to specific needs, for example, it can be 3. Furthermore, each candidate access link information is scored, and the candidate access link information with the highest score is determined as the access link information that matches the target multimedia, and the mini-program page pointed to by the access link information that matches the target multimedia is the associated page of the target multimedia. Optionally, multiple access link information that matches the target multimedia can be determined based on the score of each candidate access link information, and the mini-program pages corresponding to the multiple access link information that matches the target multimedia are the multiple associated pages of the target multimedia. For example, the top 2 candidate access link information ranked from high to low in score can be determined as the multiple access link information that matches the target multimedia.
[0117] In one embodiment, the terminal device can call the associated page search service provided by the server to obtain the access link information of the associated page of the target multimedia returned by the server. In a specific implementation: the terminal device can send an associated page search request to the server to search for the associated page of the target multimedia, and the associated page search request carries the target multimedia; after receiving the associated page search request, the server performs multi-dimensional recognition processing on the target multimedia to obtain the key information corresponding to the target multimedia; based on the key information corresponding to the target multimedia, the server searches the database for the access link information of the mini-program page that matches the target multimedia; and returns the access link information to the terminal device. The relevant process of the server obtaining the access link information of the mini-program page that matches the target multimedia is similar to the relevant process of the terminal device obtaining the access link information of the mini-program page that matches the target multimedia, and will not be repeated here.
[0118] In one embodiment, see Fig.18 , a schematic diagram of obtaining access link information of associated pages based on a server provided in an embodiment of the present application, the terminal device can respectively call the identification service provided by the identification server and the search service provided by the search server to realize the search of access link information of associated pages of the target multimedia, in the specific implementation: the terminal device can send an identification request for multi-dimensional identification of the target multimedia to the identification server, and the identification request carries the target multimedia; after receiving the identification request, the identification server performs multi-dimensional identification processing on the target multimedia, obtains the key information corresponding to the target multimedia, and sends the key information corresponding to the target multimedia to the terminal device; after the terminal device receives the key information corresponding to the target multimedia sent by the identification server, it can send a search request for searching the access link information of the associated pages of the target multimedia based on the key information corresponding to the target multimedia to the search server, and the search request carries the key information corresponding to the target multimedia; after receiving the key information corresponding to the target multimedia, the search server can search the access link information of the mini program page matching the target multimedia from the database based on the key information corresponding to the target multimedia, and return the access link information to the terminal device. Further, in response to the first form of the target multimedia being triggered, the terminal device generates a second form of the target multimedia based on the access link information, and displays the second form of the target multimedia.
[0119] S1503 , in response to the target multimedia of the first form being triggered, generating the target multimedia of the second form based on the access link information, and displaying the second form of the target multimedia.
[0120] The second form is used to prompt that the associated page of the target multimedia has been searched.
[0121] In one embodiment, the terminal device generates the second form of target multimedia based on the access link information, which may include: adding the access link information to the first form of target multimedia to generate the second form of target multimedia, so that when the second form of target multimedia is triggered, the associated page is accessed according to the access link information and the associated page is displayed.
[0122] In one embodiment, see Fig.19 , is a schematic diagram of a second form of target multimedia displayed based on a label control provided by an embodiment of the present application; when the second form of target multimedia includes an interactive label, the terminal device generates the second form of target multimedia based on the access link information, which may include: creating a label control; registering a trigger event in the label control based on the access link information, and filling the label content in the label control to obtain an interactive label; adding an interactive label on the basis of the first form of target multimedia to form the second form of target multimedia. Among them, the trigger event is used to indicate that based on the trigger operation of the label control (i.e., the interactive label generated subsequently), the associated page of the target multimedia is accessed according to the access link information, and the associated page is displayed. The trigger operation includes but is not limited to: click operation, press gesture operation, and floating gesture operation.
[0123] In one embodiment, when the target multimedia of the second form includes an associated page trigger control, the terminal device generates the target multimedia of the second form based on the access link information, which may include: creating a button control, and registering a trigger event in the button control based on the access link information to obtain an associated page trigger control; adding an associated page trigger control on the basis of the target multimedia of the first form to form the target multimedia of the second form. The trigger event is used to indicate that based on the trigger operation of the button control (i.e., the associated page trigger control generated subsequently), the associated page of the target multimedia is accessed according to the access link information, and the associated page is displayed. The trigger operation includes, but is not limited to, a click operation, a press gesture operation, and a floating gesture operation.
[0124] S1504: When the target multimedia of the second form is triggered, the associated page is displayed.
[0125] Step S1504 is consistent with the above-mentioned step S203 and will not be described again here.
[0126] See also Fig.20a, a schematic diagram of displaying an associated page based on obtaining access link information of an associated page provided by an embodiment of the present application; a terminal device displays a social page and obtains access link information of an associated page of a target multimedia; if the terminal device successfully obtains the access link information, then when the first form of the target multimedia is triggered, a second form of the target multimedia is generated based on the access link information, and the second form of the target multimedia is displayed; when the second form of the target multimedia is triggered, the associated page is displayed; if the terminal device fails to obtain the access link information, then when the first form of the target multimedia is triggered, a demonstration form of the target multimedia is generated, the demonstration form of the target multimedia includes the target multimedia but does not carry the access link information, and when the demonstration form of the target multimedia is triggered, the associated page will not be displayed.
[0127] In one embodiment, the execution order of step S1502 can be at any time after the terminal device receives the target multimedia, which can be: after receiving the target multimedia, before displaying the first form of the target multimedia on the social page, that is, before executing step S1501; or, after the terminal device receives the target multimedia, when the first form of the target multimedia is displayed on the social page, that is, when executing step S1501; or, after the terminal device receives the target multimedia, after the first form of the target multimedia is displayed on the social page, that is, after step S1501, or, when the terminal device responds to the first form of the target multimedia being triggered. Fig.20b , which is another schematic diagram of displaying an associated page based on the acquisition of access link information of the associated page provided by an embodiment of the present application; the terminal device displays a social page, and in response to the first form of target multimedia being triggered, acquires the access link information of the associated page of the target multimedia; if the terminal device successfully acquires the access link information, it generates a second form of target multimedia based on the access link information, and displays the second form of the target multimedia; when the second form of target multimedia is triggered, the associated page is displayed; if the terminal device fails to acquire the access link information, then when the first form of target multimedia is triggered, a demonstration form of target multimedia is generated, and the demonstration form of target multimedia does not carry the access link information, and when the demonstration form of target multimedia is triggered, the associated page will not be displayed.
[0128] In an embodiment of the present application, based on the multi-dimensional recognition processing of the target multimedia, access link information of the associated page of the target multimedia can be obtained; then, in response to the first form of the target multimedia being triggered, the second form of the target multimedia can be generated based on the access link information, and when the second form of the target multimedia is triggered, the associated page can be accessed based on the access link information and displayed; based on the multi-dimensional recognition processing of the target multimedia, the associated page of the target multimedia can be searched and displayed, and the associated page matching the target multimedia can be obtained on the basis of obtaining the target multimedia, which can improve the efficiency of information acquisition in social scenarios.
[0129] Based on the above-mentioned multimedia processing method embodiment, the present application embodiment provides a multimedia processing device, see Fig.21 , is a structural diagram of a multimedia processing device provided in an embodiment of the present application; the multimedia processing device may include a processing unit 2101 and an output unit 2102; the multimedia processing device may be a computer program (including program code) running in the multimedia processing device, for example, the multimedia processing device may be a terminal device, and the multimedia processing device may be a social application in the terminal device; the multimedia processing device may be used to execute Figure 2 as well as Fig.15 Some or all of the steps in the method embodiment shown. Fig.21 , the multimedia processing device comprises the following units:
[0130] The output unit 2102 is used to display a social page, wherein the social page includes target multimedia, and the target multimedia is displayed in a first form;
[0131] The output unit 2102 is further configured to display a second form of the target multimedia in response to the first form of the target multimedia being triggered, wherein the second form is configured to prompt that an associated page of the target multimedia has been searched, and the page content of the associated page matches the multimedia content of the target multimedia;
[0132] The output unit 2102 is further configured to display the associated page when the second form of target multimedia is triggered.
[0133] In one embodiment, the social page refers to any service page in the social application; the associated page includes any one of the following: a mini-program page in the social application, a service page in other applications other than the social application, or a web page;
[0134] The first form of the target multimedia is used to indicate that the target multimedia is in a state that has not been recognized; the second form of the target multimedia is used to indicate that the target multimedia is in a state that has been recognized.
[0135] In one embodiment, when the second form of the target multimedia is triggered, the output unit 2102 displays the associated page, specifically performing the following operations:
[0136] When the trigger operation is executed on the target multimedia of the second form, the associated page is displayed;
[0137] The trigger operation includes any one of the following: a click operation, a press gesture operation, and a floating gesture operation.
[0138] In one embodiment, the target multimedia of the second form includes an interactive tag, and the interactive tag is used to prompt the existence of a social friend who has an associated relationship with the target multimedia;
[0139] The interactive tag is displayed in the target multimedia of the second form in any of the following ways: displayed at any position in the target multimedia of the second form; or, the interactive tag is displayed in a suspended manner in the target multimedia of the second form; or, the interactive tag is displayed around the target multimedia of the second form; or, the interactive tag is hidden by default and is displayed only when a stay signal exists in the target multimedia of the second form;
[0140] The interactive tag includes any of the following: prompt text, prompt animation, and identity information of the social friend; the identity information includes any of the following: nickname, logo, and avatar.
[0141] In one embodiment, when the second form of the target multimedia is triggered, the output unit 2102 displays the associated page, specifically performing the following operations:
[0142] When the interactive tag is triggered, the associated page is displayed;
[0143] The trigger operation includes any one of the following: a click operation, a press gesture operation, and a floating gesture operation.
[0144] In one embodiment, the second form of the target multimedia includes an associated page trigger control, and when the second form of the target multimedia is triggered, the output unit 2102 displays the associated page, specifically performing the following operations:
[0145] When the associated page trigger control is triggered, the associated page is displayed;
[0146] Among them, the display method of the associated page trigger control in the target multimedia of the second form includes any one of the following: displayed at any position in the target multimedia of the second form; or, the associated page trigger control is displayed in suspension in the target multimedia of the second form; or, the associated page trigger control is displayed around the target multimedia of the second form; or, the associated page trigger control is hidden by default and is displayed only when there is a stay signal in the target multimedia of the second form.
[0147] In one embodiment, the number of associated pages of the target multimedia is multiple;
[0148] When the associated page trigger control is triggered, the output unit 2102 displays the associated page, specifically performing the following operations:
[0149] When the associated page trigger control is triggered, a candidate list is displayed, wherein the candidate list includes a plurality of associated page candidate items; different associated page candidate items among the plurality of associated page candidate items are used to trigger the display of different associated pages of the target multimedia;
[0150] When any associated page candidate in the candidate list is selected, the associated page pointed to by the selected associated page candidate is displayed.
[0151] In one embodiment, the target multimedia has multiple associated pages, and the target multimedia of the second form includes multiple associated page trigger controls, each associated page trigger control is used to trigger the display of one associated page of the target multimedia;
[0152] When the second form of the target multimedia is triggered, the output unit 2102 displays the associated page, specifically performing the following operations:
[0153] When any associated page trigger control among the multiple associated page trigger controls is triggered, displaying the associated page pointed to by the triggered associated page trigger control;
[0154] Among them, the display methods of the multiple associated page trigger controls in the second form of target multimedia include any one of the following: randomly distributed and displayed in the second form of target multimedia; sequentially arranged and displayed in the second form of target multimedia; displayed around the second form of target multimedia.
[0155] In one embodiment, in response to the first form of the target multimedia being triggered, the output unit 2102 specifically performs the following operations when displaying the second form of the target multimedia:
[0156] In response to the first form of target multimedia being triggered, outputting a multimedia browsing window;
[0157] The second form of the target multimedia is displayed in the multimedia browsing window.
[0158] In one embodiment, the output unit 2102 is further configured to update and display the target multimedia in the first form as the target multimedia in the second form in the social page when the multimedia browsing window is closed or the associated page is closed.
[0159] In one embodiment, the social page is a conversation page in a social application, the conversation page includes a target conversation message, and the target conversation message includes the first form of target multimedia; or
[0160] The social page is a friend dynamic page in the social application, the friend dynamic page includes a target dynamic message, and the target dynamic message includes the first form of target multimedia; or
[0161] The social page is a status query page of a target social friend in the social application, the status query page includes status content posted by the target social friend, and the status content includes the first form of target multimedia; or
[0162] The social page is a topic page in the social application, and the topic page includes the target multimedia in the first form.
[0163] In one embodiment, the associated page is searched and obtained after the search function is enabled for the target multimedia; the output unit 2102 is further used to output a search authorization prompt when the target multimedia to be published to the social page is detected, and the search authorization prompt is used to prompt to enable the search function for the target multimedia;
[0164] The processing unit 2101 is configured to enable a search function for the target multimedia when receiving confirmation information of the search authorization prompt.
[0165] In one embodiment, the associated page includes a mini-program page in a social application; the processing unit 2101 is used to obtain access link information of the associated page of the target multimedia, the access link information including: the mini-program name and the access path of the mini-program page;
[0166] The processing unit 2101 is further configured to generate the target multimedia of the second form based on the access link information in response to the target multimedia of the first form being triggered.
[0167] In one embodiment, when the processing unit 2101 obtains the access link information of the associated page of the target multimedia, the processing unit 2101 specifically performs the following operations:
[0168] Performing multi-dimensional recognition processing on the target multimedia to obtain key information corresponding to the target multimedia;
[0169] Based on the key information corresponding to the target multimedia, access link information of the mini-program page matching the target multimedia is searched from the database.
[0170] In one embodiment, when the processing unit 2101 generates the second form of target multimedia based on the access link information, the processing unit 2101 specifically performs the following operations:
[0171] The access link information is added to the target multimedia in the first form to generate the target multimedia in the second form.
[0172] In one embodiment, when the processing unit 2101 generates the second form of target multimedia based on the access link information, the processing unit 2101 specifically performs the following operations:
[0173] Create a label control;
[0174] Registering a trigger event in the label control based on the access link information, and filling label content in the label control to obtain an interactive label;
[0175] The interactive tag is added to the target multimedia of the first form to form the target multimedia of the second form.
[0176] In one embodiment, when the processing unit 2101 generates the second form of target multimedia based on the access link information, the processing unit 2101 specifically performs the following operations:
[0177] Creating a button control, and registering a trigger event in the button control based on the access link information to obtain an associated page trigger control;
[0178] The associated page trigger control is added to the target multimedia of the first form to form the target multimedia of the second form.
[0179] According to one embodiment of the present application, Figure 2 as well as Fig.15 The steps involved in the multimedia processing method shown can be Fig.21 The various units in the multimedia processing device shown are executed. For example, Figure 2 Steps S201 to S203 shown in FIG. Fig.21 The output unit 2103 in the multimedia processing device shown in the figure is executed; for example, Fig.15 Step S1501 and step S1504 shown in FIG. Fig.21 The output unit 2102 in the multimedia processing device shown is executed, Fig.15 Step S1502 shown can be performed by Fig.21 The processing unit 2101 in the multimedia processing device shown is used to execute, Fig.15 Step S1503 shown can be performed by Fig.21 The processing unit 2101 and the output unit 2102 in the multimedia processing device shown are executed together.
[0180] According to another embodiment of the present application, Fig.21 The various units in the multimedia processing device shown can be separately or all combined into one or several other units to constitute, or one (some) of the units can also be split into multiple smaller units in function to constitute, which can achieve the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above-mentioned units are divided based on logical functions. In practical applications, the function of one unit can also be implemented by multiple units, or the functions of multiple units can be implemented by one unit. In other embodiments of the present application, the multimedia processing device based on logical function division can also include other units. In practical applications, these functions can also be implemented with the assistance of other units, and can be implemented by the collaboration of multiple units.
[0181] According to another embodiment of the present application, the program can be executed by running on a general computing device such as a computer including a central processing unit (CPU), a random access memory medium (RAM), a read-only memory medium (ROM), and other processing elements and storage elements. Figure 2 or Fig.15 A computer program (including program code) for each step involved in the corresponding method shown in FIG. Fig.21 The multimedia processing device shown in the embodiment of the present application is implemented by the multimedia processing method. The computer program can be recorded on a computer-readable storage medium, for example, and loaded into the computing device through the computer-readable storage medium and run therein.
[0182] In an embodiment of the present application, a first form of target multimedia is displayed in a social page, and in response to the first form of target multimedia being triggered, a second form of the target multimedia is displayed, and the second form is used to prompt that the associated page of the target multimedia has been searched; here, the first form of target multimedia is triggered, which can indicate that there is a need to further search for related information of the target multimedia, so the first form of target multimedia can be identified, and its associated page can be searched based on the identification result, and the target multimedia can be displayed in the second form to remind the user to view the searched associated page. When the second form of target multimedia is triggered, the associated page is displayed, and the user can obtain more information related to the target multimedia from the associated page, which effectively improves the efficiency and convenience of information acquisition in social scenarios.
[0183] Based on the above-mentioned multimedia processing method embodiment and device embodiment, the present application also provides a multimedia processing device. Fig. 22 , is a structural diagram of a multimedia processing device provided in an embodiment of the present application. Fig. 22 The multimedia processing device shown may include at least a processor 2201, an input interface 2202, an output interface 2203, and a computer storage medium 2204. The processor 2201, the input interface 2202, the output interface 2203, and the computer storage medium 2204 may be connected via a bus or other means.
[0184] The computer storage medium 2204 can be stored in the memory of the multimedia processing device. The computer storage medium 2204 is used to store a computer program. The computer program includes program instructions. The processor 2201 is used to execute the program instructions stored in the computer storage medium 2204. The processor 2201 (or CPU (Central Processing Unit)) is the computing core and control core of the multimedia processing device, which is suitable for implementing one or more instructions, and is specifically suitable for loading and executing one or more instructions to implement the above-mentioned multimedia processing method flow or corresponding functions.
[0185] The embodiment of the present application also provides a computer storage medium (Memory), which is a memory device in a multimedia processing device for storing programs and data. It is understandable that the computer storage medium here can include both the built-in storage medium in the terminal and the extended storage medium supported by the terminal. The computer storage medium provides a storage space, which stores the operating system of the terminal. In addition, one or more instructions suitable for being loaded and executed by the processor 2201 are also stored in the storage space, and these instructions can be one or more computer programs (including program codes). It should be noted that the computer storage medium here can be a high-speed random access memory (RAM) memory, or a non-volatile memory (non-volatile memory), such as at least one disk storage; optionally, it can also be at least one computer storage medium located away from the aforementioned processor.
[0186] In one embodiment, the multimedia processing device may be the terminal device mentioned in the above embodiment; the processor 2201 and the output interface 2203 may load and execute one or more instructions stored in the computer storage medium to implement the above-mentioned related Figure 2 as well as Fig.15 In the corresponding steps of the method in the multimedia processing method embodiment, in a specific implementation, one or more instructions in the computer storage medium are loaded by the processor 2201 and the output interface 2203 and execute the following steps:
[0187] Output interface 2203, used to display a social page, wherein the social page includes target multimedia, and the target multimedia is displayed in a first form;
[0188] The output interface 2203 is further used to display a second form of the target multimedia in response to the first form of the target multimedia being triggered, wherein the second form is used to prompt that an associated page of the target multimedia has been searched, and the page content of the associated page matches the multimedia content of the target multimedia;
[0189] The output interface 2203 is further configured to display the associated page when the second form of target multimedia is triggered.
[0190] In one embodiment, the social page refers to any service page in the social application; the associated page includes any one of the following: a mini-program page in the social application, a service page in other applications other than the social application, or a web page;
[0191] The first form of the target multimedia is used to indicate that the target multimedia is in a state that has not been recognized; the second form of the target multimedia is used to indicate that the target multimedia is in a state that has been recognized.
[0192] In one embodiment, when the second form of the target multimedia is triggered, the output interface 2203 displays the associated page, specifically performing the following operations:
[0193] When the trigger operation is executed on the target multimedia of the second form, the associated page is displayed;
[0194] The trigger operation includes any one of the following: a click operation, a press gesture operation, and a floating gesture operation.
[0195] In one embodiment, the target multimedia of the second form includes an interactive tag, and the interactive tag is used to prompt the existence of a social friend who has an associated relationship with the target multimedia;
[0196] The interactive tag is displayed in the target multimedia of the second form in any of the following ways: displayed at any position in the target multimedia of the second form; or, the interactive tag is displayed in a suspended manner in the target multimedia of the second form; or, the interactive tag is displayed around the target multimedia of the second form; or, the interactive tag is hidden by default and is displayed only when a stay signal exists in the target multimedia of the second form;
[0197] The interactive tag includes any of the following: prompt text, prompt animation, and identity information of the social friend; the identity information includes any of the following: nickname, logo, and avatar.
[0198] In one embodiment, when the second form of the target multimedia is triggered, the output interface 2203 displays the associated page, specifically performing the following operations:
[0199] When the interactive tag is triggered, the associated page is displayed;
[0200] The trigger operation includes any one of the following: a click operation, a press gesture operation, and a floating gesture operation.
[0201] In one embodiment, the second form of the target multimedia includes an associated page trigger control, and when the second form of the target multimedia is triggered, the output interface 2203 displays the associated page, specifically performing the following operations:
[0202] When the associated page trigger control is triggered, the associated page is displayed;
[0203] Among them, the display method of the associated page trigger control in the target multimedia of the second form includes any one of the following: displayed at any position in the target multimedia of the second form; or, the associated page trigger control is displayed in suspension in the target multimedia of the second form; or, the associated page trigger control is displayed around the target multimedia of the second form; or, the associated page trigger control is hidden by default and is displayed only when there is a stay signal in the target multimedia of the second form.
[0204] In one embodiment, the number of associated pages of the target multimedia is multiple;
[0205] When the associated page trigger control is triggered, the output interface 2203 displays the associated page, specifically performing the following operations:
[0206] When the associated page trigger control is triggered, a candidate list is displayed, wherein the candidate list includes a plurality of associated page candidate items; different associated page candidate items among the plurality of associated page candidate items are used to trigger the display of different associated pages of the target multimedia;
[0207] When any associated page candidate in the candidate list is selected, the associated page pointed to by the selected associated page candidate is displayed.
[0208] In one embodiment, the target multimedia has multiple associated pages, and the target multimedia of the second form includes multiple associated page trigger controls, each associated page trigger control is used to trigger the display of one associated page of the target multimedia;
[0209] When the second form of the target multimedia is triggered, the output interface 2203 displays the associated page, and specifically performs the following operations:
[0210] When any associated page trigger control among the multiple associated page trigger controls is triggered, displaying the associated page pointed to by the triggered associated page trigger control;
[0211] Among them, the display methods of the multiple associated page trigger controls in the second form of target multimedia include any one of the following: randomly distributed and displayed in the second form of target multimedia; sequentially arranged and displayed in the second form of target multimedia; displayed around the second form of target multimedia.
[0212] In one embodiment, in response to the first form of the target multimedia being triggered, the output interface 2203 specifically performs the following operations when displaying the second form of the target multimedia:
[0213] In response to the first form of target multimedia being triggered, outputting a multimedia browsing window;
[0214] The second form of the target multimedia is displayed in the multimedia browsing window.
[0215] In one embodiment, the output interface 2203 is further used to update and display the target multimedia in the first form as the target multimedia in the second form in the social page when the multimedia browsing window or the associated page is closed.
[0216] In one embodiment, the social page is a conversation page in a social application, the conversation page includes a target conversation message, and the target conversation message includes the first form of target multimedia; or
[0217] The social page is a friend dynamic page in the social application, the friend dynamic page includes a target dynamic message, and the target dynamic message includes the first form of target multimedia; or
[0218] The social page is a status query page of a target social friend in the social application, the status query page includes status content posted by the target social friend, and the status content includes the first form of target multimedia; or
[0219] The social page is a topic page in the social application, and the topic page includes the target multimedia in the first form.
[0220] In one embodiment, the associated page is searched and obtained after the search function is enabled for the target multimedia; the output interface 2203 is further used to output a search authorization prompt when the target multimedia to be published to the social page is detected, and the search authorization prompt is used to prompt to enable the search function for the target multimedia;
[0221] The processor 2201 is configured to enable a search function for the target multimedia when receiving confirmation information of the search authorization prompt.
[0222] In one embodiment, the associated page includes a mini-program page in a social application; the processor 2201 is used to obtain access link information of the associated page of the target multimedia, the access link information including: the mini-program name and the access path of the mini-program page;
[0223] The processor 2201 is further configured to generate the target multimedia of the second form based on the access link information in response to the target multimedia of the first form being triggered.
[0224] In one embodiment, when the processor 2201 obtains the access link information of the associated page of the target multimedia, the processor 2201 specifically performs the following operations:
[0225] Performing multi-dimensional recognition processing on the target multimedia to obtain key information corresponding to the target multimedia;
[0226] Based on the key information corresponding to the target multimedia, access link information of the mini-program page matching the target multimedia is searched from the database.
[0227] In one embodiment, when the processor 2201 generates the second form of target multimedia based on the access link information, the processor 2201 specifically performs the following operations:
[0228] The access link information is added to the target multimedia in the first form to generate the target multimedia in the second form.
[0229] In one embodiment, when the processor 2201 generates the second form of target multimedia based on the access link information, the processor 2201 specifically performs the following operations:
[0230] Create a label control;
[0231] Registering a trigger event in the label control based on the access link information, and filling label content in the label control to obtain an interactive label;
[0232] The interactive tag is added to the target multimedia of the first form to form the target multimedia of the second form.
[0233] In one embodiment, when the processor 2201 generates the second form of target multimedia based on the access link information, the processor 2201 specifically performs the following operations:
[0234] Creating a button control, and registering a trigger event in the button control based on the access link information to obtain an associated page trigger control;
[0235] The associated page trigger control is added to the target multimedia of the first form to form the target multimedia of the second form.
[0236] The embodiment of the present application provides a computer program product or a computer program. The computer program product includes a computer program, which is stored in a computer storage medium; a processor of a multimedia processing device reads the computer program from the computer storage medium, and the processor executes the computer program, so that the multimedia processing device performs the above-mentioned Figure 2 as well as Fig.15The computer-readable storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a random access memory (RAM).
[0237] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A multimedia processing method, It is characterized in that include: Displaying a social page, wherein the social page includes target multimedia, and the target multimedia is displayed in a first form; The first form refers to a form in which the target multimedia is not identified and searched; In response to the first form of the target multimedia being triggered, output a multimedia browsing window; display a second form of the target multimedia in the multimedia browsing window, wherein the second form is used to prompt that an associated page of the target multimedia has been searched, and the page content of the associated page matches the multimedia content of the target multimedia; When the target multimedia of the second form is triggered, displaying the associated page; When the multimedia browsing window is closed or the associated page is closed, the target multimedia in the first form is updated and displayed as the target multimedia in the second form in the social page; The associated page is searched and obtained after the target multimedia is searched for; the method further includes: When the target multimedia to be published to the social page is detected, a search authorization prompt is output, where the search authorization prompt is used to prompt to start a search function for the target multimedia; When confirmation information of the search authorization prompt is received, the search function is enabled for the target multimedia.
2. The method according to claim 1, It is characterized in that The social page refers to any service page in the social application; the associated page includes any of the following: a mini-program page in the social application, a service page in other applications other than the social application, or a web page; The first form of the target multimedia is used to indicate that the target multimedia is in a state that has not been recognized; the second form of the target multimedia is used to indicate that the target multimedia is in a state that has been recognized.
3. The method according to claim 1 or 2, It is characterized in that When the target multimedia of the second form is triggered, displaying the associated page includes: When the trigger operation is executed on the target multimedia of the second form, the associated page is displayed; The trigger operation includes any one of the following: a click operation, a press gesture operation, and a floating gesture operation.
4. The method according to claim 1 or 2, It is characterized in that The target multimedia of the second form includes an interactive tag, and the interactive tag is used to prompt the existence of a social friend who has an associated relationship with the target multimedia; The interactive tag is displayed in the target multimedia of the second form in any of the following ways: displayed at any position in the target multimedia of the second form; or, the interactive tag is displayed in a suspended manner in the target multimedia of the second form; or, the interactive tag is displayed around the target multimedia of the second form; or, the interactive tag is hidden by default and is displayed only when a stay signal exists in the target multimedia of the second form; The interactive tag includes any of the following: prompt text, prompt animation, and identity information of the social friend; the identity information includes any of the following: nickname, logo, and avatar.
5. The method according to claim 4, It is characterized in that When the target multimedia of the second form is triggered, displaying the associated page includes: When the interactive tag is triggered, the associated page is displayed; The trigger operation includes any one of the following: a click operation, a press gesture operation, and a floating gesture operation.
6. The method according to claim 1 or 2, It is characterized in that The target multimedia of the second form includes an associated page trigger control, and when the target multimedia of the second form is triggered, the associated page is displayed, including: When the associated page trigger control is triggered, the associated page is displayed; Among them, the display method of the associated page trigger control in the target multimedia of the second form includes any one of the following: displayed at any position in the target multimedia of the second form; or, the associated page trigger control is displayed in suspension in the target multimedia of the second form; or, the associated page trigger control is displayed around the target multimedia of the second form; or, the associated page trigger control is hidden by default and is displayed only when there is a stay signal in the target multimedia of the second form.
7. The method according to claim 6, It is characterized in that The number of associated pages of the target multimedia is multiple; When the associated page trigger control is triggered, the associated page is displayed, including: When the associated page trigger control is triggered, a candidate list is displayed, wherein the candidate list includes a plurality of associated page candidate items; different associated page candidate items among the plurality of associated page candidate items are used to trigger the display of different associated pages of the target multimedia; When any associated page candidate in the candidate list is selected, the associated page pointed to by the selected associated page candidate is displayed.
8. The method according to claim 1 or 2, It is characterized in that The target multimedia has a plurality of associated pages, and the target multimedia of the second form includes a plurality of associated page trigger controls, each associated page trigger control being used to trigger display of one associated page of the target multimedia; When the target multimedia of the second form is triggered, displaying the associated page includes: When any associated page trigger control among the multiple associated page trigger controls is triggered, displaying the associated page pointed to by the triggered associated page trigger control; Among them, the display methods of the multiple associated page trigger controls in the second form of target multimedia include any one of the following: randomly distributed and displayed in the second form of target multimedia; sequentially arranged and displayed in the second form of target multimedia; displayed around the second form of target multimedia.
9. The method according to claim 1 or 2, It is characterized in that The social page is a conversation page in a social application, the conversation page includes a target conversation message, and the target conversation message includes the target multimedia in the first form; or, The social page is a friend dynamic page in the social application, the friend dynamic page includes a target dynamic message, and the target dynamic message includes the target multimedia in the first form; or, The social page is a status query page of a target social friend in the social application, the status query page includes status content posted by the target social friend, and the status content includes the first form of target multimedia; or, The social page is a topic page in the social application, and the topic page includes the target multimedia in the first form.
10. The method according to claim 1, It is characterized in that The associated page includes a mini-program page in a social application; and the method further includes: Obtaining access link information of the associated page of the target multimedia, wherein the access link information includes: the name of the mini-program and the access path of the mini-program page; In response to the first form of target multimedia being triggered, the second form of target multimedia is generated based on the access link information.
11. The method according to claim 10, It is characterized in that The step of obtaining access link information of a page associated with the target multimedia includes: Performing multi-dimensional recognition processing on the target multimedia to obtain key information corresponding to the target multimedia; Based on the key information corresponding to the target multimedia, access link information of the mini-program page matching the target multimedia is searched from the database.
12. The method according to claim 10, It is characterized in that The step of generating the second form of target multimedia based on the access link information includes: The access link information is added to the target multimedia in the first form to generate the target multimedia in the second form.
13. The method according to claim 10, It is characterized in that The step of generating the second form of target multimedia based on the access link information includes: Create a label control; Registering a trigger event in the label control based on the access link information, and filling label content in the label control to obtain an interactive label; The interactive tag is added to the target multimedia of the first form to form the target multimedia of the second form.
14. The method according to claim 10, It is characterized in that The step of generating the second form of target multimedia based on the access link information includes: Creating a button control, and registering a trigger event in the button control based on the access link information to obtain an associated page trigger control; The associated page trigger control is added to the target multimedia of the first form to form the target multimedia of the second form.
15. A multimedia processing device, It is characterized in that include: The multimedia processing device comprises a processing unit and an output unit, and the processing unit and the output unit are used to execute the multimedia processing method according to any one of claims 1-14.
16. A multimedia processing device, It is characterized in that The multimedia processing device includes an input interface and an output interface, and further includes: a processor adapted to implement one or more instructions; and, A computer storage medium storing one or more instructions, wherein the one or more instructions are suitable for being loaded by the processor and executing the multimedia processing method according to any one of claims 1 to 14.
17. A computer storage medium, It is characterized in that The computer storage medium stores computer program instructions, and when the computer program instructions are executed by a processor, they are used to execute the multimedia processing method according to any one of claims 1 to 14.
18. A computer program product or a computer program, It is characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the computer program is used to load and execute the multimedia processing method according to any one of claims 1 to 14.
