Content query method and apparatus, device and storage medium

By generating rich text information and presenting text and non-text modal content in the target window, the problem that existing online platforms cannot meet users' query needs is solved, and high-quality multimodal content display is achieved.

WO2026051893A1PCT designated stage Publication Date: 2026-03-12BEIJING ZITIAO NETWORK TECH CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2025-09-01
Publication Date
2026-03-12

AI Technical Summary

Technical Problem

Existing online platforms cannot meet users' query needs, and the generated content cannot simultaneously contain text modal and non-text modal content, and the correlation between the two is poor.

Method used

Rich text information is generated through the target model. The rich text information contains the target access address and is used to present the first content associated with the text modality and the second content associated with the non-text modality in the target window.

Benefits of technology

This enables the presentation of multimodal content in the target window, improving the quality and efficiency of information display and meeting users' query needs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2025118323_12032026_PF_FP_ABST
    Figure CN2025118323_12032026_PF_FP_ABST
Patent Text Reader

Abstract

A content query method and apparatus, a device and a storage medium. The method comprises: in response to receiving a query request, acquiring rich text information generated by a target model on the basis of the query request, the rich text information indicating a target access address (310); and on the basis of the rich text information, presenting response content for the query request in a target window, the response content comprising first content associated with a text modality and second content associated with a non-text modality, and the second content being determined on the basis of the target access address (320). In this way, content of multiple modalities can be provided on the basis of a query request.
Need to check novelty before this filing date? Find Prior Art

Description

Content query method, device, apparatus and storage medium

[0001] The present application claims priority to the Chinese patent application No. 202411231302.X, filed on September 3, 2024, entitled "Content query method, device, apparatus and storage medium", the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] Example embodiments of the present disclosure generally relate to the field of computers, and in particular, to a content query method, device, apparatus and computer readable storage medium. BACKGROUND

[0003] In recent years, with the development of the Internet, more and more users query content in network platforms. However, the content generated based on the query request of the user by the existing network platform cannot meet the needs of the user. SUMMARY

[0004] In a first aspect of the present disclosure, a content query method is provided, comprising: in response to receiving a query request, obtaining rich text information generated by a target model based on the query request, the rich text information indicating a target access address; and based on the rich text information, presenting response content for the query request in a target window, the response content including first content associated with a text modality and second content associated with a non-text modality, wherein the second content is determined based on the target access address.

[0005] In a second aspect of the present disclosure, a device for content query is provided. The device comprises: an obtaining module configured to, in response to receiving a query request, obtain rich text information generated by a target model based on the query request, the rich text information indicating a target access address; and a presenting module configured to, based on the rich text information, present response content for the query request in a target window, the response content including first content associated with a text modality and second content associated with a non-text modality, wherein the second content is determined based on the target access address.

[0006] In a third aspect of the present disclosure, an electronic device is provided. The device comprises at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. The instructions, when executed by the at least one processor, cause the device to perform the method of the first aspect.

[0007] In a fourth aspect of the present disclosure, a computer readable storage medium is provided. The computer readable storage medium has stored thereon computer executable instructions executable by a processor to implement the method of the first aspect.

[0008] In a fifth aspect of the disclosure, a computer program product is provided. The computer program product includes computer executable instructions that, when executed by a processor, implement the method of the first aspect.

[0009] It should be understood that nothing in the Summary is to be construed as a limitation on the scope of the embodiments of the disclosure or the claims. Other features, aspects, and advantages of the disclosure will become apparent from the following description, which refers to the accompanying drawings. BRIEF DESCRIPTION OF DRAWINGS

[0010] The above and other features, aspects, and advantages of embodiments of the disclosure will become more apparent from the following description in conjunction with the accompanying drawings. In the drawings, like reference numerals refer to like elements, in which:

[0011] FIG. 1 shows a schematic diagram of an example environment in which embodiments according to the present disclosure can be implemented;

[0012] FIGS. 2A-2C show example interfaces according to some embodiments of the disclosure;

[0013] FIG. 3 shows a flowchart of an example process of content query according to some embodiments of the disclosure;

[0014] FIG. 4 shows a schematic structural block diagram of an example apparatus for content query according to some embodiments of the disclosure; and

[0015] FIG. 5 shows a block diagram of an electronic device capable of implementing various embodiments of the disclosure. DETAILED DESCRIPTION

[0016] Embodiments of the disclosure will be described below in greater detail with reference to the accompanying drawings. While certain embodiments of the disclosure are shown in the drawings, it is understood that the disclosure can be embodied in various forms and should not be construed as being limited to the embodiments set forth herein; rather, these embodiments are provided so that the disclosure will be more thoroughly and completely understood. It should be understood that the drawings and embodiments of the disclosure are only for illustrative purposes and are not intended to limit the scope of protection of the disclosure.

[0017] It should be noted that the titles of any sections / subsections provided herein are not limiting. Various embodiments are described throughout this document and any type of embodiment can be included under any section / subsection. Furthermore, embodiments described in any section / subsection can be combined with any other embodiment described in the same section / subsection and / or a different section / subsection in any manner.

[0018] In the description of the embodiments of the present disclosure, the term "comprising" and its similar terms are understood to be open-ended, i.e., "including but not limited to". The term "based on" is understood to be "based, at least in part, on". The term "one embodiment" or "the embodiment" is understood to be "at least one embodiment". The term "some embodiments" is understood to be "at least some embodiments". The following can also include other explicit and implicit definitions. The terms "first", "second", etc. can refer to different or same objects. The following can also include other explicit and implicit definitions.

[0019] In some embodiments of the present disclosure, data of users, acquisition and / or use of data, etc. can be involved. These aspects comply with corresponding laws and regulations and relevant provisions. In some embodiments of the present disclosure, all data collection, acquisition, processing, processing, forwarding, use, etc. are performed on the premise that the user is aware of and confirms. Accordingly, when implementing various embodiments of the present disclosure, the type of data or information that can be involved, the use range, the use scenario, etc. should be notified to the user and the authorization of the user should be obtained through appropriate means according to relevant laws and regulations. The specific notification and / or authorization method can vary according to the actual situation and application scenario, and the scope of the present disclosure is not limited in this regard.

[0020] In the present specification and embodiments, if personal information processing is involved, it will be processed on the premise of legality (for example, obtaining the consent of the subject of personal information, or being necessary for the performance of a contract, etc.), and only within the prescribed or agreed range. Users refuse to process personal information other than the necessary information required for basic functions, which will not affect the user's use of basic functions.

[0021] As mentioned above, with the development of the Internet, more and more users query content in network platforms. However, the content generated by the existing network platform based on the query request of the user cannot meet the viewing needs of the user. For example, some network platforms can only generate pure text content. While the content generated by some other network platforms can include non-text modal content, the non-text modal content and the text content in the generated content are mutually fragmented and have poor correlation. Therefore, the content generated by the existing network platform cannot meet the query needs of the user.

[0022] Some embodiments of the present disclosure provide a scheme for content query. According to the scheme, in response to receiving a query request, rich text information generated by a target model based on the query request is acquired, the rich text information indicating a target access address; and based on the rich text information, response content for the query request is presented in a target window, the response content including first content associated with a text modal and second content associated with a non-text modal, wherein the second content is determined based on the target access address.

[0023] In this way, embodiments of the present disclosure are capable of generating, based on a query request of a user, rich text information using a target model, the rich text information including a target access address for determining non-text modality content. Further, embodiments of the present disclosure are capable of presenting, based on the rich text information, response content including the text modality content and the non-text modality content in a target window.

[0024] Embodiments of the present disclosure are capable of providing, based on a query request of a user, response content of multiple modalities for the user. In this way, embodiments of the present disclosure improve the quality of the content generated for the query request on the basis of enriching the content modalities.

[0025] Various example implementations of the solution are described in further detail below in conjunction with the accompanying drawings.

[0026] Example Environment

[0027] FIG. 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. As shown in FIG. 1, the example environment 100 can include an electronic device 110.

[0028] In this example environment 100, the electronic device 110 can run an application 120 that supports interface interaction. The application 120 can be any suitable type of application for interface interaction, examples of which can include, but are not limited to, a search application or other suitable application. A user 140 can interact with the application 120 via the electronic device 110 and / or its attached devices.

[0029] In the environment 100 of FIG. 1, if the application 120 is in an active state, the electronic device 110 can present, through the application 120, an interface 150 for supporting interface interaction.

[0030] In some embodiments, the electronic device 110 communicates with a server 130 to implement the provision of services to the application 120. The electronic device 110 can be any type of mobile terminal, fixed terminal, or portable terminal including a mobile handset, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a palmtop computer, a portable gaming terminal, a VR / AR device, a Personal Communication System (PCS) device, a personal navigation device, a Personal Digital Assistant (PDA), a audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an electronic book device, a game device, or any combination thereof, including an apparatus and peripherals or combination thereof. In some embodiments, the electronic device 110 can also support any type of interface for the user (such as "wearable" circuitry, etc.).

[0031] The server 130 can be a standalone physical server, a server cluster or a distributed system composed of multiple physical servers, a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, content distribution networks, and basic cloud computing services such as big data and artificial intelligence platforms. The server 130 may, for example, include a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like. The server 130 can provide background services for the applications 120 in the electronic device 110 that support interface interaction.

[0032] A communication connection can be established between the server 130 and the electronic device 110. The communication connection can be established by wired or wireless means. The communication connection can include, but is not limited to, a Bluetooth connection, a mobile network connection, a Universal Serial Bus (USB) connection, a Wireless Fidelity (WiFi) connection, and the like, and embodiments of the present disclosure are not limited in this regard. In embodiments of the present disclosure, the server 130 and the electronic device 110 can achieve signaling interaction through the communication connection therebetween.

[0033] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only, without implying any limitation on the scope of the present disclosure.

[0034] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0035] Example Interaction

[0036] FIGS. 2A to 2C illustrate example interfaces 200A to 200C according to some embodiments of the present disclosure. The interfaces 200A to 200C may, for example, be provided by the electronic device 110 shown in FIG. 1.

[0037] In some embodiments, as shown in FIG. 2A, the electronic device 110 can obtain, in response to receiving the query request, rich text information generated by a target model based on the query request. The rich text information can indicate a target access address.

[0038] In some embodiments, the target model generating the rich text information based on the query request can include the target model generating the rich text information based on the query request and reference information. The query request and the reference information can be provided by the electronic device 110 or a server 120 associated with the electronic device 110. The reference information can indicate text descriptions and address information corresponding to a set of reference content. As an example, the target model can be implemented as a generative model capable of generating the rich text information based on the query request. The present disclosure is not intended to limit the specific content and training process of the target model.

[0039] In some embodiments, the set of reference content is associated with non-text modalities. As an example, the content can generally include text content (e.g., pure text content) associated with a text modality and non-text modality content associated with a non-text modality.

[0040] As an example, the non-text modality content can include media content (e.g., music, video, and picture sets, etc.), applet content, and content associated with other users (e.g., comment content associated with other users, content generated based on virtual avatars of other users, etc.), etc.

[0041] In some embodiments, the text descriptions corresponding to the set of reference content can include natural language descriptions of the non-text modality content. For example, the text descriptions can include natural language descriptions of a plurality of non-text modality content contained in a data source A (e.g., a database).

[0042] As an example, based on the text descriptions, the target model can understand the non-text modality content contained in the data source A in the process of generating the rich text information based on the query request, thereby generating the rich text information associated with the non-text modality content. For example, the query request can include “target A”, and the target model can determine the non-text modality content associated with “target A” from the data source A based on the text descriptions associated with “target A” for generating the rich text information.

[0043] In some embodiments, the address information corresponding to the set of reference content can include access addresses (also referred to as index addresses) in data sources corresponding to the non-text modality content. As an example, the query request can include “target A”, and the access address corresponding to the non-text modality content associated with “target A” in the data source A can include access address A, and the rich text information generated by the target model can indicate the access address A.

[0044] In some embodiments, the target model generating the rich text information based on the query request can include link information corresponding to the target access address. As an example, the electronic device 110 can obtain data corresponding to the non-text modality content based on the link information to generate the corresponding non-text modality content with the rendering engine. As an example, the link information may, for example, include a Uniform Resource Identifier (URI) and / or a Uniform Resource Locator (URL). As an example, the link information corresponding to the access address A can be implemented as {“url”: “https: / / www.xxxxx.com / ”}.

[0045] In some embodiments, with continued reference to FIG. 2A, the electronic device 110 can present the response content for the query request in the target window based on the rich text information.

[0046] In some embodiments, the response content can include first content associated with the text modality and second content associated with the non-text modality. The second content is determined based on the target access address.

[0047] In some embodiments, the target model generating the rich text information based on the query request can include the target model generating based on context information associated with a target application presenting the response content. The context information can indicate at least one component of the target application for presenting the non-text modality content.

[0048] As an example, the target application can correspond to an application in which the user initiates the query request. For example, the electronic device 110 receives the query request from the user in the application A, then the application A is the target application. The electronic device 110 can provide the context information of the target application (e.g., the application A) to the target model. As an example, the context information may, for example, indicate at least one component of the target application (e.g., the application A) for presenting the non-text modality content. The at least one component may, for example, include a media content component, a comment viewing component, and an answer viewing component, etc.

[0049] As an example, if the media content component is included in the at least one component, it can indicate that the target application supports presenting the non-text modality content including media content. As an example, if the media content component is not included in the at least one component, it can indicate that the target application supports presenting the non-text modality content not including media content. In this way, based on the context information associated with the target application, it can be indicated that the target access address indicated in the rich text information generated by the target model only corresponds to the non-text modality content supported by the target application for presentation.

[0050] In some embodiments, with continued reference to FIG. 2A, the electronic device 110 can present, in the target window 205 in the target interface 200A, first content (e.g., text 210-1, text 210-2, and text 210-3) associated with a text modality.

[0051] In some embodiments, with continued reference to FIG. 2A, the electronic device 110 can determine, in response to the target access address corresponding to media content, a first component corresponding to the media content. As an example, the first component can include a media content component for presenting and playing the media content.

[0052] In some embodiments, with continued reference to FIG. 2A, the media content can include works associated with other applications or other users. As an example, the electronic device 110 can present, in the target window 205 with the first component, second content (e.g., media content 215-1 and media content 215-2) associated with a non-text modality.

[0053] As an example, with continued reference to FIG. 2A, the query request may, for example, be associated with “A place travel guide.” As an example, the text 210-1 presented by the electronic device 110 in the target window 205 may, for example, include a description of “A place transportation route planning.” The media content 215-1 can include a plurality of video works associated with “A place transportation route planning” sourced from other users. As an example, the text 210-2 presented by the electronic device 110 in the target window 205 may, for example, include a description of “A place food recommendation.” The media content 215-2 can include a plurality of video works associated with “A place food recommendation” sourced from other users. As an example, the text 210-3 presented by the electronic device 110 in the target window 205 may, for example, include a description of “A place accommodation recommendation.”

[0054] In some embodiments, as shown in FIG. 2B, the media content can include video or photo-text content associated with news (or trending content). As an example, the electronic device 110 can present, in the target window 205 in the target interface 200B, first content (e.g., text 210-4) associated with a text modality. As an example, the electronic device 110 can present, in the target window 205 with the first component, second content (e.g., news content 215-3) associated with a non-text modality.

[0055] In some embodiments, with continued reference to FIG. 2B, the electronic device 110 can play, in the target window, the media content in response to a first operation for the first component. As an example, the electronic device 110 can play, in the target window, the news 216 in response to a tap operation (e.g., a tap operation on an area where the news 216 in the news content 215-3 is located) on the first component.

[0056] In some embodiments, with continued reference to FIG. 2B, the electronic device 110 can present a viewing interface of the media content in response to a second operation on the first component. As an example, the electronic device 110 can provide a viewing control 217 associated with the media content (e.g., news content 215-3) in the first component. Further, the electronic device 110 can present a viewing interface of the media content (e.g., news content 215-3) in response to a trigger of the viewing control 217.

[0057] In some embodiments, with continued reference to FIG. 2B, the electronic device 110 can trigger an interaction associated with the media content in response to a third operation on the first component. As an example, the electronic device 110 can provide a set of interaction controls 220 (e.g., a like control 220-1, a refresh control 220-2) in the first component. As an example, the electronic device 110 can perform a like operation on the media content (e.g., news content 215-3) in response to a trigger (e.g., a tap operation) of the like control 220-1.

[0058] In some embodiments, with continued reference to FIG. 2B, the electronic device 110 can present a table 225 generated based on the media content (e.g., news content 215-3) and / or the text 210-4 in the target window 205 of the target interface 200B with a table component. The table 225 may, for example, indicate a summary of the content of the media content (e.g., news content 215-3) and / or the text 210-4.

[0059] In some embodiments, as shown in FIG. 2C, the electronic device 110 can present the media content (e.g., media content 215-4) with the first component. As an example, the electronic device 110 can also present publication information of the media content in the first component. As an example, the publication information of the media content can include a source indication element 226 (e.g., from application AAA) and an author indication element 227 (e.g., author A) of the media content.

[0060] In some embodiments, with continued reference to FIG. 2C, the electronic device 110 can determine a second component corresponding to the comment content in response to determining that the target access address corresponds to the comment content. As an example, the second component can include a comment viewing component 230. As an example, the electronic device 110 can present the second component (e.g., the comment viewing component 230) in the target window 205. Further, the electronic device 110 can present a second content corresponding to the comment content with the second component in the target window 205.

[0061] In some embodiments, with continued reference to FIG. 2C, the second content can indicate the comment content 231, the work 232 (e.g., work A) to which the comment content is directed, and / or the publication information of the comment content. As an example, the publication information can include a user name 233 (e.g., user A) that published the comment content, a publication time, an application in which the comment content is located, and / or the like.

[0062] In some embodiments, with continued reference to FIG. 2C, the electronic device 110 can present the comment content or present the work associated with the comment content in response to a first preset operation on the second component. As an example, the electronic device 110 can present the comment content or present the work associated with the comment content in response to a click operation on the comment viewing component 230.

[0063] As an example, with continued reference to FIG. 2C, the electronic device 110 can provide a work control 234 in the second component. Further, the electronic device 110 can present a viewing interface of the work associated with the comment content in response to a click operation on the work control 234. The electronic device 110 can present the work associated with the comment content and / or the comment content in the viewing interface.

[0064] In some embodiments, with continued reference to FIG. 2C, the electronic device 110 can determine a third component corresponding to the answer content in response to determining that the target access address corresponds to the answer content generated by the virtual object based on the query request. As an example, the third component can include an answer viewing control 235. Further, the electronic device 110 can present the second content in the target window 205 with the third control (e.g., the answer viewing control 235).

[0065] In some embodiments, with continued reference to FIG. 2C, the second content in the third control can indicate the answer content and the virtual object that generated the answer content. As an example, the electronic device 110 can present the answer content 236 and the virtual object 237 (e.g., the nickname XXX of the virtual object) that generated the answer content in the answer viewing control 235.

[0066] In some embodiments, with continued reference to FIG. 2C, the electronic device 110 can present an interaction interface with the virtual object in response to a second preset operation on the third component. As an example, the electronic device 110 can provide an interaction entry 240 in the third component (e.g., the answer viewing component 235). Further, the electronic device 110 can present an interaction interface with the virtual object (e.g., XXX) in response to a trigger (e.g., a click operation) on the interaction entry 240. The user can have a conversation with the virtual object or further ask questions in the interaction interface, and / or the like.

[0067] In some embodiments, the virtual object can include any suitable processing entity that supports interaction through the prompt item and the like. In some scenarios, the virtual object can also be referred to as a virtual entity, examples of which can include, but are not limited to, an agent, a bot, or other object that supports interaction through a dialogue (e.g., a text dialogue or a voice dialogue, and the like). Such a virtual object can be implemented, for example, with a suitable machine learning model to interact accordingly based on the received prompt item. The present disclosure is not intended to limit the specific construction of the virtual object. It should be understood that, on one hand, the virtual object can have a virtual appearance for interaction. On the other hand, the virtual object can also drive its interaction behavior with a suitable model, which can include any suitable machine learning model, e.g., a generative model. In the present disclosure, various interactive processes and / or generation operations performed by the virtual object can be actually performed with a suitable model corresponding to the virtual object.

[0068] Based on the above-described processes, embodiments of the present disclosure can present multi-modal content to a user based on a query request of the user and make corresponding feedback to the user's interactive operation on the non-text modal content. Thus, embodiments of the present disclosure can provide high-quality rich text content for the user, meet the query needs of the user, and improve the information display efficiency.

[0069] Example process

[0070] FIG. 3 shows a flowchart of an example process 300 for content query, according to some embodiments of the present disclosure. The process 300 can be implemented at the electronic device 110. The process 300 is described below with reference to FIG. 1.

[0071] As shown, at block 310, in response to receiving the query request, the electronic device 110 obtains rich text information generated by a target model based on the query request, the rich text information indicating a target access address.

[0072] At block 320, the electronic device 110 presents, based on the rich text information, response content for the query request in a target window, the response content including first content associated with a text modal and second content associated with a non-text modal, wherein the second content is determined based on the target access address.

[0073] In some embodiments, presenting the response content for the query request in the target window includes: in response to determining that the target access address corresponds to media content, determining a first component corresponding to the media content; and presenting, in the target window, second content corresponding to the media content with the first component.

[0074] In some embodiments, the process 300 further includes: in response to the first operation for the first component, playing the media content in the target window; or in response to the second operation for the first component, presenting a viewing interface of the media content; or in response to the third operation for the first component, triggering an interaction associated with the media content.

[0075] In some embodiments, presenting the response content for the query request in the target window includes: in response to determining that the target access address corresponds to comment content, determining a second component corresponding to the comment content; and presenting, in the target window, second content corresponding to the comment content with the second component.

[0076] In some embodiments, the second content indicates at least one of: the comment content; a work to which the comment content is directed; publication information of the target content.

[0077] In some embodiments, the process 300 further includes: in response to a first preset operation for the second component, presenting the comment content or presenting a work associated with the target comment content.

[0078] In some embodiments, presenting the response content for the query request in the target window includes: in response to determining that the target access address corresponds to answer content generated by a virtual object based on the query request, determining a third component corresponding to the answer content; and presenting, in the target window, second content with the third component, the second content indicating the answer content and the virtual object that generated the answer content.

[0079] In some embodiments, the process 300 further includes: in response to a second preset operation for the third component, presenting an interaction interface of the virtual object.

[0080] In some embodiments, the rich text information includes link information corresponding to the target access address.

[0081] In some embodiments, the rich text information is generated based on a process of: providing, to a target model, the query request and reference information, the reference information indicating text descriptions and address information corresponding to a set of reference content, the set of reference content being associated with a non-text modality; and obtaining the rich text information generated by the target model based on the query request and the reference information.

[0082] In some embodiments, the rich text information is further generated based on context information associated with a target application that presents the response content, the context information indicating at least one component in the target application for presenting non-text modality content.

[0083] Example apparatus and devices

[0084] Embodiments of the present disclosure also provide a corresponding device for implementing the above method or process. FIG. 4 shows a schematic structural block diagram of an example device 400 for content query according to certain embodiments of the present disclosure. The device 400 can be implemented as or included in the electronic device 110. Various modules / components in the device 400 can be implemented by hardware, software, firmware, or any combination thereof.

[0085] As shown in FIG. 4, the device 400 includes an acquisition module 410 configured to, in response to receiving a query request, acquire rich text information generated by a target model based on the query request, the rich text information indicating a target access address; and a presentation module 420 configured to present, based on the rich text information, response content for the query request in a target window, the response content including first content associated with a text modality and second content associated with a non-text modality, wherein the second content is determined based on the target access address.

[0086] In some embodiments, the presentation module 420 is further configured to, in response to determining that the target access address corresponds to media content, determine a first component corresponding to the media content; and present, in the target window, the second content corresponding to the media content with the first component.

[0087] In some embodiments, the device 400 further includes a media module configured to, in response to a first operation on the first component, play the media content in the target window; or in response to a second operation on the first component, present a viewing interface of the media content; or in response to a third operation on the first component, trigger an interaction associated with the media content.

[0088] In some embodiments, the presentation module 420 is further configured to, in response to determining that the target access address corresponds to comment content, determine a second component corresponding to the comment content; and present, in the target window, the second content corresponding to the comment content with the second component.

[0089] In some embodiments, the second content indicates at least one of: the comment content; a work to which the comment content is directed; publication information of the target content.

[0090] In some embodiments, the device 400 further includes a comment module configured to, in response to a first preset operation on the second component, present the comment content or present a work associated with the target comment content.

[0091] In some embodiments, the presentation module 420 is further configured to, in response to determining that the target access address corresponds to answer content generated by a virtual object based on the query request, determine a third component corresponding to the answer content; and present, in the target window, the second content with the third component, the second content indicating the answer content and the virtual object that generates the answer content.

[0092] In some embodiments, the apparatus 400 further includes an interaction module configured to, in response to the second preset operation for the third component, present an interaction interface with the virtual object.

[0093] In some embodiments, the rich text information includes link information corresponding to the target access address.

[0094] In some embodiments, the rich text information is generated based on a process of providing a query request and reference information to a target model, the reference information indicating text descriptions and address information corresponding to a set of reference contents, the set of reference contents being associated with a non-text modality, and obtaining the rich text information generated by the target model based on the query request and the reference information.

[0095] In some embodiments, the rich text information is further generated based on context information associated with a target application that presents the response content, the context information indicating at least one component in the target application for presenting the non-text modality content.

[0096] FIG. 5 illustrates a block diagram of an electronic device 500 in which one or more embodiments of the disclosure can be implemented. It should be understood that the electronic device 500 illustrated in FIG. 5 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. The electronic device 500 illustrated in FIG. 5 can be used to implement the electronic device 110 of FIG. 1.

[0097] As shown in FIG. 5, the electronic device 500 is in the form of a general electronic device. The components of the electronic device 500 can include, but are not limited to, one or more processing units or processors 510, a memory 520, a storage device 530, one or more communication units 540, one or more input devices 550, and one or more output devices 560. The processor 510 can be a real or virtual processor and is capable of performing various processing according to programs stored in the memory 520. In a multi-processor system, multiple processors perform computer-executable instructions in parallel to improve the parallel processing capability of the electronic device 500.

[0098] The electronic device 500 typically includes a plurality of computer storage media. Such media can be any available media that is accessible by the electronic device 500 and includes both volatile and nonvolatile media, removable and non-removable media. The memory 520 can be volatile (such as register, cache, RAM), non-volatile (such as ROM, EEPROM, flash memory), or some combination of the two. The storage device 530 can be a removable or non-removable media, and can include machine-readable media, such as flash drives, magnetic disks, or any other media that can be used to store information and / or data and that can be accessed by the electronic device 500.

[0099] The electronic device 500 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 5, a disk drive for reading from or writing to a removable, non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable, non-volatile optical disk (e.g., a CD-ROM) can be provided. In such instances, each drive can be connected to the bus (not shown) by one or more data media interfaces. The memory 520 can include a computer program product 525 having one or more program modules configured to carry out the various methods or actions of the various embodiments of the present disclosure.

[0100] The communication unit 540 enables communication with other electronic devices over communication media. Additionally, the functionality of the components of the electronic device 500 can be implemented in a single computing cluster or a plurality of computer machines capable of communication over a communication connection. Thus, the electronic device 500 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network nodes.

[0101] The input device 550 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. The output device 560 can be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 500 can also communicate with one or more external devices (not shown) such as a storage device, a display device, etc. through the communication unit 540, as needed, one or more devices that enable a user to interact with the electronic device 500, or any devices (e.g., a network card, a modem, etc.) that enable the electronic device 500 to communicate with one or more other electronic devices. Such communication can be carried out via an input / output (I / O) interface (not shown).

[0102] According to an example implementation of the present disclosure, a computer readable storage medium is provided having computer executable instructions stored thereon, where the computer executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, a computer program product is also provided that is tangibly stored on a non-transitory computer readable medium and includes computer executable instructions, where the computer executable instructions are executed by a processor to implement the method described above.

[0103] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0104] These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium. The instructions stored on the computer readable storage medium can be used to program a computer, a programmable data processing apparatus, and / or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0105] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0106] The computer program product of the present disclosure can have a signal including said computer program. This signal can be electronic, electromagnetic, optical, or any other suitable type of signal. Such a signal can be provided through a communication connection, such as electrical wiring, optical fiber, wireless interface, etc. Examples of computer program products include computer program implemented on a personal computer, server, or other networked device. A non-transitory computer readable medium, such as a floppy disk, CD-ROM, DVD-ROM, Blu-ray Disc, hard disk drive, or any other suitable non-transitory computer readable medium can store the computer program product.

[0107] Having described several implementations of the present disclosure, it will be clear to those skilled in the art that many modifications, additions, and deletions can be made to the disclosed implementations without materially departing from the novel teachings of the disclosure set forth herein. Accordingly, embodiments of the present disclosure shall not be limited by what has been particularly shown and described hereinabove. Rather, the scope of the present disclosure includes both combinations and sub-combinations of the various features described hereinabove, as well as variations and modifications thereof that would be apparent to one of ordinary skill in the art upon reading the foregoing description. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting.

Claims

1.A method for content query, comprising: in response to receiving a query request, obtaining rich text information generated by a target model based on the query request, the rich text information indicating a target access address; and based on the rich text information, presenting response content for the query request in a target window, the response content comprising first content associated with a text modality and second content associated with a non-text modality, wherein the second content is determined based on the target access address. 2.The method of claim 1, wherein presenting the response content for the query request in the target window comprises: in response to determining that the target access address corresponds to media content, determining a first component corresponding to the media content; and and presenting the second content corresponding to the media content in the target window with the first component. 3.The method of claim 2, further comprising: in response to a first operation on the first component, playing the media content in the target window; or in response to a second operation on the first component, presenting a viewing interface of the media content; or in response to a third operation on the first component, triggering an interaction associated with the media content. 4.The method of claim 1, wherein presenting the response content for the query request in the target window comprises: in response to determining that the target access address corresponds to comment content, determining a second component corresponding to the comment content; and and presenting the second content corresponding to the comment content in the target window with the second component. 5.The method of claim 4, wherein the second content indicates at least one of: the comment content; a work to which the comment content is directed; publishing information of the comment content. 6.The method of claim 4, further comprising: in response to a first preset operation on the second component, presenting the comment content or presenting a work associated with the target comment content. 7.The method of claim 1, wherein presenting the response content for the query request in the target window comprises: in response to determining that the target access address corresponds to answer content generated by a virtual object based on the query request, determining a third component corresponding to the answer content; and and presenting the second content in the target window with the third component, the second content indicating the answer content and the virtual object generating the answer content. 8.The method of claim 7, further comprising: in response to a second preset operation on the third component, presenting an interaction interface with the virtual object. 9.The method of claim 1, wherein the rich text information comprises link information corresponding to the target access address. 10.The method of claim 1, wherein the rich text information is generated based on a process comprising: providing the query request and reference information to the target model, the reference information indicating a text description and address information corresponding to a set of reference content, the set of reference content being associated with the non-text modality; and ​ obtaining the rich text information generated by the target model based on the query request and the reference information. 11.The method of claim 1, wherein the rich text information is further generated based on context information associated with a target application that presents the response content, the context information indicating at least one component in the target application for presenting non-text modality content. 12.An apparatus for content query, comprising: an obtaining module configured to, in response to receiving a query request, obtain rich text information generated by a target model based on the query request, the rich text information indicating a target access address; and a presenting module configured to present, based on the rich text information, response content for the query request in a target window, the response content including first content associated with a text modality and second content associated with a non-text modality, wherein the second content is determined based on the target access address. 13.An electronic device, comprising: at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor, the instructions, when executed by the at least one processor, cause the electronic device to perform the method according to any one of claims 1-11. 14.A computer-readable storage medium having computer-executable instructions stored thereon, the computer-executable instructions executable by a processor to implement the method according to any one of claims 1-11. 15.A computer program product comprising computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method according to any one of claims 1-11.

Citation Information

Patent Citations

  • Search method, system and network robot

    CN104239481A

  • Chat bot search results integration

    CN110914819A

  • Searching method and electronic equipment

    CN116415081A

  • Large model image-text dialogue method and device, equipment and storage medium

    CN117633173A

  • Vector database retrieval method and device based on large model, terminal and medium

    CN118312594A