Method and apparatus for presenting multimedia content, device, and medium
By automatically determining the content presentation format based on user input and presenting multimedia content in appropriate applications, the problem of complex manual operation for users is solved, and data processing efficiency and ease of operation are improved.
Patent Information
- Application Number
- PCT/CN2024/101740
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-06-26
- Publication Date
- 2026-01-02
AI Technical Summary
When users process the multimedia content provided by the system, the manual operation is complicated and they cannot directly use the multimedia content for subsequent operations.
By responding to user input, the system determines the content presentation format that matches the input, generates multimedia content, and automatically presents it in suitable applications, reducing the complexity of manual operation for users.
It improves data processing efficiency, simplifies user operation processes, and enables users to view and edit multimedia content more conveniently.
Smart Images

Figure CN2024101740_02012026_PF_FP_ABST
Abstract
Description
Method, apparatus, device and medium for presenting multimedia content TECHNICAL FIELD
[0001] Exemplary implementations of the present disclosure generally relate to the field of computers, and particularly relate to a method, apparatus, device and computer readable storage medium for presenting multimedia content. BACKGROUND
[0002] With the rapid development of computer technology, a processing system can provide various services to a user. For example, the processing system can obtain input information from the user, and provide corresponding multimedia content based on the input information. However, the user can not be able to directly use the multimedia content, but needs to perform further operations on the multimedia content. At this time, it is desirable that the multimedia content can be determined and presented in a more effective manner so as to enable the user to perform subsequent operations.
[0003] SUMMARY
[0004] In a first aspect of the present disclosure, a method for presenting multimedia content is provided. In the method, in response to input information of a user, a content presentation format matching the input information is determined. Based on the input information and the content presentation format, multimedia content is generated, a file format of the multimedia content matching the content presentation format. The multimedia content is presented.
[0005] In a second aspect of the present disclosure, an apparatus for presenting multimedia content is provided. The apparatus comprises: a determining module configured to determine, in response to input information of a user, a content presentation format matching the input information; a generating module configured to generate, based on the input information and the content presentation format, multimedia content, a file format of the multimedia content matching the content presentation format; and a presenting module configured to present the multimedia content.
[0006] In a third aspect of the present disclosure, an electronic device is provided. The electronic device comprises: at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the electronic device to perform the method according to the first aspect of the present disclosure.
[0007] In a fourth aspect of the present disclosure, a computer readable storage medium is provided, having stored thereon a computer program, the computer program, when executed by a processor, causing the processor to implement the method according to the first aspect of the present disclosure.
[0008] In a fifth aspect of the present disclosure, a computer program product is provided, comprising a computer program, wherein the computer program, when executed by a processor, implements the method according to the first aspect of the present disclosure.
[0009] It is to be understood that the particulars shown herein are by way of example and for purposes of illustrative discussion of the various embodiments of the present disclosure only and are not intended to limit the scope of the present disclosure. Other aspects of the present disclosure will become apparent to those of ordinary skill in the art upon reading the following description and figures. BRIEF DESCRIPTION OF DRAWINGS
[0010] The above-mentioned and other features and advantages of various embodiments of the present disclosure will become more apparent by reference to the following description taken in conjunction with the accompanying drawings. In the drawings, like reference numerals denote like elements, wherein:
[0011] FIG. 1 illustrates a block diagram of an application environment according to one example implementation of the present disclosure;
[0012] FIG. 2 illustrates a block diagram for presenting multimedia content according to some implementations of the present disclosure;
[0013] FIG. 3A illustrates a block diagram of multimedia content according to some implementations of the present disclosure;
[0014] FIG. 3B illustrates a block diagram for selecting an application according to some implementations of the present disclosure;
[0015] FIG. 3C illustrates a block diagram of a relationship according to some implementations of the present disclosure;
[0016] FIG. 4 illustrates a block diagram of presenting multimedia content in an email application according to some implementations of the present disclosure;
[0017] FIG. 5 illustrates a block diagram of presenting multimedia content in a text application according to some implementations of the present disclosure;
[0018] FIG. 6 illustrates a block diagram of presenting multimedia content in a slide show application according to some implementations of the present disclosure;
[0019] FIG. 7 illustrates a block diagram of presenting multimedia content in a slide show application according to some implementations of the present disclosure;
[0020] FIG. 8 illustrates a block diagram of presenting multimedia content in a data table application according to some implementations of the present disclosure;
[0021] FIG. 9 illustrates a flow diagram of a method for presenting multimedia content according to some implementations of the present disclosure;
[0022] FIG. 10 illustrates a block diagram of an apparatus for presenting multimedia content according to some implementations of the present disclosure; and
[0023] FIG. 11 illustrates a block diagram of a device capable of implementing various implementations of the present disclosure. DETAILED DESCRIPTION
[0024] Implementations of the present disclosure will be described more fully hereinafter with reference to the accompanying drawings. While several implementations of the present disclosure are described, it should be understood that the present disclosure can be embodied in various forms and should not be construed as limited to the implementations set forth herein; rather, these implementations are provided so that this disclosure will be thorough and complete, and fully convey the scope of the present disclosure to those skilled in the art. It should be understood that the drawings and implementations described herein are merely for illustrative purposes and are not intended to limit the scope of the present disclosure.
[0025] In the description of implementations of the present disclosure, the term "includes" and its derivatives mean "including but not limited to". The term "based on" means "based at least in part on". The term "one implementation" or "the implementation" means "at least one implementation". The term "some implementations" means "at least some implementations". Other explicit or implicit definitions can also be included below. As used herein, the term "model" can represent the relationship between various data. For example, the above-mentioned relationship can be obtained based on various technical solutions known at present and / or to be developed in the future.
[0026] It can be understood that the data involved in the technical solutions of the present disclosure (including but not limited to the data itself, the acquisition or use of the data) should comply with the requirements of relevant laws and regulations and relevant provisions.
[0027] It can be understood that before using the technical solutions disclosed by the embodiments of the present disclosure, the type of personal information involved in the present disclosure, the scope of use, the scene of use, etc. should be informed to the user and the authorization of the user should be obtained through appropriate means according to relevant laws and regulations.
[0028] For example, in response to receiving the active request of the user, the prompt information is sent to the user to explicitly prompt the user that the operation requested to be executed will require the acquisition and use of the personal information of the user. Thus, the user can voluntarily choose whether to provide the personal information to the software or hardware such as electronic device, application program, server or storage medium, etc. that executes the operation of the technical solutions of the present disclosure according to the prompt information.
[0029] As an optional but not limited implementation, in response to receiving the active request of the user, the prompt information is sent to the user in the form of a pop-up window, and the prompt information can be presented in the form of text in the pop-up window. In addition, the pop-up window can also carry selection controls for the user to select "agree" or "disagree" to provide personal information to the electronic device.
[0030] It can be understood that the above notification and obtaining user authorization process is only illustrative, and does not limit the implementation of the present disclosure, and other ways that meet relevant laws and regulations can also be applied to the implementation of the present disclosure.
[0031] The term "in response to" as used herein refers to a state in which a corresponding event occurs or a condition is met. It will be understood that the timing of the execution of the subsequent action performed in response to the event or condition is not necessarily strongly associated with the time at which the event occurs or the condition is established. For example, in some cases, the subsequent action can be performed immediately when the event occurs or the condition is established; in other cases, the subsequent action can be performed after a period of time after the event occurs or the condition is established.
[0032] Example environment
[0033] A processing system can provide various services to a user. For example, the processing system can obtain input information from the user, and provide corresponding multimedia content based on the input information. An application environment according to some implementations of the present disclosure is described with reference to FIG. 1, which shows a block diagram 100 of an application environment according to one example implementation of the present disclosure. As shown in FIG. 1, a processing system 110 can perform various tasks, a user can input a desired task to be performed in an input box 140, and submit input information. For example, the processing system 110 can receive input information 120, and generate corresponding multimedia content 130.
[0034] Here, the processing system 110 may, for example, include a query system and / or a generative system implemented based on a machine learning model. A user can construct a prompt word as input information 120 in order to obtain a corresponding response from the processing system 110. Assuming that the user wants to compose an email, the user can input "please compose an email…", at which time the multimedia content 130 can include the content of a corresponding email. However, at this time, the user has to manually open an email application and copy the multimedia content 130 into the email application, and then perform further editing. At this time, it is desirable to determine and present the multimedia content in a more efficient manner in order for the user to perform subsequent operations.
[0035] Presenting an overview of multimedia content
[0036] To at least partially address the deficiencies in the prior art, according to one example implementation of the present disclosure, a method for presenting multimedia content is proposed. A summary of one example implementation of the present disclosure is described with reference to FIG. 2, which shows a block diagram 200 for presenting multimedia content according to some implementations of the present disclosure. As shown in FIG. 2, in response to input information 230 of a user, a content presentation format 210 that matches the input information 230 can be determined. Based on the input information 230 and the content presentation format 210, multimedia content 240 is generated, which has a file format 220 that matches the content presentation format 210. Further, the multimedia content 240 can be presented.
[0037] According to some implementations of the present disclosure, the content presentation format can include, but is not limited to, a text format, an image format, an audio format, a video format, or a rich media format including data in different formats, etc. The multimedia content can have a certain file format, which can be a format that is supported by one or more applications for browsing and / or editing. There can be a correspondence between the content presentation format and the file format, for example, a text format can correspond to multiple file formats, such as a ".txt" format, a ".doc" format, etc.; an image format can correspond to multiple file formats, such as a ".jpg" format, a ".bmp" format, etc.; a rich media format can correspond to multiple file formats, such as a ".pdf" format, a ".html" format, etc.
[0038] With the example implementations of the present disclosure, the content presentation format can be determined according to the input information of the user, and the corresponding multimedia content can be generated. Further, the multimedia content can be presented in a suitable manner, in this way, the user can be facilitated to view and / or edit the generated multimedia content. In this way, the complexity of manual operation of the user can be reduced, and the data processing efficiency can be improved.
[0039] Detailed process of presenting multimedia content
[0040] Having described a summary of some implementations of the present disclosure, more details will be provided in the following. According to some implementations of the present disclosure, generating the multimedia content can include generating a set of multimedia elements that matches the input information, the multimedia content including the set of multimedia elements, and a layout style of the set of multimedia elements being determined based on the input information and the content presentation format.
[0041] Specifically, the input information herein can be a prompt word input to a processing system (e.g., implemented based on a machine learning model), and the processing system can generate a set of multimedia elements matching the input information. More details are described with reference to FIG. 3A, which shows a block diagram 300A of multimedia content according to some implementations of the present disclosure. As shown in FIG. 3A, the generated multimedia elements 312, …, 314 arranged in a layout style 316 can be generated directly by the processing system. Alternatively and / or additionally, the multimedia elements 312, …, 314 and the layout style 316 can be generated respectively by the processing system, and the multimedia elements 312, …, 314 can be further arranged in the layout style 316 to generate the multimedia content 240. Alternatively and / or additionally, the multimedia elements 312, …, 314 can be generated respectively by the processing system, each multimedia element can be presented, and the user can arrange each multimedia element in a customized layout style to generate multimedia content more in line with the user's needs.
[0042] According to some implementations of the present disclosure, in the process of generating multimedia content, a plurality of prompt information respectively matching a plurality of candidate applications supporting a content presentation format can be provided to a user; in response to receiving an interaction request of the user for prompt information in the plurality of prompt information, a candidate application matching the prompt information is selected from the plurality of candidate applications; and based on at least one file format supported by the candidate application, the multimedia content is generated.
[0043] Specifically, assuming that the content presentation format is an image format, and the application A, the application B, and the application C can all present and edit data objects in the image format, at this time, the prompt information A, the prompt information B, and the prompt information C respectively corresponding to each application can be provided to the user. Based on the selection of the prompt information by the user, it can be determined that the user expects to present and / or edit multimedia content in the image format. Assuming that the user selects the prompt information A, and the application A corresponding to the prompt information A can support the “.jpg” format and the “.bmp” format, at this time, images in the “.jpg” format and / or the “.bmp” format can be generated. With the example implementations of the present disclosure, suitable multimedia content can be generated based on the user's needs for subsequent operations by the user.
[0044] According to some implementations of the present disclosure, during presenting the multimedia content, an application for presenting the multimedia content can be determined, and the multimedia content is presented in the application. Specifically, a user-specified application can be selected, and / or an application that the user has frequently used in the past can be selected. Specifically, to determine the application for presenting the multimedia content, in response to receiving a user input for specifying an application, the application can be determined based on the user input. For example, the user can be asked: "Which application do you want to use to open the multimedia content?" In this way, an application that is more matched to the user's needs can be selected.
[0045] Alternatively and / or additionally, during determining the application for presenting the multimedia content, an association between file formats and a plurality of applications can be determined based on a usage history of the user using the plurality of applications, and the application is selected from the plurality of applications based on the association. See FIG. 3B for more information, which illustrates a block diagram 300B for selecting an application according to some implementations of the present disclosure.
[0046] As shown in FIG. 3B, the association 334 can be determined based on the usage history 332 of using the plurality of applications. The association 334 can describe an association between a plurality of file formats and a plurality of applications respectively corresponding to the plurality of file formats. For example, a data object having a file format 322 can be processed with an application 320, a data object having a file format 326 can be processed with an application 324, and so on. Further, in response to receiving the input information 230 from the user, the multimedia content 240 that matches the input information 230 can be obtained (e.g., from a processing system). The application 330 corresponding to the file format 220 of the multimedia content 240 can be determined from the plurality of applications based on the association 334, and the multimedia content 240 is presented with the application 330.
[0047] According to some implementations of the present disclosure, the usage history can indicate a plurality of applications used by the user during processing data objects of a plurality of file formats, and determining the association comprises: for a file format of the plurality of file formats, determining an application corresponding to the file format from the plurality of applications based on a usage frequency of the plurality of applications. During the user's historical usage, which application is used by the user to process a data object of a certain format respectively can be recorded, the usage frequency of each application can be determined, and then the association between the application and the file format can be determined.
[0048] For example, the user can use one or more text applications to process data objects in text format, the user can use one or more image applications to process data objects in text format, and so on. It should be understood that the applications herein can include applications installed locally on the client device of the user, and can also include network applications accessed via a browser. In this way, the user can be supported to process data using multiple types of applications.
[0049] An example of the association relationship is described with reference to FIG. 3C, which shows a block diagram 300C of the association relationship according to some implementations of the present disclosure. As shown, column 340 can represent a file format, column 342 can represent an application for processing a data object in a certain file format, and column 344 can represent an access address of the application. For example, in the case of a local application, the access address can represent an address of an executable file under a predetermined directory of the client device; in the case of a web application, the access address can represent an address of a uniform resource locator (URL) accessed via a browser of the client device.
[0050] According to some implementations of the present disclosure, the user can update the association relationship. Specifically, in the process of determining the association relationship, the association relationship is updated based on an update request in response to receiving the update request. For example, the user can add a new association relationship to the association relationship, edit an existing association relationship, and / or delete an existing association relationship. Specifically, the user can add relevant information about the application for the file format of “email” in FIG. 3C, for example, the application P can be used to process emails, and the web address of the application P can be specified, and so on. Alternatively and / or additionally, the user can use natural language to describe the association relationship, for example, the user can input: “I often use the application P to process emails”, and so on. A priority can be specified for each association relationship, so as to determine the relevant application in a more accurate manner.
[0051] According to some implementations of the present disclosure, for a certain file format, the association relationship can specify multiple candidate applications. At this time, a certain application can be selected from the multiple candidate applications. Specifically, in response to determining that the file format corresponds to multiple candidate applications based on the association relationship, the application supported by the client device is determined from the multiple candidate applications, and the method is executed at the client device.
[0052] For example, assume that the user specifies to use the local application 1 and the web application 2 to process the text, however the client device does not install the local application 1, at this time, the URL of the web application 2 can be accessed and the multimedia content can be opened by using the web application 2. Alternatively and / or additionally, the application that is currently opened can be used to present the multimedia content. With the example implementation of the present disclosure, the user waiting time can be reduced, and the user can be supported to further edit the multimedia content in the application that is currently being used.
[0053] According to some implementations of the present disclosure, in the process of determining the application, in response to determining that the file format corresponds to a plurality of candidate applications based on the association relationship, prompt information about the plurality of candidate applications can be provided. Further, in response to receiving a selection request for the prompt information, the application can be selected based on the selection request. With the example implementation of the present disclosure, the application that is more in line with the user's needs can be used to present the multimedia content.
[0054] According to some implementations of the present disclosure, the usage scenario of the user can be further determined, and the application can be selected based on the usage scenario. The input information can be analyzed to determine the usage scenario, assuming that the input information is: "Please write an email to invite colleagues of the technical department to have a meeting in conference room A tomorrow morning…". At this time, the usage scenario can be determined to be "work email scenario" based on text analysis, and / or calling a machine learning model in the processing system, and the local email application that the user often sends and receives work emails can be selected. For another example, assume that the input information is: "Please write an email to invite friends A and B to watch a movie after work…". At this time, the usage scenario can be determined to be "private email scenario" based on text analysis, and / or calling a machine learning model in the processing system, and the web email application that the user often sends and receives private emails can be selected.
[0055] According to some implementations of the present disclosure, the plurality of applications herein are web applications, and the method described above is implemented by using a plug-in of a browser for accessing the web applications, and the association relationship is stored in the plug-in. At this time, the usage history of the user using various file formats of data objects to process various file formats by various web applications can be collected by the plug-in, thereby supporting to determine the association relationship in a simpler and more effective manner.
[0056] According to some implementations of the present disclosure, the user can interact with the browser, for example, enter the input information in the browser, and view the multimedia data presented in the browser. With the example implementation of the present disclosure, the plurality of web applications can be called in the browser, and the multimedia content can be presented in a more effective manner.
[0057] According to some implementations of the present disclosure, a plug-in can be utilized to present an interaction page with the processing system in a browser. For example, the interaction page can be presented in a sidebar of the browser, alternatively and / or additionally, the interaction page can be presented in a floating manner overlaid on top of a page of the browser. More details about presenting multimedia content are described with reference to FIG. 4, which illustrates a block diagram 400 of presenting multimedia content in an email application according to some implementations of the present disclosure. As shown in FIG. 4, a browser 410 can include a left portion and a right portion, the left portion can present a sidebar 422 for interacting with the processing system, and the right portion can present a specific page of a web application accessed by the browser. Based on a URL accessed by the browser, an email application, a text application, a slide application, a data table application, etc. can be presented respectively.
[0058] According to some implementations of the present disclosure, in a process of presenting multimedia content with an application, the multimedia content can be copied to a workspace of the application for presenting the multimedia content by the application. Specifically, the application can be first opened with an access address of the application, and then the multimedia content can be copied to a target position associated with the input information in the workspace. According to some implementations of the present disclosure, the template position can be determined based on semantic recognition and / or with a machine learning model in the processing system.
[0059] Continuing the example above, the input information 430 input by the user can represent “please reply to email XX…”, and the processing system can provide multimedia content 432 for the input information. Here, the multimedia content 432 is in an email format, thus the email application 420 can be directly opened, further, from the input information 430, it can be determined that the target position is a position for “replying to an email”, at this time, the multimedia content 432 can be inserted at the position for replying to an email in the email application 420. Alternatively and / or additionally, assuming that the input information 430 represents “please reply to all people, …”, at this time, it can be determined that the target position is an input box for “replying to all”; again, assuming that the input information 430 represents “please forward the email, …”, at this time, it can be determined that the target position is an input box for “forwarding”. In this way, the content of replying to an email can be automatically input to the desired position without the complex operation of copying / pasting by the user. The user can further edit the email in the email application 420.
[0060] According to some implementations of the present disclosure, the input information can involve a new file format that has not been used before. Here, the multimedia content is determined based on a response of the processing system to the input information, and it can be determined by means of the processing system which application to use to present the multimedia content. Specifically, in response to a failure of the application to appear based on the association, a candidate application corresponding to a file format of the multimedia content is determined by means of the processing system; and the multimedia content is presented by means of the candidate application.
[0061] More details are described with reference to FIG. 5, which shows a block diagram 500 of presenting multimedia content in a text application according to some implementations of the present disclosure. Assume that the input information indicates “please generate a review of movie XX”, and the processing system generates a review in a text format, at this time, the processing system can determine to present the multimedia content by means of the text application. Specifically, the text application 520 can be automatically opened in a browser 510, and the generated review is presented. Alternatively and / or additionally, assume that the processing system generates a review in a rich media format (e.g., including text and images), then an editing application supporting the multimedia format can be automatically opened in the browser 510, and the generated review is presented. The user can further edit the review in the text application 520. With example implementations of the present disclosure, a new file format that has not been processed before can be processed by means of the powerful processing capability of the machine learning model in the processing system.
[0062] FIG. 6 shows a block diagram 600 of presenting multimedia content in a slideshow application according to some implementations of the present disclosure. As shown in FIG. 6, assume that the input information indicates “please generate a training material for coffee making…”, the processing system can generate a document including a data object in a multimedia format. At this time, a slideshow application 620 can be opened at a browser 610 to present the document. According to some implementations of the present disclosure, the corresponding document can be generated based on an application scenario specified by the user. Assume that an interaction request of the user for a page element 630 is received, it can be determined that the application scenario is a computing field scenario, i.e., the document is to be presented at a regular computer device. At this time, a slide 640 can be generated.
[0063] FIG. 7 shows a block diagram 700 of presenting multimedia content in a slideshow application according to some implementations of the present disclosure. As shown in FIG. 7, assume that an interaction request of the user for a page element 730 is received, it can be determined that the application scenario is a mobile device, i.e., the document is to be presented at a mobile device (e.g., a cell phone). At this time, a slide 740 can be generated. With example implementations of the present disclosure, the multimedia content can be generated and presented in a manner specified by the user for further editing.
[0064] According to some implementations of the present disclosure, a user can edit multimedia content in an application. Specifically, in response to receiving another input information in the application, another multimedia content is generated that matches the another input information, the another input information indicating a task performed on a first multimedia element in the multimedia content so as to generate a second multimedia element; and the another multimedia content including the second multimedia element is provided in the application. With continued reference to FIG. 7, a user can edit the slide 740 in the slide application 720. The user can double-click the image 750 (e.g., the first multimedia element) so as to edit the image, for example, the user can enter another input information in the input box 760, for example, "please convert the image to a grayscale image." At this time, the image 750 in the slide application 720 can be replaced with a grayscale image (e.g., the second multimedia element). With example implementations of the present disclosure, a user can be facilitated to invoke the powerful processing capability of the processing system in a current application to perform a desired task.
[0065] According to some implementations of the present disclosure, a user can interact with various multimedia elements in an application, for example, edit specific content of a multimedia element, etc. Specifically, in response to receiving an access request for a second multimedia element in the application, another application corresponding to a file format of the second multimedia element is determined (e.g., determined from a plurality of applications based on an association relationship); and the second multimedia element is presented using the another application.
[0066] With continued reference to FIG. 7, assuming that a user wishes to edit the image 750, another image editing application can be opened in a browser and the image is presented. In this way, a user can be facilitated to further adjust the image in the image editing application. For example, the user can modify the brightness of the image, insert text into the image, etc. Upon confirmation by the user, the image 750 in the slide application 720 can be replaced with the image confirmed in the image editing application. In this way, a browser can automatically provide an application for processing multimedia elements of different various file formats and avoid the complicated operation process of a user constantly querying which application to use to edit a multimedia element and subsequently downloading and installing a corresponding application in a use process.
[0067] FIG. 8 illustrates a block diagram 800 of presenting multimedia content in a data table application according to some implementations of the present disclosure. As shown in FIG. 8, assuming that the input information represents "statistics of the past three years of ** data", at this time the processing system can generate a data table and a data table application 820 can be opened at the browser 810 to present the generated data table. According to some implementations of the present disclosure, login information for accessing various applications can be stored in a browser, thereby further simplifying the complexity of user operations.
[0068] With the example implementations of the present disclosure, the content presentation format can be determined according to the input information of the user, and the corresponding multimedia content can be generated. Further, the multimedia content can be presented in a suitable manner, in this way, the user can be facilitated to view and / or edit the generated multimedia content. In this way, the complexity of manual operation of the user can be reduced, and the data processing efficiency can be improved.
[0069] Example process
[0070] FIG. 9 illustrates a flowchart of a method 900 for presenting multimedia content, according to some implementations of the present disclosure. At block 910, a content presentation format matching the input information of the user is determined in response to the input information. At block 920, a multimedia content is generated based on the input information and the content presentation format, and a file format of the multimedia content matches the content presentation format. At block 930, the multimedia content is presented.
[0071] According to some implementations of the present disclosure, generating the multimedia content includes generating a set of multimedia elements matching the input information, the multimedia content includes the set of multimedia elements, and a layout style of the set of multimedia elements is determined based on the input information and the content presentation format.
[0072] According to some implementations of the present disclosure, generating the multimedia content includes providing a plurality of prompt information respectively matching a plurality of candidate applications of the content presentation format to the user, selecting a candidate application matching the prompt information from the plurality of candidate applications in response to receiving an interaction request of the user for the prompt information in the plurality of prompt information, and generating the multimedia content based on at least one file format supported by the candidate application.
[0073] According to some implementations of the present disclosure, presenting the multimedia content includes determining an application for presenting the multimedia content, and presenting the multimedia content in the application.
[0074] According to some implementations of the present disclosure, determining the application for presenting the multimedia content includes determining the application based on a user input for specifying the application in response to receiving the user input.
[0075] According to some implementations of the present disclosure, determining the application for presenting the multimedia content includes determining an association relationship between a file format and a plurality of applications based on a usage history of the user using the plurality of applications, and selecting the application from the plurality of applications based on the association relationship.
[0076] According to some implementations of the present disclosure, the usage history indicates a plurality of applications used by the user during processing of a plurality of file formats of data objects, and determining the association relationship includes determining, for a file format in the plurality of file formats, an application corresponding to the file format from the plurality of applications based on a usage frequency of the plurality of applications.
[0077] According to some implementations of the present disclosure, determining the association further includes updating the association based on an update request in response to receiving the update request for the association.
[0078] According to some implementations of the present disclosure, determining the application includes determining the application supported by the client device from a plurality of candidate applications in response to determining that the file format corresponds to the plurality of candidate applications based on the association, the method being performed at the client device.
[0079] According to some implementations of the present disclosure, determining the application includes providing prompt information about the plurality of candidate applications in response to determining that the file format corresponds to the plurality of candidate applications based on the association, and selecting the application based on a selection request in response to receiving the selection request for the prompt information.
[0080] According to some implementations of the present disclosure, presenting the multimedia content in the application includes copying the multimedia content to a workspace of the application so as to present the multimedia content by the application.
[0081] According to some implementations of the present disclosure, the multimedia content is determined based on a response of the processing system to the input information, and the method further includes determining a candidate application corresponding to the file format of the multimedia content with the processing system in response to a failure of determining the application based on the association, and presenting the multimedia content with the candidate application.
[0082] According to some implementations of the present disclosure, the plurality of applications are web applications, the method is implemented with a plug-in of a browser for accessing the web applications, and the association is stored in the plug-in.
[0083] According to some implementations of the present disclosure, the input information is input in the browser, and the multimedia data is presented in the browser.
[0084] According to some implementations of the present disclosure, the method further includes generating another multimedia content matching the other input information in response to receiving the other input information in the application, the other input information indicating a task performed for a first multimedia element in the multimedia content so as to generate a second multimedia element, and providing the other multimedia content in the application, the other multimedia content including the second multimedia element.
[0085] According to some implementations of the present disclosure, the method further includes determining another application of the second multimedia element in response to receiving an access request for the second multimedia element in the application, and presenting the second multimedia element with the other application.
[0086] Example apparatus and devices
[0087] FIG. 10 illustrates a block diagram of an apparatus 1000 for presenting multimedia content according to some implementations of the present disclosure. The apparatus includes a determining module 1010 configured to determine, in response to input information of a user, a content presentation format matching the input information; a generating module 1020 configured to generate, based on the input information and the content presentation format, multimedia content whose file format matches the content presentation format; and a presenting module 1030 configured to present the multimedia content.
[0088] According to some implementations of the present disclosure, the generating module 1020 is further configured to generate a set of multimedia elements matching the input information, the multimedia content includes the set of multimedia elements, and a layout style of the set of multimedia elements is determined based on the input information and the content presentation format.
[0089] According to some implementations of the present disclosure, the generating module 1020 is further configured to provide, to the user, a plurality of prompt information respectively matching a plurality of candidate applications of the content presentation format; select, in response to receiving an interaction request of the user for prompt information in the plurality of prompt information, a candidate application matching the prompt information from the plurality of candidate applications; and generate the multimedia content based on at least one file format supported by the candidate application.
[0090] According to some implementations of the present disclosure, the presenting module 1030 is further configured to determine an application for presenting the multimedia content; and present the multimedia content in the application.
[0091] According to some implementations of the present disclosure, the presenting module 1030 is further configured to determine, in response to receiving a user input for specifying an application, the application based on the user input.
[0092] According to some implementations of the present disclosure, the presenting module 1030 is further configured to determine, based on a usage history of the user using a plurality of applications, an association relationship between the file format and the plurality of applications; and select, based on the association relationship, the application from the plurality of applications.
[0093] According to some implementations of the present disclosure, the usage history indicates a plurality of applications used by the user during processing of a data object in a plurality of file formats, and the presenting module 1030 is further configured to determine, for a file format in the plurality of file formats, an application corresponding to the file format from the plurality of applications based on a frequency of usage of the plurality of applications.
[0094] According to some implementations of the present disclosure, the presenting module 1030 is further configured to update, in response to receiving an update request for the association relationship, the association relationship based on the update request.
[0095] According to some implementations of the present disclosure, the presenting module 1030 is further configured for determining, in response to determining that the file format corresponds to a plurality of candidate applications based on the association, an application supported by the client device from the plurality of candidate applications, the method being performed at the client device.
[0096] According to some implementations of the present disclosure, the presenting module 1030 is further configured for providing prompt information about the plurality of candidate applications in response to determining that the file format corresponds to the plurality of candidate applications based on the association, and selecting the application based on a selection request received in response to the prompt information.
[0097] According to some implementations of the present disclosure, the presenting module 1030 is further configured for copying the multimedia content to a workspace of the application so as to present the multimedia content by the application.
[0098] According to some implementations of the present disclosure, the multimedia content is determined based on a response of the processing system to the input information, and the presenting module 1030 is further configured for determining, in response to determining that the application fails to appear based on the association, a candidate application corresponding to the file format of the multimedia content by the processing system, and presenting the multimedia content by the candidate application.
[0099] According to some implementations of the present disclosure, the plurality of applications are web applications, the apparatus 1000 is implemented by a plug-in of a browser for accessing the web applications, and the association is stored in the plug-in.
[0100] According to some implementations of the present disclosure, the input information is input in the browser, and the multimedia data is presented in the browser.
[0101] According to some implementations of the present disclosure, the apparatus 1000 is further configured for generating, in response to receiving another input information in the application, another multimedia content matched to the another input information, the another input information indicating a task performed on a first multimedia element in the multimedia content so as to generate a second multimedia element, and providing the another multimedia content in the application, the another multimedia content including the second multimedia element.
[0102] According to some implementations of the present disclosure, the apparatus 1000 is further configured for determining, in response to receiving an access request for the second multimedia element in the application, another application of the second multimedia element, and presenting the second multimedia element by the another application.
[0103] FIG. 11 illustrates a block diagram of a device 1100 that is capable of implementing the various implementations of the present disclosure. It should be appreciated that the computing device 1100 illustrated in FIG. 11 is merely an example and should not be construed as any limitation of the functionality and scope of the implementations described herein. The computing device 1100 illustrated in FIG. 11 can be used to implement the methods described above.
[0104] As illustrated in FIG. 11, the computing device 1100 is in the form of a general-purpose computing device. Components of the computing device 1100 can include, but are not limited to, one or more processors or processing units 1110, a memory 1120, a storage device 1130, one or more communication units 1140, one or more input devices 1150, and one or more output devices 1160. The processing unit 1110 can be a real or virtual processor and is capable of executing various processing in accordance with programs stored in the memory 1120. In a multi-processing system, multiple processing units execute computer-executable instructions in parallel to improve the processing power of the computing device 1100.
[0105] The computing device 1100 typically includes a plurality of computer storage media. Such media can be removable and / or non-removable, volatile and / or non-volatile. The memory 1120 can be volatile (such as a register, cache, or random access memory (RAM)), non-volatile (such as read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), or flash memory), or some combination thereof. The storage device 1130 can be a removable or non-removable media, and can include machine-readable media, such as a flash drive, magnetic disk, or any other media that can be used to store information and / or data (e.g., training data for training) and can be accessed by the computing device 1100.
[0106] The computing device 1100 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 11, a disk drive or other computer-readable media drive can be provided for reading from or writing to a removable, non-removable, volatile, or non-volatile media. In these instances, each drive can be connected to the bus (not shown) by one or more data media interfaces. The memory 1120 can include a computer program product 1125 having one or more program modules configured to carry out the various methods or actions of the various implementations of the present disclosure.
[0107] The communication unit 1140 enables communication with other computing devices over a communication medium. Additionally, the functionality of the components of the computing device 1100 can be implemented in a single computing cluster or a plurality of computer machines that are capable of communicating with each other through a communication connection. Thus, the computing device 1100 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network nodes in the networking environment.
[0108] The input device 1150 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. The output device 1160 can be one or more output devices, such as a display, a speaker, a printer, etc. The computing device 1100 can also communicate with one or more external devices (not shown), such as a storage device, a display device, etc., through the communication unit 1140, as needed, a device that enables a user to interact with the computing device 1100, or any device (e.g., a network card, a modem, etc.) that enables the computing device 1100 to communicate with one or more other computing devices. Such communication can be carried out via an input / output (I / O) interface (not shown).
[0109] According to an example implementation of the present disclosure, a computer readable storage medium is provided, having stored thereon computer executable instructions, wherein the computer executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, a computer program product is also provided, tangibly stored on a non-transitory computer readable medium and comprising computer executable instructions, wherein the computer executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, a computer program product is provided, having stored thereon a computer program, which when executed by a processor implements the method described above.
[0110] Various aspects of the disclosure are now described with reference to the drawings. In general, the drawings described herein relate to a method, an apparatus, a device, and a computer program product implemented according to the present disclosure. It will be understood that each block of the flowchart diagrams and / or block diagrams, and combinations of blocks in the flowchart diagrams and / or block diagrams, can be implemented by computer readable program instructions.
[0111] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.
[0112] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.
[0113] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks.
[0114] The implementations of the disclosure have been described above with the intent to be illustrative rather than limiting. Although being shown in only a few of the various implementations, the principle of each implementation can be extended to any other implementation. Some of the present implementations have also been described with the intent to be illustrative rather than restrictive. Many modifications and variations of the described implementations are possible in light of the above teachings. It is therefore contemplated that the application can encompass modifications and variations provided they come within the scope of the following claims. It is also contemplated that the implementing specific electric circuitry such as, for example, application specific integrated circuits (ASICs) can implement one or more of the described implementations. It is therefore accurate that the claims are framed to encompass both the specific examples disclosed and also the generic implementations so disclosed.
Claims
1. A method for presenting multimedia content, comprising: determining, in response to input information of a user, a content presentation format matching the input information; generating, based on the input information and the content presentation format, multimedia content, a file format of the multimedia content matching the content presentation format; and presenting the multimedia content. generating a set of multimedia elements matching the input information, the multimedia content including the set of multimedia elements, and a layout style of the set of multimedia elements being determined based on the input information and the content presentation format.
2. The method of claim 1, wherein generating the multimedia content comprises: 3.The method of claim 1, wherein generating the multimedia content comprises: providing, to the user, a plurality of prompt information respectively matching a plurality of candidate applications of the content presentation format; selecting, in response to receiving an interaction request of the user for a prompt information of the plurality of prompt information, a candidate application matching the prompt information from the plurality of candidate applications; and generating the multimedia content based on at least one file format supported by the candidate application. 4.The method of claim 1, wherein presenting the multimedia content comprises: determining an application for presenting the multimedia content; and presenting the multimedia content in the application. determining the application based on a user input for specifying the application in response to receiving the user input. 6.The method of claim 4, wherein determining the application for presenting the multimedia content comprises: determining, based on a usage history of the user using a plurality of applications, an association relationship between the file format and the plurality of applications; and 5. The method of claim 4, wherein determining the application for presenting the multimedia content comprises: selecting the application from the plurality of applications based on the association relationship. determining, for the file format of the plurality of file formats, an application corresponding to the file format from the plurality of applications based on a frequency of usage of the plurality of applications. updating the association relationship based on an update request for the association relationship in response to receiving the update request. determining the application supported by a client device from a plurality of candidate applications in response to determining that the file format corresponds to the plurality of candidate applications based on the association relationship, the method being executed at the client device. 10.The method of claim 6, wherein determining the application comprises:
7. The method of claim 6, wherein the usage history indicates the plurality of applications used by the user during processing of a plurality of file format data objects, and determining the associations comprises: providing prompt information about a plurality of candidate applications in response to determining that the file format corresponds to the plurality of candidate applications based on the association relationship; and 8. The method of claim 6, wherein determining the association further comprises: selecting the application based on a selection request for the prompt information in response to receiving the selection request.
9. The method of claim 6, wherein determining the application comprises: copying the multimedia content to a workspace of the application so as to present the multimedia content by the application. 12.The method of claim 1, wherein the multimedia content is determined based on a response of a processing system to the input information, and the method further comprises: determining, in response to determining that the application fails to appear based on the association relationship, a candidate application corresponding to a file format of the multimedia content with the processing system; and presenting the multimedia content with the candidate application. 11. The method of claim 4, wherein presenting the multimedia content in the application comprises: 13. The method of claim 1, wherein the plurality of applications are web page applications, the method is implemented with a plug-in of a browser used to access the web page applications, and the association is stored in the plug-in.
14. The method of claim 13, wherein the input information is input in the browser, and the multimedia data is presented in the browser.
15. The method of claim 4, further comprising: in response to receiving another input information in the application, generating another multimedia content matching the another input information, the another input information indicating a task performed on a first multimedia element in the multimedia content to generate a second multimedia element; and providing the another multimedia content in the application, the another multimedia content including the second multimedia element.
16. The method of claim 15, further comprising: in response to receiving an access request for the second multimedia element in the application, determining another application for the second multimedia element; and presenting the second multimedia element with the another application.
17. An apparatus for presenting multimedia content, comprising: a determining module configured to determine, in response to an input information of a user, a content presentation format matching the input information; a generating module configured to generate, based on the input information and the content presentation format, a multimedia content, a file format of the multimedia content matching the content presentation format; and a presenting module configured to present the multimedia content.
18. An electronic device, comprising: at least one processing unit; and at least one memory coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions which when executed by the at least one processing unit cause the electronic device to perform the method according to any one of claims 1-16.
19. A computer-readable storage medium having stored thereon a computer program which, when executed by a processor, causes the processor to implement the method according to any one of claims 1-16.
20. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1-16.
Citation Information
Patent Citations
Multimedia data display method and device and storage medium
CN110020293A
Method and system for parsing rich text editor content to native client for rendering, and medium
CN111241793A
Financial content recommendation method and device, electronic equipment and storage medium
CN117271807A
Media content presentation by categorizing and formatting media types
US9454531B1