Method and device for presenting multimedia content, equipment and medium
By responding to user input information, determining and generating a matching multimedia content presentation format, the problem that the multimedia content presentation format does not match user needs is solved, and operation efficiency and data processing efficiency are improved.
Patent Information
- Application Number
- CN202480002193.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-26
- Publication Date
- 2024-12-06
AI Technical Summary
When users process multimedia content provided by the system, they need to be complicated manually and cannot be used directly. The presentation format of the multimedia content does not match the user's needs, resulting in low operation efficiency.
By responding to user input information, determine the matching content presentation format and generate corresponding multimedia content to ensure that the file format matches the presentation format, thereby directly presenting the multimedia content and reducing the complexity of user manual operation.
Improve data processing efficiency, simplify user operation processes, enable users to view and edit multimedia content more easily, and reduce manual copying and pasting operations.
Smart Images

Figure CN119096229A_ABST
Abstract
Description
Technical Field
[0001] Exemplary implementations of the present disclosure generally relate to the field of computers, and in particular, to methods, devices, apparatuses, and computer-readable storage media for presenting multimedia content. Background Art
[0002] With the rapid development of computer technology, processing systems can provide various services to users. For example, a processing system can obtain input information from a user and provide corresponding multimedia content based on the input information. However, the user may not be able to use the multimedia content directly, but needs to perform further operations on the multimedia content. At this time, it is expected that the multimedia content can be determined and presented in a more effective manner so that the user can perform subsequent operations. Summary of the invention
[0003] In a first aspect of the present disclosure, a method for presenting multimedia content is provided. In the method, in response to input information of a user, a content presentation format matching the input information is determined. Based on the input information and the content presentation format, multimedia content is generated, and the file format of the multimedia content matches the content presentation format. The multimedia content is presented.
[0004] In a second aspect of the present disclosure, a device for presenting multimedia content is provided. The device includes: a determination module configured to determine, in response to user input information, a content presentation format that matches the input information; a generation module configured to generate multimedia content based on the input information and the content presentation format, wherein the file format of the multimedia content matches the content presentation format; and a presentation module configured to present the multimedia content.
[0005] In a third aspect of the present disclosure, an electronic device is provided. The electronic device includes: at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit, and when the instructions are executed by the at least one processing unit, the electronic device executes the method according to the first aspect of the present disclosure.
[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the processor implements the method according to the first aspect of the present disclosure.
[0007] In a fifth aspect of the present disclosure, a computer program product is provided, comprising a computer program, wherein the computer program implements the method according to the first aspect of the present disclosure when executed by a processor.
[0008] It should be understood that the content described in this content section is not intended to limit the key features or important features of the implementation of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easy to understand through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] In the following, in conjunction with the accompanying drawings and with reference to the following detailed description, the above and other features, advantages and aspects of various implementations of the present disclosure will become more apparent. In the accompanying drawings, the same or similar figure labels represent the same or similar elements, wherein:
[0010] Figure 1 A block diagram showing an application environment according to an exemplary implementation of the present disclosure is shown;
[0011] Figure 2 A block diagram for presenting multimedia content according to some implementations of the present disclosure is shown;
[0012] Figure 3A A block diagram illustrating multimedia content according to some implementations of the present disclosure;
[0013] Figure 3B A block diagram for selecting an application according to some implementations of the present disclosure is shown;
[0014] Figure 3C A block diagram showing association relationships according to some implementations of the present disclosure;
[0015] Figure 4 A block diagram illustrating presenting multimedia content in an email application according to some implementations of the present disclosure is shown;
[0016] Figure 5 A block diagram illustrating presenting multimedia content in a text application according to some implementations of the present disclosure is shown;
[0017] Figure 6 A block diagram showing a method of presenting multimedia content in a slideshow application according to some implementations of the present disclosure is shown;
[0018] Figure 7 A block diagram showing a method of presenting multimedia content in a slideshow application according to some implementations of the present disclosure is shown;
[0019] Figure 8 A block diagram illustrating presenting multimedia content in a data table application according to some implementations of the present disclosure is shown;
[0020] Fig. 9 A flowchart of a method for presenting multimedia content according to some implementations of the present disclosure is shown;
[0021] Fig.10A block diagram showing an apparatus for presenting multimedia content according to some implementations of the present disclosure; and
[0022] Fig.11 A block diagram of a device capable of implementing multiple implementations of the present disclosure is shown. DETAILED DESCRIPTION
[0023] The implementation of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain implementations of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be interpreted as being limited to the implementations described herein. On the contrary, these implementations are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and implementations of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.
[0024] In the description of the implementation methods of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "an implementation" or "the implementation" should be understood as "at least one implementation". The term "some implementations" should be understood as "at least some implementations". The following may also include other explicit and implicit definitions. As used herein, the term "model" can represent the association relationship between various data. For example, the above-mentioned association relationship can be obtained based on a variety of technical solutions currently known and / or to be developed in the future.
[0025] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition or use of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.
[0026] It is understandable that before using the technical solutions disclosed in the embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.
[0027] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.
[0028] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information is sent to the user in a manner such as a pop-up window, in which the prompt information can be presented in text form. In addition, the pop-up window can also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.
[0029] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present disclosure.
[0030] The term "in response to" as used herein refers to a state in which a corresponding event occurs or a condition is satisfied. It will be understood that the timing of executing a subsequent action executed in response to the event or condition is not necessarily strongly related to the time when the event occurs or the condition is satisfied. For example, in some cases, the subsequent action may be executed immediately when the event occurs or the condition is satisfied; while in other cases, the subsequent action may be executed some time after the event occurs or the condition is satisfied.
[0031] Example Environment
[0032] The processing system can provide various services to the user. For example, the processing system can obtain input information from the user and provide corresponding multimedia content based on the input information. Figure 1 Describe the application environment according to some implementations of the present disclosure. Figure 1 A block diagram 100 of an application environment according to an exemplary implementation of the present disclosure is shown. Figure 1 As shown, the processing system 110 can perform a variety of tasks, and the user can input the desired task in the input box 140 and submit the input information. For example, the processing system 110 can receive the input information 120 and generate corresponding multimedia content 130.
[0033] Here, the processing system 110 may include, for example, a query system and / or a generative system based on a machine learning model. The user may construct a prompt word as input information 120 to obtain a corresponding response from the processing system 110. Assuming that the user wants to compose an email, the user may enter "please compose an email...", and the multimedia content 130 may include the content of the corresponding email. However, at this time, the user has to manually open the email application and copy the multimedia content 130 into the email application to perform further editing. At this time, it is expected that the multimedia content can be determined and presented in a more efficient manner so that the user can perform subsequent operations.
[0034] Presenting a summary of multimedia content
[0035] In order to at least partially solve the deficiencies in the prior art, according to an exemplary implementation of the present disclosure, a method for presenting multimedia content is proposed. Figure 2 Describes an overview of an exemplary implementation according to the present disclosure, Figure 2 A block diagram 200 for presenting multimedia content according to some implementations of the present disclosure is shown. Figure 2 As shown, in response to user input information 230, a content presentation format 210 matching the input information 230 may be determined. Based on the input information 230 and the content presentation format 210, multimedia content 240 is generated, and the file format 220 of the multimedia content 240 matches the content presentation format 210. Further, the multimedia content 240 may be presented.
[0036] According to some implementations of the present disclosure, the content presentation format may include, but is not limited to, a text format, an image format, an audio format, a video format, or a rich media format including data in different formats, etc. The multimedia content may have a certain file format, which may be a format that supports browsing and / or editing by one or more applications. There may be a corresponding relationship between the content presentation format and the file format. For example, the text format may correspond to multiple file formats, such as ".txt" format, ".doc" format, etc.; the image format may correspond to multiple file formats, such as ".jpg" format, ".bmp" format, etc.; the rich media format may correspond to multiple file formats, such as ".pdf" format, ".html" format, etc.
[0037] By using the example implementation of the present disclosure, the content presentation format can be determined according to the information input by the user, and the corresponding multimedia content can be generated. Further, the multimedia content can be presented in a suitable manner, so that it is convenient for the user to view and / or edit the generated multimedia content. In this way, the complexity of the user's manual operation can be reduced, thereby improving the data processing efficiency.
[0038] Detailed process of presenting multimedia content
[0039] An overview of some implementations of the present disclosure has been described, and more details will be provided below. According to some implementations of the present disclosure, generating multimedia content may include: generating a set of multimedia elements that match input information, the multimedia content includes a set of multimedia elements, and a layout style of the set of multimedia elements is determined based on the input information and the content presentation format.
[0040] Specifically, the input information here can be a prompt word input to a processing system (for example, based on a machine learning model), and the processing system can generate a set of multimedia elements that match the input information. Figure 3A Describe in more detail the Figure 3A Block diagram 300A of multimedia content according to some implementations of the present disclosure is shown. Figure 3A As shown, the processing system may directly generate the generated multimedia elements 312, ..., 314 arranged according to the layout style 316. Alternatively and / or additionally, the processing system may generate the multimedia elements 312, ..., 314 and the layout style 316 respectively, and further the multimedia elements 312, ..., 314 may be arranged according to the layout style 316 to generate the multimedia content 240. Alternatively and / or additionally, the processing system may generate the multimedia elements 312, ..., 314 respectively, and each multimedia element may be presented, and the user may arrange each multimedia element according to a customized layout style to generate multimedia content that better meets their needs.
[0041] According to some implementations of the present disclosure, in the process of generating multimedia content, multiple prompt information of multiple candidate applications that respectively match the content presentation format can be provided to the user; in response to receiving an interactive request from the user for prompt information in the multiple prompt information, a candidate application that matches the prompt information is selected from the multiple candidate applications; and multimedia content is generated based on at least one file format supported by the candidate application.
[0042] Specifically, assuming that the content presentation format is an image format, and application A, application B, and application C can all present and edit data objects in image format, then prompt information A, prompt information B, and prompt information C corresponding to each application can be provided to the user. Based on the user's selection of prompt information, it can be determined that the user expects to present and / or edit multimedia content in image format. Assuming that the user selects prompt information A, and application A corresponding to prompt information A can support ".jpg" format and ".bmp" format, at this time, images in ".jpg" format and / or ".bmp" format can be generated. Using the example implementation of the present disclosure, suitable multimedia content can be generated based on user needs to facilitate subsequent user operations.
[0043] According to some implementations of the present disclosure, in the process of presenting multimedia content, an application for presenting the multimedia content can be determined, and the multimedia content can be presented in the application. Specifically, an application specified by the user can be selected, and / or an application that the user has frequently used in the past can be selected. Specifically, in order to determine the application for presenting the multimedia content, in response to receiving user input for specifying the application, the application can be determined based on the user input. For example, the user can be asked: "Which application do you want to use to open the multimedia content?" In this way, an application that better matches the user's needs can be selected.
[0044] Alternatively and / or additionally, in the process of determining the application for presenting the multimedia content, an association relationship between the file format and the multiple applications may be determined based on the user's usage history of the multiple applications; and an application may be selected from the multiple applications based on the association relationship. Figure 3B For more information, Figure 3B A block diagram 300B for selecting an application according to some implementations of the present disclosure is shown.
[0045] like Figure 3B As shown, an association relationship 334 may be determined based on a usage history 332 of multiple applications. The association relationship 334 may describe an association relationship between multiple file formats and multiple applications corresponding to the multiple file formats, respectively. For example, application 320 may be used to process a data object having a file format 322, ..., application 324 may be used to process a data object having a file format 326, and so on. Further, in response to receiving input information 230 from a user, multimedia content 240 matching the input information 230 may be obtained (e.g., the multimedia content is obtained from a processing system). Based on the association relationship 334, an application 330 corresponding to the file format 220 of the multimedia content 240 may be determined from multiple applications, and the multimedia content 240 may be presented using the application 330.
[0046] According to some implementations of the present disclosure, the usage history may indicate multiple applications used by a user during processing of data objects of multiple file formats, and determining the association relationship includes: for a file format in the multiple file formats, based on the usage frequencies of the multiple applications, determining the application corresponding to the file format from the multiple applications. During the user's historical usage, it may be recorded which application the user used to process a data object of a certain format, the usage frequency of each application may be determined, and then the association relationship between the application and the file format may be determined.
[0047] For example, a user may use one or more text applications to process a data object in a text format, a user may use one or more image applications to process a data object in a text format, and so on. It should be understood that the application herein may include an application installed locally on the user's client device, or may include a network application accessed via a browser. In this way, it is possible to support users to process data using multiple types of applications.
[0048] See also Figure 3C Describes an example of an association relationship. Figure 3C A block diagram 300C is shown of association relationships according to some implementations of the present disclosure. As shown, column 340 may represent a file format, column 342 may represent an application for processing a data object of a certain file format, and column 344 may represent an access address of the application. For example, in the case of a local application, the access address may represent an address of an executable file in a predetermined directory of a client device; in the case of a web application, the access address may represent an address of a uniform resource locator (URL) accessed via a browser of the client device.
[0049] According to some implementations of the present disclosure, a user can update an association relationship. Specifically, in the process of determining an association relationship, in response to receiving an update request for the association relationship, the association relationship is updated based on the update request. For example, a user can add a new association relationship to the association relationship, edit an existing association relationship, and / or delete an existing association relationship. Specifically, a user can Figure 3C In the example, the user can add relevant information about the application of the file format of "email" to the user, for example, the application P can be used to process emails, and the webpage address of the application P can be specified, etc. Alternatively and / or additionally, the user can use natural language to describe the association relationship, for example, the user can enter: "I often use application P to process emails", etc. A priority can be specified for each association relationship so as to determine the relevant application in a more accurate manner.
[0050] According to some implementations of the present disclosure, for a certain file format, the association relationship may specify multiple candidate applications. In this case, a certain application may be selected from the multiple candidate applications. Specifically, in response to determining that the file format corresponds to the multiple candidate applications based on the association relationship, an application supported by the client device is determined from the multiple candidate applications, and the method is performed at the client device.
[0051] For example, assuming that the user specifies to use local application 1 and web application 2 to process text, but the client device does not have local application 1 installed, at this time, the URL of web application 2 can be accessed and the multimedia content can be opened using the web application 2. Alternatively and / or additionally, the currently opened application can be used to present the multimedia content. Using the example implementation of the present disclosure, the user's waiting time can be reduced, and the user is supported to further edit the multimedia content in the application currently being used.
[0052] According to some implementations of the present disclosure, in the process of determining an application, in response to determining that a file format corresponds to multiple candidate applications based on an association relationship, prompt information about multiple candidate applications can be provided. Further, in response to receiving a selection request for the prompt information, an application can be selected based on the selection request. Using the example implementation of the present disclosure, multimedia content can be presented using an application that better meets user needs.
[0053] According to some implementations of the present disclosure, the user's usage scenario can be further determined, and an application can be selected based on the usage scenario. The input information can be analyzed to determine the usage scenario. Suppose the input information is: "Please write an email to invite colleagues from the technical department to a meeting in conference room A tomorrow morning..." At this time, the usage scenario can be determined as a "work email scenario" based on text analysis and / or calling a machine learning model in the processing system, and a local email application that the user frequently sends and receives work emails can be selected. For another example, suppose the input information is: "Please write an email to invite friends A and B to watch a movie after get off work..." At this time, the usage scenario can be determined as a "private email scenario" based on text analysis and / or calling a machine learning model in the processing system, and a web email application that the user frequently sends and receives private emails can be selected.
[0054] According to some implementations of the present disclosure, the multiple applications herein are web applications, and the method described above is implemented using a plug-in of a browser for accessing web applications, and the association relationship is stored in the plug-in. In this case, the plug-in can collect the user's usage history of using each web application to process data objects of various file formats, thereby supporting the determination of the association relationship in a simpler and more effective manner.
[0055] According to some implementations of the present disclosure, a user can interact with a browser, for example, enter input information in the browser, and view multimedia data presented in the browser. Using the example implementations of the present disclosure, multiple web applications can be called in the browser, and multimedia content can be presented in a more efficient manner.
[0056] According to some implementations of the present disclosure, a plug-in may be used to present an interactive page with a processing system in a browser. For example, the interactive page may be presented in a sidebar of the browser, and alternatively and / or additionally, the interactive page may be presented in a floating layer overlaid on the page of the browser. Figure 4 Describes more details about presenting multimedia content. Figure 4 A block diagram 400 is shown for presenting multimedia content in an email application according to some implementations of the present disclosure. Figure 4 As shown, the browser 410 may include a left portion and a right portion, the left portion may present a sidebar 422 for interacting with the processing system, and the right portion may present a specific page of a web application accessed by the browser. Based on the URL accessed by the browser, an email application, a text application, a slide application, a data table application, etc. may be presented respectively.
[0057] According to some implementations of the present disclosure, in the process of presenting multimedia content using an application, the multimedia content can be copied to the workspace of the application so that the multimedia content is presented by the application. Specifically, the application can be first opened using the access address of the application, and then the multimedia content can be copied to the target location in the workspace associated with the input information. According to some implementations of the present disclosure, the template position can be determined based on semantic recognition and / or using a machine learning model in a processing system.
[0058] Continuing with the above example, the input information 430 input by the user may represent “Please reply to email XX…”, and the processing system may provide multimedia content 432 for the input information. Here, the multimedia content 432 is in the email format, so the email application 420 may be directly opened. Further, the target location may be determined to be the location of “reply email” from the input information 430, and the multimedia content 432 may be inserted at the location for replying emails in the email application 420. Alternatively and / or additionally, assuming that the input information 430 represents “Please reply to all people,…”, the target location may be determined to be an input box for “reply all”; assuming that the input information 430 represents “Please forward the email,…”, the target location may be determined to be an input box for “forward”. In this way, the content of the reply email may be automatically input to the desired location without the need for the user to perform complex operations of copying / pasting. The user may further edit the email in the email application 420.
[0059] According to some implementations of the present disclosure, the input information may involve a new file format that has not been used before. Here, the multimedia content is determined based on the response of the processing system to the input information, and the processing system can be used to determine which application to use to present the multimedia content. Specifically, in response to the failure of determining that the application has failed based on the association relationship, the processing system is used to determine a candidate application corresponding to the file format of the multimedia content; and the multimedia content is presented using the candidate application.
[0060] See also Figure 5 Describe in more detail, Figure 5 A block diagram 500 for presenting multimedia content in a text application according to some implementations of the present disclosure is shown. Assuming that the input information indicates "please generate a review of movie XX", and the processing system generates a review in text format, at this time, the processing system can determine to use a text application to present the multimedia content. Specifically, the text application 520 can be automatically opened in the browser 510, and the generated review can be presented. Alternatively and / or additionally, assuming that the processing system generates a review in a rich media format (e.g., including text and images), an editing application that supports multimedia formats can be automatically opened in the browser 510, and the generated review can be presented. The user can further edit the review in the text application 520. Using the example implementation of the present disclosure, new file formats that have not been processed before can be processed with the help of the powerful processing capabilities of the machine learning model in the processing system.
[0061] Figure 6 A block diagram 600 of presenting multimedia content in a slideshow application according to some implementations of the present disclosure is shown. Figure 6 As shown, assuming that the input information indicates "please generate coffee making training materials...", the processing system can generate a document including a data object in a multimedia format. At this time, a slide application 620 can be opened at the browser 610 to present the document. According to some implementations of the present disclosure, a corresponding document can be generated based on an application scenario specified by a user. Assuming that a user's interactive request for a page element 630 is received, it can be determined that the application scenario is a computer scenario, and the document is about to be presented at a conventional computer device. At this time, a slide 640 can be generated.
[0062] Figure 7 A block diagram 700 of presenting multimedia content in a slideshow application according to some implementations of the present disclosure is shown. Figure 7 As shown, assuming that a user's interactive request for page element 730 is received, it can be determined that the application scenario is a mobile device, and the document is to be presented at the mobile device (e.g., a mobile phone). At this time, a slide 740 can be generated. Using the example implementation of the present disclosure, multimedia content can be generated and presented in a user-specified manner for further editing by the user.
[0063] According to some implementations of the present disclosure, a user can edit multimedia content in an application. Specifically, in response to receiving another input information in the application, another multimedia content matching the another input information is generated, the another input information indicates a task to be performed on a first multimedia element in the multimedia content in order to generate a second multimedia element; and another multimedia content is provided in the application, the another multimedia content including the second multimedia element. Figure 7 , the user can edit the slide 740 in the slide application 720. The user can double-click the image 750 (e.g., the first multimedia element) to edit the image. For example, the user can enter another input information in the input box 760, such as "please convert the image to a grayscale image". At this time, the image 750 in the slide application 720 can be replaced with the grayscale image (e.g., the second multimedia element). Using the example implementation of the present disclosure, it is convenient for the user to call the powerful processing capability of the processing system in the current application to perform the desired task.
[0064] According to some implementations of the present disclosure, a user may interact with each multimedia element in an application, for example, edit specific content of the multimedia element, etc. Specifically, in response to receiving an access request for a second multimedia element in an application, another application corresponding to a file format of the second multimedia element is determined (for example, from multiple applications based on an association relationship); and the second multimedia element is presented using the other application.
[0065] Continue to see Figure 7 , assuming that the user wants to edit image 750, another image editing application can be opened in the browser and the image can be presented. In this way, it is convenient for the user to further adjust the image in the image editing application. For example, the user can modify the brightness of the image, insert text into the image, and so on. With the user's confirmation, the image 750 in the slide application 720 can be replaced with the image confirmed in the image editing application. In this way, the browser can automatically provide an application for processing multimedia elements in various file formats, and avoid the user's constant query during use of which application to use to edit the multimedia elements, and the complex operation process of subsequently downloading and installing the corresponding application.
[0066] Figure 8 A block diagram 800 is shown for presenting multimedia content in a data table application according to some implementations of the present disclosure. Figure 8As shown, assuming that the input information indicates "statistics of ** data for the past three years", the processing system can generate a data table, and a data table application 820 can be opened at the browser 810 to present the generated data table. According to some implementations of the present disclosure, login information for accessing various applications can be stored in the browser, thereby further simplifying the complexity of user operations.
[0067] By using the example implementation of the present disclosure, the content presentation format can be determined according to the information input by the user, and the corresponding multimedia content can be generated. Further, the multimedia content can be presented in a suitable manner, so that it is convenient for the user to view and / or edit the generated multimedia content. In this way, the complexity of the user's manual operation can be reduced, thereby improving the data processing efficiency.
[0068] Example Process
[0069] Fig. 9 A flow chart of a method 900 for presenting multimedia content according to some implementations of the present disclosure is shown. At block 910, in response to input information from a user, a content presentation format that matches the input information is determined. At block 920, multimedia content is generated based on the input information and the content presentation format, and the file format of the multimedia content matches the content presentation format. At block 930, the multimedia content is presented.
[0070] According to some implementations of the present disclosure, generating multimedia content includes: generating a group of multimedia elements matching input information, the multimedia content includes a group of multimedia elements, and the layout style of the group of multimedia elements is determined based on the input information and the content presentation format.
[0071] According to some implementations of the present disclosure, generating multimedia content includes: providing a user with multiple prompt information of multiple candidate applications that respectively match the content presentation format; in response to receiving an interactive request from the user for the prompt information in the multiple prompt information, selecting a candidate application that matches the prompt information from the multiple candidate applications; and generating the multimedia content based on at least one file format supported by the candidate application.
[0072] According to some implementations of the present disclosure, presenting multimedia content includes: determining an application for presenting the multimedia content; and presenting the multimedia content in the application.
[0073] According to some implementations of the present disclosure, determining an application for presenting multimedia content includes: in response to receiving a user input for specifying an application, determining the application based on the user input.
[0074] According to some implementations of the present disclosure, determining an application for presenting multimedia content includes: determining associations between file formats and multiple applications based on a user's usage history of the multiple applications; and selecting an application from the multiple applications based on the associations.
[0075] According to some implementations of the present disclosure, the usage history indicates multiple applications used by a user during processing of data objects in multiple file formats, and determining the association relationship includes: for a file format among the multiple file formats, based on the usage frequency of the multiple applications, determining the application corresponding to the file format from the multiple applications.
[0076] According to some implementations of the present disclosure, determining the association relationship further includes: in response to receiving an update request for the association relationship, updating the association relationship based on the update request.
[0077] According to some implementations of the present disclosure, determining the application includes: in response to determining that the file format corresponds to multiple candidate applications based on the association relationship, determining an application supported by the client device from the multiple candidate applications, and the method is executed at the client device.
[0078] According to some implementations of the present disclosure, determining an application includes: in response to determining that a file format corresponds to multiple candidate applications based on an association relationship, providing prompt information about the multiple candidate applications; and in response to receiving a selection request for the prompt information, selecting an application based on the selection request.
[0079] According to some implementations of the present disclosure, presenting the multimedia content in the application includes: copying the multimedia content to a workspace of the application so that the application presents the multimedia content.
[0080] According to some implementations of the present disclosure, the multimedia content is determined based on a response of a processing system to input information, and the method further includes: in response to determining that an application has failed based on an association relationship, determining, using the processing system, a candidate application corresponding to a file format of the multimedia content; and presenting the multimedia content using the candidate application.
[0081] According to some implementations of the present disclosure, the plurality of applications are web applications, the method is implemented using a plug-in of a browser for accessing the web applications, and the association relationship is stored in the plug-in.
[0082] According to some implementations of the present disclosure, input information is input in a browser, and multimedia data is presented in the browser.
[0083] According to some implementations of the present disclosure, the method further includes: in response to receiving another input information in the application, generating another multimedia content matching the another input information, the other input information indicating a task performed on a first multimedia element in the multimedia content in order to generate a second multimedia element; and providing another multimedia content in the application, the other multimedia content including the second multimedia element.
[0084] According to some implementations of the present disclosure, the method further includes: in response to receiving an access request for the second multimedia element in the application, determining another application of the second multimedia element; and presenting the second multimedia element using the other application.
[0085] Example devices and equipment
[0086] Fig.10 A block diagram of an apparatus 1000 for presenting multimedia content according to some implementations of the present disclosure is shown. The apparatus includes: a determination module 1010, configured to determine, in response to user input information, a content presentation format that matches the input information; a generation module 1020, configured to generate multimedia content based on the input information and the content presentation format, wherein the file format of the multimedia content matches the content presentation format; and a presentation module 1030, configured to present the multimedia content.
[0087] According to some implementations of the present disclosure, the generation module 1020 is further configured to: generate a set of multimedia elements matching the input information, the multimedia content includes a set of multimedia elements, and the layout style of the set of multimedia elements is determined based on the input information and the content presentation format.
[0088] According to some implementations of the present disclosure, the generation module 1020 is further configured to: provide a user with multiple prompt information of multiple candidate applications that respectively match the content presentation format; in response to receiving an interactive request from the user for the prompt information in the multiple prompt information, select a candidate application that matches the prompt information from the multiple candidate applications; and generate multimedia content based on at least one file format supported by the candidate application.
[0089] According to some implementations of the present disclosure, the presentation module 1030 is further configured to: determine an application for presenting the multimedia content; and present the multimedia content in the application.
[0090] According to some implementations of the present disclosure, the presentation module 1030 is further configured to: in response to receiving a user input for specifying an application, determine the application based on the user input.
[0091] According to some implementations of the present disclosure, the presentation module 1030 is further configured to: determine the association relationship between the file format and the multiple applications based on the user's usage history of the multiple applications; and select an application from the multiple applications based on the association relationship.
[0092] According to some implementations of the present disclosure, the usage history indicates multiple applications used by the user during processing of data objects of multiple file formats, and the presentation module 1030 is further configured to: for a file format among the multiple file formats, determine an application corresponding to the file format from the multiple applications based on the usage frequency of the multiple applications.
[0093] According to some implementations of the present disclosure, the presentation module 1030 is further configured to: in response to receiving an update request for the association relationship, update the association relationship based on the update request.
[0094] According to some implementations of the present disclosure, the presentation module 1030 is further configured to: in response to determining that the file format corresponds to multiple candidate applications based on the association relationship, determine an application supported by the client device from the multiple candidate applications, and the method is executed at the client device.
[0095] According to some implementations of the present disclosure, the presentation module 1030 is further configured to: in response to determining that the file format corresponds to multiple candidate applications based on the association relationship, provide prompt information about multiple candidate applications; and in response to receiving a selection request for the prompt information, select an application based on the selection request.
[0096] According to some implementations of the present disclosure, the presentation module 1030 is further configured to: copy the multimedia content to the workspace of the application so that the multimedia content is presented by the application.
[0097] According to some implementations of the present disclosure, the multimedia content is determined based on the response of the processing system to the input information, and the presentation module 1030 is further configured to: in response to determining that an application has failed based on an association relationship, determine a candidate application corresponding to the file format of the multimedia content using the processing system; and present the multimedia content using the candidate application.
[0098] According to some implementations of the present disclosure, the plurality of applications are web applications, the apparatus 1000 is implemented using a plug-in of a browser for accessing the web application, and the association relationship is stored in the plug-in.
[0099] According to some implementations of the present disclosure, input information is input in a browser, and multimedia data is presented in the browser.
[0100] According to some implementations of the present disclosure, the device 1000 is further configured to: in response to receiving another input information in the application, generate another multimedia content matching the other input information, the other input information indicating a task performed on a first multimedia element in the multimedia content in order to generate a second multimedia element; and provide another multimedia content in the application, the other multimedia content including the second multimedia element.
[0101] According to some implementations of the present disclosure, the apparatus 1000 is further configured to: in response to receiving an access request for the second multimedia element in the application, determine another application of the second multimedia element; and present the second multimedia element using the other application.
[0102] Fig.11 1 shows a block diagram of a device 1100 capable of implementing multiple implementations of the present disclosure. It should be understood that Fig.11 The computing device 1100 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the implementations described herein. Fig.11 The computing device 1100 shown may be used to implement the methods described above.
[0103] like Fig.11 As shown, computing device 1100 is in the form of a general-purpose computing device. Components of computing device 1100 may include, but are not limited to, one or more processors or processing units 1110, memory 1120, storage device 1130, one or more communication units 1140, one or more input devices 1150, and one or more output devices 1160. Processing unit 1110 may be an actual or virtual processor and is capable of performing various processes according to a program stored in memory 1120. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to increase the parallel processing capabilities of computing device 1100.
[0104] The computing device 1100 typically includes a plurality of computer storage media. Such media may be any available media accessible to the computing device 1100, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 1120 may be a volatile memory (e.g., registers, caches, random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 1130 may be a removable or non-removable medium, and may include a machine-readable medium, such as a flash drive, a disk, or any other medium, which may be capable of being used to store information and / or data (e.g., training data for training) and may be accessed within the computing device 1100.
[0105] The computing device 1100 may further include additional removable / non-removable, volatile / non-volatile storage media. Fig.11 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. The memory 1120 may include a computer program product 1125 having one or more program modules that are configured to perform various methods or actions of various implementations of the present disclosure.
[0106] The communication unit 1140 enables communication with other computing devices via a communication medium. Additionally, the functions of the components of the computing device 1100 can be implemented in a single computing cluster or multiple computing machines that can communicate via a communication connection. Therefore, the computing device 1100 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.
[0107] Input device 1150 may be one or more input devices, such as a mouse, keyboard, trackball, etc. Output device 1160 may be one or more output devices, such as a display, speaker, printer, etc. Computing device 1100 may also communicate with one or more external devices (not shown) through communication unit 1140 as needed, such as storage devices, display devices, etc., communicate with one or more devices that allow a user to interact with computing device 1100, or communicate with any device that allows computing device 1100 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).
[0108] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, the computer program product is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is provided, on which a computer program is stored, and when the program is executed by a processor, the method described above is implemented.
[0109] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.
[0110] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0111] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.
[0112] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.
[0113] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.
Claims
1. A method for presenting multimedia content, include: In response to user input information, determining a content presentation format matching the input information; Based on the input information and the content presentation format, generate multimedia content, wherein the file format of the multimedia content matches the content presentation format; as well as The multimedia content is presented.
2. The method according to claim 1, wherein the multimedia content is generated include: A group of multimedia elements matching the input information is generated, the multimedia content includes the group of multimedia elements, and a layout style of the group of multimedia elements is determined based on the input information and the content presentation format.
3. The method according to claim 1, wherein the multimedia content is generated include: Providing the user with a plurality of prompt information of a plurality of candidate applications respectively matching the content presentation format; In response to receiving an interaction request from the user for prompt information among the plurality of prompt information, selecting a candidate application matching the prompt information from the plurality of candidate applications; as well as The multimedia content is generated based on at least one file format supported by the candidate application.
4. The method of claim 1, wherein presenting the multimedia content include: determining an application for presenting the multimedia content; as well as The multimedia content is presented in the application.
5. The method according to claim 4, wherein determining the application for presenting the multimedia content include: In response to receiving a user input for specifying the application, the application is determined based on the user input.
6. The method of claim 4, wherein determining the application for presenting the multimedia content include: Determining associations between the file format and the multiple applications based on the user's usage history of the multiple applications; as well as Based on the association relationship, the application is selected from the multiple applications.
7. The method according to claim 6, wherein the usage history indicates the plurality of applications used by the user during processing of data objects of a plurality of file formats, and determining the association relationship include: For the file format among the plurality of file formats, based on usage frequencies of the plurality of applications, an application corresponding to the file format is determined from among the plurality of applications.
8. The method according to claim 6, wherein determining the association relationship further comprises: include: In response to receiving an update request for the association relationship, the association relationship is updated based on the update request.
9. The method according to claim 6, wherein determining the application include: In response to determining that the file format corresponds to a plurality of candidate applications based on the association relationship, the application supported by the client device is determined from the plurality of candidate applications, and the method is executed at the client device.
10. The method according to claim 6, wherein determining the application include: In response to determining that the file format corresponds to a plurality of candidate applications based on the association relationship, providing prompt information about the plurality of candidate applications; as well as In response to receiving a selection request for the prompt information, the application is selected based on the selection request.
11. The method of claim 4, wherein the multimedia content is presented in the application include: The multimedia content is copied to a workspace of the application so that the multimedia content is presented by the application.
12. The method of claim 1, wherein the multimedia content is determined based on a response of a processing system to the input information, and the method further include: In response to determining that the application fails based on the association relationship, determining, using the processing system, a candidate application corresponding to the file format of the multimedia content; as well as The multimedia content is presented using the candidate application.
13. The method according to claim 1, wherein the plurality of applications are web applications, the method is implemented using a plug-in of a browser for accessing the web applications, and the association relationship is stored in the plug-in. The method according to claim 13 , wherein the input information is input in the browser and the multimedia data is presented in the browser.
15. The method according to claim 4, further comprising: include: In response to receiving another input information in the application, generating another multimedia content matching the another input information, the another input information indicating a task to be performed on a first multimedia element in the multimedia content in order to generate a second multimedia element; as well as The other multimedia content is provided in the application, the other multimedia content including the second multimedia element.
16. The method according to claim 15, further comprising: include: In response to receiving an access request for the second multimedia element in the application, determining another application of the second multimedia element; as well as The second multimedia element is presented using the other application.
17. A device for presenting multimedia content, include: A determination module, configured to determine, in response to user input information, a content presentation format that matches the input information; A generating module configured to generate multimedia content based on the input information and the content presentation format, wherein the file format of the multimedia content matches the content presentation format; as well as The presentation module is configured to present the multimedia content.
18. An electronic device, include: at least one processing unit; as well as At least one memory, the at least one memory being coupled to the at least one processing unit and storing instructions for execution by the at least one processing unit, the instructions causing the electronic device to perform the method according to any one of claims 1 to 16 when executed by the at least one processing unit.
19. A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, causes the processor to implement the method according to any one of claims 1 to 16.
20. A computer program product comprising a computer program, wherein the computer program implements the method according to any one of claims 1 to 16 when executed by a processor.
