Content processing method and device, electronic equipment, storage medium and program product

Abstract

The invention relates to a content processing method and device, electronic equipment, a storage medium and a program product, and relates to the technical field of computers. The content processing method comprises the steps that an entrance of second media content is displayed in a display interface of first media content, and the first media content and the second media content correspond to the same story and belong to different media types; and in response to a trigger operation on the entry, playing a second content unit in the second media content matched with the progress of the first content unit, the first content unit being a content unit played in the first media content.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and in particular to a content processing method, apparatus, electronic device, storage medium, and program product. Background Technology

[0002] With the development of internet technology, the forms of various media content have become increasingly diverse. Taking the same story as an example, it is no longer limited to a single presentation format, but has evolved into various types of media content such as e-books, audio broadcasts, videos, and images, meeting the diversified consumption needs of users in different scenarios. Summary of the Invention

[0003] According to some embodiments of this disclosure, a content processing method is provided, including: displaying an entry point of a second media content in a display interface of a first media content, wherein the first media content and the second media content correspond to the same story but belong to different media types; and, in response to a triggering operation on the entry point, playing a second content unit in the second media content that matches the progress of the first content unit, wherein the first content unit is a content unit played in the first media content.

[0004] According to some other embodiments of this disclosure, a content processing apparatus is provided, including: a display module configured to display an entry point of a second media content in a display interface of a first media content, wherein the first media content and the second media content correspond to the same story but belong to different media types; and a playback module configured to play a second content unit in the second media content that matches the progress of the first content unit in response to a trigger operation on the entry point, wherein the first content unit is a content unit played in the first media content.

[0005] According to further embodiments of the present disclosure, an electronic device is provided, including: a processor; and a memory coupled to the processor for storing instructions, which, when executed by the processor, cause the processor to perform a content processing method according to any embodiment of the present disclosure.

[0006] According to further embodiments of the present disclosure, a computer-readable storage medium is provided having a computer program stored thereon that, when executed by a processor, implements the content processing method of any embodiment of the present disclosure.

[0007] According to some other embodiments of the present disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements the content processing method of any embodiment of the present disclosure.

[0008] Other features, aspects, and advantages of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0009] Embodiments of this disclosure are described below with reference to the accompanying drawings. It should be understood that the drawings described below are merely illustrative of some embodiments of this disclosure and are not intended to limit the scope of this disclosure. In the drawings:

[0010] Figure 1 A flowchart illustrating content processing methods according to some embodiments of this disclosure is shown;

[0011] Figures 2-6 A schematic diagram illustrating the display interface of some embodiments of this disclosure;

[0012] Figure 7 This invention discloses a schematic diagram of the structure of a content processing apparatus according to some embodiments of the present disclosure;

[0013] Figure 8 This invention discloses schematic diagrams of the structure of electronic devices according to some embodiments of the present disclosure;

[0014] Figure 9 A schematic diagram of the structure of an electronic device according to other embodiments of the present disclosure is shown. Detailed Implementation

[0015] The technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. It should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein.

[0016] It should be understood that the various steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect. Unless otherwise specifically stated, the relative arrangement of steps set forth in these embodiments should be interpreted as merely exemplary and does not limit the scope of this disclosure.

[0017] As used in this disclosure, the term "comprising" and its variations are open-ended terms that include at least the following elements / features but do not exclude other elements / features, i.e., "including but not limited to". The term "based on" means "at least partially based on".

[0018] It should be noted that the concepts of "first," "second," etc., used in this disclosure are used only to distinguish different devices, modules, or units, and are not intended to define the order of functions performed by these devices, modules, or units or their interdependencies. Unless otherwise specified, the concepts of "first," "second," etc., are not intended to imply that the objects described herein must be in a given temporal, spatial, rank, or any other given order.

[0019] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0020] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0021] The embodiments of this disclosure are described in detail below with reference to the accompanying drawings; however, this disclosure is not limited to these specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. Furthermore, in one or more embodiments, specific features, structures, or characteristics can be combined in any suitable manner that will be apparent to those skilled in the art from this disclosure.

[0022] Multiple types of media content can be generated for the same story, such as ebooks, audio, video, and images. This content can be user-generated or generated using AI (Artificial Intelligence). However, the distribution of different types of media content is quite scattered; for example, some are posted in comment sections, some on video platforms, and some on ebook reading platforms. Users need to manually search for and find different types of media content for the same story.

[0023] This disclosure proposes a content processing method that displays an entry point for second media content within the display interface of first media content. In response to a trigger operation on the entry point, a second content unit in the second media content, matching the progress of a first content unit in the first media content, is played. The first and second media content correspond to the same story but belong to different media types. This content processing method directly links multiple media contents of the same story together. Users can directly trigger the playback of the second media content while viewing or listening to the first media content, eliminating the need for manual searching and retrieval. This effectively utilizes multiple media contents of the same story and improves the efficiency of accessing multiple interconnected media contents. Furthermore, when playing the first content unit in the first media content, the second content unit matching the progress of the first content unit can be played directly without requiring manual adjustment of the playback progress of the second media content. This further improves the accuracy and efficiency of the second media content playback, meets the precise needs of users accessing different content units at the same progress, and enhances the user experience.

[0024] The following is combined Figures 1-6This disclosure describes a content processing method. This content processing method can be executed by a content processing apparatus, electronic device, or the like. The content processing apparatus can be implemented in software and / or hardware. For example, the content processing apparatus can be a media content playback application, client, platform, etc., and is not limited to the examples given.

[0025] Figure 1 Flowcharts illustrating some embodiments of the content processing method disclosed herein. For example... Figure 1 As shown, the method of this embodiment includes steps S102 to S104.

[0026] In step S102, the entry point for the second media content is displayed in the display interface of the first media content.

[0027] The primary and secondary media content correspond to the same story but belong to different media types. Both primary and secondary media content are generated based on the same story, and if both are generated by a single user, they are used with that user's authorization.

[0028] For example, the first media content is text (or an e-book), and the second media content is video, audio, or an image. For example, the first media content is audio, and the second media content is text (or an e-book), video, or an image. For example, the first media content is video, and the second media content is text (or an e-book), audio, or an image. Yet another example is that the first media content is an image, and the second media content is text (or an e-book), audio, or video. These examples are not limited to those listed above.

[0029] The entry point for the second media content can be displayed as an interactive interface element. In addition to displaying the entry point for the second media content, relevant information about the second media content can also be displayed, such as the name, type, or access method of the second media content, etc., and is not limited to the examples given.

[0030] If the same story corresponds to media content across more than two media types, the entry points for other media types can be displayed within the first media content's display interface. These other media types include second, third, fourth, and so on. Users can access other media types through media content of one media type.

[0031] In step S104, in response to the triggering operation of the entry point, the second content unit in the second media content that matches the progress of the first content unit is played.

[0032] For example, a user can trigger the playback of the second media content by activating an interactive interface element corresponding to the entry point of the second media content. The first and second media content can be divided into multiple content units. For example, if the first media content is text (or an e-book), the first content unit could be a chapter, paragraph, or sentence within it. Similarly, if the second media content is video, the second content unit could be an episode or a segment of video within it. The division of content units between the first and second media content is specifically determined based on their media type and playback progress, and is not limited to the examples given.

[0033] The first content unit is the content unit played within the first media content. The second content unit is determined based on the playback progress of the first media content, allowing users to directly view or listen to the second media content at the same pace as the first media content, achieving seamless switching between the first and second media content.

[0034] The content processing method of the above embodiments can display the entry point of the second media content in the display interface of the first media content. In response to a trigger operation on the entry point, the second content unit in the second media content, matching the progress of the first content unit in the first media content, is played. Since the first and second media content correspond to the same story but belong to different media types, the content processing method of the above embodiments can directly associate multiple media contents of the same story. Users can directly trigger the playback of the second media content while viewing or listening to the first media content, without requiring manual searching and retrieval. This effectively utilizes multiple media contents of the same story and improves the efficiency of users accessing multiple interconnected media contents. Furthermore, when playing the first content unit in the first media content, the second content unit matching the progress of the first content unit can be played directly without requiring users to manually adjust the playback progress of the second media content, further improving the accuracy and efficiency of the second media content playback, meeting the precise needs of users to access different content units at the same progress, and enhancing the user's access experience.

[0035] There are multiple ways to display the entry point for secondary media content. Below are some methods for displaying the entry point for secondary media content.

[0036] In some embodiments, displaying an entry point for the second media content in the display interface of the first media content includes: displaying an entry point for the second media content in association with the first content unit in the display interface of the first media content.

[0037] Multiple content units can be identified from the first media content, and an entry point for displaying the second media content can be associated with them. These multiple content units include the first content unit. For example, the entry point for the second media content can be displayed in the display interface corresponding to each of the multiple content units. For example, if the first media content is text (or an e-book), the entry point for the second media content can be displayed in the reading interface of the first content unit. For example, if the first media content is audio, the entry point for the second media content can be displayed in the playback interface of the first content unit. For example, if the first media content is video or an image, the entry point for the second media content can be displayed in the display interface of the first content unit.

[0038] When multiple content units are displayed in the display interface corresponding to the first content unit, the entry point for the second media content can be displayed within a preset range around the first content unit. For example, if the first content unit is a text paragraph, and multiple text paragraphs can be displayed in the display interface corresponding to the first content unit, the entry point for the second media content can be displayed within a preset range around the first content unit.

[0039] like Figure 2 As shown, taking text (or e-book) as the media type of the first media content and a text paragraph as the first content unit as an example, multiple text paragraphs, including the first content unit 201, can be displayed in the display interface 200 of the first media content. Below the first content unit 201, the entry point 202 of the second media content can be displayed. For example, the second media content is a video. The entry point of the second media content can also be displayed in other styles or in other locations, not limited to the example given.

[0040] Different content units within the primary media content can be linked to display entry points for media content of different media types, and the same content unit can also be linked to display entry points for media content of multiple media types.

[0041] The method described in the above embodiments displays an entry point for second media content associated with the first content unit in the display interface of the first media content. This allows users to more accurately locate content units that are associated with multiple media content. Users can also more accurately select a content unit to view media content of other media types associated with it based on their own interests, thereby improving the flexibility and experience of users accessing media content of multiple media types.

[0042] In some embodiments, displaying an entry point for the second media content in the display interface of the first media content includes: displaying an entry control for the second media content in the display interface of the first media content, wherein different media types correspond to different styles of entry controls.

[0043] The entry control for the second media content can be permanently displayed within a designated area of ​​the first media content's display interface. Users can trigger playback of the second media content at any time through this entry control. Entry controls for various other media types can also be displayed within the first media content's display interface, with different styles for each media type.

[0044] like Figure 3 As shown, taking text (or e-book) as the first media content, video as the second media content, and audio as the third media content as an example, the display interface 300 for the first media content displays entry controls 301 for the second media content and 302 for the third media content. Entry controls 301 and 302 can be distinguished by the access methods of the second and third media content. Responding to a user's trigger operation on entry control 301, the second media content can be displayed; responding to a user's trigger operation on entry control 302, the third media content can be played.

[0045] The method described in the above embodiments displays an entry control for the second media content within the display interface of the first media content. Users can access the second media content at any time while viewing or listening to the first media content, facilitating user operation and improving efficiency. Furthermore, different media types correspond to different styles of entry controls, allowing users to more accurately locate the media content of the desired type, thus enhancing the user experience.

[0046] In some embodiments, displaying an entry point for the second media content in the display interface of the first media content includes: displaying a plurality of content units of the first media content in the display interface of the first media content; and displaying an entry point for the second media content in the display interface of the first media content in response to a selection operation of a first content unit among the plurality of content units of the first media content.

[0047] In some cases, the display interface of the first media content can show multiple content units of the first media content. For example, if the first media content is text (or an e-book), multiple text paragraphs can be displayed in the reading interface. The user can select any text paragraph (the first content unit) to trigger the display of the entry point for the second media content. Playback of the second content unit corresponding to the selected text paragraph can then be triggered through the entry point of the second media content. For example, a long press or double-click can trigger the display of a selection marker and a drag handle. Dragging the handles adjusts the selection range to select the first content unit, and this is not limited to the example given. After selecting the first content unit, the entry control for the second media content can be displayed, as can entry controls for other media types.

[0048] For example, in response to the triggering of the content unit selection control, multiple content unit options are displayed in the display interface of the first media content; in response to the selection of the first content unit option, an entry control for the second media content is displayed; and entry controls for media content of other media types can also be displayed.

[0049] Based on the method described in the above embodiments, users can select any content unit as the first content unit according to their needs, thereby triggering the playback of a second content unit at the same progress as the first content unit. This improves the convenience and flexibility of user operation, meets user needs, and enhances the user experience.

[0050] The various display methods for the entry point of the second media content described above can be used in combination. For example, when the first media content is text (or an e-book), and multiple text paragraphs are displayed in the display interface of the first media content, in response to a trigger operation on the first entry control of the second media content in the display interface of the first media content, a second content unit matching the progress of the first text paragraph among the multiple text paragraphs can be played. In response to a selection operation on the first content unit (a certain text paragraph or sentence) among the multiple text paragraphs, a second entry control of the second media content is displayed in the display interface of the first media content, and in response to a trigger operation on the second entry control, a second content unit matching the progress of the first content unit is played. In addition, a third entry control of the second media content can also be displayed in association with the first content unit, and in response to a trigger operation on the third entry control, a second content unit matching the progress of the first content unit is played.

[0051] The following describes some display and interaction methods for secondary media content.

[0052] In some embodiments, the content processing method further includes: displaying a first selection entry in the display interface of the second media content; displaying information of one or more candidate media contents in response to a triggering operation of the first selection entry, wherein the one or more candidate media contents have the same media type as the second media content; and playing a third content unit in the target media contents that matches the progress of the first content unit in response to a selection operation of a target media content among the one or more candidate media contents.

[0053] The first media content can correspond to multiple candidate media content of the same media type, including the second media content. Entering through the second media content triggers the display of its interface, where the first selection entry point can be displayed. In response to the triggering of the first selection entry point, information about one or more candidate media content is displayed, such as the identifier and other relevant information for each candidate media content. The information for each candidate media content can include interactive elements, which can be triggered to select the target media content. The target media content plays according to the playback progress of the first media content.

[0054] like Figure 4 As shown, taking video as an example of the media type of the second media content, the second content unit is displayed in the display interface 400 of the second media content. The display interface 400 can also display a first selection entry 401, and in response to a trigger operation on the first selection entry 401, the following is displayed: Figure 5 The interface shown.

[0055] like Figure 5 As shown, the display interface 400 for the second media content displays multiple candidate media content options 501 and 502. For example, each candidate media content option includes information about each media content, such as its name, media type, image (cover image, preview image, etc.), status, number of units, and number of plays. The status of each media content can include at least one of access status and completion status. Access status includes, for example, whether it has been played before and the progress of the last playback. The information for each media content is not limited to the examples given above. If the target media content selected by the user is media content that the user has viewed or listened to, playback can resume from the last playback progress.

[0056] like Figure 5 As shown, multiple candidate media content options 501 and 502 can be displayed in a first area, which may be a panel, window, or overlay. Second media content is played in the second area. This reduces the obstruction of the second media content by the multiple candidate media content options. A collapse control 503 can be displayed in the first area; in response to a triggering operation on the collapse control 503, the display of multiple candidate media content options can be stopped.

[0057] In the method of the above embodiments, when there are multiple versions of media content of the same media type, the user can select the target media content through the first selection entry and play the target media content according to the playback progress of the first media content, which facilitates the user's access to different versions of media content and improves the ease of operation and user experience.

[0058] like Figure 4 As shown, the display interface 400 of the second media content can display a prompt message 402 to indicate that the currently playing content corresponds to the playback progress of the first media content. The display interface 400 of the second media content can also display a start playback control 403, which, in response to triggering the start playback control, starts playback from the first content unit of the second media content. The display interface 400 of the second media content can also display relevant information 404 about the second media content, such as the name of the second media content, the identifier and description of the currently playing content unit, etc., and is not limited to the examples given.

[0059] In some embodiments, a second selection entry is displayed in the display interface of the second media content; in response to a triggering operation on the second selection entry, information of a plurality of content units of the second media content is displayed; in response to a selection operation on a fourth content unit among the plurality of content units of the second media content, the fourth content unit is played.

[0060] Users can view information about multiple content units of the second media content through the second selection entry, and select the fourth content unit from the multiple content units to trigger the playback of the fourth content unit.

[0061] like Figure 4 As shown, a second selection entry 405 can be displayed in the display interface 400 of the second media content. In response to the triggering operation of the second selection entry 405, a unit list of the second media content can be displayed. The unit list includes information (identifiers, etc.) of multiple content units. In response to the selection operation of the fourth content unit in the unit list, the fourth content unit is played.

[0062] If the user does not select any content unit, after the second content unit has finished playing, the next content unit will be played in the order of the multiple content units in the second media content.

[0063] The method described in the above embodiments allows users to flexibly and conveniently select any content unit for playback in the display interface of the second media content, thereby improving user operation efficiency and user experience.

[0064] In some embodiments, the media type of the first media content is text (or e-book), and the media type of the second media content is video or audio. The content processing method further includes: displaying a first control in the display interface of the second media content; responding to a trigger operation on the first control, returning to the display interface of the first media content, playing the fifth content unit in the first media content and playing the second media content in the background, wherein the fifth content unit matches the playback progress of the second media content.

[0065] Returning from the display interface of the second media content to the display interface of the first media content, the second media content may have been playing for some time. Based on the playback progress of the second media content, the fifth content unit in the first media content can be determined and played. While the fifth content unit is playing, the second media content continues to play in the background, achieving a simultaneous listening and reading effect.

[0066] The first media content is an image, and the second media content is a video or audio. Alternatively, the method described above can be used to play the second media content in the background while the fifth content unit is playing. This will not be elaborated further here.

[0067] like Figure 4 As shown, in the display interface 400 of the second media content, a first control 406 is displayed. In response to a trigger operation on the first control 406, the display interface of the first media content can be displayed, for example, similar to... Figure 2 Or the interface shown in Figure 3.

[0068] In the method described above, the user can trigger the display of the first media content display interface by triggering the first control, and play the fifth content unit in the first media content display interface based on the playback progress of the second media content, while the second media content continues to play in the background, achieving the effect of listening and reading at the same time, which better assists the user in understanding the content of the story and enhances the user's audiovisual experience.

[0069] In some embodiments, the media type of the first media content is text (or e-book), and the media type of the second media content is video or audio. The content processing method further includes: displaying a second control in the display interface of the second media content; responding to a trigger operation on the second control, returning to the display interface of the first media content, playing the sixth content unit in the first media content, and playing the second media content in a target area above the display interface of the first media content, wherein the sixth content unit matches the playback progress of the second media content, and the area of ​​the target area is smaller than the area of ​​the display interface of the first media content.

[0070] When the second control is triggered, the sixth content unit of the first media content is played, while the second media content continues to play in the target area above the display interface of the first media content. For example, the target area can be displayed as a window, panel, card, or floating component. If the second media content is video, the video can continue playing in the target area; if the second media content is audio, the audio can continue playing in the target area, and related audio information can be displayed, such as corresponding images or icons. A playback control can also be displayed in the target area, which can be triggered to play or pause the playback of the second media content. A close control can also be displayed in the target area, which closes the target area in response to being triggered.

[0071] like Figure 4 As shown, in the display interface 400 of the second media content, a second control is displayed, which can be a return control 407. In response to a trigger operation on the return control 407, the following is displayed: Figure 6 The interface shown.

[0072] like Figure 6 As shown, taking text (or e-book) as the first media content and video as the second media content as an example, the second media content is played in the target area 601 above the display interface 400 of the first media content. The target area 601 can be moved; for example, in response to click and drag operations on the target area 601, the target area 601 is displayed at the end position of the drag operation. For example, in response to a trigger operation on the target area 601, the system returns to the display interface of the second media content. Figure 6 As shown, in response to displaying the second media content in the target area 601, the entry corresponding to the second media content is stopped from being displayed. Figure 6 relative to Figure 3 Entry 301: No secondary media content displayed.

[0073] The method described in the above embodiments allows users to trigger the display of the first media content's display interface by triggering the second control. In the first media content's display interface, the sixth content unit is played based on the playback progress of the second media content, while the second media content continues to play in the target area. This achieves the effect of listening and reading simultaneously, and watching and reading simultaneously, better assisting users in understanding the story's content and enhancing their audiovisual experience.

[0074] The specific functions of the second control can be configured. In some embodiments, in response to a configuration trigger operation, a configuration interface is displayed, wherein the configuration interface includes a first option and a second option. The first option indicates that after returning to the display interface of the first media content, the second media content will be played in the target area, and the second option indicates that after returning to the display interface of the first media content, the playback of the second media content will be stopped. In response to a trigger operation on the second option, configuration information of the second option is stored. In response to the storage of the configuration information of the second option and the trigger operation on the second control, the display interface of the first media content is returned, the sixth content unit in the first media content is played, and the second media content is played in the target area above the display interface of the first media content.

[0075] For example, the trigger action can be configured as a long press, swipe, or other similar operation, or it can be configured to trigger an action of a configured control, not limited to the examples given. Users can configure whether to play the second media content in the target area when the second control is triggered. If the user selects the first option, the display interface of the first media content is returned, the sixth content unit of the first media content is played, and the second media content is played simultaneously in the target area. If the user selects the second option, the display interface of the first media content is returned, the sixth content unit of the first media content is played, and the second media content is no longer played.

[0076] The method described in the above embodiments allows users to choose whether to continue playing the second media content after returning to the display interface of the first media content, thus meeting different user needs and improving the user experience.

[0077] The second content unit needs to be determined based on the playback progress of the first media content, so that users can switch between multiple media content at the same pace. The following describes how to determine the second content unit.

[0078] In some embodiments, the second content unit selects a content unit that matches the first content unit from a plurality of content units of the second media content based on its understanding of the first content unit and the second media content.

[0079] For example, a machine learning model can be used to understand a first content unit and second media content, and to select content units from multiple content units in the second media content that match the first content unit. For instance, the machine learning model could be a multimodal model. The content units in the second media content that match each content unit in the first media content can be predetermined.

[0080] The method in the above embodiments, by understanding the first content unit and the second media content, determines to select a content unit from the second media content that matches the first content unit, thereby improving the accuracy of the display of the second media content and enhancing the display effect.

[0081] In some embodiments, the second content unit is determined according to the following method: based on an understanding of the first content unit and the second media content, the roles and keywords of the first content unit, and the roles and keywords of each content unit in the second media content are determined; based on the roles and keywords of the first content unit and the roles and keywords of each content unit in the second media content, one or more candidate content units corresponding to the first content unit are determined from a plurality of content units in the second media content; based on the semantic information of each sentence in the first content unit and the semantic information of each sentence in each candidate content unit, the second content unit is determined from one or more candidate content units.

[0082] For example, a machine learning model can be used to first match the roles and / or keywords of each content unit in the first content unit and the second media content to determine one or more candidate content units from the second media content. Further, each sentence in the first content unit is precisely matched with each sentence in each candidate content unit to determine the second content unit from the one or more candidate units. If the first content unit is one or more statements, content matching those statements can be determined from the second media content to determine the start time of playback for the second media content.

[0083] The method described in the above embodiments can improve the accuracy of determining the second content unit, and can be accurate to the sentence correspondence between the first media content and the second media content, thereby improving the accuracy of playing the second media content and enhancing the user experience.

[0084] The media type of the second media content can be determined based on the content of the first content unit. The following describes how to determine the media type of the second media content.

[0085] In some embodiments, displaying an entry point for the second media content in the display interface of the first media content includes: displaying an entry point for the second media content in association with the first content unit in the display interface of the first media content, wherein the target media type used to assist in understanding the first content unit is determined as the media type of the second media content, and the target media type is determined based on the understanding of the first content unit.

[0086] For example, by using a machine learning model to understand the first content unit, the target media type that aids in understanding the first content unit can be determined, and this target media type can be identified as the media type of the second media content. The same method can be used to determine the media type of the second media content if the entry point uses other display formats.

[0087] The method in the above embodiments involves understanding the first content unit and determining a target media type that aids in understanding the first content unit, which is then used as the media type of the second media content. The second media content can aid in understanding the first media content and, in combination with the first media content, enhance the user's audiovisual experience.

[0088] In some embodiments, the media type of the first media content is text (or e-book), the first content unit is a first text unit, and in response to the first text unit including elements for visualization, an image or video is used as a target media type to aid in understanding the first content unit. The elements for visualization are determined based on the semantic understanding of the first text unit, and the elements for visualization include elements for describing at least one of a scene, a character's appearance, a character's actions, and an object.

[0089] For example, a machine learning model can be used to perform semantic understanding on the first text unit to determine whether it includes elements for visualization. If the first text unit includes elements for visualization, then it is suitable to use videos or images to assist in understanding the first text unit. Elements for visualization are those that are suitable for visual presentation. For example, if the first content unit describes a scene, a character's appearance (looks, clothing, expressions, etc.), actions, or objects, then it is suitable to present them in a visual form.

[0090] When the media type of the first media content is audio, the first content unit can also be understood, and in response to the first content unit including elements for visualization, images or videos can be used as target media types to aid in understanding the first content unit.

[0091] The method described above, by understanding the first content unit and determining an image or video for the first content unit as a target media type to aid in understanding the first content unit, can assist users in understanding the first content unit through more vivid and engaging visual content, thereby enhancing the user's reading experience.

[0092] In some embodiments, the media type of the first media content is text (or e-book), the first content unit is a first text unit, and in response to the first text unit including elements for auditoryization, audio is used as the target media type to aid in understanding the first content unit. The elements for auditoryization are determined based on the semantic understanding of the first text unit, and the elements for auditoryization include elements for describing at least one of sound, atmosphere, and background environment.

[0093] For example, a machine learning model can be used to perform semantic understanding on the first text unit to determine whether it includes elements for auditory interpretation. If the first text unit includes elements for auditory interpretation, then audio is suitable for assisting in understanding the first text unit. Elements for auditory interpretation are those suitable for presentation using audio. For example, if the first content unit is used to describe sounds, create atmosphere (tension, horror, etc.), or show the background environment, then it is suitable to present it in an auditory form.

[0094] The method described above determines audio for the first content unit by understanding the first content unit, serving as a target media type to aid in understanding the first content unit. This can help users understand the first content unit through sound, thereby improving the user's reading experience.

[0095] The first content unit can be a content unit selected from the first media content, and the entry point for displaying the second media content is associated with the first content unit. The following describes how the first content unit is determined.

[0096] In some embodiments, the first content unit is a key content unit determined from multiple content units of the first media content based on at least one of the plot development information and interactive data of the first media content, wherein the plot development information of the first media content is determined based on an understanding of the first media content.

[0097] For example, machine learning models can be used to understand primary media content and identify key content units that influence the plot development from multiple content units, such as climax plot units or iconic scenes. Alternatively, key content units can be identified from multiple content units based on interaction data for each content unit within the primary media content. For example, interaction data includes at least one of comment data, feedback data, and access data. For instance, comment data includes the number of comments, feedback data includes the number of positive feedback (e.g., likes) and negative feedback, and access data includes the number of visits, etc., and is not limited to the examples given. Content units with more interaction data tend to attract more user attention; therefore, key content units can be selected based on interaction data.

[0098] The method described in the above embodiments can select content units that influence the plot development and attract more user attention as the first content unit, and display the entry point of the second media content for the first content unit, which better meets the needs of most users, increases the access probability of the second media content, and improves the experience of most users.

[0099] In some embodiments, displaying an entry point for the second media content in the display interface of the first media content includes: displaying an entry point for the second media content in association with a first content unit in the display interface of the first media content, wherein the first content unit is determined from multiple content units based on comment information of multiple content units in the first multimedia content, and the second media content is determined based on the comment information of the first content unit.

[0100] The system can analyze the comment information of each content unit within the first media content to determine if there are target comment messages related to other media types. If a content unit contains target comment messages, that content unit can be designated as the first content unit, and the other media types associated with the target comment messages can be designated as the second media content. For example, the target comment message for the first content unit might be "The anime adaptation of this famous scene is also very good."

[0101] The method described above directly determines the first content unit and the second media content based on comment information related to multiple content units, effectively utilizes media content of other media types associated with the comment information, aggregates media content published in different locations, and provides users with a richer experience.

[0102] In some embodiments, the entry point for displaying the second media content associated with the first content unit includes: information for displaying target comment information, the second media content, and the second media content associated with the first content unit, wherein the target comment information is associated with the first content unit and the second media content.

[0103] For example, information about the second media content includes the name of the second media content and at least one of the images. Figure 2 As shown, target comment information 203 can be displayed together with the entry point of the second media content.

[0104] The method described in the above embodiments, by including the target comment information, the information of the second media content, and the entry point of the second media content, can demonstrate that the second media content is media content recommended or followed by other users, thereby increasing users' interest in the second media content and improving the effectiveness of the second media content.

[0105] Based on the content processing method disclosed herein, users can access media content of different media types in a linked manner. Users can also quickly browse parts of the content using media content of different media types, satisfying users' various reading, watching, and listening needs and improving user experience.

[0106] This disclosure also provides a content processing apparatus, which is described below in conjunction with... Figure 7 Describe it.

[0107] Figure 7These are structural diagrams of some embodiments of the content processing apparatus disclosed herein. Figure 7 As shown, the content processing device 70 in this embodiment includes a display module 710 and a playback module 720.

[0108] The display module 710 is configured to display the entry point of the second media content in the display interface of the first media content, wherein the first media content and the second media content correspond to the same story but belong to different media types.

[0109] The playback module 720 is configured to play a second content unit in the second media content that matches the progress of the first content unit in response to a trigger operation on the entry point, wherein the first content unit is the content unit played in the first media content.

[0110] The content processing device of the above embodiments can display an entry point for second media content in the display interface of the first media content. In response to a trigger operation on the entry point, a second content unit in the second media content, matching the progress of the first content unit in the first media content, is played. Since the first and second media content correspond to the same story but belong to different media types, the content processing device of the above embodiments can directly associate multiple media contents of the same story. Users can directly trigger the playback of the second media content while viewing or listening to the first media content, without requiring manual searching and retrieval. This effectively utilizes multiple media contents of the same story and improves the efficiency of users accessing multiple interconnected media contents. Furthermore, when playing the first content unit in the first media content, the second content unit matching the progress of the first content unit can be played directly without requiring users to manually adjust the playback progress of the second media content, further improving the accuracy and efficiency of the second media content playback, meeting the precise needs of users to access different content units at the same progress, and enhancing the user's access experience.

[0111] In some embodiments, the display module 710 is configured to display an entry point for the second media content associated with the first content unit in the display interface of the first media content, wherein the target media type used to assist in understanding the first content unit is determined as the media type of the second media content, and the target media type is determined based on the understanding of the first content unit.

[0112] In some embodiments, the media type of the first media content is text, the first content unit is a first text unit, and in response to the first text unit including elements for visualization, an image or video is used as a target media type to aid in understanding the first content unit. The elements for visualization are determined based on the semantic understanding of the first text unit, and the elements for visualization include elements for describing at least one of a scene, a character's appearance, a character's actions, and an object.

[0113] In some embodiments, the media type of the first media content is text, the first content unit is a first text unit, and in response to the first text unit including elements for auditoryization, audio is used as the target media type to aid in understanding the first content unit. The elements for auditoryization are determined based on the semantic understanding of the first text unit, and the elements for auditoryization include elements for describing at least one of sound, atmosphere, and background environment.

[0114] In some embodiments, the first content unit is a key content unit determined from multiple content units of the first media content based on at least one of the plot development information and interactive data of the first media content, wherein the plot development information of the first media content is determined based on an understanding of the first media content.

[0115] In some embodiments, the display module 710 is configured to display an entry point for the second media content in association with the first content unit in the display interface of the first media content, wherein the first content unit is determined from multiple content units based on comment information of multiple content units in the first multimedia content, and the second media content is determined based on the comment information of the first content unit.

[0116] In some embodiments, the display module 710 is configured to display target comment information, information of the second media content, and an entry point of the second media content in association with the first content unit, wherein the target comment information is associated with the first content unit and the second media content.

[0117] In some embodiments, the display module 710 is configured to display an entry control for the second media content in the display interface of the first media content, wherein different media types correspond to different styles of entry controls.

[0118] In some embodiments, the second content unit selects a content unit that matches the first content unit from a plurality of content units of the second media content based on its understanding of the first content unit and the second media content.

[0119] In some embodiments, the content processing apparatus 70 further includes: a determining module 730 configured to determine, based on an understanding of the first content unit and the second media content, the roles and keywords of the first content unit and the roles and keywords of each content unit in the second media content; to determine, based on the roles and keywords of the first content unit and the roles and keywords of each content unit in the second media content, one or more candidate content units corresponding to the first content unit from a plurality of content units in the second media content; and to determine, based on the semantic information of each sentence in the first content unit and the semantic information of each sentence in each candidate content unit, the second content unit from one or more candidate content units.

[0120] In some embodiments, the display module 710 is configured to display a plurality of content units of the first media content in the display interface of the first media content; in response to a selection operation of the first content unit among the plurality of content units of the first media content, an entry point of the second media content is displayed in the display interface of the first media content.

[0121] In some embodiments, the playback module 720 is further configured to display a first selection entry in the display interface of the second media content; in response to a triggering operation of the first selection entry, display information of one or more candidate media contents, wherein the one or more candidate media contents have the same media type as the second media content; and in response to a selection operation of a target media content among the one or more candidate media contents, play a third content unit in the target media content that matches the progress of the first content unit.

[0122] In some embodiments, the playback module 720 is further configured to display a second selection entry in the display interface of the second media content; display information of a plurality of content units of the second media content in response to a triggering operation of the second selection entry; and play the fourth content unit in response to a selection operation of the fourth content unit among the plurality of content units of the second media content.

[0123] In some embodiments, the media type of the first media content is text, and the media type of the second media content is video or audio. The playback module 720 is further configured to display a first control in the display interface of the second media content. The display module 710 is further configured to return to the display interface of the first media content in response to a trigger operation on the first control, play the fifth content unit in the first media content, and play the second media content in the background, wherein the fifth content unit matches the playback progress of the second media content.

[0124] In some embodiments, the media type of the first media content is text, and the media type of the second media content is video or audio. The playback module 720 is further configured to display a second control in the display interface of the second media content. The display module 710 is further configured to return to the display interface of the first media content in response to a trigger operation on the second control, play the sixth content unit in the first media content, and play the second media content in the target area above the display interface of the first media content, wherein the sixth content unit matches the playback progress of the second media content, and the area of ​​the target area is smaller than the area of ​​the display interface of the first media content.

[0125] In some embodiments, the content processing device 70 further includes: a configuration module 740 configured to display a configuration interface in response to a configuration trigger operation, wherein the configuration interface includes a first option and a second option, the first option indicating that after returning to the display interface of the first media content, the second media content will be played in a target area, and the second option indicating that after returning to the display interface of the first media content, the playback of the second media content will be stopped; in response to a trigger operation on the second option, configuration information of the second option will be stored; wherein the display module 710 is configured to return to the display interface of the first media content, play the sixth content unit in the first media content, and play the second media content in the target area above the display interface of the first media content in response to the storage of the configuration information of the second option and a trigger operation on the second control.

[0126] This disclosure also provides an electronic device, which is described below in conjunction with... Figure 8 and 9 Describe it. Figure 8 A block diagram of an electronic device according to some embodiments of the present disclosure is shown.

[0127] like Figure 8 As shown, the electronic device 8 includes a processor 82; and a memory 81 coupled to the processor 82 for storing instructions, which, when executed by the processor 82, cause the processor 82 to perform a content processing method as described in any embodiment of this disclosure.

[0128] The electronic device of the above embodiments can display an entry point for second media content within the display interface of the first media content. In response to a trigger operation on the entry point, a second content unit in the second media content, matching the progress of the first content unit in the first media content, is played. Since the first and second media content correspond to the same story but belong to different media types, the electronic device of the above embodiments can directly associate multiple media contents of the same story. Users can directly trigger the playback of the second media content while viewing or listening to the first media content, eliminating the need for manual searching and retrieval. This effectively utilizes multiple media contents of the same story, improving the efficiency of users accessing multiple interconnected media contents. Furthermore, when playing the first content unit in the first media content, the second content unit matching the progress of the first content unit can be played directly, eliminating the need for users to manually adjust the playback progress of the second media content. This further improves the accuracy and efficiency of the second media content playback, meeting the precise needs of users to access different content units at the same progress, and enhancing the user experience.

[0129] Memory 81 is used to store one or more computer-readable instructions. Memory 81 may include any combination of various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory, including but not limited to random access memory (RAM), dynamic random access memory (DRAM), static random access memory (SRAM), read-only memory (ROM), and flash memory. Memory 81 may, for example, store operating systems, application programs, bootloaders, databases, and other programs, as well as various application programs and various data.

[0130] The processor 82 is configured to execute computer-readable instructions to implement the content processing method of any of the foregoing embodiments. Specific implementations of each step of the method can be found in the above embodiments; repeated details will not be elaborated here.

[0131] The processor 82 can be various processing devices, such as a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. The central processing unit (CPU) can be based on x86 or ARM architectures, etc.

[0132] The processor 82 and the memory 81 can communicate with each other directly or indirectly. For example, the processor 82 and the memory 81 can communicate via a network. The network can include wireless networks, wired networks, and / or any combination of wireless and wired networks. The processor 82 and the memory 81 can also communicate with each other via a system bus, which is not limited in this disclosure.

[0133] It should be noted that Figure 8 The components of the electronic device 8 shown are merely exemplary and not limiting. The electronic device 8 may have other components depending on the specific application requirements. The processor 82 can control other components in the electronic device 8 to perform desired functions.

[0134] Electronic device 8 can be implemented by software, firmware and / or hardware, and can be integrated into a device with the relevant application installed.

[0135] Figure 9 Block diagrams of electronic devices according to other embodiments of the present disclosure are shown.

[0136] Figure 9 The electronic device 9 shown can be a computer system with a dedicated hardware structure, which can perform corresponding functions when the relevant application is installed.

[0137] Electronic devices include, but are not limited to, mobile terminals such as smartphones, laptops, personal digital assistants (PDAs), tablet computers (PCs), PMPs (portable multimedia players), in-vehicle terminals (such as in-vehicle navigation terminals), wearable devices, and fixed terminals such as digital televisions and desktop computers.

[0138] like Figure 9 As shown, the Central Processing Unit (CPU) 91 performs various processes based on a program stored in the Read-Only Memory (ROM) 92 or a program loaded from the storage section 98 into the Random Access Memory (RAM) 93. The RAM 93 stores data required as needed when the CPU 91 performs various processes, etc. The CPU is merely exemplary; it could also be other types of processors, such as the various processors described above. The ROM 92, RAM 93, and storage section 98 can be various forms of computer-readable storage media. It should be noted that although... Figure 9 The diagram shows ROM 92, RAM 93 and storage section 98, but one or more of them may be combined or located in the same or different memory or storage modules.

[0139] CPU 91, ROM 92 and RAM 93 are interconnected via bus 94. Input / output interface 95 is also connected to bus 94.

[0140] The following components are connected to the input / output interface 95: input section 96, such as a touchscreen, touchpad, keyboard, mouse, image sensor, microphone, accelerometer, gyroscope, etc.; output section 97, including displays such as cathode ray tube (CRT), liquid crystal display (LCD), speakers, vibrators, etc.; storage section 98, including hard disk, magnetic tape, etc.; and communication section 99, including network interface cards such as LAN cards, modems, etc. The communication section 99 allows communication processing via a network such as the Internet. It is easy to understand that, although... Figure 9 The portion of the electronic device 9 shown communicates via bus 94, but it may also communicate via a network or other means, wherein the network may include a wireless network, a wired network, and / or any combination of wireless and wired networks.

[0141] As needed, drive 910 is also connected to input / output interface 95. Removable media 911, such as disks, optical disks, magneto-optical disks, semiconductor memories, etc., are installed on drive 910 as needed, so that computer programs read from them can be installed into storage section 98 as needed.

[0142] When the above series of processes are implemented through software, the program constituting the software can be installed from a network such as the Internet or a storage medium such as a removable medium 911.

[0143] According to embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. This disclosure also provides a computer program product, including a computer program that, when executed by a processor, implements the content processing method of any embodiment of this disclosure.

[0144] The computer program product of the above embodiments can display an entry point for second media content in the display interface of the first media content. In response to a trigger operation on the entry point, a second content unit in the second media content, matching the progress of the first content unit in the first media content, is played. Since the first and second media content correspond to the same story but belong to different media types, the computer program product of the above embodiments can directly associate multiple media contents of the same story. Users can directly trigger the playback of the second media content while viewing or listening to the first media content, without requiring manual searching and retrieval. This effectively utilizes multiple media contents of the same story and improves the efficiency of users accessing multiple interconnected media contents. Furthermore, when playing the first content unit in the first media content, the second content unit matching the progress of the first content unit can be played directly without requiring users to manually adjust the playback progress of the second media content, further improving the accuracy and efficiency of the second media content playback, meeting the precise needs of users to access different content units at the same progress, and enhancing the user's access experience.

[0145] For example, some embodiments of this disclosure include a computer program product that, when run on a computer, causes the computer to perform the methods of any of the foregoing embodiments. The computer program product includes computer instructions carried on a computer-readable medium, comprising program code for performing the methods shown in the flowchart. In such embodiments, the computer instructions can be downloaded and installed from a network via communication section 99, or installed from storage section 98, or installed from ROM 92. When the computer program is executed by CPU 91, the methods of embodiments of this disclosure are performed.

[0146] This disclosure also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the content processing method of any embodiment of this disclosure.

[0147] The computer-readable storage medium of the above embodiments can display an entry point for second media content within the display interface of first media content. In response to a triggering operation on the entry point, a second content unit in the second media content, matching the progress of a first content unit in the first media content, is played. Since the first and second media content correspond to the same story but belong to different media types, the computer-readable storage medium of the above embodiments can directly associate multiple media contents of the same story. Users can directly trigger the playback of the second media content while viewing or listening to the first media content, eliminating the need for manual searching and retrieval. This effectively utilizes multiple media contents of the same story, improving the efficiency of users accessing multiple interconnected media contents. Furthermore, when playing the first content unit in the first media content, the second content unit matching the progress of the first content unit can be played directly, eliminating the need for users to manually adjust the playback progress of the second media content. This further improves the accuracy and efficiency of the second media content playback, meeting the precise needs of users to access different content units at the same progress, and enhancing the user experience.

[0148] It should be noted that, in the context of this disclosure, a computer-readable medium can be a tangible medium that may contain or store programs for use by or in conjunction with an instruction execution system, apparatus, or device.

[0149] A computer-readable medium may be a computer-readable storage medium, a computer-readable signal medium, or any combination thereof.

[0150] Computer-readable storage media include, but are not limited to, systems, apparatuses, or devices that are electrical, magnetic, optical, electromagnetic, infrared, or semiconductor, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this disclosure, a computer-readable storage medium can be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. The computer-readable storage medium stores computer instructions that, when executed by a processor, implement the methods of any of the foregoing embodiments.

[0151] Computer-readable signal media may include data signals propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, capable of sending, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0152] The aforementioned computer-readable medium may be included in the aforementioned electronic device; or it may exist independently and not assembled into the electronic device.

[0153] In some embodiments, a computer program is also provided, comprising: instructions that, when executed by a processor, cause the processor to perform the methods of any of the foregoing embodiments. For example, the instructions may be embodied in computer program code.

[0154] In embodiments of this disclosure, computer program code for performing the operations of this disclosure can be written in one or more programming languages ​​or a combination thereof. These programming languages ​​include, but are not limited to, object-oriented programming languages ​​such as Java, Smalltalk, and C++, as well as conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network (including a local area network (LAN) or a wide area network (WAN)), or it can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0155] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0156] The functions described above can be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary hardware logic components that can be used include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0157] While specific embodiments of this disclosure have been described in detail by way of example, those skilled in the art should understand that the examples are for illustrative purposes only and not intended to limit the scope of this disclosure. Those skilled in the art should understand that modifications can be made to the above embodiments without departing from the scope and spirit of this disclosure. The scope of this disclosure is defined by the appended claims.

Claims

1. A content processing method, comprising: The entry point for the second media content is displayed in the display interface of the first media content, wherein the first media content and the second media content correspond to the same story but belong to different media types; In response to a trigger operation on the entry point, a second content unit in the second media content that matches the progress of the first content unit is played, wherein the first content unit is the content unit played in the first media content.

2. The content processing method according to claim 1, wherein, The entry point for displaying the second media content in the display interface of the first media content includes: In the display interface of the first media content, an entry point for displaying the second media content is associated with the first content unit. The target media type used to assist in understanding the first content unit is determined as the media type of the second media content. The target media type is determined based on the understanding of the first content unit.

3. The content processing method according to claim 2, wherein, The media type of the first media content is text, the first content unit is a first text unit, and in response to the first text unit including elements for visualization, an image or video is used as a target media type to aid in understanding the first content unit. The elements for visualization are determined based on the semantic understanding of the first text unit, and the elements for visualization include elements for describing at least one of the following: scene, character appearance, character action, and object.

4. The content processing method according to claim 2, wherein, The media type of the first media content is text, the first content unit is a first text unit, and in response to the first text unit including elements for auditoryization, audio is used as the target media type to aid in understanding the first content unit. The elements for auditoryization are determined based on the semantic understanding of the first text unit, and the elements for auditoryization include elements for describing at least one of sound, atmosphere, and background environment.

5. The content processing method according to claim 2, wherein, The first content unit is a key content unit determined from multiple content units of the first media content based on at least one of the plot development information and interactive data of the first media content, and the plot development information of the first media content is determined based on the understanding of the first media content.

6. The content processing method according to claim 1, wherein, The entry point for displaying the second media content in the display interface of the first media content includes: In the display interface of the first media content, an entry point for the second media content is displayed in association with the first content unit. The first content unit is determined from the multiple content units based on the comment information of the multiple content units in the first multimedia content, and the second media content is determined based on the comment information of the first content unit.

7. The content processing method according to claim 6, wherein, The entry point associated with the first content unit to display the second media content includes: The target comment information, the information of the second media content, and the entry point of the second media content are displayed in association with the first content unit, wherein the target comment information is associated with the first content unit and the second media content.

8. The content processing method according to claim 1, wherein, The entry point for displaying the second media content in the display interface of the first media content includes: In the display interface of the first media content, an entry control for the second media content is displayed, wherein different media types correspond to different styles of entry controls.

9. The content processing method according to claim 1, wherein, Based on its understanding of the first content unit and the second media content, the second content unit selects a content unit that matches the first content unit from among the multiple content units of the second media content.

10. The content processing method according to claim 9, wherein, The second content unit is determined according to the following method: Based on the understanding of the first content unit and the second media content, determine the roles and keywords of the first content unit, as well as the roles and keywords of each content unit in the second media content; Based on the role and keywords of the first content unit and the role and keywords of each content unit in the second media content, one or more candidate content units corresponding to the first content unit are determined from multiple content units of the second media content; The second content unit is determined from the one or more candidate content units based on the semantic information of each sentence in the first content unit and the semantic information of each sentence in each candidate content unit.

11. The content processing method according to claim 1, wherein, The entry point for displaying the second media content in the display interface of the first media content includes: Multiple content units of the first media content are displayed in the display interface of the first media content; In response to the selection operation of the first content unit among the multiple content units of the first media content, the entry point of the second media content is displayed in the display interface of the first media content.

12. The content processing method according to any one of claims 1-11, further comprising: The first selection entry is displayed in the display interface of the second media content; In response to a trigger operation on the first selection entry, information on one or more candidate media contents is displayed, wherein the one or more candidate media contents are of the same media type as the second media content; In response to the selection operation of target media content among the one or more candidate media content, a third content unit of the target media content that matches the progress of the first content unit is played.

13. The content processing method according to any one of claims 1-11, further comprising: In the display interface of the second media content, a second selection entry is displayed; In response to a trigger operation on the second selection entry, information of multiple content units of the second media content is displayed; In response to a selection operation of a fourth content unit among a plurality of content units of the second media content, the fourth content unit is played.

14. The content processing method according to any one of claims 1-11, wherein, The first media content is of text type, the second media content is of video or audio type, and the content processing method further includes: In the display interface of the second media content, the first control is displayed; In response to the triggering operation of the first control, the display interface of the first media content is returned, the fifth content unit in the first media content is played, and the second media content is played in the background, wherein the fifth content unit is matched with the playback progress of the second media content.

15. The content processing method according to any one of claims 1-11, wherein, The first media content is of text type, the second media content is of video or audio type, and the content processing method further includes: In the display interface of the second media content, the second control is displayed; In response to the triggering operation of the second control, the display interface of the first media content is returned, the sixth content unit in the first media content is played, and the second media content is played in the target area above the display interface of the first media content, wherein the sixth content unit matches the playback progress of the second media content, and the area of ​​the target area is smaller than the area of ​​the display interface of the first media content.

16. The content processing method according to claim 15, further comprising: In response to a configuration trigger operation, a configuration interface is displayed, wherein the configuration interface includes a first option and a second option. The first option indicates that the second media content is played in the target area after returning to the display interface of the first media content, and the second option indicates that the playback of the second media content is stopped after returning to the display interface of the first media content. In response to a triggering operation on the second option, the configuration information of the second option is stored; In response to the storage of configuration information for the second option and the triggering operation of the second control, the system returns to the display interface of the first media content, plays the sixth content unit in the first media content, and plays the second media content in the target area above the display interface of the first media content.

17. A content processing apparatus, comprising: The display module is configured to display the entry point of the second media content in the display interface of the first media content, wherein the first media content and the second media content correspond to the same story but belong to different media types; The playback module is configured to, in response to a trigger operation on the entry point, play a second content unit in the second media content that matches the progress of the first content unit, wherein the first content unit is the content unit played in the first media content.

18. An electronic device comprising: processor; as well as A memory coupled to the processor is used to store instructions that, when executed by the processor, cause the processor to perform the content processing method according to any one of claims 1 to 16.

19. A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the content processing method of any one of claims 1 to 16.

20. A computer program product comprising a computer program that, when executed by a processor, implements the content processing method according to any one of claims 1 to 16.

Images