Media content display method, apparatus, electronic device, and storage medium
The method and device automate text-image matching in media content creation, enhancing efficiency and user convenience by reducing manual input and improving text relevance, thus optimizing media content generation.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- BEIJING ZITIAO NETWORK TECH CO LTD
- Filing Date
- 2024-06-07
- Publication Date
- 2026-07-07
AI Technical Summary
Existing media content display solutions lack efficiency and convenience in automatically matching text to images during content creation, requiring manual user input for text addition.
A media content display method and device that automatically matches text to images based on preset matching criteria, allowing for preview and editing of target media content, including a targeting function that determines and displays text based on image content, and supports style conversion and scene-specific text generation.
Enhances the convenience and efficiency of media content creation by reducing manual text entry operations and improving the accuracy and relevance of text-image matching, facilitating user-friendly content generation.
Smart Images

Figure 2026522316000001_ABST
Abstract
Description
Technical Field
[0001] (Reference to Related Applications) This application claims the priority of Chinese Patent Application No. 202310673697.8, titled "Media Content Display Method, Device, Equipment, and Storage Medium", filed on June 7, 2023, and all the content disclosed in the above Chinese Patent Application is incorporated herein by reference. (Technical Field)
[0002] Embodiments of the present disclosure relate to the field of computer technology, and more particularly, to a media content display method, device, electronic equipment, and storage medium.
Background Art
[0003] With the development of Internet technology, users can view various multimedia contents through the Internet. Different users can share media contents created by themselves in the form of media contents such as distribution videos or images with each other.
Summary of the Invention
[0004] Embodiments of the present disclosure provide a media content display method, device, electronic equipment, and storage medium, which can optimize existing media content display solutions.
[0005] Embodiments of the present disclosure provide a media content display method. The method includes, on the side of the first user, a step of obtaining original pixel materials on a media content generation page, where the media content generation page is for generating target media content, and the target media content is to be transmitted to a second user or distributed as the work of the first user; When the targeting function is turned on, the process includes the step of displaying preview media content in a first mode, wherein the preview media content in the first mode includes a target image and target text to be displayed at the target location, the target image is determined based on the original image, and the target text includes text that satisfies the preset matching degree conditions, which are determined based on the target image, and the preview media content in the first mode is for generating the target media content.
[0006] Embodiments of this disclosure further provide a media content display device, which is located on the first user side. The media content display device includes a material acquisition module configured to acquire original image materials on a media content generation page, the media content generation page is for generating target media content, and the target media content is transmitted to a second user or distributed as the work of a first user, and the material acquisition module is configured to acquire original image materials on a media content generation page. A content display module configured to display preview media content in a first mode when the target function is turned on, wherein the preview media content in the first mode includes a target image and target text to be displayed at the target position, the target image is determined based on an original image, and the target text includes text that satisfies preset matching degree conditions, which are determined based on the target image, and the preview media content in the first mode is for generating the target media content.
[0007] Embodiments of this disclosure further provide electronic devices. The electronic device comprises one or more processors and a memory device configured to store one or more programs, When one or more programs are executed by one or more processors, the media content display method according to the embodiments of this disclosure is made to be executed by one or more processors.
[0008] Embodiments of this disclosure further provide a storage medium containing computer-executable instructions. When the computer-executable instructions are executed by a computer processor, a media content display method according to embodiments of this disclosure is performed. [Brief explanation of the drawing]
[0009] The aforementioned and other features, advantages and methods of each embodiment of this disclosure will become more apparent with reference to the drawings and, further, to the exemplary embodiments described below. In the drawings, the same or similar reference numerals indicate the same or similar elements. The drawings are schematic and not necessarily drawn to scale.
[0010] [Figure 1] This is a schematic flowchart of the media content display method according to the embodiment of this disclosure. [Figure 2] This is a schematic diagram of an interface according to an embodiment of the present disclosure. [Figure 3] This is a schematic flowchart of another media content display method according to an embodiment of the present disclosure. [Figure 4] This is a schematic diagram of the interface interaction according to the embodiment of the present disclosure. [Figure 5] This is a schematic diagram of a media content display device according to an embodiment of the present disclosure. [Figure 6] This is a schematic diagram of the electronic device according to an embodiment of the present disclosure. [Modes for carrying out the invention]
[0011] Next, embodiments of the present disclosure will be described in detail with reference to the drawings. While the drawings show several embodiments of the present disclosure, the disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein. On the contrary, these embodiments are provided to allow for a more thorough and complete understanding of the present disclosure. The drawings and embodiments of the present disclosure are illustrative only and should not be understood as limiting the scope of protection of the present disclosure.
[0012] To ensure that it is understood that the steps described in the embodiments of the methods of this disclosure may be performed in different orders and / or in parallel. Furthermore, embodiments of the methods may include additional steps and / or steps that may be omitted. The scope of this disclosure is not limited in this respect.
[0013] As used herein, the terms “including” and their variations are open inclusions meaning “including but not limited to.” The term “based on” means “based at least in part.” The term “one embodiment” means “at least one embodiment,” the term “another embodiment” means “at least one other embodiment,” and the term “several embodiments” means “at least several embodiments.” Relevant definitions of other terms are given in the following explanation.
[0014] The terms "first," "second," etc., used in this disclosure are intended to distinguish between different devices, modules, or units, and are not intended to limit the order or interdependence of the functions performed by these devices, modules, or units.
[0015] Furthermore, the modifications “one” and “more” as used in this disclosure are illustrative and not restrictive, and should be understood as “one or more” by those skilled in the art unless otherwise specified in the context.
[0016] The names of messages or information exchanged between multiple devices in embodiments of this disclosure are for illustrative purposes only and do not limit the scope of such messages or information.
[0017] Before using the embodiments disclosed in each example of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information related to the present disclosure must be notified to the user in an appropriate manner based on relevant laws and regulations, and the user's authorization must be obtained.
[0018] For example, in response to receiving a voluntary request from a user, the operation of sending presentation information to the user, explicitly presenting it to the user, and requesting its execution requires obtaining and using the user's personal information. Thereby, the user can choose by himself whether to provide personal information to software or hardware such as an electronic device, an application, a server, or a storage medium that executes the operations of the embodiments of the present disclosure based on the presentation information.
[0019] As a selectable but non-limiting embodiment, the method of sending presentation information to the user in response to receiving a voluntary request from the user may be, for example, in the form of a pop-up window, and the presentation information may be displayed in text in the pop-up window. Further, the pop-up window may further incorporate a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.
[0020] As can be understood, the above-mentioned notification and user authentication process are merely exemplary and do not limit the embodiments of the present disclosure. Other forms that meet the relevant laws and regulations are also applicable to the embodiments of the present disclosure.
[0021] As can be understood, the data according to this embodiment (including but not limited to the data itself, the acquisition or use of the data) should comply with the requirements of the corresponding laws and regulations and related regulations.
[0022] FIG. 1 is a flowchart of a media content display method according to an embodiment of the present disclosure. The embodiments of the present disclosure are applicable to the case of media content display. The method may be executed by a media content display device. The device may be implemented in the form of software and / or hardware, and optionally, may be implemented by an electronic device. The electronic device may be a mobile terminal such as a mobile phone, a smart watch, a tablet computer, and a personal digital assistant, or may be a device such as a personal computer (PC) terminal or a server.
[0023] As shown in FIG. 1, in one possible embodiment, the method includes the following steps on the first user side.
[0024] Step 101, original pixel materials are obtained on a media content generation page, and the media content generation page is for generating the target media content, and the target media content is to be sent to a second user or distributed as a work of the first user.
[0025] In the embodiments of the present disclosure, the original pixel materials can be determined based on user operations. The user operation may be, for example, a shooting operation or a material selection operation. The original pixel materials may include at least one original image and / or at least one original video. Correspondingly, the following target pixel materials may also include at least one target image and / or at least one target video.
[0026] Optionally, the media content generation page may also be a shooting page. For example, a user can trigger a shooting operation on the shooting page, acquire an image or video using an image acquisition device such as a camera on an electronic device, and obtain the corresponding original image material. The media content generation page may also be a material selection page. For example, a user can input a material selection operation on the material selection page and use the selected image and / or video as the original image material. The selectable materials displayed on the material selection page may, for example, be from draft media content on the electronic device's local storage or application. Optionally, if the media content generation page is a shooting page, a jump from the shooting page to the material selection page may be possible.
[0027] For example, the first user can be considered as a user currently using an electronic device. The second user may be any user different from the first user. The first user can operate the electronic device to trigger and generate target media content and send the generated target media content to the second user. The transmission method is not limited; for example, the generated target media content could be sent to the second user who subscribes to instant messaging using an instant messaging window, and the first user could distribute it as a media work created by the first user.
[0028] Step 102, when the target function is turned on, preview media content for the first mode is displayed, which includes a target image and target text to be displayed at the target location, wherein the target image is determined based on the original image, and the target text includes text that satisfies the preset matching degree conditions, which is determined based on the target image, and the preview media content for the first mode is for generating the target media content.
[0029] For example, a targeting function can be added. This function can automatically match text to image materials. The targeting function can be turned on or off based on system settings or user-defined settings.
[0030] For example, after an original image is acquired, a target image can be determined based on the original image. The target image is understood as an image included in the preview media content. The target image may be the original image itself, or it may be an image obtained by performing preset processing on the original image. Preset processing may include, for example, resizing, color adjustment, cropping, cutting, or processing the original image with stylization special effects, sticker materials, etc. To make it understandable, after the user turns on the target function, the original image can be automatically processed as a target image, and the corresponding target text can be added.
[0031] For example, preview media content in the first mode is understood to include preview media content to which text is automatically added based on the target image. When the targeting function is turned on, text that satisfies the target image and preset matching criteria is automatically determined. The text may include letters and / or symbols. Symbols may include punctuation and emojis, etc. The preset matching criteria can be determined based on the similarity between the image content and the text content. For example, based on the target image, text that satisfies the target image and preset matching criteria can be selected from a preset text library, or the image content of the target image can be identified and text that satisfies the image content and preset matching criteria can be generated. To understand this, the identification of the image content of the target image is triggered by the user with full user approval.
[0032] Optionally, when determining the degree of matching, the determination may be based on all or part of the target image material. For example, if there are multiple target images, the text that satisfies the preset matching degree conditions for the first target image may be automatically determined, or, for example, if there are multiple target images, the text that satisfies the preset matching degree conditions for each target image may be automatically determined. Correspondingly, when preview media content in the first mode is displayed, sequential display of different target images is supported, and when each target image is displayed, the target text corresponding to the current target image may be displayed at the target position corresponding to the current target image. Also, for example, if the target image material includes at least one target video, the target text includes preset text that satisfies the preset video frame and preset matching degree conditions in the at least one target video, which are automatically determined. The preset video frame may be a fixed-number video frame, such as the first video frame or the last video frame, or it may be a dynamically determined frame, such as an intermediate video frame or the first video frame appearing in the identified target object. The target object may be a preset entity, such as a preset product.
[0033] For example, after the target text is determined, preview media content for the first mode is displayed. For example, the target image is displayed, and the target text is displayed at the target position. The target position may be, for example, the center of the bottom of the screen where the target image is displayed. The target position may be predetermined, or it may be dynamically determined based on the image content of the target image and / or the text content of the target text.
[0034] For example, Figure 2 is a schematic diagram of an interface according to an embodiment of the present disclosure. If the original image material includes a sheep image, the target image material is the original image material itself, and the automatically determined text is "a cute smiling lamb", then the preview media content of the first mode, i.e., the target image material 201 including the sheep image, can be displayed, and furthermore, the target text 202 can be displayed at the target position.
[0035] In the media content display method according to the embodiment of this disclosure, original image materials are acquired on the media content generation page. The media content generation page is for generating target media content to be sent to a second user or distributed as the work of the first user. When the target function is turned on, preview media content in the first mode is displayed. The preview media content in the first mode includes target image materials and target text to be displayed at the target position. The target image materials are determined based on the original image materials, and the target text includes text that satisfies preset matching degree conditions, which are determined based on the target image materials. The preview media content in the first mode is for generating target media content. By using the above embodiment, after the original image materials are acquired, target text that satisfies a certain degree of matching is automatically matched to the target image materials determined based on the original image materials, and the target image materials and target text are included in the displayed preview media content to generate target media content, thereby reducing the associated operations of manually entering text by the user and improving the convenience of media content creation.
[0036] In some embodiments, after the preview media content of the first mode is displayed, the process further includes a step of generating target media content based on the preview media content of the first mode in response to a preset generation operation. This helps the user easily generate the target media content and allows the user to know in advance the effect after automatically adding text by checking the preview media content of the first mode.
[0037] Optionally, a preview generation control may be displayed. After the user triggers this preview generation control, the target media content can be generated. In one example, after the target media content is generated, the user can also trigger the distribution of the target media content. Optionally, the preview generation control may be a media content distribution control. After the user triggers this media content distribution control, the target media content can be generated and distributed.
[0038] In some embodiments, after the preview media content in the first mode is displayed, the further step includes updating the target text in the preview media content in the first mode to text corresponding to the editing result of the editing operation in response to an editing operation on the target text. This allows the user to edit the target text and meet the user's actual text placement needs.
[0039] Optionally, the editing operation includes at least one of the following: modifying the text content, adjusting the text display position, and adjusting the text display style. The text display pattern may include, for example, font, size, or color.
[0040] Optionally, users can trigger target text using preset trigger actions such as clicks, enter editing mode for the target text, and then input further editing operations.
[0041] In some embodiments, after the preview media content of the first mode is displayed, the further step includes updating the target text in the preview media content of the first mode to text that satisfies a preset matching degree, determined based on the next target image, in response to a switch operation on the target text. This allows the user to easily switch to another text that satisfies the preset matching degree by entering a switch operation if they do not like the current target text, thus better balancing the user's actual text-adding needs and the convenience of text-adding.
[0042] For example, a toggle control can be displayed at the location associated with the target text. The user can input a toggle operation by triggering the toggle control, or by inputting a gesture operation such as a slide operation on the target text, for example, a left slide operation.
[0043] In some embodiments, displaying preview media content in the first mode includes the steps of: displaying preview media content in a second mode, which includes the target image and a plurality of candidate texts; and, in response to a selection operation for the target candidate text, determining the target candidate text as the target text and displaying preview media content in the first mode. The candidate text includes text that satisfies the target image and preset matching criteria. This allows multiple texts that satisfy the target image and preset matching criteria to be displayed to the user simultaneously for selection, improving selection efficiency.
[0044] For example, multiple candidate texts are displayed simultaneously in a list or matrix format. Users can input a selection operation for a target candidate text by inputting a trigger operation such as a click. For example, the candidate text clicked by the user is determined as the target candidate text selected by the user, and the preview media content in the first mode is displayed.
[0045] In some embodiments, the target image material includes material obtained by performing a style conversion process on the original image material. This allows for first performing a style conversion on the original image material and then adding text. In other words, the preset processing described above may include a style conversion process to satisfy the diverse media content generation needs of the user.
[0046] Optionally, the original image material can be converted into an image material in the target style to obtain the target image material. The target style may be, for example, a cute style, a cartoon style, or a sketch style. The target style may be automatically determined based on the image content of the original image material, or it may be specified by the user.
[0047] In some embodiments, the generation of the target text is associated with the corresponding scene on the media content generation page. This allows the generated target text to be more closely aligned with the image and media content generation scenes.
[0048] As an option, the method of dividing scenes is not limited and may be based on the application scene that triggers the acquisition, or on the scene when entering the media content generation page. For example, the acquisition of original image materials may be triggered in the instant messenger scene, in the artwork creation scene, or in the photography equipment viewing scene.
[0049] The embodiments of this disclosure are not limited to the method by which the generation of the target text relates to a scene. Optionally, the text style of the target text may differ for different scenes. Differences in text style may be reflected in aspects such as the length of the text, the tone of the text, the tense of the text, the rhetorical devices used in the text, and whether or not emoticons are added.
[0050] In some embodiments, the target text is determined by inputting target material, which includes all or part of the target image material, into a preset model for determining the similarity between the target material and the text in each library of a preset text library, and then determining the target text from the preset text library based on the output of the preset model. This allows the model to quickly and accurately select similar text as the target text from the preset text library.
[0051] For example, the preset model may be a preset multimodal model. The multimodal model can receive various different input methods. For example, in the embodiments of this disclosure, target material and library text can be input to the preset multimodal model, and the similarity between the two can be determined. The output of the preset multimodal model may be the similarity between the target material and each library text in the preset text library, and the library text with the highest corresponding similarity is determined as the target text, or the library texts are ranked in descending order according to similarity, and the library text with the highest preset number ranking is determined as the target text.
[0052] For example, the model parameters and / or preset text library in the preset model relate to the corresponding scene on the media content generation page. This allows the preset model to output different results in different scenes, and furthermore, different target texts can be obtained. Optionally, since the text styles of the target text corresponding to different scenes are different, different model parameters and / or preset text libraries can be set for different text styles.
[0053] In some embodiments, when the targeting function is turned off, preview media content in a third mode, including the target image, is displayed. Preview media content in the third mode is understood as preview media content without automatically added text. Thus, the user has the flexibility to control whether or not automatically added text is included in the preview media content, according to the user's intent.
[0054] In some embodiments, when the target function is turned on, the display of media preview content in the first mode includes entering a media content preview page, and when the target function is turned on, the media preview content in the first mode is displayed on the media content preview page, and a switch control corresponding to the target function is displayed on the media content generation page and / or the media content preview page. By displaying the switch control for the target function on the media content generation page and / or the media content preview page, the user can flexibly control whether or not the target function is turned on and when it is turned on.
[0055] Figure 3 is a schematic flowchart of another media content display method according to an embodiment of the present disclosure. Embodiments of the present disclosure are obtained based on each of the selectable solutions in the embodiments, for example, the method is Step 301 is a step in which, in response to a trigger operation on the page entrance of the media content generation page, the media content generation page is entered and original image materials are obtained on the media content generation page, The media content generation page includes a step where the switch control is displayed.
[0056] For example, the page entrance to a media content generation page may be included in an instant messaging scene page (e.g., a chat page). The page entrance may correspond to a scene for creating media content. If the page entrance is on a different page, it may correspond to a scene for acquiring different original image assets.
[0057] Figure 4 is a schematic diagram of the interface interaction according to an embodiment of the present disclosure. As shown in Figure 4, the instant messaging scene page 401 displays the page entrance to the media content generation page, for example, "Take a Photo" 402. When the user clicks "Take a Photo" 402, they proceed to the media content generation page 403. The media content generation page 403 displays a switch control 404 that is currently on, and also displays a shooting control 405. If the framing content is a single sheep, the media content generation page 403 displays an image of a sheep. When the user clicks the shooting control 405, the captured image is obtained as the original image material.
[0058] Step 302: Enter the media content preview page and determine whether the target function is turned on. If YES, step 303 is executed; otherwise, step 307 is executed.
[0059] An example of a media content preview page 406 is shown in Figure 4.
[0060] Step 303: The media content preview page displays the media content preview in the first mode.
[0061] For example, a style conversion function switch may be provided. When this function is turned on, a style conversion process is performed on the original image material, which is a photograph of a sheep. For example, an animation style conversion is performed, and the animated sheep image is obtained as the target image material. For example, the original image material is input into a style conversion model that corresponds to an animation style to obtain an animated sheep image. The animated sheep image is input into a preset multimodal model that corresponds to an instant messaging scene, and based on the output of the preset multimodal model, multiple target texts with the highest similarity ranking are determined from the preset text library. On the second preset page, the animated sheep image and the target text with the highest similarity are displayed. As in Figure 4, "See this smiling lamb quickly, it's so cute (emoji)" 407, the target text is displayed at the bottom of the animated sheep image, in the center position. In the instant messaging scene in Figure 4, the style of the generated target text is appropriate for direct communication and sharing by the user, for example, by adding more emojis for chat to the generated text.
[0062] To simplify the explanation, if the page entrance of a media content generation page corresponds to a scene for creating media content, the model parameters and / or preset text library in the preset multimodal model used will change. For example, the target text with the highest determined similarity may be "Smiling Cute Lamb." The text style will lean more towards a description of the image than towards the target text in Figure 4.
[0063] Step 304, in response to a switch operation on the target text, the target text in the preview media content of the first mode is updated to text that meets the preset matching degree criteria, which are determined based on the target image material.
[0064] For example, if a user performs a left-slide operation (switch operation) on the currently displayed target text, the display can be switched to show the target text ranked second in similarity. This would look like "Look, it's a little lamb, isn't it cute?" 408 in Figure 4.
[0065] Step 305: In response to an editing operation on the target text, the target text in the preview media content in the first mode is updated to the text corresponding to the editing result of the editing operation.
[0066] As shown in Figure 4, if the user is not completely satisfied after switching, they can click on the current target text to enter editing mode, edit the target text to obtain the edited "Look, it's a little lamb, so cute!" 409, and after editing is complete, the user can click the "Done" button to view a preview of the updated first mode media content.
[0067] Step 306, in response to the preset generation operation, the target media content is generated based on the preview media content of the first mode.
[0068] Step 307: The media content preview page displays the media content preview in the third mode.
[0069] The preview media content in the third mode includes target image materials, such as an animated image of a sheep. If the style transformation function is turned off, the preview media content in the third mode includes a photograph of a sheep.
[0070] Step 308, in response to the preset generation operation, the target media content is generated based on the preview media content of the third mode.
[0071] Those skilled in the art can understand that the details omitted in the description of steps S301-S308 in this embodiment can be found by referring to the relevant descriptions of the corresponding steps in the embodiments of the method described above, and are therefore omitted here.
[0072] The media content display method according to the embodiment of this disclosure acquires original image materials, automatically performs a style conversion process on the original image materials to acquire target image materials, selects a corresponding preset multimodal model based on the actual acquired scene, automatically matches target text that meets a certain degree of matching to the target image materials, includes the target image materials and target text in the displayed preview media content, supports switching and personalized editing of target text, balances the user's actual text addition needs with the convenience of text addition, and can improve the convenience and efficiency of media content creation.
[0073] Figure 5 is a schematic diagram of the structure of a media content display device according to an embodiment of the present disclosure. The device includes the following modules.
[0074] The material acquisition module 501 is configured to acquire original image materials on the media content generation page. The media content generation page is for generating target media content. The target media content is to be sent to a second user or distributed as the work of the first user.
[0075] The content display module 502 is configured to display preview media content in a first mode when the target function is turned on. The preview media content in the first mode includes a target image and target text to be displayed at the target position, wherein the target image is determined based on the original image, and the target text includes text that satisfies preset matching degree conditions, which are determined based on the target image. The preview media content in the first mode is for generating the target media content.
[0076] The media content display device according to the embodiment of this disclosure, after acquiring original image material, automatically matches target text that meets a certain degree of matching to target image material determined based on the original image material, includes the target image material and target text in the displayed preview media content, generates target media content, reduces the associated operations of manually entering text by the user, and improves the convenience of creating media content.
[0077] Optionally, the device further includes a content generation module configured to generate target media content based on the preview media content of the first mode in response to a preset generation operation, after the preview media content of the first mode has been displayed.
[0078] Optionally, the device further includes an editing module configured to update the target text in the preview media content of the first mode to text corresponding to the editing result of the editing operation, in response to an editing operation on the target text after the preview media content of the first mode has been displayed.
[0079] Optionally, the device further includes a switching module configured to update the target text in the preview media content of the first mode to the next text that satisfies a preset matching degree, determined based on the target image material, in response to a switching operation on the target text after the preview media content of the first mode has been displayed.
[0080] As an option, the content display module is: A first display unit configured to display preview media content in a second mode, wherein the preview media content in the second mode includes the target image and a plurality of candidate texts, the candidate texts include texts that satisfy the preset matching degree conditions with the target image, The system includes a second display unit configured to determine the target candidate text as the target text and display preview media content in a first mode in response to a selection operation on the target candidate text.
[0081] Optionally, the target image material may include material obtained by performing a style conversion process on the original image material.
[0082] Optionally, the target image material includes at least one target image and / or at least one target video.
[0083] Optionally, if the target image material includes at least one target video, the target text includes text that satisfies the conditions of a preset video frame and preset matching degree in the at least one target video.
[0084] Optionally, the generation of the target text is related to the corresponding scene on the media content generation page.
[0085] Optionally, the text style of the target text may differ depending on the scene.
[0086] Optionally, the target text is determined as follows: The target material is input into a preset model. The target material includes all or part of the target image material, and the preset model is used to determine the similarity between the target material and the text within each library in the preset text library. Based on the output of the preset model, the target text is determined from the preset text library.
[0087] Optionally, the model parameters and / or the preset text library in the preset model relate to the corresponding scene in the media content generation page.
[0088] As an option, the device, The system further includes a media content display module configured to display a preview media content in a third mode, including the target image, when the targeting function is turned off.
[0089] Optionally, the content display module may be configured to display preview media content in a first mode on the media content preview page, for example, when entering the media content preview page and the target function is turned on. Here, the media content generation page and / or the media content preview page display a switch control corresponding to the target function.
[0090] The media content display device according to the embodiment of this disclosure can perform a media content display method according to any embodiment of this disclosure and has a functional module and beneficial effects corresponding to the execution method.
[0091] Furthermore, the units and modules included in the apparatus are merely categorized according to functional logic and are not limited to such categories; they only need to be able to realize the corresponding functions. Also, the specific names of each functional unit are merely for distinguishing them from one another and do not limit the scope of protection of the embodiments of this disclosure.
[0092] Figure 6 is a schematic diagram of the structure of an electronic device according to an embodiment of the present disclosure. Next, we refer to Figure 6, which shows a schematic diagram of the structure of an electronic device (for example, a terminal device or server in Figure 6) 600 applied to the realization of an embodiment of the present disclosure. Terminal devices in the embodiment of the present disclosure include, but are not limited to, mobile devices such as mobile phones, notebook computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), and in-vehicle terminals (for example, car navigation terminals), as well as fixed terminals such as digital TVs and desktop computers. The electronic device shown in Figure 6 is merely an example and does not limit the functions and scope of use of the embodiment of the present disclosure.
[0093] As shown in Figure 6, the electronic device 600 may include a processing unit (e.g., a central processing unit, a graphics processor, etc.) 601 capable of performing various appropriate operations and processes based on a program stored in a read-only memory (ROM) 602 or a program loaded from a storage device 608 into a random access memory (RAM) 603. The RAM 603 also stores various programs and data necessary for the operation of the electronic device 600. The processing unit 601, the processing unit ROM 602, and the RAM 603 are connected to each other via a bus 604. The bus 604 is further connected to an edit / output (I / O) interface 605.
[0094] Generally, the following devices can be connected to the I / O interface 605 and include input devices 606, such as touchscreens, touchpads, keyboards, mice, cameras, microphones, accelerometers, and gyroscopes; output devices 607, such as liquid crystal displays (LCDs), speakers, and vibrators; storage devices 608, such as magnetic tape and hard disks; and communication devices 609. The communication device 609 can allow the electronic device 600 to communicate with other devices wirelessly or via wire to exchange data. Figure 6 shows the electronic device 600 with various devices, but it should be understood that it is not necessary to implement or include all the devices shown. More or fewer devices may be implemented instead.
[0095] In particular, according to embodiments of the present disclosure, the process described with reference to the flowchart above may be implemented as a computer software program. For example, embodiments of the present disclosure include a computer program product which includes a computer program placed on a non-temporary computer-readable medium, the computer program which includes program code for performing the method shown in the flowchart. In such embodiments, the computer program may be downloaded and installed from a network via a communication device 609, or installed from a storage device 608, or installed from a ROM 602. When the computer program is executed by the processing device 601, the functions limited to the method of embodiments of the present disclosure are performed.
[0096] The names of messages or information exchanged between multiple devices in embodiments of this disclosure are for illustrative purposes only and do not limit the scope of such messages or information.
[0097] The electronic device according to the embodiment of this disclosure belongs to the same inventive concept as the media content display method according to the above embodiment, and for technical details not described in detail in this embodiment, refer to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.
[0098] The embodiments of this disclosure provide a computer storage medium in which a computer program is stored, and when the program is executed by a processor, the media content display method according to the embodiments is realized.
[0099] The computer-readable medium in this disclosure may be a computer-readable signal medium, a computer-readable storage medium, or any combination of both. The computer-readable storage medium may be, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage mediums include, but are not limited to, electrical connections having one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof. In this disclosure, the computer-readable storage medium may be any tangible medium containing or storing a program, the program may be used by or in combination with an instruction execution system, apparatus, or device. In this disclosure, the computer-readable signal medium may include data signals propagated as part of a baseband or carrier wave, and carry computer-readable program code. Such transmitted data signals may include, but are not limited to, electromagnetic signals, optical signals, or any suitable combination thereof, and may employ a variety of other forms. The computer-readable signal medium may be any computer-readable medium other than a computer-readable storage medium. The computer-readable signal medium may transmit, transmit, or transmit programs used by or in combination with instruction execution systems, apparatus, or devices. The program code contained in the computer-readable medium may be transmitted by, but are not limited to, electric wires, optical cables, RF (radio frequency), and any other suitable medium.
[0100] In some embodiments, client terminals and servers can communicate using any currently known or future-developed network protocol, such as HTTP (Hypertext Transfer Protocol), and can interconnect with digital data communications (e.g., communication networks) in any form or medium. Examples of communication networks include local area networks ("LANs"), wide area networks ("WANs"), the Internet (e.g., the Internet), end-to-end networks (e.g., ad-hoc end-to-end networks), and any currently known or future-developed networks.
[0101] The computer-readable medium may be included in the electronic device, or it may exist independently without being attached to the electronic device.
[0102] The computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the electronic device is instructed to perform the following steps: original image data is obtained on a media content generation page, the media content generation page is used to generate target media content; the target media content is to be transmitted to a second user or distributed as the work of a first user; and, when the target function is turned on, the electronic device is instructed to display a preview media content in a first mode that includes target image data and target text to be displayed at the target location, wherein the target image data includes text that satisfies preset matching criteria, determined based on the original image data, and the target text is determined based on the target image data, and the preview media content in the first mode is for generating the target media content.
[0103] Computer program code for performing the operations of the Disclosure is written in one or more program design languages and / or combinations thereof. The program design languages include, but are not limited to, object-oriented program design languages such as Java, Smalltalk, and C++, and further include conventional procedural program design languages such as C and similar languages. The program code may run entirely on a user computer, partially on a user computer, as a standalone software package, partially on a user computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user computer via any type of network, including a local area network (LAN) or wide area network (WAN), or it may be connected to an external computer (for example, via the Internet using an Internet service provider).
[0104] The flowcharts and block diagrams in the drawings illustrate the implementable architectures, functions, and operations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in a flowchart or block diagram may represent a module, block, or part of code. The module, block, or part of code includes one or more executable instructions for implementing a given logical function. In some alternative implementations, the functions attached to a block may occur in a different order than those attached to the drawings. For example, two consecutively represented blocks may be executed substantially in parallel, or in some cases, in reverse order. Furthermore, each block in a block diagram and / or flowchart, and combinations of blocks in a block diagram and / or flowchart, may be implemented by a system based on dedicated hardware for performing a given function or operation, or by a combination of dedicated hardware and computer instructions.
[0105] The units described in the embodiments of this disclosure may be implemented by software or by hardware. Herein, the names of the modules are not limited in any case to the unit itself. For example, the material acquisition module may be described as "a module that acquires original image materials on a media content generation page, wherein the media content generation page is for generating target media content, and the target media content is transmitted to a second user or distributed as the work of a first user."
[0106] At least some of the functions described herein may be performed by one or more hardware logic components. For example, non-limiting exemplary types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standards (ASSPs), systems-on-a-chip (SOCs), and composite programmable logic devices (CPLDs).
[0107] In the context of this disclosure, a machine-readable medium may be a tangible medium that contains or can store a program for the use of an instruction execution system, apparatus, or device, or for the use of an instruction execution system, apparatus, or device in combination with such a program. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination thereof. More specific examples of machine-readable storage media include one or more wire-based electrical connections, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.
[0108] One or more embodiments of this disclosure provide a method for displaying media content. The method includes the step of obtaining original image materials on a media content generation page on the first user's side, wherein the media content generation page is for generating target media content, and the target media content is sent to a second user or distributed as the first user's work. The steps include: in response to the target function being turned on, preview media content of a first mode is displayed, wherein the preview media content of the first mode includes a target image and target text to be displayed at a target position, the target image is determined based on the original image, the target text includes text that satisfies preset matching degree conditions determined based on the target image, and the preview media content of the first mode is for generating the target media content.
[0109] According to one or more embodiments of this disclosure, after the media preview content of the first mode is displayed, The process includes the step of generating target media content based on preview media content of the first mode in response to a preset generation operation.
[0110] According to one or more embodiments of this disclosure, after the media preview content of the first mode is displayed, The further step includes updating the target text in the preview media content of the first mode to text corresponding to the editing result of the editing operation, in response to an editing operation on the target text.
[0111] According to one or more embodiments of this disclosure, after the media preview content of the first mode is displayed, The process includes, in response to a switching operation on the target text, updating the target text in the preview media content of the first mode to text that satisfies the preset matching degree conditions, which are determined based on the next target image material.
[0112] According to one or more embodiments of the present disclosure, the step of displaying the preview media content in the first mode is: A step in which preview media content of a second mode is displayed, wherein the preview media content of the second mode includes the target image material and a plurality of candidate texts, the candidate texts include texts that satisfy the preset matching degree conditions with the target image material, The process includes the step of determining the target text as the target text in response to a selection operation on the target candidate text, and displaying preview media content in a first mode.
[0113] According to one or more embodiments of the present disclosure, the target image material includes material obtained by performing a style conversion process on the original image material.
[0114] According to one or more embodiments of the present disclosure, the target image material includes at least one target image and / or at least one target video.
[0115] According to one or more embodiments of the present disclosure, if the target image material includes at least one target video, the target text includes text that satisfies the conditions of a preset video frame and preset matching degree in the at least one target video.
[0116] According to one or more embodiments of the present disclosure, the generation of the target text is related to the corresponding scene on the media content generation page.
[0117] According to one embodiment of the present disclosure, the text style of the target text corresponding to different scenes is different.
[0118] According to one or more embodiments of this disclosure, the target text is: The steps include inputting target material into a preset model, wherein the target material includes all or part of the target image material, and the preset model is for determining the similarity between the target material and the text within each library in the preset text library; The process is determined by the steps of determining the target text from the preset text library based on the output of the preset model.
[0119] According to one or more embodiments of this disclosure, the model parameters and / or the preset text library in the preset model relate to the corresponding scenes in the media content generation page.
[0120] According to one embodiment of this disclosure, when the target function is turned on, displaying preview media content in a first mode is possible. When the media content preview page is accessed and the target function is turned on, the media content preview page displays preview media content in a first mode, and the media content generation page and / or the media content preview page displays a switch control corresponding to the target function.
[0121] One or more embodiments of this disclosure provide a media content display device. The media content display device is A media content generation page includes a material acquisition module configured to acquire original image materials, wherein the media content generation page is for generating target media content, and the target media content is to be sent to a second user or distributed as the work of a first user. A content display module configured to display preview media content in a first mode in response to the target function being turned on, wherein the preview media content in the first mode includes a target image and target text to be displayed at a target position, the target image being determined based on the original image, and the target text including text that satisfies preset matching degree conditions, determined based on the target image, and the preview media content in the first mode is for generating the target media content.
[0122] One or more embodiments of the present disclosure provide an electronic device. The electronic device comprises one or more processors and a storage device configured to store one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors are made to execute a media content display method according to an embodiment of the present disclosure.
[0123] One or more embodiments of the present disclosure provide a storage medium containing computer-executable instructions. When the computer-executable instructions are executed by the processor, a media content display method according to an embodiment of the present disclosure is executed on the storage medium containing the computer-executable instructions.
[0124] The above description is merely a description of preferred embodiments and applicable technical principles of the present disclosure. Those skilled in the art should understand that the scope of the disclosure is not limited to embodiments of specific combinations of the aforementioned technical features, but also includes other embodiments formed by any combination of the aforementioned technical features or their equivalents, without departing from the spirit of the disclosure. For example, the aforementioned features may be replaced by similar functional technical features disclosed in the present disclosure in the form of technical embodiments.
[0125] Furthermore, although each operation is described in a specific order, it should not be understood that these operations must be performed in the specific order or sequence illustrated. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although the foregoing discussion includes some specific implementation details, these should not be construed as limiting the scope of this disclosure. In the context of a single embodiment, some of the features described can be implemented in combination in a single embodiment. Conversely, in the context of a single embodiment, various features described can be implemented individually or in any suitable subcombination in multiple embodiments.
[0126] Although the present invention is described using language specified by structural features and / or methods and logical operations, it should be understood that the subject matter limited by the appended claims is not necessarily limited to the aforementioned specific features or operations. Conversely, the aforementioned specific features and operations are merely exemplary forms of realizing the claims.
Claims
1. A method for displaying media content, wherein on the first user side, A step in which original image materials are acquired on a media content generation page, the media content generation page is for generating target media content, and the target media content is to be sent to a second user or distributed as the work of the first user, A media content display method comprising the steps of: displaying preview media content in a first mode in response to the target function being turned on, wherein the preview media content in the first mode includes a target image and target text to be displayed at a target position, the target image is determined based on the original image, the target text includes text that satisfies preset matching degree conditions determined based on the target image, and the preview media content in the first mode is for generating the target media content.
2. After the media preview content in the first mode is displayed, The aforementioned method, The method according to claim 1, comprising the step of generating target media content based on preview media content of the first mode in response to a preset generation operation.
3. After the media preview content in the first mode is displayed, The aforementioned method, The method according to claim 1 or 2, further comprising the step of updating the target text in the preview media content of the first mode to text corresponding to the editing result of the editing operation, in response to an editing operation on the target text.
4. After the media preview content in the first mode is displayed, The aforementioned method, The method according to any one of claims 1 to 3, comprising the step of updating the target text in the preview media content of the first mode to text that satisfies the following preset matching degree conditions, determined based on the target image material, in response to a switching operation on the target text.
5. The preview media content of the first mode is displayed as follows: A step in which preview media content of a second mode is displayed, wherein the preview media content of the second mode includes the target image material and a plurality of candidate texts, the candidate texts include texts that satisfy the preset matching degree conditions with the target image material, The method according to any one of claims 1-4, comprising the steps of determining the target candidate text as the target text in response to a selection operation for the target candidate text, and displaying preview media content in a first mode.
6. The method according to any one of claims 1 to 5, wherein the target image material includes material obtained by performing a style conversion process on the original image material.
7. The method according to any one of claims 1 to 6, wherein the target image material includes at least one target image and / or at least one target video.
8. The method according to claim 7, wherein the target image material includes at least one target video, and the target text includes text that satisfies the conditions of a preset video frame and preset matching degree in the at least one target video.
9. The method according to any one of claims 1 to 8, relating to the corresponding scene of the media content generation page, wherein the generation of the target text is as described above.
10. The method according to claim 9, wherein the text style of the target text corresponding to different scenes is different.
11. The aforementioned target text is, The steps include inputting target material into a preset model, wherein the target material includes all or part of the target image material, and the preset model is for determining the similarity between the target material and the text within each library in the preset text library; The method according to claim 1, comprising the steps of determining a target text from the preset text library based on the output of the preset model.
12. The method according to claim 11, wherein the model parameters in the preset model and / or the preset text library relate to the corresponding scenes of the media content generation page.
13. The method according to claim 7, wherein the target image material includes a plurality of target images, and the target text is determined based on text that satisfies the preset matching degree conditions for the first target image among the plurality of target images, or each of the target images is determined based on text that satisfies the preset matching degree conditions for each of the plurality of target images.
14. The aforementioned target image material includes multiple target images, and the multiple target texts are arranged to correspond to each of the multiple target images, and in response to the target function being turned on, the preview media content of the first mode is displayed. The method according to claim 7, further comprising the steps of sequentially displaying the plurality of target images, and when each target image is displayed, displaying the target text corresponding to the current target image at the target position corresponding to the current target image.
15. In response to the aforementioned target function being turned on, the preview media content of the first mode is displayed. The method according to any one of claims 1 to 14, comprising the steps of entering a media content preview page and, in response to the target function being turned on, displaying preview media content in a first mode on the media content preview page, wherein the media content generation page and / or the media content preview page display a switch control corresponding to the target function.
16. The method according to claim 1, wherein, in response to the target function being turned off, preview media content of a third mode is displayed, and the preview media content of the third mode includes the target image material but does not include the target text.
17. A media content display device located on the first user side, A media content generation page includes a material acquisition module configured to acquire original image materials, wherein the media content generation page is for generating target media content, and the target media content is transmitted to a second user or distributed as the work of a first user. A media content display device comprising: a content display module configured to display preview media content in a first mode in response to the target function being turned on, wherein the preview media content in the first mode includes a target image and target text to be displayed at a target position, the target image is determined based on the original image, the target text includes text that satisfies preset matching degree conditions determined based on the target image, and the preview media content in the first mode is for generating the target media content.
18. The apparatus according to claim 17, comprising a module configured to perform the method described in any one of claims 2 to 16.
19. It is an electronic device, One or more processors, It comprises a storage device configured to store one or more programs, When the one or more programs are executed by the one or more processors, an electronic device that causes the one or more processors to execute the media content display method according to any one of claims 1 to 16.
20. A storage medium containing computer-executable instructions, A storage medium on which the media content display method according to any one of claims 1-16 is executed when the computer-executable instruction is executed on the processor.